Oct 23 21:28:52 user nova-compute[74337]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=74337) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=74337) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=74337) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 23 21:28:52 user nova-compute[74337]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.030s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:28:52 user nova-compute[74337]: INFO nova.virt.driver [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] Loading compute driver 'libvirt.LibvirtDriver'
Oct 23 21:28:52 user nova-compute[74337]: INFO nova.compute.provider_config [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] Acquiring lock "singleton_lock" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] Acquired lock "singleton_lock" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] Releasing lock "singleton_lock" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] Full set of CONF: {{(pid=74337) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] ******************************************************************************** {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] Configuration options gathered from: {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] ================================================================================ {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] allow_resize_to_same_host      = True {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] arq_binding_timeout            = 300 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] backdoor_port                  = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] backdoor_socket                = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] block_device_allocate_retries  = 300 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] block_device_allocate_retries_interval = 5 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] cert                           = self.pem {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] compute_monitors               = [] {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] config_dir                     = [] {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] config_drive_format            = iso9660 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] config_source                  = [] {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] console_host                   = user {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] control_exchange               = nova {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] cpu_allocation_ratio           = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] daemon                         = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] debug                          = True {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] default_access_ip_network_name = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] default_availability_zone      = nova {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] default_ephemeral_format       = ext4 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] default_green_pool_size        = 1000 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] default_schedule_zone          = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] disk_allocation_ratio          = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] enable_new_services            = True {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] enabled_apis                   = ['osapi_compute'] {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] enabled_ssl_apis               = [] {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] flat_injected                  = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] force_config_drive             = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] force_raw_images               = True {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] graceful_shutdown_timeout      = 5 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] heal_instance_info_cache_interval = 60 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] host                           = user {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] initial_disk_allocation_ratio  = 1.0 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] initial_ram_allocation_ratio   = 1.0 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] instance_build_timeout         = 0 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] instance_delete_interval       = 300 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] instance_format                = [instance: %(uuid)s]  {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] instance_name_template         = instance-%08x {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] instance_usage_audit           = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] instance_usage_audit_period    = month {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] internal_service_availability_zone = internal {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] key                            = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] live_migration_retry_count     = 30 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] log_config_append              = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] log_dir                        = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] log_file                       = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] log_options                    = True {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] log_rotate_interval            = 1 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] log_rotate_interval_type       = days {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] log_rotation_type              = none {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] long_rpc_timeout               = 1800 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] max_concurrent_builds          = 10 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] max_concurrent_live_migrations = 1 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] max_concurrent_snapshots       = 5 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] max_local_block_devices        = 3 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] max_logfile_count              = 30 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] max_logfile_size_mb            = 200 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] maximum_instance_delete_attempts = 5 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] metadata_listen                = 0.0.0.0 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] metadata_listen_port           = 8775 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] metadata_workers               = 3 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] migrate_max_retries            = -1 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] mkisofs_cmd                    = genisoimage {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] my_block_storage_ip            = 10.0.0.210 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] my_ip                          = 10.0.0.210 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] network_allocate_retries       = 0 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] osapi_compute_listen           = 0.0.0.0 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] osapi_compute_listen_port      = 8774 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] osapi_compute_unique_server_name_scope =  {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] osapi_compute_workers          = 3 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] password_length                = 12 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] periodic_enable                = True {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] periodic_fuzzy_delay           = 60 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] pointer_model                  = ps2mouse {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] preallocate_images             = none {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] publish_errors                 = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] pybasedir                      = /opt/stack/nova {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] ram_allocation_ratio           = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] rate_limit_burst               = 0 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] rate_limit_except_level        = CRITICAL {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] rate_limit_interval            = 0 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] reboot_timeout                 = 0 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] reclaim_instance_interval      = 0 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] record                         = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] reimage_timeout_per_gb         = 60 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] report_interval                = 120 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] rescue_timeout                 = 0 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] reserved_host_cpus             = 0 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] reserved_host_disk_mb          = 0 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] reserved_host_memory_mb        = 512 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] reserved_huge_pages            = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] resize_confirm_window          = 0 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] resize_fs_using_block_device   = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] resume_guests_state_on_host_boot = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] rpc_response_timeout           = 60 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] run_external_periodic_tasks    = True {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] running_deleted_instance_action = reap {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] running_deleted_instance_poll_interval = 1800 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] running_deleted_instance_timeout = 0 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] scheduler_instance_sync_interval = 120 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] service_down_time              = 720 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] servicegroup_driver            = db {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] shelved_offload_time           = 0 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] shelved_poll_interval          = 3600 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] shutdown_timeout               = 0 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] source_is_ipv6                 = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] ssl_only                       = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] state_path                     = /opt/stack/data/nova {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] sync_power_state_interval      = 600 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] sync_power_state_pool_size     = 1000 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] syslog_log_facility            = LOG_USER {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] tempdir                        = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] timeout_nbd                    = 10 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] transport_url                  = **** {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] update_resources_interval      = 0 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] use_cow_images                 = True {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] use_eventlog                   = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] use_journal                    = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] use_json                       = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] use_rootwrap_daemon            = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] use_stderr                     = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] use_syslog                     = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] vcpu_pin_set                   = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] vif_plugging_is_fatal          = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] vif_plugging_timeout           = 0 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] virt_mkfs                      = [] {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] volume_usage_poll_interval     = 0 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] watch_log_file                 = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] web                            = /usr/share/spice-html5 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] oslo_concurrency.disable_process_locking = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] api.auth_strategy              = keystone {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] api.compute_link_prefix        = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] api.dhcp_domain                = novalocal {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] api.enable_instance_password   = True {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] api.glance_link_prefix         = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] api.instance_list_cells_batch_strategy = distributed {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] api.instance_list_per_project_cells = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] api.list_records_by_skipping_down_cells = True {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] api.local_metadata_per_cell    = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] api.max_limit                  = 1000 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] api.metadata_cache_expiration  = 15 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] api.neutron_default_tenant_id  = default {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] api.use_forwarded_for          = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] api.use_neutron_default_nets   = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] api.vendordata_dynamic_failure_fatal = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] api.vendordata_dynamic_targets = [] {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] api.vendordata_jsonfile_path   = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] cache.backend                  = dogpile.cache.memcached {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] cache.backend_argument         = **** {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] cache.config_prefix            = cache.oslo {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] cache.dead_timeout             = 60.0 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] cache.debug_cache_backend      = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] cache.enable_retry_client      = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] cache.enable_socket_keepalive  = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] cache.enabled                  = True {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] cache.expiration_time          = 600 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] cache.hashclient_retry_attempts = 2 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] cache.hashclient_retry_delay   = 1.0 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] cache.memcache_dead_retry      = 300 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] cache.memcache_password        =  {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] cache.memcache_pool_maxsize    = 10 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] cache.memcache_pool_unused_timeout = 60 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] cache.memcache_sasl_enabled    = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] cache.memcache_socket_timeout  = 1.0 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] cache.memcache_username        =  {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] cache.proxies                  = [] {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] cache.retry_attempts           = 2 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] cache.retry_delay              = 0.0 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] cache.socket_keepalive_count   = 1 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] cache.socket_keepalive_idle    = 1 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] cache.socket_keepalive_interval = 1 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] cache.tls_allowed_ciphers      = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] cache.tls_cafile               = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] cache.tls_certfile             = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] cache.tls_enabled              = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] cache.tls_keyfile              = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] cinder.auth_section            = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] cinder.auth_type               = password {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] cinder.cafile                  = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] cinder.catalog_info            = volumev3::publicURL {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] cinder.certfile                = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] cinder.collect_timing          = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] cinder.cross_az_attach         = True {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] cinder.debug                   = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] cinder.endpoint_template       = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] cinder.http_retries            = 3 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] cinder.insecure                = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] cinder.keyfile                 = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] cinder.os_region_name          = RegionOne {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] cinder.split_loggers           = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] cinder.timeout                 = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] compute.cpu_dedicated_set      = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] compute.cpu_shared_set         = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] compute.image_type_exclude_list = [] {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] compute.live_migration_wait_for_vif_plug = True {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] compute.max_concurrent_disk_ops = 0 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] compute.max_disk_devices_to_attach = -1 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] compute.resource_provider_association_refresh = 300 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] compute.shutdown_retry_interval = 10 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] conductor.workers              = 3 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] console.allowed_origins        = [] {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] console.ssl_ciphers            = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] console.ssl_minimum_version    = default {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] consoleauth.token_ttl          = 600 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] cyborg.cafile                  = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] cyborg.certfile                = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] cyborg.collect_timing          = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] cyborg.connect_retries         = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] cyborg.connect_retry_delay     = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] cyborg.endpoint_override       = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] cyborg.insecure                = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] cyborg.keyfile                 = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] cyborg.max_version             = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] cyborg.min_version             = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] cyborg.region_name             = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] cyborg.service_name            = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] cyborg.service_type            = accelerator {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] cyborg.split_loggers           = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] cyborg.status_code_retries     = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] cyborg.status_code_retry_delay = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] cyborg.timeout                 = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] cyborg.version                 = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] database.backend               = sqlalchemy {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] database.connection            = **** {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] database.connection_debug      = 0 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] database.connection_parameters =  {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] database.connection_recycle_time = 3600 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] database.connection_trace      = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] database.db_inc_retry_interval = True {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] database.db_max_retries        = 20 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] database.db_max_retry_interval = 10 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] database.db_retry_interval     = 1 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] database.max_overflow          = 50 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] database.max_pool_size         = 5 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] database.max_retries           = 10 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] database.mysql_wsrep_sync_wait = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] database.pool_timeout          = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] database.retry_interval        = 10 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] database.slave_connection      = **** {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] database.sqlite_synchronous    = True {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] api_database.backend           = sqlalchemy {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] api_database.connection        = **** {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] api_database.connection_debug  = 0 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] api_database.connection_parameters =  {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] api_database.connection_recycle_time = 3600 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] api_database.connection_trace  = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] api_database.db_inc_retry_interval = True {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] api_database.db_max_retries    = 20 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] api_database.db_max_retry_interval = 10 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] api_database.db_retry_interval = 1 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] api_database.max_overflow      = 50 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] api_database.max_pool_size     = 5 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] api_database.max_retries       = 10 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] api_database.mysql_wsrep_sync_wait = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] api_database.pool_timeout      = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] api_database.retry_interval    = 10 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] api_database.slave_connection  = **** {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] api_database.sqlite_synchronous = True {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] devices.enabled_mdev_types     = [] {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] ephemeral_storage_encryption.enabled = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] ephemeral_storage_encryption.key_size = 512 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] glance.api_servers             = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] glance.cafile                  = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] glance.certfile                = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] glance.collect_timing          = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] glance.connect_retries         = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] glance.connect_retry_delay     = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] glance.debug                   = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] glance.default_trusted_certificate_ids = [] {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] glance.enable_certificate_validation = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] glance.enable_rbd_download     = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] glance.endpoint_override       = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] glance.insecure                = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] glance.keyfile                 = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] glance.max_version             = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] glance.min_version             = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] glance.num_retries             = 3 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] glance.rbd_ceph_conf           =  {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] glance.rbd_connect_timeout     = 5 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] glance.rbd_pool                =  {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] glance.rbd_user                =  {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] glance.region_name             = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] glance.service_name            = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] glance.service_type            = image {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] glance.split_loggers           = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] glance.status_code_retries     = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] glance.status_code_retry_delay = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] glance.timeout                 = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] glance.verify_glance_signatures = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] glance.version                 = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] guestfs.debug                  = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] hyperv.config_drive_cdrom      = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] hyperv.config_drive_inject_password = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] hyperv.enable_instance_metrics_collection = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] hyperv.enable_remotefx         = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] hyperv.instances_path_share    =  {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] hyperv.iscsi_initiator_list    = [] {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] hyperv.limit_cpu_features      = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] hyperv.power_state_check_timeframe = 60 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] hyperv.power_state_event_polling_interval = 2 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] hyperv.use_multipath_io        = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] hyperv.volume_attach_retry_count = 10 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] hyperv.volume_attach_retry_interval = 5 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] hyperv.vswitch_name            = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] mks.enabled                    = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] image_cache.manager_interval   = 2400 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] image_cache.precache_concurrency = 1 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] image_cache.remove_unused_base_images = True {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] image_cache.subdirectory_name  = _base {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] ironic.api_max_retries         = 60 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] ironic.api_retry_interval      = 2 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] ironic.auth_section            = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] ironic.auth_type               = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] ironic.cafile                  = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] ironic.certfile                = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] ironic.collect_timing          = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] ironic.conductor_group         = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] ironic.connect_retries         = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] ironic.connect_retry_delay     = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] ironic.endpoint_override       = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] ironic.insecure                = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] ironic.keyfile                 = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] ironic.max_version             = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] ironic.min_version             = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] ironic.peer_list               = [] {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] ironic.region_name             = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] ironic.serial_console_state_timeout = 10 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] ironic.service_name            = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] ironic.service_type            = baremetal {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] ironic.split_loggers           = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] ironic.status_code_retries     = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] ironic.status_code_retry_delay = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] ironic.timeout                 = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] ironic.version                 = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] key_manager.fixed_key          = **** {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] barbican.barbican_api_version  = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] barbican.barbican_endpoint     = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] barbican.barbican_endpoint_type = public {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] barbican.barbican_region_name  = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] barbican.cafile                = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] barbican.certfile              = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] barbican.collect_timing        = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] barbican.insecure              = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] barbican.keyfile               = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] barbican.number_of_retries     = 60 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] barbican.retry_delay           = 1 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] barbican.send_service_user_token = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] barbican.split_loggers         = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] barbican.timeout               = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] barbican.verify_ssl            = True {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] barbican.verify_ssl_path       = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] barbican_service_user.auth_section = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] barbican_service_user.auth_type = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] barbican_service_user.cafile   = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] barbican_service_user.certfile = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] barbican_service_user.collect_timing = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] barbican_service_user.insecure = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] barbican_service_user.keyfile  = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] barbican_service_user.split_loggers = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] barbican_service_user.timeout  = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] vault.approle_role_id          = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] vault.approle_secret_id        = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] vault.cafile                   = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] vault.certfile                 = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] vault.collect_timing           = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] vault.insecure                 = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] vault.keyfile                  = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] vault.kv_mountpoint            = secret {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] vault.kv_path                  = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] vault.kv_version               = 2 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] vault.namespace                = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] vault.root_token_id            = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] vault.split_loggers            = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] vault.ssl_ca_crt_file          = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] vault.timeout                  = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] vault.use_ssl                  = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] keystone.auth_section          = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] keystone.auth_type             = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] keystone.cafile                = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] keystone.certfile              = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] keystone.collect_timing        = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] keystone.connect_retries       = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] keystone.connect_retry_delay   = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] keystone.endpoint_override     = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] keystone.insecure              = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] keystone.keyfile               = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] keystone.max_version           = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] keystone.min_version           = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] keystone.region_name           = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] keystone.service_name          = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] keystone.service_type          = identity {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] keystone.split_loggers         = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] keystone.status_code_retries   = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] keystone.status_code_retry_delay = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] keystone.timeout               = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] keystone.version               = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] libvirt.connection_uri         =  {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] libvirt.cpu_mode               = custom {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] libvirt.cpu_model_extra_flags  = [] {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: WARNING oslo_config.cfg [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] libvirt.cpu_power_governor_high = performance {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] libvirt.cpu_power_governor_low = powersave {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] libvirt.cpu_power_management   = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] libvirt.device_detach_attempts = 8 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] libvirt.device_detach_timeout  = 20 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] libvirt.disk_cachemodes        = [] {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] libvirt.disk_prefix            = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] libvirt.enabled_perf_events    = [] {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] libvirt.file_backed_memory     = 0 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] libvirt.gid_maps               = [] {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] libvirt.hw_disk_discard        = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] libvirt.hw_machine_type        = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] libvirt.images_rbd_ceph_conf   =  {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] libvirt.images_rbd_glance_store_name =  {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] libvirt.images_rbd_pool        = rbd {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] libvirt.images_type            = default {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] libvirt.images_volume_group    = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] libvirt.inject_key             = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] libvirt.inject_partition       = -2 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] libvirt.inject_password        = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] libvirt.iscsi_iface            = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] libvirt.iser_use_multipath     = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] libvirt.live_migration_bandwidth = 0 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] libvirt.live_migration_completion_timeout = 800 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] libvirt.live_migration_downtime = 500 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] libvirt.live_migration_downtime_delay = 75 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] libvirt.live_migration_downtime_steps = 10 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] libvirt.live_migration_inbound_addr = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] libvirt.live_migration_permit_auto_converge = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] libvirt.live_migration_permit_post_copy = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] libvirt.live_migration_scheme  = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] libvirt.live_migration_timeout_action = abort {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] libvirt.live_migration_tunnelled = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: WARNING oslo_config.cfg [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Oct 23 21:28:52 user nova-compute[74337]: live_migration_uri is deprecated for removal in favor of two other options that
Oct 23 21:28:52 user nova-compute[74337]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Oct 23 21:28:52 user nova-compute[74337]: and ``live_migration_inbound_addr`` respectively.
Oct 23 21:28:52 user nova-compute[74337]: ).  Its value may be silently ignored in the future.
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] libvirt.live_migration_with_native_tls = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] libvirt.max_queues             = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] libvirt.mem_stats_period_seconds = 10 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] libvirt.nfs_mount_options      = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] libvirt.num_aoe_discover_tries = 3 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] libvirt.num_iser_scan_tries    = 5 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] libvirt.num_memory_encrypted_guests = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] libvirt.num_nvme_discover_tries = 5 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] libvirt.num_pcie_ports         = 0 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] libvirt.num_volume_scan_tries  = 5 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] libvirt.pmem_namespaces        = [] {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] libvirt.quobyte_client_cfg     = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] libvirt.rbd_connect_timeout    = 5 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] libvirt.rbd_secret_uuid        = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] libvirt.rbd_user               = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] libvirt.realtime_scheduler_priority = 1 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] libvirt.remote_filesystem_transport = ssh {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] libvirt.rescue_image_id        = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] libvirt.rescue_kernel_id       = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] libvirt.rescue_ramdisk_id      = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] libvirt.rx_queue_size          = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] libvirt.smbfs_mount_options    =  {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] libvirt.snapshot_compression   = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] libvirt.snapshot_image_format  = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] libvirt.sparse_logical_volumes = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] libvirt.swtpm_enabled          = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] libvirt.swtpm_group            = tss {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] libvirt.swtpm_user             = tss {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] libvirt.sysinfo_serial         = unique {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] libvirt.tb_cache_size          = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] libvirt.tx_queue_size          = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] libvirt.uid_maps               = [] {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] libvirt.use_virtio_for_bridges = True {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] libvirt.virt_type              = kvm {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] libvirt.volume_clear           = zero {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] libvirt.volume_clear_size      = 0 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] libvirt.volume_use_multipath   = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] libvirt.vzstorage_cache_path   = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] libvirt.vzstorage_mount_group  = qemu {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] libvirt.vzstorage_mount_opts   = [] {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] libvirt.vzstorage_mount_user   = stack {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] neutron.auth_section           = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] neutron.auth_type              = password {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] neutron.cafile                 = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] neutron.certfile               = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] neutron.collect_timing         = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] neutron.connect_retries        = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] neutron.connect_retry_delay    = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] neutron.default_floating_pool  = public {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] neutron.endpoint_override      = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] neutron.extension_sync_interval = 600 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] neutron.http_retries           = 3 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] neutron.insecure               = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] neutron.keyfile                = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] neutron.max_version            = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] neutron.metadata_proxy_shared_secret = **** {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] neutron.min_version            = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] neutron.ovs_bridge             = br-int {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] neutron.physnets               = [] {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] neutron.region_name            = RegionOne {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] neutron.service_metadata_proxy = True {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] neutron.service_name           = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] neutron.service_type           = network {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] neutron.split_loggers          = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] neutron.status_code_retries    = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] neutron.status_code_retry_delay = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] neutron.timeout                = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] neutron.version                = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] notifications.bdms_in_notifications = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] notifications.default_level    = INFO {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] notifications.notification_format = unversioned {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] notifications.notify_on_state_change = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] pci.alias                      = [] {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] pci.device_spec                = [] {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] pci.report_in_placement        = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] placement.auth_section         = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] placement.auth_type            = password {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] placement.cafile               = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] placement.certfile             = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] placement.collect_timing       = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] placement.connect_retries      = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] placement.connect_retry_delay  = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] placement.default_domain_id    = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] placement.default_domain_name  = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] placement.domain_id            = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] placement.domain_name          = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] placement.endpoint_override    = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] placement.insecure             = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] placement.keyfile              = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] placement.max_version          = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] placement.min_version          = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] placement.password             = **** {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] placement.project_domain_id    = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] placement.project_domain_name  = Default {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] placement.project_id           = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] placement.project_name         = service {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] placement.region_name          = RegionOne {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] placement.service_name         = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] placement.service_type         = placement {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] placement.split_loggers        = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] placement.status_code_retries  = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] placement.status_code_retry_delay = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] placement.system_scope         = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] placement.timeout              = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] placement.trust_id             = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] placement.user_domain_id       = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] placement.user_domain_name     = Default {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] placement.user_id              = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] placement.username             = placement {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] placement.version              = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] quota.cores                    = 20 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] quota.count_usage_from_placement = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] quota.injected_file_content_bytes = 10240 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] quota.injected_file_path_length = 255 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] quota.injected_files           = 5 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] quota.instances                = 10 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] quota.key_pairs                = 100 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] quota.metadata_items           = 128 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] quota.ram                      = 51200 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] quota.recheck_quota            = True {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] quota.server_group_members     = 10 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] quota.server_groups            = 10 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] rdp.enabled                    = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] scheduler.image_metadata_prefilter = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] scheduler.max_attempts         = 3 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] scheduler.max_placement_results = 1000 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] scheduler.query_placement_for_image_type_support = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] scheduler.workers              = 3 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] filter_scheduler.host_subset_size = 1 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] filter_scheduler.image_properties_default_architecture = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] filter_scheduler.isolated_hosts = [] {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] filter_scheduler.isolated_images = [] {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] filter_scheduler.max_instances_per_host = 50 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] filter_scheduler.pci_in_placement = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] filter_scheduler.track_instance_changes = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] metrics.required               = True {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] metrics.weight_multiplier      = 1.0 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] metrics.weight_setting         = [] {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] serial_console.enabled         = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] serial_console.port_range      = 10000:20000 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] serial_console.serialproxy_port = 6083 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] service_user.auth_section      = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] service_user.auth_type         = password {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] service_user.cafile            = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] service_user.certfile          = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] service_user.collect_timing    = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] service_user.insecure          = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] service_user.keyfile           = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] service_user.send_service_user_token = True {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] service_user.split_loggers     = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] service_user.timeout           = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] spice.agent_enabled            = True {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] spice.enabled                  = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] spice.html5proxy_port          = 6082 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] spice.image_compression        = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] spice.jpeg_compression         = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] spice.playback_compression     = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] spice.server_listen            = 127.0.0.1 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] spice.streaming_mode           = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] spice.zlib_compression         = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] upgrade_levels.baseapi         = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] upgrade_levels.cert            = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] upgrade_levels.compute         = auto {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] upgrade_levels.conductor       = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] upgrade_levels.scheduler       = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] vendordata_dynamic_auth.auth_section = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] vendordata_dynamic_auth.auth_type = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] vendordata_dynamic_auth.cafile = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] vendordata_dynamic_auth.certfile = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] vendordata_dynamic_auth.collect_timing = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] vendordata_dynamic_auth.insecure = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] vendordata_dynamic_auth.keyfile = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] vendordata_dynamic_auth.split_loggers = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] vendordata_dynamic_auth.timeout = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] vmware.api_retry_count         = 10 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] vmware.ca_file                 = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] vmware.cache_prefix            = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] vmware.cluster_name            = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] vmware.connection_pool_size    = 10 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] vmware.console_delay_seconds   = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] vmware.datastore_regex         = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] vmware.host_ip                 = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] vmware.host_password           = **** {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] vmware.host_port               = 443 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] vmware.host_username           = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] vmware.insecure                = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] vmware.integration_bridge      = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] vmware.maximum_objects         = 100 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] vmware.pbm_default_policy      = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] vmware.pbm_enabled             = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] vmware.pbm_wsdl_location       = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] vmware.serial_port_proxy_uri   = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] vmware.serial_port_service_uri = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] vmware.task_poll_interval      = 0.5 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] vmware.use_linked_clone        = True {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] vmware.vnc_keymap              = en-us {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] vmware.vnc_port                = 5900 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] vmware.vnc_port_total          = 10000 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] vnc.auth_schemes               = ['none'] {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] vnc.enabled                    = True {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] vnc.novncproxy_port            = 6080 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] vnc.server_listen              = 0.0.0.0 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] vnc.vencrypt_ca_certs          = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] vnc.vencrypt_client_cert       = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] vnc.vencrypt_client_key        = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] workarounds.disable_fallback_pcpu_query = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] workarounds.disable_group_policy_check_upcall = True {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] workarounds.disable_rootwrap   = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] workarounds.enable_numa_live_migration = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] workarounds.handle_virt_lifecycle_events = True {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] workarounds.libvirt_disable_apic = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] workarounds.never_download_image_if_on_rbd = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] wsgi.client_socket_timeout     = 900 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] wsgi.default_pool_size         = 1000 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] wsgi.keep_alive                = True {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] wsgi.max_header_line           = 16384 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] wsgi.secure_proxy_ssl_header   = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] wsgi.ssl_ca_file               = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] wsgi.ssl_cert_file             = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] wsgi.ssl_key_file              = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] wsgi.tcp_keepidle              = 600 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] zvm.ca_file                    = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] zvm.cloud_connector_url        = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] zvm.reachable_timeout          = 300 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] oslo_policy.enforce_new_defaults = True {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] oslo_policy.enforce_scope      = True {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] oslo_policy.policy_default_rule = default {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] oslo_policy.policy_file        = policy.yaml {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] profiler.connection_string     = messaging:// {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] profiler.enabled               = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] profiler.es_doc_type           = notification {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] profiler.es_scroll_size        = 10000 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] profiler.es_scroll_time        = 2m {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] profiler.filter_error_trace    = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] profiler.hmac_keys             = **** {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] profiler.sentinel_service_name = mymaster {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:52 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] profiler.socket_timeout        = 0.1 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] profiler.trace_requests        = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] profiler.trace_sqlalchemy      = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] profiler_jaeger.process_tags   = {} {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] profiler_jaeger.service_name_prefix = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] profiler_otlp.service_name_prefix = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] remote_debug.host              = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] remote_debug.port              = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] oslo_messaging_rabbit.ssl      = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] oslo_messaging_rabbit.ssl_version =  {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] oslo_messaging_notifications.retry = -1 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] oslo_messaging_notifications.transport_url = **** {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] oslo_limit.auth_section        = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] oslo_limit.auth_type           = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] oslo_limit.cafile              = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] oslo_limit.certfile            = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] oslo_limit.collect_timing      = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] oslo_limit.connect_retries     = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] oslo_limit.connect_retry_delay = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] oslo_limit.endpoint_id         = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] oslo_limit.endpoint_override   = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] oslo_limit.insecure            = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] oslo_limit.keyfile             = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] oslo_limit.max_version         = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] oslo_limit.min_version         = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] oslo_limit.region_name         = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] oslo_limit.service_name        = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] oslo_limit.service_type        = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] oslo_limit.split_loggers       = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] oslo_limit.status_code_retries = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] oslo_limit.status_code_retry_delay = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] oslo_limit.timeout             = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] oslo_limit.valid_interfaces    = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] oslo_limit.version             = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] oslo_reports.file_event_handler = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] oslo_reports.file_event_handler_interval = 1 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] oslo_reports.log_dir           = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] vif_plug_linux_bridge_privileged.group = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] vif_plug_linux_bridge_privileged.user = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] vif_plug_ovs_privileged.group  = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] vif_plug_ovs_privileged.helper_command = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] vif_plug_ovs_privileged.user   = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] os_vif_linux_bridge.flat_interface = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] os_vif_linux_bridge.vlan_interface = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] os_vif_ovs.isolate_vif         = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] os_vif_ovs.ovsdb_interface     = native {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] os_vif_ovs.per_port_bridge     = False {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] os_brick.lock_path             = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] privsep_osbrick.capabilities   = [21] {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] privsep_osbrick.group          = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] privsep_osbrick.helper_command = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] privsep_osbrick.thread_pool_size = 12 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] privsep_osbrick.user           = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] nova_sys_admin.group           = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] nova_sys_admin.helper_command  = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] nova_sys_admin.thread_pool_size = 12 {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] nova_sys_admin.user            = None {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG oslo_service.service [None req-724fd8a0-3423-453b-ba77-21077a40fb8e None None] ******************************************************************************** {{(pid=74337) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Oct 23 21:28:53 user nova-compute[74337]: INFO nova.service [-] Starting compute node (version 0.0.0)
Oct 23 21:28:53 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] Connecting to libvirt: qemu:///system {{(pid=74337) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f5ef57ca530> {{(pid=74337) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Oct 23 21:28:53 user nova-compute[74337]: libvirt:  error : internal error: could not initialize domain event timer
Oct 23 21:28:53 user nova-compute[74337]: WARNING nova.virt.libvirt.host [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Oct 23 21:28:53 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f5ef57ca530> {{(pid=74337) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] Starting native event thread {{(pid=74337) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] Starting green dispatch thread {{(pid=74337) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Oct 23 21:28:53 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] Starting connection event dispatch thread {{(pid=74337) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Oct 23 21:28:53 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] Connection event '1' reason 'None'
Oct 23 21:28:53 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Oct 23 21:28:53 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.mount [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] Initialising _HostMountState generation 0 {{(pid=74337) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Oct 23 21:29:00 user nova-compute[74337]: INFO nova.virt.libvirt.host [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] Libvirt host capabilities <capabilities>
Oct 23 21:29:00 user nova-compute[74337]:   <host>
Oct 23 21:29:00 user nova-compute[74337]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Oct 23 21:29:00 user nova-compute[74337]:     <cpu>
Oct 23 21:29:00 user nova-compute[74337]:       <arch>x86_64</arch>
Oct 23 21:29:00 user nova-compute[74337]:       <model>IvyBridge-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <vendor>Intel</vendor>
Oct 23 21:29:00 user nova-compute[74337]:       <microcode version='1070'/>
Oct 23 21:29:00 user nova-compute[74337]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Oct 23 21:29:00 user nova-compute[74337]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature name='ss'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature name='vmx'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature name='pcid'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature name='osxsave'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature name='hypervisor'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature name='arat'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature name='tsc_adjust'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature name='md-clear'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature name='stibp'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature name='arch-capabilities'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature name='ssbd'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature name='invtsc'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature name='rsba'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature name='skip-l1dfl-vmentry'/>
Oct 23 21:29:00 user nova-compute[74337]:       <pages unit='KiB' size='4'/>
Oct 23 21:29:00 user nova-compute[74337]:       <pages unit='KiB' size='2048'/>
Oct 23 21:29:00 user nova-compute[74337]:     </cpu>
Oct 23 21:29:00 user nova-compute[74337]:     <power_management>
Oct 23 21:29:00 user nova-compute[74337]:       <suspend_mem/>
Oct 23 21:29:00 user nova-compute[74337]:       <suspend_disk/>
Oct 23 21:29:00 user nova-compute[74337]:       <suspend_hybrid/>
Oct 23 21:29:00 user nova-compute[74337]:     </power_management>
Oct 23 21:29:00 user nova-compute[74337]:     <iommu support='no'/>
Oct 23 21:29:00 user nova-compute[74337]:     <migration_features>
Oct 23 21:29:00 user nova-compute[74337]:       <live/>
Oct 23 21:29:00 user nova-compute[74337]:       <uri_transports>
Oct 23 21:29:00 user nova-compute[74337]:         <uri_transport>tcp</uri_transport>
Oct 23 21:29:00 user nova-compute[74337]:         <uri_transport>rdma</uri_transport>
Oct 23 21:29:00 user nova-compute[74337]:       </uri_transports>
Oct 23 21:29:00 user nova-compute[74337]:     </migration_features>
Oct 23 21:29:00 user nova-compute[74337]:     <topology>
Oct 23 21:29:00 user nova-compute[74337]:       <cells num='2'>
Oct 23 21:29:00 user nova-compute[74337]:         <cell id='0'>
Oct 23 21:29:00 user nova-compute[74337]:           <memory unit='KiB'>8140616</memory>
Oct 23 21:29:00 user nova-compute[74337]:           <pages unit='KiB' size='4'>2035154</pages>
Oct 23 21:29:00 user nova-compute[74337]:           <pages unit='KiB' size='2048'>0</pages>
Oct 23 21:29:00 user nova-compute[74337]:           <distances>
Oct 23 21:29:00 user nova-compute[74337]:             <sibling id='0' value='10'/>
Oct 23 21:29:00 user nova-compute[74337]:             <sibling id='1' value='20'/>
Oct 23 21:29:00 user nova-compute[74337]:           </distances>
Oct 23 21:29:00 user nova-compute[74337]:           <cpus num='6'>
Oct 23 21:29:00 user nova-compute[74337]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Oct 23 21:29:00 user nova-compute[74337]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Oct 23 21:29:00 user nova-compute[74337]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Oct 23 21:29:00 user nova-compute[74337]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Oct 23 21:29:00 user nova-compute[74337]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Oct 23 21:29:00 user nova-compute[74337]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Oct 23 21:29:00 user nova-compute[74337]:           </cpus>
Oct 23 21:29:00 user nova-compute[74337]:         </cell>
Oct 23 21:29:00 user nova-compute[74337]:         <cell id='1'>
Oct 23 21:29:00 user nova-compute[74337]:           <memory unit='KiB'>8255068</memory>
Oct 23 21:29:00 user nova-compute[74337]:           <pages unit='KiB' size='4'>2063767</pages>
Oct 23 21:29:00 user nova-compute[74337]:           <pages unit='KiB' size='2048'>0</pages>
Oct 23 21:29:00 user nova-compute[74337]:           <distances>
Oct 23 21:29:00 user nova-compute[74337]:             <sibling id='0' value='20'/>
Oct 23 21:29:00 user nova-compute[74337]:             <sibling id='1' value='10'/>
Oct 23 21:29:00 user nova-compute[74337]:           </distances>
Oct 23 21:29:00 user nova-compute[74337]:           <cpus num='6'>
Oct 23 21:29:00 user nova-compute[74337]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Oct 23 21:29:00 user nova-compute[74337]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Oct 23 21:29:00 user nova-compute[74337]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Oct 23 21:29:00 user nova-compute[74337]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Oct 23 21:29:00 user nova-compute[74337]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Oct 23 21:29:00 user nova-compute[74337]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Oct 23 21:29:00 user nova-compute[74337]:           </cpus>
Oct 23 21:29:00 user nova-compute[74337]:         </cell>
Oct 23 21:29:00 user nova-compute[74337]:       </cells>
Oct 23 21:29:00 user nova-compute[74337]:     </topology>
Oct 23 21:29:00 user nova-compute[74337]:     <cache>
Oct 23 21:29:00 user nova-compute[74337]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Oct 23 21:29:00 user nova-compute[74337]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Oct 23 21:29:00 user nova-compute[74337]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Oct 23 21:29:00 user nova-compute[74337]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Oct 23 21:29:00 user nova-compute[74337]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Oct 23 21:29:00 user nova-compute[74337]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Oct 23 21:29:00 user nova-compute[74337]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Oct 23 21:29:00 user nova-compute[74337]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Oct 23 21:29:00 user nova-compute[74337]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Oct 23 21:29:00 user nova-compute[74337]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Oct 23 21:29:00 user nova-compute[74337]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Oct 23 21:29:00 user nova-compute[74337]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Oct 23 21:29:00 user nova-compute[74337]:     </cache>
Oct 23 21:29:00 user nova-compute[74337]:     <secmodel>
Oct 23 21:29:00 user nova-compute[74337]:       <model>apparmor</model>
Oct 23 21:29:00 user nova-compute[74337]:       <doi>0</doi>
Oct 23 21:29:00 user nova-compute[74337]:     </secmodel>
Oct 23 21:29:00 user nova-compute[74337]:     <secmodel>
Oct 23 21:29:00 user nova-compute[74337]:       <model>dac</model>
Oct 23 21:29:00 user nova-compute[74337]:       <doi>0</doi>
Oct 23 21:29:00 user nova-compute[74337]:       <baselabel type='kvm'>+64055:+108</baselabel>
Oct 23 21:29:00 user nova-compute[74337]:       <baselabel type='qemu'>+64055:+108</baselabel>
Oct 23 21:29:00 user nova-compute[74337]:     </secmodel>
Oct 23 21:29:00 user nova-compute[74337]:   </host>
Oct 23 21:29:00 user nova-compute[74337]:   <guest>
Oct 23 21:29:00 user nova-compute[74337]:     <os_type>hvm</os_type>
Oct 23 21:29:00 user nova-compute[74337]:     <arch name='alpha'>
Oct 23 21:29:00 user nova-compute[74337]:       <wordsize>64</wordsize>
Oct 23 21:29:00 user nova-compute[74337]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='4'>clipper</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <domain type='qemu'/>
Oct 23 21:29:00 user nova-compute[74337]:     </arch>
Oct 23 21:29:00 user nova-compute[74337]:     <features>
Oct 23 21:29:00 user nova-compute[74337]:       <cpuselection/>
Oct 23 21:29:00 user nova-compute[74337]:       <deviceboot/>
Oct 23 21:29:00 user nova-compute[74337]:       <disksnapshot default='on' toggle='no'/>
Oct 23 21:29:00 user nova-compute[74337]:     </features>
Oct 23 21:29:00 user nova-compute[74337]:   </guest>
Oct 23 21:29:00 user nova-compute[74337]:   <guest>
Oct 23 21:29:00 user nova-compute[74337]:     <os_type>hvm</os_type>
Oct 23 21:29:00 user nova-compute[74337]:     <arch name='armv6l'>
Oct 23 21:29:00 user nova-compute[74337]:       <wordsize>32</wordsize>
Oct 23 21:29:00 user nova-compute[74337]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>integratorcp</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>borzoi</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>spitz</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2'>nuri</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2'>musca-b1</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>versatileab</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>kzm</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2'>musca-a</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2'>smdkc210</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>sx1</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>z2</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>tosa</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='4'>sabrelite</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>realview-eb</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>n810</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>n800</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>versatilepb</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>terrier</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>mainstone</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='4'>midway</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>musicpal</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>microbit</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>cubieboard</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>verdex</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>netduino2</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='4'>raspi2b</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>cheetah</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='4'>highbank</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>akita</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>connex</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>collie</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>raspi0</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <domain type='qemu'/>
Oct 23 21:29:00 user nova-compute[74337]:     </arch>
Oct 23 21:29:00 user nova-compute[74337]:     <features>
Oct 23 21:29:00 user nova-compute[74337]:       <cpuselection/>
Oct 23 21:29:00 user nova-compute[74337]:       <deviceboot/>
Oct 23 21:29:00 user nova-compute[74337]:       <disksnapshot default='on' toggle='no'/>
Oct 23 21:29:00 user nova-compute[74337]:     </features>
Oct 23 21:29:00 user nova-compute[74337]:   </guest>
Oct 23 21:29:00 user nova-compute[74337]:   <guest>
Oct 23 21:29:00 user nova-compute[74337]:     <os_type>hvm</os_type>
Oct 23 21:29:00 user nova-compute[74337]:     <arch name='armv7l'>
Oct 23 21:29:00 user nova-compute[74337]:       <wordsize>32</wordsize>
Oct 23 21:29:00 user nova-compute[74337]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>integratorcp</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>borzoi</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>spitz</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2'>nuri</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2'>musca-b1</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>versatileab</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>kzm</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2'>musca-a</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2'>smdkc210</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>sx1</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>z2</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>tosa</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='4'>sabrelite</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>realview-eb</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>n810</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>n800</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>versatilepb</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>terrier</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>mainstone</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='4'>midway</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>musicpal</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>microbit</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>cubieboard</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>verdex</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>netduino2</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='4'>raspi2b</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>cheetah</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='4'>highbank</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>akita</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>connex</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>collie</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>raspi0</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <domain type='qemu'/>
Oct 23 21:29:00 user nova-compute[74337]:     </arch>
Oct 23 21:29:00 user nova-compute[74337]:     <features>
Oct 23 21:29:00 user nova-compute[74337]:       <cpuselection/>
Oct 23 21:29:00 user nova-compute[74337]:       <deviceboot/>
Oct 23 21:29:00 user nova-compute[74337]:       <disksnapshot default='on' toggle='no'/>
Oct 23 21:29:00 user nova-compute[74337]:     </features>
Oct 23 21:29:00 user nova-compute[74337]:   </guest>
Oct 23 21:29:00 user nova-compute[74337]:   <guest>
Oct 23 21:29:00 user nova-compute[74337]:     <os_type>hvm</os_type>
Oct 23 21:29:00 user nova-compute[74337]:     <arch name='aarch64'>
Oct 23 21:29:00 user nova-compute[74337]:       <wordsize>64</wordsize>
Oct 23 21:29:00 user nova-compute[74337]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>integratorcp</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>borzoi</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>spitz</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2'>nuri</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2'>musca-b1</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>versatileab</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>kzm</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2'>musca-a</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2'>smdkc210</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>sx1</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>z2</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>tosa</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='4'>sabrelite</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>realview-eb</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='512'>sbsa-ref</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>n810</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>n800</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>versatilepb</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>terrier</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>mainstone</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='4'>midway</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>musicpal</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>microbit</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='4'>raspi3ap</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>cubieboard</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>verdex</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>netduino2</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='4'>raspi3b</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='4'>raspi2b</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>cheetah</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='4'>highbank</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>akita</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>connex</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>collie</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>raspi0</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <domain type='qemu'/>
Oct 23 21:29:00 user nova-compute[74337]:     </arch>
Oct 23 21:29:00 user nova-compute[74337]:     <features>
Oct 23 21:29:00 user nova-compute[74337]:       <acpi default='on' toggle='yes'/>
Oct 23 21:29:00 user nova-compute[74337]:       <cpuselection/>
Oct 23 21:29:00 user nova-compute[74337]:       <deviceboot/>
Oct 23 21:29:00 user nova-compute[74337]:       <disksnapshot default='on' toggle='no'/>
Oct 23 21:29:00 user nova-compute[74337]:     </features>
Oct 23 21:29:00 user nova-compute[74337]:   </guest>
Oct 23 21:29:00 user nova-compute[74337]:   <guest>
Oct 23 21:29:00 user nova-compute[74337]:     <os_type>hvm</os_type>
Oct 23 21:29:00 user nova-compute[74337]:     <arch name='cris'>
Oct 23 21:29:00 user nova-compute[74337]:       <wordsize>32</wordsize>
Oct 23 21:29:00 user nova-compute[74337]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>axis-dev88</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <domain type='qemu'/>
Oct 23 21:29:00 user nova-compute[74337]:     </arch>
Oct 23 21:29:00 user nova-compute[74337]:     <features>
Oct 23 21:29:00 user nova-compute[74337]:       <cpuselection/>
Oct 23 21:29:00 user nova-compute[74337]:       <deviceboot/>
Oct 23 21:29:00 user nova-compute[74337]:       <disksnapshot default='on' toggle='no'/>
Oct 23 21:29:00 user nova-compute[74337]:     </features>
Oct 23 21:29:00 user nova-compute[74337]:   </guest>
Oct 23 21:29:00 user nova-compute[74337]:   <guest>
Oct 23 21:29:00 user nova-compute[74337]:     <os_type>hvm</os_type>
Oct 23 21:29:00 user nova-compute[74337]:     <arch name='i686'>
Oct 23 21:29:00 user nova-compute[74337]:       <wordsize>32</wordsize>
Oct 23 21:29:00 user nova-compute[74337]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='288'>pc-q35-artful</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>x-remote</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>isapc</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='288'>pc-q35-disco</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='288'>pc-q35-impish</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='288'>pc-q35-focal</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='288'>microvm</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <domain type='qemu'/>
Oct 23 21:29:00 user nova-compute[74337]:       <domain type='kvm'/>
Oct 23 21:29:00 user nova-compute[74337]:     </arch>
Oct 23 21:29:00 user nova-compute[74337]:     <features>
Oct 23 21:29:00 user nova-compute[74337]:       <pae/>
Oct 23 21:29:00 user nova-compute[74337]:       <nonpae/>
Oct 23 21:29:00 user nova-compute[74337]:       <acpi default='on' toggle='yes'/>
Oct 23 21:29:00 user nova-compute[74337]:       <apic default='on' toggle='no'/>
Oct 23 21:29:00 user nova-compute[74337]:       <cpuselection/>
Oct 23 21:29:00 user nova-compute[74337]:       <deviceboot/>
Oct 23 21:29:00 user nova-compute[74337]:       <disksnapshot default='on' toggle='no'/>
Oct 23 21:29:00 user nova-compute[74337]:     </features>
Oct 23 21:29:00 user nova-compute[74337]:   </guest>
Oct 23 21:29:00 user nova-compute[74337]:   <guest>
Oct 23 21:29:00 user nova-compute[74337]:     <os_type>hvm</os_type>
Oct 23 21:29:00 user nova-compute[74337]:     <arch name='m68k'>
Oct 23 21:29:00 user nova-compute[74337]:       <wordsize>32</wordsize>
Oct 23 21:29:00 user nova-compute[74337]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>mcf5208evb</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>an5206</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>virt-6.0</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>q800</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>virt-6.2</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>next-cube</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>virt-6.1</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <domain type='qemu'/>
Oct 23 21:29:00 user nova-compute[74337]:     </arch>
Oct 23 21:29:00 user nova-compute[74337]:     <features>
Oct 23 21:29:00 user nova-compute[74337]:       <cpuselection/>
Oct 23 21:29:00 user nova-compute[74337]:       <deviceboot/>
Oct 23 21:29:00 user nova-compute[74337]:       <disksnapshot default='on' toggle='no'/>
Oct 23 21:29:00 user nova-compute[74337]:     </features>
Oct 23 21:29:00 user nova-compute[74337]:   </guest>
Oct 23 21:29:00 user nova-compute[74337]:   <guest>
Oct 23 21:29:00 user nova-compute[74337]:     <os_type>hvm</os_type>
Oct 23 21:29:00 user nova-compute[74337]:     <arch name='microblaze'>
Oct 23 21:29:00 user nova-compute[74337]:       <wordsize>32</wordsize>
Oct 23 21:29:00 user nova-compute[74337]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>petalogix-ml605</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <domain type='qemu'/>
Oct 23 21:29:00 user nova-compute[74337]:     </arch>
Oct 23 21:29:00 user nova-compute[74337]:     <features>
Oct 23 21:29:00 user nova-compute[74337]:       <cpuselection/>
Oct 23 21:29:00 user nova-compute[74337]:       <deviceboot/>
Oct 23 21:29:00 user nova-compute[74337]:       <disksnapshot default='on' toggle='no'/>
Oct 23 21:29:00 user nova-compute[74337]:     </features>
Oct 23 21:29:00 user nova-compute[74337]:   </guest>
Oct 23 21:29:00 user nova-compute[74337]:   <guest>
Oct 23 21:29:00 user nova-compute[74337]:     <os_type>hvm</os_type>
Oct 23 21:29:00 user nova-compute[74337]:     <arch name='microblazeel'>
Oct 23 21:29:00 user nova-compute[74337]:       <wordsize>32</wordsize>
Oct 23 21:29:00 user nova-compute[74337]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>petalogix-ml605</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <domain type='qemu'/>
Oct 23 21:29:00 user nova-compute[74337]:     </arch>
Oct 23 21:29:00 user nova-compute[74337]:     <features>
Oct 23 21:29:00 user nova-compute[74337]:       <cpuselection/>
Oct 23 21:29:00 user nova-compute[74337]:       <deviceboot/>
Oct 23 21:29:00 user nova-compute[74337]:       <disksnapshot default='on' toggle='no'/>
Oct 23 21:29:00 user nova-compute[74337]:     </features>
Oct 23 21:29:00 user nova-compute[74337]:   </guest>
Oct 23 21:29:00 user nova-compute[74337]:   <guest>
Oct 23 21:29:00 user nova-compute[74337]:     <os_type>hvm</os_type>
Oct 23 21:29:00 user nova-compute[74337]:     <arch name='mips'>
Oct 23 21:29:00 user nova-compute[74337]:       <wordsize>32</wordsize>
Oct 23 21:29:00 user nova-compute[74337]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='16'>malta</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>mipssim</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <domain type='qemu'/>
Oct 23 21:29:00 user nova-compute[74337]:     </arch>
Oct 23 21:29:00 user nova-compute[74337]:     <features>
Oct 23 21:29:00 user nova-compute[74337]:       <cpuselection/>
Oct 23 21:29:00 user nova-compute[74337]:       <deviceboot/>
Oct 23 21:29:00 user nova-compute[74337]:       <disksnapshot default='on' toggle='no'/>
Oct 23 21:29:00 user nova-compute[74337]:     </features>
Oct 23 21:29:00 user nova-compute[74337]:   </guest>
Oct 23 21:29:00 user nova-compute[74337]:   <guest>
Oct 23 21:29:00 user nova-compute[74337]:     <os_type>hvm</os_type>
Oct 23 21:29:00 user nova-compute[74337]:     <arch name='mipsel'>
Oct 23 21:29:00 user nova-compute[74337]:       <wordsize>32</wordsize>
Oct 23 21:29:00 user nova-compute[74337]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='16'>malta</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>mipssim</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <domain type='qemu'/>
Oct 23 21:29:00 user nova-compute[74337]:     </arch>
Oct 23 21:29:00 user nova-compute[74337]:     <features>
Oct 23 21:29:00 user nova-compute[74337]:       <cpuselection/>
Oct 23 21:29:00 user nova-compute[74337]:       <deviceboot/>
Oct 23 21:29:00 user nova-compute[74337]:       <disksnapshot default='on' toggle='no'/>
Oct 23 21:29:00 user nova-compute[74337]:     </features>
Oct 23 21:29:00 user nova-compute[74337]:   </guest>
Oct 23 21:29:00 user nova-compute[74337]:   <guest>
Oct 23 21:29:00 user nova-compute[74337]:     <os_type>hvm</os_type>
Oct 23 21:29:00 user nova-compute[74337]:     <arch name='mips64'>
Oct 23 21:29:00 user nova-compute[74337]:       <wordsize>64</wordsize>
Oct 23 21:29:00 user nova-compute[74337]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='16'>malta</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>mipssim</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>pica61</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>magnum</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <domain type='qemu'/>
Oct 23 21:29:00 user nova-compute[74337]:     </arch>
Oct 23 21:29:00 user nova-compute[74337]:     <features>
Oct 23 21:29:00 user nova-compute[74337]:       <cpuselection/>
Oct 23 21:29:00 user nova-compute[74337]:       <deviceboot/>
Oct 23 21:29:00 user nova-compute[74337]:       <disksnapshot default='on' toggle='no'/>
Oct 23 21:29:00 user nova-compute[74337]:     </features>
Oct 23 21:29:00 user nova-compute[74337]:   </guest>
Oct 23 21:29:00 user nova-compute[74337]:   <guest>
Oct 23 21:29:00 user nova-compute[74337]:     <os_type>hvm</os_type>
Oct 23 21:29:00 user nova-compute[74337]:     <arch name='mips64el'>
Oct 23 21:29:00 user nova-compute[74337]:       <wordsize>64</wordsize>
Oct 23 21:29:00 user nova-compute[74337]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='16'>malta</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='16'>loongson3-virt</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>mipssim</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>pica61</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>magnum</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='16'>boston</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>fuloong2e</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <domain type='qemu'/>
Oct 23 21:29:00 user nova-compute[74337]:     </arch>
Oct 23 21:29:00 user nova-compute[74337]:     <features>
Oct 23 21:29:00 user nova-compute[74337]:       <cpuselection/>
Oct 23 21:29:00 user nova-compute[74337]:       <deviceboot/>
Oct 23 21:29:00 user nova-compute[74337]:       <disksnapshot default='on' toggle='no'/>
Oct 23 21:29:00 user nova-compute[74337]:     </features>
Oct 23 21:29:00 user nova-compute[74337]:   </guest>
Oct 23 21:29:00 user nova-compute[74337]:   <guest>
Oct 23 21:29:00 user nova-compute[74337]:     <os_type>hvm</os_type>
Oct 23 21:29:00 user nova-compute[74337]:     <arch name='ppc'>
Oct 23 21:29:00 user nova-compute[74337]:       <wordsize>32</wordsize>
Oct 23 21:29:00 user nova-compute[74337]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>g3beige</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>mac99</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='32'>ppce500</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>pegasos2</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>sam460ex</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>bamboo</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>40p</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>ref405ep</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>taihu</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <domain type='qemu'/>
Oct 23 21:29:00 user nova-compute[74337]:     </arch>
Oct 23 21:29:00 user nova-compute[74337]:     <features>
Oct 23 21:29:00 user nova-compute[74337]:       <cpuselection/>
Oct 23 21:29:00 user nova-compute[74337]:       <deviceboot/>
Oct 23 21:29:00 user nova-compute[74337]:       <disksnapshot default='on' toggle='no'/>
Oct 23 21:29:00 user nova-compute[74337]:     </features>
Oct 23 21:29:00 user nova-compute[74337]:   </guest>
Oct 23 21:29:00 user nova-compute[74337]:   <guest>
Oct 23 21:29:00 user nova-compute[74337]:     <os_type>hvm</os_type>
Oct 23 21:29:00 user nova-compute[74337]:     <arch name='ppc64'>
Oct 23 21:29:00 user nova-compute[74337]:       <wordsize>64</wordsize>
Oct 23 21:29:00 user nova-compute[74337]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2048'>powernv9</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>taihu</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2048'>powernv10</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='32'>ppce500</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>40p</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>pegasos2</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>bamboo</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>g3beige</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>mac99</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>sam460ex</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>ref405ep</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2048'>powernv8</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <domain type='qemu'/>
Oct 23 21:29:00 user nova-compute[74337]:     </arch>
Oct 23 21:29:00 user nova-compute[74337]:     <features>
Oct 23 21:29:00 user nova-compute[74337]:       <cpuselection/>
Oct 23 21:29:00 user nova-compute[74337]:       <deviceboot/>
Oct 23 21:29:00 user nova-compute[74337]:       <disksnapshot default='on' toggle='no'/>
Oct 23 21:29:00 user nova-compute[74337]:     </features>
Oct 23 21:29:00 user nova-compute[74337]:   </guest>
Oct 23 21:29:00 user nova-compute[74337]:   <guest>
Oct 23 21:29:00 user nova-compute[74337]:     <os_type>hvm</os_type>
Oct 23 21:29:00 user nova-compute[74337]:     <arch name='ppc64le'>
Oct 23 21:29:00 user nova-compute[74337]:       <wordsize>64</wordsize>
Oct 23 21:29:00 user nova-compute[74337]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2048'>powernv9</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>taihu</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2048'>powernv10</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='32'>ppce500</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>40p</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>pegasos2</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>bamboo</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>g3beige</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>mac99</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>sam460ex</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>ref405ep</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2048'>powernv8</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <domain type='qemu'/>
Oct 23 21:29:00 user nova-compute[74337]:     </arch>
Oct 23 21:29:00 user nova-compute[74337]:     <features>
Oct 23 21:29:00 user nova-compute[74337]:       <cpuselection/>
Oct 23 21:29:00 user nova-compute[74337]:       <deviceboot/>
Oct 23 21:29:00 user nova-compute[74337]:       <disksnapshot default='on' toggle='no'/>
Oct 23 21:29:00 user nova-compute[74337]:     </features>
Oct 23 21:29:00 user nova-compute[74337]:   </guest>
Oct 23 21:29:00 user nova-compute[74337]:   <guest>
Oct 23 21:29:00 user nova-compute[74337]:     <os_type>hvm</os_type>
Oct 23 21:29:00 user nova-compute[74337]:     <arch name='riscv32'>
Oct 23 21:29:00 user nova-compute[74337]:       <wordsize>32</wordsize>
Oct 23 21:29:00 user nova-compute[74337]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='8'>spike</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>opentitan</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='5'>sifive_u</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>sifive_e</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='8'>virt</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <domain type='qemu'/>
Oct 23 21:29:00 user nova-compute[74337]:     </arch>
Oct 23 21:29:00 user nova-compute[74337]:     <features>
Oct 23 21:29:00 user nova-compute[74337]:       <cpuselection/>
Oct 23 21:29:00 user nova-compute[74337]:       <deviceboot/>
Oct 23 21:29:00 user nova-compute[74337]:       <disksnapshot default='on' toggle='no'/>
Oct 23 21:29:00 user nova-compute[74337]:     </features>
Oct 23 21:29:00 user nova-compute[74337]:   </guest>
Oct 23 21:29:00 user nova-compute[74337]:   <guest>
Oct 23 21:29:00 user nova-compute[74337]:     <os_type>hvm</os_type>
Oct 23 21:29:00 user nova-compute[74337]:     <arch name='riscv64'>
Oct 23 21:29:00 user nova-compute[74337]:       <wordsize>64</wordsize>
Oct 23 21:29:00 user nova-compute[74337]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='8'>spike</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='5'>sifive_u</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>shakti_c</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>sifive_e</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='8'>virt</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <domain type='qemu'/>
Oct 23 21:29:00 user nova-compute[74337]:     </arch>
Oct 23 21:29:00 user nova-compute[74337]:     <features>
Oct 23 21:29:00 user nova-compute[74337]:       <cpuselection/>
Oct 23 21:29:00 user nova-compute[74337]:       <deviceboot/>
Oct 23 21:29:00 user nova-compute[74337]:       <disksnapshot default='on' toggle='no'/>
Oct 23 21:29:00 user nova-compute[74337]:     </features>
Oct 23 21:29:00 user nova-compute[74337]:   </guest>
Oct 23 21:29:00 user nova-compute[74337]:   <guest>
Oct 23 21:29:00 user nova-compute[74337]:     <os_type>hvm</os_type>
Oct 23 21:29:00 user nova-compute[74337]:     <arch name='s390x'>
Oct 23 21:29:00 user nova-compute[74337]:       <wordsize>64</wordsize>
Oct 23 21:29:00 user nova-compute[74337]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <domain type='qemu'/>
Oct 23 21:29:00 user nova-compute[74337]:     </arch>
Oct 23 21:29:00 user nova-compute[74337]:     <features>
Oct 23 21:29:00 user nova-compute[74337]:       <cpuselection/>
Oct 23 21:29:00 user nova-compute[74337]:       <deviceboot/>
Oct 23 21:29:00 user nova-compute[74337]:       <disksnapshot default='on' toggle='no'/>
Oct 23 21:29:00 user nova-compute[74337]:     </features>
Oct 23 21:29:00 user nova-compute[74337]:   </guest>
Oct 23 21:29:00 user nova-compute[74337]:   <guest>
Oct 23 21:29:00 user nova-compute[74337]:     <os_type>hvm</os_type>
Oct 23 21:29:00 user nova-compute[74337]:     <arch name='sh4'>
Oct 23 21:29:00 user nova-compute[74337]:       <wordsize>32</wordsize>
Oct 23 21:29:00 user nova-compute[74337]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>shix</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>r2d</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <domain type='qemu'/>
Oct 23 21:29:00 user nova-compute[74337]:     </arch>
Oct 23 21:29:00 user nova-compute[74337]:     <features>
Oct 23 21:29:00 user nova-compute[74337]:       <cpuselection/>
Oct 23 21:29:00 user nova-compute[74337]:       <deviceboot/>
Oct 23 21:29:00 user nova-compute[74337]:       <disksnapshot default='on' toggle='no'/>
Oct 23 21:29:00 user nova-compute[74337]:     </features>
Oct 23 21:29:00 user nova-compute[74337]:   </guest>
Oct 23 21:29:00 user nova-compute[74337]:   <guest>
Oct 23 21:29:00 user nova-compute[74337]:     <os_type>hvm</os_type>
Oct 23 21:29:00 user nova-compute[74337]:     <arch name='sh4eb'>
Oct 23 21:29:00 user nova-compute[74337]:       <wordsize>64</wordsize>
Oct 23 21:29:00 user nova-compute[74337]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>shix</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>r2d</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <domain type='qemu'/>
Oct 23 21:29:00 user nova-compute[74337]:     </arch>
Oct 23 21:29:00 user nova-compute[74337]:     <features>
Oct 23 21:29:00 user nova-compute[74337]:       <cpuselection/>
Oct 23 21:29:00 user nova-compute[74337]:       <deviceboot/>
Oct 23 21:29:00 user nova-compute[74337]:       <disksnapshot default='on' toggle='no'/>
Oct 23 21:29:00 user nova-compute[74337]:     </features>
Oct 23 21:29:00 user nova-compute[74337]:   </guest>
Oct 23 21:29:00 user nova-compute[74337]:   <guest>
Oct 23 21:29:00 user nova-compute[74337]:     <os_type>hvm</os_type>
Oct 23 21:29:00 user nova-compute[74337]:     <arch name='sparc'>
Oct 23 21:29:00 user nova-compute[74337]:       <wordsize>32</wordsize>
Oct 23 21:29:00 user nova-compute[74337]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>SS-5</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='4'>SS-20</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>LX</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>SPARCClassic</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>leon3_generic</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>SPARCbook</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>SS-4</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='4'>SS-600MP</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='4'>SS-10</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>Voyager</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <domain type='qemu'/>
Oct 23 21:29:00 user nova-compute[74337]:     </arch>
Oct 23 21:29:00 user nova-compute[74337]:     <features>
Oct 23 21:29:00 user nova-compute[74337]:       <cpuselection/>
Oct 23 21:29:00 user nova-compute[74337]:       <deviceboot/>
Oct 23 21:29:00 user nova-compute[74337]:       <disksnapshot default='on' toggle='no'/>
Oct 23 21:29:00 user nova-compute[74337]:     </features>
Oct 23 21:29:00 user nova-compute[74337]:   </guest>
Oct 23 21:29:00 user nova-compute[74337]:   <guest>
Oct 23 21:29:00 user nova-compute[74337]:     <os_type>hvm</os_type>
Oct 23 21:29:00 user nova-compute[74337]:     <arch name='sparc64'>
Oct 23 21:29:00 user nova-compute[74337]:       <wordsize>64</wordsize>
Oct 23 21:29:00 user nova-compute[74337]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>sun4u</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>niagara</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>sun4v</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <domain type='qemu'/>
Oct 23 21:29:00 user nova-compute[74337]:     </arch>
Oct 23 21:29:00 user nova-compute[74337]:     <features>
Oct 23 21:29:00 user nova-compute[74337]:       <cpuselection/>
Oct 23 21:29:00 user nova-compute[74337]:       <deviceboot/>
Oct 23 21:29:00 user nova-compute[74337]:       <disksnapshot default='on' toggle='no'/>
Oct 23 21:29:00 user nova-compute[74337]:     </features>
Oct 23 21:29:00 user nova-compute[74337]:   </guest>
Oct 23 21:29:00 user nova-compute[74337]:   <guest>
Oct 23 21:29:00 user nova-compute[74337]:     <os_type>hvm</os_type>
Oct 23 21:29:00 user nova-compute[74337]:     <arch name='x86_64'>
Oct 23 21:29:00 user nova-compute[74337]:       <wordsize>64</wordsize>
Oct 23 21:29:00 user nova-compute[74337]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='288'>pc-q35-artful</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>x-remote</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='1'>isapc</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='288'>pc-q35-disco</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='288'>pc-q35-impish</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='288'>pc-q35-focal</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='288'>microvm</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <domain type='qemu'/>
Oct 23 21:29:00 user nova-compute[74337]:       <domain type='kvm'/>
Oct 23 21:29:00 user nova-compute[74337]:     </arch>
Oct 23 21:29:00 user nova-compute[74337]:     <features>
Oct 23 21:29:00 user nova-compute[74337]:       <acpi default='on' toggle='yes'/>
Oct 23 21:29:00 user nova-compute[74337]:       <apic default='on' toggle='no'/>
Oct 23 21:29:00 user nova-compute[74337]:       <cpuselection/>
Oct 23 21:29:00 user nova-compute[74337]:       <deviceboot/>
Oct 23 21:29:00 user nova-compute[74337]:       <disksnapshot default='on' toggle='no'/>
Oct 23 21:29:00 user nova-compute[74337]:     </features>
Oct 23 21:29:00 user nova-compute[74337]:   </guest>
Oct 23 21:29:00 user nova-compute[74337]:   <guest>
Oct 23 21:29:00 user nova-compute[74337]:     <os_type>hvm</os_type>
Oct 23 21:29:00 user nova-compute[74337]:     <arch name='xtensa'>
Oct 23 21:29:00 user nova-compute[74337]:       <wordsize>32</wordsize>
Oct 23 21:29:00 user nova-compute[74337]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='4'>sim</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='32'>kc705</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='32'>ml605</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='32'>ml605-nommu</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='32'>virt</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='32'>lx60-nommu</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='32'>lx200</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='32'>lx200-nommu</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='32'>lx60</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='32'>kc705-nommu</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <domain type='qemu'/>
Oct 23 21:29:00 user nova-compute[74337]:     </arch>
Oct 23 21:29:00 user nova-compute[74337]:     <features>
Oct 23 21:29:00 user nova-compute[74337]:       <cpuselection/>
Oct 23 21:29:00 user nova-compute[74337]:       <deviceboot/>
Oct 23 21:29:00 user nova-compute[74337]:       <disksnapshot default='on' toggle='no'/>
Oct 23 21:29:00 user nova-compute[74337]:     </features>
Oct 23 21:29:00 user nova-compute[74337]:   </guest>
Oct 23 21:29:00 user nova-compute[74337]:   <guest>
Oct 23 21:29:00 user nova-compute[74337]:     <os_type>hvm</os_type>
Oct 23 21:29:00 user nova-compute[74337]:     <arch name='xtensaeb'>
Oct 23 21:29:00 user nova-compute[74337]:       <wordsize>32</wordsize>
Oct 23 21:29:00 user nova-compute[74337]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='4'>sim</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='32'>kc705</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='32'>ml605</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='32'>ml605-nommu</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='32'>virt</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='32'>lx60-nommu</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='32'>lx200</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='32'>lx200-nommu</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='32'>lx60</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <machine maxCpus='32'>kc705-nommu</machine>
Oct 23 21:29:00 user nova-compute[74337]:       <domain type='qemu'/>
Oct 23 21:29:00 user nova-compute[74337]:     </arch>
Oct 23 21:29:00 user nova-compute[74337]:     <features>
Oct 23 21:29:00 user nova-compute[74337]:       <cpuselection/>
Oct 23 21:29:00 user nova-compute[74337]:       <deviceboot/>
Oct 23 21:29:00 user nova-compute[74337]:       <disksnapshot default='on' toggle='no'/>
Oct 23 21:29:00 user nova-compute[74337]:     </features>
Oct 23 21:29:00 user nova-compute[74337]:   </guest>
Oct 23 21:29:00 user nova-compute[74337]: </capabilities>
Oct 23 21:29:00 user nova-compute[74337]: 
Oct 23 21:29:00 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=74337) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 21:29:00 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=74337) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 21:29:00 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=74337) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 21:29:00 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74337) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 21:29:00 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74337) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 21:29:00 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=74337) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 21:29:00 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74337) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 21:29:00 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=74337) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 21:29:00 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=74337) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 21:29:00 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] Getting domain capabilities for cris via machine types: {None} {{(pid=74337) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 21:29:00 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=74337) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 21:29:00 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] Getting domain capabilities for i686 via machine types: {'ubuntu', 'ubuntu-q35', 'q35', 'pc'} {{(pid=74337) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 21:29:00 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Oct 23 21:29:00 user nova-compute[74337]: <domainCapabilities>
Oct 23 21:29:00 user nova-compute[74337]:   <path>/usr/bin/qemu-system-i386</path>
Oct 23 21:29:00 user nova-compute[74337]:   <domain>kvm</domain>
Oct 23 21:29:00 user nova-compute[74337]:   <machine>pc-i440fx-jammy</machine>
Oct 23 21:29:00 user nova-compute[74337]:   <arch>i686</arch>
Oct 23 21:29:00 user nova-compute[74337]:   <vcpu max='255'/>
Oct 23 21:29:00 user nova-compute[74337]:   <iothreads supported='yes'/>
Oct 23 21:29:00 user nova-compute[74337]:   <os supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:     <enum name='firmware'/>
Oct 23 21:29:00 user nova-compute[74337]:     <loader supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 23 21:29:00 user nova-compute[74337]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 23 21:29:00 user nova-compute[74337]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 23 21:29:00 user nova-compute[74337]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 23 21:29:00 user nova-compute[74337]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='type'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>rom</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>pflash</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='readonly'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>yes</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>no</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='secure'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>no</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:     </loader>
Oct 23 21:29:00 user nova-compute[74337]:   </os>
Oct 23 21:29:00 user nova-compute[74337]:   <cpu>
Oct 23 21:29:00 user nova-compute[74337]:     <mode name='host-passthrough' supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='hostPassthroughMigratable'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>off</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:     </mode>
Oct 23 21:29:00 user nova-compute[74337]:     <mode name='maximum' supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='maximumMigratable'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>on</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>off</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:     </mode>
Oct 23 21:29:00 user nova-compute[74337]:     <mode name='host-model' supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <vendor>Intel</vendor>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='ss'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='vmx'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='pcid'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='hypervisor'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='arat'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='tsc_adjust'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='umip'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='md-clear'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='stibp'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='arch-capabilities'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='ssbd'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='ibpb'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='ibrs'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='amd-stibp'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='amd-ssbd'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='disable' name='erms'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='disable' name='xsaveopt'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='disable' name='lm'/>
Oct 23 21:29:00 user nova-compute[74337]:     </mode>
Oct 23 21:29:00 user nova-compute[74337]:     <mode name='custom' supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>qemu64</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='yes'>qemu32</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>phenom</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='yes'>pentium3</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='yes'>pentium2</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='yes'>pentium</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>n270</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>kvm64</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='yes'>kvm32</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='yes'>coreduo</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>core2duo</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>athlon</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Westmere-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Westmere</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Snowridge</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Skylake-Server</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Skylake-Client</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>SandyBridge</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Penryn</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Opteron_G5</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Opteron_G4</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Opteron_G3</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Opteron_G2</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Opteron_G1</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Nehalem-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Nehalem</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>IvyBridge</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Icelake-Server</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Haswell-noTSX</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Haswell-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Haswell</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>EPYC-Rome</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>EPYC-Milan</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>EPYC-IBPB</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>EPYC</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Dhyana</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Cooperlake</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Conroe</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Cascadelake-Server</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Broadwell-noTSX</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Broadwell-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Broadwell</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='yes'>486</model>
Oct 23 21:29:00 user nova-compute[74337]:     </mode>
Oct 23 21:29:00 user nova-compute[74337]:   </cpu>
Oct 23 21:29:00 user nova-compute[74337]:   <memoryBacking supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:     <enum name='sourceType'>
Oct 23 21:29:00 user nova-compute[74337]:       <value>file</value>
Oct 23 21:29:00 user nova-compute[74337]:       <value>anonymous</value>
Oct 23 21:29:00 user nova-compute[74337]:       <value>memfd</value>
Oct 23 21:29:00 user nova-compute[74337]:     </enum>
Oct 23 21:29:00 user nova-compute[74337]:   </memoryBacking>
Oct 23 21:29:00 user nova-compute[74337]:   <devices>
Oct 23 21:29:00 user nova-compute[74337]:     <disk supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='diskDevice'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>disk</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>cdrom</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>floppy</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>lun</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='bus'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>ide</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>fdc</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>scsi</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>virtio</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>usb</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>sata</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='model'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>virtio</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>virtio-transitional</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>virtio-non-transitional</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:     </disk>
Oct 23 21:29:00 user nova-compute[74337]:     <graphics supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='type'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>sdl</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>vnc</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>spice</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>egl-headless</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:     </graphics>
Oct 23 21:29:00 user nova-compute[74337]:     <video supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='modelType'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>vga</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>cirrus</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>vmvga</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>qxl</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>virtio</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>none</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>bochs</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>ramfb</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:     </video>
Oct 23 21:29:00 user nova-compute[74337]:     <hostdev supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='mode'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>subsystem</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='startupPolicy'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>default</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>mandatory</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>requisite</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>optional</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='subsysType'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>usb</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>pci</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>scsi</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='capsType'/>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='pciBackend'/>
Oct 23 21:29:00 user nova-compute[74337]:     </hostdev>
Oct 23 21:29:00 user nova-compute[74337]:     <rng supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='model'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>virtio</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>virtio-transitional</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>virtio-non-transitional</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='backendModel'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>random</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>egd</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>builtin</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:     </rng>
Oct 23 21:29:00 user nova-compute[74337]:     <filesystem supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='driverType'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>path</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>handle</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>virtiofs</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:     </filesystem>
Oct 23 21:29:00 user nova-compute[74337]:     <tpm supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='model'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>tpm-tis</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>tpm-crb</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='backendModel'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>passthrough</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>emulator</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:     </tpm>
Oct 23 21:29:00 user nova-compute[74337]:   </devices>
Oct 23 21:29:00 user nova-compute[74337]:   <features>
Oct 23 21:29:00 user nova-compute[74337]:     <gic supported='no'/>
Oct 23 21:29:00 user nova-compute[74337]:     <vmcoreinfo supported='yes'/>
Oct 23 21:29:00 user nova-compute[74337]:     <genid supported='yes'/>
Oct 23 21:29:00 user nova-compute[74337]:     <backingStoreInput supported='yes'/>
Oct 23 21:29:00 user nova-compute[74337]:     <backup supported='yes'/>
Oct 23 21:29:00 user nova-compute[74337]:     <sev supported='no'/>
Oct 23 21:29:00 user nova-compute[74337]:   </features>
Oct 23 21:29:00 user nova-compute[74337]: </domainCapabilities>
Oct 23 21:29:00 user nova-compute[74337]:  {{(pid=74337) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 23 21:29:00 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Oct 23 21:29:00 user nova-compute[74337]: <domainCapabilities>
Oct 23 21:29:00 user nova-compute[74337]:   <path>/usr/bin/qemu-system-i386</path>
Oct 23 21:29:00 user nova-compute[74337]:   <domain>kvm</domain>
Oct 23 21:29:00 user nova-compute[74337]:   <machine>pc-q35-jammy</machine>
Oct 23 21:29:00 user nova-compute[74337]:   <arch>i686</arch>
Oct 23 21:29:00 user nova-compute[74337]:   <vcpu max='288'/>
Oct 23 21:29:00 user nova-compute[74337]:   <iothreads supported='yes'/>
Oct 23 21:29:00 user nova-compute[74337]:   <os supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:     <enum name='firmware'/>
Oct 23 21:29:00 user nova-compute[74337]:     <loader supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 23 21:29:00 user nova-compute[74337]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 23 21:29:00 user nova-compute[74337]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 23 21:29:00 user nova-compute[74337]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 23 21:29:00 user nova-compute[74337]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='type'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>rom</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>pflash</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='readonly'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>yes</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>no</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='secure'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>no</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:     </loader>
Oct 23 21:29:00 user nova-compute[74337]:   </os>
Oct 23 21:29:00 user nova-compute[74337]:   <cpu>
Oct 23 21:29:00 user nova-compute[74337]:     <mode name='host-passthrough' supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='hostPassthroughMigratable'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>off</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:     </mode>
Oct 23 21:29:00 user nova-compute[74337]:     <mode name='maximum' supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='maximumMigratable'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>on</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>off</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:     </mode>
Oct 23 21:29:00 user nova-compute[74337]:     <mode name='host-model' supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <vendor>Intel</vendor>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='ss'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='vmx'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='pcid'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='hypervisor'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='arat'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='tsc_adjust'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='umip'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='md-clear'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='stibp'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='arch-capabilities'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='ssbd'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='ibpb'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='ibrs'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='amd-stibp'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='amd-ssbd'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='disable' name='erms'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='disable' name='xsaveopt'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='disable' name='lm'/>
Oct 23 21:29:00 user nova-compute[74337]:     </mode>
Oct 23 21:29:00 user nova-compute[74337]:     <mode name='custom' supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>qemu64</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='yes'>qemu32</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>phenom</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='yes'>pentium3</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='yes'>pentium2</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='yes'>pentium</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>n270</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>kvm64</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='yes'>kvm32</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='yes'>coreduo</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>core2duo</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>athlon</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Westmere-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Westmere</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Snowridge</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Skylake-Server</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Skylake-Client</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>SandyBridge</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Penryn</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Opteron_G5</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Opteron_G4</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Opteron_G3</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Opteron_G2</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Opteron_G1</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Nehalem-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Nehalem</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>IvyBridge</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Icelake-Server</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Haswell-noTSX</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Haswell-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Haswell</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>EPYC-Rome</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>EPYC-Milan</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>EPYC-IBPB</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>EPYC</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Dhyana</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Cooperlake</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Conroe</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Cascadelake-Server</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Broadwell-noTSX</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Broadwell-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Broadwell</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='yes'>486</model>
Oct 23 21:29:00 user nova-compute[74337]:     </mode>
Oct 23 21:29:00 user nova-compute[74337]:   </cpu>
Oct 23 21:29:00 user nova-compute[74337]:   <memoryBacking supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:     <enum name='sourceType'>
Oct 23 21:29:00 user nova-compute[74337]:       <value>file</value>
Oct 23 21:29:00 user nova-compute[74337]:       <value>anonymous</value>
Oct 23 21:29:00 user nova-compute[74337]:       <value>memfd</value>
Oct 23 21:29:00 user nova-compute[74337]:     </enum>
Oct 23 21:29:00 user nova-compute[74337]:   </memoryBacking>
Oct 23 21:29:00 user nova-compute[74337]:   <devices>
Oct 23 21:29:00 user nova-compute[74337]:     <disk supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='diskDevice'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>disk</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>cdrom</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>floppy</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>lun</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='bus'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>fdc</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>scsi</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>virtio</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>usb</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>sata</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='model'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>virtio</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>virtio-transitional</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>virtio-non-transitional</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:     </disk>
Oct 23 21:29:00 user nova-compute[74337]:     <graphics supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='type'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>sdl</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>vnc</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>spice</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>egl-headless</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:     </graphics>
Oct 23 21:29:00 user nova-compute[74337]:     <video supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='modelType'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>vga</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>cirrus</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>vmvga</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>qxl</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>virtio</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>none</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>bochs</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>ramfb</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:     </video>
Oct 23 21:29:00 user nova-compute[74337]:     <hostdev supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='mode'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>subsystem</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='startupPolicy'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>default</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>mandatory</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>requisite</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>optional</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='subsysType'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>usb</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>pci</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>scsi</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='capsType'/>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='pciBackend'/>
Oct 23 21:29:00 user nova-compute[74337]:     </hostdev>
Oct 23 21:29:00 user nova-compute[74337]:     <rng supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='model'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>virtio</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>virtio-transitional</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>virtio-non-transitional</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='backendModel'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>random</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>egd</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>builtin</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:     </rng>
Oct 23 21:29:00 user nova-compute[74337]:     <filesystem supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='driverType'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>path</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>handle</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>virtiofs</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:     </filesystem>
Oct 23 21:29:00 user nova-compute[74337]:     <tpm supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='model'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>tpm-tis</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>tpm-crb</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='backendModel'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>passthrough</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>emulator</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:     </tpm>
Oct 23 21:29:00 user nova-compute[74337]:   </devices>
Oct 23 21:29:00 user nova-compute[74337]:   <features>
Oct 23 21:29:00 user nova-compute[74337]:     <gic supported='no'/>
Oct 23 21:29:00 user nova-compute[74337]:     <vmcoreinfo supported='yes'/>
Oct 23 21:29:00 user nova-compute[74337]:     <genid supported='yes'/>
Oct 23 21:29:00 user nova-compute[74337]:     <backingStoreInput supported='yes'/>
Oct 23 21:29:00 user nova-compute[74337]:     <backup supported='yes'/>
Oct 23 21:29:00 user nova-compute[74337]:     <sev supported='no'/>
Oct 23 21:29:00 user nova-compute[74337]:   </features>
Oct 23 21:29:00 user nova-compute[74337]: </domainCapabilities>
Oct 23 21:29:00 user nova-compute[74337]:  {{(pid=74337) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 23 21:29:00 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Oct 23 21:29:00 user nova-compute[74337]: <domainCapabilities>
Oct 23 21:29:00 user nova-compute[74337]:   <path>/usr/bin/qemu-system-i386</path>
Oct 23 21:29:00 user nova-compute[74337]:   <domain>kvm</domain>
Oct 23 21:29:00 user nova-compute[74337]:   <machine>pc-q35-6.2</machine>
Oct 23 21:29:00 user nova-compute[74337]:   <arch>i686</arch>
Oct 23 21:29:00 user nova-compute[74337]:   <vcpu max='288'/>
Oct 23 21:29:00 user nova-compute[74337]:   <iothreads supported='yes'/>
Oct 23 21:29:00 user nova-compute[74337]:   <os supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:     <enum name='firmware'/>
Oct 23 21:29:00 user nova-compute[74337]:     <loader supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 23 21:29:00 user nova-compute[74337]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 23 21:29:00 user nova-compute[74337]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 23 21:29:00 user nova-compute[74337]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 23 21:29:00 user nova-compute[74337]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='type'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>rom</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>pflash</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='readonly'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>yes</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>no</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='secure'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>no</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:     </loader>
Oct 23 21:29:00 user nova-compute[74337]:   </os>
Oct 23 21:29:00 user nova-compute[74337]:   <cpu>
Oct 23 21:29:00 user nova-compute[74337]:     <mode name='host-passthrough' supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='hostPassthroughMigratable'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>off</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:     </mode>
Oct 23 21:29:00 user nova-compute[74337]:     <mode name='maximum' supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='maximumMigratable'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>on</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>off</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:     </mode>
Oct 23 21:29:00 user nova-compute[74337]:     <mode name='host-model' supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <vendor>Intel</vendor>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='ss'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='vmx'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='pcid'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='hypervisor'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='arat'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='tsc_adjust'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='umip'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='md-clear'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='stibp'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='arch-capabilities'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='ssbd'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='ibpb'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='ibrs'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='amd-stibp'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='amd-ssbd'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='disable' name='erms'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='disable' name='xsaveopt'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='disable' name='lm'/>
Oct 23 21:29:00 user nova-compute[74337]:     </mode>
Oct 23 21:29:00 user nova-compute[74337]:     <mode name='custom' supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>qemu64</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='yes'>qemu32</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>phenom</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='yes'>pentium3</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='yes'>pentium2</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='yes'>pentium</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>n270</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>kvm64</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='yes'>kvm32</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='yes'>coreduo</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>core2duo</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>athlon</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Westmere-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Westmere</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Snowridge</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Skylake-Server</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Skylake-Client</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>SandyBridge</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Penryn</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Opteron_G5</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Opteron_G4</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Opteron_G3</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Opteron_G2</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Opteron_G1</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Nehalem-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Nehalem</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>IvyBridge</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Icelake-Server</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Haswell-noTSX</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Haswell-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Haswell</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>EPYC-Rome</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>EPYC-Milan</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>EPYC-IBPB</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>EPYC</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Dhyana</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Cooperlake</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Conroe</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Cascadelake-Server</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Broadwell-noTSX</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Broadwell-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Broadwell</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='yes'>486</model>
Oct 23 21:29:00 user nova-compute[74337]:     </mode>
Oct 23 21:29:00 user nova-compute[74337]:   </cpu>
Oct 23 21:29:00 user nova-compute[74337]:   <memoryBacking supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:     <enum name='sourceType'>
Oct 23 21:29:00 user nova-compute[74337]:       <value>file</value>
Oct 23 21:29:00 user nova-compute[74337]:       <value>anonymous</value>
Oct 23 21:29:00 user nova-compute[74337]:       <value>memfd</value>
Oct 23 21:29:00 user nova-compute[74337]:     </enum>
Oct 23 21:29:00 user nova-compute[74337]:   </memoryBacking>
Oct 23 21:29:00 user nova-compute[74337]:   <devices>
Oct 23 21:29:00 user nova-compute[74337]:     <disk supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='diskDevice'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>disk</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>cdrom</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>floppy</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>lun</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='bus'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>fdc</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>scsi</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>virtio</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>usb</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>sata</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='model'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>virtio</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>virtio-transitional</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>virtio-non-transitional</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:     </disk>
Oct 23 21:29:00 user nova-compute[74337]:     <graphics supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='type'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>sdl</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>vnc</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>spice</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>egl-headless</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:     </graphics>
Oct 23 21:29:00 user nova-compute[74337]:     <video supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='modelType'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>vga</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>cirrus</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>vmvga</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>qxl</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>virtio</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>none</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>bochs</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>ramfb</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:     </video>
Oct 23 21:29:00 user nova-compute[74337]:     <hostdev supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='mode'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>subsystem</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='startupPolicy'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>default</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>mandatory</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>requisite</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>optional</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='subsysType'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>usb</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>pci</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>scsi</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='capsType'/>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='pciBackend'/>
Oct 23 21:29:00 user nova-compute[74337]:     </hostdev>
Oct 23 21:29:00 user nova-compute[74337]:     <rng supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='model'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>virtio</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>virtio-transitional</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>virtio-non-transitional</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='backendModel'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>random</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>egd</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>builtin</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:     </rng>
Oct 23 21:29:00 user nova-compute[74337]:     <filesystem supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='driverType'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>path</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>handle</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>virtiofs</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:     </filesystem>
Oct 23 21:29:00 user nova-compute[74337]:     <tpm supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='model'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>tpm-tis</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>tpm-crb</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='backendModel'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>passthrough</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>emulator</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:     </tpm>
Oct 23 21:29:00 user nova-compute[74337]:   </devices>
Oct 23 21:29:00 user nova-compute[74337]:   <features>
Oct 23 21:29:00 user nova-compute[74337]:     <gic supported='no'/>
Oct 23 21:29:00 user nova-compute[74337]:     <vmcoreinfo supported='yes'/>
Oct 23 21:29:00 user nova-compute[74337]:     <genid supported='yes'/>
Oct 23 21:29:00 user nova-compute[74337]:     <backingStoreInput supported='yes'/>
Oct 23 21:29:00 user nova-compute[74337]:     <backup supported='yes'/>
Oct 23 21:29:00 user nova-compute[74337]:     <sev supported='no'/>
Oct 23 21:29:00 user nova-compute[74337]:   </features>
Oct 23 21:29:00 user nova-compute[74337]: </domainCapabilities>
Oct 23 21:29:00 user nova-compute[74337]:  {{(pid=74337) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 23 21:29:00 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Oct 23 21:29:00 user nova-compute[74337]: <domainCapabilities>
Oct 23 21:29:00 user nova-compute[74337]:   <path>/usr/bin/qemu-system-i386</path>
Oct 23 21:29:00 user nova-compute[74337]:   <domain>kvm</domain>
Oct 23 21:29:00 user nova-compute[74337]:   <machine>pc-i440fx-6.2</machine>
Oct 23 21:29:00 user nova-compute[74337]:   <arch>i686</arch>
Oct 23 21:29:00 user nova-compute[74337]:   <vcpu max='255'/>
Oct 23 21:29:00 user nova-compute[74337]:   <iothreads supported='yes'/>
Oct 23 21:29:00 user nova-compute[74337]:   <os supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:     <enum name='firmware'/>
Oct 23 21:29:00 user nova-compute[74337]:     <loader supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 23 21:29:00 user nova-compute[74337]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 23 21:29:00 user nova-compute[74337]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 23 21:29:00 user nova-compute[74337]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 23 21:29:00 user nova-compute[74337]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='type'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>rom</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>pflash</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='readonly'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>yes</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>no</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='secure'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>no</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:     </loader>
Oct 23 21:29:00 user nova-compute[74337]:   </os>
Oct 23 21:29:00 user nova-compute[74337]:   <cpu>
Oct 23 21:29:00 user nova-compute[74337]:     <mode name='host-passthrough' supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='hostPassthroughMigratable'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>off</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:     </mode>
Oct 23 21:29:00 user nova-compute[74337]:     <mode name='maximum' supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='maximumMigratable'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>on</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>off</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:     </mode>
Oct 23 21:29:00 user nova-compute[74337]:     <mode name='host-model' supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <vendor>Intel</vendor>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='ss'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='vmx'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='pcid'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='hypervisor'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='arat'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='tsc_adjust'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='umip'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='md-clear'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='stibp'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='arch-capabilities'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='ssbd'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='ibpb'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='ibrs'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='amd-stibp'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='amd-ssbd'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='disable' name='erms'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='disable' name='xsaveopt'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='disable' name='lm'/>
Oct 23 21:29:00 user nova-compute[74337]:     </mode>
Oct 23 21:29:00 user nova-compute[74337]:     <mode name='custom' supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>qemu64</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='yes'>qemu32</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>phenom</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='yes'>pentium3</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='yes'>pentium2</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='yes'>pentium</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>n270</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>kvm64</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='yes'>kvm32</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='yes'>coreduo</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>core2duo</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>athlon</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Westmere-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Westmere</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Snowridge</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Skylake-Server</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Skylake-Client</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>SandyBridge</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Penryn</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Opteron_G5</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Opteron_G4</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Opteron_G3</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Opteron_G2</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Opteron_G1</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Nehalem-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Nehalem</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>IvyBridge</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Icelake-Server</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Haswell-noTSX</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Haswell-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Haswell</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>EPYC-Rome</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>EPYC-Milan</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>EPYC-IBPB</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>EPYC</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Dhyana</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Cooperlake</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Conroe</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Cascadelake-Server</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Broadwell-noTSX</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Broadwell-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Broadwell</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='yes'>486</model>
Oct 23 21:29:00 user nova-compute[74337]:     </mode>
Oct 23 21:29:00 user nova-compute[74337]:   </cpu>
Oct 23 21:29:00 user nova-compute[74337]:   <memoryBacking supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:     <enum name='sourceType'>
Oct 23 21:29:00 user nova-compute[74337]:       <value>file</value>
Oct 23 21:29:00 user nova-compute[74337]:       <value>anonymous</value>
Oct 23 21:29:00 user nova-compute[74337]:       <value>memfd</value>
Oct 23 21:29:00 user nova-compute[74337]:     </enum>
Oct 23 21:29:00 user nova-compute[74337]:   </memoryBacking>
Oct 23 21:29:00 user nova-compute[74337]:   <devices>
Oct 23 21:29:00 user nova-compute[74337]:     <disk supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='diskDevice'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>disk</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>cdrom</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>floppy</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>lun</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='bus'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>ide</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>fdc</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>scsi</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>virtio</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>usb</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>sata</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='model'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>virtio</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>virtio-transitional</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>virtio-non-transitional</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:     </disk>
Oct 23 21:29:00 user nova-compute[74337]:     <graphics supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='type'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>sdl</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>vnc</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>spice</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>egl-headless</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:     </graphics>
Oct 23 21:29:00 user nova-compute[74337]:     <video supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='modelType'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>vga</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>cirrus</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>vmvga</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>qxl</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>virtio</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>none</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>bochs</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>ramfb</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:     </video>
Oct 23 21:29:00 user nova-compute[74337]:     <hostdev supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='mode'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>subsystem</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='startupPolicy'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>default</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>mandatory</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>requisite</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>optional</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='subsysType'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>usb</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>pci</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>scsi</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='capsType'/>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='pciBackend'/>
Oct 23 21:29:00 user nova-compute[74337]:     </hostdev>
Oct 23 21:29:00 user nova-compute[74337]:     <rng supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='model'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>virtio</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>virtio-transitional</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>virtio-non-transitional</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='backendModel'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>random</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>egd</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>builtin</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:     </rng>
Oct 23 21:29:00 user nova-compute[74337]:     <filesystem supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='driverType'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>path</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>handle</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>virtiofs</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:     </filesystem>
Oct 23 21:29:00 user nova-compute[74337]:     <tpm supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='model'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>tpm-tis</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>tpm-crb</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='backendModel'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>passthrough</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>emulator</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:     </tpm>
Oct 23 21:29:00 user nova-compute[74337]:   </devices>
Oct 23 21:29:00 user nova-compute[74337]:   <features>
Oct 23 21:29:00 user nova-compute[74337]:     <gic supported='no'/>
Oct 23 21:29:00 user nova-compute[74337]:     <vmcoreinfo supported='yes'/>
Oct 23 21:29:00 user nova-compute[74337]:     <genid supported='yes'/>
Oct 23 21:29:00 user nova-compute[74337]:     <backingStoreInput supported='yes'/>
Oct 23 21:29:00 user nova-compute[74337]:     <backup supported='yes'/>
Oct 23 21:29:00 user nova-compute[74337]:     <sev supported='no'/>
Oct 23 21:29:00 user nova-compute[74337]:   </features>
Oct 23 21:29:00 user nova-compute[74337]: </domainCapabilities>
Oct 23 21:29:00 user nova-compute[74337]:  {{(pid=74337) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 23 21:29:00 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=74337) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 21:29:00 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74337) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 21:29:00 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74337) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 21:29:00 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=74337) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 21:29:00 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=74337) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 21:29:00 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=74337) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 21:29:00 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=74337) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 21:29:00 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] Getting domain capabilities for mips via machine types: {None} {{(pid=74337) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 21:29:00 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=74337) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 21:29:00 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=74337) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 21:29:00 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=74337) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 21:29:00 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=74337) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 21:29:00 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=74337) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 21:29:00 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=74337) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 21:29:00 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=74337) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 21:29:00 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=74337) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 21:29:00 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=74337) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 21:29:00 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=74337) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 21:29:00 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74337) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 21:29:00 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74337) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 21:29:00 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74337) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 21:29:00 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=74337) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 21:29:00 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74337) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 21:29:00 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74337) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 21:29:00 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=74337) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 21:29:00 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=74337) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 21:29:00 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=74337) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 21:29:00 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=74337) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 21:29:00 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=74337) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 21:29:00 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=74337) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 21:29:00 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=74337) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 21:29:00 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=74337) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 21:29:00 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=74337) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 21:29:00 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=74337) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 21:29:00 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=74337) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 21:29:00 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=74337) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 21:29:00 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=74337) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 21:29:00 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=74337) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 21:29:00 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu', 'ubuntu-q35', 'q35', 'pc'} {{(pid=74337) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 21:29:00 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Oct 23 21:29:00 user nova-compute[74337]: <domainCapabilities>
Oct 23 21:29:00 user nova-compute[74337]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 23 21:29:00 user nova-compute[74337]:   <domain>kvm</domain>
Oct 23 21:29:00 user nova-compute[74337]:   <machine>pc-i440fx-jammy</machine>
Oct 23 21:29:00 user nova-compute[74337]:   <arch>x86_64</arch>
Oct 23 21:29:00 user nova-compute[74337]:   <vcpu max='255'/>
Oct 23 21:29:00 user nova-compute[74337]:   <iothreads supported='yes'/>
Oct 23 21:29:00 user nova-compute[74337]:   <os supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:     <enum name='firmware'>
Oct 23 21:29:00 user nova-compute[74337]:       <value>efi</value>
Oct 23 21:29:00 user nova-compute[74337]:     </enum>
Oct 23 21:29:00 user nova-compute[74337]:     <loader supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='type'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>rom</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>pflash</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='readonly'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>yes</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>no</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='secure'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>no</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:     </loader>
Oct 23 21:29:00 user nova-compute[74337]:   </os>
Oct 23 21:29:00 user nova-compute[74337]:   <cpu>
Oct 23 21:29:00 user nova-compute[74337]:     <mode name='host-passthrough' supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='hostPassthroughMigratable'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>on</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>off</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:     </mode>
Oct 23 21:29:00 user nova-compute[74337]:     <mode name='maximum' supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='maximumMigratable'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>on</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>off</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:     </mode>
Oct 23 21:29:00 user nova-compute[74337]:     <mode name='host-model' supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <vendor>Intel</vendor>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='ss'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='vmx'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='pcid'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='hypervisor'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='arat'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='tsc_adjust'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='umip'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='md-clear'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='stibp'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='arch-capabilities'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='ssbd'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='invtsc'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='ibpb'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='ibrs'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='amd-stibp'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='amd-ssbd'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='rsba'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='pschange-mc-no'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='disable' name='erms'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='disable' name='xsaveopt'/>
Oct 23 21:29:00 user nova-compute[74337]:     </mode>
Oct 23 21:29:00 user nova-compute[74337]:     <mode name='custom' supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>qemu64</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='yes'>qemu32</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>phenom</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='yes'>pentium3</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='yes'>pentium2</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='yes'>pentium</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>n270</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='yes'>kvm64</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='yes'>kvm32</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='yes'>coreduo</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='yes'>core2duo</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>athlon</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='yes'>Westmere-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='yes'>Westmere</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Snowridge</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Skylake-Server</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Skylake-Client</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>SandyBridge</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='yes'>Penryn</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Opteron_G5</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Opteron_G4</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Opteron_G3</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Opteron_G2</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='yes'>Opteron_G1</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='yes'>Nehalem</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>IvyBridge</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Icelake-Server</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Haswell-noTSX</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Haswell-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Haswell</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>EPYC-Rome</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>EPYC-Milan</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>EPYC-IBPB</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>EPYC</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Dhyana</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Cooperlake</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='yes'>Conroe</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Cascadelake-Server</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Broadwell-noTSX</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Broadwell-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Broadwell</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='yes'>486</model>
Oct 23 21:29:00 user nova-compute[74337]:     </mode>
Oct 23 21:29:00 user nova-compute[74337]:   </cpu>
Oct 23 21:29:00 user nova-compute[74337]:   <memoryBacking supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:     <enum name='sourceType'>
Oct 23 21:29:00 user nova-compute[74337]:       <value>file</value>
Oct 23 21:29:00 user nova-compute[74337]:       <value>anonymous</value>
Oct 23 21:29:00 user nova-compute[74337]:       <value>memfd</value>
Oct 23 21:29:00 user nova-compute[74337]:     </enum>
Oct 23 21:29:00 user nova-compute[74337]:   </memoryBacking>
Oct 23 21:29:00 user nova-compute[74337]:   <devices>
Oct 23 21:29:00 user nova-compute[74337]:     <disk supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='diskDevice'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>disk</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>cdrom</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>floppy</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>lun</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='bus'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>ide</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>fdc</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>scsi</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>virtio</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>usb</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>sata</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='model'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>virtio</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>virtio-transitional</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>virtio-non-transitional</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:     </disk>
Oct 23 21:29:00 user nova-compute[74337]:     <graphics supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='type'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>sdl</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>vnc</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>spice</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>egl-headless</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:     </graphics>
Oct 23 21:29:00 user nova-compute[74337]:     <video supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='modelType'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>vga</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>cirrus</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>vmvga</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>qxl</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>virtio</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>none</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>bochs</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>ramfb</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:     </video>
Oct 23 21:29:00 user nova-compute[74337]:     <hostdev supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='mode'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>subsystem</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='startupPolicy'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>default</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>mandatory</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>requisite</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>optional</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='subsysType'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>usb</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>pci</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>scsi</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='capsType'/>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='pciBackend'/>
Oct 23 21:29:00 user nova-compute[74337]:     </hostdev>
Oct 23 21:29:00 user nova-compute[74337]:     <rng supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='model'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>virtio</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>virtio-transitional</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>virtio-non-transitional</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='backendModel'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>random</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>egd</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>builtin</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:     </rng>
Oct 23 21:29:00 user nova-compute[74337]:     <filesystem supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='driverType'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>path</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>handle</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>virtiofs</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:     </filesystem>
Oct 23 21:29:00 user nova-compute[74337]:     <tpm supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='model'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>tpm-tis</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>tpm-crb</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='backendModel'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>passthrough</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>emulator</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:     </tpm>
Oct 23 21:29:00 user nova-compute[74337]:   </devices>
Oct 23 21:29:00 user nova-compute[74337]:   <features>
Oct 23 21:29:00 user nova-compute[74337]:     <gic supported='no'/>
Oct 23 21:29:00 user nova-compute[74337]:     <vmcoreinfo supported='yes'/>
Oct 23 21:29:00 user nova-compute[74337]:     <genid supported='yes'/>
Oct 23 21:29:00 user nova-compute[74337]:     <backingStoreInput supported='yes'/>
Oct 23 21:29:00 user nova-compute[74337]:     <backup supported='yes'/>
Oct 23 21:29:00 user nova-compute[74337]:     <sev supported='no'/>
Oct 23 21:29:00 user nova-compute[74337]:   </features>
Oct 23 21:29:00 user nova-compute[74337]: </domainCapabilities>
Oct 23 21:29:00 user nova-compute[74337]:  {{(pid=74337) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 23 21:29:00 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Oct 23 21:29:00 user nova-compute[74337]: <domainCapabilities>
Oct 23 21:29:00 user nova-compute[74337]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 23 21:29:00 user nova-compute[74337]:   <domain>kvm</domain>
Oct 23 21:29:00 user nova-compute[74337]:   <machine>pc-q35-jammy</machine>
Oct 23 21:29:00 user nova-compute[74337]:   <arch>x86_64</arch>
Oct 23 21:29:00 user nova-compute[74337]:   <vcpu max='288'/>
Oct 23 21:29:00 user nova-compute[74337]:   <iothreads supported='yes'/>
Oct 23 21:29:00 user nova-compute[74337]:   <os supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:     <enum name='firmware'>
Oct 23 21:29:00 user nova-compute[74337]:       <value>efi</value>
Oct 23 21:29:00 user nova-compute[74337]:     </enum>
Oct 23 21:29:00 user nova-compute[74337]:     <loader supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Oct 23 21:29:00 user nova-compute[74337]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Oct 23 21:29:00 user nova-compute[74337]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='type'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>rom</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>pflash</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='readonly'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>yes</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>no</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='secure'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>yes</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>no</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:     </loader>
Oct 23 21:29:00 user nova-compute[74337]:   </os>
Oct 23 21:29:00 user nova-compute[74337]:   <cpu>
Oct 23 21:29:00 user nova-compute[74337]:     <mode name='host-passthrough' supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='hostPassthroughMigratable'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>on</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>off</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:     </mode>
Oct 23 21:29:00 user nova-compute[74337]:     <mode name='maximum' supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='maximumMigratable'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>on</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>off</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:     </mode>
Oct 23 21:29:00 user nova-compute[74337]:     <mode name='host-model' supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <vendor>Intel</vendor>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='ss'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='vmx'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='pcid'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='hypervisor'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='arat'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='tsc_adjust'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='umip'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='md-clear'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='stibp'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='arch-capabilities'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='ssbd'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='invtsc'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='ibpb'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='ibrs'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='amd-stibp'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='amd-ssbd'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='rsba'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='pschange-mc-no'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='disable' name='erms'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='disable' name='xsaveopt'/>
Oct 23 21:29:00 user nova-compute[74337]:     </mode>
Oct 23 21:29:00 user nova-compute[74337]:     <mode name='custom' supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>qemu64</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='yes'>qemu32</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>phenom</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='yes'>pentium3</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='yes'>pentium2</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='yes'>pentium</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>n270</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='yes'>kvm64</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='yes'>kvm32</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='yes'>coreduo</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='yes'>core2duo</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>athlon</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='yes'>Westmere-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='yes'>Westmere</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Snowridge</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Skylake-Server</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Skylake-Client</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>SandyBridge</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='yes'>Penryn</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Opteron_G5</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Opteron_G4</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Opteron_G3</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Opteron_G2</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='yes'>Opteron_G1</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='yes'>Nehalem</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>IvyBridge</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Icelake-Server</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Haswell-noTSX</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Haswell-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Haswell</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>EPYC-Rome</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>EPYC-Milan</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>EPYC-IBPB</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>EPYC</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Dhyana</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Cooperlake</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='yes'>Conroe</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Cascadelake-Server</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Broadwell-noTSX</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Broadwell-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Broadwell</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='yes'>486</model>
Oct 23 21:29:00 user nova-compute[74337]:     </mode>
Oct 23 21:29:00 user nova-compute[74337]:   </cpu>
Oct 23 21:29:00 user nova-compute[74337]:   <memoryBacking supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:     <enum name='sourceType'>
Oct 23 21:29:00 user nova-compute[74337]:       <value>file</value>
Oct 23 21:29:00 user nova-compute[74337]:       <value>anonymous</value>
Oct 23 21:29:00 user nova-compute[74337]:       <value>memfd</value>
Oct 23 21:29:00 user nova-compute[74337]:     </enum>
Oct 23 21:29:00 user nova-compute[74337]:   </memoryBacking>
Oct 23 21:29:00 user nova-compute[74337]:   <devices>
Oct 23 21:29:00 user nova-compute[74337]:     <disk supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='diskDevice'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>disk</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>cdrom</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>floppy</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>lun</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='bus'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>fdc</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>scsi</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>virtio</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>usb</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>sata</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='model'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>virtio</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>virtio-transitional</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>virtio-non-transitional</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:     </disk>
Oct 23 21:29:00 user nova-compute[74337]:     <graphics supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='type'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>sdl</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>vnc</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>spice</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>egl-headless</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:     </graphics>
Oct 23 21:29:00 user nova-compute[74337]:     <video supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='modelType'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>vga</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>cirrus</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>vmvga</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>qxl</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>virtio</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>none</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>bochs</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>ramfb</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:     </video>
Oct 23 21:29:00 user nova-compute[74337]:     <hostdev supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='mode'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>subsystem</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='startupPolicy'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>default</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>mandatory</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>requisite</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>optional</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='subsysType'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>usb</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>pci</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>scsi</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='capsType'/>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='pciBackend'/>
Oct 23 21:29:00 user nova-compute[74337]:     </hostdev>
Oct 23 21:29:00 user nova-compute[74337]:     <rng supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='model'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>virtio</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>virtio-transitional</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>virtio-non-transitional</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='backendModel'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>random</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>egd</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>builtin</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:     </rng>
Oct 23 21:29:00 user nova-compute[74337]:     <filesystem supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='driverType'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>path</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>handle</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>virtiofs</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:     </filesystem>
Oct 23 21:29:00 user nova-compute[74337]:     <tpm supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='model'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>tpm-tis</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>tpm-crb</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='backendModel'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>passthrough</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>emulator</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:     </tpm>
Oct 23 21:29:00 user nova-compute[74337]:   </devices>
Oct 23 21:29:00 user nova-compute[74337]:   <features>
Oct 23 21:29:00 user nova-compute[74337]:     <gic supported='no'/>
Oct 23 21:29:00 user nova-compute[74337]:     <vmcoreinfo supported='yes'/>
Oct 23 21:29:00 user nova-compute[74337]:     <genid supported='yes'/>
Oct 23 21:29:00 user nova-compute[74337]:     <backingStoreInput supported='yes'/>
Oct 23 21:29:00 user nova-compute[74337]:     <backup supported='yes'/>
Oct 23 21:29:00 user nova-compute[74337]:     <sev supported='no'/>
Oct 23 21:29:00 user nova-compute[74337]:   </features>
Oct 23 21:29:00 user nova-compute[74337]: </domainCapabilities>
Oct 23 21:29:00 user nova-compute[74337]:  {{(pid=74337) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 23 21:29:00 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Oct 23 21:29:00 user nova-compute[74337]: <domainCapabilities>
Oct 23 21:29:00 user nova-compute[74337]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 23 21:29:00 user nova-compute[74337]:   <domain>kvm</domain>
Oct 23 21:29:00 user nova-compute[74337]:   <machine>pc-q35-6.2</machine>
Oct 23 21:29:00 user nova-compute[74337]:   <arch>x86_64</arch>
Oct 23 21:29:00 user nova-compute[74337]:   <vcpu max='288'/>
Oct 23 21:29:00 user nova-compute[74337]:   <iothreads supported='yes'/>
Oct 23 21:29:00 user nova-compute[74337]:   <os supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:     <enum name='firmware'>
Oct 23 21:29:00 user nova-compute[74337]:       <value>efi</value>
Oct 23 21:29:00 user nova-compute[74337]:     </enum>
Oct 23 21:29:00 user nova-compute[74337]:     <loader supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Oct 23 21:29:00 user nova-compute[74337]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Oct 23 21:29:00 user nova-compute[74337]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='type'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>rom</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>pflash</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='readonly'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>yes</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>no</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='secure'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>yes</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>no</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:     </loader>
Oct 23 21:29:00 user nova-compute[74337]:   </os>
Oct 23 21:29:00 user nova-compute[74337]:   <cpu>
Oct 23 21:29:00 user nova-compute[74337]:     <mode name='host-passthrough' supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='hostPassthroughMigratable'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>on</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>off</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:     </mode>
Oct 23 21:29:00 user nova-compute[74337]:     <mode name='maximum' supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='maximumMigratable'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>on</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>off</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:     </mode>
Oct 23 21:29:00 user nova-compute[74337]:     <mode name='host-model' supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <vendor>Intel</vendor>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='ss'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='vmx'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='pcid'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='hypervisor'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='arat'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='tsc_adjust'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='umip'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='md-clear'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='stibp'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='arch-capabilities'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='ssbd'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='invtsc'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='ibpb'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='ibrs'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='amd-stibp'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='amd-ssbd'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='rsba'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='pschange-mc-no'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='disable' name='erms'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='disable' name='xsaveopt'/>
Oct 23 21:29:00 user nova-compute[74337]:     </mode>
Oct 23 21:29:00 user nova-compute[74337]:     <mode name='custom' supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>qemu64</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='yes'>qemu32</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>phenom</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='yes'>pentium3</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='yes'>pentium2</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='yes'>pentium</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>n270</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='yes'>kvm64</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='yes'>kvm32</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='yes'>coreduo</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='yes'>core2duo</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>athlon</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='yes'>Westmere-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='yes'>Westmere</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Snowridge</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Skylake-Server</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Skylake-Client</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>SandyBridge</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='yes'>Penryn</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Opteron_G5</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Opteron_G4</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Opteron_G3</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Opteron_G2</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='yes'>Opteron_G1</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='yes'>Nehalem</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>IvyBridge</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Icelake-Server</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Haswell-noTSX</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Haswell-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Haswell</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>EPYC-Rome</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>EPYC-Milan</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>EPYC-IBPB</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>EPYC</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Dhyana</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Cooperlake</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='yes'>Conroe</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Cascadelake-Server</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Broadwell-noTSX</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Broadwell-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Broadwell</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='yes'>486</model>
Oct 23 21:29:00 user nova-compute[74337]:     </mode>
Oct 23 21:29:00 user nova-compute[74337]:   </cpu>
Oct 23 21:29:00 user nova-compute[74337]:   <memoryBacking supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:     <enum name='sourceType'>
Oct 23 21:29:00 user nova-compute[74337]:       <value>file</value>
Oct 23 21:29:00 user nova-compute[74337]:       <value>anonymous</value>
Oct 23 21:29:00 user nova-compute[74337]:       <value>memfd</value>
Oct 23 21:29:00 user nova-compute[74337]:     </enum>
Oct 23 21:29:00 user nova-compute[74337]:   </memoryBacking>
Oct 23 21:29:00 user nova-compute[74337]:   <devices>
Oct 23 21:29:00 user nova-compute[74337]:     <disk supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='diskDevice'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>disk</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>cdrom</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>floppy</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>lun</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='bus'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>fdc</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>scsi</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>virtio</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>usb</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>sata</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='model'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>virtio</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>virtio-transitional</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>virtio-non-transitional</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:     </disk>
Oct 23 21:29:00 user nova-compute[74337]:     <graphics supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='type'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>sdl</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>vnc</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>spice</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>egl-headless</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:     </graphics>
Oct 23 21:29:00 user nova-compute[74337]:     <video supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='modelType'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>vga</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>cirrus</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>vmvga</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>qxl</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>virtio</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>none</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>bochs</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>ramfb</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:     </video>
Oct 23 21:29:00 user nova-compute[74337]:     <hostdev supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='mode'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>subsystem</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='startupPolicy'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>default</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>mandatory</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>requisite</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>optional</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='subsysType'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>usb</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>pci</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>scsi</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='capsType'/>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='pciBackend'/>
Oct 23 21:29:00 user nova-compute[74337]:     </hostdev>
Oct 23 21:29:00 user nova-compute[74337]:     <rng supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='model'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>virtio</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>virtio-transitional</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>virtio-non-transitional</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='backendModel'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>random</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>egd</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>builtin</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:     </rng>
Oct 23 21:29:00 user nova-compute[74337]:     <filesystem supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='driverType'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>path</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>handle</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>virtiofs</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:     </filesystem>
Oct 23 21:29:00 user nova-compute[74337]:     <tpm supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='model'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>tpm-tis</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>tpm-crb</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='backendModel'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>passthrough</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>emulator</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:     </tpm>
Oct 23 21:29:00 user nova-compute[74337]:   </devices>
Oct 23 21:29:00 user nova-compute[74337]:   <features>
Oct 23 21:29:00 user nova-compute[74337]:     <gic supported='no'/>
Oct 23 21:29:00 user nova-compute[74337]:     <vmcoreinfo supported='yes'/>
Oct 23 21:29:00 user nova-compute[74337]:     <genid supported='yes'/>
Oct 23 21:29:00 user nova-compute[74337]:     <backingStoreInput supported='yes'/>
Oct 23 21:29:00 user nova-compute[74337]:     <backup supported='yes'/>
Oct 23 21:29:00 user nova-compute[74337]:     <sev supported='no'/>
Oct 23 21:29:00 user nova-compute[74337]:   </features>
Oct 23 21:29:00 user nova-compute[74337]: </domainCapabilities>
Oct 23 21:29:00 user nova-compute[74337]:  {{(pid=74337) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 23 21:29:00 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Oct 23 21:29:00 user nova-compute[74337]: <domainCapabilities>
Oct 23 21:29:00 user nova-compute[74337]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 23 21:29:00 user nova-compute[74337]:   <domain>kvm</domain>
Oct 23 21:29:00 user nova-compute[74337]:   <machine>pc-i440fx-6.2</machine>
Oct 23 21:29:00 user nova-compute[74337]:   <arch>x86_64</arch>
Oct 23 21:29:00 user nova-compute[74337]:   <vcpu max='255'/>
Oct 23 21:29:00 user nova-compute[74337]:   <iothreads supported='yes'/>
Oct 23 21:29:00 user nova-compute[74337]:   <os supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:     <enum name='firmware'>
Oct 23 21:29:00 user nova-compute[74337]:       <value>efi</value>
Oct 23 21:29:00 user nova-compute[74337]:     </enum>
Oct 23 21:29:00 user nova-compute[74337]:     <loader supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='type'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>rom</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>pflash</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='readonly'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>yes</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>no</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='secure'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>no</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:     </loader>
Oct 23 21:29:00 user nova-compute[74337]:   </os>
Oct 23 21:29:00 user nova-compute[74337]:   <cpu>
Oct 23 21:29:00 user nova-compute[74337]:     <mode name='host-passthrough' supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='hostPassthroughMigratable'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>on</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>off</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:     </mode>
Oct 23 21:29:00 user nova-compute[74337]:     <mode name='maximum' supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='maximumMigratable'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>on</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>off</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:     </mode>
Oct 23 21:29:00 user nova-compute[74337]:     <mode name='host-model' supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <vendor>Intel</vendor>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='ss'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='vmx'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='pcid'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='hypervisor'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='arat'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='tsc_adjust'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='umip'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='md-clear'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='stibp'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='arch-capabilities'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='ssbd'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='invtsc'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='ibpb'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='ibrs'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='amd-stibp'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='amd-ssbd'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='rsba'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='require' name='pschange-mc-no'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='disable' name='erms'/>
Oct 23 21:29:00 user nova-compute[74337]:       <feature policy='disable' name='xsaveopt'/>
Oct 23 21:29:00 user nova-compute[74337]:     </mode>
Oct 23 21:29:00 user nova-compute[74337]:     <mode name='custom' supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>qemu64</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='yes'>qemu32</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>phenom</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='yes'>pentium3</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='yes'>pentium2</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='yes'>pentium</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>n270</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='yes'>kvm64</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='yes'>kvm32</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='yes'>coreduo</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='yes'>core2duo</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>athlon</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='yes'>Westmere-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='yes'>Westmere</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Snowridge</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Skylake-Server</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Skylake-Client</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>SandyBridge</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='yes'>Penryn</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Opteron_G5</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Opteron_G4</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Opteron_G3</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Opteron_G2</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='yes'>Opteron_G1</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='yes'>Nehalem</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>IvyBridge</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Icelake-Server</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Haswell-noTSX</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Haswell-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Haswell</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>EPYC-Rome</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>EPYC-Milan</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>EPYC-IBPB</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>EPYC</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Dhyana</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Cooperlake</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='yes'>Conroe</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Cascadelake-Server</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Broadwell-noTSX</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Broadwell-IBRS</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='no'>Broadwell</model>
Oct 23 21:29:00 user nova-compute[74337]:       <model usable='yes'>486</model>
Oct 23 21:29:00 user nova-compute[74337]:     </mode>
Oct 23 21:29:00 user nova-compute[74337]:   </cpu>
Oct 23 21:29:00 user nova-compute[74337]:   <memoryBacking supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:     <enum name='sourceType'>
Oct 23 21:29:00 user nova-compute[74337]:       <value>file</value>
Oct 23 21:29:00 user nova-compute[74337]:       <value>anonymous</value>
Oct 23 21:29:00 user nova-compute[74337]:       <value>memfd</value>
Oct 23 21:29:00 user nova-compute[74337]:     </enum>
Oct 23 21:29:00 user nova-compute[74337]:   </memoryBacking>
Oct 23 21:29:00 user nova-compute[74337]:   <devices>
Oct 23 21:29:00 user nova-compute[74337]:     <disk supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='diskDevice'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>disk</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>cdrom</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>floppy</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>lun</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='bus'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>ide</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>fdc</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>scsi</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>virtio</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>usb</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>sata</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='model'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>virtio</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>virtio-transitional</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>virtio-non-transitional</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:     </disk>
Oct 23 21:29:00 user nova-compute[74337]:     <graphics supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='type'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>sdl</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>vnc</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>spice</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>egl-headless</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:     </graphics>
Oct 23 21:29:00 user nova-compute[74337]:     <video supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='modelType'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>vga</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>cirrus</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>vmvga</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>qxl</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>virtio</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>none</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>bochs</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>ramfb</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:     </video>
Oct 23 21:29:00 user nova-compute[74337]:     <hostdev supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='mode'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>subsystem</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='startupPolicy'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>default</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>mandatory</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>requisite</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>optional</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='subsysType'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>usb</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>pci</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>scsi</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='capsType'/>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='pciBackend'/>
Oct 23 21:29:00 user nova-compute[74337]:     </hostdev>
Oct 23 21:29:00 user nova-compute[74337]:     <rng supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='model'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>virtio</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>virtio-transitional</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>virtio-non-transitional</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='backendModel'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>random</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>egd</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>builtin</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:     </rng>
Oct 23 21:29:00 user nova-compute[74337]:     <filesystem supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='driverType'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>path</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>handle</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>virtiofs</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:     </filesystem>
Oct 23 21:29:00 user nova-compute[74337]:     <tpm supported='yes'>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='model'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>tpm-tis</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>tpm-crb</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:       <enum name='backendModel'>
Oct 23 21:29:00 user nova-compute[74337]:         <value>passthrough</value>
Oct 23 21:29:00 user nova-compute[74337]:         <value>emulator</value>
Oct 23 21:29:00 user nova-compute[74337]:       </enum>
Oct 23 21:29:00 user nova-compute[74337]:     </tpm>
Oct 23 21:29:00 user nova-compute[74337]:   </devices>
Oct 23 21:29:00 user nova-compute[74337]:   <features>
Oct 23 21:29:00 user nova-compute[74337]:     <gic supported='no'/>
Oct 23 21:29:00 user nova-compute[74337]:     <vmcoreinfo supported='yes'/>
Oct 23 21:29:00 user nova-compute[74337]:     <genid supported='yes'/>
Oct 23 21:29:00 user nova-compute[74337]:     <backingStoreInput supported='yes'/>
Oct 23 21:29:00 user nova-compute[74337]:     <backup supported='yes'/>
Oct 23 21:29:00 user nova-compute[74337]:     <sev supported='no'/>
Oct 23 21:29:00 user nova-compute[74337]:   </features>
Oct 23 21:29:00 user nova-compute[74337]: </domainCapabilities>
Oct 23 21:29:00 user nova-compute[74337]:  {{(pid=74337) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 23 21:29:00 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=74337) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 21:29:00 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=74337) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 21:29:00 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=74337) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 23 21:29:00 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=74337) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 23 21:29:00 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] Checking secure boot support for host arch (x86_64) {{(pid=74337) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Oct 23 21:29:00 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] Checking secure boot support for host arch (x86_64) {{(pid=74337) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Oct 23 21:29:00 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] Checking secure boot support for host arch (x86_64) {{(pid=74337) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Oct 23 21:29:00 user nova-compute[74337]: INFO nova.virt.libvirt.host [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] Secure Boot support detected
Oct 23 21:29:00 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] cpu compare xml: <cpu match="exact">
Oct 23 21:29:00 user nova-compute[74337]:   <model>Nehalem</model>
Oct 23 21:29:00 user nova-compute[74337]: </cpu>
Oct 23 21:29:00 user nova-compute[74337]:  {{(pid=74337) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Oct 23 21:29:00 user nova-compute[74337]: INFO nova.virt.node [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] Generated node identity dfcf3942-a432-4293-945b-14b86f57d794
Oct 23 21:29:00 user nova-compute[74337]: INFO nova.virt.node [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] Wrote node identity dfcf3942-a432-4293-945b-14b86f57d794 to /opt/stack/data/nova/compute_id
Oct 23 21:29:00 user nova-compute[74337]: WARNING nova.compute.manager [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] Compute nodes ['dfcf3942-a432-4293-945b-14b86f57d794'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Oct 23 21:29:00 user nova-compute[74337]: INFO nova.compute.manager [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Oct 23 21:29:00 user nova-compute[74337]: WARNING nova.compute.manager [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Oct 23 21:29:00 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:29:00 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:29:00 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:29:00 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] Auditing locally available compute resources for user (node: user) {{(pid=74337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 21:29:00 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:29:00 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:29:00 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] Hypervisor/Node resource view: name=user free_ram=10956MB free_disk=26.246429443359375GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 21:29:00 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:29:00 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:29:00 user nova-compute[74337]: WARNING nova.compute.resource_tracker [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] No compute node record for user:dfcf3942-a432-4293-945b-14b86f57d794: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host dfcf3942-a432-4293-945b-14b86f57d794 could not be found.
Oct 23 21:29:00 user nova-compute[74337]: INFO nova.compute.resource_tracker [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] Compute node record created for user:user with uuid: dfcf3942-a432-4293-945b-14b86f57d794
Oct 23 21:29:00 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 21:29:00 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 21:29:01 user nova-compute[74337]: INFO nova.scheduler.client.report [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] [req-16893720-9758-4065-b137-8e8b20513831] Created resource provider record via placement API for resource provider with UUID dfcf3942-a432-4293-945b-14b86f57d794 and name user.
Oct 23 21:29:01 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=74337) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Oct 23 21:29:01 user nova-compute[74337]: INFO nova.virt.libvirt.host [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] kernel doesn't support AMD SEV
Oct 23 21:29:01 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] Updating inventory in ProviderTree for provider dfcf3942-a432-4293-945b-14b86f57d794 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 23 21:29:01 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 21:29:01 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] Libvirt baseline CPU <cpu>
Oct 23 21:29:01 user nova-compute[74337]:   <arch>x86_64</arch>
Oct 23 21:29:01 user nova-compute[74337]:   <model>Nehalem</model>
Oct 23 21:29:01 user nova-compute[74337]:   <vendor>Intel</vendor>
Oct 23 21:29:01 user nova-compute[74337]:   <topology sockets="6" cores="1" threads="1"/>
Oct 23 21:29:01 user nova-compute[74337]: </cpu>
Oct 23 21:29:01 user nova-compute[74337]:  {{(pid=74337) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Oct 23 21:29:01 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] Updated inventory for provider dfcf3942-a432-4293-945b-14b86f57d794 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Oct 23 21:29:01 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] Updating resource provider dfcf3942-a432-4293-945b-14b86f57d794 generation from 0 to 1 during operation: update_inventory {{(pid=74337) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Oct 23 21:29:01 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] Updating inventory in ProviderTree for provider dfcf3942-a432-4293-945b-14b86f57d794 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 23 21:29:01 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] Updating resource provider dfcf3942-a432-4293-945b-14b86f57d794 generation from 1 to 2 during operation: update_traits {{(pid=74337) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Oct 23 21:29:01 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] Compute_service record updated for user:user {{(pid=74337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 21:29:01 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.637s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:29:01 user nova-compute[74337]: DEBUG nova.service [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] Creating RPC server for service compute {{(pid=74337) start /opt/stack/nova/nova/service.py:182}}
Oct 23 21:29:01 user nova-compute[74337]: DEBUG nova.service [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] Join ServiceGroup membership for this service compute {{(pid=74337) start /opt/stack/nova/nova/service.py:199}}
Oct 23 21:29:01 user nova-compute[74337]: DEBUG nova.servicegroup.drivers.db [None req-7f8a61b6-edcb-4d1f-a92d-a2e4fa9c6ddb None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=74337) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Oct 23 21:29:44 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:29:44 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:29:52 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:29:52 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:29:52 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Starting heal instance info cache {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 21:29:52 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Rebuilding the list of instances to heal {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 21:29:52 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Didn't find any instances for network info cache update. {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 23 21:29:52 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:29:52 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:29:52 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:29:52 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:29:52 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:29:52 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:29:52 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 21:29:52 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:29:52 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:29:52 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:29:52 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:29:52 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Auditing locally available compute resources for user (node: user) {{(pid=74337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 21:29:52 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:29:52 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:29:52 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Hypervisor/Node resource view: name=user free_ram=10382MB free_disk=26.150081634521484GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 21:29:52 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:29:52 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:29:52 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 21:29:52 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 21:29:52 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:29:52 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:29:52 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Compute_service record updated for user:user {{(pid=74337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 21:29:52 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.172s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:30:52 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:30:52 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:30:52 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:30:53 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:30:53 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Starting heal instance info cache {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 21:30:53 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Rebuilding the list of instances to heal {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 21:30:53 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Didn't find any instances for network info cache update. {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 23 21:30:53 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:30:53 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:30:53 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:30:53 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 21:30:54 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:30:54 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:30:54 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:30:54 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:30:54 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:30:54 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:30:54 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Auditing locally available compute resources for user (node: user) {{(pid=74337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 21:30:54 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:30:54 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:30:54 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Hypervisor/Node resource view: name=user free_ram=10311MB free_disk=26.20328140258789GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 21:30:54 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:30:54 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:30:54 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 21:30:54 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 21:30:54 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:30:54 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:30:54 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Compute_service record updated for user:user {{(pid=74337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 21:30:54 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.100s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:31:52 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:31:53 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:31:54 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:31:54 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:31:54 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:31:54 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 21:31:54 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:31:54 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:31:54 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:31:54 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:31:54 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Auditing locally available compute resources for user (node: user) {{(pid=74337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 21:31:54 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:31:54 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:31:54 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Hypervisor/Node resource view: name=user free_ram=10353MB free_disk=25.967823028564453GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 21:31:54 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:31:54 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:31:54 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 21:31:54 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 21:31:54 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:31:54 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:31:54 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Compute_service record updated for user:user {{(pid=74337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 21:31:54 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.167s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:31:55 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:31:55 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Starting heal instance info cache {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 21:31:55 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Rebuilding the list of instances to heal {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 21:31:55 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Didn't find any instances for network info cache update. {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 23 21:31:55 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:31:56 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:32:52 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:32:54 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:32:54 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:32:54 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:32:54 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 21:32:55 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:32:55 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:32:56 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:32:56 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:32:56 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Starting heal instance info cache {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 21:32:56 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Rebuilding the list of instances to heal {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 21:32:56 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Didn't find any instances for network info cache update. {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 23 21:32:56 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:32:56 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:32:56 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:32:56 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:32:56 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:32:56 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Auditing locally available compute resources for user (node: user) {{(pid=74337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 21:32:56 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:32:56 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:32:56 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Hypervisor/Node resource view: name=user free_ram=9576MB free_disk=25.98746109008789GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 21:32:56 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:32:56 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:32:56 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 21:32:56 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 21:32:56 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:32:56 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:32:57 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Compute_service record updated for user:user {{(pid=74337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 21:32:57 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.158s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:32:59 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Acquiring lock "05b80b08-f66c-4cc6-b806-f25543536bfa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:32:59 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Lock "05b80b08-f66c-4cc6-b806-f25543536bfa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:32:59 user nova-compute[74337]: DEBUG nova.compute.manager [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] [instance: 05b80b08-f66c-4cc6-b806-f25543536bfa] Starting instance... {{(pid=74337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 21:33:00 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:33:00 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:33:00 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 21:33:00 user nova-compute[74337]: INFO nova.compute.claims [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] [instance: 05b80b08-f66c-4cc6-b806-f25543536bfa] Claim successful on node user
Oct 23 21:33:00 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:33:00 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:33:00 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.311s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:33:00 user nova-compute[74337]: DEBUG nova.compute.manager [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] [instance: 05b80b08-f66c-4cc6-b806-f25543536bfa] Start building networks asynchronously for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 21:33:01 user nova-compute[74337]: DEBUG nova.compute.manager [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] [instance: 05b80b08-f66c-4cc6-b806-f25543536bfa] Allocating IP information in the background. {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 21:33:01 user nova-compute[74337]: DEBUG nova.network.neutron [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] [instance: 05b80b08-f66c-4cc6-b806-f25543536bfa] allocate_for_instance() {{(pid=74337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 21:33:01 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] [instance: 05b80b08-f66c-4cc6-b806-f25543536bfa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 21:33:01 user nova-compute[74337]: DEBUG nova.compute.manager [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] [instance: 05b80b08-f66c-4cc6-b806-f25543536bfa] Start building block device mappings for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 21:33:01 user nova-compute[74337]: DEBUG nova.compute.manager [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] [instance: 05b80b08-f66c-4cc6-b806-f25543536bfa] Start spawning the instance on the hypervisor. {{(pid=74337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 21:33:01 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] [instance: 05b80b08-f66c-4cc6-b806-f25543536bfa] Creating instance directory {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 21:33:01 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] [instance: 05b80b08-f66c-4cc6-b806-f25543536bfa] Creating image(s)
Oct 23 21:33:01 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Acquiring lock "/opt/stack/data/nova/instances/05b80b08-f66c-4cc6-b806-f25543536bfa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:33:01 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Lock "/opt/stack/data/nova/instances/05b80b08-f66c-4cc6-b806-f25543536bfa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:33:01 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Lock "/opt/stack/data/nova/instances/05b80b08-f66c-4cc6-b806-f25543536bfa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:33:01 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Acquiring lock "fc7b140751b8c385de81623e40fb09ce09374ab7" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:33:01 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Lock "fc7b140751b8c385de81623e40fb09ce09374ab7" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:33:01 user nova-compute[74337]: DEBUG nova.policy [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '249a875f6a784bd58a5b80583a92d72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3411c1b9d3c847498ccfe3f0ef368dae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74337) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 21:33:02 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7.part --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:33:02 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7.part --force-share --output=json" returned: 0 in 0.196s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:33:02 user nova-compute[74337]: DEBUG nova.virt.images [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] d859d89d-998d-4109-b26a-0d6e28152932 was qcow2, converting to raw {{(pid=74337) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 23 21:33:02 user nova-compute[74337]: DEBUG nova.privsep.utils [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74337) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 23 21:33:02 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7.part /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7.converted {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:33:02 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7.part /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7.converted" returned: 0 in 0.169s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:33:02 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7.converted --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:33:03 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7.converted --force-share --output=json" returned: 0 in 0.198s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:33:03 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Lock "fc7b140751b8c385de81623e40fb09ce09374ab7" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.786s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:33:03 user nova-compute[74337]: INFO oslo.privsep.daemon [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmphy8zpr20/privsep.sock']
Oct 23 21:33:03 user sudo[83584]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmphy8zpr20/privsep.sock
Oct 23 21:33:03 user sudo[83584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 23 21:33:04 user nova-compute[74337]: DEBUG nova.network.neutron [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] [instance: 05b80b08-f66c-4cc6-b806-f25543536bfa] Successfully created port: 3373880f-4797-411f-9e90-104572cca818 {{(pid=74337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 21:33:04 user sudo[83584]: pam_unix(sudo:session): session closed for user root
Oct 23 21:33:04 user nova-compute[74337]: INFO oslo.privsep.daemon [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Spawned new privsep daemon via rootwrap
Oct 23 21:33:04 user nova-compute[74337]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 23 21:33:04 user nova-compute[74337]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 23 21:33:04 user nova-compute[74337]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Oct 23 21:33:04 user nova-compute[74337]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83589
Oct 23 21:33:04 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:33:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.182s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:33:05 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Acquiring lock "fc7b140751b8c385de81623e40fb09ce09374ab7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:33:05 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Lock "fc7b140751b8c385de81623e40fb09ce09374ab7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:33:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:33:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.169s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:33:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7,backing_fmt=raw /opt/stack/data/nova/instances/05b80b08-f66c-4cc6-b806-f25543536bfa/disk 1073741824 {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:33:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7,backing_fmt=raw /opt/stack/data/nova/instances/05b80b08-f66c-4cc6-b806-f25543536bfa/disk 1073741824" returned: 0 in 0.041s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:33:05 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Lock "fc7b140751b8c385de81623e40fb09ce09374ab7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.215s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:33:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:33:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.168s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:33:05 user nova-compute[74337]: DEBUG nova.virt.disk.api [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Checking if we can resize image /opt/stack/data/nova/instances/05b80b08-f66c-4cc6-b806-f25543536bfa/disk. size=1073741824 {{(pid=74337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 21:33:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05b80b08-f66c-4cc6-b806-f25543536bfa/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:33:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05b80b08-f66c-4cc6-b806-f25543536bfa/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:33:05 user nova-compute[74337]: DEBUG nova.virt.disk.api [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Cannot resize image /opt/stack/data/nova/instances/05b80b08-f66c-4cc6-b806-f25543536bfa/disk to a smaller size. {{(pid=74337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 21:33:05 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] [instance: 05b80b08-f66c-4cc6-b806-f25543536bfa] Created local disks {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 21:33:05 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] [instance: 05b80b08-f66c-4cc6-b806-f25543536bfa] Ensure instance console log exists: /opt/stack/data/nova/instances/05b80b08-f66c-4cc6-b806-f25543536bfa/console.log {{(pid=74337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 21:33:05 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:33:05 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:33:05 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:33:06 user nova-compute[74337]: DEBUG nova.network.neutron [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] [instance: 05b80b08-f66c-4cc6-b806-f25543536bfa] Successfully updated port: 3373880f-4797-411f-9e90-104572cca818 {{(pid=74337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 21:33:06 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Acquiring lock "refresh_cache-05b80b08-f66c-4cc6-b806-f25543536bfa" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:33:06 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Acquired lock "refresh_cache-05b80b08-f66c-4cc6-b806-f25543536bfa" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:33:06 user nova-compute[74337]: DEBUG nova.network.neutron [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] [instance: 05b80b08-f66c-4cc6-b806-f25543536bfa] Building network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 21:33:06 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-30b7d05d-6333-4fff-8588-2875d1c0ddf9 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] Acquiring lock "cf6270ba-7a4e-40c4-b7fd-c62a44125c89" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:33:06 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-30b7d05d-6333-4fff-8588-2875d1c0ddf9 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] Lock "cf6270ba-7a4e-40c4-b7fd-c62a44125c89" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:33:06 user nova-compute[74337]: DEBUG nova.compute.manager [None req-30b7d05d-6333-4fff-8588-2875d1c0ddf9 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89] Starting instance... {{(pid=74337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 21:33:07 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-30b7d05d-6333-4fff-8588-2875d1c0ddf9 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:33:07 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-30b7d05d-6333-4fff-8588-2875d1c0ddf9 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:33:07 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-30b7d05d-6333-4fff-8588-2875d1c0ddf9 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 21:33:07 user nova-compute[74337]: INFO nova.compute.claims [None req-30b7d05d-6333-4fff-8588-2875d1c0ddf9 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89] Claim successful on node user
Oct 23 21:33:07 user nova-compute[74337]: DEBUG nova.network.neutron [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] [instance: 05b80b08-f66c-4cc6-b806-f25543536bfa] Instance cache missing network info. {{(pid=74337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 21:33:07 user nova-compute[74337]: DEBUG nova.compute.manager [req-0e8fd636-f97b-4a85-96d8-ed11a336729c req-bab9409a-e909-45b1-96b2-c3216e21d06b service nova] [instance: 05b80b08-f66c-4cc6-b806-f25543536bfa] Received event network-changed-3373880f-4797-411f-9e90-104572cca818 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:33:07 user nova-compute[74337]: DEBUG nova.compute.manager [req-0e8fd636-f97b-4a85-96d8-ed11a336729c req-bab9409a-e909-45b1-96b2-c3216e21d06b service nova] [instance: 05b80b08-f66c-4cc6-b806-f25543536bfa] Refreshing instance network info cache due to event network-changed-3373880f-4797-411f-9e90-104572cca818. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 21:33:07 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-0e8fd636-f97b-4a85-96d8-ed11a336729c req-bab9409a-e909-45b1-96b2-c3216e21d06b service nova] Acquiring lock "refresh_cache-05b80b08-f66c-4cc6-b806-f25543536bfa" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:33:07 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-30b7d05d-6333-4fff-8588-2875d1c0ddf9 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:33:07 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-30b7d05d-6333-4fff-8588-2875d1c0ddf9 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:33:07 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-30b7d05d-6333-4fff-8588-2875d1c0ddf9 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.538s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:33:07 user nova-compute[74337]: DEBUG nova.compute.manager [None req-30b7d05d-6333-4fff-8588-2875d1c0ddf9 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89] Start building networks asynchronously for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 21:33:07 user nova-compute[74337]: DEBUG nova.compute.manager [None req-30b7d05d-6333-4fff-8588-2875d1c0ddf9 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89] Allocating IP information in the background. {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 21:33:07 user nova-compute[74337]: DEBUG nova.network.neutron [None req-30b7d05d-6333-4fff-8588-2875d1c0ddf9 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89] allocate_for_instance() {{(pid=74337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 21:33:07 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-30b7d05d-6333-4fff-8588-2875d1c0ddf9 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 21:33:07 user nova-compute[74337]: DEBUG nova.compute.manager [None req-30b7d05d-6333-4fff-8588-2875d1c0ddf9 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89] Start building block device mappings for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 21:33:08 user nova-compute[74337]: DEBUG nova.compute.manager [None req-30b7d05d-6333-4fff-8588-2875d1c0ddf9 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89] Start spawning the instance on the hypervisor. {{(pid=74337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 21:33:08 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-30b7d05d-6333-4fff-8588-2875d1c0ddf9 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89] Creating instance directory {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 21:33:08 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-30b7d05d-6333-4fff-8588-2875d1c0ddf9 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89] Creating image(s)
Oct 23 21:33:08 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-30b7d05d-6333-4fff-8588-2875d1c0ddf9 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] Acquiring lock "/opt/stack/data/nova/instances/cf6270ba-7a4e-40c4-b7fd-c62a44125c89/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:33:08 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-30b7d05d-6333-4fff-8588-2875d1c0ddf9 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] Lock "/opt/stack/data/nova/instances/cf6270ba-7a4e-40c4-b7fd-c62a44125c89/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:33:08 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-30b7d05d-6333-4fff-8588-2875d1c0ddf9 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] Lock "/opt/stack/data/nova/instances/cf6270ba-7a4e-40c4-b7fd-c62a44125c89/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:33:08 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-30b7d05d-6333-4fff-8588-2875d1c0ddf9 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:33:08 user nova-compute[74337]: DEBUG nova.policy [None req-30b7d05d-6333-4fff-8588-2875d1c0ddf9 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a09f292f96924276a76d524aee8dc667', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2877cbc901948b68f6f8c588f29d89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74337) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 21:33:08 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-30b7d05d-6333-4fff-8588-2875d1c0ddf9 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.168s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:33:08 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-30b7d05d-6333-4fff-8588-2875d1c0ddf9 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] Acquiring lock "fc7b140751b8c385de81623e40fb09ce09374ab7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:33:08 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-30b7d05d-6333-4fff-8588-2875d1c0ddf9 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] Lock "fc7b140751b8c385de81623e40fb09ce09374ab7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:33:08 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-30b7d05d-6333-4fff-8588-2875d1c0ddf9 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:33:08 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-30b7d05d-6333-4fff-8588-2875d1c0ddf9 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.201s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:33:08 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-30b7d05d-6333-4fff-8588-2875d1c0ddf9 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7,backing_fmt=raw /opt/stack/data/nova/instances/cf6270ba-7a4e-40c4-b7fd-c62a44125c89/disk 1073741824 {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:33:08 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-30b7d05d-6333-4fff-8588-2875d1c0ddf9 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7,backing_fmt=raw /opt/stack/data/nova/instances/cf6270ba-7a4e-40c4-b7fd-c62a44125c89/disk 1073741824" returned: 0 in 0.041s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:33:08 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-30b7d05d-6333-4fff-8588-2875d1c0ddf9 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] Lock "fc7b140751b8c385de81623e40fb09ce09374ab7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:33:08 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-30b7d05d-6333-4fff-8588-2875d1c0ddf9 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:33:08 user nova-compute[74337]: DEBUG nova.network.neutron [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] [instance: 05b80b08-f66c-4cc6-b806-f25543536bfa] Updating instance_info_cache with network_info: [{"id": "3373880f-4797-411f-9e90-104572cca818", "address": "fa:16:3e:a8:ad:5b", "network": {"id": "decd291a-5626-4c07-9568-d019eb36dd28", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1526257557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3411c1b9d3c847498ccfe3f0ef368dae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3373880f-47", "ovs_interfaceid": "3373880f-4797-411f-9e90-104572cca818", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:33:08 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Releasing lock "refresh_cache-05b80b08-f66c-4cc6-b806-f25543536bfa" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:33:08 user nova-compute[74337]: DEBUG nova.compute.manager [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] [instance: 05b80b08-f66c-4cc6-b806-f25543536bfa] Instance network_info: |[{"id": "3373880f-4797-411f-9e90-104572cca818", "address": "fa:16:3e:a8:ad:5b", "network": {"id": "decd291a-5626-4c07-9568-d019eb36dd28", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1526257557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3411c1b9d3c847498ccfe3f0ef368dae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3373880f-47", "ovs_interfaceid": "3373880f-4797-411f-9e90-104572cca818", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 21:33:08 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-0e8fd636-f97b-4a85-96d8-ed11a336729c req-bab9409a-e909-45b1-96b2-c3216e21d06b service nova] Acquired lock "refresh_cache-05b80b08-f66c-4cc6-b806-f25543536bfa" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:33:08 user nova-compute[74337]: DEBUG nova.network.neutron [req-0e8fd636-f97b-4a85-96d8-ed11a336729c req-bab9409a-e909-45b1-96b2-c3216e21d06b service nova] [instance: 05b80b08-f66c-4cc6-b806-f25543536bfa] Refreshing network info cache for port 3373880f-4797-411f-9e90-104572cca818 {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 21:33:08 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] [instance: 05b80b08-f66c-4cc6-b806-f25543536bfa] Start _get_guest_xml network_info=[{"id": "3373880f-4797-411f-9e90-104572cca818", "address": "fa:16:3e:a8:ad:5b", "network": {"id": "decd291a-5626-4c07-9568-d019eb36dd28", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1526257557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3411c1b9d3c847498ccfe3f0ef368dae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3373880f-47", "ovs_interfaceid": "3373880f-4797-411f-9e90-104572cca818", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T21:29:21Z,direct_url=<?>,disk_format='qcow2',id=d859d89d-998d-4109-b26a-0d6e28152932,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ff43462300764979a6cf688444336a56',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T21:29:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'image_id': 'd859d89d-998d-4109-b26a-0d6e28152932'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 21:33:08 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:33:08 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:33:08 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 21:33:08 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] CPU controller missing on host. {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 21:33:08 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 21:33:08 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] CPU controller found on host. {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 21:33:08 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 21:33:08 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T21:29:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T21:29:21Z,direct_url=<?>,disk_format='qcow2',id=d859d89d-998d-4109-b26a-0d6e28152932,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ff43462300764979a6cf688444336a56',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T21:29:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 21:33:08 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Flavor limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 21:33:08 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Image limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 21:33:08 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Flavor pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 21:33:08 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Image pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 21:33:08 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 21:33:08 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 21:33:08 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 21:33:08 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Got 1 possible topologies {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 21:33:08 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 21:33:08 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 21:33:08 user nova-compute[74337]: DEBUG nova.privsep.utils [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74337) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 23 21:33:08 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:32:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-608663478',display_name='tempest-DeleteServersTestJSON-server-608663478',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-608663478',id=1,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3411c1b9d3c847498ccfe3f0ef368dae',ramdisk_id='',reservation_id='r-00wfxijp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-741709678',owner_user_name='tempest-DeleteServersTestJSON-741709678-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:33:01Z,user_data=None,user_id='249a875f6a784bd58a5b80583a92d72d',uuid=05b80b08-f66c-4cc6-b806-f25543536bfa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3373880f-4797-411f-9e90-104572cca818", "address": "fa:16:3e:a8:ad:5b", "network": {"id": "decd291a-5626-4c07-9568-d019eb36dd28", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1526257557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3411c1b9d3c847498ccfe3f0ef368dae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3373880f-47", "ovs_interfaceid": "3373880f-4797-411f-9e90-104572cca818", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 21:33:08 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Converting VIF {"id": "3373880f-4797-411f-9e90-104572cca818", "address": "fa:16:3e:a8:ad:5b", "network": {"id": "decd291a-5626-4c07-9568-d019eb36dd28", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1526257557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3411c1b9d3c847498ccfe3f0ef368dae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3373880f-47", "ovs_interfaceid": "3373880f-4797-411f-9e90-104572cca818", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:33:08 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:ad:5b,bridge_name='br-int',has_traffic_filtering=True,id=3373880f-4797-411f-9e90-104572cca818,network=Network(decd291a-5626-4c07-9568-d019eb36dd28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3373880f-47') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:33:08 user nova-compute[74337]: DEBUG nova.objects.instance [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Lazy-loading 'pci_devices' on Instance uuid 05b80b08-f66c-4cc6-b806-f25543536bfa {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:33:08 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-30b7d05d-6333-4fff-8588-2875d1c0ddf9 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.222s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:33:08 user nova-compute[74337]: DEBUG nova.virt.disk.api [None req-30b7d05d-6333-4fff-8588-2875d1c0ddf9 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cf6270ba-7a4e-40c4-b7fd-c62a44125c89/disk. size=1073741824 {{(pid=74337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 21:33:08 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-30b7d05d-6333-4fff-8588-2875d1c0ddf9 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf6270ba-7a4e-40c4-b7fd-c62a44125c89/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:33:08 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] [instance: 05b80b08-f66c-4cc6-b806-f25543536bfa] End _get_guest_xml xml=<domain type="kvm">
Oct 23 21:33:08 user nova-compute[74337]:   <uuid>05b80b08-f66c-4cc6-b806-f25543536bfa</uuid>
Oct 23 21:33:08 user nova-compute[74337]:   <name>instance-00000001</name>
Oct 23 21:33:08 user nova-compute[74337]:   <memory>524288</memory>
Oct 23 21:33:08 user nova-compute[74337]:   <vcpu>1</vcpu>
Oct 23 21:33:08 user nova-compute[74337]:   <metadata>
Oct 23 21:33:08 user nova-compute[74337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 21:33:08 user nova-compute[74337]:       <nova:package version="0.0.0"/>
Oct 23 21:33:08 user nova-compute[74337]:       <nova:name>tempest-DeleteServersTestJSON-server-608663478</nova:name>
Oct 23 21:33:08 user nova-compute[74337]:       <nova:creationTime>2023-10-23 21:33:08</nova:creationTime>
Oct 23 21:33:08 user nova-compute[74337]:       <nova:flavor name="m1.tiny">
Oct 23 21:33:08 user nova-compute[74337]:         <nova:memory>512</nova:memory>
Oct 23 21:33:08 user nova-compute[74337]:         <nova:disk>1</nova:disk>
Oct 23 21:33:08 user nova-compute[74337]:         <nova:swap>0</nova:swap>
Oct 23 21:33:08 user nova-compute[74337]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 21:33:08 user nova-compute[74337]:         <nova:vcpus>1</nova:vcpus>
Oct 23 21:33:08 user nova-compute[74337]:       </nova:flavor>
Oct 23 21:33:08 user nova-compute[74337]:       <nova:owner>
Oct 23 21:33:08 user nova-compute[74337]:         <nova:user uuid="249a875f6a784bd58a5b80583a92d72d">tempest-DeleteServersTestJSON-741709678-project-member</nova:user>
Oct 23 21:33:08 user nova-compute[74337]:         <nova:project uuid="3411c1b9d3c847498ccfe3f0ef368dae">tempest-DeleteServersTestJSON-741709678</nova:project>
Oct 23 21:33:08 user nova-compute[74337]:       </nova:owner>
Oct 23 21:33:08 user nova-compute[74337]:       <nova:root type="image" uuid="d859d89d-998d-4109-b26a-0d6e28152932"/>
Oct 23 21:33:08 user nova-compute[74337]:       <nova:ports>
Oct 23 21:33:08 user nova-compute[74337]:         <nova:port uuid="3373880f-4797-411f-9e90-104572cca818">
Oct 23 21:33:08 user nova-compute[74337]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 23 21:33:08 user nova-compute[74337]:         </nova:port>
Oct 23 21:33:08 user nova-compute[74337]:       </nova:ports>
Oct 23 21:33:08 user nova-compute[74337]:     </nova:instance>
Oct 23 21:33:08 user nova-compute[74337]:   </metadata>
Oct 23 21:33:08 user nova-compute[74337]:   <sysinfo type="smbios">
Oct 23 21:33:08 user nova-compute[74337]:     <system>
Oct 23 21:33:08 user nova-compute[74337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 21:33:08 user nova-compute[74337]:       <entry name="product">OpenStack Nova</entry>
Oct 23 21:33:08 user nova-compute[74337]:       <entry name="version">0.0.0</entry>
Oct 23 21:33:08 user nova-compute[74337]:       <entry name="serial">05b80b08-f66c-4cc6-b806-f25543536bfa</entry>
Oct 23 21:33:08 user nova-compute[74337]:       <entry name="uuid">05b80b08-f66c-4cc6-b806-f25543536bfa</entry>
Oct 23 21:33:08 user nova-compute[74337]:       <entry name="family">Virtual Machine</entry>
Oct 23 21:33:08 user nova-compute[74337]:     </system>
Oct 23 21:33:08 user nova-compute[74337]:   </sysinfo>
Oct 23 21:33:08 user nova-compute[74337]:   <os>
Oct 23 21:33:08 user nova-compute[74337]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 21:33:08 user nova-compute[74337]:     <boot dev="hd"/>
Oct 23 21:33:08 user nova-compute[74337]:     <smbios mode="sysinfo"/>
Oct 23 21:33:08 user nova-compute[74337]:   </os>
Oct 23 21:33:08 user nova-compute[74337]:   <features>
Oct 23 21:33:08 user nova-compute[74337]:     <acpi/>
Oct 23 21:33:08 user nova-compute[74337]:     <apic/>
Oct 23 21:33:08 user nova-compute[74337]:     <vmcoreinfo/>
Oct 23 21:33:08 user nova-compute[74337]:   </features>
Oct 23 21:33:08 user nova-compute[74337]:   <clock offset="utc">
Oct 23 21:33:08 user nova-compute[74337]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 21:33:08 user nova-compute[74337]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 21:33:08 user nova-compute[74337]:     <timer name="hpet" present="no"/>
Oct 23 21:33:08 user nova-compute[74337]:   </clock>
Oct 23 21:33:08 user nova-compute[74337]:   <cpu mode="custom" match="exact">
Oct 23 21:33:08 user nova-compute[74337]:     <model>Nehalem</model>
Oct 23 21:33:08 user nova-compute[74337]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 21:33:08 user nova-compute[74337]:   </cpu>
Oct 23 21:33:08 user nova-compute[74337]:   <devices>
Oct 23 21:33:08 user nova-compute[74337]:     <disk type="file" device="disk">
Oct 23 21:33:08 user nova-compute[74337]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 21:33:08 user nova-compute[74337]:       <source file="/opt/stack/data/nova/instances/05b80b08-f66c-4cc6-b806-f25543536bfa/disk"/>
Oct 23 21:33:08 user nova-compute[74337]:       <target dev="vda" bus="virtio"/>
Oct 23 21:33:08 user nova-compute[74337]:     </disk>
Oct 23 21:33:08 user nova-compute[74337]:     <interface type="ethernet">
Oct 23 21:33:08 user nova-compute[74337]:       <mac address="fa:16:3e:a8:ad:5b"/>
Oct 23 21:33:08 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:33:08 user nova-compute[74337]:       <mtu size="1442"/>
Oct 23 21:33:08 user nova-compute[74337]:       <target dev="tap3373880f-47"/>
Oct 23 21:33:08 user nova-compute[74337]:     </interface>
Oct 23 21:33:08 user nova-compute[74337]:     <serial type="pty">
Oct 23 21:33:08 user nova-compute[74337]:       <log file="/opt/stack/data/nova/instances/05b80b08-f66c-4cc6-b806-f25543536bfa/console.log" append="off"/>
Oct 23 21:33:08 user nova-compute[74337]:     </serial>
Oct 23 21:33:08 user nova-compute[74337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 21:33:08 user nova-compute[74337]:     <video>
Oct 23 21:33:08 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:33:08 user nova-compute[74337]:     </video>
Oct 23 21:33:08 user nova-compute[74337]:     <rng model="virtio">
Oct 23 21:33:08 user nova-compute[74337]:       <backend model="random">/dev/urandom</backend>
Oct 23 21:33:08 user nova-compute[74337]:     </rng>
Oct 23 21:33:08 user nova-compute[74337]:     <controller type="usb" index="0" model="none"/>
Oct 23 21:33:08 user nova-compute[74337]:     <memballoon model="virtio">
Oct 23 21:33:08 user nova-compute[74337]:       <stats period="10"/>
Oct 23 21:33:08 user nova-compute[74337]:     </memballoon>
Oct 23 21:33:08 user nova-compute[74337]:   </devices>
Oct 23 21:33:08 user nova-compute[74337]: </domain>
Oct 23 21:33:08 user nova-compute[74337]:  {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 21:33:08 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:32:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-608663478',display_name='tempest-DeleteServersTestJSON-server-608663478',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-608663478',id=1,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3411c1b9d3c847498ccfe3f0ef368dae',ramdisk_id='',reservation_id='r-00wfxijp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-741709678',owner_user_name='tempest-DeleteServersTestJSON-741709678-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:33:01Z,user_data=None,user_id='249a875f6a784bd58a5b80583a92d72d',uuid=05b80b08-f66c-4cc6-b806-f25543536bfa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3373880f-4797-411f-9e90-104572cca818", "address": "fa:16:3e:a8:ad:5b", "network": {"id": "decd291a-5626-4c07-9568-d019eb36dd28", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1526257557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3411c1b9d3c847498ccfe3f0ef368dae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3373880f-47", "ovs_interfaceid": "3373880f-4797-411f-9e90-104572cca818", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 21:33:08 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Converting VIF {"id": "3373880f-4797-411f-9e90-104572cca818", "address": "fa:16:3e:a8:ad:5b", "network": {"id": "decd291a-5626-4c07-9568-d019eb36dd28", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1526257557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3411c1b9d3c847498ccfe3f0ef368dae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3373880f-47", "ovs_interfaceid": "3373880f-4797-411f-9e90-104572cca818", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:33:08 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:ad:5b,bridge_name='br-int',has_traffic_filtering=True,id=3373880f-4797-411f-9e90-104572cca818,network=Network(decd291a-5626-4c07-9568-d019eb36dd28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3373880f-47') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:33:08 user nova-compute[74337]: DEBUG os_vif [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:ad:5b,bridge_name='br-int',has_traffic_filtering=True,id=3373880f-4797-411f-9e90-104572cca818,network=Network(decd291a-5626-4c07-9568-d019eb36dd28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3373880f-47') {{(pid=74337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 21:33:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Created schema index Interface.name {{(pid=74337) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 23 21:33:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Created schema index Port.name {{(pid=74337) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 23 21:33:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Created schema index Bridge.name {{(pid=74337) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 23 21:33:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 21:33:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] [POLLOUT] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 21:33:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:08 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-30b7d05d-6333-4fff-8588-2875d1c0ddf9 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf6270ba-7a4e-40c4-b7fd-c62a44125c89/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:33:08 user nova-compute[74337]: DEBUG nova.virt.disk.api [None req-30b7d05d-6333-4fff-8588-2875d1c0ddf9 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] Cannot resize image /opt/stack/data/nova/instances/cf6270ba-7a4e-40c4-b7fd-c62a44125c89/disk to a smaller size. {{(pid=74337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 21:33:08 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-30b7d05d-6333-4fff-8588-2875d1c0ddf9 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89] Created local disks {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 21:33:08 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-30b7d05d-6333-4fff-8588-2875d1c0ddf9 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89] Ensure instance console log exists: /opt/stack/data/nova/instances/cf6270ba-7a4e-40c4-b7fd-c62a44125c89/console.log {{(pid=74337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 21:33:08 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-30b7d05d-6333-4fff-8588-2875d1c0ddf9 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:33:08 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-30b7d05d-6333-4fff-8588-2875d1c0ddf9 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:33:08 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-30b7d05d-6333-4fff-8588-2875d1c0ddf9 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:33:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:33:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 21:33:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4f6d9239-febf-525c-babd-4f6c6e991352', '_type': 'linux-noop'}}, row=False) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:33:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:33:09 user nova-compute[74337]: INFO oslo.privsep.daemon [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmp2nn0ar0j/privsep.sock']
Oct 23 21:33:09 user sudo[83635]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmp2nn0ar0j/privsep.sock
Oct 23 21:33:09 user sudo[83635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 23 21:33:09 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4c3ee9c6-598c-4949-b246-42f0195f73b1 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Acquiring lock "d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:33:09 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4c3ee9c6-598c-4949-b246-42f0195f73b1 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Lock "d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:33:09 user nova-compute[74337]: DEBUG nova.compute.manager [None req-4c3ee9c6-598c-4949-b246-42f0195f73b1 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Starting instance... {{(pid=74337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 21:33:09 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4c3ee9c6-598c-4949-b246-42f0195f73b1 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:33:09 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4c3ee9c6-598c-4949-b246-42f0195f73b1 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:33:09 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-4c3ee9c6-598c-4949-b246-42f0195f73b1 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 21:33:09 user nova-compute[74337]: INFO nova.compute.claims [None req-4c3ee9c6-598c-4949-b246-42f0195f73b1 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Claim successful on node user
Oct 23 21:33:09 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-4c3ee9c6-598c-4949-b246-42f0195f73b1 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:33:09 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-4c3ee9c6-598c-4949-b246-42f0195f73b1 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:33:09 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4c3ee9c6-598c-4949-b246-42f0195f73b1 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.279s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:33:09 user nova-compute[74337]: DEBUG nova.compute.manager [None req-4c3ee9c6-598c-4949-b246-42f0195f73b1 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Start building networks asynchronously for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 21:33:09 user nova-compute[74337]: DEBUG nova.compute.manager [None req-4c3ee9c6-598c-4949-b246-42f0195f73b1 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Allocating IP information in the background. {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 21:33:09 user nova-compute[74337]: DEBUG nova.network.neutron [None req-4c3ee9c6-598c-4949-b246-42f0195f73b1 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] allocate_for_instance() {{(pid=74337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 21:33:09 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-4c3ee9c6-598c-4949-b246-42f0195f73b1 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 21:33:09 user nova-compute[74337]: DEBUG nova.compute.manager [None req-4c3ee9c6-598c-4949-b246-42f0195f73b1 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Start building block device mappings for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 21:33:09 user nova-compute[74337]: DEBUG nova.network.neutron [req-0e8fd636-f97b-4a85-96d8-ed11a336729c req-bab9409a-e909-45b1-96b2-c3216e21d06b service nova] [instance: 05b80b08-f66c-4cc6-b806-f25543536bfa] Updated VIF entry in instance network info cache for port 3373880f-4797-411f-9e90-104572cca818. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 21:33:09 user nova-compute[74337]: DEBUG nova.network.neutron [req-0e8fd636-f97b-4a85-96d8-ed11a336729c req-bab9409a-e909-45b1-96b2-c3216e21d06b service nova] [instance: 05b80b08-f66c-4cc6-b806-f25543536bfa] Updating instance_info_cache with network_info: [{"id": "3373880f-4797-411f-9e90-104572cca818", "address": "fa:16:3e:a8:ad:5b", "network": {"id": "decd291a-5626-4c07-9568-d019eb36dd28", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1526257557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3411c1b9d3c847498ccfe3f0ef368dae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3373880f-47", "ovs_interfaceid": "3373880f-4797-411f-9e90-104572cca818", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:33:09 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-0e8fd636-f97b-4a85-96d8-ed11a336729c req-bab9409a-e909-45b1-96b2-c3216e21d06b service nova] Releasing lock "refresh_cache-05b80b08-f66c-4cc6-b806-f25543536bfa" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:33:10 user nova-compute[74337]: DEBUG nova.compute.manager [None req-4c3ee9c6-598c-4949-b246-42f0195f73b1 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Start spawning the instance on the hypervisor. {{(pid=74337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 21:33:10 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-4c3ee9c6-598c-4949-b246-42f0195f73b1 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Creating instance directory {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 21:33:10 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-4c3ee9c6-598c-4949-b246-42f0195f73b1 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Creating image(s)
Oct 23 21:33:10 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4c3ee9c6-598c-4949-b246-42f0195f73b1 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Acquiring lock "/opt/stack/data/nova/instances/d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:33:10 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4c3ee9c6-598c-4949-b246-42f0195f73b1 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Lock "/opt/stack/data/nova/instances/d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:33:10 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4c3ee9c6-598c-4949-b246-42f0195f73b1 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Lock "/opt/stack/data/nova/instances/d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:33:10 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-4c3ee9c6-598c-4949-b246-42f0195f73b1 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:33:10 user nova-compute[74337]: DEBUG nova.policy [None req-4c3ee9c6-598c-4949-b246-42f0195f73b1 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '92570d8849c646d882017142cac1b674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17117e60d0d9484d80c0bc8de393921c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74337) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 21:33:10 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-4c3ee9c6-598c-4949-b246-42f0195f73b1 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.211s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:33:10 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4c3ee9c6-598c-4949-b246-42f0195f73b1 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Acquiring lock "fc7b140751b8c385de81623e40fb09ce09374ab7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:33:10 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4c3ee9c6-598c-4949-b246-42f0195f73b1 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Lock "fc7b140751b8c385de81623e40fb09ce09374ab7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:33:10 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-4c3ee9c6-598c-4949-b246-42f0195f73b1 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:33:10 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-4c3ee9c6-598c-4949-b246-42f0195f73b1 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.183s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:33:10 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-4c3ee9c6-598c-4949-b246-42f0195f73b1 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7,backing_fmt=raw /opt/stack/data/nova/instances/d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50/disk 1073741824 {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:33:10 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-4c3ee9c6-598c-4949-b246-42f0195f73b1 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7,backing_fmt=raw /opt/stack/data/nova/instances/d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50/disk 1073741824" returned: 0 in 0.045s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:33:10 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4c3ee9c6-598c-4949-b246-42f0195f73b1 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Lock "fc7b140751b8c385de81623e40fb09ce09374ab7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:33:10 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-4c3ee9c6-598c-4949-b246-42f0195f73b1 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:33:10 user sudo[83635]: pam_unix(sudo:session): session closed for user root
Oct 23 21:33:10 user nova-compute[74337]: INFO oslo.privsep.daemon [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Spawned new privsep daemon via rootwrap
Oct 23 21:33:10 user nova-compute[74337]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 23 21:33:10 user nova-compute[74337]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 23 21:33:10 user nova-compute[74337]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Oct 23 21:33:10 user nova-compute[74337]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83646
Oct 23 21:33:10 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-4c3ee9c6-598c-4949-b246-42f0195f73b1 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.178s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:33:10 user nova-compute[74337]: DEBUG nova.virt.disk.api [None req-4c3ee9c6-598c-4949-b246-42f0195f73b1 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50/disk. size=1073741824 {{(pid=74337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 21:33:10 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-4c3ee9c6-598c-4949-b246-42f0195f73b1 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:33:10 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-4c3ee9c6-598c-4949-b246-42f0195f73b1 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:33:10 user nova-compute[74337]: DEBUG nova.virt.disk.api [None req-4c3ee9c6-598c-4949-b246-42f0195f73b1 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Cannot resize image /opt/stack/data/nova/instances/d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50/disk to a smaller size. {{(pid=74337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 21:33:10 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-4c3ee9c6-598c-4949-b246-42f0195f73b1 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Created local disks {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 21:33:10 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-4c3ee9c6-598c-4949-b246-42f0195f73b1 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Ensure instance console log exists: /opt/stack/data/nova/instances/d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50/console.log {{(pid=74337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 21:33:10 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4c3ee9c6-598c-4949-b246-42f0195f73b1 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:33:10 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4c3ee9c6-598c-4949-b246-42f0195f73b1 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:33:10 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4c3ee9c6-598c-4949-b246-42f0195f73b1 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:33:11 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:11 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:11 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3373880f-47, may_exist=True, interface_attrs={}) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:33:11 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3373880f-47, col_values=(('qos', UUID('56fd66eb-4933-41d9-adc4-7b8a7353d374')),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:33:11 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3373880f-47, col_values=(('external_ids', {'iface-id': '3373880f-4797-411f-9e90-104572cca818', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a8:ad:5b', 'vm-uuid': '05b80b08-f66c-4cc6-b806-f25543536bfa'}),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:33:11 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:11 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:33:11 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:11 user nova-compute[74337]: INFO os_vif [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:ad:5b,bridge_name='br-int',has_traffic_filtering=True,id=3373880f-4797-411f-9e90-104572cca818,network=Network(decd291a-5626-4c07-9568-d019eb36dd28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3373880f-47')
Oct 23 21:33:11 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] No BDM found with device name vda, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 21:33:11 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] No VIF found with MAC fa:16:3e:a8:ad:5b, not building metadata {{(pid=74337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 21:33:11 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:11 user nova-compute[74337]: DEBUG nova.network.neutron [None req-30b7d05d-6333-4fff-8588-2875d1c0ddf9 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89] Successfully created port: d6e114a4-cf61-4a19-bb3d-e0bcbfc5f5e5 {{(pid=74337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 21:33:11 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:11 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:12 user nova-compute[74337]: DEBUG nova.network.neutron [None req-4c3ee9c6-598c-4949-b246-42f0195f73b1 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Successfully created port: 872b2a23-8054-4d26-b798-c0099d1c9a91 {{(pid=74337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 21:33:12 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:12 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:12 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:12 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:12 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:12 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:14 user nova-compute[74337]: DEBUG nova.compute.manager [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] [instance: 05b80b08-f66c-4cc6-b806-f25543536bfa] Instance event wait completed in 0 seconds for  {{(pid=74337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 21:33:14 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] [instance: 05b80b08-f66c-4cc6-b806-f25543536bfa] Guest created on hypervisor {{(pid=74337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 21:33:14 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:14 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: 05b80b08-f66c-4cc6-b806-f25543536bfa] Instance spawned successfully.
Oct 23 21:33:14 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] [instance: 05b80b08-f66c-4cc6-b806-f25543536bfa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 21:33:14 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] [instance: 05b80b08-f66c-4cc6-b806-f25543536bfa] Found default for hw_cdrom_bus of ide {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:33:14 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] [instance: 05b80b08-f66c-4cc6-b806-f25543536bfa] Found default for hw_disk_bus of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:33:14 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] [instance: 05b80b08-f66c-4cc6-b806-f25543536bfa] Found default for hw_input_bus of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:33:14 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] [instance: 05b80b08-f66c-4cc6-b806-f25543536bfa] Found default for hw_pointer_model of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:33:14 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] [instance: 05b80b08-f66c-4cc6-b806-f25543536bfa] Found default for hw_video_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:33:14 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] [instance: 05b80b08-f66c-4cc6-b806-f25543536bfa] Found default for hw_vif_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:33:14 user nova-compute[74337]: INFO nova.compute.manager [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] [instance: 05b80b08-f66c-4cc6-b806-f25543536bfa] Took 13.30 seconds to spawn the instance on the hypervisor.
Oct 23 21:33:14 user nova-compute[74337]: DEBUG nova.compute.manager [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] [instance: 05b80b08-f66c-4cc6-b806-f25543536bfa] Checking state {{(pid=74337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 21:33:14 user nova-compute[74337]: INFO nova.compute.manager [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] [instance: 05b80b08-f66c-4cc6-b806-f25543536bfa] Took 14.81 seconds to build instance.
Oct 23 21:33:14 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-e54e57d8-abde-4968-a962-4b85d0bf996b tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Lock "05b80b08-f66c-4cc6-b806-f25543536bfa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.006s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:33:15 user nova-compute[74337]: DEBUG nova.network.neutron [None req-30b7d05d-6333-4fff-8588-2875d1c0ddf9 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89] Successfully updated port: d6e114a4-cf61-4a19-bb3d-e0bcbfc5f5e5 {{(pid=74337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 21:33:15 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-30b7d05d-6333-4fff-8588-2875d1c0ddf9 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] Acquiring lock "refresh_cache-cf6270ba-7a4e-40c4-b7fd-c62a44125c89" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:33:15 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-30b7d05d-6333-4fff-8588-2875d1c0ddf9 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] Acquired lock "refresh_cache-cf6270ba-7a4e-40c4-b7fd-c62a44125c89" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:33:15 user nova-compute[74337]: DEBUG nova.network.neutron [None req-30b7d05d-6333-4fff-8588-2875d1c0ddf9 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89] Building network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 21:33:15 user nova-compute[74337]: DEBUG nova.network.neutron [None req-4c3ee9c6-598c-4949-b246-42f0195f73b1 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Successfully updated port: 872b2a23-8054-4d26-b798-c0099d1c9a91 {{(pid=74337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 21:33:15 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4c3ee9c6-598c-4949-b246-42f0195f73b1 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Acquiring lock "refresh_cache-d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:33:15 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4c3ee9c6-598c-4949-b246-42f0195f73b1 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Acquired lock "refresh_cache-d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:33:15 user nova-compute[74337]: DEBUG nova.network.neutron [None req-4c3ee9c6-598c-4949-b246-42f0195f73b1 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Building network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 21:33:15 user nova-compute[74337]: DEBUG nova.network.neutron [None req-30b7d05d-6333-4fff-8588-2875d1c0ddf9 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89] Instance cache missing network info. {{(pid=74337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 21:33:15 user nova-compute[74337]: DEBUG nova.network.neutron [None req-4c3ee9c6-598c-4949-b246-42f0195f73b1 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Instance cache missing network info. {{(pid=74337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 21:33:15 user nova-compute[74337]: DEBUG nova.compute.manager [req-8e29d3c5-21fc-4658-9892-215cac8dd705 req-01cf9708-9795-42eb-8b5c-b174dd0e1bf1 service nova] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Received event network-changed-872b2a23-8054-4d26-b798-c0099d1c9a91 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:33:15 user nova-compute[74337]: DEBUG nova.compute.manager [req-8e29d3c5-21fc-4658-9892-215cac8dd705 req-01cf9708-9795-42eb-8b5c-b174dd0e1bf1 service nova] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Refreshing instance network info cache due to event network-changed-872b2a23-8054-4d26-b798-c0099d1c9a91. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 21:33:15 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-8e29d3c5-21fc-4658-9892-215cac8dd705 req-01cf9708-9795-42eb-8b5c-b174dd0e1bf1 service nova] Acquiring lock "refresh_cache-d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:33:15 user nova-compute[74337]: DEBUG nova.compute.manager [req-af77ac61-6510-41a9-b39f-46f686ce320d req-17a40b04-f7a8-4c09-b417-12a3d25e3bcd service nova] [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89] Received event network-changed-d6e114a4-cf61-4a19-bb3d-e0bcbfc5f5e5 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:33:15 user nova-compute[74337]: DEBUG nova.compute.manager [req-af77ac61-6510-41a9-b39f-46f686ce320d req-17a40b04-f7a8-4c09-b417-12a3d25e3bcd service nova] [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89] Refreshing instance network info cache due to event network-changed-d6e114a4-cf61-4a19-bb3d-e0bcbfc5f5e5. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 21:33:15 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-af77ac61-6510-41a9-b39f-46f686ce320d req-17a40b04-f7a8-4c09-b417-12a3d25e3bcd service nova] Acquiring lock "refresh_cache-cf6270ba-7a4e-40c4-b7fd-c62a44125c89" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:33:15 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:16 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:16 user nova-compute[74337]: DEBUG nova.network.neutron [None req-4c3ee9c6-598c-4949-b246-42f0195f73b1 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Updating instance_info_cache with network_info: [{"id": "872b2a23-8054-4d26-b798-c0099d1c9a91", "address": "fa:16:3e:30:a6:90", "network": {"id": "b6a24032-0229-4ebe-83a3-8804e494838c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1472404179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17117e60d0d9484d80c0bc8de393921c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap872b2a23-80", "ovs_interfaceid": "872b2a23-8054-4d26-b798-c0099d1c9a91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:33:16 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4c3ee9c6-598c-4949-b246-42f0195f73b1 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Releasing lock "refresh_cache-d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:33:16 user nova-compute[74337]: DEBUG nova.compute.manager [None req-4c3ee9c6-598c-4949-b246-42f0195f73b1 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Instance network_info: |[{"id": "872b2a23-8054-4d26-b798-c0099d1c9a91", "address": "fa:16:3e:30:a6:90", "network": {"id": "b6a24032-0229-4ebe-83a3-8804e494838c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1472404179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17117e60d0d9484d80c0bc8de393921c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap872b2a23-80", "ovs_interfaceid": "872b2a23-8054-4d26-b798-c0099d1c9a91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 21:33:16 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-8e29d3c5-21fc-4658-9892-215cac8dd705 req-01cf9708-9795-42eb-8b5c-b174dd0e1bf1 service nova] Acquired lock "refresh_cache-d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:33:16 user nova-compute[74337]: DEBUG nova.network.neutron [req-8e29d3c5-21fc-4658-9892-215cac8dd705 req-01cf9708-9795-42eb-8b5c-b174dd0e1bf1 service nova] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Refreshing network info cache for port 872b2a23-8054-4d26-b798-c0099d1c9a91 {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 21:33:16 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-4c3ee9c6-598c-4949-b246-42f0195f73b1 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Start _get_guest_xml network_info=[{"id": "872b2a23-8054-4d26-b798-c0099d1c9a91", "address": "fa:16:3e:30:a6:90", "network": {"id": "b6a24032-0229-4ebe-83a3-8804e494838c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1472404179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17117e60d0d9484d80c0bc8de393921c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap872b2a23-80", "ovs_interfaceid": "872b2a23-8054-4d26-b798-c0099d1c9a91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T21:29:21Z,direct_url=<?>,disk_format='qcow2',id=d859d89d-998d-4109-b26a-0d6e28152932,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ff43462300764979a6cf688444336a56',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T21:29:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'image_id': 'd859d89d-998d-4109-b26a-0d6e28152932'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 21:33:16 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-4c3ee9c6-598c-4949-b246-42f0195f73b1 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:33:16 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-4c3ee9c6-598c-4949-b246-42f0195f73b1 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:33:16 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-4c3ee9c6-598c-4949-b246-42f0195f73b1 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 21:33:16 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-4c3ee9c6-598c-4949-b246-42f0195f73b1 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] CPU controller missing on host. {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 21:33:16 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-4c3ee9c6-598c-4949-b246-42f0195f73b1 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 21:33:16 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-4c3ee9c6-598c-4949-b246-42f0195f73b1 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] CPU controller found on host. {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 21:33:16 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-4c3ee9c6-598c-4949-b246-42f0195f73b1 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 21:33:16 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-4c3ee9c6-598c-4949-b246-42f0195f73b1 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T21:29:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T21:29:21Z,direct_url=<?>,disk_format='qcow2',id=d859d89d-998d-4109-b26a-0d6e28152932,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ff43462300764979a6cf688444336a56',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T21:29:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 21:33:16 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-4c3ee9c6-598c-4949-b246-42f0195f73b1 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Flavor limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 21:33:16 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-4c3ee9c6-598c-4949-b246-42f0195f73b1 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Image limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 21:33:16 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-4c3ee9c6-598c-4949-b246-42f0195f73b1 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Flavor pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 21:33:16 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-4c3ee9c6-598c-4949-b246-42f0195f73b1 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Image pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 21:33:16 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-4c3ee9c6-598c-4949-b246-42f0195f73b1 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 21:33:16 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-4c3ee9c6-598c-4949-b246-42f0195f73b1 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 21:33:16 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-4c3ee9c6-598c-4949-b246-42f0195f73b1 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 21:33:16 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-4c3ee9c6-598c-4949-b246-42f0195f73b1 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Got 1 possible topologies {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 21:33:16 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-4c3ee9c6-598c-4949-b246-42f0195f73b1 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 21:33:16 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-4c3ee9c6-598c-4949-b246-42f0195f73b1 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 21:33:16 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-4c3ee9c6-598c-4949-b246-42f0195f73b1 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:33:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1887044710',display_name='tempest-ServerActionsTestOtherB-server-1887044710',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1887044710',id=3,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHU30kXpNK56Ek7qPPN2svMqEvJefmquCorzEt/taRsaipSAkpLIVwB8P5vsm9bHgo5LnJ4I5wS/V9f0J2TYkkYbtKjnjylT3HdP3iz0AGKDmStPt9PuAI+hC3gVCHen5Q==',key_name='tempest-keypair-1524952332',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='17117e60d0d9484d80c0bc8de393921c',ramdisk_id='',reservation_id='r-1ao5mr6t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1301864789',owner_user_name='tempest-ServerActionsTestOtherB-1301864789-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:33:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='92570d8849c646d882017142cac1b674',uuid=d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "872b2a23-8054-4d26-b798-c0099d1c9a91", "address": "fa:16:3e:30:a6:90", "network": {"id": "b6a24032-0229-4ebe-83a3-8804e494838c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1472404179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17117e60d0d9484d80c0bc8de393921c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap872b2a23-80", "ovs_interfaceid": "872b2a23-8054-4d26-b798-c0099d1c9a91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 21:33:16 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-4c3ee9c6-598c-4949-b246-42f0195f73b1 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Converting VIF {"id": "872b2a23-8054-4d26-b798-c0099d1c9a91", "address": "fa:16:3e:30:a6:90", "network": {"id": "b6a24032-0229-4ebe-83a3-8804e494838c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1472404179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17117e60d0d9484d80c0bc8de393921c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap872b2a23-80", "ovs_interfaceid": "872b2a23-8054-4d26-b798-c0099d1c9a91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:33:16 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-4c3ee9c6-598c-4949-b246-42f0195f73b1 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:a6:90,bridge_name='br-int',has_traffic_filtering=True,id=872b2a23-8054-4d26-b798-c0099d1c9a91,network=Network(b6a24032-0229-4ebe-83a3-8804e494838c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap872b2a23-80') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:33:16 user nova-compute[74337]: DEBUG nova.objects.instance [None req-4c3ee9c6-598c-4949-b246-42f0195f73b1 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Lazy-loading 'pci_devices' on Instance uuid d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:33:16 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-4c3ee9c6-598c-4949-b246-42f0195f73b1 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] End _get_guest_xml xml=<domain type="kvm">
Oct 23 21:33:16 user nova-compute[74337]:   <uuid>d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50</uuid>
Oct 23 21:33:16 user nova-compute[74337]:   <name>instance-00000003</name>
Oct 23 21:33:16 user nova-compute[74337]:   <memory>524288</memory>
Oct 23 21:33:16 user nova-compute[74337]:   <vcpu>1</vcpu>
Oct 23 21:33:16 user nova-compute[74337]:   <metadata>
Oct 23 21:33:16 user nova-compute[74337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 21:33:16 user nova-compute[74337]:       <nova:package version="0.0.0"/>
Oct 23 21:33:16 user nova-compute[74337]:       <nova:name>tempest-ServerActionsTestOtherB-server-1887044710</nova:name>
Oct 23 21:33:16 user nova-compute[74337]:       <nova:creationTime>2023-10-23 21:33:16</nova:creationTime>
Oct 23 21:33:16 user nova-compute[74337]:       <nova:flavor name="m1.tiny">
Oct 23 21:33:16 user nova-compute[74337]:         <nova:memory>512</nova:memory>
Oct 23 21:33:16 user nova-compute[74337]:         <nova:disk>1</nova:disk>
Oct 23 21:33:16 user nova-compute[74337]:         <nova:swap>0</nova:swap>
Oct 23 21:33:16 user nova-compute[74337]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 21:33:16 user nova-compute[74337]:         <nova:vcpus>1</nova:vcpus>
Oct 23 21:33:16 user nova-compute[74337]:       </nova:flavor>
Oct 23 21:33:16 user nova-compute[74337]:       <nova:owner>
Oct 23 21:33:16 user nova-compute[74337]:         <nova:user uuid="92570d8849c646d882017142cac1b674">tempest-ServerActionsTestOtherB-1301864789-project-member</nova:user>
Oct 23 21:33:16 user nova-compute[74337]:         <nova:project uuid="17117e60d0d9484d80c0bc8de393921c">tempest-ServerActionsTestOtherB-1301864789</nova:project>
Oct 23 21:33:16 user nova-compute[74337]:       </nova:owner>
Oct 23 21:33:16 user nova-compute[74337]:       <nova:root type="image" uuid="d859d89d-998d-4109-b26a-0d6e28152932"/>
Oct 23 21:33:16 user nova-compute[74337]:       <nova:ports>
Oct 23 21:33:16 user nova-compute[74337]:         <nova:port uuid="872b2a23-8054-4d26-b798-c0099d1c9a91">
Oct 23 21:33:16 user nova-compute[74337]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 23 21:33:16 user nova-compute[74337]:         </nova:port>
Oct 23 21:33:16 user nova-compute[74337]:       </nova:ports>
Oct 23 21:33:16 user nova-compute[74337]:     </nova:instance>
Oct 23 21:33:16 user nova-compute[74337]:   </metadata>
Oct 23 21:33:16 user nova-compute[74337]:   <sysinfo type="smbios">
Oct 23 21:33:16 user nova-compute[74337]:     <system>
Oct 23 21:33:16 user nova-compute[74337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 21:33:16 user nova-compute[74337]:       <entry name="product">OpenStack Nova</entry>
Oct 23 21:33:16 user nova-compute[74337]:       <entry name="version">0.0.0</entry>
Oct 23 21:33:16 user nova-compute[74337]:       <entry name="serial">d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50</entry>
Oct 23 21:33:16 user nova-compute[74337]:       <entry name="uuid">d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50</entry>
Oct 23 21:33:16 user nova-compute[74337]:       <entry name="family">Virtual Machine</entry>
Oct 23 21:33:16 user nova-compute[74337]:     </system>
Oct 23 21:33:16 user nova-compute[74337]:   </sysinfo>
Oct 23 21:33:16 user nova-compute[74337]:   <os>
Oct 23 21:33:16 user nova-compute[74337]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 21:33:16 user nova-compute[74337]:     <boot dev="hd"/>
Oct 23 21:33:16 user nova-compute[74337]:     <smbios mode="sysinfo"/>
Oct 23 21:33:16 user nova-compute[74337]:   </os>
Oct 23 21:33:16 user nova-compute[74337]:   <features>
Oct 23 21:33:16 user nova-compute[74337]:     <acpi/>
Oct 23 21:33:16 user nova-compute[74337]:     <apic/>
Oct 23 21:33:16 user nova-compute[74337]:     <vmcoreinfo/>
Oct 23 21:33:16 user nova-compute[74337]:   </features>
Oct 23 21:33:16 user nova-compute[74337]:   <clock offset="utc">
Oct 23 21:33:16 user nova-compute[74337]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 21:33:16 user nova-compute[74337]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 21:33:16 user nova-compute[74337]:     <timer name="hpet" present="no"/>
Oct 23 21:33:16 user nova-compute[74337]:   </clock>
Oct 23 21:33:16 user nova-compute[74337]:   <cpu mode="custom" match="exact">
Oct 23 21:33:16 user nova-compute[74337]:     <model>Nehalem</model>
Oct 23 21:33:16 user nova-compute[74337]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 21:33:16 user nova-compute[74337]:   </cpu>
Oct 23 21:33:16 user nova-compute[74337]:   <devices>
Oct 23 21:33:16 user nova-compute[74337]:     <disk type="file" device="disk">
Oct 23 21:33:16 user nova-compute[74337]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 21:33:16 user nova-compute[74337]:       <source file="/opt/stack/data/nova/instances/d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50/disk"/>
Oct 23 21:33:16 user nova-compute[74337]:       <target dev="vda" bus="virtio"/>
Oct 23 21:33:16 user nova-compute[74337]:     </disk>
Oct 23 21:33:16 user nova-compute[74337]:     <interface type="ethernet">
Oct 23 21:33:16 user nova-compute[74337]:       <mac address="fa:16:3e:30:a6:90"/>
Oct 23 21:33:16 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:33:16 user nova-compute[74337]:       <mtu size="1442"/>
Oct 23 21:33:16 user nova-compute[74337]:       <target dev="tap872b2a23-80"/>
Oct 23 21:33:16 user nova-compute[74337]:     </interface>
Oct 23 21:33:16 user nova-compute[74337]:     <serial type="pty">
Oct 23 21:33:16 user nova-compute[74337]:       <log file="/opt/stack/data/nova/instances/d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50/console.log" append="off"/>
Oct 23 21:33:16 user nova-compute[74337]:     </serial>
Oct 23 21:33:16 user nova-compute[74337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 21:33:16 user nova-compute[74337]:     <video>
Oct 23 21:33:16 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:33:16 user nova-compute[74337]:     </video>
Oct 23 21:33:16 user nova-compute[74337]:     <rng model="virtio">
Oct 23 21:33:16 user nova-compute[74337]:       <backend model="random">/dev/urandom</backend>
Oct 23 21:33:16 user nova-compute[74337]:     </rng>
Oct 23 21:33:16 user nova-compute[74337]:     <controller type="usb" index="0" model="none"/>
Oct 23 21:33:16 user nova-compute[74337]:     <memballoon model="virtio">
Oct 23 21:33:16 user nova-compute[74337]:       <stats period="10"/>
Oct 23 21:33:16 user nova-compute[74337]:     </memballoon>
Oct 23 21:33:16 user nova-compute[74337]:   </devices>
Oct 23 21:33:16 user nova-compute[74337]: </domain>
Oct 23 21:33:16 user nova-compute[74337]:  {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 21:33:16 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-4c3ee9c6-598c-4949-b246-42f0195f73b1 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:33:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1887044710',display_name='tempest-ServerActionsTestOtherB-server-1887044710',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1887044710',id=3,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHU30kXpNK56Ek7qPPN2svMqEvJefmquCorzEt/taRsaipSAkpLIVwB8P5vsm9bHgo5LnJ4I5wS/V9f0J2TYkkYbtKjnjylT3HdP3iz0AGKDmStPt9PuAI+hC3gVCHen5Q==',key_name='tempest-keypair-1524952332',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='17117e60d0d9484d80c0bc8de393921c',ramdisk_id='',reservation_id='r-1ao5mr6t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1301864789',owner_user_name='tempest-ServerActionsTestOtherB-1301864789-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:33:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='92570d8849c646d882017142cac1b674',uuid=d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "872b2a23-8054-4d26-b798-c0099d1c9a91", "address": "fa:16:3e:30:a6:90", "network": {"id": "b6a24032-0229-4ebe-83a3-8804e494838c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1472404179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17117e60d0d9484d80c0bc8de393921c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap872b2a23-80", "ovs_interfaceid": "872b2a23-8054-4d26-b798-c0099d1c9a91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 21:33:16 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-4c3ee9c6-598c-4949-b246-42f0195f73b1 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Converting VIF {"id": "872b2a23-8054-4d26-b798-c0099d1c9a91", "address": "fa:16:3e:30:a6:90", "network": {"id": "b6a24032-0229-4ebe-83a3-8804e494838c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1472404179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17117e60d0d9484d80c0bc8de393921c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap872b2a23-80", "ovs_interfaceid": "872b2a23-8054-4d26-b798-c0099d1c9a91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:33:16 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-4c3ee9c6-598c-4949-b246-42f0195f73b1 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:a6:90,bridge_name='br-int',has_traffic_filtering=True,id=872b2a23-8054-4d26-b798-c0099d1c9a91,network=Network(b6a24032-0229-4ebe-83a3-8804e494838c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap872b2a23-80') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:33:16 user nova-compute[74337]: DEBUG os_vif [None req-4c3ee9c6-598c-4949-b246-42f0195f73b1 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:a6:90,bridge_name='br-int',has_traffic_filtering=True,id=872b2a23-8054-4d26-b798-c0099d1c9a91,network=Network(b6a24032-0229-4ebe-83a3-8804e494838c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap872b2a23-80') {{(pid=74337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 21:33:16 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:16 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:33:16 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 21:33:16 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:16 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a05b1896-5c56-5ff6-93a0-848735048ff7', '_type': 'linux-noop'}}, row=False) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:33:16 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:33:16 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:16 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap872b2a23-80, may_exist=True, interface_attrs={}) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:33:16 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap872b2a23-80, col_values=(('qos', UUID('6a1c8f5b-b3ee-4f0c-8219-5a7ff59d72eb')),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:33:16 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap872b2a23-80, col_values=(('external_ids', {'iface-id': '872b2a23-8054-4d26-b798-c0099d1c9a91', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:30:a6:90', 'vm-uuid': 'd1dbccc7-0a00-4b8b-813d-e3ca38ee0d50'}),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:33:16 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:33:16 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:16 user nova-compute[74337]: INFO os_vif [None req-4c3ee9c6-598c-4949-b246-42f0195f73b1 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:a6:90,bridge_name='br-int',has_traffic_filtering=True,id=872b2a23-8054-4d26-b798-c0099d1c9a91,network=Network(b6a24032-0229-4ebe-83a3-8804e494838c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap872b2a23-80')
Oct 23 21:33:16 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-4c3ee9c6-598c-4949-b246-42f0195f73b1 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] No BDM found with device name vda, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 21:33:16 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-4c3ee9c6-598c-4949-b246-42f0195f73b1 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] No VIF found with MAC fa:16:3e:30:a6:90, not building metadata {{(pid=74337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 21:33:16 user nova-compute[74337]: DEBUG nova.network.neutron [None req-30b7d05d-6333-4fff-8588-2875d1c0ddf9 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89] Updating instance_info_cache with network_info: [{"id": "d6e114a4-cf61-4a19-bb3d-e0bcbfc5f5e5", "address": "fa:16:3e:8b:08:80", "network": {"id": "94117ecb-54bb-40a0-b3dc-d21eac6c8f7b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1530803655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2877cbc901948b68f6f8c588f29d89c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6e114a4-cf", "ovs_interfaceid": "d6e114a4-cf61-4a19-bb3d-e0bcbfc5f5e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:33:16 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-30b7d05d-6333-4fff-8588-2875d1c0ddf9 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] Releasing lock "refresh_cache-cf6270ba-7a4e-40c4-b7fd-c62a44125c89" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:33:16 user nova-compute[74337]: DEBUG nova.compute.manager [None req-30b7d05d-6333-4fff-8588-2875d1c0ddf9 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89] Instance network_info: |[{"id": "d6e114a4-cf61-4a19-bb3d-e0bcbfc5f5e5", "address": "fa:16:3e:8b:08:80", "network": {"id": "94117ecb-54bb-40a0-b3dc-d21eac6c8f7b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1530803655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2877cbc901948b68f6f8c588f29d89c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6e114a4-cf", "ovs_interfaceid": "d6e114a4-cf61-4a19-bb3d-e0bcbfc5f5e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 21:33:16 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-af77ac61-6510-41a9-b39f-46f686ce320d req-17a40b04-f7a8-4c09-b417-12a3d25e3bcd service nova] Acquired lock "refresh_cache-cf6270ba-7a4e-40c4-b7fd-c62a44125c89" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:33:16 user nova-compute[74337]: DEBUG nova.network.neutron [req-af77ac61-6510-41a9-b39f-46f686ce320d req-17a40b04-f7a8-4c09-b417-12a3d25e3bcd service nova] [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89] Refreshing network info cache for port d6e114a4-cf61-4a19-bb3d-e0bcbfc5f5e5 {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 21:33:16 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-30b7d05d-6333-4fff-8588-2875d1c0ddf9 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89] Start _get_guest_xml network_info=[{"id": "d6e114a4-cf61-4a19-bb3d-e0bcbfc5f5e5", "address": "fa:16:3e:8b:08:80", "network": {"id": "94117ecb-54bb-40a0-b3dc-d21eac6c8f7b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1530803655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2877cbc901948b68f6f8c588f29d89c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6e114a4-cf", "ovs_interfaceid": "d6e114a4-cf61-4a19-bb3d-e0bcbfc5f5e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T21:29:21Z,direct_url=<?>,disk_format='qcow2',id=d859d89d-998d-4109-b26a-0d6e28152932,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ff43462300764979a6cf688444336a56',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T21:29:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'image_id': 'd859d89d-998d-4109-b26a-0d6e28152932'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 21:33:16 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-30b7d05d-6333-4fff-8588-2875d1c0ddf9 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:33:16 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-30b7d05d-6333-4fff-8588-2875d1c0ddf9 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:33:16 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-30b7d05d-6333-4fff-8588-2875d1c0ddf9 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 21:33:16 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-30b7d05d-6333-4fff-8588-2875d1c0ddf9 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] CPU controller missing on host. {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 21:33:16 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-30b7d05d-6333-4fff-8588-2875d1c0ddf9 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 21:33:16 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-30b7d05d-6333-4fff-8588-2875d1c0ddf9 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] CPU controller found on host. {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 21:33:16 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-30b7d05d-6333-4fff-8588-2875d1c0ddf9 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 21:33:16 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-30b7d05d-6333-4fff-8588-2875d1c0ddf9 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T21:29:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T21:29:21Z,direct_url=<?>,disk_format='qcow2',id=d859d89d-998d-4109-b26a-0d6e28152932,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ff43462300764979a6cf688444336a56',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T21:29:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 21:33:16 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-30b7d05d-6333-4fff-8588-2875d1c0ddf9 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] Flavor limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 21:33:16 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-30b7d05d-6333-4fff-8588-2875d1c0ddf9 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] Image limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 21:33:16 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-30b7d05d-6333-4fff-8588-2875d1c0ddf9 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] Flavor pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 21:33:16 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-30b7d05d-6333-4fff-8588-2875d1c0ddf9 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] Image pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 21:33:16 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-30b7d05d-6333-4fff-8588-2875d1c0ddf9 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 21:33:16 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-30b7d05d-6333-4fff-8588-2875d1c0ddf9 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 21:33:16 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-30b7d05d-6333-4fff-8588-2875d1c0ddf9 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 21:33:16 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-30b7d05d-6333-4fff-8588-2875d1c0ddf9 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] Got 1 possible topologies {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 21:33:16 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-30b7d05d-6333-4fff-8588-2875d1c0ddf9 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 21:33:16 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-30b7d05d-6333-4fff-8588-2875d1c0ddf9 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 21:33:16 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-30b7d05d-6333-4fff-8588-2875d1c0ddf9 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:33:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1807506748',display_name='tempest-ServerStableDeviceRescueTest-server-1807506748',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1807506748',id=2,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCKAfhfYSJmBpzGrgTijINyu4Q3mJB71opW9wdqNlUAgJOt7WcELNE8A6fbXkzg5OBi07FIQ/ou8CKPcqlXP8qct1wC9f8LTz62fKL1SPRtByRFrnFXg/qMzjyoqfMRydg==',key_name='tempest-keypair-907434616',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c2877cbc901948b68f6f8c588f29d89c',ramdisk_id='',reservation_id='r-soafzqn4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-325029318',owner_user_name='tempest-ServerStableDeviceRescueTest-325029318-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:33:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a09f292f96924276a76d524aee8dc667',uuid=cf6270ba-7a4e-40c4-b7fd-c62a44125c89,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d6e114a4-cf61-4a19-bb3d-e0bcbfc5f5e5", "address": "fa:16:3e:8b:08:80", "network": {"id": "94117ecb-54bb-40a0-b3dc-d21eac6c8f7b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1530803655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2877cbc901948b68f6f8c588f29d89c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6e114a4-cf", "ovs_interfaceid": "d6e114a4-cf61-4a19-bb3d-e0bcbfc5f5e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 21:33:16 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-30b7d05d-6333-4fff-8588-2875d1c0ddf9 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] Converting VIF {"id": "d6e114a4-cf61-4a19-bb3d-e0bcbfc5f5e5", "address": "fa:16:3e:8b:08:80", "network": {"id": "94117ecb-54bb-40a0-b3dc-d21eac6c8f7b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1530803655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2877cbc901948b68f6f8c588f29d89c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6e114a4-cf", "ovs_interfaceid": "d6e114a4-cf61-4a19-bb3d-e0bcbfc5f5e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:33:16 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-30b7d05d-6333-4fff-8588-2875d1c0ddf9 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:08:80,bridge_name='br-int',has_traffic_filtering=True,id=d6e114a4-cf61-4a19-bb3d-e0bcbfc5f5e5,network=Network(94117ecb-54bb-40a0-b3dc-d21eac6c8f7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6e114a4-cf') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:33:16 user nova-compute[74337]: DEBUG nova.objects.instance [None req-30b7d05d-6333-4fff-8588-2875d1c0ddf9 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] Lazy-loading 'pci_devices' on Instance uuid cf6270ba-7a4e-40c4-b7fd-c62a44125c89 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:33:16 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-30b7d05d-6333-4fff-8588-2875d1c0ddf9 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89] End _get_guest_xml xml=<domain type="kvm">
Oct 23 21:33:16 user nova-compute[74337]:   <uuid>cf6270ba-7a4e-40c4-b7fd-c62a44125c89</uuid>
Oct 23 21:33:16 user nova-compute[74337]:   <name>instance-00000002</name>
Oct 23 21:33:16 user nova-compute[74337]:   <memory>524288</memory>
Oct 23 21:33:16 user nova-compute[74337]:   <vcpu>1</vcpu>
Oct 23 21:33:16 user nova-compute[74337]:   <metadata>
Oct 23 21:33:16 user nova-compute[74337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 21:33:16 user nova-compute[74337]:       <nova:package version="0.0.0"/>
Oct 23 21:33:16 user nova-compute[74337]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1807506748</nova:name>
Oct 23 21:33:16 user nova-compute[74337]:       <nova:creationTime>2023-10-23 21:33:16</nova:creationTime>
Oct 23 21:33:16 user nova-compute[74337]:       <nova:flavor name="m1.tiny">
Oct 23 21:33:16 user nova-compute[74337]:         <nova:memory>512</nova:memory>
Oct 23 21:33:16 user nova-compute[74337]:         <nova:disk>1</nova:disk>
Oct 23 21:33:16 user nova-compute[74337]:         <nova:swap>0</nova:swap>
Oct 23 21:33:16 user nova-compute[74337]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 21:33:16 user nova-compute[74337]:         <nova:vcpus>1</nova:vcpus>
Oct 23 21:33:16 user nova-compute[74337]:       </nova:flavor>
Oct 23 21:33:16 user nova-compute[74337]:       <nova:owner>
Oct 23 21:33:16 user nova-compute[74337]:         <nova:user uuid="a09f292f96924276a76d524aee8dc667">tempest-ServerStableDeviceRescueTest-325029318-project-member</nova:user>
Oct 23 21:33:16 user nova-compute[74337]:         <nova:project uuid="c2877cbc901948b68f6f8c588f29d89c">tempest-ServerStableDeviceRescueTest-325029318</nova:project>
Oct 23 21:33:16 user nova-compute[74337]:       </nova:owner>
Oct 23 21:33:16 user nova-compute[74337]:       <nova:root type="image" uuid="d859d89d-998d-4109-b26a-0d6e28152932"/>
Oct 23 21:33:16 user nova-compute[74337]:       <nova:ports>
Oct 23 21:33:16 user nova-compute[74337]:         <nova:port uuid="d6e114a4-cf61-4a19-bb3d-e0bcbfc5f5e5">
Oct 23 21:33:16 user nova-compute[74337]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 23 21:33:16 user nova-compute[74337]:         </nova:port>
Oct 23 21:33:16 user nova-compute[74337]:       </nova:ports>
Oct 23 21:33:16 user nova-compute[74337]:     </nova:instance>
Oct 23 21:33:16 user nova-compute[74337]:   </metadata>
Oct 23 21:33:16 user nova-compute[74337]:   <sysinfo type="smbios">
Oct 23 21:33:16 user nova-compute[74337]:     <system>
Oct 23 21:33:16 user nova-compute[74337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 21:33:16 user nova-compute[74337]:       <entry name="product">OpenStack Nova</entry>
Oct 23 21:33:16 user nova-compute[74337]:       <entry name="version">0.0.0</entry>
Oct 23 21:33:16 user nova-compute[74337]:       <entry name="serial">cf6270ba-7a4e-40c4-b7fd-c62a44125c89</entry>
Oct 23 21:33:16 user nova-compute[74337]:       <entry name="uuid">cf6270ba-7a4e-40c4-b7fd-c62a44125c89</entry>
Oct 23 21:33:16 user nova-compute[74337]:       <entry name="family">Virtual Machine</entry>
Oct 23 21:33:16 user nova-compute[74337]:     </system>
Oct 23 21:33:16 user nova-compute[74337]:   </sysinfo>
Oct 23 21:33:16 user nova-compute[74337]:   <os>
Oct 23 21:33:16 user nova-compute[74337]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 21:33:16 user nova-compute[74337]:     <boot dev="hd"/>
Oct 23 21:33:16 user nova-compute[74337]:     <smbios mode="sysinfo"/>
Oct 23 21:33:16 user nova-compute[74337]:   </os>
Oct 23 21:33:16 user nova-compute[74337]:   <features>
Oct 23 21:33:16 user nova-compute[74337]:     <acpi/>
Oct 23 21:33:16 user nova-compute[74337]:     <apic/>
Oct 23 21:33:16 user nova-compute[74337]:     <vmcoreinfo/>
Oct 23 21:33:16 user nova-compute[74337]:   </features>
Oct 23 21:33:16 user nova-compute[74337]:   <clock offset="utc">
Oct 23 21:33:16 user nova-compute[74337]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 21:33:16 user nova-compute[74337]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 21:33:16 user nova-compute[74337]:     <timer name="hpet" present="no"/>
Oct 23 21:33:16 user nova-compute[74337]:   </clock>
Oct 23 21:33:16 user nova-compute[74337]:   <cpu mode="custom" match="exact">
Oct 23 21:33:16 user nova-compute[74337]:     <model>Nehalem</model>
Oct 23 21:33:16 user nova-compute[74337]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 21:33:16 user nova-compute[74337]:   </cpu>
Oct 23 21:33:16 user nova-compute[74337]:   <devices>
Oct 23 21:33:16 user nova-compute[74337]:     <disk type="file" device="disk">
Oct 23 21:33:16 user nova-compute[74337]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 21:33:16 user nova-compute[74337]:       <source file="/opt/stack/data/nova/instances/cf6270ba-7a4e-40c4-b7fd-c62a44125c89/disk"/>
Oct 23 21:33:16 user nova-compute[74337]:       <target dev="vda" bus="virtio"/>
Oct 23 21:33:16 user nova-compute[74337]:     </disk>
Oct 23 21:33:16 user nova-compute[74337]:     <interface type="ethernet">
Oct 23 21:33:16 user nova-compute[74337]:       <mac address="fa:16:3e:8b:08:80"/>
Oct 23 21:33:16 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:33:16 user nova-compute[74337]:       <mtu size="1442"/>
Oct 23 21:33:16 user nova-compute[74337]:       <target dev="tapd6e114a4-cf"/>
Oct 23 21:33:16 user nova-compute[74337]:     </interface>
Oct 23 21:33:16 user nova-compute[74337]:     <serial type="pty">
Oct 23 21:33:16 user nova-compute[74337]:       <log file="/opt/stack/data/nova/instances/cf6270ba-7a4e-40c4-b7fd-c62a44125c89/console.log" append="off"/>
Oct 23 21:33:16 user nova-compute[74337]:     </serial>
Oct 23 21:33:16 user nova-compute[74337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 21:33:16 user nova-compute[74337]:     <video>
Oct 23 21:33:16 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:33:16 user nova-compute[74337]:     </video>
Oct 23 21:33:16 user nova-compute[74337]:     <rng model="virtio">
Oct 23 21:33:16 user nova-compute[74337]:       <backend model="random">/dev/urandom</backend>
Oct 23 21:33:16 user nova-compute[74337]:     </rng>
Oct 23 21:33:16 user nova-compute[74337]:     <controller type="usb" index="0" model="none"/>
Oct 23 21:33:16 user nova-compute[74337]:     <memballoon model="virtio">
Oct 23 21:33:16 user nova-compute[74337]:       <stats period="10"/>
Oct 23 21:33:16 user nova-compute[74337]:     </memballoon>
Oct 23 21:33:16 user nova-compute[74337]:   </devices>
Oct 23 21:33:16 user nova-compute[74337]: </domain>
Oct 23 21:33:16 user nova-compute[74337]:  {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 21:33:16 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-30b7d05d-6333-4fff-8588-2875d1c0ddf9 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:33:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1807506748',display_name='tempest-ServerStableDeviceRescueTest-server-1807506748',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1807506748',id=2,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCKAfhfYSJmBpzGrgTijINyu4Q3mJB71opW9wdqNlUAgJOt7WcELNE8A6fbXkzg5OBi07FIQ/ou8CKPcqlXP8qct1wC9f8LTz62fKL1SPRtByRFrnFXg/qMzjyoqfMRydg==',key_name='tempest-keypair-907434616',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c2877cbc901948b68f6f8c588f29d89c',ramdisk_id='',reservation_id='r-soafzqn4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-325029318',owner_user_name='tempest-ServerStableDeviceRescueTest-325029318-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:33:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a09f292f96924276a76d524aee8dc667',uuid=cf6270ba-7a4e-40c4-b7fd-c62a44125c89,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d6e114a4-cf61-4a19-bb3d-e0bcbfc5f5e5", "address": "fa:16:3e:8b:08:80", "network": {"id": "94117ecb-54bb-40a0-b3dc-d21eac6c8f7b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1530803655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2877cbc901948b68f6f8c588f29d89c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6e114a4-cf", "ovs_interfaceid": "d6e114a4-cf61-4a19-bb3d-e0bcbfc5f5e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 21:33:16 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-30b7d05d-6333-4fff-8588-2875d1c0ddf9 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] Converting VIF {"id": "d6e114a4-cf61-4a19-bb3d-e0bcbfc5f5e5", "address": "fa:16:3e:8b:08:80", "network": {"id": "94117ecb-54bb-40a0-b3dc-d21eac6c8f7b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1530803655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2877cbc901948b68f6f8c588f29d89c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6e114a4-cf", "ovs_interfaceid": "d6e114a4-cf61-4a19-bb3d-e0bcbfc5f5e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:33:16 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-30b7d05d-6333-4fff-8588-2875d1c0ddf9 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:08:80,bridge_name='br-int',has_traffic_filtering=True,id=d6e114a4-cf61-4a19-bb3d-e0bcbfc5f5e5,network=Network(94117ecb-54bb-40a0-b3dc-d21eac6c8f7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6e114a4-cf') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:33:16 user nova-compute[74337]: DEBUG os_vif [None req-30b7d05d-6333-4fff-8588-2875d1c0ddf9 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:08:80,bridge_name='br-int',has_traffic_filtering=True,id=d6e114a4-cf61-4a19-bb3d-e0bcbfc5f5e5,network=Network(94117ecb-54bb-40a0-b3dc-d21eac6c8f7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6e114a4-cf') {{(pid=74337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 21:33:16 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:16 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:33:16 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 21:33:16 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:16 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fff666c8-67d8-52bc-83a8-c19f10bdc757', '_type': 'linux-noop'}}, row=False) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:33:16 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:16 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:16 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:16 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd6e114a4-cf, may_exist=True, interface_attrs={}) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:33:16 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd6e114a4-cf, col_values=(('qos', UUID('31c92899-8dfa-4cdf-8357-fe60b2294e4a')),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:33:16 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd6e114a4-cf, col_values=(('external_ids', {'iface-id': 'd6e114a4-cf61-4a19-bb3d-e0bcbfc5f5e5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8b:08:80', 'vm-uuid': 'cf6270ba-7a4e-40c4-b7fd-c62a44125c89'}),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:33:16 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:16 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:33:16 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:16 user nova-compute[74337]: INFO os_vif [None req-30b7d05d-6333-4fff-8588-2875d1c0ddf9 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:08:80,bridge_name='br-int',has_traffic_filtering=True,id=d6e114a4-cf61-4a19-bb3d-e0bcbfc5f5e5,network=Network(94117ecb-54bb-40a0-b3dc-d21eac6c8f7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6e114a4-cf')
Oct 23 21:33:17 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-30b7d05d-6333-4fff-8588-2875d1c0ddf9 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] No BDM found with device name vda, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 21:33:17 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-30b7d05d-6333-4fff-8588-2875d1c0ddf9 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] No VIF found with MAC fa:16:3e:8b:08:80, not building metadata {{(pid=74337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 21:33:17 user nova-compute[74337]: DEBUG nova.network.neutron [req-8e29d3c5-21fc-4658-9892-215cac8dd705 req-01cf9708-9795-42eb-8b5c-b174dd0e1bf1 service nova] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Updated VIF entry in instance network info cache for port 872b2a23-8054-4d26-b798-c0099d1c9a91. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 21:33:17 user nova-compute[74337]: DEBUG nova.network.neutron [req-8e29d3c5-21fc-4658-9892-215cac8dd705 req-01cf9708-9795-42eb-8b5c-b174dd0e1bf1 service nova] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Updating instance_info_cache with network_info: [{"id": "872b2a23-8054-4d26-b798-c0099d1c9a91", "address": "fa:16:3e:30:a6:90", "network": {"id": "b6a24032-0229-4ebe-83a3-8804e494838c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1472404179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17117e60d0d9484d80c0bc8de393921c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap872b2a23-80", "ovs_interfaceid": "872b2a23-8054-4d26-b798-c0099d1c9a91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:33:17 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-8e29d3c5-21fc-4658-9892-215cac8dd705 req-01cf9708-9795-42eb-8b5c-b174dd0e1bf1 service nova] Releasing lock "refresh_cache-d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:33:17 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:17 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:18 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:18 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:18 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:18 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:18 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:19 user nova-compute[74337]: DEBUG nova.network.neutron [req-af77ac61-6510-41a9-b39f-46f686ce320d req-17a40b04-f7a8-4c09-b417-12a3d25e3bcd service nova] [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89] Updated VIF entry in instance network info cache for port d6e114a4-cf61-4a19-bb3d-e0bcbfc5f5e5. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 21:33:19 user nova-compute[74337]: DEBUG nova.network.neutron [req-af77ac61-6510-41a9-b39f-46f686ce320d req-17a40b04-f7a8-4c09-b417-12a3d25e3bcd service nova] [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89] Updating instance_info_cache with network_info: [{"id": "d6e114a4-cf61-4a19-bb3d-e0bcbfc5f5e5", "address": "fa:16:3e:8b:08:80", "network": {"id": "94117ecb-54bb-40a0-b3dc-d21eac6c8f7b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1530803655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2877cbc901948b68f6f8c588f29d89c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6e114a4-cf", "ovs_interfaceid": "d6e114a4-cf61-4a19-bb3d-e0bcbfc5f5e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:33:19 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-af77ac61-6510-41a9-b39f-46f686ce320d req-17a40b04-f7a8-4c09-b417-12a3d25e3bcd service nova] Releasing lock "refresh_cache-cf6270ba-7a4e-40c4-b7fd-c62a44125c89" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:33:19 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:19 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:19 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:19 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:19 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:20 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:20 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:20 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-9746e41f-ca57-4065-8462-d853cea59297 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Acquiring lock "d45e8ae8-371b-46ae-849d-d7f7d5bbd770" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:33:20 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-9746e41f-ca57-4065-8462-d853cea59297 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Lock "d45e8ae8-371b-46ae-849d-d7f7d5bbd770" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:33:20 user nova-compute[74337]: DEBUG nova.compute.manager [None req-9746e41f-ca57-4065-8462-d853cea59297 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] [instance: d45e8ae8-371b-46ae-849d-d7f7d5bbd770] Starting instance... {{(pid=74337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 21:33:20 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-9746e41f-ca57-4065-8462-d853cea59297 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:33:20 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-9746e41f-ca57-4065-8462-d853cea59297 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:33:20 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-9746e41f-ca57-4065-8462-d853cea59297 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 21:33:20 user nova-compute[74337]: INFO nova.compute.claims [None req-9746e41f-ca57-4065-8462-d853cea59297 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] [instance: d45e8ae8-371b-46ae-849d-d7f7d5bbd770] Claim successful on node user
Oct 23 21:33:21 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-9746e41f-ca57-4065-8462-d853cea59297 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:33:21 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-9746e41f-ca57-4065-8462-d853cea59297 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:33:21 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:21 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-9746e41f-ca57-4065-8462-d853cea59297 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.625s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:33:21 user nova-compute[74337]: DEBUG nova.compute.manager [None req-9746e41f-ca57-4065-8462-d853cea59297 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] [instance: d45e8ae8-371b-46ae-849d-d7f7d5bbd770] Start building networks asynchronously for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 21:33:21 user nova-compute[74337]: DEBUG nova.compute.manager [None req-9746e41f-ca57-4065-8462-d853cea59297 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] [instance: d45e8ae8-371b-46ae-849d-d7f7d5bbd770] Allocating IP information in the background. {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 21:33:21 user nova-compute[74337]: DEBUG nova.network.neutron [None req-9746e41f-ca57-4065-8462-d853cea59297 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] [instance: d45e8ae8-371b-46ae-849d-d7f7d5bbd770] allocate_for_instance() {{(pid=74337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 21:33:21 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-9746e41f-ca57-4065-8462-d853cea59297 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] [instance: d45e8ae8-371b-46ae-849d-d7f7d5bbd770] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 21:33:21 user nova-compute[74337]: DEBUG nova.compute.manager [None req-9746e41f-ca57-4065-8462-d853cea59297 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] [instance: d45e8ae8-371b-46ae-849d-d7f7d5bbd770] Start building block device mappings for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 21:33:21 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:21 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:21 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:21 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:21 user nova-compute[74337]: DEBUG nova.compute.manager [None req-9746e41f-ca57-4065-8462-d853cea59297 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] [instance: d45e8ae8-371b-46ae-849d-d7f7d5bbd770] Start spawning the instance on the hypervisor. {{(pid=74337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 21:33:21 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-9746e41f-ca57-4065-8462-d853cea59297 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] [instance: d45e8ae8-371b-46ae-849d-d7f7d5bbd770] Creating instance directory {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 21:33:21 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-9746e41f-ca57-4065-8462-d853cea59297 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] [instance: d45e8ae8-371b-46ae-849d-d7f7d5bbd770] Creating image(s)
Oct 23 21:33:21 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-9746e41f-ca57-4065-8462-d853cea59297 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Acquiring lock "/opt/stack/data/nova/instances/d45e8ae8-371b-46ae-849d-d7f7d5bbd770/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:33:21 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-9746e41f-ca57-4065-8462-d853cea59297 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Lock "/opt/stack/data/nova/instances/d45e8ae8-371b-46ae-849d-d7f7d5bbd770/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:33:21 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-9746e41f-ca57-4065-8462-d853cea59297 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Lock "/opt/stack/data/nova/instances/d45e8ae8-371b-46ae-849d-d7f7d5bbd770/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:33:21 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-9746e41f-ca57-4065-8462-d853cea59297 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:33:21 user nova-compute[74337]: DEBUG nova.policy [None req-9746e41f-ca57-4065-8462-d853cea59297 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1106b04eeefe488c9ead914063b88d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997b9ab7d2794438be79f11bb972be47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74337) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 21:33:21 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:21 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-9746e41f-ca57-4065-8462-d853cea59297 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.254s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:33:21 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-9746e41f-ca57-4065-8462-d853cea59297 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Acquiring lock "fc7b140751b8c385de81623e40fb09ce09374ab7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:33:21 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-9746e41f-ca57-4065-8462-d853cea59297 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Lock "fc7b140751b8c385de81623e40fb09ce09374ab7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:33:21 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-9746e41f-ca57-4065-8462-d853cea59297 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:33:22 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:22 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-9746e41f-ca57-4065-8462-d853cea59297 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.257s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:33:22 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-9746e41f-ca57-4065-8462-d853cea59297 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7,backing_fmt=raw /opt/stack/data/nova/instances/d45e8ae8-371b-46ae-849d-d7f7d5bbd770/disk 1073741824 {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:33:22 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-9746e41f-ca57-4065-8462-d853cea59297 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7,backing_fmt=raw /opt/stack/data/nova/instances/d45e8ae8-371b-46ae-849d-d7f7d5bbd770/disk 1073741824" returned: 0 in 0.091s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:33:22 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-9746e41f-ca57-4065-8462-d853cea59297 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Lock "fc7b140751b8c385de81623e40fb09ce09374ab7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.354s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:33:22 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-9746e41f-ca57-4065-8462-d853cea59297 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:33:22 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:22 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-9746e41f-ca57-4065-8462-d853cea59297 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.262s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:33:22 user nova-compute[74337]: DEBUG nova.virt.disk.api [None req-9746e41f-ca57-4065-8462-d853cea59297 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d45e8ae8-371b-46ae-849d-d7f7d5bbd770/disk. size=1073741824 {{(pid=74337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 21:33:22 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-9746e41f-ca57-4065-8462-d853cea59297 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d45e8ae8-371b-46ae-849d-d7f7d5bbd770/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:33:22 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:22 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:22 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-9746e41f-ca57-4065-8462-d853cea59297 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d45e8ae8-371b-46ae-849d-d7f7d5bbd770/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:33:22 user nova-compute[74337]: DEBUG nova.virt.disk.api [None req-9746e41f-ca57-4065-8462-d853cea59297 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Cannot resize image /opt/stack/data/nova/instances/d45e8ae8-371b-46ae-849d-d7f7d5bbd770/disk to a smaller size. {{(pid=74337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 21:33:22 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-9746e41f-ca57-4065-8462-d853cea59297 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] [instance: d45e8ae8-371b-46ae-849d-d7f7d5bbd770] Created local disks {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 21:33:22 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-9746e41f-ca57-4065-8462-d853cea59297 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] [instance: d45e8ae8-371b-46ae-849d-d7f7d5bbd770] Ensure instance console log exists: /opt/stack/data/nova/instances/d45e8ae8-371b-46ae-849d-d7f7d5bbd770/console.log {{(pid=74337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 21:33:22 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-9746e41f-ca57-4065-8462-d853cea59297 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:33:22 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-9746e41f-ca57-4065-8462-d853cea59297 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:33:22 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-9746e41f-ca57-4065-8462-d853cea59297 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:33:22 user nova-compute[74337]: DEBUG nova.compute.manager [None req-4c3ee9c6-598c-4949-b246-42f0195f73b1 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Instance event wait completed in 0 seconds for  {{(pid=74337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 21:33:22 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-4c3ee9c6-598c-4949-b246-42f0195f73b1 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Guest created on hypervisor {{(pid=74337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 21:33:22 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Instance spawned successfully.
Oct 23 21:33:22 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-4c3ee9c6-598c-4949-b246-42f0195f73b1 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 21:33:22 user nova-compute[74337]: DEBUG nova.compute.manager [None req-30b7d05d-6333-4fff-8588-2875d1c0ddf9 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89] Instance event wait completed in 0 seconds for  {{(pid=74337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 21:33:22 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-30b7d05d-6333-4fff-8588-2875d1c0ddf9 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89] Guest created on hypervisor {{(pid=74337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 21:33:23 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-4c3ee9c6-598c-4949-b246-42f0195f73b1 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Found default for hw_cdrom_bus of ide {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:33:23 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-4c3ee9c6-598c-4949-b246-42f0195f73b1 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Found default for hw_disk_bus of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:33:23 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-4c3ee9c6-598c-4949-b246-42f0195f73b1 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Found default for hw_input_bus of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:33:23 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-4c3ee9c6-598c-4949-b246-42f0195f73b1 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Found default for hw_pointer_model of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:33:23 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-4c3ee9c6-598c-4949-b246-42f0195f73b1 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Found default for hw_video_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:33:23 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-4c3ee9c6-598c-4949-b246-42f0195f73b1 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Found default for hw_vif_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:33:23 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89] Instance spawned successfully.
Oct 23 21:33:23 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-30b7d05d-6333-4fff-8588-2875d1c0ddf9 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 21:33:23 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-30b7d05d-6333-4fff-8588-2875d1c0ddf9 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89] Found default for hw_cdrom_bus of ide {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:33:23 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-30b7d05d-6333-4fff-8588-2875d1c0ddf9 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89] Found default for hw_disk_bus of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:33:23 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-30b7d05d-6333-4fff-8588-2875d1c0ddf9 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89] Found default for hw_input_bus of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:33:23 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-30b7d05d-6333-4fff-8588-2875d1c0ddf9 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89] Found default for hw_pointer_model of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:33:23 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-30b7d05d-6333-4fff-8588-2875d1c0ddf9 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89] Found default for hw_video_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:33:23 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-30b7d05d-6333-4fff-8588-2875d1c0ddf9 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89] Found default for hw_vif_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:33:23 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:23 user nova-compute[74337]: INFO nova.compute.manager [None req-4c3ee9c6-598c-4949-b246-42f0195f73b1 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Took 13.37 seconds to spawn the instance on the hypervisor.
Oct 23 21:33:23 user nova-compute[74337]: DEBUG nova.compute.manager [None req-4c3ee9c6-598c-4949-b246-42f0195f73b1 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Checking state {{(pid=74337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 21:33:23 user nova-compute[74337]: INFO nova.compute.manager [None req-30b7d05d-6333-4fff-8588-2875d1c0ddf9 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89] Took 15.43 seconds to spawn the instance on the hypervisor.
Oct 23 21:33:23 user nova-compute[74337]: DEBUG nova.compute.manager [None req-30b7d05d-6333-4fff-8588-2875d1c0ddf9 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89] Checking state {{(pid=74337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 21:33:23 user nova-compute[74337]: INFO nova.compute.manager [None req-4c3ee9c6-598c-4949-b246-42f0195f73b1 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Took 14.14 seconds to build instance.
Oct 23 21:33:23 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4c3ee9c6-598c-4949-b246-42f0195f73b1 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Lock "d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.267s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:33:23 user nova-compute[74337]: INFO nova.compute.manager [None req-30b7d05d-6333-4fff-8588-2875d1c0ddf9 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89] Took 16.51 seconds to build instance.
Oct 23 21:33:23 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-30b7d05d-6333-4fff-8588-2875d1c0ddf9 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] Lock "cf6270ba-7a4e-40c4-b7fd-c62a44125c89" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.691s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:33:23 user nova-compute[74337]: DEBUG nova.network.neutron [None req-9746e41f-ca57-4065-8462-d853cea59297 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] [instance: d45e8ae8-371b-46ae-849d-d7f7d5bbd770] Successfully created port: 7ac73679-68b0-430f-8d77-68438fbb52f0 {{(pid=74337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 21:33:24 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:25 user nova-compute[74337]: DEBUG nova.network.neutron [None req-9746e41f-ca57-4065-8462-d853cea59297 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] [instance: d45e8ae8-371b-46ae-849d-d7f7d5bbd770] Successfully updated port: 7ac73679-68b0-430f-8d77-68438fbb52f0 {{(pid=74337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 21:33:25 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-9746e41f-ca57-4065-8462-d853cea59297 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Acquiring lock "refresh_cache-d45e8ae8-371b-46ae-849d-d7f7d5bbd770" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:33:25 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-9746e41f-ca57-4065-8462-d853cea59297 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Acquired lock "refresh_cache-d45e8ae8-371b-46ae-849d-d7f7d5bbd770" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:33:25 user nova-compute[74337]: DEBUG nova.network.neutron [None req-9746e41f-ca57-4065-8462-d853cea59297 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] [instance: d45e8ae8-371b-46ae-849d-d7f7d5bbd770] Building network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 21:33:25 user nova-compute[74337]: DEBUG nova.compute.manager [req-5e99b79f-052f-4952-a37c-8c322d7556ce req-9d86bb13-18fb-4d84-99f3-a7986bb6a78f service nova] [instance: d45e8ae8-371b-46ae-849d-d7f7d5bbd770] Received event network-changed-7ac73679-68b0-430f-8d77-68438fbb52f0 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:33:25 user nova-compute[74337]: DEBUG nova.compute.manager [req-5e99b79f-052f-4952-a37c-8c322d7556ce req-9d86bb13-18fb-4d84-99f3-a7986bb6a78f service nova] [instance: d45e8ae8-371b-46ae-849d-d7f7d5bbd770] Refreshing instance network info cache due to event network-changed-7ac73679-68b0-430f-8d77-68438fbb52f0. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 21:33:25 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-5e99b79f-052f-4952-a37c-8c322d7556ce req-9d86bb13-18fb-4d84-99f3-a7986bb6a78f service nova] Acquiring lock "refresh_cache-d45e8ae8-371b-46ae-849d-d7f7d5bbd770" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:33:25 user nova-compute[74337]: DEBUG nova.network.neutron [None req-9746e41f-ca57-4065-8462-d853cea59297 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] [instance: d45e8ae8-371b-46ae-849d-d7f7d5bbd770] Instance cache missing network info. {{(pid=74337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 21:33:26 user nova-compute[74337]: DEBUG nova.network.neutron [None req-9746e41f-ca57-4065-8462-d853cea59297 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] [instance: d45e8ae8-371b-46ae-849d-d7f7d5bbd770] Updating instance_info_cache with network_info: [{"id": "7ac73679-68b0-430f-8d77-68438fbb52f0", "address": "fa:16:3e:9b:5f:a0", "network": {"id": "9fa29b5e-b3c7-4890-9d82-d9524e4cb78a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-89037375-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "997b9ab7d2794438be79f11bb972be47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ac73679-68", "ovs_interfaceid": "7ac73679-68b0-430f-8d77-68438fbb52f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:33:26 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-9746e41f-ca57-4065-8462-d853cea59297 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Releasing lock "refresh_cache-d45e8ae8-371b-46ae-849d-d7f7d5bbd770" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:33:26 user nova-compute[74337]: DEBUG nova.compute.manager [None req-9746e41f-ca57-4065-8462-d853cea59297 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] [instance: d45e8ae8-371b-46ae-849d-d7f7d5bbd770] Instance network_info: |[{"id": "7ac73679-68b0-430f-8d77-68438fbb52f0", "address": "fa:16:3e:9b:5f:a0", "network": {"id": "9fa29b5e-b3c7-4890-9d82-d9524e4cb78a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-89037375-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "997b9ab7d2794438be79f11bb972be47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ac73679-68", "ovs_interfaceid": "7ac73679-68b0-430f-8d77-68438fbb52f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 21:33:26 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-5e99b79f-052f-4952-a37c-8c322d7556ce req-9d86bb13-18fb-4d84-99f3-a7986bb6a78f service nova] Acquired lock "refresh_cache-d45e8ae8-371b-46ae-849d-d7f7d5bbd770" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:33:26 user nova-compute[74337]: DEBUG nova.network.neutron [req-5e99b79f-052f-4952-a37c-8c322d7556ce req-9d86bb13-18fb-4d84-99f3-a7986bb6a78f service nova] [instance: d45e8ae8-371b-46ae-849d-d7f7d5bbd770] Refreshing network info cache for port 7ac73679-68b0-430f-8d77-68438fbb52f0 {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 21:33:26 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-9746e41f-ca57-4065-8462-d853cea59297 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] [instance: d45e8ae8-371b-46ae-849d-d7f7d5bbd770] Start _get_guest_xml network_info=[{"id": "7ac73679-68b0-430f-8d77-68438fbb52f0", "address": "fa:16:3e:9b:5f:a0", "network": {"id": "9fa29b5e-b3c7-4890-9d82-d9524e4cb78a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-89037375-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "997b9ab7d2794438be79f11bb972be47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ac73679-68", "ovs_interfaceid": "7ac73679-68b0-430f-8d77-68438fbb52f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T21:29:21Z,direct_url=<?>,disk_format='qcow2',id=d859d89d-998d-4109-b26a-0d6e28152932,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ff43462300764979a6cf688444336a56',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T21:29:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'image_id': 'd859d89d-998d-4109-b26a-0d6e28152932'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 21:33:26 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-9746e41f-ca57-4065-8462-d853cea59297 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:33:26 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-9746e41f-ca57-4065-8462-d853cea59297 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:33:26 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-9746e41f-ca57-4065-8462-d853cea59297 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 21:33:26 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-9746e41f-ca57-4065-8462-d853cea59297 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] CPU controller missing on host. {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 21:33:26 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-9746e41f-ca57-4065-8462-d853cea59297 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 21:33:26 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-9746e41f-ca57-4065-8462-d853cea59297 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] CPU controller found on host. {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 21:33:26 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-9746e41f-ca57-4065-8462-d853cea59297 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 21:33:26 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-9746e41f-ca57-4065-8462-d853cea59297 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T21:29:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T21:29:21Z,direct_url=<?>,disk_format='qcow2',id=d859d89d-998d-4109-b26a-0d6e28152932,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ff43462300764979a6cf688444336a56',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T21:29:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 21:33:26 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-9746e41f-ca57-4065-8462-d853cea59297 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Flavor limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 21:33:26 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-9746e41f-ca57-4065-8462-d853cea59297 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Image limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 21:33:26 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-9746e41f-ca57-4065-8462-d853cea59297 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Flavor pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 21:33:26 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-9746e41f-ca57-4065-8462-d853cea59297 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Image pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 21:33:26 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-9746e41f-ca57-4065-8462-d853cea59297 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 21:33:26 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-9746e41f-ca57-4065-8462-d853cea59297 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 21:33:26 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-9746e41f-ca57-4065-8462-d853cea59297 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 21:33:26 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-9746e41f-ca57-4065-8462-d853cea59297 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Got 1 possible topologies {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 21:33:26 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-9746e41f-ca57-4065-8462-d853cea59297 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 21:33:26 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-9746e41f-ca57-4065-8462-d853cea59297 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 21:33:26 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-9746e41f-ca57-4065-8462-d853cea59297 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:33:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-992409238',display_name='tempest-VolumesAdminNegativeTest-server-992409238',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-992409238',id=4,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFZ52OJ5twsVrFvABjW3otbjRNWAc2GIXi/skppyx2gna8NdORx461dsWawhVGIhn5WFtYir1ab9f9lbDUw8nx+zGdcFSfvQmIZtHX0UArDfEHl6zO2Ol/2UdUY22NJKlA==',key_name='tempest-keypair-134951423',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='997b9ab7d2794438be79f11bb972be47',ramdisk_id='',reservation_id='r-f7onx0p9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-547225907',owner_user_name='tempest-VolumesAdminNegativeTest-547225907-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:33:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1106b04eeefe488c9ead914063b88d33',uuid=d45e8ae8-371b-46ae-849d-d7f7d5bbd770,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ac73679-68b0-430f-8d77-68438fbb52f0", "address": "fa:16:3e:9b:5f:a0", "network": {"id": "9fa29b5e-b3c7-4890-9d82-d9524e4cb78a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-89037375-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "997b9ab7d2794438be79f11bb972be47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ac73679-68", "ovs_interfaceid": "7ac73679-68b0-430f-8d77-68438fbb52f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 21:33:26 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-9746e41f-ca57-4065-8462-d853cea59297 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Converting VIF {"id": "7ac73679-68b0-430f-8d77-68438fbb52f0", "address": "fa:16:3e:9b:5f:a0", "network": {"id": "9fa29b5e-b3c7-4890-9d82-d9524e4cb78a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-89037375-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "997b9ab7d2794438be79f11bb972be47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ac73679-68", "ovs_interfaceid": "7ac73679-68b0-430f-8d77-68438fbb52f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:33:26 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-9746e41f-ca57-4065-8462-d853cea59297 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:5f:a0,bridge_name='br-int',has_traffic_filtering=True,id=7ac73679-68b0-430f-8d77-68438fbb52f0,network=Network(9fa29b5e-b3c7-4890-9d82-d9524e4cb78a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ac73679-68') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:33:26 user nova-compute[74337]: DEBUG nova.objects.instance [None req-9746e41f-ca57-4065-8462-d853cea59297 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Lazy-loading 'pci_devices' on Instance uuid d45e8ae8-371b-46ae-849d-d7f7d5bbd770 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:33:26 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-9746e41f-ca57-4065-8462-d853cea59297 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] [instance: d45e8ae8-371b-46ae-849d-d7f7d5bbd770] End _get_guest_xml xml=<domain type="kvm">
Oct 23 21:33:26 user nova-compute[74337]:   <uuid>d45e8ae8-371b-46ae-849d-d7f7d5bbd770</uuid>
Oct 23 21:33:26 user nova-compute[74337]:   <name>instance-00000004</name>
Oct 23 21:33:26 user nova-compute[74337]:   <memory>524288</memory>
Oct 23 21:33:26 user nova-compute[74337]:   <vcpu>1</vcpu>
Oct 23 21:33:26 user nova-compute[74337]:   <metadata>
Oct 23 21:33:26 user nova-compute[74337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 21:33:26 user nova-compute[74337]:       <nova:package version="0.0.0"/>
Oct 23 21:33:26 user nova-compute[74337]:       <nova:name>tempest-VolumesAdminNegativeTest-server-992409238</nova:name>
Oct 23 21:33:26 user nova-compute[74337]:       <nova:creationTime>2023-10-23 21:33:26</nova:creationTime>
Oct 23 21:33:26 user nova-compute[74337]:       <nova:flavor name="m1.tiny">
Oct 23 21:33:26 user nova-compute[74337]:         <nova:memory>512</nova:memory>
Oct 23 21:33:26 user nova-compute[74337]:         <nova:disk>1</nova:disk>
Oct 23 21:33:26 user nova-compute[74337]:         <nova:swap>0</nova:swap>
Oct 23 21:33:26 user nova-compute[74337]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 21:33:26 user nova-compute[74337]:         <nova:vcpus>1</nova:vcpus>
Oct 23 21:33:26 user nova-compute[74337]:       </nova:flavor>
Oct 23 21:33:26 user nova-compute[74337]:       <nova:owner>
Oct 23 21:33:26 user nova-compute[74337]:         <nova:user uuid="1106b04eeefe488c9ead914063b88d33">tempest-VolumesAdminNegativeTest-547225907-project-member</nova:user>
Oct 23 21:33:26 user nova-compute[74337]:         <nova:project uuid="997b9ab7d2794438be79f11bb972be47">tempest-VolumesAdminNegativeTest-547225907</nova:project>
Oct 23 21:33:26 user nova-compute[74337]:       </nova:owner>
Oct 23 21:33:26 user nova-compute[74337]:       <nova:root type="image" uuid="d859d89d-998d-4109-b26a-0d6e28152932"/>
Oct 23 21:33:26 user nova-compute[74337]:       <nova:ports>
Oct 23 21:33:26 user nova-compute[74337]:         <nova:port uuid="7ac73679-68b0-430f-8d77-68438fbb52f0">
Oct 23 21:33:26 user nova-compute[74337]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 23 21:33:26 user nova-compute[74337]:         </nova:port>
Oct 23 21:33:26 user nova-compute[74337]:       </nova:ports>
Oct 23 21:33:26 user nova-compute[74337]:     </nova:instance>
Oct 23 21:33:26 user nova-compute[74337]:   </metadata>
Oct 23 21:33:26 user nova-compute[74337]:   <sysinfo type="smbios">
Oct 23 21:33:26 user nova-compute[74337]:     <system>
Oct 23 21:33:26 user nova-compute[74337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 21:33:26 user nova-compute[74337]:       <entry name="product">OpenStack Nova</entry>
Oct 23 21:33:26 user nova-compute[74337]:       <entry name="version">0.0.0</entry>
Oct 23 21:33:26 user nova-compute[74337]:       <entry name="serial">d45e8ae8-371b-46ae-849d-d7f7d5bbd770</entry>
Oct 23 21:33:26 user nova-compute[74337]:       <entry name="uuid">d45e8ae8-371b-46ae-849d-d7f7d5bbd770</entry>
Oct 23 21:33:26 user nova-compute[74337]:       <entry name="family">Virtual Machine</entry>
Oct 23 21:33:26 user nova-compute[74337]:     </system>
Oct 23 21:33:26 user nova-compute[74337]:   </sysinfo>
Oct 23 21:33:26 user nova-compute[74337]:   <os>
Oct 23 21:33:26 user nova-compute[74337]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 21:33:26 user nova-compute[74337]:     <boot dev="hd"/>
Oct 23 21:33:26 user nova-compute[74337]:     <smbios mode="sysinfo"/>
Oct 23 21:33:26 user nova-compute[74337]:   </os>
Oct 23 21:33:26 user nova-compute[74337]:   <features>
Oct 23 21:33:26 user nova-compute[74337]:     <acpi/>
Oct 23 21:33:26 user nova-compute[74337]:     <apic/>
Oct 23 21:33:26 user nova-compute[74337]:     <vmcoreinfo/>
Oct 23 21:33:26 user nova-compute[74337]:   </features>
Oct 23 21:33:26 user nova-compute[74337]:   <clock offset="utc">
Oct 23 21:33:26 user nova-compute[74337]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 21:33:26 user nova-compute[74337]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 21:33:26 user nova-compute[74337]:     <timer name="hpet" present="no"/>
Oct 23 21:33:26 user nova-compute[74337]:   </clock>
Oct 23 21:33:26 user nova-compute[74337]:   <cpu mode="custom" match="exact">
Oct 23 21:33:26 user nova-compute[74337]:     <model>Nehalem</model>
Oct 23 21:33:26 user nova-compute[74337]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 21:33:26 user nova-compute[74337]:   </cpu>
Oct 23 21:33:26 user nova-compute[74337]:   <devices>
Oct 23 21:33:26 user nova-compute[74337]:     <disk type="file" device="disk">
Oct 23 21:33:26 user nova-compute[74337]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 21:33:26 user nova-compute[74337]:       <source file="/opt/stack/data/nova/instances/d45e8ae8-371b-46ae-849d-d7f7d5bbd770/disk"/>
Oct 23 21:33:26 user nova-compute[74337]:       <target dev="vda" bus="virtio"/>
Oct 23 21:33:26 user nova-compute[74337]:     </disk>
Oct 23 21:33:26 user nova-compute[74337]:     <interface type="ethernet">
Oct 23 21:33:26 user nova-compute[74337]:       <mac address="fa:16:3e:9b:5f:a0"/>
Oct 23 21:33:26 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:33:26 user nova-compute[74337]:       <mtu size="1442"/>
Oct 23 21:33:26 user nova-compute[74337]:       <target dev="tap7ac73679-68"/>
Oct 23 21:33:26 user nova-compute[74337]:     </interface>
Oct 23 21:33:26 user nova-compute[74337]:     <serial type="pty">
Oct 23 21:33:26 user nova-compute[74337]:       <log file="/opt/stack/data/nova/instances/d45e8ae8-371b-46ae-849d-d7f7d5bbd770/console.log" append="off"/>
Oct 23 21:33:26 user nova-compute[74337]:     </serial>
Oct 23 21:33:26 user nova-compute[74337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 21:33:26 user nova-compute[74337]:     <video>
Oct 23 21:33:26 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:33:26 user nova-compute[74337]:     </video>
Oct 23 21:33:26 user nova-compute[74337]:     <rng model="virtio">
Oct 23 21:33:26 user nova-compute[74337]:       <backend model="random">/dev/urandom</backend>
Oct 23 21:33:26 user nova-compute[74337]:     </rng>
Oct 23 21:33:26 user nova-compute[74337]:     <controller type="usb" index="0" model="none"/>
Oct 23 21:33:26 user nova-compute[74337]:     <memballoon model="virtio">
Oct 23 21:33:26 user nova-compute[74337]:       <stats period="10"/>
Oct 23 21:33:26 user nova-compute[74337]:     </memballoon>
Oct 23 21:33:26 user nova-compute[74337]:   </devices>
Oct 23 21:33:26 user nova-compute[74337]: </domain>
Oct 23 21:33:26 user nova-compute[74337]:  {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 21:33:26 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-9746e41f-ca57-4065-8462-d853cea59297 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:33:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-992409238',display_name='tempest-VolumesAdminNegativeTest-server-992409238',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-992409238',id=4,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFZ52OJ5twsVrFvABjW3otbjRNWAc2GIXi/skppyx2gna8NdORx461dsWawhVGIhn5WFtYir1ab9f9lbDUw8nx+zGdcFSfvQmIZtHX0UArDfEHl6zO2Ol/2UdUY22NJKlA==',key_name='tempest-keypair-134951423',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='997b9ab7d2794438be79f11bb972be47',ramdisk_id='',reservation_id='r-f7onx0p9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-547225907',owner_user_name='tempest-VolumesAdminNegativeTest-547225907-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:33:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1106b04eeefe488c9ead914063b88d33',uuid=d45e8ae8-371b-46ae-849d-d7f7d5bbd770,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ac73679-68b0-430f-8d77-68438fbb52f0", "address": "fa:16:3e:9b:5f:a0", "network": {"id": "9fa29b5e-b3c7-4890-9d82-d9524e4cb78a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-89037375-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "997b9ab7d2794438be79f11bb972be47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ac73679-68", "ovs_interfaceid": "7ac73679-68b0-430f-8d77-68438fbb52f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 21:33:26 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-9746e41f-ca57-4065-8462-d853cea59297 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Converting VIF {"id": "7ac73679-68b0-430f-8d77-68438fbb52f0", "address": "fa:16:3e:9b:5f:a0", "network": {"id": "9fa29b5e-b3c7-4890-9d82-d9524e4cb78a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-89037375-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "997b9ab7d2794438be79f11bb972be47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ac73679-68", "ovs_interfaceid": "7ac73679-68b0-430f-8d77-68438fbb52f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:33:26 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-9746e41f-ca57-4065-8462-d853cea59297 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:5f:a0,bridge_name='br-int',has_traffic_filtering=True,id=7ac73679-68b0-430f-8d77-68438fbb52f0,network=Network(9fa29b5e-b3c7-4890-9d82-d9524e4cb78a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ac73679-68') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:33:26 user nova-compute[74337]: DEBUG os_vif [None req-9746e41f-ca57-4065-8462-d853cea59297 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:5f:a0,bridge_name='br-int',has_traffic_filtering=True,id=7ac73679-68b0-430f-8d77-68438fbb52f0,network=Network(9fa29b5e-b3c7-4890-9d82-d9524e4cb78a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ac73679-68') {{(pid=74337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 21:33:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:33:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 21:33:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c4e17be9-b4ef-5d0d-adcc-378266519e9c', '_type': 'linux-noop'}}, row=False) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:33:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7ac73679-68, may_exist=True, interface_attrs={}) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:33:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7ac73679-68, col_values=(('qos', UUID('68e64ec9-1a34-4af3-bda1-f836a73acf3e')),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:33:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7ac73679-68, col_values=(('external_ids', {'iface-id': '7ac73679-68b0-430f-8d77-68438fbb52f0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9b:5f:a0', 'vm-uuid': 'd45e8ae8-371b-46ae-849d-d7f7d5bbd770'}),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:33:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:33:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:26 user nova-compute[74337]: INFO os_vif [None req-9746e41f-ca57-4065-8462-d853cea59297 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:5f:a0,bridge_name='br-int',has_traffic_filtering=True,id=7ac73679-68b0-430f-8d77-68438fbb52f0,network=Network(9fa29b5e-b3c7-4890-9d82-d9524e4cb78a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ac73679-68')
Oct 23 21:33:26 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-9746e41f-ca57-4065-8462-d853cea59297 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] No BDM found with device name vda, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 21:33:26 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-9746e41f-ca57-4065-8462-d853cea59297 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] No VIF found with MAC fa:16:3e:9b:5f:a0, not building metadata {{(pid=74337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 21:33:27 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:27 user nova-compute[74337]: DEBUG nova.network.neutron [req-5e99b79f-052f-4952-a37c-8c322d7556ce req-9d86bb13-18fb-4d84-99f3-a7986bb6a78f service nova] [instance: d45e8ae8-371b-46ae-849d-d7f7d5bbd770] Updated VIF entry in instance network info cache for port 7ac73679-68b0-430f-8d77-68438fbb52f0. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 21:33:27 user nova-compute[74337]: DEBUG nova.network.neutron [req-5e99b79f-052f-4952-a37c-8c322d7556ce req-9d86bb13-18fb-4d84-99f3-a7986bb6a78f service nova] [instance: d45e8ae8-371b-46ae-849d-d7f7d5bbd770] Updating instance_info_cache with network_info: [{"id": "7ac73679-68b0-430f-8d77-68438fbb52f0", "address": "fa:16:3e:9b:5f:a0", "network": {"id": "9fa29b5e-b3c7-4890-9d82-d9524e4cb78a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-89037375-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "997b9ab7d2794438be79f11bb972be47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ac73679-68", "ovs_interfaceid": "7ac73679-68b0-430f-8d77-68438fbb52f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:33:27 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-5e99b79f-052f-4952-a37c-8c322d7556ce req-9d86bb13-18fb-4d84-99f3-a7986bb6a78f service nova] Releasing lock "refresh_cache-d45e8ae8-371b-46ae-849d-d7f7d5bbd770" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:33:28 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:28 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:28 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:28 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:28 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:29 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:29 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:29 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:29 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:31 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:32 user nova-compute[74337]: DEBUG nova.compute.manager [None req-9746e41f-ca57-4065-8462-d853cea59297 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] [instance: d45e8ae8-371b-46ae-849d-d7f7d5bbd770] Instance event wait completed in 0 seconds for  {{(pid=74337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 21:33:32 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-9746e41f-ca57-4065-8462-d853cea59297 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] [instance: d45e8ae8-371b-46ae-849d-d7f7d5bbd770] Guest created on hypervisor {{(pid=74337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 21:33:32 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: d45e8ae8-371b-46ae-849d-d7f7d5bbd770] Instance spawned successfully.
Oct 23 21:33:32 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-9746e41f-ca57-4065-8462-d853cea59297 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] [instance: d45e8ae8-371b-46ae-849d-d7f7d5bbd770] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 21:33:32 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-9746e41f-ca57-4065-8462-d853cea59297 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] [instance: d45e8ae8-371b-46ae-849d-d7f7d5bbd770] Found default for hw_cdrom_bus of ide {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:33:32 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-9746e41f-ca57-4065-8462-d853cea59297 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] [instance: d45e8ae8-371b-46ae-849d-d7f7d5bbd770] Found default for hw_disk_bus of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:33:32 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-9746e41f-ca57-4065-8462-d853cea59297 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] [instance: d45e8ae8-371b-46ae-849d-d7f7d5bbd770] Found default for hw_input_bus of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:33:32 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-9746e41f-ca57-4065-8462-d853cea59297 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] [instance: d45e8ae8-371b-46ae-849d-d7f7d5bbd770] Found default for hw_pointer_model of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:33:32 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-9746e41f-ca57-4065-8462-d853cea59297 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] [instance: d45e8ae8-371b-46ae-849d-d7f7d5bbd770] Found default for hw_video_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:33:32 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-9746e41f-ca57-4065-8462-d853cea59297 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] [instance: d45e8ae8-371b-46ae-849d-d7f7d5bbd770] Found default for hw_vif_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:33:32 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-1d528b47-2a3b-42ab-b251-9c2ad291f36e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Acquiring lock "8acc1b10-a541-4c06-aeb7-1ecf7a2457be" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:33:32 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-1d528b47-2a3b-42ab-b251-9c2ad291f36e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Lock "8acc1b10-a541-4c06-aeb7-1ecf7a2457be" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:33:32 user nova-compute[74337]: DEBUG nova.compute.manager [None req-1d528b47-2a3b-42ab-b251-9c2ad291f36e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] Starting instance... {{(pid=74337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 21:33:32 user nova-compute[74337]: INFO nova.compute.manager [None req-9746e41f-ca57-4065-8462-d853cea59297 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] [instance: d45e8ae8-371b-46ae-849d-d7f7d5bbd770] Took 10.62 seconds to spawn the instance on the hypervisor.
Oct 23 21:33:32 user nova-compute[74337]: DEBUG nova.compute.manager [None req-9746e41f-ca57-4065-8462-d853cea59297 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] [instance: d45e8ae8-371b-46ae-849d-d7f7d5bbd770] Checking state {{(pid=74337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 21:33:32 user nova-compute[74337]: INFO nova.compute.manager [None req-9746e41f-ca57-4065-8462-d853cea59297 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] [instance: d45e8ae8-371b-46ae-849d-d7f7d5bbd770] Took 11.85 seconds to build instance.
Oct 23 21:33:32 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-1d528b47-2a3b-42ab-b251-9c2ad291f36e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:33:32 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-1d528b47-2a3b-42ab-b251-9c2ad291f36e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:33:32 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-1d528b47-2a3b-42ab-b251-9c2ad291f36e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 21:33:32 user nova-compute[74337]: INFO nova.compute.claims [None req-1d528b47-2a3b-42ab-b251-9c2ad291f36e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] Claim successful on node user
Oct 23 21:33:32 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-9746e41f-ca57-4065-8462-d853cea59297 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Lock "d45e8ae8-371b-46ae-849d-d7f7d5bbd770" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.016s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:33:32 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:32 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-1d528b47-2a3b-42ab-b251-9c2ad291f36e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:33:32 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-1d528b47-2a3b-42ab-b251-9c2ad291f36e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:33:32 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:33 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-1d528b47-2a3b-42ab-b251-9c2ad291f36e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.625s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:33:33 user nova-compute[74337]: DEBUG nova.compute.manager [None req-1d528b47-2a3b-42ab-b251-9c2ad291f36e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] Start building networks asynchronously for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 21:33:33 user nova-compute[74337]: DEBUG nova.compute.manager [None req-1d528b47-2a3b-42ab-b251-9c2ad291f36e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] Allocating IP information in the background. {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 21:33:33 user nova-compute[74337]: DEBUG nova.network.neutron [None req-1d528b47-2a3b-42ab-b251-9c2ad291f36e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] allocate_for_instance() {{(pid=74337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 21:33:33 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-1d528b47-2a3b-42ab-b251-9c2ad291f36e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 21:33:33 user nova-compute[74337]: DEBUG nova.compute.manager [None req-1d528b47-2a3b-42ab-b251-9c2ad291f36e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] Start building block device mappings for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 21:33:33 user nova-compute[74337]: DEBUG nova.compute.manager [None req-1d528b47-2a3b-42ab-b251-9c2ad291f36e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] Start spawning the instance on the hypervisor. {{(pid=74337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 21:33:33 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-1d528b47-2a3b-42ab-b251-9c2ad291f36e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] Creating instance directory {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 21:33:33 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-1d528b47-2a3b-42ab-b251-9c2ad291f36e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] Creating image(s)
Oct 23 21:33:33 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-1d528b47-2a3b-42ab-b251-9c2ad291f36e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Acquiring lock "/opt/stack/data/nova/instances/8acc1b10-a541-4c06-aeb7-1ecf7a2457be/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:33:33 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-1d528b47-2a3b-42ab-b251-9c2ad291f36e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Lock "/opt/stack/data/nova/instances/8acc1b10-a541-4c06-aeb7-1ecf7a2457be/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:33:33 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-1d528b47-2a3b-42ab-b251-9c2ad291f36e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Lock "/opt/stack/data/nova/instances/8acc1b10-a541-4c06-aeb7-1ecf7a2457be/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:33:33 user nova-compute[74337]: DEBUG nova.policy [None req-1d528b47-2a3b-42ab-b251-9c2ad291f36e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ec1a4c2d1f9b4983ab9124c7f6056da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d7baedb5f74976be4b0cf308964086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74337) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 21:33:33 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-1d528b47-2a3b-42ab-b251-9c2ad291f36e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:33:33 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-1d528b47-2a3b-42ab-b251-9c2ad291f36e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.303s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:33:33 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-1d528b47-2a3b-42ab-b251-9c2ad291f36e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Acquiring lock "fc7b140751b8c385de81623e40fb09ce09374ab7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:33:33 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-1d528b47-2a3b-42ab-b251-9c2ad291f36e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Lock "fc7b140751b8c385de81623e40fb09ce09374ab7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:33:33 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-1d528b47-2a3b-42ab-b251-9c2ad291f36e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:33:34 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-1d528b47-2a3b-42ab-b251-9c2ad291f36e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.261s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:33:34 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-1d528b47-2a3b-42ab-b251-9c2ad291f36e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7,backing_fmt=raw /opt/stack/data/nova/instances/8acc1b10-a541-4c06-aeb7-1ecf7a2457be/disk 1073741824 {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:33:34 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-1d528b47-2a3b-42ab-b251-9c2ad291f36e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7,backing_fmt=raw /opt/stack/data/nova/instances/8acc1b10-a541-4c06-aeb7-1ecf7a2457be/disk 1073741824" returned: 0 in 0.078s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:33:34 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-1d528b47-2a3b-42ab-b251-9c2ad291f36e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Lock "fc7b140751b8c385de81623e40fb09ce09374ab7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.350s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:33:34 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-1d528b47-2a3b-42ab-b251-9c2ad291f36e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:33:34 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-1d528b47-2a3b-42ab-b251-9c2ad291f36e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.232s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:33:34 user nova-compute[74337]: DEBUG nova.virt.disk.api [None req-1d528b47-2a3b-42ab-b251-9c2ad291f36e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8acc1b10-a541-4c06-aeb7-1ecf7a2457be/disk. size=1073741824 {{(pid=74337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 21:33:34 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-1d528b47-2a3b-42ab-b251-9c2ad291f36e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8acc1b10-a541-4c06-aeb7-1ecf7a2457be/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:33:34 user nova-compute[74337]: DEBUG nova.network.neutron [None req-1d528b47-2a3b-42ab-b251-9c2ad291f36e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] Successfully created port: 530b7241-1498-47dc-8a6f-79e6c9cc850a {{(pid=74337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 21:33:34 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-1d528b47-2a3b-42ab-b251-9c2ad291f36e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8acc1b10-a541-4c06-aeb7-1ecf7a2457be/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:33:34 user nova-compute[74337]: DEBUG nova.virt.disk.api [None req-1d528b47-2a3b-42ab-b251-9c2ad291f36e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Cannot resize image /opt/stack/data/nova/instances/8acc1b10-a541-4c06-aeb7-1ecf7a2457be/disk to a smaller size. {{(pid=74337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 21:33:34 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-1d528b47-2a3b-42ab-b251-9c2ad291f36e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] Created local disks {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 21:33:34 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-1d528b47-2a3b-42ab-b251-9c2ad291f36e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] Ensure instance console log exists: /opt/stack/data/nova/instances/8acc1b10-a541-4c06-aeb7-1ecf7a2457be/console.log {{(pid=74337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 21:33:34 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-1d528b47-2a3b-42ab-b251-9c2ad291f36e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:33:34 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-1d528b47-2a3b-42ab-b251-9c2ad291f36e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:33:34 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-1d528b47-2a3b-42ab-b251-9c2ad291f36e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:33:35 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:36 user nova-compute[74337]: DEBUG nova.network.neutron [None req-1d528b47-2a3b-42ab-b251-9c2ad291f36e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] Successfully updated port: 530b7241-1498-47dc-8a6f-79e6c9cc850a {{(pid=74337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 21:33:36 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-1d528b47-2a3b-42ab-b251-9c2ad291f36e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Acquiring lock "refresh_cache-8acc1b10-a541-4c06-aeb7-1ecf7a2457be" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:33:36 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-1d528b47-2a3b-42ab-b251-9c2ad291f36e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Acquired lock "refresh_cache-8acc1b10-a541-4c06-aeb7-1ecf7a2457be" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:33:36 user nova-compute[74337]: DEBUG nova.network.neutron [None req-1d528b47-2a3b-42ab-b251-9c2ad291f36e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] Building network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 21:33:36 user nova-compute[74337]: DEBUG nova.compute.manager [req-f981251e-9214-4a48-b60a-c142eb8a740e req-3de76864-e8f7-4c32-a7ef-d02229007461 service nova] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] Received event network-changed-530b7241-1498-47dc-8a6f-79e6c9cc850a {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:33:36 user nova-compute[74337]: DEBUG nova.compute.manager [req-f981251e-9214-4a48-b60a-c142eb8a740e req-3de76864-e8f7-4c32-a7ef-d02229007461 service nova] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] Refreshing instance network info cache due to event network-changed-530b7241-1498-47dc-8a6f-79e6c9cc850a. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 21:33:36 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-f981251e-9214-4a48-b60a-c142eb8a740e req-3de76864-e8f7-4c32-a7ef-d02229007461 service nova] Acquiring lock "refresh_cache-8acc1b10-a541-4c06-aeb7-1ecf7a2457be" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:33:36 user nova-compute[74337]: DEBUG nova.network.neutron [None req-1d528b47-2a3b-42ab-b251-9c2ad291f36e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] Instance cache missing network info. {{(pid=74337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 21:33:36 user nova-compute[74337]: DEBUG nova.network.neutron [None req-1d528b47-2a3b-42ab-b251-9c2ad291f36e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] Updating instance_info_cache with network_info: [{"id": "530b7241-1498-47dc-8a6f-79e6c9cc850a", "address": "fa:16:3e:47:6a:0e", "network": {"id": "44c67162-ce40-4b2b-bc3e-07b0203e2083", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1341457246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84d7baedb5f74976be4b0cf308964086", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap530b7241-14", "ovs_interfaceid": "530b7241-1498-47dc-8a6f-79e6c9cc850a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:33:36 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-1d528b47-2a3b-42ab-b251-9c2ad291f36e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Releasing lock "refresh_cache-8acc1b10-a541-4c06-aeb7-1ecf7a2457be" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:33:36 user nova-compute[74337]: DEBUG nova.compute.manager [None req-1d528b47-2a3b-42ab-b251-9c2ad291f36e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] Instance network_info: |[{"id": "530b7241-1498-47dc-8a6f-79e6c9cc850a", "address": "fa:16:3e:47:6a:0e", "network": {"id": "44c67162-ce40-4b2b-bc3e-07b0203e2083", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1341457246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84d7baedb5f74976be4b0cf308964086", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap530b7241-14", "ovs_interfaceid": "530b7241-1498-47dc-8a6f-79e6c9cc850a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 21:33:36 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-f981251e-9214-4a48-b60a-c142eb8a740e req-3de76864-e8f7-4c32-a7ef-d02229007461 service nova] Acquired lock "refresh_cache-8acc1b10-a541-4c06-aeb7-1ecf7a2457be" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:33:36 user nova-compute[74337]: DEBUG nova.network.neutron [req-f981251e-9214-4a48-b60a-c142eb8a740e req-3de76864-e8f7-4c32-a7ef-d02229007461 service nova] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] Refreshing network info cache for port 530b7241-1498-47dc-8a6f-79e6c9cc850a {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 21:33:36 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-1d528b47-2a3b-42ab-b251-9c2ad291f36e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] Start _get_guest_xml network_info=[{"id": "530b7241-1498-47dc-8a6f-79e6c9cc850a", "address": "fa:16:3e:47:6a:0e", "network": {"id": "44c67162-ce40-4b2b-bc3e-07b0203e2083", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1341457246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84d7baedb5f74976be4b0cf308964086", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap530b7241-14", "ovs_interfaceid": "530b7241-1498-47dc-8a6f-79e6c9cc850a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T21:29:21Z,direct_url=<?>,disk_format='qcow2',id=d859d89d-998d-4109-b26a-0d6e28152932,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ff43462300764979a6cf688444336a56',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T21:29:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'image_id': 'd859d89d-998d-4109-b26a-0d6e28152932'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 21:33:36 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-1d528b47-2a3b-42ab-b251-9c2ad291f36e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:33:36 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-1d528b47-2a3b-42ab-b251-9c2ad291f36e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:33:36 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:36 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-1d528b47-2a3b-42ab-b251-9c2ad291f36e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 21:33:36 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-1d528b47-2a3b-42ab-b251-9c2ad291f36e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] CPU controller missing on host. {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 21:33:36 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-1d528b47-2a3b-42ab-b251-9c2ad291f36e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 21:33:36 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-1d528b47-2a3b-42ab-b251-9c2ad291f36e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] CPU controller found on host. {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 21:33:36 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-1d528b47-2a3b-42ab-b251-9c2ad291f36e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 21:33:36 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-1d528b47-2a3b-42ab-b251-9c2ad291f36e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T21:29:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T21:29:21Z,direct_url=<?>,disk_format='qcow2',id=d859d89d-998d-4109-b26a-0d6e28152932,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ff43462300764979a6cf688444336a56',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T21:29:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 21:33:36 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-1d528b47-2a3b-42ab-b251-9c2ad291f36e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Flavor limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 21:33:36 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-1d528b47-2a3b-42ab-b251-9c2ad291f36e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Image limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 21:33:36 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-1d528b47-2a3b-42ab-b251-9c2ad291f36e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Flavor pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 21:33:36 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-1d528b47-2a3b-42ab-b251-9c2ad291f36e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Image pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 21:33:36 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-1d528b47-2a3b-42ab-b251-9c2ad291f36e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 21:33:36 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-1d528b47-2a3b-42ab-b251-9c2ad291f36e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 21:33:36 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-1d528b47-2a3b-42ab-b251-9c2ad291f36e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 21:33:36 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-1d528b47-2a3b-42ab-b251-9c2ad291f36e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Got 1 possible topologies {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 21:33:36 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-1d528b47-2a3b-42ab-b251-9c2ad291f36e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 21:33:36 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-1d528b47-2a3b-42ab-b251-9c2ad291f36e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 21:33:36 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-1d528b47-2a3b-42ab-b251-9c2ad291f36e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T21:33:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1843796381',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1843796381',id=5,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAop3qssYFI+MVvFuH2+7gwm//7zwcdy6tYm9eD42fbRzv89CUtru1RL8WlSDZgdlRSrkM4Tb4QtCQmTEE7AA2YXPHv9z6iJ2d9asZLABlNx58K0PwTsdZsKKihbdIgMOg==',key_name='tempest-keypair-586099674',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='84d7baedb5f74976be4b0cf308964086',ramdisk_id='',reservation_id='r-4zf725dv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-2141482979',owner_user_name='tempest-TaggedAttachmentsTest-2141482979-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:33:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec1a4c2d1f9b4983ab9124c7f6056da6',uuid=8acc1b10-a541-4c06-aeb7-1ecf7a2457be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "530b7241-1498-47dc-8a6f-79e6c9cc850a", "address": "fa:16:3e:47:6a:0e", "network": {"id": "44c67162-ce40-4b2b-bc3e-07b0203e2083", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1341457246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84d7baedb5f74976be4b0cf308964086", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap530b7241-14", "ovs_interfaceid": "530b7241-1498-47dc-8a6f-79e6c9cc850a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 21:33:36 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-1d528b47-2a3b-42ab-b251-9c2ad291f36e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Converting VIF {"id": "530b7241-1498-47dc-8a6f-79e6c9cc850a", "address": "fa:16:3e:47:6a:0e", "network": {"id": "44c67162-ce40-4b2b-bc3e-07b0203e2083", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1341457246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84d7baedb5f74976be4b0cf308964086", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap530b7241-14", "ovs_interfaceid": "530b7241-1498-47dc-8a6f-79e6c9cc850a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:33:36 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-1d528b47-2a3b-42ab-b251-9c2ad291f36e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:6a:0e,bridge_name='br-int',has_traffic_filtering=True,id=530b7241-1498-47dc-8a6f-79e6c9cc850a,network=Network(44c67162-ce40-4b2b-bc3e-07b0203e2083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap530b7241-14') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:33:36 user nova-compute[74337]: DEBUG nova.objects.instance [None req-1d528b47-2a3b-42ab-b251-9c2ad291f36e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Lazy-loading 'pci_devices' on Instance uuid 8acc1b10-a541-4c06-aeb7-1ecf7a2457be {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:33:36 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-1d528b47-2a3b-42ab-b251-9c2ad291f36e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] End _get_guest_xml xml=<domain type="kvm">
Oct 23 21:33:36 user nova-compute[74337]:   <uuid>8acc1b10-a541-4c06-aeb7-1ecf7a2457be</uuid>
Oct 23 21:33:36 user nova-compute[74337]:   <name>instance-00000005</name>
Oct 23 21:33:36 user nova-compute[74337]:   <memory>524288</memory>
Oct 23 21:33:36 user nova-compute[74337]:   <vcpu>1</vcpu>
Oct 23 21:33:36 user nova-compute[74337]:   <metadata>
Oct 23 21:33:36 user nova-compute[74337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 21:33:36 user nova-compute[74337]:       <nova:package version="0.0.0"/>
Oct 23 21:33:36 user nova-compute[74337]:       <nova:name>tempest-device-tagging-server-1843796381</nova:name>
Oct 23 21:33:36 user nova-compute[74337]:       <nova:creationTime>2023-10-23 21:33:36</nova:creationTime>
Oct 23 21:33:36 user nova-compute[74337]:       <nova:flavor name="m1.tiny">
Oct 23 21:33:36 user nova-compute[74337]:         <nova:memory>512</nova:memory>
Oct 23 21:33:36 user nova-compute[74337]:         <nova:disk>1</nova:disk>
Oct 23 21:33:36 user nova-compute[74337]:         <nova:swap>0</nova:swap>
Oct 23 21:33:36 user nova-compute[74337]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 21:33:36 user nova-compute[74337]:         <nova:vcpus>1</nova:vcpus>
Oct 23 21:33:36 user nova-compute[74337]:       </nova:flavor>
Oct 23 21:33:36 user nova-compute[74337]:       <nova:owner>
Oct 23 21:33:36 user nova-compute[74337]:         <nova:user uuid="ec1a4c2d1f9b4983ab9124c7f6056da6">tempest-TaggedAttachmentsTest-2141482979-project-member</nova:user>
Oct 23 21:33:36 user nova-compute[74337]:         <nova:project uuid="84d7baedb5f74976be4b0cf308964086">tempest-TaggedAttachmentsTest-2141482979</nova:project>
Oct 23 21:33:36 user nova-compute[74337]:       </nova:owner>
Oct 23 21:33:36 user nova-compute[74337]:       <nova:root type="image" uuid="d859d89d-998d-4109-b26a-0d6e28152932"/>
Oct 23 21:33:36 user nova-compute[74337]:       <nova:ports>
Oct 23 21:33:36 user nova-compute[74337]:         <nova:port uuid="530b7241-1498-47dc-8a6f-79e6c9cc850a">
Oct 23 21:33:36 user nova-compute[74337]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 23 21:33:36 user nova-compute[74337]:         </nova:port>
Oct 23 21:33:36 user nova-compute[74337]:       </nova:ports>
Oct 23 21:33:36 user nova-compute[74337]:     </nova:instance>
Oct 23 21:33:36 user nova-compute[74337]:   </metadata>
Oct 23 21:33:36 user nova-compute[74337]:   <sysinfo type="smbios">
Oct 23 21:33:36 user nova-compute[74337]:     <system>
Oct 23 21:33:36 user nova-compute[74337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 21:33:36 user nova-compute[74337]:       <entry name="product">OpenStack Nova</entry>
Oct 23 21:33:36 user nova-compute[74337]:       <entry name="version">0.0.0</entry>
Oct 23 21:33:36 user nova-compute[74337]:       <entry name="serial">8acc1b10-a541-4c06-aeb7-1ecf7a2457be</entry>
Oct 23 21:33:36 user nova-compute[74337]:       <entry name="uuid">8acc1b10-a541-4c06-aeb7-1ecf7a2457be</entry>
Oct 23 21:33:36 user nova-compute[74337]:       <entry name="family">Virtual Machine</entry>
Oct 23 21:33:36 user nova-compute[74337]:     </system>
Oct 23 21:33:36 user nova-compute[74337]:   </sysinfo>
Oct 23 21:33:36 user nova-compute[74337]:   <os>
Oct 23 21:33:36 user nova-compute[74337]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 21:33:36 user nova-compute[74337]:     <boot dev="hd"/>
Oct 23 21:33:36 user nova-compute[74337]:     <smbios mode="sysinfo"/>
Oct 23 21:33:36 user nova-compute[74337]:   </os>
Oct 23 21:33:36 user nova-compute[74337]:   <features>
Oct 23 21:33:36 user nova-compute[74337]:     <acpi/>
Oct 23 21:33:36 user nova-compute[74337]:     <apic/>
Oct 23 21:33:36 user nova-compute[74337]:     <vmcoreinfo/>
Oct 23 21:33:36 user nova-compute[74337]:   </features>
Oct 23 21:33:36 user nova-compute[74337]:   <clock offset="utc">
Oct 23 21:33:36 user nova-compute[74337]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 21:33:36 user nova-compute[74337]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 21:33:36 user nova-compute[74337]:     <timer name="hpet" present="no"/>
Oct 23 21:33:36 user nova-compute[74337]:   </clock>
Oct 23 21:33:36 user nova-compute[74337]:   <cpu mode="custom" match="exact">
Oct 23 21:33:36 user nova-compute[74337]:     <model>Nehalem</model>
Oct 23 21:33:36 user nova-compute[74337]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 21:33:36 user nova-compute[74337]:   </cpu>
Oct 23 21:33:36 user nova-compute[74337]:   <devices>
Oct 23 21:33:36 user nova-compute[74337]:     <disk type="file" device="disk">
Oct 23 21:33:36 user nova-compute[74337]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 21:33:36 user nova-compute[74337]:       <source file="/opt/stack/data/nova/instances/8acc1b10-a541-4c06-aeb7-1ecf7a2457be/disk"/>
Oct 23 21:33:36 user nova-compute[74337]:       <target dev="vda" bus="virtio"/>
Oct 23 21:33:36 user nova-compute[74337]:     </disk>
Oct 23 21:33:36 user nova-compute[74337]:     <disk type="file" device="cdrom">
Oct 23 21:33:36 user nova-compute[74337]:       <driver name="qemu" type="raw" cache="none"/>
Oct 23 21:33:36 user nova-compute[74337]:       <source file="/opt/stack/data/nova/instances/8acc1b10-a541-4c06-aeb7-1ecf7a2457be/disk.config"/>
Oct 23 21:33:36 user nova-compute[74337]:       <target dev="hda" bus="ide"/>
Oct 23 21:33:36 user nova-compute[74337]:     </disk>
Oct 23 21:33:36 user nova-compute[74337]:     <interface type="ethernet">
Oct 23 21:33:36 user nova-compute[74337]:       <mac address="fa:16:3e:47:6a:0e"/>
Oct 23 21:33:36 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:33:36 user nova-compute[74337]:       <mtu size="1442"/>
Oct 23 21:33:36 user nova-compute[74337]:       <target dev="tap530b7241-14"/>
Oct 23 21:33:36 user nova-compute[74337]:     </interface>
Oct 23 21:33:36 user nova-compute[74337]:     <serial type="pty">
Oct 23 21:33:36 user nova-compute[74337]:       <log file="/opt/stack/data/nova/instances/8acc1b10-a541-4c06-aeb7-1ecf7a2457be/console.log" append="off"/>
Oct 23 21:33:36 user nova-compute[74337]:     </serial>
Oct 23 21:33:36 user nova-compute[74337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 21:33:36 user nova-compute[74337]:     <video>
Oct 23 21:33:36 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:33:36 user nova-compute[74337]:     </video>
Oct 23 21:33:36 user nova-compute[74337]:     <rng model="virtio">
Oct 23 21:33:36 user nova-compute[74337]:       <backend model="random">/dev/urandom</backend>
Oct 23 21:33:36 user nova-compute[74337]:     </rng>
Oct 23 21:33:36 user nova-compute[74337]:     <controller type="usb" index="0" model="none"/>
Oct 23 21:33:36 user nova-compute[74337]:     <memballoon model="virtio">
Oct 23 21:33:36 user nova-compute[74337]:       <stats period="10"/>
Oct 23 21:33:36 user nova-compute[74337]:     </memballoon>
Oct 23 21:33:36 user nova-compute[74337]:   </devices>
Oct 23 21:33:36 user nova-compute[74337]: </domain>
Oct 23 21:33:36 user nova-compute[74337]:  {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 21:33:36 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-1d528b47-2a3b-42ab-b251-9c2ad291f36e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T21:33:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1843796381',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1843796381',id=5,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAop3qssYFI+MVvFuH2+7gwm//7zwcdy6tYm9eD42fbRzv89CUtru1RL8WlSDZgdlRSrkM4Tb4QtCQmTEE7AA2YXPHv9z6iJ2d9asZLABlNx58K0PwTsdZsKKihbdIgMOg==',key_name='tempest-keypair-586099674',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='84d7baedb5f74976be4b0cf308964086',ramdisk_id='',reservation_id='r-4zf725dv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-2141482979',owner_user_name='tempest-TaggedAttachmentsTest-2141482979-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:33:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec1a4c2d1f9b4983ab9124c7f6056da6',uuid=8acc1b10-a541-4c06-aeb7-1ecf7a2457be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "530b7241-1498-47dc-8a6f-79e6c9cc850a", "address": "fa:16:3e:47:6a:0e", "network": {"id": "44c67162-ce40-4b2b-bc3e-07b0203e2083", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1341457246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84d7baedb5f74976be4b0cf308964086", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap530b7241-14", "ovs_interfaceid": "530b7241-1498-47dc-8a6f-79e6c9cc850a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 21:33:36 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-1d528b47-2a3b-42ab-b251-9c2ad291f36e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Converting VIF {"id": "530b7241-1498-47dc-8a6f-79e6c9cc850a", "address": "fa:16:3e:47:6a:0e", "network": {"id": "44c67162-ce40-4b2b-bc3e-07b0203e2083", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1341457246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84d7baedb5f74976be4b0cf308964086", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap530b7241-14", "ovs_interfaceid": "530b7241-1498-47dc-8a6f-79e6c9cc850a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:33:36 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-1d528b47-2a3b-42ab-b251-9c2ad291f36e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:6a:0e,bridge_name='br-int',has_traffic_filtering=True,id=530b7241-1498-47dc-8a6f-79e6c9cc850a,network=Network(44c67162-ce40-4b2b-bc3e-07b0203e2083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap530b7241-14') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:33:36 user nova-compute[74337]: DEBUG os_vif [None req-1d528b47-2a3b-42ab-b251-9c2ad291f36e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:6a:0e,bridge_name='br-int',has_traffic_filtering=True,id=530b7241-1498-47dc-8a6f-79e6c9cc850a,network=Network(44c67162-ce40-4b2b-bc3e-07b0203e2083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap530b7241-14') {{(pid=74337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 21:33:36 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:36 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:33:36 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 21:33:36 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:36 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'abe2692c-95da-59d0-bbe6-2cab16eb1984', '_type': 'linux-noop'}}, row=False) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:33:36 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:36 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:33:36 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:36 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap530b7241-14, may_exist=True, interface_attrs={}) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:33:36 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap530b7241-14, col_values=(('qos', UUID('a09a86d7-aa6d-47ac-bc41-12861ecf850b')),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:33:36 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap530b7241-14, col_values=(('external_ids', {'iface-id': '530b7241-1498-47dc-8a6f-79e6c9cc850a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:47:6a:0e', 'vm-uuid': '8acc1b10-a541-4c06-aeb7-1ecf7a2457be'}),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:33:36 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:36 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:33:36 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:36 user nova-compute[74337]: INFO os_vif [None req-1d528b47-2a3b-42ab-b251-9c2ad291f36e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:6a:0e,bridge_name='br-int',has_traffic_filtering=True,id=530b7241-1498-47dc-8a6f-79e6c9cc850a,network=Network(44c67162-ce40-4b2b-bc3e-07b0203e2083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap530b7241-14')
Oct 23 21:33:36 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-1d528b47-2a3b-42ab-b251-9c2ad291f36e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] No BDM found with device name vda, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 21:33:36 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-1d528b47-2a3b-42ab-b251-9c2ad291f36e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] No BDM found with device name hda, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 21:33:36 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-1d528b47-2a3b-42ab-b251-9c2ad291f36e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] No VIF found with MAC fa:16:3e:47:6a:0e, not building metadata {{(pid=74337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 21:33:36 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-1d528b47-2a3b-42ab-b251-9c2ad291f36e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] Using config drive
Oct 23 21:33:37 user nova-compute[74337]: DEBUG nova.network.neutron [req-f981251e-9214-4a48-b60a-c142eb8a740e req-3de76864-e8f7-4c32-a7ef-d02229007461 service nova] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] Updated VIF entry in instance network info cache for port 530b7241-1498-47dc-8a6f-79e6c9cc850a. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 21:33:37 user nova-compute[74337]: DEBUG nova.network.neutron [req-f981251e-9214-4a48-b60a-c142eb8a740e req-3de76864-e8f7-4c32-a7ef-d02229007461 service nova] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] Updating instance_info_cache with network_info: [{"id": "530b7241-1498-47dc-8a6f-79e6c9cc850a", "address": "fa:16:3e:47:6a:0e", "network": {"id": "44c67162-ce40-4b2b-bc3e-07b0203e2083", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1341457246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84d7baedb5f74976be4b0cf308964086", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap530b7241-14", "ovs_interfaceid": "530b7241-1498-47dc-8a6f-79e6c9cc850a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:33:37 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-f981251e-9214-4a48-b60a-c142eb8a740e req-3de76864-e8f7-4c32-a7ef-d02229007461 service nova] Releasing lock "refresh_cache-8acc1b10-a541-4c06-aeb7-1ecf7a2457be" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:33:37 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:38 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-1d528b47-2a3b-42ab-b251-9c2ad291f36e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] Creating config drive at /opt/stack/data/nova/instances/8acc1b10-a541-4c06-aeb7-1ecf7a2457be/disk.config
Oct 23 21:33:38 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-1d528b47-2a3b-42ab-b251-9c2ad291f36e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/8acc1b10-a541-4c06-aeb7-1ecf7a2457be/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpv_np2bkf {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:33:38 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-1d528b47-2a3b-42ab-b251-9c2ad291f36e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/8acc1b10-a541-4c06-aeb7-1ecf7a2457be/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpv_np2bkf" returned: 0 in 0.112s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:33:39 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Acquiring lock "ff1c790c-2458-438e-95c7-7e1412fe05fc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:33:39 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Lock "ff1c790c-2458-438e-95c7-7e1412fe05fc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:33:39 user nova-compute[74337]: DEBUG nova.compute.manager [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] [instance: ff1c790c-2458-438e-95c7-7e1412fe05fc] Starting instance... {{(pid=74337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 21:33:39 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:33:39 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:33:39 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 21:33:39 user nova-compute[74337]: INFO nova.compute.claims [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] [instance: ff1c790c-2458-438e-95c7-7e1412fe05fc] Claim successful on node user
Oct 23 21:33:40 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:33:40 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:33:40 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.759s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:33:40 user nova-compute[74337]: DEBUG nova.compute.manager [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] [instance: ff1c790c-2458-438e-95c7-7e1412fe05fc] Start building networks asynchronously for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 21:33:40 user nova-compute[74337]: DEBUG nova.compute.manager [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] [instance: ff1c790c-2458-438e-95c7-7e1412fe05fc] Allocating IP information in the background. {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 21:33:40 user nova-compute[74337]: DEBUG nova.network.neutron [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] [instance: ff1c790c-2458-438e-95c7-7e1412fe05fc] allocate_for_instance() {{(pid=74337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 21:33:40 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:40 user nova-compute[74337]: DEBUG nova.compute.manager [req-6cef0222-8043-4164-8e6a-d98143018893 req-85994ac8-5cae-4f40-af37-bb7324d83b8e service nova] [instance: 05b80b08-f66c-4cc6-b806-f25543536bfa] Received event network-vif-plugged-3373880f-4797-411f-9e90-104572cca818 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:33:40 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-6cef0222-8043-4164-8e6a-d98143018893 req-85994ac8-5cae-4f40-af37-bb7324d83b8e service nova] Acquiring lock "05b80b08-f66c-4cc6-b806-f25543536bfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:33:40 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-6cef0222-8043-4164-8e6a-d98143018893 req-85994ac8-5cae-4f40-af37-bb7324d83b8e service nova] Lock "05b80b08-f66c-4cc6-b806-f25543536bfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:33:40 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-6cef0222-8043-4164-8e6a-d98143018893 req-85994ac8-5cae-4f40-af37-bb7324d83b8e service nova] Lock "05b80b08-f66c-4cc6-b806-f25543536bfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:33:40 user nova-compute[74337]: DEBUG nova.compute.manager [req-6cef0222-8043-4164-8e6a-d98143018893 req-85994ac8-5cae-4f40-af37-bb7324d83b8e service nova] [instance: 05b80b08-f66c-4cc6-b806-f25543536bfa] No waiting events found dispatching network-vif-plugged-3373880f-4797-411f-9e90-104572cca818 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:33:40 user nova-compute[74337]: WARNING nova.compute.manager [req-6cef0222-8043-4164-8e6a-d98143018893 req-85994ac8-5cae-4f40-af37-bb7324d83b8e service nova] [instance: 05b80b08-f66c-4cc6-b806-f25543536bfa] Received unexpected event network-vif-plugged-3373880f-4797-411f-9e90-104572cca818 for instance with vm_state active and task_state None.
Oct 23 21:33:40 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] [instance: ff1c790c-2458-438e-95c7-7e1412fe05fc] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Oct 23 21:33:40 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:40 user nova-compute[74337]: DEBUG nova.compute.manager [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] [instance: ff1c790c-2458-438e-95c7-7e1412fe05fc] Start building block device mappings for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 21:33:40 user nova-compute[74337]: DEBUG nova.policy [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9275fe8f8ca0498aa0a743a3165e30d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8974716be54b402a8d6b91a30e71f480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74337) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 21:33:40 user nova-compute[74337]: DEBUG nova.compute.manager [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] [instance: ff1c790c-2458-438e-95c7-7e1412fe05fc] Start spawning the instance on the hypervisor. {{(pid=74337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 21:33:40 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] [instance: ff1c790c-2458-438e-95c7-7e1412fe05fc] Creating instance directory {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 21:33:40 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] [instance: ff1c790c-2458-438e-95c7-7e1412fe05fc] Creating image(s)
Oct 23 21:33:40 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Acquiring lock "/opt/stack/data/nova/instances/ff1c790c-2458-438e-95c7-7e1412fe05fc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:33:40 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Lock "/opt/stack/data/nova/instances/ff1c790c-2458-438e-95c7-7e1412fe05fc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:33:40 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Lock "/opt/stack/data/nova/instances/ff1c790c-2458-438e-95c7-7e1412fe05fc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:33:40 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Acquiring lock "39aa0a5e56f1f3c05de609dc55fafb3bfc8559b9" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:33:40 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Lock "39aa0a5e56f1f3c05de609dc55fafb3bfc8559b9" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:33:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/39aa0a5e56f1f3c05de609dc55fafb3bfc8559b9.part --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:33:41 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:41 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:41 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/39aa0a5e56f1f3c05de609dc55fafb3bfc8559b9.part --force-share --output=json" returned: 0 in 0.251s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:33:41 user nova-compute[74337]: DEBUG nova.virt.images [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] 42a1517e-ef22-4f53-800d-106330acefbc was qcow2, converting to raw {{(pid=74337) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 23 21:33:41 user nova-compute[74337]: DEBUG nova.privsep.utils [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74337) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 23 21:33:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/39aa0a5e56f1f3c05de609dc55fafb3bfc8559b9.part /opt/stack/data/nova/instances/_base/39aa0a5e56f1f3c05de609dc55fafb3bfc8559b9.converted {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:33:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/39aa0a5e56f1f3c05de609dc55fafb3bfc8559b9.part /opt/stack/data/nova/instances/_base/39aa0a5e56f1f3c05de609dc55fafb3bfc8559b9.converted" returned: 0 in 0.494s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:33:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/39aa0a5e56f1f3c05de609dc55fafb3bfc8559b9.converted --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:33:42 user nova-compute[74337]: DEBUG nova.network.neutron [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] [instance: ff1c790c-2458-438e-95c7-7e1412fe05fc] Successfully created port: ff6c7795-2085-4305-b0aa-72050c9b979b {{(pid=74337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 21:33:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/39aa0a5e56f1f3c05de609dc55fafb3bfc8559b9.converted --force-share --output=json" returned: 0 in 0.213s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:33:42 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Lock "39aa0a5e56f1f3c05de609dc55fafb3bfc8559b9" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.740s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:33:42 user nova-compute[74337]: DEBUG nova.compute.manager [req-f406ae3b-6c93-471f-9769-5bef22402364 req-8e9778f7-7e32-4bab-90ed-dc870a0e53a6 service nova] [instance: 05b80b08-f66c-4cc6-b806-f25543536bfa] Received event network-vif-plugged-3373880f-4797-411f-9e90-104572cca818 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:33:42 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-f406ae3b-6c93-471f-9769-5bef22402364 req-8e9778f7-7e32-4bab-90ed-dc870a0e53a6 service nova] Acquiring lock "05b80b08-f66c-4cc6-b806-f25543536bfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:33:42 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-f406ae3b-6c93-471f-9769-5bef22402364 req-8e9778f7-7e32-4bab-90ed-dc870a0e53a6 service nova] Lock "05b80b08-f66c-4cc6-b806-f25543536bfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:33:42 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-f406ae3b-6c93-471f-9769-5bef22402364 req-8e9778f7-7e32-4bab-90ed-dc870a0e53a6 service nova] Lock "05b80b08-f66c-4cc6-b806-f25543536bfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:33:42 user nova-compute[74337]: DEBUG nova.compute.manager [req-f406ae3b-6c93-471f-9769-5bef22402364 req-8e9778f7-7e32-4bab-90ed-dc870a0e53a6 service nova] [instance: 05b80b08-f66c-4cc6-b806-f25543536bfa] No waiting events found dispatching network-vif-plugged-3373880f-4797-411f-9e90-104572cca818 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:33:42 user nova-compute[74337]: WARNING nova.compute.manager [req-f406ae3b-6c93-471f-9769-5bef22402364 req-8e9778f7-7e32-4bab-90ed-dc870a0e53a6 service nova] [instance: 05b80b08-f66c-4cc6-b806-f25543536bfa] Received unexpected event network-vif-plugged-3373880f-4797-411f-9e90-104572cca818 for instance with vm_state active and task_state None.
Oct 23 21:33:42 user nova-compute[74337]: DEBUG nova.compute.manager [req-f406ae3b-6c93-471f-9769-5bef22402364 req-8e9778f7-7e32-4bab-90ed-dc870a0e53a6 service nova] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Received event network-vif-plugged-872b2a23-8054-4d26-b798-c0099d1c9a91 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:33:42 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-f406ae3b-6c93-471f-9769-5bef22402364 req-8e9778f7-7e32-4bab-90ed-dc870a0e53a6 service nova] Acquiring lock "d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:33:42 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-f406ae3b-6c93-471f-9769-5bef22402364 req-8e9778f7-7e32-4bab-90ed-dc870a0e53a6 service nova] Lock "d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:33:42 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-f406ae3b-6c93-471f-9769-5bef22402364 req-8e9778f7-7e32-4bab-90ed-dc870a0e53a6 service nova] Lock "d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:33:42 user nova-compute[74337]: DEBUG nova.compute.manager [req-f406ae3b-6c93-471f-9769-5bef22402364 req-8e9778f7-7e32-4bab-90ed-dc870a0e53a6 service nova] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] No waiting events found dispatching network-vif-plugged-872b2a23-8054-4d26-b798-c0099d1c9a91 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:33:42 user nova-compute[74337]: WARNING nova.compute.manager [req-f406ae3b-6c93-471f-9769-5bef22402364 req-8e9778f7-7e32-4bab-90ed-dc870a0e53a6 service nova] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Received unexpected event network-vif-plugged-872b2a23-8054-4d26-b798-c0099d1c9a91 for instance with vm_state active and task_state None.
Oct 23 21:33:42 user nova-compute[74337]: DEBUG nova.compute.manager [req-f406ae3b-6c93-471f-9769-5bef22402364 req-8e9778f7-7e32-4bab-90ed-dc870a0e53a6 service nova] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Received event network-vif-plugged-872b2a23-8054-4d26-b798-c0099d1c9a91 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:33:42 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-f406ae3b-6c93-471f-9769-5bef22402364 req-8e9778f7-7e32-4bab-90ed-dc870a0e53a6 service nova] Acquiring lock "d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:33:42 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-f406ae3b-6c93-471f-9769-5bef22402364 req-8e9778f7-7e32-4bab-90ed-dc870a0e53a6 service nova] Lock "d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:33:42 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-f406ae3b-6c93-471f-9769-5bef22402364 req-8e9778f7-7e32-4bab-90ed-dc870a0e53a6 service nova] Lock "d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:33:42 user nova-compute[74337]: DEBUG nova.compute.manager [req-f406ae3b-6c93-471f-9769-5bef22402364 req-8e9778f7-7e32-4bab-90ed-dc870a0e53a6 service nova] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] No waiting events found dispatching network-vif-plugged-872b2a23-8054-4d26-b798-c0099d1c9a91 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:33:42 user nova-compute[74337]: WARNING nova.compute.manager [req-f406ae3b-6c93-471f-9769-5bef22402364 req-8e9778f7-7e32-4bab-90ed-dc870a0e53a6 service nova] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Received unexpected event network-vif-plugged-872b2a23-8054-4d26-b798-c0099d1c9a91 for instance with vm_state active and task_state None.
Oct 23 21:33:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/39aa0a5e56f1f3c05de609dc55fafb3bfc8559b9 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:33:42 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-8e262346-aecf-46a7-8511-486018366793 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Acquiring lock "5a181593-8086-4ece-9f5b-5ccba0bfe91e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:33:42 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-8e262346-aecf-46a7-8511-486018366793 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Lock "5a181593-8086-4ece-9f5b-5ccba0bfe91e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:33:42 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:42 user nova-compute[74337]: DEBUG nova.compute.manager [None req-8e262346-aecf-46a7-8511-486018366793 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] [instance: 5a181593-8086-4ece-9f5b-5ccba0bfe91e] Starting instance... {{(pid=74337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 21:33:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/39aa0a5e56f1f3c05de609dc55fafb3bfc8559b9 --force-share --output=json" returned: 0 in 0.278s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:33:42 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Acquiring lock "39aa0a5e56f1f3c05de609dc55fafb3bfc8559b9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:33:42 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Lock "39aa0a5e56f1f3c05de609dc55fafb3bfc8559b9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:33:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/39aa0a5e56f1f3c05de609dc55fafb3bfc8559b9 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:33:42 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-8e262346-aecf-46a7-8511-486018366793 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:33:42 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-8e262346-aecf-46a7-8511-486018366793 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:33:43 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-8e262346-aecf-46a7-8511-486018366793 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 21:33:43 user nova-compute[74337]: INFO nova.compute.claims [None req-8e262346-aecf-46a7-8511-486018366793 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] [instance: 5a181593-8086-4ece-9f5b-5ccba0bfe91e] Claim successful on node user
Oct 23 21:33:43 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/39aa0a5e56f1f3c05de609dc55fafb3bfc8559b9 --force-share --output=json" returned: 0 in 0.297s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:33:43 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/39aa0a5e56f1f3c05de609dc55fafb3bfc8559b9,backing_fmt=raw /opt/stack/data/nova/instances/ff1c790c-2458-438e-95c7-7e1412fe05fc/disk 1073741824 {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:33:43 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/39aa0a5e56f1f3c05de609dc55fafb3bfc8559b9,backing_fmt=raw /opt/stack/data/nova/instances/ff1c790c-2458-438e-95c7-7e1412fe05fc/disk 1073741824" returned: 0 in 0.223s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:33:43 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Lock "39aa0a5e56f1f3c05de609dc55fafb3bfc8559b9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.527s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:33:43 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/39aa0a5e56f1f3c05de609dc55fafb3bfc8559b9 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:33:43 user nova-compute[74337]: DEBUG nova.network.neutron [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] [instance: ff1c790c-2458-438e-95c7-7e1412fe05fc] Successfully updated port: ff6c7795-2085-4305-b0aa-72050c9b979b {{(pid=74337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 21:33:43 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Acquiring lock "refresh_cache-ff1c790c-2458-438e-95c7-7e1412fe05fc" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:33:43 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Acquired lock "refresh_cache-ff1c790c-2458-438e-95c7-7e1412fe05fc" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:33:43 user nova-compute[74337]: DEBUG nova.network.neutron [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] [instance: ff1c790c-2458-438e-95c7-7e1412fe05fc] Building network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 21:33:43 user nova-compute[74337]: DEBUG nova.compute.manager [req-89ca3dfe-6c83-4255-9534-6dcb699b01c5 req-a07e1198-41e5-4367-abc1-e6822978bac2 service nova] [instance: ff1c790c-2458-438e-95c7-7e1412fe05fc] Received event network-changed-ff6c7795-2085-4305-b0aa-72050c9b979b {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:33:43 user nova-compute[74337]: DEBUG nova.compute.manager [req-89ca3dfe-6c83-4255-9534-6dcb699b01c5 req-a07e1198-41e5-4367-abc1-e6822978bac2 service nova] [instance: ff1c790c-2458-438e-95c7-7e1412fe05fc] Refreshing instance network info cache due to event network-changed-ff6c7795-2085-4305-b0aa-72050c9b979b. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 21:33:43 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-89ca3dfe-6c83-4255-9534-6dcb699b01c5 req-a07e1198-41e5-4367-abc1-e6822978bac2 service nova] Acquiring lock "refresh_cache-ff1c790c-2458-438e-95c7-7e1412fe05fc" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:33:43 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/39aa0a5e56f1f3c05de609dc55fafb3bfc8559b9 --force-share --output=json" returned: 0 in 0.212s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:33:43 user nova-compute[74337]: DEBUG nova.virt.disk.api [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ff1c790c-2458-438e-95c7-7e1412fe05fc/disk. size=1073741824 {{(pid=74337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 21:33:43 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff1c790c-2458-438e-95c7-7e1412fe05fc/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:33:43 user nova-compute[74337]: DEBUG nova.network.neutron [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] [instance: ff1c790c-2458-438e-95c7-7e1412fe05fc] Instance cache missing network info. {{(pid=74337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 21:33:43 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-8e262346-aecf-46a7-8511-486018366793 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:33:43 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-8e262346-aecf-46a7-8511-486018366793 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:33:43 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-8e262346-aecf-46a7-8511-486018366793 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.797s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:33:43 user nova-compute[74337]: DEBUG nova.compute.manager [None req-8e262346-aecf-46a7-8511-486018366793 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] [instance: 5a181593-8086-4ece-9f5b-5ccba0bfe91e] Start building networks asynchronously for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 21:33:43 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff1c790c-2458-438e-95c7-7e1412fe05fc/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:33:43 user nova-compute[74337]: DEBUG nova.virt.disk.api [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Cannot resize image /opt/stack/data/nova/instances/ff1c790c-2458-438e-95c7-7e1412fe05fc/disk to a smaller size. {{(pid=74337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 21:33:43 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] [instance: ff1c790c-2458-438e-95c7-7e1412fe05fc] Created local disks {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 21:33:43 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] [instance: ff1c790c-2458-438e-95c7-7e1412fe05fc] Ensure instance console log exists: /opt/stack/data/nova/instances/ff1c790c-2458-438e-95c7-7e1412fe05fc/console.log {{(pid=74337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 21:33:43 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:33:43 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:33:43 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:33:43 user nova-compute[74337]: DEBUG nova.compute.manager [None req-8e262346-aecf-46a7-8511-486018366793 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] [instance: 5a181593-8086-4ece-9f5b-5ccba0bfe91e] Allocating IP information in the background. {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 21:33:43 user nova-compute[74337]: DEBUG nova.network.neutron [None req-8e262346-aecf-46a7-8511-486018366793 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] [instance: 5a181593-8086-4ece-9f5b-5ccba0bfe91e] allocate_for_instance() {{(pid=74337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 21:33:43 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-8e262346-aecf-46a7-8511-486018366793 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] [instance: 5a181593-8086-4ece-9f5b-5ccba0bfe91e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 21:33:43 user nova-compute[74337]: DEBUG nova.compute.manager [None req-8e262346-aecf-46a7-8511-486018366793 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] [instance: 5a181593-8086-4ece-9f5b-5ccba0bfe91e] Start building block device mappings for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 21:33:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:44 user nova-compute[74337]: DEBUG nova.compute.manager [None req-8e262346-aecf-46a7-8511-486018366793 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] [instance: 5a181593-8086-4ece-9f5b-5ccba0bfe91e] Start spawning the instance on the hypervisor. {{(pid=74337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 21:33:44 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-8e262346-aecf-46a7-8511-486018366793 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] [instance: 5a181593-8086-4ece-9f5b-5ccba0bfe91e] Creating instance directory {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 21:33:44 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-8e262346-aecf-46a7-8511-486018366793 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] [instance: 5a181593-8086-4ece-9f5b-5ccba0bfe91e] Creating image(s)
Oct 23 21:33:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-8e262346-aecf-46a7-8511-486018366793 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Acquiring lock "/opt/stack/data/nova/instances/5a181593-8086-4ece-9f5b-5ccba0bfe91e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:33:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-8e262346-aecf-46a7-8511-486018366793 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Lock "/opt/stack/data/nova/instances/5a181593-8086-4ece-9f5b-5ccba0bfe91e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:33:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-8e262346-aecf-46a7-8511-486018366793 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Lock "/opt/stack/data/nova/instances/5a181593-8086-4ece-9f5b-5ccba0bfe91e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:33:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-8e262346-aecf-46a7-8511-486018366793 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:33:44 user nova-compute[74337]: DEBUG nova.compute.manager [None req-1d528b47-2a3b-42ab-b251-9c2ad291f36e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] Instance event wait completed in 0 seconds for  {{(pid=74337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 21:33:44 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-1d528b47-2a3b-42ab-b251-9c2ad291f36e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] Guest created on hypervisor {{(pid=74337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 21:33:44 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] Instance spawned successfully.
Oct 23 21:33:44 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-1d528b47-2a3b-42ab-b251-9c2ad291f36e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 21:33:44 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-1d528b47-2a3b-42ab-b251-9c2ad291f36e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] Found default for hw_cdrom_bus of ide {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:33:44 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-1d528b47-2a3b-42ab-b251-9c2ad291f36e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] Found default for hw_disk_bus of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:33:44 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-1d528b47-2a3b-42ab-b251-9c2ad291f36e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] Found default for hw_input_bus of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:33:44 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-1d528b47-2a3b-42ab-b251-9c2ad291f36e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] Found default for hw_pointer_model of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:33:44 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-1d528b47-2a3b-42ab-b251-9c2ad291f36e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] Found default for hw_video_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:33:44 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-1d528b47-2a3b-42ab-b251-9c2ad291f36e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] Found default for hw_vif_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:33:44 user nova-compute[74337]: DEBUG nova.policy [None req-8e262346-aecf-46a7-8511-486018366793 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3fbcff9492364ae9b4771d5f890016dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '222c613ffcb647f183ef412107337c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74337) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 21:33:44 user nova-compute[74337]: INFO nova.compute.manager [None req-1d528b47-2a3b-42ab-b251-9c2ad291f36e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] Took 10.78 seconds to spawn the instance on the hypervisor.
Oct 23 21:33:44 user nova-compute[74337]: DEBUG nova.compute.manager [None req-1d528b47-2a3b-42ab-b251-9c2ad291f36e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] Checking state {{(pid=74337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 21:33:44 user nova-compute[74337]: DEBUG nova.network.neutron [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] [instance: ff1c790c-2458-438e-95c7-7e1412fe05fc] Updating instance_info_cache with network_info: [{"id": "ff6c7795-2085-4305-b0aa-72050c9b979b", "address": "fa:16:3e:0c:4d:a8", "network": {"id": "44287c31-0a66-49b2-a43f-9197e80d754e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1903058995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8974716be54b402a8d6b91a30e71f480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff6c7795-20", "ovs_interfaceid": "ff6c7795-2085-4305-b0aa-72050c9b979b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:33:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-8e262346-aecf-46a7-8511-486018366793 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.225s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:33:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-8e262346-aecf-46a7-8511-486018366793 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Acquiring lock "fc7b140751b8c385de81623e40fb09ce09374ab7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:33:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-8e262346-aecf-46a7-8511-486018366793 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Lock "fc7b140751b8c385de81623e40fb09ce09374ab7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:33:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-8e262346-aecf-46a7-8511-486018366793 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:33:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Releasing lock "refresh_cache-ff1c790c-2458-438e-95c7-7e1412fe05fc" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:33:44 user nova-compute[74337]: DEBUG nova.compute.manager [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] [instance: ff1c790c-2458-438e-95c7-7e1412fe05fc] Instance network_info: |[{"id": "ff6c7795-2085-4305-b0aa-72050c9b979b", "address": "fa:16:3e:0c:4d:a8", "network": {"id": "44287c31-0a66-49b2-a43f-9197e80d754e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1903058995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8974716be54b402a8d6b91a30e71f480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff6c7795-20", "ovs_interfaceid": "ff6c7795-2085-4305-b0aa-72050c9b979b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 21:33:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-89ca3dfe-6c83-4255-9534-6dcb699b01c5 req-a07e1198-41e5-4367-abc1-e6822978bac2 service nova] Acquired lock "refresh_cache-ff1c790c-2458-438e-95c7-7e1412fe05fc" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:33:44 user nova-compute[74337]: DEBUG nova.network.neutron [req-89ca3dfe-6c83-4255-9534-6dcb699b01c5 req-a07e1198-41e5-4367-abc1-e6822978bac2 service nova] [instance: ff1c790c-2458-438e-95c7-7e1412fe05fc] Refreshing network info cache for port ff6c7795-2085-4305-b0aa-72050c9b979b {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 21:33:44 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] [instance: ff1c790c-2458-438e-95c7-7e1412fe05fc] Start _get_guest_xml network_info=[{"id": "ff6c7795-2085-4305-b0aa-72050c9b979b", "address": "fa:16:3e:0c:4d:a8", "network": {"id": "44287c31-0a66-49b2-a43f-9197e80d754e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1903058995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8974716be54b402a8d6b91a30e71f480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff6c7795-20", "ovs_interfaceid": "ff6c7795-2085-4305-b0aa-72050c9b979b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T21:33:30Z,direct_url=<?>,disk_format='qcow2',id=42a1517e-ef22-4f53-800d-106330acefbc,min_disk=0,min_ram=0,name='',owner='45fcbede2bb641ec8b22de326797ac62',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T21:33:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'device_name': '/dev/sda', 'device_type': 'disk', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'scsi', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'image_id': '42a1517e-ef22-4f53-800d-106330acefbc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 21:33:44 user nova-compute[74337]: INFO nova.compute.manager [None req-1d528b47-2a3b-42ab-b251-9c2ad291f36e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] Took 12.06 seconds to build instance.
Oct 23 21:33:44 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:33:44 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:33:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-1d528b47-2a3b-42ab-b251-9c2ad291f36e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Lock "8acc1b10-a541-4c06-aeb7-1ecf7a2457be" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.213s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:33:44 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 21:33:44 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] CPU controller missing on host. {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 21:33:44 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 21:33:44 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] CPU controller found on host. {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 21:33:44 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 21:33:44 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T21:29:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T21:33:30Z,direct_url=<?>,disk_format='qcow2',id=42a1517e-ef22-4f53-800d-106330acefbc,min_disk=0,min_ram=0,name='',owner='45fcbede2bb641ec8b22de326797ac62',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T21:33:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 21:33:44 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Flavor limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 21:33:44 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Image limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 21:33:44 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Flavor pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 21:33:44 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Image pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 21:33:44 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 21:33:44 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 21:33:44 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 21:33:44 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Got 1 possible topologies {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 21:33:44 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 21:33:44 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 21:33:44 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T21:33:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-908688255',display_name='tempest-AttachSCSIVolumeTestJSON-server-908688255',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-908688255',id=6,image_ref='42a1517e-ef22-4f53-800d-106330acefbc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPd/iziWr420mTBtexQB4JLh3y8nMF7b3lC+/orZ3nWa+5WnD0Xmmnhsi/7IDK797OWZ0kYksxXSw3CGKqjBoRTEb2oV6oL9K/CdufbDV0xMehjtw5wOx0IPRPI0cilhhg==',key_name='tempest-keypair-327531323',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8974716be54b402a8d6b91a30e71f480',ramdisk_id='',reservation_id='r-jwzeai7b',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='42a1517e-ef22-4f53-800d-106330acefbc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-305936041',owner_user_name='tempest-AttachSCSIVolumeTestJSON-305936041-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:33:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9275fe8f8ca0498aa0a743a3165e30d3',uuid=ff1c790c-2458-438e-95c7-7e1412fe05fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff6c7795-2085-4305-b0aa-72050c9b979b", "address": "fa:16:3e:0c:4d:a8", "network": {"id": "44287c31-0a66-49b2-a43f-9197e80d754e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1903058995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8974716be54b402a8d6b91a30e71f480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff6c7795-20", "ovs_interfaceid": "ff6c7795-2085-4305-b0aa-72050c9b979b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 21:33:44 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Converting VIF {"id": "ff6c7795-2085-4305-b0aa-72050c9b979b", "address": "fa:16:3e:0c:4d:a8", "network": {"id": "44287c31-0a66-49b2-a43f-9197e80d754e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1903058995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8974716be54b402a8d6b91a30e71f480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff6c7795-20", "ovs_interfaceid": "ff6c7795-2085-4305-b0aa-72050c9b979b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:33:44 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:4d:a8,bridge_name='br-int',has_traffic_filtering=True,id=ff6c7795-2085-4305-b0aa-72050c9b979b,network=Network(44287c31-0a66-49b2-a43f-9197e80d754e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff6c7795-20') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:33:44 user nova-compute[74337]: DEBUG nova.objects.instance [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Lazy-loading 'pci_devices' on Instance uuid ff1c790c-2458-438e-95c7-7e1412fe05fc {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:33:44 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] [instance: ff1c790c-2458-438e-95c7-7e1412fe05fc] End _get_guest_xml xml=<domain type="kvm">
Oct 23 21:33:44 user nova-compute[74337]:   <uuid>ff1c790c-2458-438e-95c7-7e1412fe05fc</uuid>
Oct 23 21:33:44 user nova-compute[74337]:   <name>instance-00000006</name>
Oct 23 21:33:44 user nova-compute[74337]:   <memory>524288</memory>
Oct 23 21:33:44 user nova-compute[74337]:   <vcpu>1</vcpu>
Oct 23 21:33:44 user nova-compute[74337]:   <metadata>
Oct 23 21:33:44 user nova-compute[74337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 21:33:44 user nova-compute[74337]:       <nova:package version="0.0.0"/>
Oct 23 21:33:44 user nova-compute[74337]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-908688255</nova:name>
Oct 23 21:33:44 user nova-compute[74337]:       <nova:creationTime>2023-10-23 21:33:44</nova:creationTime>
Oct 23 21:33:44 user nova-compute[74337]:       <nova:flavor name="m1.tiny">
Oct 23 21:33:44 user nova-compute[74337]:         <nova:memory>512</nova:memory>
Oct 23 21:33:44 user nova-compute[74337]:         <nova:disk>1</nova:disk>
Oct 23 21:33:44 user nova-compute[74337]:         <nova:swap>0</nova:swap>
Oct 23 21:33:44 user nova-compute[74337]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 21:33:44 user nova-compute[74337]:         <nova:vcpus>1</nova:vcpus>
Oct 23 21:33:44 user nova-compute[74337]:       </nova:flavor>
Oct 23 21:33:44 user nova-compute[74337]:       <nova:owner>
Oct 23 21:33:44 user nova-compute[74337]:         <nova:user uuid="9275fe8f8ca0498aa0a743a3165e30d3">tempest-AttachSCSIVolumeTestJSON-305936041-project-member</nova:user>
Oct 23 21:33:44 user nova-compute[74337]:         <nova:project uuid="8974716be54b402a8d6b91a30e71f480">tempest-AttachSCSIVolumeTestJSON-305936041</nova:project>
Oct 23 21:33:44 user nova-compute[74337]:       </nova:owner>
Oct 23 21:33:44 user nova-compute[74337]:       <nova:root type="image" uuid="42a1517e-ef22-4f53-800d-106330acefbc"/>
Oct 23 21:33:44 user nova-compute[74337]:       <nova:ports>
Oct 23 21:33:44 user nova-compute[74337]:         <nova:port uuid="ff6c7795-2085-4305-b0aa-72050c9b979b">
Oct 23 21:33:44 user nova-compute[74337]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 23 21:33:44 user nova-compute[74337]:         </nova:port>
Oct 23 21:33:44 user nova-compute[74337]:       </nova:ports>
Oct 23 21:33:44 user nova-compute[74337]:     </nova:instance>
Oct 23 21:33:44 user nova-compute[74337]:   </metadata>
Oct 23 21:33:44 user nova-compute[74337]:   <sysinfo type="smbios">
Oct 23 21:33:44 user nova-compute[74337]:     <system>
Oct 23 21:33:44 user nova-compute[74337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 21:33:44 user nova-compute[74337]:       <entry name="product">OpenStack Nova</entry>
Oct 23 21:33:44 user nova-compute[74337]:       <entry name="version">0.0.0</entry>
Oct 23 21:33:44 user nova-compute[74337]:       <entry name="serial">ff1c790c-2458-438e-95c7-7e1412fe05fc</entry>
Oct 23 21:33:44 user nova-compute[74337]:       <entry name="uuid">ff1c790c-2458-438e-95c7-7e1412fe05fc</entry>
Oct 23 21:33:44 user nova-compute[74337]:       <entry name="family">Virtual Machine</entry>
Oct 23 21:33:44 user nova-compute[74337]:     </system>
Oct 23 21:33:44 user nova-compute[74337]:   </sysinfo>
Oct 23 21:33:44 user nova-compute[74337]:   <os>
Oct 23 21:33:44 user nova-compute[74337]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 21:33:44 user nova-compute[74337]:     <boot dev="hd"/>
Oct 23 21:33:44 user nova-compute[74337]:     <smbios mode="sysinfo"/>
Oct 23 21:33:44 user nova-compute[74337]:   </os>
Oct 23 21:33:44 user nova-compute[74337]:   <features>
Oct 23 21:33:44 user nova-compute[74337]:     <acpi/>
Oct 23 21:33:44 user nova-compute[74337]:     <apic/>
Oct 23 21:33:44 user nova-compute[74337]:     <vmcoreinfo/>
Oct 23 21:33:44 user nova-compute[74337]:   </features>
Oct 23 21:33:44 user nova-compute[74337]:   <clock offset="utc">
Oct 23 21:33:44 user nova-compute[74337]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 21:33:44 user nova-compute[74337]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 21:33:44 user nova-compute[74337]:     <timer name="hpet" present="no"/>
Oct 23 21:33:44 user nova-compute[74337]:   </clock>
Oct 23 21:33:44 user nova-compute[74337]:   <cpu mode="custom" match="exact">
Oct 23 21:33:44 user nova-compute[74337]:     <model>Nehalem</model>
Oct 23 21:33:44 user nova-compute[74337]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 21:33:44 user nova-compute[74337]:   </cpu>
Oct 23 21:33:44 user nova-compute[74337]:   <devices>
Oct 23 21:33:44 user nova-compute[74337]:     <disk type="file" device="disk">
Oct 23 21:33:44 user nova-compute[74337]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 21:33:44 user nova-compute[74337]:       <source file="/opt/stack/data/nova/instances/ff1c790c-2458-438e-95c7-7e1412fe05fc/disk"/>
Oct 23 21:33:44 user nova-compute[74337]:       <target dev="sda" bus="scsi"/>
Oct 23 21:33:44 user nova-compute[74337]:       <address type="drive" controller="0" unit="0"/>
Oct 23 21:33:44 user nova-compute[74337]:     </disk>
Oct 23 21:33:44 user nova-compute[74337]:     <disk type="file" device="cdrom">
Oct 23 21:33:44 user nova-compute[74337]:       <driver name="qemu" type="raw" cache="none"/>
Oct 23 21:33:44 user nova-compute[74337]:       <source file="/opt/stack/data/nova/instances/ff1c790c-2458-438e-95c7-7e1412fe05fc/disk.config"/>
Oct 23 21:33:44 user nova-compute[74337]:       <target dev="sdb" bus="scsi"/>
Oct 23 21:33:44 user nova-compute[74337]:       <address type="drive" controller="0" unit="1"/>
Oct 23 21:33:44 user nova-compute[74337]:     </disk>
Oct 23 21:33:44 user nova-compute[74337]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Oct 23 21:33:44 user nova-compute[74337]:     <interface type="ethernet">
Oct 23 21:33:44 user nova-compute[74337]:       <mac address="fa:16:3e:0c:4d:a8"/>
Oct 23 21:33:44 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:33:44 user nova-compute[74337]:       <mtu size="1442"/>
Oct 23 21:33:44 user nova-compute[74337]:       <target dev="tapff6c7795-20"/>
Oct 23 21:33:44 user nova-compute[74337]:     </interface>
Oct 23 21:33:44 user nova-compute[74337]:     <serial type="pty">
Oct 23 21:33:44 user nova-compute[74337]:       <log file="/opt/stack/data/nova/instances/ff1c790c-2458-438e-95c7-7e1412fe05fc/console.log" append="off"/>
Oct 23 21:33:44 user nova-compute[74337]:     </serial>
Oct 23 21:33:44 user nova-compute[74337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 21:33:44 user nova-compute[74337]:     <video>
Oct 23 21:33:44 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:33:44 user nova-compute[74337]:     </video>
Oct 23 21:33:44 user nova-compute[74337]:     <rng model="virtio">
Oct 23 21:33:44 user nova-compute[74337]:       <backend model="random">/dev/urandom</backend>
Oct 23 21:33:44 user nova-compute[74337]:     </rng>
Oct 23 21:33:44 user nova-compute[74337]:     <controller type="usb" index="0" model="none"/>
Oct 23 21:33:44 user nova-compute[74337]:     <memballoon model="virtio">
Oct 23 21:33:44 user nova-compute[74337]:       <stats period="10"/>
Oct 23 21:33:44 user nova-compute[74337]:     </memballoon>
Oct 23 21:33:44 user nova-compute[74337]:   </devices>
Oct 23 21:33:44 user nova-compute[74337]: </domain>
Oct 23 21:33:44 user nova-compute[74337]:  {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 21:33:44 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T21:33:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-908688255',display_name='tempest-AttachSCSIVolumeTestJSON-server-908688255',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-908688255',id=6,image_ref='42a1517e-ef22-4f53-800d-106330acefbc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPd/iziWr420mTBtexQB4JLh3y8nMF7b3lC+/orZ3nWa+5WnD0Xmmnhsi/7IDK797OWZ0kYksxXSw3CGKqjBoRTEb2oV6oL9K/CdufbDV0xMehjtw5wOx0IPRPI0cilhhg==',key_name='tempest-keypair-327531323',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8974716be54b402a8d6b91a30e71f480',ramdisk_id='',reservation_id='r-jwzeai7b',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='42a1517e-ef22-4f53-800d-106330acefbc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-305936041',owner_user_name='tempest-AttachSCSIVolumeTestJSON-305936041-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:33:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9275fe8f8ca0498aa0a743a3165e30d3',uuid=ff1c790c-2458-438e-95c7-7e1412fe05fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff6c7795-2085-4305-b0aa-72050c9b979b", "address": "fa:16:3e:0c:4d:a8", "network": {"id": "44287c31-0a66-49b2-a43f-9197e80d754e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1903058995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8974716be54b402a8d6b91a30e71f480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff6c7795-20", "ovs_interfaceid": "ff6c7795-2085-4305-b0aa-72050c9b979b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 21:33:44 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Converting VIF {"id": "ff6c7795-2085-4305-b0aa-72050c9b979b", "address": "fa:16:3e:0c:4d:a8", "network": {"id": "44287c31-0a66-49b2-a43f-9197e80d754e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1903058995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8974716be54b402a8d6b91a30e71f480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff6c7795-20", "ovs_interfaceid": "ff6c7795-2085-4305-b0aa-72050c9b979b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:33:44 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:4d:a8,bridge_name='br-int',has_traffic_filtering=True,id=ff6c7795-2085-4305-b0aa-72050c9b979b,network=Network(44287c31-0a66-49b2-a43f-9197e80d754e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff6c7795-20') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:33:44 user nova-compute[74337]: DEBUG os_vif [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:4d:a8,bridge_name='br-int',has_traffic_filtering=True,id=ff6c7795-2085-4305-b0aa-72050c9b979b,network=Network(44287c31-0a66-49b2-a43f-9197e80d754e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff6c7795-20') {{(pid=74337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 21:33:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:33:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 21:33:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '10f4ff89-6f4f-5a65-ac5e-75125b13b9f7', '_type': 'linux-noop'}}, row=False) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:33:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:33:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapff6c7795-20, may_exist=True, interface_attrs={}) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:33:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapff6c7795-20, col_values=(('qos', UUID('c792d37b-a9a6-4733-b74f-3be79d726083')),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:33:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapff6c7795-20, col_values=(('external_ids', {'iface-id': 'ff6c7795-2085-4305-b0aa-72050c9b979b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0c:4d:a8', 'vm-uuid': 'ff1c790c-2458-438e-95c7-7e1412fe05fc'}),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:33:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:33:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-8e262346-aecf-46a7-8511-486018366793 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.263s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:33:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-8e262346-aecf-46a7-8511-486018366793 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7,backing_fmt=raw /opt/stack/data/nova/instances/5a181593-8086-4ece-9f5b-5ccba0bfe91e/disk 1073741824 {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:33:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:44 user nova-compute[74337]: INFO os_vif [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:4d:a8,bridge_name='br-int',has_traffic_filtering=True,id=ff6c7795-2085-4305-b0aa-72050c9b979b,network=Network(44287c31-0a66-49b2-a43f-9197e80d754e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff6c7795-20')
Oct 23 21:33:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-8e262346-aecf-46a7-8511-486018366793 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7,backing_fmt=raw /opt/stack/data/nova/instances/5a181593-8086-4ece-9f5b-5ccba0bfe91e/disk 1073741824" returned: 0 in 0.064s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:33:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-8e262346-aecf-46a7-8511-486018366793 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Lock "fc7b140751b8c385de81623e40fb09ce09374ab7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.340s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:33:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-8e262346-aecf-46a7-8511-486018366793 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:33:44 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] No BDM found with device name sda, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 21:33:44 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 21:33:44 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] No VIF found with MAC fa:16:3e:0c:4d:a8, not building metadata {{(pid=74337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 21:33:44 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] [instance: ff1c790c-2458-438e-95c7-7e1412fe05fc] Using config drive
Oct 23 21:33:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-8e262346-aecf-46a7-8511-486018366793 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.257s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:33:44 user nova-compute[74337]: DEBUG nova.virt.disk.api [None req-8e262346-aecf-46a7-8511-486018366793 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5a181593-8086-4ece-9f5b-5ccba0bfe91e/disk. size=1073741824 {{(pid=74337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 21:33:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-8e262346-aecf-46a7-8511-486018366793 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a181593-8086-4ece-9f5b-5ccba0bfe91e/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:33:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-8e262346-aecf-46a7-8511-486018366793 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a181593-8086-4ece-9f5b-5ccba0bfe91e/disk --force-share --output=json" returned: 0 in 0.279s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:33:45 user nova-compute[74337]: DEBUG nova.virt.disk.api [None req-8e262346-aecf-46a7-8511-486018366793 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Cannot resize image /opt/stack/data/nova/instances/5a181593-8086-4ece-9f5b-5ccba0bfe91e/disk to a smaller size. {{(pid=74337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 21:33:45 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-8e262346-aecf-46a7-8511-486018366793 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] [instance: 5a181593-8086-4ece-9f5b-5ccba0bfe91e] Created local disks {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 21:33:45 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-8e262346-aecf-46a7-8511-486018366793 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] [instance: 5a181593-8086-4ece-9f5b-5ccba0bfe91e] Ensure instance console log exists: /opt/stack/data/nova/instances/5a181593-8086-4ece-9f5b-5ccba0bfe91e/console.log {{(pid=74337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 21:33:45 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-8e262346-aecf-46a7-8511-486018366793 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:33:45 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-8e262346-aecf-46a7-8511-486018366793 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:33:45 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-8e262346-aecf-46a7-8511-486018366793 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:33:45 user nova-compute[74337]: DEBUG nova.network.neutron [None req-8e262346-aecf-46a7-8511-486018366793 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] [instance: 5a181593-8086-4ece-9f5b-5ccba0bfe91e] Successfully created port: b1c5ce36-994a-4a4d-9027-6e3716b2d8f5 {{(pid=74337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 21:33:45 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-48371ae4-5710-4721-9c71-bf52997cce40 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] Acquiring lock "a4bf4723-1e3c-42f1-a422-9d9263b67e3d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:33:45 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-48371ae4-5710-4721-9c71-bf52997cce40 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] Lock "a4bf4723-1e3c-42f1-a422-9d9263b67e3d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:33:45 user nova-compute[74337]: DEBUG nova.compute.manager [None req-48371ae4-5710-4721-9c71-bf52997cce40 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d] Starting instance... {{(pid=74337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 21:33:45 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] [instance: ff1c790c-2458-438e-95c7-7e1412fe05fc] Creating config drive at /opt/stack/data/nova/instances/ff1c790c-2458-438e-95c7-7e1412fe05fc/disk.config
Oct 23 21:33:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ff1c790c-2458-438e-95c7-7e1412fe05fc/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp62vgoqp2 {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:33:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ff1c790c-2458-438e-95c7-7e1412fe05fc/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp62vgoqp2" returned: 0 in 0.081s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:33:45 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-48371ae4-5710-4721-9c71-bf52997cce40 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:33:45 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-48371ae4-5710-4721-9c71-bf52997cce40 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:33:45 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-48371ae4-5710-4721-9c71-bf52997cce40 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 21:33:45 user nova-compute[74337]: INFO nova.compute.claims [None req-48371ae4-5710-4721-9c71-bf52997cce40 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d] Claim successful on node user
Oct 23 21:33:45 user nova-compute[74337]: DEBUG nova.compute.manager [req-8bc03aaf-5820-44c8-a412-83ac50df7ffb req-df04a78a-15d6-4cd0-91b1-fe98eff873bc service nova] [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89] Received event network-vif-plugged-d6e114a4-cf61-4a19-bb3d-e0bcbfc5f5e5 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:33:45 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-8bc03aaf-5820-44c8-a412-83ac50df7ffb req-df04a78a-15d6-4cd0-91b1-fe98eff873bc service nova] Acquiring lock "cf6270ba-7a4e-40c4-b7fd-c62a44125c89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:33:45 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-8bc03aaf-5820-44c8-a412-83ac50df7ffb req-df04a78a-15d6-4cd0-91b1-fe98eff873bc service nova] Lock "cf6270ba-7a4e-40c4-b7fd-c62a44125c89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:33:45 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-8bc03aaf-5820-44c8-a412-83ac50df7ffb req-df04a78a-15d6-4cd0-91b1-fe98eff873bc service nova] Lock "cf6270ba-7a4e-40c4-b7fd-c62a44125c89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:33:45 user nova-compute[74337]: DEBUG nova.compute.manager [req-8bc03aaf-5820-44c8-a412-83ac50df7ffb req-df04a78a-15d6-4cd0-91b1-fe98eff873bc service nova] [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89] No waiting events found dispatching network-vif-plugged-d6e114a4-cf61-4a19-bb3d-e0bcbfc5f5e5 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:33:45 user nova-compute[74337]: WARNING nova.compute.manager [req-8bc03aaf-5820-44c8-a412-83ac50df7ffb req-df04a78a-15d6-4cd0-91b1-fe98eff873bc service nova] [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89] Received unexpected event network-vif-plugged-d6e114a4-cf61-4a19-bb3d-e0bcbfc5f5e5 for instance with vm_state active and task_state None.
Oct 23 21:33:45 user nova-compute[74337]: DEBUG nova.compute.manager [req-8bc03aaf-5820-44c8-a412-83ac50df7ffb req-df04a78a-15d6-4cd0-91b1-fe98eff873bc service nova] [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89] Received event network-vif-plugged-d6e114a4-cf61-4a19-bb3d-e0bcbfc5f5e5 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:33:45 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-8bc03aaf-5820-44c8-a412-83ac50df7ffb req-df04a78a-15d6-4cd0-91b1-fe98eff873bc service nova] Acquiring lock "cf6270ba-7a4e-40c4-b7fd-c62a44125c89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:33:45 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-8bc03aaf-5820-44c8-a412-83ac50df7ffb req-df04a78a-15d6-4cd0-91b1-fe98eff873bc service nova] Lock "cf6270ba-7a4e-40c4-b7fd-c62a44125c89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:33:45 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-8bc03aaf-5820-44c8-a412-83ac50df7ffb req-df04a78a-15d6-4cd0-91b1-fe98eff873bc service nova] Lock "cf6270ba-7a4e-40c4-b7fd-c62a44125c89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:33:45 user nova-compute[74337]: DEBUG nova.compute.manager [req-8bc03aaf-5820-44c8-a412-83ac50df7ffb req-df04a78a-15d6-4cd0-91b1-fe98eff873bc service nova] [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89] No waiting events found dispatching network-vif-plugged-d6e114a4-cf61-4a19-bb3d-e0bcbfc5f5e5 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:33:45 user nova-compute[74337]: WARNING nova.compute.manager [req-8bc03aaf-5820-44c8-a412-83ac50df7ffb req-df04a78a-15d6-4cd0-91b1-fe98eff873bc service nova] [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89] Received unexpected event network-vif-plugged-d6e114a4-cf61-4a19-bb3d-e0bcbfc5f5e5 for instance with vm_state active and task_state None.
Oct 23 21:33:45 user nova-compute[74337]: DEBUG nova.compute.manager [req-8bc03aaf-5820-44c8-a412-83ac50df7ffb req-df04a78a-15d6-4cd0-91b1-fe98eff873bc service nova] [instance: d45e8ae8-371b-46ae-849d-d7f7d5bbd770] Received event network-vif-plugged-7ac73679-68b0-430f-8d77-68438fbb52f0 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:33:45 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-8bc03aaf-5820-44c8-a412-83ac50df7ffb req-df04a78a-15d6-4cd0-91b1-fe98eff873bc service nova] Acquiring lock "d45e8ae8-371b-46ae-849d-d7f7d5bbd770-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:33:45 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-8bc03aaf-5820-44c8-a412-83ac50df7ffb req-df04a78a-15d6-4cd0-91b1-fe98eff873bc service nova] Lock "d45e8ae8-371b-46ae-849d-d7f7d5bbd770-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:33:45 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-8bc03aaf-5820-44c8-a412-83ac50df7ffb req-df04a78a-15d6-4cd0-91b1-fe98eff873bc service nova] Lock "d45e8ae8-371b-46ae-849d-d7f7d5bbd770-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:33:45 user nova-compute[74337]: DEBUG nova.compute.manager [req-8bc03aaf-5820-44c8-a412-83ac50df7ffb req-df04a78a-15d6-4cd0-91b1-fe98eff873bc service nova] [instance: d45e8ae8-371b-46ae-849d-d7f7d5bbd770] No waiting events found dispatching network-vif-plugged-7ac73679-68b0-430f-8d77-68438fbb52f0 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:33:45 user nova-compute[74337]: WARNING nova.compute.manager [req-8bc03aaf-5820-44c8-a412-83ac50df7ffb req-df04a78a-15d6-4cd0-91b1-fe98eff873bc service nova] [instance: d45e8ae8-371b-46ae-849d-d7f7d5bbd770] Received unexpected event network-vif-plugged-7ac73679-68b0-430f-8d77-68438fbb52f0 for instance with vm_state active and task_state None.
Oct 23 21:33:46 user nova-compute[74337]: DEBUG nova.network.neutron [req-89ca3dfe-6c83-4255-9534-6dcb699b01c5 req-a07e1198-41e5-4367-abc1-e6822978bac2 service nova] [instance: ff1c790c-2458-438e-95c7-7e1412fe05fc] Updated VIF entry in instance network info cache for port ff6c7795-2085-4305-b0aa-72050c9b979b. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 21:33:46 user nova-compute[74337]: DEBUG nova.network.neutron [req-89ca3dfe-6c83-4255-9534-6dcb699b01c5 req-a07e1198-41e5-4367-abc1-e6822978bac2 service nova] [instance: ff1c790c-2458-438e-95c7-7e1412fe05fc] Updating instance_info_cache with network_info: [{"id": "ff6c7795-2085-4305-b0aa-72050c9b979b", "address": "fa:16:3e:0c:4d:a8", "network": {"id": "44287c31-0a66-49b2-a43f-9197e80d754e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1903058995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8974716be54b402a8d6b91a30e71f480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff6c7795-20", "ovs_interfaceid": "ff6c7795-2085-4305-b0aa-72050c9b979b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:33:46 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-89ca3dfe-6c83-4255-9534-6dcb699b01c5 req-a07e1198-41e5-4367-abc1-e6822978bac2 service nova] Releasing lock "refresh_cache-ff1c790c-2458-438e-95c7-7e1412fe05fc" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:33:46 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-48371ae4-5710-4721-9c71-bf52997cce40 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:33:46 user nova-compute[74337]: DEBUG nova.network.neutron [None req-8e262346-aecf-46a7-8511-486018366793 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] [instance: 5a181593-8086-4ece-9f5b-5ccba0bfe91e] Successfully updated port: b1c5ce36-994a-4a4d-9027-6e3716b2d8f5 {{(pid=74337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 21:33:46 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-48371ae4-5710-4721-9c71-bf52997cce40 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:33:46 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-8e262346-aecf-46a7-8511-486018366793 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Acquiring lock "refresh_cache-5a181593-8086-4ece-9f5b-5ccba0bfe91e" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:33:46 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-8e262346-aecf-46a7-8511-486018366793 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Acquired lock "refresh_cache-5a181593-8086-4ece-9f5b-5ccba0bfe91e" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:33:46 user nova-compute[74337]: DEBUG nova.network.neutron [None req-8e262346-aecf-46a7-8511-486018366793 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] [instance: 5a181593-8086-4ece-9f5b-5ccba0bfe91e] Building network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 21:33:46 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-48371ae4-5710-4721-9c71-bf52997cce40 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.718s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:33:46 user nova-compute[74337]: DEBUG nova.compute.manager [None req-48371ae4-5710-4721-9c71-bf52997cce40 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d] Start building networks asynchronously for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 21:33:46 user nova-compute[74337]: DEBUG nova.compute.manager [req-074095f2-1930-452f-8541-fe7ec8f5dccc req-4705200b-83f6-47d6-8524-5031d6e9fc32 service nova] [instance: 5a181593-8086-4ece-9f5b-5ccba0bfe91e] Received event network-changed-b1c5ce36-994a-4a4d-9027-6e3716b2d8f5 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:33:46 user nova-compute[74337]: DEBUG nova.compute.manager [req-074095f2-1930-452f-8541-fe7ec8f5dccc req-4705200b-83f6-47d6-8524-5031d6e9fc32 service nova] [instance: 5a181593-8086-4ece-9f5b-5ccba0bfe91e] Refreshing instance network info cache due to event network-changed-b1c5ce36-994a-4a4d-9027-6e3716b2d8f5. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 21:33:46 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-074095f2-1930-452f-8541-fe7ec8f5dccc req-4705200b-83f6-47d6-8524-5031d6e9fc32 service nova] Acquiring lock "refresh_cache-5a181593-8086-4ece-9f5b-5ccba0bfe91e" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:33:46 user nova-compute[74337]: DEBUG nova.compute.manager [None req-48371ae4-5710-4721-9c71-bf52997cce40 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d] Allocating IP information in the background. {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 21:33:46 user nova-compute[74337]: DEBUG nova.network.neutron [None req-48371ae4-5710-4721-9c71-bf52997cce40 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d] allocate_for_instance() {{(pid=74337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 21:33:46 user nova-compute[74337]: DEBUG nova.network.neutron [None req-8e262346-aecf-46a7-8511-486018366793 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] [instance: 5a181593-8086-4ece-9f5b-5ccba0bfe91e] Instance cache missing network info. {{(pid=74337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 21:33:46 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-48371ae4-5710-4721-9c71-bf52997cce40 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 21:33:46 user nova-compute[74337]: DEBUG nova.compute.manager [None req-48371ae4-5710-4721-9c71-bf52997cce40 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d] Start building block device mappings for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 21:33:46 user nova-compute[74337]: DEBUG nova.compute.manager [None req-48371ae4-5710-4721-9c71-bf52997cce40 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d] Start spawning the instance on the hypervisor. {{(pid=74337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 21:33:46 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-48371ae4-5710-4721-9c71-bf52997cce40 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d] Creating instance directory {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 21:33:46 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-48371ae4-5710-4721-9c71-bf52997cce40 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d] Creating image(s)
Oct 23 21:33:46 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-48371ae4-5710-4721-9c71-bf52997cce40 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] Acquiring lock "/opt/stack/data/nova/instances/a4bf4723-1e3c-42f1-a422-9d9263b67e3d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:33:46 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-48371ae4-5710-4721-9c71-bf52997cce40 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] Lock "/opt/stack/data/nova/instances/a4bf4723-1e3c-42f1-a422-9d9263b67e3d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:33:46 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-48371ae4-5710-4721-9c71-bf52997cce40 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] Lock "/opt/stack/data/nova/instances/a4bf4723-1e3c-42f1-a422-9d9263b67e3d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:33:46 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-48371ae4-5710-4721-9c71-bf52997cce40 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:33:46 user nova-compute[74337]: DEBUG nova.policy [None req-48371ae4-5710-4721-9c71-bf52997cce40 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '800fabf8cbf54e2daf153736c1ff3614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85815ae529d347c48efe797a4722025d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74337) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 21:33:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:46 user nova-compute[74337]: DEBUG nova.network.neutron [None req-8e262346-aecf-46a7-8511-486018366793 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] [instance: 5a181593-8086-4ece-9f5b-5ccba0bfe91e] Updating instance_info_cache with network_info: [{"id": "b1c5ce36-994a-4a4d-9027-6e3716b2d8f5", "address": "fa:16:3e:9a:56:5a", "network": {"id": "41a76d3f-a889-4294-bdc5-d9175a403158", "bridge": "br-int", "label": "tempest-TestVolumeSwap-237128553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "222c613ffcb647f183ef412107337c74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1c5ce36-99", "ovs_interfaceid": "b1c5ce36-994a-4a4d-9027-6e3716b2d8f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:33:46 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-8e262346-aecf-46a7-8511-486018366793 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Releasing lock "refresh_cache-5a181593-8086-4ece-9f5b-5ccba0bfe91e" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:33:46 user nova-compute[74337]: DEBUG nova.compute.manager [None req-8e262346-aecf-46a7-8511-486018366793 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] [instance: 5a181593-8086-4ece-9f5b-5ccba0bfe91e] Instance network_info: |[{"id": "b1c5ce36-994a-4a4d-9027-6e3716b2d8f5", "address": "fa:16:3e:9a:56:5a", "network": {"id": "41a76d3f-a889-4294-bdc5-d9175a403158", "bridge": "br-int", "label": "tempest-TestVolumeSwap-237128553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "222c613ffcb647f183ef412107337c74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1c5ce36-99", "ovs_interfaceid": "b1c5ce36-994a-4a4d-9027-6e3716b2d8f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 21:33:46 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-074095f2-1930-452f-8541-fe7ec8f5dccc req-4705200b-83f6-47d6-8524-5031d6e9fc32 service nova] Acquired lock "refresh_cache-5a181593-8086-4ece-9f5b-5ccba0bfe91e" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:33:46 user nova-compute[74337]: DEBUG nova.network.neutron [req-074095f2-1930-452f-8541-fe7ec8f5dccc req-4705200b-83f6-47d6-8524-5031d6e9fc32 service nova] [instance: 5a181593-8086-4ece-9f5b-5ccba0bfe91e] Refreshing network info cache for port b1c5ce36-994a-4a4d-9027-6e3716b2d8f5 {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 21:33:46 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-8e262346-aecf-46a7-8511-486018366793 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] [instance: 5a181593-8086-4ece-9f5b-5ccba0bfe91e] Start _get_guest_xml network_info=[{"id": "b1c5ce36-994a-4a4d-9027-6e3716b2d8f5", "address": "fa:16:3e:9a:56:5a", "network": {"id": "41a76d3f-a889-4294-bdc5-d9175a403158", "bridge": "br-int", "label": "tempest-TestVolumeSwap-237128553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "222c613ffcb647f183ef412107337c74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1c5ce36-99", "ovs_interfaceid": "b1c5ce36-994a-4a4d-9027-6e3716b2d8f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T21:29:21Z,direct_url=<?>,disk_format='qcow2',id=d859d89d-998d-4109-b26a-0d6e28152932,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ff43462300764979a6cf688444336a56',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T21:29:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'image_id': 'd859d89d-998d-4109-b26a-0d6e28152932'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 21:33:46 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-8e262346-aecf-46a7-8511-486018366793 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:33:46 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-8e262346-aecf-46a7-8511-486018366793 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:33:46 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-48371ae4-5710-4721-9c71-bf52997cce40 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.250s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:33:46 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-48371ae4-5710-4721-9c71-bf52997cce40 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] Acquiring lock "fc7b140751b8c385de81623e40fb09ce09374ab7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:33:46 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-48371ae4-5710-4721-9c71-bf52997cce40 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] Lock "fc7b140751b8c385de81623e40fb09ce09374ab7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:33:46 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-48371ae4-5710-4721-9c71-bf52997cce40 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:33:46 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-8e262346-aecf-46a7-8511-486018366793 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 21:33:46 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-8e262346-aecf-46a7-8511-486018366793 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] CPU controller missing on host. {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 21:33:46 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-8e262346-aecf-46a7-8511-486018366793 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 21:33:46 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-8e262346-aecf-46a7-8511-486018366793 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] CPU controller found on host. {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 21:33:46 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-8e262346-aecf-46a7-8511-486018366793 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 21:33:46 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-8e262346-aecf-46a7-8511-486018366793 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T21:29:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T21:29:21Z,direct_url=<?>,disk_format='qcow2',id=d859d89d-998d-4109-b26a-0d6e28152932,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ff43462300764979a6cf688444336a56',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T21:29:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 21:33:46 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-8e262346-aecf-46a7-8511-486018366793 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Flavor limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 21:33:46 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-8e262346-aecf-46a7-8511-486018366793 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Image limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 21:33:46 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-8e262346-aecf-46a7-8511-486018366793 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Flavor pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 21:33:46 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-8e262346-aecf-46a7-8511-486018366793 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Image pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 21:33:46 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-8e262346-aecf-46a7-8511-486018366793 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 21:33:46 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-8e262346-aecf-46a7-8511-486018366793 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 21:33:46 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-8e262346-aecf-46a7-8511-486018366793 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 21:33:46 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-8e262346-aecf-46a7-8511-486018366793 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Got 1 possible topologies {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 21:33:46 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-8e262346-aecf-46a7-8511-486018366793 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 21:33:46 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-8e262346-aecf-46a7-8511-486018366793 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 21:33:46 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-8e262346-aecf-46a7-8511-486018366793 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:33:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-488665569',display_name='tempest-TestVolumeSwap-server-488665569',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-488665569',id=7,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBREbt4B1CUPwdNxcRJpmycGObsc6eTclaKlhBHbFnJAHw2nV0mdvTN6etl0nHBuvYUj7a84WrQL+G/mBv++WAGQ//stCz/cJWxqfyF9uZzadmruucmbrScsEoE5r1Xxgw==',key_name='tempest-keypair-229409021',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='222c613ffcb647f183ef412107337c74',ramdisk_id='',reservation_id='r-p94f8ybe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-2123571584',owner_user_name='tempest-TestVolumeSwap-2123571584-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:33:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3fbcff9492364ae9b4771d5f890016dd',uuid=5a181593-8086-4ece-9f5b-5ccba0bfe91e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b1c5ce36-994a-4a4d-9027-6e3716b2d8f5", "address": "fa:16:3e:9a:56:5a", "network": {"id": "41a76d3f-a889-4294-bdc5-d9175a403158", "bridge": "br-int", "label": "tempest-TestVolumeSwap-237128553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "222c613ffcb647f183ef412107337c74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1c5ce36-99", "ovs_interfaceid": "b1c5ce36-994a-4a4d-9027-6e3716b2d8f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 21:33:46 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-8e262346-aecf-46a7-8511-486018366793 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Converting VIF {"id": "b1c5ce36-994a-4a4d-9027-6e3716b2d8f5", "address": "fa:16:3e:9a:56:5a", "network": {"id": "41a76d3f-a889-4294-bdc5-d9175a403158", "bridge": "br-int", "label": "tempest-TestVolumeSwap-237128553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "222c613ffcb647f183ef412107337c74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1c5ce36-99", "ovs_interfaceid": "b1c5ce36-994a-4a4d-9027-6e3716b2d8f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:33:46 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-8e262346-aecf-46a7-8511-486018366793 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:56:5a,bridge_name='br-int',has_traffic_filtering=True,id=b1c5ce36-994a-4a4d-9027-6e3716b2d8f5,network=Network(41a76d3f-a889-4294-bdc5-d9175a403158),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1c5ce36-99') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:33:46 user nova-compute[74337]: DEBUG nova.objects.instance [None req-8e262346-aecf-46a7-8511-486018366793 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Lazy-loading 'pci_devices' on Instance uuid 5a181593-8086-4ece-9f5b-5ccba0bfe91e {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:33:47 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-8e262346-aecf-46a7-8511-486018366793 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] [instance: 5a181593-8086-4ece-9f5b-5ccba0bfe91e] End _get_guest_xml xml=<domain type="kvm">
Oct 23 21:33:47 user nova-compute[74337]:   <uuid>5a181593-8086-4ece-9f5b-5ccba0bfe91e</uuid>
Oct 23 21:33:47 user nova-compute[74337]:   <name>instance-00000007</name>
Oct 23 21:33:47 user nova-compute[74337]:   <memory>524288</memory>
Oct 23 21:33:47 user nova-compute[74337]:   <vcpu>1</vcpu>
Oct 23 21:33:47 user nova-compute[74337]:   <metadata>
Oct 23 21:33:47 user nova-compute[74337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 21:33:47 user nova-compute[74337]:       <nova:package version="0.0.0"/>
Oct 23 21:33:47 user nova-compute[74337]:       <nova:name>tempest-TestVolumeSwap-server-488665569</nova:name>
Oct 23 21:33:47 user nova-compute[74337]:       <nova:creationTime>2023-10-23 21:33:46</nova:creationTime>
Oct 23 21:33:47 user nova-compute[74337]:       <nova:flavor name="m1.tiny">
Oct 23 21:33:47 user nova-compute[74337]:         <nova:memory>512</nova:memory>
Oct 23 21:33:47 user nova-compute[74337]:         <nova:disk>1</nova:disk>
Oct 23 21:33:47 user nova-compute[74337]:         <nova:swap>0</nova:swap>
Oct 23 21:33:47 user nova-compute[74337]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 21:33:47 user nova-compute[74337]:         <nova:vcpus>1</nova:vcpus>
Oct 23 21:33:47 user nova-compute[74337]:       </nova:flavor>
Oct 23 21:33:47 user nova-compute[74337]:       <nova:owner>
Oct 23 21:33:47 user nova-compute[74337]:         <nova:user uuid="3fbcff9492364ae9b4771d5f890016dd">tempest-TestVolumeSwap-2123571584-project-member</nova:user>
Oct 23 21:33:47 user nova-compute[74337]:         <nova:project uuid="222c613ffcb647f183ef412107337c74">tempest-TestVolumeSwap-2123571584</nova:project>
Oct 23 21:33:47 user nova-compute[74337]:       </nova:owner>
Oct 23 21:33:47 user nova-compute[74337]:       <nova:root type="image" uuid="d859d89d-998d-4109-b26a-0d6e28152932"/>
Oct 23 21:33:47 user nova-compute[74337]:       <nova:ports>
Oct 23 21:33:47 user nova-compute[74337]:         <nova:port uuid="b1c5ce36-994a-4a4d-9027-6e3716b2d8f5">
Oct 23 21:33:47 user nova-compute[74337]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 23 21:33:47 user nova-compute[74337]:         </nova:port>
Oct 23 21:33:47 user nova-compute[74337]:       </nova:ports>
Oct 23 21:33:47 user nova-compute[74337]:     </nova:instance>
Oct 23 21:33:47 user nova-compute[74337]:   </metadata>
Oct 23 21:33:47 user nova-compute[74337]:   <sysinfo type="smbios">
Oct 23 21:33:47 user nova-compute[74337]:     <system>
Oct 23 21:33:47 user nova-compute[74337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 21:33:47 user nova-compute[74337]:       <entry name="product">OpenStack Nova</entry>
Oct 23 21:33:47 user nova-compute[74337]:       <entry name="version">0.0.0</entry>
Oct 23 21:33:47 user nova-compute[74337]:       <entry name="serial">5a181593-8086-4ece-9f5b-5ccba0bfe91e</entry>
Oct 23 21:33:47 user nova-compute[74337]:       <entry name="uuid">5a181593-8086-4ece-9f5b-5ccba0bfe91e</entry>
Oct 23 21:33:47 user nova-compute[74337]:       <entry name="family">Virtual Machine</entry>
Oct 23 21:33:47 user nova-compute[74337]:     </system>
Oct 23 21:33:47 user nova-compute[74337]:   </sysinfo>
Oct 23 21:33:47 user nova-compute[74337]:   <os>
Oct 23 21:33:47 user nova-compute[74337]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 21:33:47 user nova-compute[74337]:     <boot dev="hd"/>
Oct 23 21:33:47 user nova-compute[74337]:     <smbios mode="sysinfo"/>
Oct 23 21:33:47 user nova-compute[74337]:   </os>
Oct 23 21:33:47 user nova-compute[74337]:   <features>
Oct 23 21:33:47 user nova-compute[74337]:     <acpi/>
Oct 23 21:33:47 user nova-compute[74337]:     <apic/>
Oct 23 21:33:47 user nova-compute[74337]:     <vmcoreinfo/>
Oct 23 21:33:47 user nova-compute[74337]:   </features>
Oct 23 21:33:47 user nova-compute[74337]:   <clock offset="utc">
Oct 23 21:33:47 user nova-compute[74337]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 21:33:47 user nova-compute[74337]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 21:33:47 user nova-compute[74337]:     <timer name="hpet" present="no"/>
Oct 23 21:33:47 user nova-compute[74337]:   </clock>
Oct 23 21:33:47 user nova-compute[74337]:   <cpu mode="custom" match="exact">
Oct 23 21:33:47 user nova-compute[74337]:     <model>Nehalem</model>
Oct 23 21:33:47 user nova-compute[74337]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 21:33:47 user nova-compute[74337]:   </cpu>
Oct 23 21:33:47 user nova-compute[74337]:   <devices>
Oct 23 21:33:47 user nova-compute[74337]:     <disk type="file" device="disk">
Oct 23 21:33:47 user nova-compute[74337]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 21:33:47 user nova-compute[74337]:       <source file="/opt/stack/data/nova/instances/5a181593-8086-4ece-9f5b-5ccba0bfe91e/disk"/>
Oct 23 21:33:47 user nova-compute[74337]:       <target dev="vda" bus="virtio"/>
Oct 23 21:33:47 user nova-compute[74337]:     </disk>
Oct 23 21:33:47 user nova-compute[74337]:     <interface type="ethernet">
Oct 23 21:33:47 user nova-compute[74337]:       <mac address="fa:16:3e:9a:56:5a"/>
Oct 23 21:33:47 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:33:47 user nova-compute[74337]:       <mtu size="1442"/>
Oct 23 21:33:47 user nova-compute[74337]:       <target dev="tapb1c5ce36-99"/>
Oct 23 21:33:47 user nova-compute[74337]:     </interface>
Oct 23 21:33:47 user nova-compute[74337]:     <serial type="pty">
Oct 23 21:33:47 user nova-compute[74337]:       <log file="/opt/stack/data/nova/instances/5a181593-8086-4ece-9f5b-5ccba0bfe91e/console.log" append="off"/>
Oct 23 21:33:47 user nova-compute[74337]:     </serial>
Oct 23 21:33:47 user nova-compute[74337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 21:33:47 user nova-compute[74337]:     <video>
Oct 23 21:33:47 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:33:47 user nova-compute[74337]:     </video>
Oct 23 21:33:47 user nova-compute[74337]:     <rng model="virtio">
Oct 23 21:33:47 user nova-compute[74337]:       <backend model="random">/dev/urandom</backend>
Oct 23 21:33:47 user nova-compute[74337]:     </rng>
Oct 23 21:33:47 user nova-compute[74337]:     <controller type="usb" index="0" model="none"/>
Oct 23 21:33:47 user nova-compute[74337]:     <memballoon model="virtio">
Oct 23 21:33:47 user nova-compute[74337]:       <stats period="10"/>
Oct 23 21:33:47 user nova-compute[74337]:     </memballoon>
Oct 23 21:33:47 user nova-compute[74337]:   </devices>
Oct 23 21:33:47 user nova-compute[74337]: </domain>
Oct 23 21:33:47 user nova-compute[74337]:  {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 21:33:47 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-8e262346-aecf-46a7-8511-486018366793 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:33:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-488665569',display_name='tempest-TestVolumeSwap-server-488665569',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-488665569',id=7,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBREbt4B1CUPwdNxcRJpmycGObsc6eTclaKlhBHbFnJAHw2nV0mdvTN6etl0nHBuvYUj7a84WrQL+G/mBv++WAGQ//stCz/cJWxqfyF9uZzadmruucmbrScsEoE5r1Xxgw==',key_name='tempest-keypair-229409021',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='222c613ffcb647f183ef412107337c74',ramdisk_id='',reservation_id='r-p94f8ybe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-2123571584',owner_user_name='tempest-TestVolumeSwap-2123571584-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:33:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3fbcff9492364ae9b4771d5f890016dd',uuid=5a181593-8086-4ece-9f5b-5ccba0bfe91e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b1c5ce36-994a-4a4d-9027-6e3716b2d8f5", "address": "fa:16:3e:9a:56:5a", "network": {"id": "41a76d3f-a889-4294-bdc5-d9175a403158", "bridge": "br-int", "label": "tempest-TestVolumeSwap-237128553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "222c613ffcb647f183ef412107337c74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1c5ce36-99", "ovs_interfaceid": "b1c5ce36-994a-4a4d-9027-6e3716b2d8f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 21:33:47 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-8e262346-aecf-46a7-8511-486018366793 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Converting VIF {"id": "b1c5ce36-994a-4a4d-9027-6e3716b2d8f5", "address": "fa:16:3e:9a:56:5a", "network": {"id": "41a76d3f-a889-4294-bdc5-d9175a403158", "bridge": "br-int", "label": "tempest-TestVolumeSwap-237128553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "222c613ffcb647f183ef412107337c74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1c5ce36-99", "ovs_interfaceid": "b1c5ce36-994a-4a4d-9027-6e3716b2d8f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:33:47 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-8e262346-aecf-46a7-8511-486018366793 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:56:5a,bridge_name='br-int',has_traffic_filtering=True,id=b1c5ce36-994a-4a4d-9027-6e3716b2d8f5,network=Network(41a76d3f-a889-4294-bdc5-d9175a403158),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1c5ce36-99') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:33:47 user nova-compute[74337]: DEBUG os_vif [None req-8e262346-aecf-46a7-8511-486018366793 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:56:5a,bridge_name='br-int',has_traffic_filtering=True,id=b1c5ce36-994a-4a4d-9027-6e3716b2d8f5,network=Network(41a76d3f-a889-4294-bdc5-d9175a403158),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1c5ce36-99') {{(pid=74337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 21:33:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:33:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 21:33:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a29a9c3b-01e0-5e19-a50a-23fc351da673', '_type': 'linux-noop'}}, row=False) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:33:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:33:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb1c5ce36-99, may_exist=True, interface_attrs={}) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:33:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb1c5ce36-99, col_values=(('qos', UUID('e18551eb-b7b1-4018-adec-1db51a64cbbe')),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:33:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb1c5ce36-99, col_values=(('external_ids', {'iface-id': 'b1c5ce36-994a-4a4d-9027-6e3716b2d8f5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9a:56:5a', 'vm-uuid': '5a181593-8086-4ece-9f5b-5ccba0bfe91e'}),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:33:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:33:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:47 user nova-compute[74337]: INFO os_vif [None req-8e262346-aecf-46a7-8511-486018366793 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:56:5a,bridge_name='br-int',has_traffic_filtering=True,id=b1c5ce36-994a-4a4d-9027-6e3716b2d8f5,network=Network(41a76d3f-a889-4294-bdc5-d9175a403158),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1c5ce36-99')
Oct 23 21:33:47 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-8e262346-aecf-46a7-8511-486018366793 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] No BDM found with device name vda, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 21:33:47 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-8e262346-aecf-46a7-8511-486018366793 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] No VIF found with MAC fa:16:3e:9a:56:5a, not building metadata {{(pid=74337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 21:33:47 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-48371ae4-5710-4721-9c71-bf52997cce40 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.304s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:33:47 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-48371ae4-5710-4721-9c71-bf52997cce40 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7,backing_fmt=raw /opt/stack/data/nova/instances/a4bf4723-1e3c-42f1-a422-9d9263b67e3d/disk 1073741824 {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:33:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:47 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-48371ae4-5710-4721-9c71-bf52997cce40 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7,backing_fmt=raw /opt/stack/data/nova/instances/a4bf4723-1e3c-42f1-a422-9d9263b67e3d/disk 1073741824" returned: 0 in 0.071s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:33:47 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-48371ae4-5710-4721-9c71-bf52997cce40 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] Lock "fc7b140751b8c385de81623e40fb09ce09374ab7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.379s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:33:47 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-48371ae4-5710-4721-9c71-bf52997cce40 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:33:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:47 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-48371ae4-5710-4721-9c71-bf52997cce40 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.228s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:33:47 user nova-compute[74337]: DEBUG nova.virt.disk.api [None req-48371ae4-5710-4721-9c71-bf52997cce40 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a4bf4723-1e3c-42f1-a422-9d9263b67e3d/disk. size=1073741824 {{(pid=74337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 21:33:47 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-48371ae4-5710-4721-9c71-bf52997cce40 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4bf4723-1e3c-42f1-a422-9d9263b67e3d/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:33:47 user nova-compute[74337]: DEBUG nova.network.neutron [req-074095f2-1930-452f-8541-fe7ec8f5dccc req-4705200b-83f6-47d6-8524-5031d6e9fc32 service nova] [instance: 5a181593-8086-4ece-9f5b-5ccba0bfe91e] Updated VIF entry in instance network info cache for port b1c5ce36-994a-4a4d-9027-6e3716b2d8f5. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 21:33:47 user nova-compute[74337]: DEBUG nova.network.neutron [req-074095f2-1930-452f-8541-fe7ec8f5dccc req-4705200b-83f6-47d6-8524-5031d6e9fc32 service nova] [instance: 5a181593-8086-4ece-9f5b-5ccba0bfe91e] Updating instance_info_cache with network_info: [{"id": "b1c5ce36-994a-4a4d-9027-6e3716b2d8f5", "address": "fa:16:3e:9a:56:5a", "network": {"id": "41a76d3f-a889-4294-bdc5-d9175a403158", "bridge": "br-int", "label": "tempest-TestVolumeSwap-237128553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "222c613ffcb647f183ef412107337c74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1c5ce36-99", "ovs_interfaceid": "b1c5ce36-994a-4a4d-9027-6e3716b2d8f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:33:47 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-074095f2-1930-452f-8541-fe7ec8f5dccc req-4705200b-83f6-47d6-8524-5031d6e9fc32 service nova] Releasing lock "refresh_cache-5a181593-8086-4ece-9f5b-5ccba0bfe91e" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:33:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:47 user nova-compute[74337]: DEBUG nova.compute.manager [req-f0530a89-f4af-4b7f-8b74-4e80f62536aa req-1f7974dc-2e32-41e9-9f06-e641d03c03e4 service nova] [instance: d45e8ae8-371b-46ae-849d-d7f7d5bbd770] Received event network-vif-plugged-7ac73679-68b0-430f-8d77-68438fbb52f0 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:33:47 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-f0530a89-f4af-4b7f-8b74-4e80f62536aa req-1f7974dc-2e32-41e9-9f06-e641d03c03e4 service nova] Acquiring lock "d45e8ae8-371b-46ae-849d-d7f7d5bbd770-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:33:47 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-f0530a89-f4af-4b7f-8b74-4e80f62536aa req-1f7974dc-2e32-41e9-9f06-e641d03c03e4 service nova] Lock "d45e8ae8-371b-46ae-849d-d7f7d5bbd770-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:33:47 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-f0530a89-f4af-4b7f-8b74-4e80f62536aa req-1f7974dc-2e32-41e9-9f06-e641d03c03e4 service nova] Lock "d45e8ae8-371b-46ae-849d-d7f7d5bbd770-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:33:47 user nova-compute[74337]: DEBUG nova.compute.manager [req-f0530a89-f4af-4b7f-8b74-4e80f62536aa req-1f7974dc-2e32-41e9-9f06-e641d03c03e4 service nova] [instance: d45e8ae8-371b-46ae-849d-d7f7d5bbd770] No waiting events found dispatching network-vif-plugged-7ac73679-68b0-430f-8d77-68438fbb52f0 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:33:47 user nova-compute[74337]: WARNING nova.compute.manager [req-f0530a89-f4af-4b7f-8b74-4e80f62536aa req-1f7974dc-2e32-41e9-9f06-e641d03c03e4 service nova] [instance: d45e8ae8-371b-46ae-849d-d7f7d5bbd770] Received unexpected event network-vif-plugged-7ac73679-68b0-430f-8d77-68438fbb52f0 for instance with vm_state active and task_state None.
Oct 23 21:33:47 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-48371ae4-5710-4721-9c71-bf52997cce40 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4bf4723-1e3c-42f1-a422-9d9263b67e3d/disk --force-share --output=json" returned: 0 in 0.302s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:33:47 user nova-compute[74337]: DEBUG nova.virt.disk.api [None req-48371ae4-5710-4721-9c71-bf52997cce40 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] Cannot resize image /opt/stack/data/nova/instances/a4bf4723-1e3c-42f1-a422-9d9263b67e3d/disk to a smaller size. {{(pid=74337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 21:33:47 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-48371ae4-5710-4721-9c71-bf52997cce40 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d] Created local disks {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 21:33:47 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-48371ae4-5710-4721-9c71-bf52997cce40 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d] Ensure instance console log exists: /opt/stack/data/nova/instances/a4bf4723-1e3c-42f1-a422-9d9263b67e3d/console.log {{(pid=74337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 21:33:47 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-48371ae4-5710-4721-9c71-bf52997cce40 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:33:47 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-48371ae4-5710-4721-9c71-bf52997cce40 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:33:47 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-48371ae4-5710-4721-9c71-bf52997cce40 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.006s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:33:48 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:48 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:48 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:48 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:48 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:48 user nova-compute[74337]: DEBUG nova.network.neutron [None req-48371ae4-5710-4721-9c71-bf52997cce40 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d] Successfully created port: 36e0b911-4cb9-4b24-bcb2-e44022f7f3d4 {{(pid=74337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 21:33:48 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-963b1597-d7b1-4c40-94eb-0b6f83975058 tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] Acquiring lock "2075057e-81db-424a-bb20-662d77faafed" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:33:48 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-963b1597-d7b1-4c40-94eb-0b6f83975058 tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] Lock "2075057e-81db-424a-bb20-662d77faafed" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:33:48 user nova-compute[74337]: DEBUG nova.compute.manager [None req-963b1597-d7b1-4c40-94eb-0b6f83975058 tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] [instance: 2075057e-81db-424a-bb20-662d77faafed] Starting instance... {{(pid=74337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 21:33:48 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-963b1597-d7b1-4c40-94eb-0b6f83975058 tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:33:48 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-963b1597-d7b1-4c40-94eb-0b6f83975058 tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:33:48 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-963b1597-d7b1-4c40-94eb-0b6f83975058 tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 21:33:48 user nova-compute[74337]: INFO nova.compute.claims [None req-963b1597-d7b1-4c40-94eb-0b6f83975058 tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] [instance: 2075057e-81db-424a-bb20-662d77faafed] Claim successful on node user
Oct 23 21:33:49 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:49 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-963b1597-d7b1-4c40-94eb-0b6f83975058 tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:33:49 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:49 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-963b1597-d7b1-4c40-94eb-0b6f83975058 tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:33:49 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:49 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-963b1597-d7b1-4c40-94eb-0b6f83975058 tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.759s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:33:49 user nova-compute[74337]: DEBUG nova.compute.manager [None req-963b1597-d7b1-4c40-94eb-0b6f83975058 tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] [instance: 2075057e-81db-424a-bb20-662d77faafed] Start building networks asynchronously for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 21:33:49 user nova-compute[74337]: DEBUG nova.network.neutron [None req-48371ae4-5710-4721-9c71-bf52997cce40 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d] Successfully updated port: 36e0b911-4cb9-4b24-bcb2-e44022f7f3d4 {{(pid=74337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 21:33:49 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-48371ae4-5710-4721-9c71-bf52997cce40 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] Acquiring lock "refresh_cache-a4bf4723-1e3c-42f1-a422-9d9263b67e3d" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:33:49 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-48371ae4-5710-4721-9c71-bf52997cce40 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] Acquired lock "refresh_cache-a4bf4723-1e3c-42f1-a422-9d9263b67e3d" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:33:49 user nova-compute[74337]: DEBUG nova.network.neutron [None req-48371ae4-5710-4721-9c71-bf52997cce40 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d] Building network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 21:33:49 user nova-compute[74337]: DEBUG nova.compute.manager [None req-963b1597-d7b1-4c40-94eb-0b6f83975058 tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] [instance: 2075057e-81db-424a-bb20-662d77faafed] Allocating IP information in the background. {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 21:33:49 user nova-compute[74337]: DEBUG nova.network.neutron [None req-963b1597-d7b1-4c40-94eb-0b6f83975058 tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] [instance: 2075057e-81db-424a-bb20-662d77faafed] allocate_for_instance() {{(pid=74337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 21:33:49 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-963b1597-d7b1-4c40-94eb-0b6f83975058 tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] [instance: 2075057e-81db-424a-bb20-662d77faafed] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 21:33:49 user nova-compute[74337]: DEBUG nova.network.neutron [None req-48371ae4-5710-4721-9c71-bf52997cce40 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d] Instance cache missing network info. {{(pid=74337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 21:33:49 user nova-compute[74337]: DEBUG nova.compute.manager [None req-963b1597-d7b1-4c40-94eb-0b6f83975058 tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] [instance: 2075057e-81db-424a-bb20-662d77faafed] Start building block device mappings for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 21:33:49 user nova-compute[74337]: DEBUG nova.policy [None req-963b1597-d7b1-4c40-94eb-0b6f83975058 tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4ac397ba607f4facb455b04bc440f9b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad79ba1168a4c3bb9b7f5ebcdce0529', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74337) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 21:33:49 user nova-compute[74337]: DEBUG nova.compute.manager [req-c41627a2-7eef-43bf-bc98-935408e95f05 req-4aabc755-e2ce-4c4f-8d97-f852518c84a2 service nova] [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d] Received event network-changed-36e0b911-4cb9-4b24-bcb2-e44022f7f3d4 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:33:49 user nova-compute[74337]: DEBUG nova.compute.manager [req-c41627a2-7eef-43bf-bc98-935408e95f05 req-4aabc755-e2ce-4c4f-8d97-f852518c84a2 service nova] [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d] Refreshing instance network info cache due to event network-changed-36e0b911-4cb9-4b24-bcb2-e44022f7f3d4. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 21:33:49 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-c41627a2-7eef-43bf-bc98-935408e95f05 req-4aabc755-e2ce-4c4f-8d97-f852518c84a2 service nova] Acquiring lock "refresh_cache-a4bf4723-1e3c-42f1-a422-9d9263b67e3d" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:33:49 user nova-compute[74337]: DEBUG nova.compute.manager [None req-963b1597-d7b1-4c40-94eb-0b6f83975058 tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] [instance: 2075057e-81db-424a-bb20-662d77faafed] Start spawning the instance on the hypervisor. {{(pid=74337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 21:33:49 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-963b1597-d7b1-4c40-94eb-0b6f83975058 tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] [instance: 2075057e-81db-424a-bb20-662d77faafed] Creating instance directory {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 21:33:49 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-963b1597-d7b1-4c40-94eb-0b6f83975058 tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] [instance: 2075057e-81db-424a-bb20-662d77faafed] Creating image(s)
Oct 23 21:33:49 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-963b1597-d7b1-4c40-94eb-0b6f83975058 tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] Acquiring lock "/opt/stack/data/nova/instances/2075057e-81db-424a-bb20-662d77faafed/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:33:49 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-963b1597-d7b1-4c40-94eb-0b6f83975058 tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] Lock "/opt/stack/data/nova/instances/2075057e-81db-424a-bb20-662d77faafed/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:33:49 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-963b1597-d7b1-4c40-94eb-0b6f83975058 tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] Lock "/opt/stack/data/nova/instances/2075057e-81db-424a-bb20-662d77faafed/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:33:49 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-963b1597-d7b1-4c40-94eb-0b6f83975058 tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:33:50 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-963b1597-d7b1-4c40-94eb-0b6f83975058 tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.247s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:33:50 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-963b1597-d7b1-4c40-94eb-0b6f83975058 tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] Acquiring lock "fc7b140751b8c385de81623e40fb09ce09374ab7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:33:50 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-963b1597-d7b1-4c40-94eb-0b6f83975058 tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] Lock "fc7b140751b8c385de81623e40fb09ce09374ab7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:33:50 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-963b1597-d7b1-4c40-94eb-0b6f83975058 tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:33:50 user nova-compute[74337]: DEBUG nova.network.neutron [None req-48371ae4-5710-4721-9c71-bf52997cce40 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d] Updating instance_info_cache with network_info: [{"id": "36e0b911-4cb9-4b24-bcb2-e44022f7f3d4", "address": "fa:16:3e:9f:d4:56", "network": {"id": "0891479c-8d7d-4e74-be06-51d2ecbcdef8", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1955051047-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85815ae529d347c48efe797a4722025d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36e0b911-4c", "ovs_interfaceid": "36e0b911-4cb9-4b24-bcb2-e44022f7f3d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:33:50 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:50 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:50 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-48371ae4-5710-4721-9c71-bf52997cce40 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] Releasing lock "refresh_cache-a4bf4723-1e3c-42f1-a422-9d9263b67e3d" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:33:50 user nova-compute[74337]: DEBUG nova.compute.manager [None req-48371ae4-5710-4721-9c71-bf52997cce40 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d] Instance network_info: |[{"id": "36e0b911-4cb9-4b24-bcb2-e44022f7f3d4", "address": "fa:16:3e:9f:d4:56", "network": {"id": "0891479c-8d7d-4e74-be06-51d2ecbcdef8", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1955051047-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85815ae529d347c48efe797a4722025d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36e0b911-4c", "ovs_interfaceid": "36e0b911-4cb9-4b24-bcb2-e44022f7f3d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 21:33:50 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-c41627a2-7eef-43bf-bc98-935408e95f05 req-4aabc755-e2ce-4c4f-8d97-f852518c84a2 service nova] Acquired lock "refresh_cache-a4bf4723-1e3c-42f1-a422-9d9263b67e3d" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:33:50 user nova-compute[74337]: DEBUG nova.network.neutron [req-c41627a2-7eef-43bf-bc98-935408e95f05 req-4aabc755-e2ce-4c4f-8d97-f852518c84a2 service nova] [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d] Refreshing network info cache for port 36e0b911-4cb9-4b24-bcb2-e44022f7f3d4 {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 21:33:50 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-48371ae4-5710-4721-9c71-bf52997cce40 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d] Start _get_guest_xml network_info=[{"id": "36e0b911-4cb9-4b24-bcb2-e44022f7f3d4", "address": "fa:16:3e:9f:d4:56", "network": {"id": "0891479c-8d7d-4e74-be06-51d2ecbcdef8", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1955051047-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85815ae529d347c48efe797a4722025d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36e0b911-4c", "ovs_interfaceid": "36e0b911-4cb9-4b24-bcb2-e44022f7f3d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T21:29:21Z,direct_url=<?>,disk_format='qcow2',id=d859d89d-998d-4109-b26a-0d6e28152932,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ff43462300764979a6cf688444336a56',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T21:29:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'image_id': 'd859d89d-998d-4109-b26a-0d6e28152932'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 21:33:50 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-48371ae4-5710-4721-9c71-bf52997cce40 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:33:50 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-48371ae4-5710-4721-9c71-bf52997cce40 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:33:50 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-48371ae4-5710-4721-9c71-bf52997cce40 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 21:33:50 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-48371ae4-5710-4721-9c71-bf52997cce40 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] CPU controller missing on host. {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 21:33:50 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-48371ae4-5710-4721-9c71-bf52997cce40 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 21:33:50 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-48371ae4-5710-4721-9c71-bf52997cce40 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] CPU controller found on host. {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 21:33:50 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-48371ae4-5710-4721-9c71-bf52997cce40 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 21:33:50 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-48371ae4-5710-4721-9c71-bf52997cce40 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T21:29:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T21:29:21Z,direct_url=<?>,disk_format='qcow2',id=d859d89d-998d-4109-b26a-0d6e28152932,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ff43462300764979a6cf688444336a56',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T21:29:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 21:33:50 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-48371ae4-5710-4721-9c71-bf52997cce40 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] Flavor limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 21:33:50 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-48371ae4-5710-4721-9c71-bf52997cce40 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] Image limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 21:33:50 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-48371ae4-5710-4721-9c71-bf52997cce40 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] Flavor pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 21:33:50 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-48371ae4-5710-4721-9c71-bf52997cce40 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] Image pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 21:33:50 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-48371ae4-5710-4721-9c71-bf52997cce40 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 21:33:50 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-48371ae4-5710-4721-9c71-bf52997cce40 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 21:33:50 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-48371ae4-5710-4721-9c71-bf52997cce40 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 21:33:50 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-48371ae4-5710-4721-9c71-bf52997cce40 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] Got 1 possible topologies {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 21:33:50 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-48371ae4-5710-4721-9c71-bf52997cce40 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 21:33:50 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-48371ae4-5710-4721-9c71-bf52997cce40 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 21:33:50 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-48371ae4-5710-4721-9c71-bf52997cce40 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:33:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-995477550',display_name='tempest-VolumesAssistedSnapshotsTest-server-995477550',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-995477550',id=8,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEgBDDuYXZW2aYihqShoj0FXXa/1O08PJI4TzEf9/aP4s5NHc//IUQnF9Y190W0c2EksTAQFuo+XTjlJen+Ckm046QwtwrYyecO5pMhjzxLm/NYwKKvFPbJ5lQYpFnzPIw==',key_name='tempest-keypair-498850097',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='85815ae529d347c48efe797a4722025d',ramdisk_id='',reservation_id='r-q9erkyb5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-750224046',owner_user_name='tempest-VolumesAssistedSnapshotsTest-750224046-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:33:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='800fabf8cbf54e2daf153736c1ff3614',uuid=a4bf4723-1e3c-42f1-a422-9d9263b67e3d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "36e0b911-4cb9-4b24-bcb2-e44022f7f3d4", "address": "fa:16:3e:9f:d4:56", "network": {"id": "0891479c-8d7d-4e74-be06-51d2ecbcdef8", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1955051047-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85815ae529d347c48efe797a4722025d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36e0b911-4c", "ovs_interfaceid": "36e0b911-4cb9-4b24-bcb2-e44022f7f3d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 21:33:50 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-48371ae4-5710-4721-9c71-bf52997cce40 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] Converting VIF {"id": "36e0b911-4cb9-4b24-bcb2-e44022f7f3d4", "address": "fa:16:3e:9f:d4:56", "network": {"id": "0891479c-8d7d-4e74-be06-51d2ecbcdef8", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1955051047-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85815ae529d347c48efe797a4722025d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36e0b911-4c", "ovs_interfaceid": "36e0b911-4cb9-4b24-bcb2-e44022f7f3d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:33:50 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-48371ae4-5710-4721-9c71-bf52997cce40 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:d4:56,bridge_name='br-int',has_traffic_filtering=True,id=36e0b911-4cb9-4b24-bcb2-e44022f7f3d4,network=Network(0891479c-8d7d-4e74-be06-51d2ecbcdef8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36e0b911-4c') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:33:50 user nova-compute[74337]: DEBUG nova.objects.instance [None req-48371ae4-5710-4721-9c71-bf52997cce40 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] Lazy-loading 'pci_devices' on Instance uuid a4bf4723-1e3c-42f1-a422-9d9263b67e3d {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:33:50 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-48371ae4-5710-4721-9c71-bf52997cce40 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d] End _get_guest_xml xml=<domain type="kvm">
Oct 23 21:33:50 user nova-compute[74337]:   <uuid>a4bf4723-1e3c-42f1-a422-9d9263b67e3d</uuid>
Oct 23 21:33:50 user nova-compute[74337]:   <name>instance-00000008</name>
Oct 23 21:33:50 user nova-compute[74337]:   <memory>524288</memory>
Oct 23 21:33:50 user nova-compute[74337]:   <vcpu>1</vcpu>
Oct 23 21:33:50 user nova-compute[74337]:   <metadata>
Oct 23 21:33:50 user nova-compute[74337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 21:33:50 user nova-compute[74337]:       <nova:package version="0.0.0"/>
Oct 23 21:33:50 user nova-compute[74337]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-995477550</nova:name>
Oct 23 21:33:50 user nova-compute[74337]:       <nova:creationTime>2023-10-23 21:33:50</nova:creationTime>
Oct 23 21:33:50 user nova-compute[74337]:       <nova:flavor name="m1.tiny">
Oct 23 21:33:50 user nova-compute[74337]:         <nova:memory>512</nova:memory>
Oct 23 21:33:50 user nova-compute[74337]:         <nova:disk>1</nova:disk>
Oct 23 21:33:50 user nova-compute[74337]:         <nova:swap>0</nova:swap>
Oct 23 21:33:50 user nova-compute[74337]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 21:33:50 user nova-compute[74337]:         <nova:vcpus>1</nova:vcpus>
Oct 23 21:33:50 user nova-compute[74337]:       </nova:flavor>
Oct 23 21:33:50 user nova-compute[74337]:       <nova:owner>
Oct 23 21:33:50 user nova-compute[74337]:         <nova:user uuid="800fabf8cbf54e2daf153736c1ff3614">tempest-VolumesAssistedSnapshotsTest-750224046-project-member</nova:user>
Oct 23 21:33:50 user nova-compute[74337]:         <nova:project uuid="85815ae529d347c48efe797a4722025d">tempest-VolumesAssistedSnapshotsTest-750224046</nova:project>
Oct 23 21:33:50 user nova-compute[74337]:       </nova:owner>
Oct 23 21:33:50 user nova-compute[74337]:       <nova:root type="image" uuid="d859d89d-998d-4109-b26a-0d6e28152932"/>
Oct 23 21:33:50 user nova-compute[74337]:       <nova:ports>
Oct 23 21:33:50 user nova-compute[74337]:         <nova:port uuid="36e0b911-4cb9-4b24-bcb2-e44022f7f3d4">
Oct 23 21:33:50 user nova-compute[74337]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 23 21:33:50 user nova-compute[74337]:         </nova:port>
Oct 23 21:33:50 user nova-compute[74337]:       </nova:ports>
Oct 23 21:33:50 user nova-compute[74337]:     </nova:instance>
Oct 23 21:33:50 user nova-compute[74337]:   </metadata>
Oct 23 21:33:50 user nova-compute[74337]:   <sysinfo type="smbios">
Oct 23 21:33:50 user nova-compute[74337]:     <system>
Oct 23 21:33:50 user nova-compute[74337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 21:33:50 user nova-compute[74337]:       <entry name="product">OpenStack Nova</entry>
Oct 23 21:33:50 user nova-compute[74337]:       <entry name="version">0.0.0</entry>
Oct 23 21:33:50 user nova-compute[74337]:       <entry name="serial">a4bf4723-1e3c-42f1-a422-9d9263b67e3d</entry>
Oct 23 21:33:50 user nova-compute[74337]:       <entry name="uuid">a4bf4723-1e3c-42f1-a422-9d9263b67e3d</entry>
Oct 23 21:33:50 user nova-compute[74337]:       <entry name="family">Virtual Machine</entry>
Oct 23 21:33:50 user nova-compute[74337]:     </system>
Oct 23 21:33:50 user nova-compute[74337]:   </sysinfo>
Oct 23 21:33:50 user nova-compute[74337]:   <os>
Oct 23 21:33:50 user nova-compute[74337]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 21:33:50 user nova-compute[74337]:     <boot dev="hd"/>
Oct 23 21:33:50 user nova-compute[74337]:     <smbios mode="sysinfo"/>
Oct 23 21:33:50 user nova-compute[74337]:   </os>
Oct 23 21:33:50 user nova-compute[74337]:   <features>
Oct 23 21:33:50 user nova-compute[74337]:     <acpi/>
Oct 23 21:33:50 user nova-compute[74337]:     <apic/>
Oct 23 21:33:50 user nova-compute[74337]:     <vmcoreinfo/>
Oct 23 21:33:50 user nova-compute[74337]:   </features>
Oct 23 21:33:50 user nova-compute[74337]:   <clock offset="utc">
Oct 23 21:33:50 user nova-compute[74337]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 21:33:50 user nova-compute[74337]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 21:33:50 user nova-compute[74337]:     <timer name="hpet" present="no"/>
Oct 23 21:33:50 user nova-compute[74337]:   </clock>
Oct 23 21:33:50 user nova-compute[74337]:   <cpu mode="custom" match="exact">
Oct 23 21:33:50 user nova-compute[74337]:     <model>Nehalem</model>
Oct 23 21:33:50 user nova-compute[74337]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 21:33:50 user nova-compute[74337]:   </cpu>
Oct 23 21:33:50 user nova-compute[74337]:   <devices>
Oct 23 21:33:50 user nova-compute[74337]:     <disk type="file" device="disk">
Oct 23 21:33:50 user nova-compute[74337]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 21:33:50 user nova-compute[74337]:       <source file="/opt/stack/data/nova/instances/a4bf4723-1e3c-42f1-a422-9d9263b67e3d/disk"/>
Oct 23 21:33:50 user nova-compute[74337]:       <target dev="vda" bus="virtio"/>
Oct 23 21:33:50 user nova-compute[74337]:     </disk>
Oct 23 21:33:50 user nova-compute[74337]:     <interface type="ethernet">
Oct 23 21:33:50 user nova-compute[74337]:       <mac address="fa:16:3e:9f:d4:56"/>
Oct 23 21:33:50 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:33:50 user nova-compute[74337]:       <mtu size="1442"/>
Oct 23 21:33:50 user nova-compute[74337]:       <target dev="tap36e0b911-4c"/>
Oct 23 21:33:50 user nova-compute[74337]:     </interface>
Oct 23 21:33:50 user nova-compute[74337]:     <serial type="pty">
Oct 23 21:33:50 user nova-compute[74337]:       <log file="/opt/stack/data/nova/instances/a4bf4723-1e3c-42f1-a422-9d9263b67e3d/console.log" append="off"/>
Oct 23 21:33:50 user nova-compute[74337]:     </serial>
Oct 23 21:33:50 user nova-compute[74337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 21:33:50 user nova-compute[74337]:     <video>
Oct 23 21:33:50 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:33:50 user nova-compute[74337]:     </video>
Oct 23 21:33:50 user nova-compute[74337]:     <rng model="virtio">
Oct 23 21:33:50 user nova-compute[74337]:       <backend model="random">/dev/urandom</backend>
Oct 23 21:33:50 user nova-compute[74337]:     </rng>
Oct 23 21:33:50 user nova-compute[74337]:     <controller type="usb" index="0" model="none"/>
Oct 23 21:33:50 user nova-compute[74337]:     <memballoon model="virtio">
Oct 23 21:33:50 user nova-compute[74337]:       <stats period="10"/>
Oct 23 21:33:50 user nova-compute[74337]:     </memballoon>
Oct 23 21:33:50 user nova-compute[74337]:   </devices>
Oct 23 21:33:50 user nova-compute[74337]: </domain>
Oct 23 21:33:50 user nova-compute[74337]:  {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 21:33:50 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-48371ae4-5710-4721-9c71-bf52997cce40 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:33:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-995477550',display_name='tempest-VolumesAssistedSnapshotsTest-server-995477550',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-995477550',id=8,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEgBDDuYXZW2aYihqShoj0FXXa/1O08PJI4TzEf9/aP4s5NHc//IUQnF9Y190W0c2EksTAQFuo+XTjlJen+Ckm046QwtwrYyecO5pMhjzxLm/NYwKKvFPbJ5lQYpFnzPIw==',key_name='tempest-keypair-498850097',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='85815ae529d347c48efe797a4722025d',ramdisk_id='',reservation_id='r-q9erkyb5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-750224046',owner_user_name='tempest-VolumesAssistedSnapshotsTest-750224046-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:33:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='800fabf8cbf54e2daf153736c1ff3614',uuid=a4bf4723-1e3c-42f1-a422-9d9263b67e3d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "36e0b911-4cb9-4b24-bcb2-e44022f7f3d4", "address": "fa:16:3e:9f:d4:56", "network": {"id": "0891479c-8d7d-4e74-be06-51d2ecbcdef8", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1955051047-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85815ae529d347c48efe797a4722025d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36e0b911-4c", "ovs_interfaceid": "36e0b911-4cb9-4b24-bcb2-e44022f7f3d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 21:33:50 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-48371ae4-5710-4721-9c71-bf52997cce40 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] Converting VIF {"id": "36e0b911-4cb9-4b24-bcb2-e44022f7f3d4", "address": "fa:16:3e:9f:d4:56", "network": {"id": "0891479c-8d7d-4e74-be06-51d2ecbcdef8", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1955051047-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85815ae529d347c48efe797a4722025d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36e0b911-4c", "ovs_interfaceid": "36e0b911-4cb9-4b24-bcb2-e44022f7f3d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:33:50 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-48371ae4-5710-4721-9c71-bf52997cce40 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:d4:56,bridge_name='br-int',has_traffic_filtering=True,id=36e0b911-4cb9-4b24-bcb2-e44022f7f3d4,network=Network(0891479c-8d7d-4e74-be06-51d2ecbcdef8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36e0b911-4c') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:33:50 user nova-compute[74337]: DEBUG os_vif [None req-48371ae4-5710-4721-9c71-bf52997cce40 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:d4:56,bridge_name='br-int',has_traffic_filtering=True,id=36e0b911-4cb9-4b24-bcb2-e44022f7f3d4,network=Network(0891479c-8d7d-4e74-be06-51d2ecbcdef8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36e0b911-4c') {{(pid=74337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 21:33:50 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:50 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:33:50 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 21:33:50 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:50 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dc3fb0f9-32fd-507c-816d-1b98f4508633', '_type': 'linux-noop'}}, row=False) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:33:50 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:50 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:50 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:50 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap36e0b911-4c, may_exist=True, interface_attrs={}) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:33:50 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap36e0b911-4c, col_values=(('qos', UUID('78674944-df6d-4410-9743-c5347be2f872')),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:33:50 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap36e0b911-4c, col_values=(('external_ids', {'iface-id': '36e0b911-4cb9-4b24-bcb2-e44022f7f3d4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9f:d4:56', 'vm-uuid': 'a4bf4723-1e3c-42f1-a422-9d9263b67e3d'}),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:33:50 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:50 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:33:50 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:50 user nova-compute[74337]: INFO os_vif [None req-48371ae4-5710-4721-9c71-bf52997cce40 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:d4:56,bridge_name='br-int',has_traffic_filtering=True,id=36e0b911-4cb9-4b24-bcb2-e44022f7f3d4,network=Network(0891479c-8d7d-4e74-be06-51d2ecbcdef8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36e0b911-4c')
Oct 23 21:33:50 user nova-compute[74337]: DEBUG nova.compute.manager [req-1526509f-690c-4f87-b2c1-932207a9f52d req-9109d0a7-12e2-49f2-8c60-0998b4fa0e67 service nova] [instance: 5a181593-8086-4ece-9f5b-5ccba0bfe91e] Received event network-vif-plugged-b1c5ce36-994a-4a4d-9027-6e3716b2d8f5 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:33:50 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-1526509f-690c-4f87-b2c1-932207a9f52d req-9109d0a7-12e2-49f2-8c60-0998b4fa0e67 service nova] Acquiring lock "5a181593-8086-4ece-9f5b-5ccba0bfe91e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:33:50 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-1526509f-690c-4f87-b2c1-932207a9f52d req-9109d0a7-12e2-49f2-8c60-0998b4fa0e67 service nova] Lock "5a181593-8086-4ece-9f5b-5ccba0bfe91e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:33:50 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-1526509f-690c-4f87-b2c1-932207a9f52d req-9109d0a7-12e2-49f2-8c60-0998b4fa0e67 service nova] Lock "5a181593-8086-4ece-9f5b-5ccba0bfe91e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:33:50 user nova-compute[74337]: DEBUG nova.compute.manager [req-1526509f-690c-4f87-b2c1-932207a9f52d req-9109d0a7-12e2-49f2-8c60-0998b4fa0e67 service nova] [instance: 5a181593-8086-4ece-9f5b-5ccba0bfe91e] No waiting events found dispatching network-vif-plugged-b1c5ce36-994a-4a4d-9027-6e3716b2d8f5 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:33:50 user nova-compute[74337]: WARNING nova.compute.manager [req-1526509f-690c-4f87-b2c1-932207a9f52d req-9109d0a7-12e2-49f2-8c60-0998b4fa0e67 service nova] [instance: 5a181593-8086-4ece-9f5b-5ccba0bfe91e] Received unexpected event network-vif-plugged-b1c5ce36-994a-4a4d-9027-6e3716b2d8f5 for instance with vm_state building and task_state spawning.
Oct 23 21:33:50 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-48371ae4-5710-4721-9c71-bf52997cce40 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] No BDM found with device name vda, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 21:33:50 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-48371ae4-5710-4721-9c71-bf52997cce40 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] No VIF found with MAC fa:16:3e:9f:d4:56, not building metadata {{(pid=74337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 21:33:50 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-963b1597-d7b1-4c40-94eb-0b6f83975058 tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.551s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:33:50 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-963b1597-d7b1-4c40-94eb-0b6f83975058 tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7,backing_fmt=raw /opt/stack/data/nova/instances/2075057e-81db-424a-bb20-662d77faafed/disk 1073741824 {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:33:50 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-963b1597-d7b1-4c40-94eb-0b6f83975058 tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7,backing_fmt=raw /opt/stack/data/nova/instances/2075057e-81db-424a-bb20-662d77faafed/disk 1073741824" returned: 0 in 0.063s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:33:50 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-963b1597-d7b1-4c40-94eb-0b6f83975058 tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] Lock "fc7b140751b8c385de81623e40fb09ce09374ab7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.618s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:33:50 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-963b1597-d7b1-4c40-94eb-0b6f83975058 tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:33:51 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-963b1597-d7b1-4c40-94eb-0b6f83975058 tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.205s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:33:51 user nova-compute[74337]: DEBUG nova.virt.disk.api [None req-963b1597-d7b1-4c40-94eb-0b6f83975058 tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2075057e-81db-424a-bb20-662d77faafed/disk. size=1073741824 {{(pid=74337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 21:33:51 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-963b1597-d7b1-4c40-94eb-0b6f83975058 tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2075057e-81db-424a-bb20-662d77faafed/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:33:51 user nova-compute[74337]: DEBUG nova.network.neutron [None req-963b1597-d7b1-4c40-94eb-0b6f83975058 tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] [instance: 2075057e-81db-424a-bb20-662d77faafed] Successfully created port: 603e30f8-b216-49f6-ae75-5c60b4e602f8 {{(pid=74337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 21:33:51 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-963b1597-d7b1-4c40-94eb-0b6f83975058 tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2075057e-81db-424a-bb20-662d77faafed/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:33:51 user nova-compute[74337]: DEBUG nova.virt.disk.api [None req-963b1597-d7b1-4c40-94eb-0b6f83975058 tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] Cannot resize image /opt/stack/data/nova/instances/2075057e-81db-424a-bb20-662d77faafed/disk to a smaller size. {{(pid=74337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 21:33:51 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-963b1597-d7b1-4c40-94eb-0b6f83975058 tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] [instance: 2075057e-81db-424a-bb20-662d77faafed] Created local disks {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 21:33:51 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-963b1597-d7b1-4c40-94eb-0b6f83975058 tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] [instance: 2075057e-81db-424a-bb20-662d77faafed] Ensure instance console log exists: /opt/stack/data/nova/instances/2075057e-81db-424a-bb20-662d77faafed/console.log {{(pid=74337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 21:33:51 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-963b1597-d7b1-4c40-94eb-0b6f83975058 tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:33:51 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-963b1597-d7b1-4c40-94eb-0b6f83975058 tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:33:51 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-963b1597-d7b1-4c40-94eb-0b6f83975058 tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:33:51 user nova-compute[74337]: DEBUG nova.network.neutron [req-c41627a2-7eef-43bf-bc98-935408e95f05 req-4aabc755-e2ce-4c4f-8d97-f852518c84a2 service nova] [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d] Updated VIF entry in instance network info cache for port 36e0b911-4cb9-4b24-bcb2-e44022f7f3d4. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 21:33:51 user nova-compute[74337]: DEBUG nova.network.neutron [req-c41627a2-7eef-43bf-bc98-935408e95f05 req-4aabc755-e2ce-4c4f-8d97-f852518c84a2 service nova] [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d] Updating instance_info_cache with network_info: [{"id": "36e0b911-4cb9-4b24-bcb2-e44022f7f3d4", "address": "fa:16:3e:9f:d4:56", "network": {"id": "0891479c-8d7d-4e74-be06-51d2ecbcdef8", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1955051047-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85815ae529d347c48efe797a4722025d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36e0b911-4c", "ovs_interfaceid": "36e0b911-4cb9-4b24-bcb2-e44022f7f3d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:33:51 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-c41627a2-7eef-43bf-bc98-935408e95f05 req-4aabc755-e2ce-4c4f-8d97-f852518c84a2 service nova] Releasing lock "refresh_cache-a4bf4723-1e3c-42f1-a422-9d9263b67e3d" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:33:51 user nova-compute[74337]: DEBUG nova.compute.manager [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] [instance: ff1c790c-2458-438e-95c7-7e1412fe05fc] Instance event wait completed in 0 seconds for  {{(pid=74337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 21:33:51 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] [instance: ff1c790c-2458-438e-95c7-7e1412fe05fc] Guest created on hypervisor {{(pid=74337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 21:33:51 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: ff1c790c-2458-438e-95c7-7e1412fe05fc] Instance spawned successfully.
Oct 23 21:33:51 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] [instance: ff1c790c-2458-438e-95c7-7e1412fe05fc] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 21:33:51 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] [instance: ff1c790c-2458-438e-95c7-7e1412fe05fc] Found default for hw_input_bus of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:33:51 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] [instance: ff1c790c-2458-438e-95c7-7e1412fe05fc] Found default for hw_pointer_model of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:33:51 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] [instance: ff1c790c-2458-438e-95c7-7e1412fe05fc] Found default for hw_video_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:33:51 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] [instance: ff1c790c-2458-438e-95c7-7e1412fe05fc] Found default for hw_vif_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:33:51 user nova-compute[74337]: INFO nova.compute.manager [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] [instance: ff1c790c-2458-438e-95c7-7e1412fe05fc] Took 10.88 seconds to spawn the instance on the hypervisor.
Oct 23 21:33:51 user nova-compute[74337]: DEBUG nova.compute.manager [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] [instance: ff1c790c-2458-438e-95c7-7e1412fe05fc] Checking state {{(pid=74337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 21:33:51 user nova-compute[74337]: INFO nova.compute.manager [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] [instance: ff1c790c-2458-438e-95c7-7e1412fe05fc] Took 12.30 seconds to build instance.
Oct 23 21:33:51 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4593c1f4-6114-42a1-9083-ca02b2141b09 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Lock "ff1c790c-2458-438e-95c7-7e1412fe05fc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.491s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:33:51 user nova-compute[74337]: DEBUG nova.compute.manager [req-a1233344-2028-4173-a2ca-560d3b350983 req-2e096f96-c43d-460e-9776-30e794cffdd8 service nova] [instance: ff1c790c-2458-438e-95c7-7e1412fe05fc] Received event network-vif-plugged-ff6c7795-2085-4305-b0aa-72050c9b979b {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:33:51 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-a1233344-2028-4173-a2ca-560d3b350983 req-2e096f96-c43d-460e-9776-30e794cffdd8 service nova] Acquiring lock "ff1c790c-2458-438e-95c7-7e1412fe05fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:33:51 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-a1233344-2028-4173-a2ca-560d3b350983 req-2e096f96-c43d-460e-9776-30e794cffdd8 service nova] Lock "ff1c790c-2458-438e-95c7-7e1412fe05fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:33:51 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-a1233344-2028-4173-a2ca-560d3b350983 req-2e096f96-c43d-460e-9776-30e794cffdd8 service nova] Lock "ff1c790c-2458-438e-95c7-7e1412fe05fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:33:51 user nova-compute[74337]: DEBUG nova.compute.manager [req-a1233344-2028-4173-a2ca-560d3b350983 req-2e096f96-c43d-460e-9776-30e794cffdd8 service nova] [instance: ff1c790c-2458-438e-95c7-7e1412fe05fc] No waiting events found dispatching network-vif-plugged-ff6c7795-2085-4305-b0aa-72050c9b979b {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:33:51 user nova-compute[74337]: WARNING nova.compute.manager [req-a1233344-2028-4173-a2ca-560d3b350983 req-2e096f96-c43d-460e-9776-30e794cffdd8 service nova] [instance: ff1c790c-2458-438e-95c7-7e1412fe05fc] Received unexpected event network-vif-plugged-ff6c7795-2085-4305-b0aa-72050c9b979b for instance with vm_state active and task_state None.
Oct 23 21:33:52 user nova-compute[74337]: DEBUG nova.network.neutron [None req-963b1597-d7b1-4c40-94eb-0b6f83975058 tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] [instance: 2075057e-81db-424a-bb20-662d77faafed] Successfully updated port: 603e30f8-b216-49f6-ae75-5c60b4e602f8 {{(pid=74337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 21:33:52 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-963b1597-d7b1-4c40-94eb-0b6f83975058 tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] Acquiring lock "refresh_cache-2075057e-81db-424a-bb20-662d77faafed" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:33:52 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-963b1597-d7b1-4c40-94eb-0b6f83975058 tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] Acquired lock "refresh_cache-2075057e-81db-424a-bb20-662d77faafed" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:33:52 user nova-compute[74337]: DEBUG nova.network.neutron [None req-963b1597-d7b1-4c40-94eb-0b6f83975058 tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] [instance: 2075057e-81db-424a-bb20-662d77faafed] Building network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 21:33:52 user nova-compute[74337]: DEBUG nova.network.neutron [None req-963b1597-d7b1-4c40-94eb-0b6f83975058 tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] [instance: 2075057e-81db-424a-bb20-662d77faafed] Instance cache missing network info. {{(pid=74337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 21:33:52 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:52 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:52 user nova-compute[74337]: DEBUG nova.compute.manager [None req-8e262346-aecf-46a7-8511-486018366793 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] [instance: 5a181593-8086-4ece-9f5b-5ccba0bfe91e] Instance event wait completed in 0 seconds for  {{(pid=74337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 21:33:52 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-8e262346-aecf-46a7-8511-486018366793 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] [instance: 5a181593-8086-4ece-9f5b-5ccba0bfe91e] Guest created on hypervisor {{(pid=74337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 21:33:52 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: 5a181593-8086-4ece-9f5b-5ccba0bfe91e] Instance spawned successfully.
Oct 23 21:33:52 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-8e262346-aecf-46a7-8511-486018366793 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] [instance: 5a181593-8086-4ece-9f5b-5ccba0bfe91e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 21:33:52 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-8e262346-aecf-46a7-8511-486018366793 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] [instance: 5a181593-8086-4ece-9f5b-5ccba0bfe91e] Found default for hw_cdrom_bus of ide {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:33:52 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-8e262346-aecf-46a7-8511-486018366793 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] [instance: 5a181593-8086-4ece-9f5b-5ccba0bfe91e] Found default for hw_disk_bus of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:33:52 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-8e262346-aecf-46a7-8511-486018366793 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] [instance: 5a181593-8086-4ece-9f5b-5ccba0bfe91e] Found default for hw_input_bus of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:33:52 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-8e262346-aecf-46a7-8511-486018366793 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] [instance: 5a181593-8086-4ece-9f5b-5ccba0bfe91e] Found default for hw_pointer_model of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:33:52 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-8e262346-aecf-46a7-8511-486018366793 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] [instance: 5a181593-8086-4ece-9f5b-5ccba0bfe91e] Found default for hw_video_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:33:52 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-8e262346-aecf-46a7-8511-486018366793 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] [instance: 5a181593-8086-4ece-9f5b-5ccba0bfe91e] Found default for hw_vif_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:33:52 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:33:52 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Cleaning up deleted instances {{(pid=74337) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 23 21:33:52 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] There are 0 instances to clean {{(pid=74337) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 23 21:33:52 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:33:52 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74337) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 23 21:33:52 user nova-compute[74337]: DEBUG nova.network.neutron [None req-963b1597-d7b1-4c40-94eb-0b6f83975058 tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] [instance: 2075057e-81db-424a-bb20-662d77faafed] Updating instance_info_cache with network_info: [{"id": "603e30f8-b216-49f6-ae75-5c60b4e602f8", "address": "fa:16:3e:be:de:06", "network": {"id": "5f59b94c-5047-4031-9579-fa4c76353e70", "bridge": "br-int", "label": "tempest-VolumesActionsTest-72235572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aad79ba1168a4c3bb9b7f5ebcdce0529", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap603e30f8-b2", "ovs_interfaceid": "603e30f8-b216-49f6-ae75-5c60b4e602f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:33:52 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:33:52 user nova-compute[74337]: INFO nova.compute.manager [None req-8e262346-aecf-46a7-8511-486018366793 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] [instance: 5a181593-8086-4ece-9f5b-5ccba0bfe91e] Took 8.44 seconds to spawn the instance on the hypervisor.
Oct 23 21:33:52 user nova-compute[74337]: DEBUG nova.compute.manager [None req-8e262346-aecf-46a7-8511-486018366793 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] [instance: 5a181593-8086-4ece-9f5b-5ccba0bfe91e] Checking state {{(pid=74337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 21:33:52 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-963b1597-d7b1-4c40-94eb-0b6f83975058 tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] Releasing lock "refresh_cache-2075057e-81db-424a-bb20-662d77faafed" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:33:52 user nova-compute[74337]: DEBUG nova.compute.manager [None req-963b1597-d7b1-4c40-94eb-0b6f83975058 tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] [instance: 2075057e-81db-424a-bb20-662d77faafed] Instance network_info: |[{"id": "603e30f8-b216-49f6-ae75-5c60b4e602f8", "address": "fa:16:3e:be:de:06", "network": {"id": "5f59b94c-5047-4031-9579-fa4c76353e70", "bridge": "br-int", "label": "tempest-VolumesActionsTest-72235572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aad79ba1168a4c3bb9b7f5ebcdce0529", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap603e30f8-b2", "ovs_interfaceid": "603e30f8-b216-49f6-ae75-5c60b4e602f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 21:33:52 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-963b1597-d7b1-4c40-94eb-0b6f83975058 tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] [instance: 2075057e-81db-424a-bb20-662d77faafed] Start _get_guest_xml network_info=[{"id": "603e30f8-b216-49f6-ae75-5c60b4e602f8", "address": "fa:16:3e:be:de:06", "network": {"id": "5f59b94c-5047-4031-9579-fa4c76353e70", "bridge": "br-int", "label": "tempest-VolumesActionsTest-72235572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aad79ba1168a4c3bb9b7f5ebcdce0529", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap603e30f8-b2", "ovs_interfaceid": "603e30f8-b216-49f6-ae75-5c60b4e602f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T21:29:21Z,direct_url=<?>,disk_format='qcow2',id=d859d89d-998d-4109-b26a-0d6e28152932,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ff43462300764979a6cf688444336a56',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T21:29:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'image_id': 'd859d89d-998d-4109-b26a-0d6e28152932'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 21:33:52 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-963b1597-d7b1-4c40-94eb-0b6f83975058 tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:33:52 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-963b1597-d7b1-4c40-94eb-0b6f83975058 tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:33:52 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-963b1597-d7b1-4c40-94eb-0b6f83975058 tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 21:33:52 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-963b1597-d7b1-4c40-94eb-0b6f83975058 tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] CPU controller missing on host. {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 21:33:52 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-963b1597-d7b1-4c40-94eb-0b6f83975058 tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 21:33:52 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-963b1597-d7b1-4c40-94eb-0b6f83975058 tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] CPU controller found on host. {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 21:33:52 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-963b1597-d7b1-4c40-94eb-0b6f83975058 tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 21:33:52 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-963b1597-d7b1-4c40-94eb-0b6f83975058 tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T21:29:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T21:29:21Z,direct_url=<?>,disk_format='qcow2',id=d859d89d-998d-4109-b26a-0d6e28152932,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ff43462300764979a6cf688444336a56',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T21:29:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 21:33:52 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-963b1597-d7b1-4c40-94eb-0b6f83975058 tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] Flavor limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 21:33:52 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-963b1597-d7b1-4c40-94eb-0b6f83975058 tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] Image limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 21:33:52 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-963b1597-d7b1-4c40-94eb-0b6f83975058 tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] Flavor pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 21:33:52 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-963b1597-d7b1-4c40-94eb-0b6f83975058 tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] Image pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 21:33:52 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-963b1597-d7b1-4c40-94eb-0b6f83975058 tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 21:33:52 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-963b1597-d7b1-4c40-94eb-0b6f83975058 tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 21:33:52 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-963b1597-d7b1-4c40-94eb-0b6f83975058 tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 21:33:52 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-963b1597-d7b1-4c40-94eb-0b6f83975058 tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] Got 1 possible topologies {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 21:33:52 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-963b1597-d7b1-4c40-94eb-0b6f83975058 tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 21:33:52 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-963b1597-d7b1-4c40-94eb-0b6f83975058 tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 21:33:52 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-963b1597-d7b1-4c40-94eb-0b6f83975058 tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:33:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2074914789',display_name='tempest-VolumesActionsTest-instance-2074914789',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2074914789',id=9,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aad79ba1168a4c3bb9b7f5ebcdce0529',ramdisk_id='',reservation_id='r-r5lf5ril',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-2062236964',owner_user_name='tempest-VolumesActionsTest-2062236964-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:33:50Z,user_data=None,user_id='4ac397ba607f4facb455b04bc440f9b5',uuid=2075057e-81db-424a-bb20-662d77faafed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "603e30f8-b216-49f6-ae75-5c60b4e602f8", "address": "fa:16:3e:be:de:06", "network": {"id": "5f59b94c-5047-4031-9579-fa4c76353e70", "bridge": "br-int", "label": "tempest-VolumesActionsTest-72235572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aad79ba1168a4c3bb9b7f5ebcdce0529", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap603e30f8-b2", "ovs_interfaceid": "603e30f8-b216-49f6-ae75-5c60b4e602f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 21:33:52 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-963b1597-d7b1-4c40-94eb-0b6f83975058 tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] Converting VIF {"id": "603e30f8-b216-49f6-ae75-5c60b4e602f8", "address": "fa:16:3e:be:de:06", "network": {"id": "5f59b94c-5047-4031-9579-fa4c76353e70", "bridge": "br-int", "label": "tempest-VolumesActionsTest-72235572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aad79ba1168a4c3bb9b7f5ebcdce0529", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap603e30f8-b2", "ovs_interfaceid": "603e30f8-b216-49f6-ae75-5c60b4e602f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:33:52 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-963b1597-d7b1-4c40-94eb-0b6f83975058 tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:de:06,bridge_name='br-int',has_traffic_filtering=True,id=603e30f8-b216-49f6-ae75-5c60b4e602f8,network=Network(5f59b94c-5047-4031-9579-fa4c76353e70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap603e30f8-b2') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:33:52 user nova-compute[74337]: DEBUG nova.objects.instance [None req-963b1597-d7b1-4c40-94eb-0b6f83975058 tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] Lazy-loading 'pci_devices' on Instance uuid 2075057e-81db-424a-bb20-662d77faafed {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:33:52 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-963b1597-d7b1-4c40-94eb-0b6f83975058 tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] [instance: 2075057e-81db-424a-bb20-662d77faafed] End _get_guest_xml xml=<domain type="kvm">
Oct 23 21:33:52 user nova-compute[74337]:   <uuid>2075057e-81db-424a-bb20-662d77faafed</uuid>
Oct 23 21:33:52 user nova-compute[74337]:   <name>instance-00000009</name>
Oct 23 21:33:52 user nova-compute[74337]:   <memory>524288</memory>
Oct 23 21:33:52 user nova-compute[74337]:   <vcpu>1</vcpu>
Oct 23 21:33:52 user nova-compute[74337]:   <metadata>
Oct 23 21:33:52 user nova-compute[74337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 21:33:52 user nova-compute[74337]:       <nova:package version="0.0.0"/>
Oct 23 21:33:52 user nova-compute[74337]:       <nova:name>tempest-VolumesActionsTest-instance-2074914789</nova:name>
Oct 23 21:33:52 user nova-compute[74337]:       <nova:creationTime>2023-10-23 21:33:52</nova:creationTime>
Oct 23 21:33:52 user nova-compute[74337]:       <nova:flavor name="m1.tiny">
Oct 23 21:33:52 user nova-compute[74337]:         <nova:memory>512</nova:memory>
Oct 23 21:33:52 user nova-compute[74337]:         <nova:disk>1</nova:disk>
Oct 23 21:33:52 user nova-compute[74337]:         <nova:swap>0</nova:swap>
Oct 23 21:33:52 user nova-compute[74337]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 21:33:52 user nova-compute[74337]:         <nova:vcpus>1</nova:vcpus>
Oct 23 21:33:52 user nova-compute[74337]:       </nova:flavor>
Oct 23 21:33:52 user nova-compute[74337]:       <nova:owner>
Oct 23 21:33:52 user nova-compute[74337]:         <nova:user uuid="4ac397ba607f4facb455b04bc440f9b5">tempest-VolumesActionsTest-2062236964-project-member</nova:user>
Oct 23 21:33:52 user nova-compute[74337]:         <nova:project uuid="aad79ba1168a4c3bb9b7f5ebcdce0529">tempest-VolumesActionsTest-2062236964</nova:project>
Oct 23 21:33:52 user nova-compute[74337]:       </nova:owner>
Oct 23 21:33:52 user nova-compute[74337]:       <nova:root type="image" uuid="d859d89d-998d-4109-b26a-0d6e28152932"/>
Oct 23 21:33:52 user nova-compute[74337]:       <nova:ports>
Oct 23 21:33:52 user nova-compute[74337]:         <nova:port uuid="603e30f8-b216-49f6-ae75-5c60b4e602f8">
Oct 23 21:33:52 user nova-compute[74337]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 23 21:33:52 user nova-compute[74337]:         </nova:port>
Oct 23 21:33:52 user nova-compute[74337]:       </nova:ports>
Oct 23 21:33:52 user nova-compute[74337]:     </nova:instance>
Oct 23 21:33:52 user nova-compute[74337]:   </metadata>
Oct 23 21:33:52 user nova-compute[74337]:   <sysinfo type="smbios">
Oct 23 21:33:52 user nova-compute[74337]:     <system>
Oct 23 21:33:52 user nova-compute[74337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 21:33:52 user nova-compute[74337]:       <entry name="product">OpenStack Nova</entry>
Oct 23 21:33:52 user nova-compute[74337]:       <entry name="version">0.0.0</entry>
Oct 23 21:33:52 user nova-compute[74337]:       <entry name="serial">2075057e-81db-424a-bb20-662d77faafed</entry>
Oct 23 21:33:52 user nova-compute[74337]:       <entry name="uuid">2075057e-81db-424a-bb20-662d77faafed</entry>
Oct 23 21:33:52 user nova-compute[74337]:       <entry name="family">Virtual Machine</entry>
Oct 23 21:33:52 user nova-compute[74337]:     </system>
Oct 23 21:33:52 user nova-compute[74337]:   </sysinfo>
Oct 23 21:33:52 user nova-compute[74337]:   <os>
Oct 23 21:33:52 user nova-compute[74337]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 21:33:52 user nova-compute[74337]:     <boot dev="hd"/>
Oct 23 21:33:52 user nova-compute[74337]:     <smbios mode="sysinfo"/>
Oct 23 21:33:52 user nova-compute[74337]:   </os>
Oct 23 21:33:52 user nova-compute[74337]:   <features>
Oct 23 21:33:52 user nova-compute[74337]:     <acpi/>
Oct 23 21:33:52 user nova-compute[74337]:     <apic/>
Oct 23 21:33:52 user nova-compute[74337]:     <vmcoreinfo/>
Oct 23 21:33:52 user nova-compute[74337]:   </features>
Oct 23 21:33:52 user nova-compute[74337]:   <clock offset="utc">
Oct 23 21:33:52 user nova-compute[74337]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 21:33:52 user nova-compute[74337]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 21:33:52 user nova-compute[74337]:     <timer name="hpet" present="no"/>
Oct 23 21:33:52 user nova-compute[74337]:   </clock>
Oct 23 21:33:52 user nova-compute[74337]:   <cpu mode="custom" match="exact">
Oct 23 21:33:52 user nova-compute[74337]:     <model>Nehalem</model>
Oct 23 21:33:52 user nova-compute[74337]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 21:33:52 user nova-compute[74337]:   </cpu>
Oct 23 21:33:52 user nova-compute[74337]:   <devices>
Oct 23 21:33:52 user nova-compute[74337]:     <disk type="file" device="disk">
Oct 23 21:33:52 user nova-compute[74337]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 21:33:52 user nova-compute[74337]:       <source file="/opt/stack/data/nova/instances/2075057e-81db-424a-bb20-662d77faafed/disk"/>
Oct 23 21:33:52 user nova-compute[74337]:       <target dev="vda" bus="virtio"/>
Oct 23 21:33:52 user nova-compute[74337]:     </disk>
Oct 23 21:33:52 user nova-compute[74337]:     <interface type="ethernet">
Oct 23 21:33:52 user nova-compute[74337]:       <mac address="fa:16:3e:be:de:06"/>
Oct 23 21:33:52 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:33:52 user nova-compute[74337]:       <mtu size="1442"/>
Oct 23 21:33:52 user nova-compute[74337]:       <target dev="tap603e30f8-b2"/>
Oct 23 21:33:52 user nova-compute[74337]:     </interface>
Oct 23 21:33:52 user nova-compute[74337]:     <serial type="pty">
Oct 23 21:33:52 user nova-compute[74337]:       <log file="/opt/stack/data/nova/instances/2075057e-81db-424a-bb20-662d77faafed/console.log" append="off"/>
Oct 23 21:33:52 user nova-compute[74337]:     </serial>
Oct 23 21:33:52 user nova-compute[74337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 21:33:52 user nova-compute[74337]:     <video>
Oct 23 21:33:52 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:33:52 user nova-compute[74337]:     </video>
Oct 23 21:33:52 user nova-compute[74337]:     <rng model="virtio">
Oct 23 21:33:52 user nova-compute[74337]:       <backend model="random">/dev/urandom</backend>
Oct 23 21:33:52 user nova-compute[74337]:     </rng>
Oct 23 21:33:52 user nova-compute[74337]:     <controller type="usb" index="0" model="none"/>
Oct 23 21:33:52 user nova-compute[74337]:     <memballoon model="virtio">
Oct 23 21:33:52 user nova-compute[74337]:       <stats period="10"/>
Oct 23 21:33:52 user nova-compute[74337]:     </memballoon>
Oct 23 21:33:52 user nova-compute[74337]:   </devices>
Oct 23 21:33:52 user nova-compute[74337]: </domain>
Oct 23 21:33:52 user nova-compute[74337]:  {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 21:33:52 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-963b1597-d7b1-4c40-94eb-0b6f83975058 tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:33:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2074914789',display_name='tempest-VolumesActionsTest-instance-2074914789',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2074914789',id=9,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aad79ba1168a4c3bb9b7f5ebcdce0529',ramdisk_id='',reservation_id='r-r5lf5ril',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-2062236964',owner_user_name='tempest-VolumesActionsTest-2062236964-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:33:50Z,user_data=None,user_id='4ac397ba607f4facb455b04bc440f9b5',uuid=2075057e-81db-424a-bb20-662d77faafed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "603e30f8-b216-49f6-ae75-5c60b4e602f8", "address": "fa:16:3e:be:de:06", "network": {"id": "5f59b94c-5047-4031-9579-fa4c76353e70", "bridge": "br-int", "label": "tempest-VolumesActionsTest-72235572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aad79ba1168a4c3bb9b7f5ebcdce0529", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap603e30f8-b2", "ovs_interfaceid": "603e30f8-b216-49f6-ae75-5c60b4e602f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 21:33:52 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-963b1597-d7b1-4c40-94eb-0b6f83975058 tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] Converting VIF {"id": "603e30f8-b216-49f6-ae75-5c60b4e602f8", "address": "fa:16:3e:be:de:06", "network": {"id": "5f59b94c-5047-4031-9579-fa4c76353e70", "bridge": "br-int", "label": "tempest-VolumesActionsTest-72235572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aad79ba1168a4c3bb9b7f5ebcdce0529", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap603e30f8-b2", "ovs_interfaceid": "603e30f8-b216-49f6-ae75-5c60b4e602f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:33:52 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-963b1597-d7b1-4c40-94eb-0b6f83975058 tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:de:06,bridge_name='br-int',has_traffic_filtering=True,id=603e30f8-b216-49f6-ae75-5c60b4e602f8,network=Network(5f59b94c-5047-4031-9579-fa4c76353e70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap603e30f8-b2') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:33:52 user nova-compute[74337]: DEBUG os_vif [None req-963b1597-d7b1-4c40-94eb-0b6f83975058 tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:de:06,bridge_name='br-int',has_traffic_filtering=True,id=603e30f8-b216-49f6-ae75-5c60b4e602f8,network=Network(5f59b94c-5047-4031-9579-fa4c76353e70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap603e30f8-b2') {{(pid=74337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 21:33:52 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:52 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:33:52 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 21:33:52 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:52 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '037ab634-69e3-5d1f-a289-1dc53dcbe717', '_type': 'linux-noop'}}, row=False) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:33:52 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:52 user nova-compute[74337]: DEBUG nova.compute.manager [req-ab9ded94-53cd-4052-af1e-6c6df05385fb req-8c4f8b94-3dba-44c7-9b76-5694b35f51a9 service nova] [instance: 5a181593-8086-4ece-9f5b-5ccba0bfe91e] Received event network-vif-plugged-b1c5ce36-994a-4a4d-9027-6e3716b2d8f5 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:33:52 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ab9ded94-53cd-4052-af1e-6c6df05385fb req-8c4f8b94-3dba-44c7-9b76-5694b35f51a9 service nova] Acquiring lock "5a181593-8086-4ece-9f5b-5ccba0bfe91e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:33:52 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ab9ded94-53cd-4052-af1e-6c6df05385fb req-8c4f8b94-3dba-44c7-9b76-5694b35f51a9 service nova] Lock "5a181593-8086-4ece-9f5b-5ccba0bfe91e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:33:52 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ab9ded94-53cd-4052-af1e-6c6df05385fb req-8c4f8b94-3dba-44c7-9b76-5694b35f51a9 service nova] Lock "5a181593-8086-4ece-9f5b-5ccba0bfe91e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:33:52 user nova-compute[74337]: DEBUG nova.compute.manager [req-ab9ded94-53cd-4052-af1e-6c6df05385fb req-8c4f8b94-3dba-44c7-9b76-5694b35f51a9 service nova] [instance: 5a181593-8086-4ece-9f5b-5ccba0bfe91e] No waiting events found dispatching network-vif-plugged-b1c5ce36-994a-4a4d-9027-6e3716b2d8f5 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:33:52 user nova-compute[74337]: WARNING nova.compute.manager [req-ab9ded94-53cd-4052-af1e-6c6df05385fb req-8c4f8b94-3dba-44c7-9b76-5694b35f51a9 service nova] [instance: 5a181593-8086-4ece-9f5b-5ccba0bfe91e] Received unexpected event network-vif-plugged-b1c5ce36-994a-4a4d-9027-6e3716b2d8f5 for instance with vm_state building and task_state spawning.
Oct 23 21:33:52 user nova-compute[74337]: DEBUG nova.compute.manager [req-ab9ded94-53cd-4052-af1e-6c6df05385fb req-8c4f8b94-3dba-44c7-9b76-5694b35f51a9 service nova] [instance: 2075057e-81db-424a-bb20-662d77faafed] Received event network-changed-603e30f8-b216-49f6-ae75-5c60b4e602f8 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:33:52 user nova-compute[74337]: DEBUG nova.compute.manager [req-ab9ded94-53cd-4052-af1e-6c6df05385fb req-8c4f8b94-3dba-44c7-9b76-5694b35f51a9 service nova] [instance: 2075057e-81db-424a-bb20-662d77faafed] Refreshing instance network info cache due to event network-changed-603e30f8-b216-49f6-ae75-5c60b4e602f8. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 21:33:52 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ab9ded94-53cd-4052-af1e-6c6df05385fb req-8c4f8b94-3dba-44c7-9b76-5694b35f51a9 service nova] Acquiring lock "refresh_cache-2075057e-81db-424a-bb20-662d77faafed" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:33:52 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ab9ded94-53cd-4052-af1e-6c6df05385fb req-8c4f8b94-3dba-44c7-9b76-5694b35f51a9 service nova] Acquired lock "refresh_cache-2075057e-81db-424a-bb20-662d77faafed" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:33:52 user nova-compute[74337]: DEBUG nova.network.neutron [req-ab9ded94-53cd-4052-af1e-6c6df05385fb req-8c4f8b94-3dba-44c7-9b76-5694b35f51a9 service nova] [instance: 2075057e-81db-424a-bb20-662d77faafed] Refreshing network info cache for port 603e30f8-b216-49f6-ae75-5c60b4e602f8 {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 21:33:52 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:33:52 user nova-compute[74337]: INFO nova.compute.manager [None req-8e262346-aecf-46a7-8511-486018366793 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] [instance: 5a181593-8086-4ece-9f5b-5ccba0bfe91e] Took 9.93 seconds to build instance.
Oct 23 21:33:52 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:52 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap603e30f8-b2, may_exist=True, interface_attrs={}) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:33:52 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap603e30f8-b2, col_values=(('qos', UUID('968b8281-4c5d-4f22-ac7e-03822e437bcc')),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:33:52 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap603e30f8-b2, col_values=(('external_ids', {'iface-id': '603e30f8-b216-49f6-ae75-5c60b4e602f8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:be:de:06', 'vm-uuid': '2075057e-81db-424a-bb20-662d77faafed'}),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:33:52 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:52 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-8e262346-aecf-46a7-8511-486018366793 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Lock "5a181593-8086-4ece-9f5b-5ccba0bfe91e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.117s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:33:52 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:33:52 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:52 user nova-compute[74337]: INFO os_vif [None req-963b1597-d7b1-4c40-94eb-0b6f83975058 tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:de:06,bridge_name='br-int',has_traffic_filtering=True,id=603e30f8-b216-49f6-ae75-5c60b4e602f8,network=Network(5f59b94c-5047-4031-9579-fa4c76353e70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap603e30f8-b2')
Oct 23 21:33:52 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-963b1597-d7b1-4c40-94eb-0b6f83975058 tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] No BDM found with device name vda, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 21:33:52 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-963b1597-d7b1-4c40-94eb-0b6f83975058 tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] No VIF found with MAC fa:16:3e:be:de:06, not building metadata {{(pid=74337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 21:33:53 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:53 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:53 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:53 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:53 user nova-compute[74337]: DEBUG nova.network.neutron [req-ab9ded94-53cd-4052-af1e-6c6df05385fb req-8c4f8b94-3dba-44c7-9b76-5694b35f51a9 service nova] [instance: 2075057e-81db-424a-bb20-662d77faafed] Updated VIF entry in instance network info cache for port 603e30f8-b216-49f6-ae75-5c60b4e602f8. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 21:33:53 user nova-compute[74337]: DEBUG nova.network.neutron [req-ab9ded94-53cd-4052-af1e-6c6df05385fb req-8c4f8b94-3dba-44c7-9b76-5694b35f51a9 service nova] [instance: 2075057e-81db-424a-bb20-662d77faafed] Updating instance_info_cache with network_info: [{"id": "603e30f8-b216-49f6-ae75-5c60b4e602f8", "address": "fa:16:3e:be:de:06", "network": {"id": "5f59b94c-5047-4031-9579-fa4c76353e70", "bridge": "br-int", "label": "tempest-VolumesActionsTest-72235572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aad79ba1168a4c3bb9b7f5ebcdce0529", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap603e30f8-b2", "ovs_interfaceid": "603e30f8-b216-49f6-ae75-5c60b4e602f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:33:53 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ab9ded94-53cd-4052-af1e-6c6df05385fb req-8c4f8b94-3dba-44c7-9b76-5694b35f51a9 service nova] Releasing lock "refresh_cache-2075057e-81db-424a-bb20-662d77faafed" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:33:53 user nova-compute[74337]: DEBUG nova.compute.manager [req-ab9ded94-53cd-4052-af1e-6c6df05385fb req-8c4f8b94-3dba-44c7-9b76-5694b35f51a9 service nova] [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d] Received event network-vif-plugged-36e0b911-4cb9-4b24-bcb2-e44022f7f3d4 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:33:53 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ab9ded94-53cd-4052-af1e-6c6df05385fb req-8c4f8b94-3dba-44c7-9b76-5694b35f51a9 service nova] Acquiring lock "a4bf4723-1e3c-42f1-a422-9d9263b67e3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:33:53 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ab9ded94-53cd-4052-af1e-6c6df05385fb req-8c4f8b94-3dba-44c7-9b76-5694b35f51a9 service nova] Lock "a4bf4723-1e3c-42f1-a422-9d9263b67e3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:33:53 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ab9ded94-53cd-4052-af1e-6c6df05385fb req-8c4f8b94-3dba-44c7-9b76-5694b35f51a9 service nova] Lock "a4bf4723-1e3c-42f1-a422-9d9263b67e3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:33:53 user nova-compute[74337]: DEBUG nova.compute.manager [req-ab9ded94-53cd-4052-af1e-6c6df05385fb req-8c4f8b94-3dba-44c7-9b76-5694b35f51a9 service nova] [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d] No waiting events found dispatching network-vif-plugged-36e0b911-4cb9-4b24-bcb2-e44022f7f3d4 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:33:53 user nova-compute[74337]: WARNING nova.compute.manager [req-ab9ded94-53cd-4052-af1e-6c6df05385fb req-8c4f8b94-3dba-44c7-9b76-5694b35f51a9 service nova] [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d] Received unexpected event network-vif-plugged-36e0b911-4cb9-4b24-bcb2-e44022f7f3d4 for instance with vm_state building and task_state spawning.
Oct 23 21:33:53 user nova-compute[74337]: DEBUG nova.compute.manager [req-264f037f-4fc9-42c0-aeb0-b3a596ea7ac0 req-ac44c3fc-e4ef-43b0-892b-6926f0981e26 service nova] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] Received event network-vif-plugged-530b7241-1498-47dc-8a6f-79e6c9cc850a {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:33:53 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-264f037f-4fc9-42c0-aeb0-b3a596ea7ac0 req-ac44c3fc-e4ef-43b0-892b-6926f0981e26 service nova] Acquiring lock "8acc1b10-a541-4c06-aeb7-1ecf7a2457be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:33:53 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-264f037f-4fc9-42c0-aeb0-b3a596ea7ac0 req-ac44c3fc-e4ef-43b0-892b-6926f0981e26 service nova] Lock "8acc1b10-a541-4c06-aeb7-1ecf7a2457be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:33:53 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-264f037f-4fc9-42c0-aeb0-b3a596ea7ac0 req-ac44c3fc-e4ef-43b0-892b-6926f0981e26 service nova] Lock "8acc1b10-a541-4c06-aeb7-1ecf7a2457be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:33:53 user nova-compute[74337]: DEBUG nova.compute.manager [req-264f037f-4fc9-42c0-aeb0-b3a596ea7ac0 req-ac44c3fc-e4ef-43b0-892b-6926f0981e26 service nova] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] No waiting events found dispatching network-vif-plugged-530b7241-1498-47dc-8a6f-79e6c9cc850a {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:33:53 user nova-compute[74337]: WARNING nova.compute.manager [req-264f037f-4fc9-42c0-aeb0-b3a596ea7ac0 req-ac44c3fc-e4ef-43b0-892b-6926f0981e26 service nova] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] Received unexpected event network-vif-plugged-530b7241-1498-47dc-8a6f-79e6c9cc850a for instance with vm_state active and task_state None.
Oct 23 21:33:53 user nova-compute[74337]: DEBUG nova.compute.manager [req-74d051c3-9d67-473f-a1d2-27a75ce2b019 req-3d585adf-9b0b-450f-b73f-7afd491c2f9a service nova] [instance: ff1c790c-2458-438e-95c7-7e1412fe05fc] Received event network-vif-plugged-ff6c7795-2085-4305-b0aa-72050c9b979b {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:33:53 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-74d051c3-9d67-473f-a1d2-27a75ce2b019 req-3d585adf-9b0b-450f-b73f-7afd491c2f9a service nova] Acquiring lock "ff1c790c-2458-438e-95c7-7e1412fe05fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:33:53 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-74d051c3-9d67-473f-a1d2-27a75ce2b019 req-3d585adf-9b0b-450f-b73f-7afd491c2f9a service nova] Lock "ff1c790c-2458-438e-95c7-7e1412fe05fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:33:53 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-74d051c3-9d67-473f-a1d2-27a75ce2b019 req-3d585adf-9b0b-450f-b73f-7afd491c2f9a service nova] Lock "ff1c790c-2458-438e-95c7-7e1412fe05fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:33:53 user nova-compute[74337]: DEBUG nova.compute.manager [req-74d051c3-9d67-473f-a1d2-27a75ce2b019 req-3d585adf-9b0b-450f-b73f-7afd491c2f9a service nova] [instance: ff1c790c-2458-438e-95c7-7e1412fe05fc] No waiting events found dispatching network-vif-plugged-ff6c7795-2085-4305-b0aa-72050c9b979b {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:33:53 user nova-compute[74337]: WARNING nova.compute.manager [req-74d051c3-9d67-473f-a1d2-27a75ce2b019 req-3d585adf-9b0b-450f-b73f-7afd491c2f9a service nova] [instance: ff1c790c-2458-438e-95c7-7e1412fe05fc] Received unexpected event network-vif-plugged-ff6c7795-2085-4305-b0aa-72050c9b979b for instance with vm_state active and task_state None.
Oct 23 21:33:54 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:33:54 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:33:54 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:33:54 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 21:33:54 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:54 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:54 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:54 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:54 user nova-compute[74337]: DEBUG nova.compute.manager [req-2e87dda3-50b5-4053-91ea-5e12d104d5b7 req-f171d877-65bb-4fab-8c85-e13beb475179 service nova] [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d] Received event network-vif-plugged-36e0b911-4cb9-4b24-bcb2-e44022f7f3d4 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:33:54 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-2e87dda3-50b5-4053-91ea-5e12d104d5b7 req-f171d877-65bb-4fab-8c85-e13beb475179 service nova] Acquiring lock "a4bf4723-1e3c-42f1-a422-9d9263b67e3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:33:54 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-2e87dda3-50b5-4053-91ea-5e12d104d5b7 req-f171d877-65bb-4fab-8c85-e13beb475179 service nova] Lock "a4bf4723-1e3c-42f1-a422-9d9263b67e3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:33:54 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-2e87dda3-50b5-4053-91ea-5e12d104d5b7 req-f171d877-65bb-4fab-8c85-e13beb475179 service nova] Lock "a4bf4723-1e3c-42f1-a422-9d9263b67e3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:33:54 user nova-compute[74337]: DEBUG nova.compute.manager [req-2e87dda3-50b5-4053-91ea-5e12d104d5b7 req-f171d877-65bb-4fab-8c85-e13beb475179 service nova] [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d] No waiting events found dispatching network-vif-plugged-36e0b911-4cb9-4b24-bcb2-e44022f7f3d4 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:33:54 user nova-compute[74337]: WARNING nova.compute.manager [req-2e87dda3-50b5-4053-91ea-5e12d104d5b7 req-f171d877-65bb-4fab-8c85-e13beb475179 service nova] [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d] Received unexpected event network-vif-plugged-36e0b911-4cb9-4b24-bcb2-e44022f7f3d4 for instance with vm_state building and task_state spawning.
Oct 23 21:33:55 user nova-compute[74337]: DEBUG nova.compute.manager [None req-48371ae4-5710-4721-9c71-bf52997cce40 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d] Instance event wait completed in 0 seconds for  {{(pid=74337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 21:33:55 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-48371ae4-5710-4721-9c71-bf52997cce40 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d] Guest created on hypervisor {{(pid=74337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 21:33:55 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d] Instance spawned successfully.
Oct 23 21:33:55 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-48371ae4-5710-4721-9c71-bf52997cce40 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 21:33:55 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-48371ae4-5710-4721-9c71-bf52997cce40 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d] Found default for hw_cdrom_bus of ide {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:33:55 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-48371ae4-5710-4721-9c71-bf52997cce40 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d] Found default for hw_disk_bus of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:33:55 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-48371ae4-5710-4721-9c71-bf52997cce40 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d] Found default for hw_input_bus of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:33:55 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-48371ae4-5710-4721-9c71-bf52997cce40 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d] Found default for hw_pointer_model of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:33:55 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-48371ae4-5710-4721-9c71-bf52997cce40 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d] Found default for hw_video_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:33:55 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-48371ae4-5710-4721-9c71-bf52997cce40 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d] Found default for hw_vif_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:33:55 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:55 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:55 user nova-compute[74337]: INFO nova.compute.manager [None req-48371ae4-5710-4721-9c71-bf52997cce40 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d] Took 8.80 seconds to spawn the instance on the hypervisor.
Oct 23 21:33:55 user nova-compute[74337]: DEBUG nova.compute.manager [None req-48371ae4-5710-4721-9c71-bf52997cce40 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d] Checking state {{(pid=74337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 21:33:55 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:33:55 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:55 user nova-compute[74337]: INFO nova.compute.manager [None req-48371ae4-5710-4721-9c71-bf52997cce40 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d] Took 10.02 seconds to build instance.
Oct 23 21:33:55 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-48371ae4-5710-4721-9c71-bf52997cce40 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] Lock "a4bf4723-1e3c-42f1-a422-9d9263b67e3d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.319s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:33:55 user nova-compute[74337]: DEBUG nova.compute.manager [req-0ffc7e33-05f2-47a1-8440-e31098e6e539 req-a149413f-7649-446f-872a-8484a74a60f1 service nova] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] Received event network-vif-plugged-530b7241-1498-47dc-8a6f-79e6c9cc850a {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:33:55 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-0ffc7e33-05f2-47a1-8440-e31098e6e539 req-a149413f-7649-446f-872a-8484a74a60f1 service nova] Acquiring lock "8acc1b10-a541-4c06-aeb7-1ecf7a2457be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:33:55 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-0ffc7e33-05f2-47a1-8440-e31098e6e539 req-a149413f-7649-446f-872a-8484a74a60f1 service nova] Lock "8acc1b10-a541-4c06-aeb7-1ecf7a2457be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:33:55 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-0ffc7e33-05f2-47a1-8440-e31098e6e539 req-a149413f-7649-446f-872a-8484a74a60f1 service nova] Lock "8acc1b10-a541-4c06-aeb7-1ecf7a2457be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:33:55 user nova-compute[74337]: DEBUG nova.compute.manager [req-0ffc7e33-05f2-47a1-8440-e31098e6e539 req-a149413f-7649-446f-872a-8484a74a60f1 service nova] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] No waiting events found dispatching network-vif-plugged-530b7241-1498-47dc-8a6f-79e6c9cc850a {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:33:55 user nova-compute[74337]: WARNING nova.compute.manager [req-0ffc7e33-05f2-47a1-8440-e31098e6e539 req-a149413f-7649-446f-872a-8484a74a60f1 service nova] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] Received unexpected event network-vif-plugged-530b7241-1498-47dc-8a6f-79e6c9cc850a for instance with vm_state active and task_state None.
Oct 23 21:33:56 user nova-compute[74337]: DEBUG nova.compute.manager [req-39502619-76f5-4a99-b9f9-54dc877a8a61 req-b6f18c9d-5fb5-4c7d-a657-77d4fd5d4842 service nova] [instance: 2075057e-81db-424a-bb20-662d77faafed] Received event network-vif-plugged-603e30f8-b216-49f6-ae75-5c60b4e602f8 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:33:56 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-39502619-76f5-4a99-b9f9-54dc877a8a61 req-b6f18c9d-5fb5-4c7d-a657-77d4fd5d4842 service nova] Acquiring lock "2075057e-81db-424a-bb20-662d77faafed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:33:56 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-39502619-76f5-4a99-b9f9-54dc877a8a61 req-b6f18c9d-5fb5-4c7d-a657-77d4fd5d4842 service nova] Lock "2075057e-81db-424a-bb20-662d77faafed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:33:56 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-39502619-76f5-4a99-b9f9-54dc877a8a61 req-b6f18c9d-5fb5-4c7d-a657-77d4fd5d4842 service nova] Lock "2075057e-81db-424a-bb20-662d77faafed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:33:56 user nova-compute[74337]: DEBUG nova.compute.manager [req-39502619-76f5-4a99-b9f9-54dc877a8a61 req-b6f18c9d-5fb5-4c7d-a657-77d4fd5d4842 service nova] [instance: 2075057e-81db-424a-bb20-662d77faafed] No waiting events found dispatching network-vif-plugged-603e30f8-b216-49f6-ae75-5c60b4e602f8 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:33:56 user nova-compute[74337]: WARNING nova.compute.manager [req-39502619-76f5-4a99-b9f9-54dc877a8a61 req-b6f18c9d-5fb5-4c7d-a657-77d4fd5d4842 service nova] [instance: 2075057e-81db-424a-bb20-662d77faafed] Received unexpected event network-vif-plugged-603e30f8-b216-49f6-ae75-5c60b4e602f8 for instance with vm_state building and task_state spawning.
Oct 23 21:33:56 user nova-compute[74337]: DEBUG nova.compute.manager [req-39502619-76f5-4a99-b9f9-54dc877a8a61 req-b6f18c9d-5fb5-4c7d-a657-77d4fd5d4842 service nova] [instance: 2075057e-81db-424a-bb20-662d77faafed] Received event network-vif-plugged-603e30f8-b216-49f6-ae75-5c60b4e602f8 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:33:56 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-39502619-76f5-4a99-b9f9-54dc877a8a61 req-b6f18c9d-5fb5-4c7d-a657-77d4fd5d4842 service nova] Acquiring lock "2075057e-81db-424a-bb20-662d77faafed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:33:56 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-39502619-76f5-4a99-b9f9-54dc877a8a61 req-b6f18c9d-5fb5-4c7d-a657-77d4fd5d4842 service nova] Lock "2075057e-81db-424a-bb20-662d77faafed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:33:56 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-39502619-76f5-4a99-b9f9-54dc877a8a61 req-b6f18c9d-5fb5-4c7d-a657-77d4fd5d4842 service nova] Lock "2075057e-81db-424a-bb20-662d77faafed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:33:56 user nova-compute[74337]: DEBUG nova.compute.manager [req-39502619-76f5-4a99-b9f9-54dc877a8a61 req-b6f18c9d-5fb5-4c7d-a657-77d4fd5d4842 service nova] [instance: 2075057e-81db-424a-bb20-662d77faafed] No waiting events found dispatching network-vif-plugged-603e30f8-b216-49f6-ae75-5c60b4e602f8 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:33:56 user nova-compute[74337]: WARNING nova.compute.manager [req-39502619-76f5-4a99-b9f9-54dc877a8a61 req-b6f18c9d-5fb5-4c7d-a657-77d4fd5d4842 service nova] [instance: 2075057e-81db-424a-bb20-662d77faafed] Received unexpected event network-vif-plugged-603e30f8-b216-49f6-ae75-5c60b4e602f8 for instance with vm_state building and task_state spawning.
Oct 23 21:33:56 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:33:56 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:33:57 user nova-compute[74337]: DEBUG nova.compute.manager [None req-963b1597-d7b1-4c40-94eb-0b6f83975058 tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] [instance: 2075057e-81db-424a-bb20-662d77faafed] Instance event wait completed in 0 seconds for  {{(pid=74337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 21:33:57 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-963b1597-d7b1-4c40-94eb-0b6f83975058 tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] [instance: 2075057e-81db-424a-bb20-662d77faafed] Guest created on hypervisor {{(pid=74337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 21:33:57 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: 2075057e-81db-424a-bb20-662d77faafed] Instance spawned successfully.
Oct 23 21:33:57 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-963b1597-d7b1-4c40-94eb-0b6f83975058 tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] [instance: 2075057e-81db-424a-bb20-662d77faafed] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 21:33:57 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-963b1597-d7b1-4c40-94eb-0b6f83975058 tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] [instance: 2075057e-81db-424a-bb20-662d77faafed] Found default for hw_cdrom_bus of ide {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:33:57 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-963b1597-d7b1-4c40-94eb-0b6f83975058 tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] [instance: 2075057e-81db-424a-bb20-662d77faafed] Found default for hw_disk_bus of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:33:57 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-963b1597-d7b1-4c40-94eb-0b6f83975058 tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] [instance: 2075057e-81db-424a-bb20-662d77faafed] Found default for hw_input_bus of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:33:57 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-963b1597-d7b1-4c40-94eb-0b6f83975058 tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] [instance: 2075057e-81db-424a-bb20-662d77faafed] Found default for hw_pointer_model of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:33:57 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-963b1597-d7b1-4c40-94eb-0b6f83975058 tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] [instance: 2075057e-81db-424a-bb20-662d77faafed] Found default for hw_video_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:33:57 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-963b1597-d7b1-4c40-94eb-0b6f83975058 tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] [instance: 2075057e-81db-424a-bb20-662d77faafed] Found default for hw_vif_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:33:57 user nova-compute[74337]: INFO nova.compute.manager [None req-963b1597-d7b1-4c40-94eb-0b6f83975058 tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] [instance: 2075057e-81db-424a-bb20-662d77faafed] Took 7.40 seconds to spawn the instance on the hypervisor.
Oct 23 21:33:57 user nova-compute[74337]: DEBUG nova.compute.manager [None req-963b1597-d7b1-4c40-94eb-0b6f83975058 tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] [instance: 2075057e-81db-424a-bb20-662d77faafed] Checking state {{(pid=74337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 21:33:57 user nova-compute[74337]: INFO nova.compute.manager [None req-963b1597-d7b1-4c40-94eb-0b6f83975058 tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] [instance: 2075057e-81db-424a-bb20-662d77faafed] Took 8.65 seconds to build instance.
Oct 23 21:33:57 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-963b1597-d7b1-4c40-94eb-0b6f83975058 tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] Lock "2075057e-81db-424a-bb20-662d77faafed" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.783s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:33:57 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:33:57 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Starting heal instance info cache {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 21:33:57 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Rebuilding the list of instances to heal {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 21:33:57 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "refresh_cache-05b80b08-f66c-4cc6-b806-f25543536bfa" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:33:57 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquired lock "refresh_cache-05b80b08-f66c-4cc6-b806-f25543536bfa" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:33:57 user nova-compute[74337]: DEBUG nova.network.neutron [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 05b80b08-f66c-4cc6-b806-f25543536bfa] Forcefully refreshing network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 21:33:57 user nova-compute[74337]: DEBUG nova.objects.instance [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lazy-loading 'info_cache' on Instance uuid 05b80b08-f66c-4cc6-b806-f25543536bfa {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:33:57 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:57 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:33:58 user nova-compute[74337]: DEBUG nova.network.neutron [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 05b80b08-f66c-4cc6-b806-f25543536bfa] Updating instance_info_cache with network_info: [{"id": "3373880f-4797-411f-9e90-104572cca818", "address": "fa:16:3e:a8:ad:5b", "network": {"id": "decd291a-5626-4c07-9568-d019eb36dd28", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1526257557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3411c1b9d3c847498ccfe3f0ef368dae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3373880f-47", "ovs_interfaceid": "3373880f-4797-411f-9e90-104572cca818", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:33:58 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Releasing lock "refresh_cache-05b80b08-f66c-4cc6-b806-f25543536bfa" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:33:58 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 05b80b08-f66c-4cc6-b806-f25543536bfa] Updated the network info_cache for instance {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 21:33:58 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:33:58 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:33:58 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:33:58 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:33:58 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:33:58 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Auditing locally available compute resources for user (node: user) {{(pid=74337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 21:33:58 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a181593-8086-4ece-9f5b-5ccba0bfe91e/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:33:59 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a181593-8086-4ece-9f5b-5ccba0bfe91e/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:33:59 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a181593-8086-4ece-9f5b-5ccba0bfe91e/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:33:59 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a181593-8086-4ece-9f5b-5ccba0bfe91e/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:33:59 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8acc1b10-a541-4c06-aeb7-1ecf7a2457be/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:33:59 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8acc1b10-a541-4c06-aeb7-1ecf7a2457be/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:33:59 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8acc1b10-a541-4c06-aeb7-1ecf7a2457be/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:33:59 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8acc1b10-a541-4c06-aeb7-1ecf7a2457be/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:33:59 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d45e8ae8-371b-46ae-849d-d7f7d5bbd770/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:33:59 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d45e8ae8-371b-46ae-849d-d7f7d5bbd770/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:33:59 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d45e8ae8-371b-46ae-849d-d7f7d5bbd770/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:34:00 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d45e8ae8-371b-46ae-849d-d7f7d5bbd770/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:34:00 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05b80b08-f66c-4cc6-b806-f25543536bfa/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:34:00 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05b80b08-f66c-4cc6-b806-f25543536bfa/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:34:00 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05b80b08-f66c-4cc6-b806-f25543536bfa/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:34:00 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05b80b08-f66c-4cc6-b806-f25543536bfa/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:34:00 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:34:00 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:34:00 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:34:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:34:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4bf4723-1e3c-42f1-a422-9d9263b67e3d/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:34:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4bf4723-1e3c-42f1-a422-9d9263b67e3d/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:34:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4bf4723-1e3c-42f1-a422-9d9263b67e3d/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:34:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4bf4723-1e3c-42f1-a422-9d9263b67e3d/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:34:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf6270ba-7a4e-40c4-b7fd-c62a44125c89/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:34:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf6270ba-7a4e-40c4-b7fd-c62a44125c89/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:34:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf6270ba-7a4e-40c4-b7fd-c62a44125c89/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:34:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf6270ba-7a4e-40c4-b7fd-c62a44125c89/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:34:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2075057e-81db-424a-bb20-662d77faafed/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:34:02 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2075057e-81db-424a-bb20-662d77faafed/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:34:02 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2075057e-81db-424a-bb20-662d77faafed/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:34:02 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2075057e-81db-424a-bb20-662d77faafed/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:34:02 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff1c790c-2458-438e-95c7-7e1412fe05fc/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:34:02 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff1c790c-2458-438e-95c7-7e1412fe05fc/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:34:02 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff1c790c-2458-438e-95c7-7e1412fe05fc/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:34:02 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff1c790c-2458-438e-95c7-7e1412fe05fc/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:34:02 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:34:03 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:34:03 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:34:03 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:34:03 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Hypervisor/Node resource view: name=user free_ram=7920MB free_disk=25.720745086669922GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 21:34:03 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:34:03 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:34:03 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 05b80b08-f66c-4cc6-b806-f25543536bfa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:34:03 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance cf6270ba-7a4e-40c4-b7fd-c62a44125c89 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:34:03 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:34:03 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance d45e8ae8-371b-46ae-849d-d7f7d5bbd770 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:34:03 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 8acc1b10-a541-4c06-aeb7-1ecf7a2457be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:34:03 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance ff1c790c-2458-438e-95c7-7e1412fe05fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:34:03 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 5a181593-8086-4ece-9f5b-5ccba0bfe91e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:34:03 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance a4bf4723-1e3c-42f1-a422-9d9263b67e3d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:34:03 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 2075057e-81db-424a-bb20-662d77faafed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:34:03 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 21:34:03 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 21:34:03 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Refreshing inventories for resource provider dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 23 21:34:03 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Updating ProviderTree inventory for provider dfcf3942-a432-4293-945b-14b86f57d794 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 23 21:34:03 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Updating inventory in ProviderTree for provider dfcf3942-a432-4293-945b-14b86f57d794 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 23 21:34:03 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Refreshing aggregate associations for resource provider dfcf3942-a432-4293-945b-14b86f57d794, aggregates: None {{(pid=74337) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 23 21:34:03 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Refreshing trait associations for resource provider dfcf3942-a432-4293-945b-14b86f57d794, traits: COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE2,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE42,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_EXTEND,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_TRUSTED_CERTS {{(pid=74337) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 23 21:34:04 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:34:04 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:34:04 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Compute_service record updated for user:user {{(pid=74337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 21:34:04 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.972s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:34:07 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:34:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:34:12 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:34:13 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:34:17 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:34:18 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:34:22 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:34:23 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:34:27 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:34:28 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:34:31 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:34:33 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:34:38 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:34:38 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:34:38 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 21:34:38 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 21:34:38 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 21:34:38 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:34:40 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Acquiring lock "f1040399-0c5d-4a68-9ee0-4fbe45a42c55" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:34:40 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Lock "f1040399-0c5d-4a68-9ee0-4fbe45a42c55" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:34:40 user nova-compute[74337]: DEBUG nova.compute.manager [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Starting instance... {{(pid=74337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 21:34:40 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:34:40 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:34:40 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 21:34:40 user nova-compute[74337]: INFO nova.compute.claims [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Claim successful on node user
Oct 23 21:34:40 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:34:40 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:34:40 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.405s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:34:40 user nova-compute[74337]: DEBUG nova.compute.manager [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Start building networks asynchronously for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 21:34:40 user nova-compute[74337]: DEBUG nova.compute.manager [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Allocating IP information in the background. {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 21:34:40 user nova-compute[74337]: DEBUG nova.network.neutron [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] allocate_for_instance() {{(pid=74337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 21:34:40 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 21:34:40 user nova-compute[74337]: DEBUG nova.compute.manager [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Start building block device mappings for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 21:34:41 user nova-compute[74337]: INFO nova.virt.block_device [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Booting with volume 694e3124-c6ed-4079-82c0-18f56c369932 at /dev/vda
Oct 23 21:34:41 user nova-compute[74337]: DEBUG nova.policy [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '06b6ce06ab564b719c3b09ee9bece960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b3449d434445e7973d49183234beee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74337) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 21:34:41 user nova-compute[74337]: DEBUG os_brick.utils [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:34:41 user nova-compute[74337]: INFO oslo.privsep.daemon [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpkrz3epeg/privsep.sock']
Oct 23 21:34:41 user sudo[85562]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpkrz3epeg/privsep.sock
Oct 23 21:34:41 user sudo[85562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 23 21:34:41 user nova-compute[74337]: DEBUG nova.network.neutron [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Successfully created port: 58eb51e5-3d74-4162-93b8-66bdf176c1d5 {{(pid=74337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 21:34:42 user nova-compute[74337]: DEBUG nova.network.neutron [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Successfully created port: ddee6c78-417b-494f-a9e1-f662c549f425 {{(pid=74337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 21:34:42 user sudo[85562]: pam_unix(sudo:session): session closed for user root
Oct 23 21:34:42 user nova-compute[74337]: INFO oslo.privsep.daemon [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Spawned new privsep daemon via rootwrap
Oct 23 21:34:42 user nova-compute[74337]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 23 21:34:42 user nova-compute[74337]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 23 21:34:42 user nova-compute[74337]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Oct 23 21:34:42 user nova-compute[74337]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85566
Oct 23 21:34:42 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c356fbb2-2747-477d-a173-742ce468f7b3]: (2,) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:34:42 user nova-compute[74337]: DEBUG nova.network.neutron [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Successfully created port: b1664585-4013-46f9-9738-33fd7b9a3161 {{(pid=74337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 21:34:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:34:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:34:42 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ddd5ef-55a1-4841-977f-dc32dea047ac]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f34011b66e40\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:34:42 user nova-compute[74337]: WARNING os_brick.initiator.connectors.nvmeof [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Oct 23 21:34:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:34:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:34:42 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d06f082-988d-4037-888d-7454792545c6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:34:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:34:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:34:42 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb2a9f47-5c7d-4ea2-91fb-ba5c47312341]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:34:42 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ab5e8b-1257-4ee4-b328-e9021abe21d8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:34:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Running cmd (subprocess): nvme version {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:34:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] 'nvme version' failed. Not Retrying. {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 21:34:42 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] nvme not present on system {{(pid=74337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 21:34:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:34:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 21:34:42 user nova-compute[74337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 21:34:42 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e25fe78-4999-4c83-bec2-9b109fb0de76]: (4, '') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:34:42 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 21:34:42 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 21:34:42 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] LIGHTOS: no hostnqn found. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 21:34:42 user nova-compute[74337]: DEBUG os_brick.utils [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] <== get_connector_properties: return (1861ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f34011b66e40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:34:42 user nova-compute[74337]: DEBUG nova.virt.block_device [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Updating existing volume attachment record: c1b5c2e8-5d5f-4b41-9ea1-52608f008b08 {{(pid=74337) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 21:34:43 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:34:43 user nova-compute[74337]: DEBUG nova.network.neutron [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Successfully created port: ba01b035-453b-4378-92fc-1d81b84363ff {{(pid=74337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 21:34:43 user nova-compute[74337]: DEBUG nova.network.neutron [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Successfully created port: 248131be-39a9-430f-b27a-377d176d7846 {{(pid=74337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 21:34:44 user nova-compute[74337]: DEBUG nova.network.neutron [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Successfully updated port: 58eb51e5-3d74-4162-93b8-66bdf176c1d5 {{(pid=74337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 21:34:44 user nova-compute[74337]: DEBUG nova.compute.manager [req-717f87bd-01a3-4b74-98f4-da7459aac5d4 req-5a2708d7-135b-4868-b0d3-5aa43893354f service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Received event network-changed-58eb51e5-3d74-4162-93b8-66bdf176c1d5 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:34:44 user nova-compute[74337]: DEBUG nova.compute.manager [req-717f87bd-01a3-4b74-98f4-da7459aac5d4 req-5a2708d7-135b-4868-b0d3-5aa43893354f service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Refreshing instance network info cache due to event network-changed-58eb51e5-3d74-4162-93b8-66bdf176c1d5. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 21:34:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-717f87bd-01a3-4b74-98f4-da7459aac5d4 req-5a2708d7-135b-4868-b0d3-5aa43893354f service nova] Acquiring lock "refresh_cache-f1040399-0c5d-4a68-9ee0-4fbe45a42c55" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:34:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-717f87bd-01a3-4b74-98f4-da7459aac5d4 req-5a2708d7-135b-4868-b0d3-5aa43893354f service nova] Acquired lock "refresh_cache-f1040399-0c5d-4a68-9ee0-4fbe45a42c55" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:34:44 user nova-compute[74337]: DEBUG nova.network.neutron [req-717f87bd-01a3-4b74-98f4-da7459aac5d4 req-5a2708d7-135b-4868-b0d3-5aa43893354f service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Refreshing network info cache for port 58eb51e5-3d74-4162-93b8-66bdf176c1d5 {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 21:34:44 user nova-compute[74337]: DEBUG nova.network.neutron [req-717f87bd-01a3-4b74-98f4-da7459aac5d4 req-5a2708d7-135b-4868-b0d3-5aa43893354f service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Instance cache missing network info. {{(pid=74337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 21:34:44 user nova-compute[74337]: DEBUG nova.network.neutron [req-717f87bd-01a3-4b74-98f4-da7459aac5d4 req-5a2708d7-135b-4868-b0d3-5aa43893354f service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Updating instance_info_cache with network_info: [] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:34:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-717f87bd-01a3-4b74-98f4-da7459aac5d4 req-5a2708d7-135b-4868-b0d3-5aa43893354f service nova] Releasing lock "refresh_cache-f1040399-0c5d-4a68-9ee0-4fbe45a42c55" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:34:45 user nova-compute[74337]: DEBUG nova.network.neutron [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Successfully updated port: dd8e8982-b86c-469a-aa55-72bb2ac9bb8b {{(pid=74337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 21:34:45 user nova-compute[74337]: DEBUG nova.network.neutron [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Successfully updated port: e91aa55a-4a71-4090-bdde-88c4a648b60b {{(pid=74337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 21:34:46 user nova-compute[74337]: DEBUG nova.network.neutron [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Successfully updated port: ddee6c78-417b-494f-a9e1-f662c549f425 {{(pid=74337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 21:34:46 user nova-compute[74337]: DEBUG nova.compute.manager [req-c796369e-e73a-4cf3-a81a-1ab69368f548 req-290c45f2-d07e-4d22-8a3b-7697be9cd10e service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Received event network-changed-dd8e8982-b86c-469a-aa55-72bb2ac9bb8b {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:34:46 user nova-compute[74337]: DEBUG nova.compute.manager [req-c796369e-e73a-4cf3-a81a-1ab69368f548 req-290c45f2-d07e-4d22-8a3b-7697be9cd10e service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Refreshing instance network info cache due to event network-changed-dd8e8982-b86c-469a-aa55-72bb2ac9bb8b. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 21:34:46 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-c796369e-e73a-4cf3-a81a-1ab69368f548 req-290c45f2-d07e-4d22-8a3b-7697be9cd10e service nova] Acquiring lock "refresh_cache-f1040399-0c5d-4a68-9ee0-4fbe45a42c55" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:34:46 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-c796369e-e73a-4cf3-a81a-1ab69368f548 req-290c45f2-d07e-4d22-8a3b-7697be9cd10e service nova] Acquired lock "refresh_cache-f1040399-0c5d-4a68-9ee0-4fbe45a42c55" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:34:46 user nova-compute[74337]: DEBUG nova.network.neutron [req-c796369e-e73a-4cf3-a81a-1ab69368f548 req-290c45f2-d07e-4d22-8a3b-7697be9cd10e service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Refreshing network info cache for port dd8e8982-b86c-469a-aa55-72bb2ac9bb8b {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 21:34:46 user nova-compute[74337]: DEBUG nova.network.neutron [req-c796369e-e73a-4cf3-a81a-1ab69368f548 req-290c45f2-d07e-4d22-8a3b-7697be9cd10e service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Instance cache missing network info. {{(pid=74337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 21:34:46 user nova-compute[74337]: DEBUG nova.network.neutron [req-c796369e-e73a-4cf3-a81a-1ab69368f548 req-290c45f2-d07e-4d22-8a3b-7697be9cd10e service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Updating instance_info_cache with network_info: [] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:34:46 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-c796369e-e73a-4cf3-a81a-1ab69368f548 req-290c45f2-d07e-4d22-8a3b-7697be9cd10e service nova] Releasing lock "refresh_cache-f1040399-0c5d-4a68-9ee0-4fbe45a42c55" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:34:46 user nova-compute[74337]: DEBUG nova.compute.manager [req-c796369e-e73a-4cf3-a81a-1ab69368f548 req-290c45f2-d07e-4d22-8a3b-7697be9cd10e service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Received event network-changed-e91aa55a-4a71-4090-bdde-88c4a648b60b {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:34:46 user nova-compute[74337]: DEBUG nova.compute.manager [req-c796369e-e73a-4cf3-a81a-1ab69368f548 req-290c45f2-d07e-4d22-8a3b-7697be9cd10e service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Refreshing instance network info cache due to event network-changed-e91aa55a-4a71-4090-bdde-88c4a648b60b. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 21:34:46 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-c796369e-e73a-4cf3-a81a-1ab69368f548 req-290c45f2-d07e-4d22-8a3b-7697be9cd10e service nova] Acquiring lock "refresh_cache-f1040399-0c5d-4a68-9ee0-4fbe45a42c55" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:34:46 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-c796369e-e73a-4cf3-a81a-1ab69368f548 req-290c45f2-d07e-4d22-8a3b-7697be9cd10e service nova] Acquired lock "refresh_cache-f1040399-0c5d-4a68-9ee0-4fbe45a42c55" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:34:46 user nova-compute[74337]: DEBUG nova.network.neutron [req-c796369e-e73a-4cf3-a81a-1ab69368f548 req-290c45f2-d07e-4d22-8a3b-7697be9cd10e service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Refreshing network info cache for port e91aa55a-4a71-4090-bdde-88c4a648b60b {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 21:34:47 user nova-compute[74337]: DEBUG nova.network.neutron [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Successfully updated port: b1664585-4013-46f9-9738-33fd7b9a3161 {{(pid=74337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 21:34:47 user nova-compute[74337]: DEBUG nova.network.neutron [req-c796369e-e73a-4cf3-a81a-1ab69368f548 req-290c45f2-d07e-4d22-8a3b-7697be9cd10e service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Instance cache missing network info. {{(pid=74337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 21:34:47 user nova-compute[74337]: DEBUG nova.network.neutron [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Successfully updated port: ba01b035-453b-4378-92fc-1d81b84363ff {{(pid=74337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 21:34:47 user nova-compute[74337]: DEBUG nova.network.neutron [req-c796369e-e73a-4cf3-a81a-1ab69368f548 req-290c45f2-d07e-4d22-8a3b-7697be9cd10e service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Updating instance_info_cache with network_info: [] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:34:47 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-c796369e-e73a-4cf3-a81a-1ab69368f548 req-290c45f2-d07e-4d22-8a3b-7697be9cd10e service nova] Releasing lock "refresh_cache-f1040399-0c5d-4a68-9ee0-4fbe45a42c55" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:34:48 user nova-compute[74337]: DEBUG nova.network.neutron [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Successfully updated port: 248131be-39a9-430f-b27a-377d176d7846 {{(pid=74337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 21:34:48 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Acquiring lock "refresh_cache-f1040399-0c5d-4a68-9ee0-4fbe45a42c55" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:34:48 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Acquired lock "refresh_cache-f1040399-0c5d-4a68-9ee0-4fbe45a42c55" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:34:48 user nova-compute[74337]: DEBUG nova.network.neutron [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Building network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 21:34:48 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:34:48 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:34:48 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 21:34:48 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 21:34:48 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 21:34:48 user nova-compute[74337]: DEBUG nova.network.neutron [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Instance cache missing network info. {{(pid=74337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 21:34:48 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:34:48 user nova-compute[74337]: DEBUG nova.compute.manager [req-5144ee7d-c58c-4b61-ad5e-d632acda6046 req-8c2839e1-1736-4cc6-935d-41485754cb83 service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Received event network-changed-ddee6c78-417b-494f-a9e1-f662c549f425 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:34:48 user nova-compute[74337]: DEBUG nova.compute.manager [req-5144ee7d-c58c-4b61-ad5e-d632acda6046 req-8c2839e1-1736-4cc6-935d-41485754cb83 service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Refreshing instance network info cache due to event network-changed-ddee6c78-417b-494f-a9e1-f662c549f425. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 21:34:48 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-5144ee7d-c58c-4b61-ad5e-d632acda6046 req-8c2839e1-1736-4cc6-935d-41485754cb83 service nova] Acquiring lock "refresh_cache-f1040399-0c5d-4a68-9ee0-4fbe45a42c55" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:34:50 user nova-compute[74337]: DEBUG nova.network.neutron [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Updating instance_info_cache with network_info: [{"id": "58eb51e5-3d74-4162-93b8-66bdf176c1d5", "address": "fa:16:3e:53:ba:1b", "network": {"id": "54ea29fa-daa7-4818-8d2d-c90ee9a18a95", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1215215856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58eb51e5-3d", "ovs_interfaceid": "58eb51e5-3d74-4162-93b8-66bdf176c1d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dd8e8982-b86c-469a-aa55-72bb2ac9bb8b", "address": "fa:16:3e:67:90:76", "network": {"id": "8b22a426-2945-474d-b0e6-8c22bb5e57e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-57423842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd8e8982-b8", "ovs_interfaceid": "dd8e8982-b86c-469a-aa55-72bb2ac9bb8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e91aa55a-4a71-4090-bdde-88c4a648b60b", "address": "fa:16:3e:45:60:43", "network": {"id": "8b22a426-2945-474d-b0e6-8c22bb5e57e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-57423842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape91aa55a-4a", "ovs_interfaceid": "e91aa55a-4a71-4090-bdde-88c4a648b60b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ddee6c78-417b-494f-a9e1-f662c549f425", "address": "fa:16:3e:fb:ef:75", "network": {"id": "8b22a426-2945-474d-b0e6-8c22bb5e57e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-57423842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddee6c78-41", "ovs_interfaceid": "ddee6c78-417b-494f-a9e1-f662c549f425", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b1664585-4013-46f9-9738-33fd7b9a3161", "address": "fa:16:3e:e8:30:72", "network": {"id": "8b22a426-2945-474d-b0e6-8c22bb5e57e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-57423842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1664585-40", "ovs_interfaceid": "b1664585-4013-46f9-9738-33fd7b9a3161", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ba01b035-453b-4378-92fc-1d81b84363ff", "address": "fa:16:3e:89:cb:12", "network": {"id": "cd8ce1ca-56b3-48fa-bb57-54d0616aa7ca", "bridge": "br-int", "label": "tempest-device-tagging-net2-611360182", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba01b035-45", "ovs_interfaceid": "ba01b035-453b-4378-92fc-1d81b84363ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "248131be-39a9-430f-b27a-377d176d7846", "address": "fa:16:3e:5d:ae:b7", "network": {"id": "cd8ce1ca-56b3-48fa-bb57-54d0616aa7ca", "bridge": "br-int", "label": "tempest-device-tagging-net2-611360182", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap248131be-39", "ovs_interfaceid": "248131be-39a9-430f-b27a-377d176d7846", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:34:50 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Releasing lock "refresh_cache-f1040399-0c5d-4a68-9ee0-4fbe45a42c55" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:34:50 user nova-compute[74337]: DEBUG nova.compute.manager [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Instance network_info: |[{"id": "58eb51e5-3d74-4162-93b8-66bdf176c1d5", "address": "fa:16:3e:53:ba:1b", "network": {"id": "54ea29fa-daa7-4818-8d2d-c90ee9a18a95", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1215215856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58eb51e5-3d", "ovs_interfaceid": "58eb51e5-3d74-4162-93b8-66bdf176c1d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dd8e8982-b86c-469a-aa55-72bb2ac9bb8b", "address": "fa:16:3e:67:90:76", "network": {"id": "8b22a426-2945-474d-b0e6-8c22bb5e57e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-57423842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd8e8982-b8", "ovs_interfaceid": "dd8e8982-b86c-469a-aa55-72bb2ac9bb8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e91aa55a-4a71-4090-bdde-88c4a648b60b", "address": "fa:16:3e:45:60:43", "network": {"id": "8b22a426-2945-474d-b0e6-8c22bb5e57e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-57423842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape91aa55a-4a", "ovs_interfaceid": "e91aa55a-4a71-4090-bdde-88c4a648b60b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ddee6c78-417b-494f-a9e1-f662c549f425", "address": "fa:16:3e:fb:ef:75", "network": {"id": "8b22a426-2945-474d-b0e6-8c22bb5e57e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-57423842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddee6c78-41", "ovs_interfaceid": "ddee6c78-417b-494f-a9e1-f662c549f425", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b1664585-4013-46f9-9738-33fd7b9a3161", "address": "fa:16:3e:e8:30:72", "network": {"id": "8b22a426-2945-474d-b0e6-8c22bb5e57e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-57423842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1664585-40", "ovs_interfaceid": "b1664585-4013-46f9-9738-33fd7b9a3161", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ba01b035-453b-4378-92fc-1d81b84363ff", "address": "fa:16:3e:89:cb:12", "network": {"id": "cd8ce1ca-56b3-48fa-bb57-54d0616aa7ca", "bridge": "br-int", "label": "tempest-device-tagging-net2-611360182", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba01b035-45", "ovs_interfaceid": "ba01b035-453b-4378-92fc-1d81b84363ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "248131be-39a9-430f-b27a-377d176d7846", "address": "fa:16:3e:5d:ae:b7", "network": {"id": "cd8ce1ca-56b3-48fa-bb57-54d0616aa7ca", "bridge": "br-int", "label": "tempest-device-tagging-net2-611360182", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap248131be-39", "ovs_interfaceid": "248131be-39a9-430f-b27a-377d176d7846", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 21:34:50 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-5144ee7d-c58c-4b61-ad5e-d632acda6046 req-8c2839e1-1736-4cc6-935d-41485754cb83 service nova] Acquired lock "refresh_cache-f1040399-0c5d-4a68-9ee0-4fbe45a42c55" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:34:50 user nova-compute[74337]: DEBUG nova.network.neutron [req-5144ee7d-c58c-4b61-ad5e-d632acda6046 req-8c2839e1-1736-4cc6-935d-41485754cb83 service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Refreshing network info cache for port ddee6c78-417b-494f-a9e1-f662c549f425 {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 21:34:50 user nova-compute[74337]: DEBUG nova.network.neutron [req-5144ee7d-c58c-4b61-ad5e-d632acda6046 req-8c2839e1-1736-4cc6-935d-41485754cb83 service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Updated VIF entry in instance network info cache for port ddee6c78-417b-494f-a9e1-f662c549f425. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 21:34:50 user nova-compute[74337]: DEBUG nova.network.neutron [req-5144ee7d-c58c-4b61-ad5e-d632acda6046 req-8c2839e1-1736-4cc6-935d-41485754cb83 service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Updating instance_info_cache with network_info: [{"id": "58eb51e5-3d74-4162-93b8-66bdf176c1d5", "address": "fa:16:3e:53:ba:1b", "network": {"id": "54ea29fa-daa7-4818-8d2d-c90ee9a18a95", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1215215856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58eb51e5-3d", "ovs_interfaceid": "58eb51e5-3d74-4162-93b8-66bdf176c1d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dd8e8982-b86c-469a-aa55-72bb2ac9bb8b", "address": "fa:16:3e:67:90:76", "network": {"id": "8b22a426-2945-474d-b0e6-8c22bb5e57e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-57423842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd8e8982-b8", "ovs_interfaceid": "dd8e8982-b86c-469a-aa55-72bb2ac9bb8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e91aa55a-4a71-4090-bdde-88c4a648b60b", "address": "fa:16:3e:45:60:43", "network": {"id": "8b22a426-2945-474d-b0e6-8c22bb5e57e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-57423842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape91aa55a-4a", "ovs_interfaceid": "e91aa55a-4a71-4090-bdde-88c4a648b60b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ddee6c78-417b-494f-a9e1-f662c549f425", "address": "fa:16:3e:fb:ef:75", "network": {"id": "8b22a426-2945-474d-b0e6-8c22bb5e57e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-57423842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddee6c78-41", "ovs_interfaceid": "ddee6c78-417b-494f-a9e1-f662c549f425", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b1664585-4013-46f9-9738-33fd7b9a3161", "address": "fa:16:3e:e8:30:72", "network": {"id": "8b22a426-2945-474d-b0e6-8c22bb5e57e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-57423842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1664585-40", "ovs_interfaceid": "b1664585-4013-46f9-9738-33fd7b9a3161", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ba01b035-453b-4378-92fc-1d81b84363ff", "address": "fa:16:3e:89:cb:12", "network": {"id": "cd8ce1ca-56b3-48fa-bb57-54d0616aa7ca", "bridge": "br-int", "label": "tempest-device-tagging-net2-611360182", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba01b035-45", "ovs_interfaceid": "ba01b035-453b-4378-92fc-1d81b84363ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "248131be-39a9-430f-b27a-377d176d7846", "address": "fa:16:3e:5d:ae:b7", "network": {"id": "cd8ce1ca-56b3-48fa-bb57-54d0616aa7ca", "bridge": "br-int", "label": "tempest-device-tagging-net2-611360182", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap248131be-39", "ovs_interfaceid": "248131be-39a9-430f-b27a-377d176d7846", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:34:50 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-5144ee7d-c58c-4b61-ad5e-d632acda6046 req-8c2839e1-1736-4cc6-935d-41485754cb83 service nova] Releasing lock "refresh_cache-f1040399-0c5d-4a68-9ee0-4fbe45a42c55" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:34:50 user nova-compute[74337]: DEBUG nova.compute.manager [req-5144ee7d-c58c-4b61-ad5e-d632acda6046 req-8c2839e1-1736-4cc6-935d-41485754cb83 service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Received event network-changed-b1664585-4013-46f9-9738-33fd7b9a3161 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:34:50 user nova-compute[74337]: DEBUG nova.compute.manager [req-5144ee7d-c58c-4b61-ad5e-d632acda6046 req-8c2839e1-1736-4cc6-935d-41485754cb83 service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Refreshing instance network info cache due to event network-changed-b1664585-4013-46f9-9738-33fd7b9a3161. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 21:34:50 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-5144ee7d-c58c-4b61-ad5e-d632acda6046 req-8c2839e1-1736-4cc6-935d-41485754cb83 service nova] Acquiring lock "refresh_cache-f1040399-0c5d-4a68-9ee0-4fbe45a42c55" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:34:50 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-5144ee7d-c58c-4b61-ad5e-d632acda6046 req-8c2839e1-1736-4cc6-935d-41485754cb83 service nova] Acquired lock "refresh_cache-f1040399-0c5d-4a68-9ee0-4fbe45a42c55" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:34:50 user nova-compute[74337]: DEBUG nova.network.neutron [req-5144ee7d-c58c-4b61-ad5e-d632acda6046 req-8c2839e1-1736-4cc6-935d-41485754cb83 service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Refreshing network info cache for port b1664585-4013-46f9-9738-33fd7b9a3161 {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 21:34:51 user nova-compute[74337]: DEBUG nova.network.neutron [req-5144ee7d-c58c-4b61-ad5e-d632acda6046 req-8c2839e1-1736-4cc6-935d-41485754cb83 service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Updated VIF entry in instance network info cache for port b1664585-4013-46f9-9738-33fd7b9a3161. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 21:34:51 user nova-compute[74337]: DEBUG nova.network.neutron [req-5144ee7d-c58c-4b61-ad5e-d632acda6046 req-8c2839e1-1736-4cc6-935d-41485754cb83 service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Updating instance_info_cache with network_info: [{"id": "58eb51e5-3d74-4162-93b8-66bdf176c1d5", "address": "fa:16:3e:53:ba:1b", "network": {"id": "54ea29fa-daa7-4818-8d2d-c90ee9a18a95", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1215215856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58eb51e5-3d", "ovs_interfaceid": "58eb51e5-3d74-4162-93b8-66bdf176c1d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dd8e8982-b86c-469a-aa55-72bb2ac9bb8b", "address": "fa:16:3e:67:90:76", "network": {"id": "8b22a426-2945-474d-b0e6-8c22bb5e57e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-57423842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd8e8982-b8", "ovs_interfaceid": "dd8e8982-b86c-469a-aa55-72bb2ac9bb8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e91aa55a-4a71-4090-bdde-88c4a648b60b", "address": "fa:16:3e:45:60:43", "network": {"id": "8b22a426-2945-474d-b0e6-8c22bb5e57e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-57423842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape91aa55a-4a", "ovs_interfaceid": "e91aa55a-4a71-4090-bdde-88c4a648b60b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ddee6c78-417b-494f-a9e1-f662c549f425", "address": "fa:16:3e:fb:ef:75", "network": {"id": "8b22a426-2945-474d-b0e6-8c22bb5e57e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-57423842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddee6c78-41", "ovs_interfaceid": "ddee6c78-417b-494f-a9e1-f662c549f425", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b1664585-4013-46f9-9738-33fd7b9a3161", "address": "fa:16:3e:e8:30:72", "network": {"id": "8b22a426-2945-474d-b0e6-8c22bb5e57e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-57423842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1664585-40", "ovs_interfaceid": "b1664585-4013-46f9-9738-33fd7b9a3161", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ba01b035-453b-4378-92fc-1d81b84363ff", "address": "fa:16:3e:89:cb:12", "network": {"id": "cd8ce1ca-56b3-48fa-bb57-54d0616aa7ca", "bridge": "br-int", "label": "tempest-device-tagging-net2-611360182", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba01b035-45", "ovs_interfaceid": "ba01b035-453b-4378-92fc-1d81b84363ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "248131be-39a9-430f-b27a-377d176d7846", "address": "fa:16:3e:5d:ae:b7", "network": {"id": "cd8ce1ca-56b3-48fa-bb57-54d0616aa7ca", "bridge": "br-int", "label": "tempest-device-tagging-net2-611360182", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap248131be-39", "ovs_interfaceid": "248131be-39a9-430f-b27a-377d176d7846", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:34:51 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-5144ee7d-c58c-4b61-ad5e-d632acda6046 req-8c2839e1-1736-4cc6-935d-41485754cb83 service nova] Releasing lock "refresh_cache-f1040399-0c5d-4a68-9ee0-4fbe45a42c55" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:34:51 user nova-compute[74337]: DEBUG nova.compute.manager [req-5144ee7d-c58c-4b61-ad5e-d632acda6046 req-8c2839e1-1736-4cc6-935d-41485754cb83 service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Received event network-changed-ba01b035-453b-4378-92fc-1d81b84363ff {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:34:51 user nova-compute[74337]: DEBUG nova.compute.manager [req-5144ee7d-c58c-4b61-ad5e-d632acda6046 req-8c2839e1-1736-4cc6-935d-41485754cb83 service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Refreshing instance network info cache due to event network-changed-ba01b035-453b-4378-92fc-1d81b84363ff. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 21:34:51 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-5144ee7d-c58c-4b61-ad5e-d632acda6046 req-8c2839e1-1736-4cc6-935d-41485754cb83 service nova] Acquiring lock "refresh_cache-f1040399-0c5d-4a68-9ee0-4fbe45a42c55" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:34:51 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-5144ee7d-c58c-4b61-ad5e-d632acda6046 req-8c2839e1-1736-4cc6-935d-41485754cb83 service nova] Acquired lock "refresh_cache-f1040399-0c5d-4a68-9ee0-4fbe45a42c55" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:34:51 user nova-compute[74337]: DEBUG nova.network.neutron [req-5144ee7d-c58c-4b61-ad5e-d632acda6046 req-8c2839e1-1736-4cc6-935d-41485754cb83 service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Refreshing network info cache for port ba01b035-453b-4378-92fc-1d81b84363ff {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 21:34:52 user nova-compute[74337]: DEBUG nova.network.neutron [req-5144ee7d-c58c-4b61-ad5e-d632acda6046 req-8c2839e1-1736-4cc6-935d-41485754cb83 service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Updated VIF entry in instance network info cache for port ba01b035-453b-4378-92fc-1d81b84363ff. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 21:34:52 user nova-compute[74337]: DEBUG nova.network.neutron [req-5144ee7d-c58c-4b61-ad5e-d632acda6046 req-8c2839e1-1736-4cc6-935d-41485754cb83 service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Updating instance_info_cache with network_info: [{"id": "58eb51e5-3d74-4162-93b8-66bdf176c1d5", "address": "fa:16:3e:53:ba:1b", "network": {"id": "54ea29fa-daa7-4818-8d2d-c90ee9a18a95", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1215215856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58eb51e5-3d", "ovs_interfaceid": "58eb51e5-3d74-4162-93b8-66bdf176c1d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dd8e8982-b86c-469a-aa55-72bb2ac9bb8b", "address": "fa:16:3e:67:90:76", "network": {"id": "8b22a426-2945-474d-b0e6-8c22bb5e57e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-57423842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd8e8982-b8", "ovs_interfaceid": "dd8e8982-b86c-469a-aa55-72bb2ac9bb8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e91aa55a-4a71-4090-bdde-88c4a648b60b", "address": "fa:16:3e:45:60:43", "network": {"id": "8b22a426-2945-474d-b0e6-8c22bb5e57e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-57423842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape91aa55a-4a", "ovs_interfaceid": "e91aa55a-4a71-4090-bdde-88c4a648b60b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ddee6c78-417b-494f-a9e1-f662c549f425", "address": "fa:16:3e:fb:ef:75", "network": {"id": "8b22a426-2945-474d-b0e6-8c22bb5e57e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-57423842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddee6c78-41", "ovs_interfaceid": "ddee6c78-417b-494f-a9e1-f662c549f425", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b1664585-4013-46f9-9738-33fd7b9a3161", "address": "fa:16:3e:e8:30:72", "network": {"id": "8b22a426-2945-474d-b0e6-8c22bb5e57e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-57423842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1664585-40", "ovs_interfaceid": "b1664585-4013-46f9-9738-33fd7b9a3161", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ba01b035-453b-4378-92fc-1d81b84363ff", "address": "fa:16:3e:89:cb:12", "network": {"id": "cd8ce1ca-56b3-48fa-bb57-54d0616aa7ca", "bridge": "br-int", "label": "tempest-device-tagging-net2-611360182", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba01b035-45", "ovs_interfaceid": "ba01b035-453b-4378-92fc-1d81b84363ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "248131be-39a9-430f-b27a-377d176d7846", "address": "fa:16:3e:5d:ae:b7", "network": {"id": "cd8ce1ca-56b3-48fa-bb57-54d0616aa7ca", "bridge": "br-int", "label": "tempest-device-tagging-net2-611360182", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap248131be-39", "ovs_interfaceid": "248131be-39a9-430f-b27a-377d176d7846", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:34:52 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-5144ee7d-c58c-4b61-ad5e-d632acda6046 req-8c2839e1-1736-4cc6-935d-41485754cb83 service nova] Releasing lock "refresh_cache-f1040399-0c5d-4a68-9ee0-4fbe45a42c55" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:34:52 user nova-compute[74337]: DEBUG nova.compute.manager [req-5144ee7d-c58c-4b61-ad5e-d632acda6046 req-8c2839e1-1736-4cc6-935d-41485754cb83 service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Received event network-changed-248131be-39a9-430f-b27a-377d176d7846 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:34:52 user nova-compute[74337]: DEBUG nova.compute.manager [req-5144ee7d-c58c-4b61-ad5e-d632acda6046 req-8c2839e1-1736-4cc6-935d-41485754cb83 service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Refreshing instance network info cache due to event network-changed-248131be-39a9-430f-b27a-377d176d7846. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 21:34:52 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-5144ee7d-c58c-4b61-ad5e-d632acda6046 req-8c2839e1-1736-4cc6-935d-41485754cb83 service nova] Acquiring lock "refresh_cache-f1040399-0c5d-4a68-9ee0-4fbe45a42c55" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:34:52 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-5144ee7d-c58c-4b61-ad5e-d632acda6046 req-8c2839e1-1736-4cc6-935d-41485754cb83 service nova] Acquired lock "refresh_cache-f1040399-0c5d-4a68-9ee0-4fbe45a42c55" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:34:52 user nova-compute[74337]: DEBUG nova.network.neutron [req-5144ee7d-c58c-4b61-ad5e-d632acda6046 req-8c2839e1-1736-4cc6-935d-41485754cb83 service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Refreshing network info cache for port 248131be-39a9-430f-b27a-377d176d7846 {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 21:34:52 user nova-compute[74337]: DEBUG nova.network.neutron [req-5144ee7d-c58c-4b61-ad5e-d632acda6046 req-8c2839e1-1736-4cc6-935d-41485754cb83 service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Updated VIF entry in instance network info cache for port 248131be-39a9-430f-b27a-377d176d7846. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 21:34:52 user nova-compute[74337]: DEBUG nova.network.neutron [req-5144ee7d-c58c-4b61-ad5e-d632acda6046 req-8c2839e1-1736-4cc6-935d-41485754cb83 service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Updating instance_info_cache with network_info: [{"id": "58eb51e5-3d74-4162-93b8-66bdf176c1d5", "address": "fa:16:3e:53:ba:1b", "network": {"id": "54ea29fa-daa7-4818-8d2d-c90ee9a18a95", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1215215856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58eb51e5-3d", "ovs_interfaceid": "58eb51e5-3d74-4162-93b8-66bdf176c1d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dd8e8982-b86c-469a-aa55-72bb2ac9bb8b", "address": "fa:16:3e:67:90:76", "network": {"id": "8b22a426-2945-474d-b0e6-8c22bb5e57e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-57423842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd8e8982-b8", "ovs_interfaceid": "dd8e8982-b86c-469a-aa55-72bb2ac9bb8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e91aa55a-4a71-4090-bdde-88c4a648b60b", "address": "fa:16:3e:45:60:43", "network": {"id": "8b22a426-2945-474d-b0e6-8c22bb5e57e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-57423842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape91aa55a-4a", "ovs_interfaceid": "e91aa55a-4a71-4090-bdde-88c4a648b60b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ddee6c78-417b-494f-a9e1-f662c549f425", "address": "fa:16:3e:fb:ef:75", "network": {"id": "8b22a426-2945-474d-b0e6-8c22bb5e57e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-57423842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddee6c78-41", "ovs_interfaceid": "ddee6c78-417b-494f-a9e1-f662c549f425", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b1664585-4013-46f9-9738-33fd7b9a3161", "address": "fa:16:3e:e8:30:72", "network": {"id": "8b22a426-2945-474d-b0e6-8c22bb5e57e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-57423842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1664585-40", "ovs_interfaceid": "b1664585-4013-46f9-9738-33fd7b9a3161", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ba01b035-453b-4378-92fc-1d81b84363ff", "address": "fa:16:3e:89:cb:12", "network": {"id": "cd8ce1ca-56b3-48fa-bb57-54d0616aa7ca", "bridge": "br-int", "label": "tempest-device-tagging-net2-611360182", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba01b035-45", "ovs_interfaceid": "ba01b035-453b-4378-92fc-1d81b84363ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "248131be-39a9-430f-b27a-377d176d7846", "address": "fa:16:3e:5d:ae:b7", "network": {"id": "cd8ce1ca-56b3-48fa-bb57-54d0616aa7ca", "bridge": "br-int", "label": "tempest-device-tagging-net2-611360182", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap248131be-39", "ovs_interfaceid": "248131be-39a9-430f-b27a-377d176d7846", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:34:52 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-5144ee7d-c58c-4b61-ad5e-d632acda6046 req-8c2839e1-1736-4cc6-935d-41485754cb83 service nova] Releasing lock "refresh_cache-f1040399-0c5d-4a68-9ee0-4fbe45a42c55" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:34:53 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4993-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:34:55 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-d4feb163-de3e-4434-a3b9-c2df9135ed50 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Acquiring lock "05b80b08-f66c-4cc6-b806-f25543536bfa" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:34:55 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-d4feb163-de3e-4434-a3b9-c2df9135ed50 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Lock "05b80b08-f66c-4cc6-b806-f25543536bfa" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:34:55 user nova-compute[74337]: DEBUG nova.objects.instance [None req-d4feb163-de3e-4434-a3b9-c2df9135ed50 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Lazy-loading 'flavor' on Instance uuid 05b80b08-f66c-4cc6-b806-f25543536bfa {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:34:55 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-d4feb163-de3e-4434-a3b9-c2df9135ed50 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Lock "05b80b08-f66c-4cc6-b806-f25543536bfa" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.093s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:34:56 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-d4feb163-de3e-4434-a3b9-c2df9135ed50 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Acquiring lock "05b80b08-f66c-4cc6-b806-f25543536bfa" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:34:56 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-d4feb163-de3e-4434-a3b9-c2df9135ed50 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Lock "05b80b08-f66c-4cc6-b806-f25543536bfa" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:34:56 user nova-compute[74337]: INFO nova.compute.manager [None req-d4feb163-de3e-4434-a3b9-c2df9135ed50 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] [instance: 05b80b08-f66c-4cc6-b806-f25543536bfa] Attaching volume 2d9b1af1-237a-41ee-9e09-33a3a1580336 to /dev/vdb
Oct 23 21:34:56 user nova-compute[74337]: DEBUG os_brick.utils [None req-d4feb163-de3e-4434-a3b9-c2df9135ed50 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:34:56 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:34:56 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:34:56 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c805c1-56e8-4137-8ab7-a66b59f7000d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f34011b66e40\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:34:56 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:34:56 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:34:56 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a43bcaa-9bee-47e4-90f3-45ce5f52d0c0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:34:56 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:34:56 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:34:56 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a391d375-f77c-4dc8-8421-b88ca71394bd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:34:56 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd17855b-121d-4800-9ed5-57ec9ea4bb34]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:34:56 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-d4feb163-de3e-4434-a3b9-c2df9135ed50 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Running cmd (subprocess): nvme version {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:34:56 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-d4feb163-de3e-4434-a3b9-c2df9135ed50 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] 'nvme version' failed. Not Retrying. {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 21:34:56 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d4feb163-de3e-4434-a3b9-c2df9135ed50 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] nvme not present on system {{(pid=74337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 21:34:56 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:34:56 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 21:34:56 user nova-compute[74337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 21:34:56 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[f365cbc1-25fc-4948-8034-2e58e685fe1a]: (4, '') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:34:56 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-d4feb163-de3e-4434-a3b9-c2df9135ed50 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 21:34:56 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-d4feb163-de3e-4434-a3b9-c2df9135ed50 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 21:34:56 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-d4feb163-de3e-4434-a3b9-c2df9135ed50 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] LIGHTOS: no hostnqn found. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 21:34:56 user nova-compute[74337]: DEBUG os_brick.utils [None req-d4feb163-de3e-4434-a3b9-c2df9135ed50 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f34011b66e40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:34:56 user nova-compute[74337]: DEBUG nova.virt.block_device [None req-d4feb163-de3e-4434-a3b9-c2df9135ed50 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] [instance: 05b80b08-f66c-4cc6-b806-f25543536bfa] Updating existing volume attachment record: ac46dc40-f9f9-44a4-8606-745bbbbbc5f8 {{(pid=74337) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 21:34:56 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Acquiring lock "04c02325-7ce4-45c2-819b-c656e93c96ca" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:34:56 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Lock "04c02325-7ce4-45c2-819b-c656e93c96ca" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:34:56 user nova-compute[74337]: DEBUG nova.compute.manager [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Starting instance... {{(pid=74337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 21:34:56 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:34:56 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:34:56 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 21:34:56 user nova-compute[74337]: INFO nova.compute.claims [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Claim successful on node user
Oct 23 21:34:57 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:34:57 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:34:57 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.475s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:34:57 user nova-compute[74337]: DEBUG nova.compute.manager [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Start building networks asynchronously for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 21:34:57 user nova-compute[74337]: DEBUG nova.compute.manager [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Allocating IP information in the background. {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 21:34:57 user nova-compute[74337]: DEBUG nova.network.neutron [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] allocate_for_instance() {{(pid=74337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 21:34:57 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 21:34:57 user nova-compute[74337]: DEBUG nova.compute.manager [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Start building block device mappings for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 21:34:57 user nova-compute[74337]: INFO nova.virt.block_device [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Booting with volume 64864579-6ad1-4796-a620-c2c1ee8a702a at /dev/vda
Oct 23 21:34:57 user nova-compute[74337]: DEBUG os_brick.utils [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:34:57 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:34:57 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:34:57 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[467a6e61-4607-4055-9fa7-39b83657e1b9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f34011b66e40\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:34:57 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:34:57 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:34:57 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[f93a4ab7-0284-47d7-ad2e-f90e35fd311a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:34:57 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:34:57 user nova-compute[74337]: DEBUG nova.policy [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fdc4cfd43887413eabd86770e724e2b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b2b924f3a4461ba09eb54ee42f4649', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74337) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 21:34:57 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:34:57 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd6a17e-7df5-44f5-904f-be43cbfaae5a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:34:57 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b092650-c10d-4fc2-8e84-748566b693b5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:34:57 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Running cmd (subprocess): nvme version {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:34:57 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] 'nvme version' failed. Not Retrying. {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 21:34:57 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] nvme not present on system {{(pid=74337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 21:34:57 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:34:57 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 21:34:57 user nova-compute[74337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 21:34:57 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ea80462-c9d1-4875-8e4e-3fd054d3236b]: (4, '') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:34:57 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 21:34:57 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 21:34:57 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] LIGHTOS: no hostnqn found. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 21:34:57 user nova-compute[74337]: DEBUG os_brick.utils [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] <== get_connector_properties: return (107ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f34011b66e40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:34:57 user nova-compute[74337]: DEBUG nova.virt.block_device [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Updating existing volume attachment record: 283cdf3d-98ed-40e0-a2b8-bb1f31c06239 {{(pid=74337) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 21:34:58 user nova-compute[74337]: DEBUG nova.network.neutron [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Successfully created port: 2ea512c9-8ab6-49a3-9f77-14bcd380f8e8 {{(pid=74337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 21:34:58 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:34:58 user nova-compute[74337]: DEBUG nova.compute.manager [req-96bcdecb-3565-4c52-b0d7-24f458d5dff8 req-8ce47d2c-fba7-4632-8387-2076ddd57c6c service nova] [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89] Received event network-changed-d6e114a4-cf61-4a19-bb3d-e0bcbfc5f5e5 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:34:58 user nova-compute[74337]: DEBUG nova.compute.manager [req-96bcdecb-3565-4c52-b0d7-24f458d5dff8 req-8ce47d2c-fba7-4632-8387-2076ddd57c6c service nova] [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89] Refreshing instance network info cache due to event network-changed-d6e114a4-cf61-4a19-bb3d-e0bcbfc5f5e5. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 21:34:58 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-96bcdecb-3565-4c52-b0d7-24f458d5dff8 req-8ce47d2c-fba7-4632-8387-2076ddd57c6c service nova] Acquiring lock "refresh_cache-cf6270ba-7a4e-40c4-b7fd-c62a44125c89" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:34:58 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-96bcdecb-3565-4c52-b0d7-24f458d5dff8 req-8ce47d2c-fba7-4632-8387-2076ddd57c6c service nova] Acquired lock "refresh_cache-cf6270ba-7a4e-40c4-b7fd-c62a44125c89" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:34:58 user nova-compute[74337]: DEBUG nova.network.neutron [req-96bcdecb-3565-4c52-b0d7-24f458d5dff8 req-8ce47d2c-fba7-4632-8387-2076ddd57c6c service nova] [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89] Refreshing network info cache for port d6e114a4-cf61-4a19-bb3d-e0bcbfc5f5e5 {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 21:34:58 user nova-compute[74337]: DEBUG nova.network.neutron [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Successfully created port: 4da5a263-b3c7-49ba-b2e1-d54cbb5f0f0e {{(pid=74337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 21:34:59 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:34:59 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:34:59 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Starting heal instance info cache {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 21:34:59 user nova-compute[74337]: DEBUG nova.network.neutron [req-96bcdecb-3565-4c52-b0d7-24f458d5dff8 req-8ce47d2c-fba7-4632-8387-2076ddd57c6c service nova] [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89] Updated VIF entry in instance network info cache for port d6e114a4-cf61-4a19-bb3d-e0bcbfc5f5e5. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 21:34:59 user nova-compute[74337]: DEBUG nova.network.neutron [req-96bcdecb-3565-4c52-b0d7-24f458d5dff8 req-8ce47d2c-fba7-4632-8387-2076ddd57c6c service nova] [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89] Updating instance_info_cache with network_info: [{"id": "d6e114a4-cf61-4a19-bb3d-e0bcbfc5f5e5", "address": "fa:16:3e:8b:08:80", "network": {"id": "94117ecb-54bb-40a0-b3dc-d21eac6c8f7b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1530803655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2877cbc901948b68f6f8c588f29d89c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6e114a4-cf", "ovs_interfaceid": "d6e114a4-cf61-4a19-bb3d-e0bcbfc5f5e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:34:59 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-96bcdecb-3565-4c52-b0d7-24f458d5dff8 req-8ce47d2c-fba7-4632-8387-2076ddd57c6c service nova] Releasing lock "refresh_cache-cf6270ba-7a4e-40c4-b7fd-c62a44125c89" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:34:59 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "refresh_cache-cf6270ba-7a4e-40c4-b7fd-c62a44125c89" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:34:59 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquired lock "refresh_cache-cf6270ba-7a4e-40c4-b7fd-c62a44125c89" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:34:59 user nova-compute[74337]: DEBUG nova.network.neutron [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89] Forcefully refreshing network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 21:34:59 user nova-compute[74337]: DEBUG nova.network.neutron [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Successfully created port: d35e88b3-1ad6-42dc-9b9f-281cb0e99dc8 {{(pid=74337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 21:35:00 user nova-compute[74337]: DEBUG nova.network.neutron [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89] Updating instance_info_cache with network_info: [{"id": "d6e114a4-cf61-4a19-bb3d-e0bcbfc5f5e5", "address": "fa:16:3e:8b:08:80", "network": {"id": "94117ecb-54bb-40a0-b3dc-d21eac6c8f7b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1530803655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2877cbc901948b68f6f8c588f29d89c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6e114a4-cf", "ovs_interfaceid": "d6e114a4-cf61-4a19-bb3d-e0bcbfc5f5e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:35:00 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Releasing lock "refresh_cache-cf6270ba-7a4e-40c4-b7fd-c62a44125c89" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:35:00 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89] Updated the network info_cache for instance {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 21:35:00 user nova-compute[74337]: DEBUG nova.compute.manager [None req-287bb66c-8595-4e0c-b64f-c271dc84d359 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89] Checking state {{(pid=74337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 21:35:00 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:35:00 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:35:00 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:35:00 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:35:00 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:35:00 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:35:00 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 21:35:00 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:35:00 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:35:00 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:35:00 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:35:00 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Auditing locally available compute resources for user (node: user) {{(pid=74337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 21:35:00 user nova-compute[74337]: DEBUG nova.network.neutron [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Successfully created port: 78d439bc-58eb-4984-86f7-e9610cd8c17f {{(pid=74337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 21:35:00 user nova-compute[74337]: INFO nova.compute.manager [None req-287bb66c-8595-4e0c-b64f-c271dc84d359 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89] instance snapshotting
Oct 23 21:35:00 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-287bb66c-8595-4e0c-b64f-c271dc84d359 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89] Beginning live snapshot process
Oct 23 21:35:00 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a181593-8086-4ece-9f5b-5ccba0bfe91e/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:00 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-287bb66c-8595-4e0c-b64f-c271dc84d359 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf6270ba-7a4e-40c4-b7fd-c62a44125c89/disk --force-share --output=json -f qcow2 {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:00 user nova-compute[74337]: DEBUG nova.compute.manager [req-a1f2465c-b56a-4692-a58c-a344c3db95c3 req-4ca90a58-9082-468b-9263-21c65cd068d8 service nova] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Received event network-changed-872b2a23-8054-4d26-b798-c0099d1c9a91 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:35:00 user nova-compute[74337]: DEBUG nova.compute.manager [req-a1f2465c-b56a-4692-a58c-a344c3db95c3 req-4ca90a58-9082-468b-9263-21c65cd068d8 service nova] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Refreshing instance network info cache due to event network-changed-872b2a23-8054-4d26-b798-c0099d1c9a91. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 21:35:00 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-a1f2465c-b56a-4692-a58c-a344c3db95c3 req-4ca90a58-9082-468b-9263-21c65cd068d8 service nova] Acquiring lock "refresh_cache-d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:35:00 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-a1f2465c-b56a-4692-a58c-a344c3db95c3 req-4ca90a58-9082-468b-9263-21c65cd068d8 service nova] Acquired lock "refresh_cache-d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:35:00 user nova-compute[74337]: DEBUG nova.network.neutron [req-a1f2465c-b56a-4692-a58c-a344c3db95c3 req-4ca90a58-9082-468b-9263-21c65cd068d8 service nova] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Refreshing network info cache for port 872b2a23-8054-4d26-b798-c0099d1c9a91 {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 21:35:00 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a181593-8086-4ece-9f5b-5ccba0bfe91e/disk --force-share --output=json" returned: 0 in 0.295s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:00 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a181593-8086-4ece-9f5b-5ccba0bfe91e/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:00 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-287bb66c-8595-4e0c-b64f-c271dc84d359 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf6270ba-7a4e-40c4-b7fd-c62a44125c89/disk --force-share --output=json -f qcow2" returned: 0 in 0.200s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:00 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-287bb66c-8595-4e0c-b64f-c271dc84d359 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf6270ba-7a4e-40c4-b7fd-c62a44125c89/disk --force-share --output=json -f qcow2 {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:01 user nova-compute[74337]: DEBUG nova.network.neutron [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Successfully created port: 870087f8-5e43-4e98-a6ab-b65529f9fa6b {{(pid=74337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 21:35:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a181593-8086-4ece-9f5b-5ccba0bfe91e/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8acc1b10-a541-4c06-aeb7-1ecf7a2457be/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-287bb66c-8595-4e0c-b64f-c271dc84d359 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf6270ba-7a4e-40c4-b7fd-c62a44125c89/disk --force-share --output=json -f qcow2" returned: 0 in 0.231s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-287bb66c-8595-4e0c-b64f-c271dc84d359 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8acc1b10-a541-4c06-aeb7-1ecf7a2457be/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8acc1b10-a541-4c06-aeb7-1ecf7a2457be/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-287bb66c-8595-4e0c-b64f-c271dc84d359 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.216s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-287bb66c-8595-4e0c-b64f-c271dc84d359 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpr5rxlg3_/f83075aa2b094ff68806135beaf5290d.delta 1073741824 {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-287bb66c-8595-4e0c-b64f-c271dc84d359 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpr5rxlg3_/f83075aa2b094ff68806135beaf5290d.delta 1073741824" returned: 0 in 0.063s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:01 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-287bb66c-8595-4e0c-b64f-c271dc84d359 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 23 21:35:01 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-287bb66c-8595-4e0c-b64f-c271dc84d359 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] Checking UEFI support for host arch (x86_64) {{(pid=74337) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Oct 23 21:35:01 user nova-compute[74337]: INFO nova.virt.libvirt.host [None req-287bb66c-8595-4e0c-b64f-c271dc84d359 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] UEFI support detected
Oct 23 21:35:01 user nova-compute[74337]: DEBUG nova.network.neutron [req-a1f2465c-b56a-4692-a58c-a344c3db95c3 req-4ca90a58-9082-468b-9263-21c65cd068d8 service nova] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Updated VIF entry in instance network info cache for port 872b2a23-8054-4d26-b798-c0099d1c9a91. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 21:35:01 user nova-compute[74337]: DEBUG nova.network.neutron [req-a1f2465c-b56a-4692-a58c-a344c3db95c3 req-4ca90a58-9082-468b-9263-21c65cd068d8 service nova] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Updating instance_info_cache with network_info: [{"id": "872b2a23-8054-4d26-b798-c0099d1c9a91", "address": "fa:16:3e:30:a6:90", "network": {"id": "b6a24032-0229-4ebe-83a3-8804e494838c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1472404179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17117e60d0d9484d80c0bc8de393921c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap872b2a23-80", "ovs_interfaceid": "872b2a23-8054-4d26-b798-c0099d1c9a91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:35:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8acc1b10-a541-4c06-aeb7-1ecf7a2457be/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:01 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-a1f2465c-b56a-4692-a58c-a344c3db95c3 req-4ca90a58-9082-468b-9263-21c65cd068d8 service nova] Releasing lock "refresh_cache-d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:35:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d45e8ae8-371b-46ae-849d-d7f7d5bbd770/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d45e8ae8-371b-46ae-849d-d7f7d5bbd770/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d45e8ae8-371b-46ae-849d-d7f7d5bbd770/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:01 user nova-compute[74337]: DEBUG nova.network.neutron [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Successfully updated port: 2ea512c9-8ab6-49a3-9f77-14bcd380f8e8 {{(pid=74337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 21:35:01 user nova-compute[74337]: DEBUG nova.compute.manager [req-a5a12341-5545-47cb-a375-4d48936d2a73 req-b11768af-7f81-4dc9-aada-00267d6a833b service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Received event network-changed-2ea512c9-8ab6-49a3-9f77-14bcd380f8e8 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:35:01 user nova-compute[74337]: DEBUG nova.compute.manager [req-a5a12341-5545-47cb-a375-4d48936d2a73 req-b11768af-7f81-4dc9-aada-00267d6a833b service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Refreshing instance network info cache due to event network-changed-2ea512c9-8ab6-49a3-9f77-14bcd380f8e8. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 21:35:01 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-a5a12341-5545-47cb-a375-4d48936d2a73 req-b11768af-7f81-4dc9-aada-00267d6a833b service nova] Acquiring lock "refresh_cache-04c02325-7ce4-45c2-819b-c656e93c96ca" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:35:01 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-a5a12341-5545-47cb-a375-4d48936d2a73 req-b11768af-7f81-4dc9-aada-00267d6a833b service nova] Acquired lock "refresh_cache-04c02325-7ce4-45c2-819b-c656e93c96ca" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:35:01 user nova-compute[74337]: DEBUG nova.network.neutron [req-a5a12341-5545-47cb-a375-4d48936d2a73 req-b11768af-7f81-4dc9-aada-00267d6a833b service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Refreshing network info cache for port 2ea512c9-8ab6-49a3-9f77-14bcd380f8e8 {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 21:35:01 user nova-compute[74337]: INFO nova.virt.block_device [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Booting with volume b9f5f7ce-c27e-4cf5-9da5-704ff383354b at /dev/vdb
Oct 23 21:35:01 user nova-compute[74337]: DEBUG nova.network.neutron [req-a5a12341-5545-47cb-a375-4d48936d2a73 req-b11768af-7f81-4dc9-aada-00267d6a833b service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Instance cache missing network info. {{(pid=74337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 21:35:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d45e8ae8-371b-46ae-849d-d7f7d5bbd770/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05b80b08-f66c-4cc6-b806-f25543536bfa/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:02 user nova-compute[74337]: DEBUG os_brick.utils [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:35:02 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:02 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:02 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a73f4a-fe19-438e-bdea-e220f9c52ea9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f34011b66e40\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:02 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:02 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:02 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[727d85b0-e943-4007-8698-d1683e82576f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:02 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:02 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:02 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8114ef9-cf63-4893-ab37-e0e650bc55ed]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:02 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e885c6b9-8bdf-4a5d-9e44-25fc6570d323]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:02 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Running cmd (subprocess): nvme version {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:02 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] 'nvme version' failed. Not Retrying. {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 21:35:02 user nova-compute[74337]: DEBUG nova.network.neutron [req-a5a12341-5545-47cb-a375-4d48936d2a73 req-b11768af-7f81-4dc9-aada-00267d6a833b service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Updating instance_info_cache with network_info: [] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:35:02 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] nvme not present on system {{(pid=74337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 21:35:02 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:02 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-a5a12341-5545-47cb-a375-4d48936d2a73 req-b11768af-7f81-4dc9-aada-00267d6a833b service nova] Releasing lock "refresh_cache-04c02325-7ce4-45c2-819b-c656e93c96ca" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:35:02 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 21:35:02 user nova-compute[74337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 21:35:02 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7a12b3e-1ce0-44ae-a171-d08f3dd7ef8c]: (4, '') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:02 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 21:35:02 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 21:35:02 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] LIGHTOS: no hostnqn found. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 21:35:02 user nova-compute[74337]: DEBUG os_brick.utils [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f34011b66e40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:35:02 user nova-compute[74337]: DEBUG nova.virt.block_device [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Updating existing volume attachment record: da83b846-0a87-4920-8bfc-40a3675a9d51 {{(pid=74337) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 21:35:02 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05b80b08-f66c-4cc6-b806-f25543536bfa/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:02 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05b80b08-f66c-4cc6-b806-f25543536bfa/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:02 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-287bb66c-8595-4e0c-b64f-c271dc84d359 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74337) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 21:35:02 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05b80b08-f66c-4cc6-b806-f25543536bfa/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:02 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:02 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:02 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:02 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:02 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:02 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4bf4723-1e3c-42f1-a422-9d9263b67e3d/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:02 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-287bb66c-8595-4e0c-b64f-c271dc84d359 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74337) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 21:35:02 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-287bb66c-8595-4e0c-b64f-c271dc84d359 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 23 21:35:02 user nova-compute[74337]: DEBUG nova.network.neutron [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Successfully updated port: 2727b3bf-35e4-485a-b44b-66406b7d1597 {{(pid=74337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 21:35:02 user nova-compute[74337]: DEBUG nova.privsep.utils [None req-287bb66c-8595-4e0c-b64f-c271dc84d359 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74337) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 23 21:35:02 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-287bb66c-8595-4e0c-b64f-c271dc84d359 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpr5rxlg3_/f83075aa2b094ff68806135beaf5290d.delta /opt/stack/data/nova/instances/snapshots/tmpr5rxlg3_/f83075aa2b094ff68806135beaf5290d {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:03 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4bf4723-1e3c-42f1-a422-9d9263b67e3d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:03 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4bf4723-1e3c-42f1-a422-9d9263b67e3d/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:03 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4bf4723-1e3c-42f1-a422-9d9263b67e3d/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:03 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf6270ba-7a4e-40c4-b7fd-c62a44125c89/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:03 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:03 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf6270ba-7a4e-40c4-b7fd-c62a44125c89/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:03 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf6270ba-7a4e-40c4-b7fd-c62a44125c89/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:03 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-287bb66c-8595-4e0c-b64f-c271dc84d359 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpr5rxlg3_/f83075aa2b094ff68806135beaf5290d.delta /opt/stack/data/nova/instances/snapshots/tmpr5rxlg3_/f83075aa2b094ff68806135beaf5290d" returned: 0 in 0.590s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:03 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-287bb66c-8595-4e0c-b64f-c271dc84d359 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89] Snapshot extracted, beginning image upload
Oct 23 21:35:03 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf6270ba-7a4e-40c4-b7fd-c62a44125c89/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:03 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2075057e-81db-424a-bb20-662d77faafed/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:03 user nova-compute[74337]: DEBUG nova.network.neutron [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Successfully updated port: 9141d0eb-5e49-4a83-993f-3eac6a526dfd {{(pid=74337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 21:35:03 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2075057e-81db-424a-bb20-662d77faafed/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:03 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2075057e-81db-424a-bb20-662d77faafed/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:03 user nova-compute[74337]: DEBUG nova.compute.manager [req-6aaf4918-24bd-4616-b010-a2e017430a83 req-bd9ba776-3fd6-43e2-ac30-75c1b0bfd31b service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Received event network-changed-2727b3bf-35e4-485a-b44b-66406b7d1597 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:35:03 user nova-compute[74337]: DEBUG nova.compute.manager [req-6aaf4918-24bd-4616-b010-a2e017430a83 req-bd9ba776-3fd6-43e2-ac30-75c1b0bfd31b service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Refreshing instance network info cache due to event network-changed-2727b3bf-35e4-485a-b44b-66406b7d1597. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 21:35:03 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-6aaf4918-24bd-4616-b010-a2e017430a83 req-bd9ba776-3fd6-43e2-ac30-75c1b0bfd31b service nova] Acquiring lock "refresh_cache-04c02325-7ce4-45c2-819b-c656e93c96ca" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:35:03 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-6aaf4918-24bd-4616-b010-a2e017430a83 req-bd9ba776-3fd6-43e2-ac30-75c1b0bfd31b service nova] Acquired lock "refresh_cache-04c02325-7ce4-45c2-819b-c656e93c96ca" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:35:03 user nova-compute[74337]: DEBUG nova.network.neutron [req-6aaf4918-24bd-4616-b010-a2e017430a83 req-bd9ba776-3fd6-43e2-ac30-75c1b0bfd31b service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Refreshing network info cache for port 2727b3bf-35e4-485a-b44b-66406b7d1597 {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 21:35:04 user nova-compute[74337]: DEBUG nova.network.neutron [req-6aaf4918-24bd-4616-b010-a2e017430a83 req-bd9ba776-3fd6-43e2-ac30-75c1b0bfd31b service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Instance cache missing network info. {{(pid=74337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 21:35:04 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2075057e-81db-424a-bb20-662d77faafed/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:04 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff1c790c-2458-438e-95c7-7e1412fe05fc/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:04 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff1c790c-2458-438e-95c7-7e1412fe05fc/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:04 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff1c790c-2458-438e-95c7-7e1412fe05fc/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:04 user nova-compute[74337]: DEBUG nova.network.neutron [req-6aaf4918-24bd-4616-b010-a2e017430a83 req-bd9ba776-3fd6-43e2-ac30-75c1b0bfd31b service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Updating instance_info_cache with network_info: [] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:35:04 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-6aaf4918-24bd-4616-b010-a2e017430a83 req-bd9ba776-3fd6-43e2-ac30-75c1b0bfd31b service nova] Releasing lock "refresh_cache-04c02325-7ce4-45c2-819b-c656e93c96ca" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:35:04 user nova-compute[74337]: DEBUG nova.compute.manager [req-6aaf4918-24bd-4616-b010-a2e017430a83 req-bd9ba776-3fd6-43e2-ac30-75c1b0bfd31b service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Received event network-changed-9141d0eb-5e49-4a83-993f-3eac6a526dfd {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:35:04 user nova-compute[74337]: DEBUG nova.compute.manager [req-6aaf4918-24bd-4616-b010-a2e017430a83 req-bd9ba776-3fd6-43e2-ac30-75c1b0bfd31b service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Refreshing instance network info cache due to event network-changed-9141d0eb-5e49-4a83-993f-3eac6a526dfd. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 21:35:04 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-6aaf4918-24bd-4616-b010-a2e017430a83 req-bd9ba776-3fd6-43e2-ac30-75c1b0bfd31b service nova] Acquiring lock "refresh_cache-04c02325-7ce4-45c2-819b-c656e93c96ca" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:35:04 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-6aaf4918-24bd-4616-b010-a2e017430a83 req-bd9ba776-3fd6-43e2-ac30-75c1b0bfd31b service nova] Acquired lock "refresh_cache-04c02325-7ce4-45c2-819b-c656e93c96ca" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:35:04 user nova-compute[74337]: DEBUG nova.network.neutron [req-6aaf4918-24bd-4616-b010-a2e017430a83 req-bd9ba776-3fd6-43e2-ac30-75c1b0bfd31b service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Refreshing network info cache for port 9141d0eb-5e49-4a83-993f-3eac6a526dfd {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 21:35:04 user nova-compute[74337]: DEBUG nova.network.neutron [req-6aaf4918-24bd-4616-b010-a2e017430a83 req-bd9ba776-3fd6-43e2-ac30-75c1b0bfd31b service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Instance cache missing network info. {{(pid=74337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 21:35:04 user nova-compute[74337]: DEBUG nova.network.neutron [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Successfully updated port: 4da5a263-b3c7-49ba-b2e1-d54cbb5f0f0e {{(pid=74337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 21:35:04 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff1c790c-2458-438e-95c7-7e1412fe05fc/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:04 user nova-compute[74337]: DEBUG nova.network.neutron [req-6aaf4918-24bd-4616-b010-a2e017430a83 req-bd9ba776-3fd6-43e2-ac30-75c1b0bfd31b service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Updating instance_info_cache with network_info: [] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:35:04 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:35:04 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:35:04 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Hypervisor/Node resource view: name=user free_ram=7195MB free_disk=25.595478057861328GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 21:35:04 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:35:04 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:35:04 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-6aaf4918-24bd-4616-b010-a2e017430a83 req-bd9ba776-3fd6-43e2-ac30-75c1b0bfd31b service nova] Releasing lock "refresh_cache-04c02325-7ce4-45c2-819b-c656e93c96ca" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:35:05 user nova-compute[74337]: DEBUG nova.network.neutron [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Successfully updated port: d35e88b3-1ad6-42dc-9b9f-281cb0e99dc8 {{(pid=74337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 21:35:05 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 05b80b08-f66c-4cc6-b806-f25543536bfa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:35:05 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance cf6270ba-7a4e-40c4-b7fd-c62a44125c89 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:35:05 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:35:05 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance d45e8ae8-371b-46ae-849d-d7f7d5bbd770 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:35:05 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 8acc1b10-a541-4c06-aeb7-1ecf7a2457be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:35:05 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance ff1c790c-2458-438e-95c7-7e1412fe05fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:35:05 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 5a181593-8086-4ece-9f5b-5ccba0bfe91e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:35:05 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance a4bf4723-1e3c-42f1-a422-9d9263b67e3d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:35:05 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 2075057e-81db-424a-bb20-662d77faafed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:35:05 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance f1040399-0c5d-4a68-9ee0-4fbe45a42c55 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:35:05 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 04c02325-7ce4-45c2-819b-c656e93c96ca actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:35:05 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 21:35:05 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 21:35:05 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:35:05 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:35:05 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Compute_service record updated for user:user {{(pid=74337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 21:35:05 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.623s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:35:05 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:35:05 user nova-compute[74337]: DEBUG nova.network.neutron [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Successfully updated port: 78d439bc-58eb-4984-86f7-e9610cd8c17f {{(pid=74337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 21:35:05 user nova-compute[74337]: DEBUG nova.compute.manager [req-01aa0285-c897-4751-a983-17e7f9fb07c5 req-e818002d-a6c2-4b9a-8007-da0ca8d387db service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Received event network-changed-4da5a263-b3c7-49ba-b2e1-d54cbb5f0f0e {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:35:05 user nova-compute[74337]: DEBUG nova.compute.manager [req-01aa0285-c897-4751-a983-17e7f9fb07c5 req-e818002d-a6c2-4b9a-8007-da0ca8d387db service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Refreshing instance network info cache due to event network-changed-4da5a263-b3c7-49ba-b2e1-d54cbb5f0f0e. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 21:35:05 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-01aa0285-c897-4751-a983-17e7f9fb07c5 req-e818002d-a6c2-4b9a-8007-da0ca8d387db service nova] Acquiring lock "refresh_cache-04c02325-7ce4-45c2-819b-c656e93c96ca" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:35:05 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-01aa0285-c897-4751-a983-17e7f9fb07c5 req-e818002d-a6c2-4b9a-8007-da0ca8d387db service nova] Acquired lock "refresh_cache-04c02325-7ce4-45c2-819b-c656e93c96ca" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:35:05 user nova-compute[74337]: DEBUG nova.network.neutron [req-01aa0285-c897-4751-a983-17e7f9fb07c5 req-e818002d-a6c2-4b9a-8007-da0ca8d387db service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Refreshing network info cache for port 4da5a263-b3c7-49ba-b2e1-d54cbb5f0f0e {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 21:35:06 user nova-compute[74337]: DEBUG nova.network.neutron [req-01aa0285-c897-4751-a983-17e7f9fb07c5 req-e818002d-a6c2-4b9a-8007-da0ca8d387db service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Instance cache missing network info. {{(pid=74337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 21:35:06 user nova-compute[74337]: DEBUG nova.network.neutron [req-01aa0285-c897-4751-a983-17e7f9fb07c5 req-e818002d-a6c2-4b9a-8007-da0ca8d387db service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Updating instance_info_cache with network_info: [] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:35:06 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-01aa0285-c897-4751-a983-17e7f9fb07c5 req-e818002d-a6c2-4b9a-8007-da0ca8d387db service nova] Releasing lock "refresh_cache-04c02325-7ce4-45c2-819b-c656e93c96ca" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:35:06 user nova-compute[74337]: DEBUG nova.compute.manager [req-01aa0285-c897-4751-a983-17e7f9fb07c5 req-e818002d-a6c2-4b9a-8007-da0ca8d387db service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Received event network-changed-d35e88b3-1ad6-42dc-9b9f-281cb0e99dc8 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:35:06 user nova-compute[74337]: DEBUG nova.compute.manager [req-01aa0285-c897-4751-a983-17e7f9fb07c5 req-e818002d-a6c2-4b9a-8007-da0ca8d387db service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Refreshing instance network info cache due to event network-changed-d35e88b3-1ad6-42dc-9b9f-281cb0e99dc8. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 21:35:06 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-01aa0285-c897-4751-a983-17e7f9fb07c5 req-e818002d-a6c2-4b9a-8007-da0ca8d387db service nova] Acquiring lock "refresh_cache-04c02325-7ce4-45c2-819b-c656e93c96ca" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:35:06 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-01aa0285-c897-4751-a983-17e7f9fb07c5 req-e818002d-a6c2-4b9a-8007-da0ca8d387db service nova] Acquired lock "refresh_cache-04c02325-7ce4-45c2-819b-c656e93c96ca" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:35:06 user nova-compute[74337]: DEBUG nova.network.neutron [req-01aa0285-c897-4751-a983-17e7f9fb07c5 req-e818002d-a6c2-4b9a-8007-da0ca8d387db service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Refreshing network info cache for port d35e88b3-1ad6-42dc-9b9f-281cb0e99dc8 {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 21:35:06 user nova-compute[74337]: DEBUG nova.network.neutron [req-01aa0285-c897-4751-a983-17e7f9fb07c5 req-e818002d-a6c2-4b9a-8007-da0ca8d387db service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Instance cache missing network info. {{(pid=74337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 21:35:06 user nova-compute[74337]: DEBUG nova.network.neutron [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Successfully updated port: 870087f8-5e43-4e98-a6ab-b65529f9fa6b {{(pid=74337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 21:35:06 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Acquiring lock "refresh_cache-04c02325-7ce4-45c2-819b-c656e93c96ca" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:35:06 user nova-compute[74337]: DEBUG nova.network.neutron [req-01aa0285-c897-4751-a983-17e7f9fb07c5 req-e818002d-a6c2-4b9a-8007-da0ca8d387db service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Updating instance_info_cache with network_info: [] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:35:06 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-01aa0285-c897-4751-a983-17e7f9fb07c5 req-e818002d-a6c2-4b9a-8007-da0ca8d387db service nova] Releasing lock "refresh_cache-04c02325-7ce4-45c2-819b-c656e93c96ca" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:35:06 user nova-compute[74337]: DEBUG nova.compute.manager [req-01aa0285-c897-4751-a983-17e7f9fb07c5 req-e818002d-a6c2-4b9a-8007-da0ca8d387db service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Received event network-changed-78d439bc-58eb-4984-86f7-e9610cd8c17f {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:35:06 user nova-compute[74337]: DEBUG nova.compute.manager [req-01aa0285-c897-4751-a983-17e7f9fb07c5 req-e818002d-a6c2-4b9a-8007-da0ca8d387db service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Refreshing instance network info cache due to event network-changed-78d439bc-58eb-4984-86f7-e9610cd8c17f. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 21:35:06 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-01aa0285-c897-4751-a983-17e7f9fb07c5 req-e818002d-a6c2-4b9a-8007-da0ca8d387db service nova] Acquiring lock "refresh_cache-04c02325-7ce4-45c2-819b-c656e93c96ca" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:35:06 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-01aa0285-c897-4751-a983-17e7f9fb07c5 req-e818002d-a6c2-4b9a-8007-da0ca8d387db service nova] Acquired lock "refresh_cache-04c02325-7ce4-45c2-819b-c656e93c96ca" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:35:06 user nova-compute[74337]: DEBUG nova.network.neutron [req-01aa0285-c897-4751-a983-17e7f9fb07c5 req-e818002d-a6c2-4b9a-8007-da0ca8d387db service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Refreshing network info cache for port 78d439bc-58eb-4984-86f7-e9610cd8c17f {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 21:35:06 user nova-compute[74337]: DEBUG nova.network.neutron [req-01aa0285-c897-4751-a983-17e7f9fb07c5 req-e818002d-a6c2-4b9a-8007-da0ca8d387db service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Instance cache missing network info. {{(pid=74337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 21:35:06 user nova-compute[74337]: DEBUG nova.network.neutron [req-01aa0285-c897-4751-a983-17e7f9fb07c5 req-e818002d-a6c2-4b9a-8007-da0ca8d387db service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Updating instance_info_cache with network_info: [] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:35:06 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-01aa0285-c897-4751-a983-17e7f9fb07c5 req-e818002d-a6c2-4b9a-8007-da0ca8d387db service nova] Releasing lock "refresh_cache-04c02325-7ce4-45c2-819b-c656e93c96ca" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:35:06 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Acquired lock "refresh_cache-04c02325-7ce4-45c2-819b-c656e93c96ca" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:35:06 user nova-compute[74337]: DEBUG nova.network.neutron [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Building network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 21:35:06 user nova-compute[74337]: DEBUG nova.network.neutron [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Instance cache missing network info. {{(pid=74337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 21:35:06 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-287bb66c-8595-4e0c-b64f-c271dc84d359 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89] Snapshot image upload complete
Oct 23 21:35:06 user nova-compute[74337]: INFO nova.compute.manager [None req-287bb66c-8595-4e0c-b64f-c271dc84d359 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89] Took 6.54 seconds to snapshot the instance on the hypervisor.
Oct 23 21:35:07 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:08 user nova-compute[74337]: DEBUG nova.compute.manager [req-b77efff5-686a-4b6c-8ad5-e166a37a38e4 req-3d24be41-47fc-460c-8ba9-7f95e387b676 service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Received event network-changed-870087f8-5e43-4e98-a6ab-b65529f9fa6b {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:35:08 user nova-compute[74337]: DEBUG nova.compute.manager [req-b77efff5-686a-4b6c-8ad5-e166a37a38e4 req-3d24be41-47fc-460c-8ba9-7f95e387b676 service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Refreshing instance network info cache due to event network-changed-870087f8-5e43-4e98-a6ab-b65529f9fa6b. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 21:35:08 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-b77efff5-686a-4b6c-8ad5-e166a37a38e4 req-3d24be41-47fc-460c-8ba9-7f95e387b676 service nova] Acquiring lock "refresh_cache-04c02325-7ce4-45c2-819b-c656e93c96ca" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:35:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:08 user nova-compute[74337]: DEBUG nova.network.neutron [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Updating instance_info_cache with network_info: [{"id": "2ea512c9-8ab6-49a3-9f77-14bcd380f8e8", "address": "fa:16:3e:75:d8:7f", "network": {"id": "e5fd79cb-72f1-4d32-a604-b9518e375fcd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-840255736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46b2b924f3a4461ba09eb54ee42f4649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ea512c9-8a", "ovs_interfaceid": "2ea512c9-8ab6-49a3-9f77-14bcd380f8e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2727b3bf-35e4-485a-b44b-66406b7d1597", "address": "fa:16:3e:e2:6e:58", "network": {"id": "8a3d7452-cadc-4728-a772-801d6a5c4770", "bridge": "br-int", "label": "tempest-device-tagging-net1-560176148", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46b2b924f3a4461ba09eb54ee42f4649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2727b3bf-35", "ovs_interfaceid": "2727b3bf-35e4-485a-b44b-66406b7d1597", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9141d0eb-5e49-4a83-993f-3eac6a526dfd", "address": "fa:16:3e:1f:61:c0", "network": {"id": "8a3d7452-cadc-4728-a772-801d6a5c4770", "bridge": "br-int", "label": "tempest-device-tagging-net1-560176148", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46b2b924f3a4461ba09eb54ee42f4649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9141d0eb-5e", "ovs_interfaceid": "9141d0eb-5e49-4a83-993f-3eac6a526dfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4da5a263-b3c7-49ba-b2e1-d54cbb5f0f0e", "address": "fa:16:3e:2d:65:73", "network": {"id": "8a3d7452-cadc-4728-a772-801d6a5c4770", "bridge": "br-int", "label": "tempest-device-tagging-net1-560176148", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46b2b924f3a4461ba09eb54ee42f4649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4da5a263-b3", "ovs_interfaceid": "4da5a263-b3c7-49ba-b2e1-d54cbb5f0f0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d35e88b3-1ad6-42dc-9b9f-281cb0e99dc8", "address": "fa:16:3e:51:c9:d7", "network": {"id": "8a3d7452-cadc-4728-a772-801d6a5c4770", "bridge": "br-int", "label": "tempest-device-tagging-net1-560176148", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46b2b924f3a4461ba09eb54ee42f4649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd35e88b3-1a", "ovs_interfaceid": "d35e88b3-1ad6-42dc-9b9f-281cb0e99dc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "78d439bc-58eb-4984-86f7-e9610cd8c17f", "address": "fa:16:3e:a3:26:2f", "network": {"id": "1f1cb866-1870-48d7-8866-ac73e71c8ef4", "bridge": "br-int", "label": "tempest-device-tagging-net2-663589537", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "46b2b924f3a4461ba09eb54ee42f4649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78d439bc-58", "ovs_interfaceid": "78d439bc-58eb-4984-86f7-e9610cd8c17f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "870087f8-5e43-4e98-a6ab-b65529f9fa6b", "address": "fa:16:3e:96:be:1f", "network": {"id": "1f1cb866-1870-48d7-8866-ac73e71c8ef4", "bridge": "br-int", "label": "tempest-device-tagging-net2-663589537", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "46b2b924f3a4461ba09eb54ee42f4649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap870087f8-5e", "ovs_interfaceid": "870087f8-5e43-4e98-a6ab-b65529f9fa6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:35:08 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Releasing lock "refresh_cache-04c02325-7ce4-45c2-819b-c656e93c96ca" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:35:08 user nova-compute[74337]: DEBUG nova.compute.manager [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Instance network_info: |[{"id": "2ea512c9-8ab6-49a3-9f77-14bcd380f8e8", "address": "fa:16:3e:75:d8:7f", "network": {"id": "e5fd79cb-72f1-4d32-a604-b9518e375fcd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-840255736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46b2b924f3a4461ba09eb54ee42f4649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ea512c9-8a", "ovs_interfaceid": "2ea512c9-8ab6-49a3-9f77-14bcd380f8e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2727b3bf-35e4-485a-b44b-66406b7d1597", "address": "fa:16:3e:e2:6e:58", "network": {"id": "8a3d7452-cadc-4728-a772-801d6a5c4770", "bridge": "br-int", "label": "tempest-device-tagging-net1-560176148", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46b2b924f3a4461ba09eb54ee42f4649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2727b3bf-35", "ovs_interfaceid": "2727b3bf-35e4-485a-b44b-66406b7d1597", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9141d0eb-5e49-4a83-993f-3eac6a526dfd", "address": "fa:16:3e:1f:61:c0", "network": {"id": "8a3d7452-cadc-4728-a772-801d6a5c4770", "bridge": "br-int", "label": "tempest-device-tagging-net1-560176148", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46b2b924f3a4461ba09eb54ee42f4649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9141d0eb-5e", "ovs_interfaceid": "9141d0eb-5e49-4a83-993f-3eac6a526dfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4da5a263-b3c7-49ba-b2e1-d54cbb5f0f0e", "address": "fa:16:3e:2d:65:73", "network": {"id": "8a3d7452-cadc-4728-a772-801d6a5c4770", "bridge": "br-int", "label": "tempest-device-tagging-net1-560176148", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46b2b924f3a4461ba09eb54ee42f4649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4da5a263-b3", "ovs_interfaceid": "4da5a263-b3c7-49ba-b2e1-d54cbb5f0f0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d35e88b3-1ad6-42dc-9b9f-281cb0e99dc8", "address": "fa:16:3e:51:c9:d7", "network": {"id": "8a3d7452-cadc-4728-a772-801d6a5c4770", "bridge": "br-int", "label": "tempest-device-tagging-net1-560176148", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46b2b924f3a4461ba09eb54ee42f4649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd35e88b3-1a", "ovs_interfaceid": "d35e88b3-1ad6-42dc-9b9f-281cb0e99dc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "78d439bc-58eb-4984-86f7-e9610cd8c17f", "address": "fa:16:3e:a3:26:2f", "network": {"id": "1f1cb866-1870-48d7-8866-ac73e71c8ef4", "bridge": "br-int", "label": "tempest-device-tagging-net2-663589537", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "46b2b924f3a4461ba09eb54ee42f4649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78d439bc-58", "ovs_interfaceid": "78d439bc-58eb-4984-86f7-e9610cd8c17f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "870087f8-5e43-4e98-a6ab-b65529f9fa6b", "address": "fa:16:3e:96:be:1f", "network": {"id": "1f1cb866-1870-48d7-8866-ac73e71c8ef4", "bridge": "br-int", "label": "tempest-device-tagging-net2-663589537", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "46b2b924f3a4461ba09eb54ee42f4649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap870087f8-5e", "ovs_interfaceid": "870087f8-5e43-4e98-a6ab-b65529f9fa6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 21:35:08 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-b77efff5-686a-4b6c-8ad5-e166a37a38e4 req-3d24be41-47fc-460c-8ba9-7f95e387b676 service nova] Acquired lock "refresh_cache-04c02325-7ce4-45c2-819b-c656e93c96ca" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:35:08 user nova-compute[74337]: DEBUG nova.network.neutron [req-b77efff5-686a-4b6c-8ad5-e166a37a38e4 req-3d24be41-47fc-460c-8ba9-7f95e387b676 service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Refreshing network info cache for port 870087f8-5e43-4e98-a6ab-b65529f9fa6b {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 21:35:09 user nova-compute[74337]: DEBUG nova.network.neutron [req-b77efff5-686a-4b6c-8ad5-e166a37a38e4 req-3d24be41-47fc-460c-8ba9-7f95e387b676 service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Updated VIF entry in instance network info cache for port 870087f8-5e43-4e98-a6ab-b65529f9fa6b. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 21:35:09 user nova-compute[74337]: DEBUG nova.network.neutron [req-b77efff5-686a-4b6c-8ad5-e166a37a38e4 req-3d24be41-47fc-460c-8ba9-7f95e387b676 service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Updating instance_info_cache with network_info: [{"id": "2ea512c9-8ab6-49a3-9f77-14bcd380f8e8", "address": "fa:16:3e:75:d8:7f", "network": {"id": "e5fd79cb-72f1-4d32-a604-b9518e375fcd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-840255736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46b2b924f3a4461ba09eb54ee42f4649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ea512c9-8a", "ovs_interfaceid": "2ea512c9-8ab6-49a3-9f77-14bcd380f8e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2727b3bf-35e4-485a-b44b-66406b7d1597", "address": "fa:16:3e:e2:6e:58", "network": {"id": "8a3d7452-cadc-4728-a772-801d6a5c4770", "bridge": "br-int", "label": "tempest-device-tagging-net1-560176148", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46b2b924f3a4461ba09eb54ee42f4649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2727b3bf-35", "ovs_interfaceid": "2727b3bf-35e4-485a-b44b-66406b7d1597", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9141d0eb-5e49-4a83-993f-3eac6a526dfd", "address": "fa:16:3e:1f:61:c0", "network": {"id": "8a3d7452-cadc-4728-a772-801d6a5c4770", "bridge": "br-int", "label": "tempest-device-tagging-net1-560176148", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46b2b924f3a4461ba09eb54ee42f4649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9141d0eb-5e", "ovs_interfaceid": "9141d0eb-5e49-4a83-993f-3eac6a526dfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4da5a263-b3c7-49ba-b2e1-d54cbb5f0f0e", "address": "fa:16:3e:2d:65:73", "network": {"id": "8a3d7452-cadc-4728-a772-801d6a5c4770", "bridge": "br-int", "label": "tempest-device-tagging-net1-560176148", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46b2b924f3a4461ba09eb54ee42f4649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4da5a263-b3", "ovs_interfaceid": "4da5a263-b3c7-49ba-b2e1-d54cbb5f0f0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d35e88b3-1ad6-42dc-9b9f-281cb0e99dc8", "address": "fa:16:3e:51:c9:d7", "network": {"id": "8a3d7452-cadc-4728-a772-801d6a5c4770", "bridge": "br-int", "label": "tempest-device-tagging-net1-560176148", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46b2b924f3a4461ba09eb54ee42f4649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd35e88b3-1a", "ovs_interfaceid": "d35e88b3-1ad6-42dc-9b9f-281cb0e99dc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "78d439bc-58eb-4984-86f7-e9610cd8c17f", "address": "fa:16:3e:a3:26:2f", "network": {"id": "1f1cb866-1870-48d7-8866-ac73e71c8ef4", "bridge": "br-int", "label": "tempest-device-tagging-net2-663589537", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "46b2b924f3a4461ba09eb54ee42f4649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78d439bc-58", "ovs_interfaceid": "78d439bc-58eb-4984-86f7-e9610cd8c17f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "870087f8-5e43-4e98-a6ab-b65529f9fa6b", "address": "fa:16:3e:96:be:1f", "network": {"id": "1f1cb866-1870-48d7-8866-ac73e71c8ef4", "bridge": "br-int", "label": "tempest-device-tagging-net2-663589537", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "46b2b924f3a4461ba09eb54ee42f4649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap870087f8-5e", "ovs_interfaceid": "870087f8-5e43-4e98-a6ab-b65529f9fa6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:35:09 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-b77efff5-686a-4b6c-8ad5-e166a37a38e4 req-3d24be41-47fc-460c-8ba9-7f95e387b676 service nova] Releasing lock "refresh_cache-04c02325-7ce4-45c2-819b-c656e93c96ca" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:35:11 user nova-compute[74337]: DEBUG nova.compute.manager [req-c5529b02-fd92-4717-a3d4-68eb7a8974fd req-1dd73f49-a9c4-4be8-9c9c-d0b9b1f4af6c service nova] [instance: d45e8ae8-371b-46ae-849d-d7f7d5bbd770] Received event network-changed-7ac73679-68b0-430f-8d77-68438fbb52f0 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:35:11 user nova-compute[74337]: DEBUG nova.compute.manager [req-c5529b02-fd92-4717-a3d4-68eb7a8974fd req-1dd73f49-a9c4-4be8-9c9c-d0b9b1f4af6c service nova] [instance: d45e8ae8-371b-46ae-849d-d7f7d5bbd770] Refreshing instance network info cache due to event network-changed-7ac73679-68b0-430f-8d77-68438fbb52f0. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 21:35:11 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-c5529b02-fd92-4717-a3d4-68eb7a8974fd req-1dd73f49-a9c4-4be8-9c9c-d0b9b1f4af6c service nova] Acquiring lock "refresh_cache-d45e8ae8-371b-46ae-849d-d7f7d5bbd770" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:35:11 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-c5529b02-fd92-4717-a3d4-68eb7a8974fd req-1dd73f49-a9c4-4be8-9c9c-d0b9b1f4af6c service nova] Acquired lock "refresh_cache-d45e8ae8-371b-46ae-849d-d7f7d5bbd770" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:35:11 user nova-compute[74337]: DEBUG nova.network.neutron [req-c5529b02-fd92-4717-a3d4-68eb7a8974fd req-1dd73f49-a9c4-4be8-9c9c-d0b9b1f4af6c service nova] [instance: d45e8ae8-371b-46ae-849d-d7f7d5bbd770] Refreshing network info cache for port 7ac73679-68b0-430f-8d77-68438fbb52f0 {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 21:35:11 user nova-compute[74337]: DEBUG nova.network.neutron [req-c5529b02-fd92-4717-a3d4-68eb7a8974fd req-1dd73f49-a9c4-4be8-9c9c-d0b9b1f4af6c service nova] [instance: d45e8ae8-371b-46ae-849d-d7f7d5bbd770] Updated VIF entry in instance network info cache for port 7ac73679-68b0-430f-8d77-68438fbb52f0. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 21:35:11 user nova-compute[74337]: DEBUG nova.network.neutron [req-c5529b02-fd92-4717-a3d4-68eb7a8974fd req-1dd73f49-a9c4-4be8-9c9c-d0b9b1f4af6c service nova] [instance: d45e8ae8-371b-46ae-849d-d7f7d5bbd770] Updating instance_info_cache with network_info: [{"id": "7ac73679-68b0-430f-8d77-68438fbb52f0", "address": "fa:16:3e:9b:5f:a0", "network": {"id": "9fa29b5e-b3c7-4890-9d82-d9524e4cb78a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-89037375-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "997b9ab7d2794438be79f11bb972be47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ac73679-68", "ovs_interfaceid": "7ac73679-68b0-430f-8d77-68438fbb52f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:35:12 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-c5529b02-fd92-4717-a3d4-68eb7a8974fd req-1dd73f49-a9c4-4be8-9c9c-d0b9b1f4af6c service nova] Releasing lock "refresh_cache-d45e8ae8-371b-46ae-849d-d7f7d5bbd770" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:35:12 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:13 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:14 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-d4feb163-de3e-4434-a3b9-c2df9135ed50 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:35:14 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-d4feb163-de3e-4434-a3b9-c2df9135ed50 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:35:14 user nova-compute[74337]: DEBUG os_brick.initiator.connector [None req-d4feb163-de3e-4434-a3b9-c2df9135ed50 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Factory for ISCSI on None {{(pid=74337) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Oct 23 21:35:14 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-d4feb163-de3e-4434-a3b9-c2df9135ed50 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.008s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:35:14 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4feb163-de3e-4434-a3b9-c2df9135ed50 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] [instance: 05b80b08-f66c-4cc6-b806-f25543536bfa] Calling os-brick to attach iSCSI Volume {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 21:35:14 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4feb163-de3e-4434-a3b9-c2df9135ed50 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2d9b1af1-237a-41ee-9e09-33a3a1580336', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ALrDSxXT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:35:14 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-d4feb163-de3e-4434-a3b9-c2df9135ed50 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:35:14 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-d4feb163-de3e-4434-a3b9-c2df9135ed50 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:35:14 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-d4feb163-de3e-4434-a3b9-c2df9135ed50 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:35:14 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-d4feb163-de3e-4434-a3b9-c2df9135ed50 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:35:14 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-d4feb163-de3e-4434-a3b9-c2df9135ed50 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d9b1af1-237a-41ee-9e09-33a3a1580336" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:35:14 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-d4feb163-de3e-4434-a3b9-c2df9135ed50 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d9b1af1-237a-41ee-9e09-33a3a1580336" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:35:14 user nova-compute[74337]: INFO os_brick.initiator.connectors.iscsi [None req-d4feb163-de3e-4434-a3b9-c2df9135ed50 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 21:35:14 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d9b1af1-237a-41ee-9e09-33a3a1580336 -p 172.16.0.220:3260 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:14 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d9b1af1-237a-41ee-9e09-33a3a1580336 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:14 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d94ec4bb-26ed-44da-9d26-1207504569f5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:14 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4feb163-de3e-4434-a3b9-c2df9135ed50 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 21:35:14 user nova-compute[74337]:  {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:35:14 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d9b1af1-237a-41ee-9e09-33a3a1580336 -p 172.16.0.220:3260 --interface default --op new {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:14 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d9b1af1-237a-41ee-9e09-33a3a1580336 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:14 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffbbaef2-968f-48f2-9e5d-6fe8f81e326d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2d9b1af1-237a-41ee-9e09-33a3a1580336] added\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:14 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4feb163-de3e-4434-a3b9-c2df9135ed50 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2d9b1af1-237a-41ee-9e09-33a3a1580336] added
Oct 23 21:35:14 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:35:14 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d9b1af1-237a-41ee-9e09-33a3a1580336 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:14 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d9b1af1-237a-41ee-9e09-33a3a1580336 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:14 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b9a5e16-b502-4bc2-8b48-3033f145231f]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:14 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4feb163-de3e-4434-a3b9-c2df9135ed50 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:35:14 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d9b1af1-237a-41ee-9e09-33a3a1580336 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:14 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d9b1af1-237a-41ee-9e09-33a3a1580336 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:14 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f06d88-274a-415e-85bc-e3d6911d373f]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:14 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4feb163-de3e-4434-a3b9-c2df9135ed50 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:35:14 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d9b1af1-237a-41ee-9e09-33a3a1580336 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ALrDSxXT {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:14 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d9b1af1-237a-41ee-9e09-33a3a1580336 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ALrDSxXT" returned: 0 in 0.016s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:14 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[794881f8-7688-4f45-a12b-7225c186b708]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:14 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4feb163-de3e-4434-a3b9-c2df9135ed50 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ALrDSxXT'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:35:14 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d9b1af1-237a-41ee-9e09-33a3a1580336 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:14 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d9b1af1-237a-41ee-9e09-33a3a1580336 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:14 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a825e5f6-ca86-4a87-9208-fbc1e206f1b2]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:14 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4feb163-de3e-4434-a3b9-c2df9135ed50 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:35:14 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:14 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:14 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[669dd2fc-7c42-471a-85c2-762de086e195]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:14 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4feb163-de3e-4434-a3b9-c2df9135ed50 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 23 21:35:14 user nova-compute[74337]:  {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:35:14 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4feb163-de3e-4434-a3b9-c2df9135ed50 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 23 21:35:14 user nova-compute[74337]:  {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:35:14 user nova-compute[74337]: WARNING os_brick.initiator.connectors.iscsi [None req-d4feb163-de3e-4434-a3b9-c2df9135ed50 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 23 21:35:14 user nova-compute[74337]: 
Oct 23 21:35:14 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d9b1af1-237a-41ee-9e09-33a3a1580336 -p 172.16.0.220:3260 --login {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:14 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d9b1af1-237a-41ee-9e09-33a3a1580336 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:14 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fbbe95d-83f6-4589-a0e4-f505af07f425]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2d9b1af1-237a-41ee-9e09-33a3a1580336, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2d9b1af1-237a-41ee-9e09-33a3a1580336, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:14 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4feb163-de3e-4434-a3b9-c2df9135ed50 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2d9b1af1-237a-41ee-9e09-33a3a1580336, portal: 172.16.0.220,3260]
Oct 23 21:35:14 user nova-compute[74337]: Login to [iface: default, target: iqn.2010-10.org.openstack:2d9b1af1-237a-41ee-9e09-33a3a1580336, portal: 172.16.0.220,3260] successful.
Oct 23 21:35:14 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:35:14 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d9b1af1-237a-41ee-9e09-33a3a1580336 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:14 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d9b1af1-237a-41ee-9e09-33a3a1580336 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:14 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a645f5c-d07b-4d7f-ae8b-b35c5baf185d]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:14 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4feb163-de3e-4434-a3b9-c2df9135ed50 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:35:14 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:14 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:14 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7e96258-fdf8-4823-8e24-02ed0f23b0fb]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d9b1af1-237a-41ee-9e09-33a3a1580336 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:14 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4feb163-de3e-4434-a3b9-c2df9135ed50 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d9b1af1-237a-41ee-9e09-33a3a1580336 (non-flash)
Oct 23 21:35:14 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:35:14 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4feb163-de3e-4434-a3b9-c2df9135ed50 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d9b1af1-237a-41ee-9e09-33a3a1580336 (non-flash)
Oct 23 21:35:14 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:35:14 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-d4feb163-de3e-4434-a3b9-c2df9135ed50 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d9b1af1-237a-41ee-9e09-33a3a1580336" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:35:14 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4feb163-de3e-4434-a3b9-c2df9135ed50 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Connected to 172.16.0.220:3260 {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 21:35:14 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-d4feb163-de3e-4434-a3b9-c2df9135ed50 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=74337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 21:35:14 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-d4feb163-de3e-4434-a3b9-c2df9135ed50 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 21:35:14 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:14 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:14 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf1dadc-32a5-4c25-b531-6750799d856c]: (4, ('- - 0', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:14 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-d4feb163-de3e-4434-a3b9-c2df9135ed50 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 21:35:14 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4feb163-de3e-4434-a3b9-c2df9135ed50 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:2d9b1af1-237a-41ee-9e09-33a3a1580336', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ALrDSxXT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 21:35:15 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-d4feb163-de3e-4434-a3b9-c2df9135ed50 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.292s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:35:15 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4feb163-de3e-4434-a3b9-c2df9135ed50 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '26537326265353766', 'path': '/dev/sdb'} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:35:15 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4feb163-de3e-4434-a3b9-c2df9135ed50 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] [instance: 05b80b08-f66c-4cc6-b806-f25543536bfa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26537326265353766', 'path': '/dev/sdb'} {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 21:35:15 user nova-compute[74337]: DEBUG nova.objects.instance [None req-d4feb163-de3e-4434-a3b9-c2df9135ed50 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Lazy-loading 'flavor' on Instance uuid 05b80b08-f66c-4cc6-b806-f25543536bfa {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:35:15 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-d4feb163-de3e-4434-a3b9-c2df9135ed50 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 21:35:15 user nova-compute[74337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 21:35:15 user nova-compute[74337]:   <source dev="/dev/sdb"/>
Oct 23 21:35:15 user nova-compute[74337]:   <target dev="vdb" bus="virtio"/>
Oct 23 21:35:15 user nova-compute[74337]:   <serial>2d9b1af1-237a-41ee-9e09-33a3a1580336</serial>
Oct 23 21:35:15 user nova-compute[74337]: </disk>
Oct 23 21:35:15 user nova-compute[74337]:  {{(pid=74337) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 21:35:16 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-d4feb163-de3e-4434-a3b9-c2df9135ed50 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] No BDM found with device name vda, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 21:35:16 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-d4feb163-de3e-4434-a3b9-c2df9135ed50 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 21:35:16 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-d4feb163-de3e-4434-a3b9-c2df9135ed50 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] No VIF found with MAC fa:16:3e:a8:ad:5b, not building metadata {{(pid=74337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 21:35:16 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-d4feb163-de3e-4434-a3b9-c2df9135ed50 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Lock "05b80b08-f66c-4cc6-b806-f25543536bfa" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.346s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:35:16 user nova-compute[74337]: INFO nova.virt.block_device [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Booting with volume 0865a5a4-aa44-450e-8451-0d5e8b14f661 at /dev/vdb
Oct 23 21:35:16 user nova-compute[74337]: DEBUG os_brick.utils [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:35:16 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:16 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-bf16da09-b9a8-47e8-820a-4488afa64d25 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Acquiring lock "05b80b08-f66c-4cc6-b806-f25543536bfa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:35:16 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-bf16da09-b9a8-47e8-820a-4488afa64d25 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Lock "05b80b08-f66c-4cc6-b806-f25543536bfa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:35:16 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-bf16da09-b9a8-47e8-820a-4488afa64d25 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Acquiring lock "05b80b08-f66c-4cc6-b806-f25543536bfa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:35:16 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-bf16da09-b9a8-47e8-820a-4488afa64d25 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Lock "05b80b08-f66c-4cc6-b806-f25543536bfa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:35:16 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-bf16da09-b9a8-47e8-820a-4488afa64d25 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Lock "05b80b08-f66c-4cc6-b806-f25543536bfa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:35:16 user nova-compute[74337]: INFO nova.compute.manager [None req-bf16da09-b9a8-47e8-820a-4488afa64d25 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] [instance: 05b80b08-f66c-4cc6-b806-f25543536bfa] Terminating instance
Oct 23 21:35:16 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:16 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c1e39a2-0d51-44b7-94fb-7c3bd8f7064b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f34011b66e40\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:16 user nova-compute[74337]: DEBUG nova.compute.manager [None req-bf16da09-b9a8-47e8-820a-4488afa64d25 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] [instance: 05b80b08-f66c-4cc6-b806-f25543536bfa] Start destroying the instance on the hypervisor. {{(pid=74337) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 21:35:16 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:16 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:16 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[45bbc085-e9d7-4c29-a222-37e8159b1b51]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:16 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:17 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:17 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b28a297-a965-4c4f-bf86-7bf6a19212fc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:17 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fb84646-73d3-427a-b1c3-fa4f210e992b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:17 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Running cmd (subprocess): nvme version {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:17 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] 'nvme version' failed. Not Retrying. {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 21:35:17 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] nvme not present on system {{(pid=74337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 21:35:17 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:17 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:17 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 21:35:17 user nova-compute[74337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 21:35:17 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c18f2e3-2b6b-4b3d-984b-21eb78e561f3]: (4, '') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:17 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 21:35:17 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 21:35:17 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] LIGHTOS: no hostnqn found. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 21:35:17 user nova-compute[74337]: DEBUG os_brick.utils [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f34011b66e40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:35:17 user nova-compute[74337]: DEBUG nova.virt.block_device [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Updating existing volume attachment record: dcc75ca3-e611-4f00-811a-31e943f54bb4 {{(pid=74337) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 21:35:17 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:17 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:17 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:17 user nova-compute[74337]: DEBUG nova.compute.manager [req-208a6c03-3062-47ca-853f-0a7be594d413 req-ad38ad6e-ae0f-4d0b-9ab0-bc90d59a55aa service nova] [instance: 05b80b08-f66c-4cc6-b806-f25543536bfa] Received event network-vif-unplugged-3373880f-4797-411f-9e90-104572cca818 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:35:17 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-208a6c03-3062-47ca-853f-0a7be594d413 req-ad38ad6e-ae0f-4d0b-9ab0-bc90d59a55aa service nova] Acquiring lock "05b80b08-f66c-4cc6-b806-f25543536bfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:35:17 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-208a6c03-3062-47ca-853f-0a7be594d413 req-ad38ad6e-ae0f-4d0b-9ab0-bc90d59a55aa service nova] Lock "05b80b08-f66c-4cc6-b806-f25543536bfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:35:17 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-208a6c03-3062-47ca-853f-0a7be594d413 req-ad38ad6e-ae0f-4d0b-9ab0-bc90d59a55aa service nova] Lock "05b80b08-f66c-4cc6-b806-f25543536bfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:35:17 user nova-compute[74337]: DEBUG nova.compute.manager [req-208a6c03-3062-47ca-853f-0a7be594d413 req-ad38ad6e-ae0f-4d0b-9ab0-bc90d59a55aa service nova] [instance: 05b80b08-f66c-4cc6-b806-f25543536bfa] No waiting events found dispatching network-vif-unplugged-3373880f-4797-411f-9e90-104572cca818 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:35:17 user nova-compute[74337]: DEBUG nova.compute.manager [req-208a6c03-3062-47ca-853f-0a7be594d413 req-ad38ad6e-ae0f-4d0b-9ab0-bc90d59a55aa service nova] [instance: 05b80b08-f66c-4cc6-b806-f25543536bfa] Received event network-vif-unplugged-3373880f-4797-411f-9e90-104572cca818 for instance with task_state deleting. {{(pid=74337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 21:35:17 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: 05b80b08-f66c-4cc6-b806-f25543536bfa] Instance destroyed successfully.
Oct 23 21:35:17 user nova-compute[74337]: DEBUG nova.objects.instance [None req-bf16da09-b9a8-47e8-820a-4488afa64d25 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Lazy-loading 'resources' on Instance uuid 05b80b08-f66c-4cc6-b806-f25543536bfa {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:35:17 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-bf16da09-b9a8-47e8-820a-4488afa64d25 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:32:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-608663478',display_name='tempest-DeleteServersTestJSON-server-608663478',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-608663478',id=1,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-23T21:33:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3411c1b9d3c847498ccfe3f0ef368dae',ramdisk_id='',reservation_id='r-00wfxijp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-741709678',owner_user_name='tempest-DeleteServersTestJSON-741709678-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T21:33:15Z,user_data=None,user_id='249a875f6a784bd58a5b80583a92d72d',uuid=05b80b08-f66c-4cc6-b806-f25543536bfa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3373880f-4797-411f-9e90-104572cca818", "address": "fa:16:3e:a8:ad:5b", "network": {"id": "decd291a-5626-4c07-9568-d019eb36dd28", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1526257557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3411c1b9d3c847498ccfe3f0ef368dae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3373880f-47", "ovs_interfaceid": "3373880f-4797-411f-9e90-104572cca818", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 21:35:17 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-bf16da09-b9a8-47e8-820a-4488afa64d25 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Converting VIF {"id": "3373880f-4797-411f-9e90-104572cca818", "address": "fa:16:3e:a8:ad:5b", "network": {"id": "decd291a-5626-4c07-9568-d019eb36dd28", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1526257557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3411c1b9d3c847498ccfe3f0ef368dae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3373880f-47", "ovs_interfaceid": "3373880f-4797-411f-9e90-104572cca818", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:35:17 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-bf16da09-b9a8-47e8-820a-4488afa64d25 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a8:ad:5b,bridge_name='br-int',has_traffic_filtering=True,id=3373880f-4797-411f-9e90-104572cca818,network=Network(decd291a-5626-4c07-9568-d019eb36dd28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3373880f-47') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:35:17 user nova-compute[74337]: DEBUG os_vif [None req-bf16da09-b9a8-47e8-820a-4488afa64d25 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:ad:5b,bridge_name='br-int',has_traffic_filtering=True,id=3373880f-4797-411f-9e90-104572cca818,network=Network(decd291a-5626-4c07-9568-d019eb36dd28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3373880f-47') {{(pid=74337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 21:35:17 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:17 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3373880f-47, bridge=br-int, if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:35:17 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:17 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:35:17 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:17 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=56fd66eb-4933-41d9-adc4-7b8a7353d374) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:35:17 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:35:17 user nova-compute[74337]: INFO os_vif [None req-bf16da09-b9a8-47e8-820a-4488afa64d25 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:ad:5b,bridge_name='br-int',has_traffic_filtering=True,id=3373880f-4797-411f-9e90-104572cca818,network=Network(decd291a-5626-4c07-9568-d019eb36dd28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3373880f-47')
Oct 23 21:35:17 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf16da09-b9a8-47e8-820a-4488afa64d25 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] [instance: 05b80b08-f66c-4cc6-b806-f25543536bfa] calling os-brick to detach iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 21:35:17 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf16da09-b9a8-47e8-820a-4488afa64d25 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, {'target_iqn': 'iqn.2010-10.org.openstack:2d9b1af1-237a-41ee-9e09-33a3a1580336', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ALrDSxXT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:35:17 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-bf16da09-b9a8-47e8-820a-4488afa64d25 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:35:17 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-bf16da09-b9a8-47e8-820a-4488afa64d25 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:35:17 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-bf16da09-b9a8-47e8-820a-4488afa64d25 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:35:17 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:17 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:17 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:17 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e5f7b4-2de7-4960-8617-c2cf9cc7ea66]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2d9b1af1-237a-41ee-9e09-33a3a1580336\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:17 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf16da09-b9a8-47e8-820a-4488afa64d25 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 21:35:17 user nova-compute[74337]: No targets found.
Oct 23 21:35:17 user nova-compute[74337]: iSNS:
Oct 23 21:35:17 user nova-compute[74337]: No targets found.
Oct 23 21:35:17 user nova-compute[74337]: STATIC:
Oct 23 21:35:17 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:2d9b1af1-237a-41ee-9e09-33a3a1580336
Oct 23 21:35:17 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:35:17 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:35:17 user nova-compute[74337]: FIRMWARE:
Oct 23 21:35:17 user nova-compute[74337]: No targets found.
Oct 23 21:35:17 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:35:17 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf16da09-b9a8-47e8-820a-4488afa64d25 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 21:35:17 user nova-compute[74337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 21:35:17 user nova-compute[74337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 21:35:17 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf16da09-b9a8-47e8-820a-4488afa64d25 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d9b1af1-237a-41ee-9e09-33a3a1580336', 0)] {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 21:35:17 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:17 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:17 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f00f2a-a8a6-4353-97f0-5688348e3be1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d9b1af1-237a-41ee-9e09-33a3a1580336\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:17 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:17 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:17 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e0d75fc-1849-4598-a258-1ed5af682f79]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d9b1af1-237a-41ee-9e09-33a3a1580336 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:17 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf16da09-b9a8-47e8-820a-4488afa64d25 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d9b1af1-237a-41ee-9e09-33a3a1580336 (non-flash)
Oct 23 21:35:17 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:35:17 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf16da09-b9a8-47e8-820a-4488afa64d25 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d9b1af1-237a-41ee-9e09-33a3a1580336 (non-flash)
Oct 23 21:35:17 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:35:17 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf16da09-b9a8-47e8-820a-4488afa64d25 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5ef4147c70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d9b1af1-237a-41ee-9e09-33a3a1580336'): ({'sdb'}, set())}) {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 21:35:17 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-bf16da09-b9a8-47e8-820a-4488afa64d25 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Removing single pathed devices sdb {{(pid=74337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 21:35:17 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:17 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:17 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe52f36-0f6d-4f26-a59d-116fa0ddbff1]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:17 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:17 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:17 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de2efde-4ece-4af7-a841-119aa1dffc91]: (4, ('ok\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:17 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-bf16da09-b9a8-47e8-820a-4488afa64d25 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Flushing IO for device /dev/sdb {{(pid=74337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 21:35:17 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:17 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.011s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:17 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c4611ad-768c-4295-bb49-0b16dd6fa89c]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:17 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-bf16da09-b9a8-47e8-820a-4488afa64d25 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 21:35:17 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:17 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:17 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[57947b36-6e51-4752-a12d-c7a5855fd9f0]: (4, ('1', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:17 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-bf16da09-b9a8-47e8-820a-4488afa64d25 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 21:35:17 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-bf16da09-b9a8-47e8-820a-4488afa64d25 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] SCSI volumes sdb have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 21:35:17 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf16da09-b9a8-47e8-820a-4488afa64d25 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d9b1af1-237a-41ee-9e09-33a3a1580336')] {{(pid=74337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 21:35:17 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d9b1af1-237a-41ee-9e09-33a3a1580336 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:17 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d9b1af1-237a-41ee-9e09-33a3a1580336 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.016s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:17 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1eeb68c-a468-42c2-973d-69708ddbaf30]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:17 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf16da09-b9a8-47e8-820a-4488afa64d25 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:35:17 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d9b1af1-237a-41ee-9e09-33a3a1580336 -p 172.16.0.220:3260 --logout {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:18 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d9b1af1-237a-41ee-9e09-33a3a1580336 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:18 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[9440c319-7c20-44ce-b633-de36a7a39884]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:2d9b1af1-237a-41ee-9e09-33a3a1580336, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:2d9b1af1-237a-41ee-9e09-33a3a1580336, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:18 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf16da09-b9a8-47e8-820a-4488afa64d25 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:2d9b1af1-237a-41ee-9e09-33a3a1580336, portal: 172.16.0.220,3260]
Oct 23 21:35:18 user nova-compute[74337]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:2d9b1af1-237a-41ee-9e09-33a3a1580336, portal: 172.16.0.220,3260] successful.
Oct 23 21:35:18 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:35:18 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d9b1af1-237a-41ee-9e09-33a3a1580336 -p 172.16.0.220:3260 --op delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:18 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d9b1af1-237a-41ee-9e09-33a3a1580336 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:18 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b9ec0be-13bf-404d-a977-e08c2e4ab196]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:18 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf16da09-b9a8-47e8-820a-4488afa64d25 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:35:18 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-bf16da09-b9a8-47e8-820a-4488afa64d25 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:35:18 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf16da09-b9a8-47e8-820a-4488afa64d25 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] <== disconnect_volume: return (284ms) None {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:35:18 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf16da09-b9a8-47e8-820a-4488afa64d25 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] [instance: 05b80b08-f66c-4cc6-b806-f25543536bfa] Disconnected iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 21:35:18 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-bf16da09-b9a8-47e8-820a-4488afa64d25 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] [instance: 05b80b08-f66c-4cc6-b806-f25543536bfa] Deleting instance files /opt/stack/data/nova/instances/05b80b08-f66c-4cc6-b806-f25543536bfa_del
Oct 23 21:35:18 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-bf16da09-b9a8-47e8-820a-4488afa64d25 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] [instance: 05b80b08-f66c-4cc6-b806-f25543536bfa] Deletion of /opt/stack/data/nova/instances/05b80b08-f66c-4cc6-b806-f25543536bfa_del complete
Oct 23 21:35:18 user nova-compute[74337]: INFO nova.compute.manager [None req-bf16da09-b9a8-47e8-820a-4488afa64d25 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] [instance: 05b80b08-f66c-4cc6-b806-f25543536bfa] Took 1.19 seconds to destroy the instance on the hypervisor.
Oct 23 21:35:18 user nova-compute[74337]: DEBUG oslo.service.loopingcall [None req-bf16da09-b9a8-47e8-820a-4488afa64d25 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74337) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 21:35:18 user nova-compute[74337]: DEBUG nova.compute.manager [-] [instance: 05b80b08-f66c-4cc6-b806-f25543536bfa] Deallocating network for instance {{(pid=74337) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 21:35:18 user nova-compute[74337]: DEBUG nova.network.neutron [-] [instance: 05b80b08-f66c-4cc6-b806-f25543536bfa] deallocate_for_instance() {{(pid=74337) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 21:35:18 user nova-compute[74337]: DEBUG nova.network.neutron [-] [instance: 05b80b08-f66c-4cc6-b806-f25543536bfa] Updating instance_info_cache with network_info: [] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:35:18 user nova-compute[74337]: INFO nova.compute.manager [-] [instance: 05b80b08-f66c-4cc6-b806-f25543536bfa] Took 0.61 seconds to deallocate network for instance.
Oct 23 21:35:18 user nova-compute[74337]: DEBUG nova.compute.manager [req-d59ac06f-6aea-4fb5-bd42-84e5de4bc0fe req-67897452-4dc9-4032-8923-db96183b68f2 service nova] [instance: 05b80b08-f66c-4cc6-b806-f25543536bfa] Received event network-vif-deleted-3373880f-4797-411f-9e90-104572cca818 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:35:19 user nova-compute[74337]: DEBUG nova.compute.manager [req-04a96a54-b4f4-4ef4-a928-f1e0a642cc4d req-dc2ac28b-1713-40d0-b2ad-37953bbf83c0 service nova] [instance: 05b80b08-f66c-4cc6-b806-f25543536bfa] Received event network-vif-plugged-3373880f-4797-411f-9e90-104572cca818 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:35:19 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-04a96a54-b4f4-4ef4-a928-f1e0a642cc4d req-dc2ac28b-1713-40d0-b2ad-37953bbf83c0 service nova] Acquiring lock "05b80b08-f66c-4cc6-b806-f25543536bfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:35:19 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-04a96a54-b4f4-4ef4-a928-f1e0a642cc4d req-dc2ac28b-1713-40d0-b2ad-37953bbf83c0 service nova] Lock "05b80b08-f66c-4cc6-b806-f25543536bfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:35:19 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-04a96a54-b4f4-4ef4-a928-f1e0a642cc4d req-dc2ac28b-1713-40d0-b2ad-37953bbf83c0 service nova] Lock "05b80b08-f66c-4cc6-b806-f25543536bfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:35:19 user nova-compute[74337]: DEBUG nova.compute.manager [req-04a96a54-b4f4-4ef4-a928-f1e0a642cc4d req-dc2ac28b-1713-40d0-b2ad-37953bbf83c0 service nova] [instance: 05b80b08-f66c-4cc6-b806-f25543536bfa] No waiting events found dispatching network-vif-plugged-3373880f-4797-411f-9e90-104572cca818 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:35:19 user nova-compute[74337]: WARNING nova.compute.manager [req-04a96a54-b4f4-4ef4-a928-f1e0a642cc4d req-dc2ac28b-1713-40d0-b2ad-37953bbf83c0 service nova] [instance: 05b80b08-f66c-4cc6-b806-f25543536bfa] Received unexpected event network-vif-plugged-3373880f-4797-411f-9e90-104572cca818 for instance with vm_state active and task_state deleting.
Oct 23 21:35:20 user nova-compute[74337]: INFO nova.virt.block_device [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Booting with volume 3b15e515-43f3-4748-a86a-bb348b5b38c0 at /dev/vdc
Oct 23 21:35:20 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-123ca411-4f0a-4167-b7f2-2d302925213d tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Acquiring lock "d45e8ae8-371b-46ae-849d-d7f7d5bbd770" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:35:20 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-123ca411-4f0a-4167-b7f2-2d302925213d tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Lock "d45e8ae8-371b-46ae-849d-d7f7d5bbd770" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:35:20 user nova-compute[74337]: DEBUG nova.objects.instance [None req-123ca411-4f0a-4167-b7f2-2d302925213d tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Lazy-loading 'flavor' on Instance uuid d45e8ae8-371b-46ae-849d-d7f7d5bbd770 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:35:20 user nova-compute[74337]: DEBUG os_brick.utils [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:35:20 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:20 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:20 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[73922e79-77ff-4344-b028-51ef00f58ce9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f34011b66e40\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:20 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-123ca411-4f0a-4167-b7f2-2d302925213d tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Lock "d45e8ae8-371b-46ae-849d-d7f7d5bbd770" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:35:20 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:20 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:20 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[3019f00d-4e6c-44a6-9ab2-0b68c0d97505]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:20 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:20 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:20 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b7dc328-21f1-460b-80e2-3224c3915585]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:20 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d82d1e0-79e3-4e6b-a238-cc038d5e0d21]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:20 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Running cmd (subprocess): nvme version {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:20 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] 'nvme version' failed. Not Retrying. {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 21:35:20 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] nvme not present on system {{(pid=74337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 21:35:20 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:20 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 21:35:20 user nova-compute[74337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 21:35:20 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b5e6fc2-b275-4a70-8a15-f289f74c6303]: (4, '') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:20 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 21:35:20 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 21:35:20 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] LIGHTOS: no hostnqn found. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 21:35:20 user nova-compute[74337]: DEBUG os_brick.utils [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f34011b66e40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:35:20 user nova-compute[74337]: DEBUG nova.virt.block_device [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Updating existing volume attachment record: 331f7dbe-f549-4d6b-ac6d-9ee6ba3bef98 {{(pid=74337) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 21:35:20 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-123ca411-4f0a-4167-b7f2-2d302925213d tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Acquiring lock "d45e8ae8-371b-46ae-849d-d7f7d5bbd770" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:35:20 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-123ca411-4f0a-4167-b7f2-2d302925213d tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Lock "d45e8ae8-371b-46ae-849d-d7f7d5bbd770" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:35:20 user nova-compute[74337]: INFO nova.compute.manager [None req-123ca411-4f0a-4167-b7f2-2d302925213d tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] [instance: d45e8ae8-371b-46ae-849d-d7f7d5bbd770] Attaching volume 2f364c63-50fe-482f-a6e7-c234b5b9bec9 to /dev/vdb
Oct 23 21:35:22 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:22 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:23 user nova-compute[74337]: DEBUG nova.compute.manager [req-2d59be56-9166-42d3-b0f1-5683b51f3d94 req-3f91665d-e1b6-4ee8-82c0-e6fa462427a2 service nova] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] Received event network-changed-530b7241-1498-47dc-8a6f-79e6c9cc850a {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:35:23 user nova-compute[74337]: DEBUG nova.compute.manager [req-2d59be56-9166-42d3-b0f1-5683b51f3d94 req-3f91665d-e1b6-4ee8-82c0-e6fa462427a2 service nova] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] Refreshing instance network info cache due to event network-changed-530b7241-1498-47dc-8a6f-79e6c9cc850a. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 21:35:23 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-2d59be56-9166-42d3-b0f1-5683b51f3d94 req-3f91665d-e1b6-4ee8-82c0-e6fa462427a2 service nova] Acquiring lock "refresh_cache-8acc1b10-a541-4c06-aeb7-1ecf7a2457be" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:35:23 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-2d59be56-9166-42d3-b0f1-5683b51f3d94 req-3f91665d-e1b6-4ee8-82c0-e6fa462427a2 service nova] Acquired lock "refresh_cache-8acc1b10-a541-4c06-aeb7-1ecf7a2457be" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:35:23 user nova-compute[74337]: DEBUG nova.network.neutron [req-2d59be56-9166-42d3-b0f1-5683b51f3d94 req-3f91665d-e1b6-4ee8-82c0-e6fa462427a2 service nova] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] Refreshing network info cache for port 530b7241-1498-47dc-8a6f-79e6c9cc850a {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 21:35:23 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-7f6d5438-2042-417c-abb9-8dd8d6ca8600 tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Acquiring lock "interface-8acc1b10-a541-4c06-aeb7-1ecf7a2457be-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:35:23 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-7f6d5438-2042-417c-abb9-8dd8d6ca8600 tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Lock "interface-8acc1b10-a541-4c06-aeb7-1ecf7a2457be-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:35:23 user nova-compute[74337]: DEBUG nova.objects.instance [None req-7f6d5438-2042-417c-abb9-8dd8d6ca8600 tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Lazy-loading 'flavor' on Instance uuid 8acc1b10-a541-4c06-aeb7-1ecf7a2457be {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:35:23 user nova-compute[74337]: DEBUG nova.network.neutron [req-2d59be56-9166-42d3-b0f1-5683b51f3d94 req-3f91665d-e1b6-4ee8-82c0-e6fa462427a2 service nova] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] Updated VIF entry in instance network info cache for port 530b7241-1498-47dc-8a6f-79e6c9cc850a. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 21:35:23 user nova-compute[74337]: DEBUG nova.network.neutron [req-2d59be56-9166-42d3-b0f1-5683b51f3d94 req-3f91665d-e1b6-4ee8-82c0-e6fa462427a2 service nova] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] Updating instance_info_cache with network_info: [{"id": "530b7241-1498-47dc-8a6f-79e6c9cc850a", "address": "fa:16:3e:47:6a:0e", "network": {"id": "44c67162-ce40-4b2b-bc3e-07b0203e2083", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1341457246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84d7baedb5f74976be4b0cf308964086", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap530b7241-14", "ovs_interfaceid": "530b7241-1498-47dc-8a6f-79e6c9cc850a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:35:23 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-2d59be56-9166-42d3-b0f1-5683b51f3d94 req-3f91665d-e1b6-4ee8-82c0-e6fa462427a2 service nova] Releasing lock "refresh_cache-8acc1b10-a541-4c06-aeb7-1ecf7a2457be" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:35:23 user nova-compute[74337]: DEBUG nova.objects.instance [None req-7f6d5438-2042-417c-abb9-8dd8d6ca8600 tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Lazy-loading 'pci_requests' on Instance uuid 8acc1b10-a541-4c06-aeb7-1ecf7a2457be {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:35:23 user nova-compute[74337]: DEBUG nova.objects.base [None req-7f6d5438-2042-417c-abb9-8dd8d6ca8600 tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Object Instance<8acc1b10-a541-4c06-aeb7-1ecf7a2457be> lazy-loaded attributes: flavor,pci_requests {{(pid=74337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 21:35:23 user nova-compute[74337]: DEBUG nova.network.neutron [None req-7f6d5438-2042-417c-abb9-8dd8d6ca8600 tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] allocate_for_instance() {{(pid=74337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 21:35:23 user nova-compute[74337]: DEBUG nova.policy [None req-7f6d5438-2042-417c-abb9-8dd8d6ca8600 tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ec1a4c2d1f9b4983ab9124c7f6056da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d7baedb5f74976be4b0cf308964086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74337) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 21:35:24 user nova-compute[74337]: DEBUG nova.network.neutron [None req-7f6d5438-2042-417c-abb9-8dd8d6ca8600 tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] Successfully created port: e522a54f-9f6f-4224-a928-97d630fc5080 {{(pid=74337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 21:35:24 user nova-compute[74337]: INFO nova.compute.manager [None req-bf16da09-b9a8-47e8-820a-4488afa64d25 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] [instance: 05b80b08-f66c-4cc6-b806-f25543536bfa] Took 5.90 seconds to detach 1 volumes for instance.
Oct 23 21:35:24 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-bf16da09-b9a8-47e8-820a-4488afa64d25 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:35:24 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-bf16da09-b9a8-47e8-820a-4488afa64d25 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:35:24 user nova-compute[74337]: DEBUG os_brick.utils [None req-123ca411-4f0a-4167-b7f2-2d302925213d tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:35:24 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:24 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:24 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc28601f-2d58-4e19-b50a-68c06770680d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f34011b66e40\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:24 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:24 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:24 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[7379e3d6-4da2-4642-aa03-e433f6a3992a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:24 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:24 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:24 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf70b721-3a75-4e70-983a-f47feeae7d68]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:24 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b828f6cb-6364-42a8-8fa7-e257122f4250]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:24 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-123ca411-4f0a-4167-b7f2-2d302925213d tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Running cmd (subprocess): nvme version {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:24 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-123ca411-4f0a-4167-b7f2-2d302925213d tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] 'nvme version' failed. Not Retrying. {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 21:35:24 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-123ca411-4f0a-4167-b7f2-2d302925213d tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] nvme not present on system {{(pid=74337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 21:35:24 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:24 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 21:35:24 user nova-compute[74337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 21:35:24 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dbc0b07-d036-47d6-93a2-55a030b0512c]: (4, '') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:24 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-123ca411-4f0a-4167-b7f2-2d302925213d tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 21:35:24 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-123ca411-4f0a-4167-b7f2-2d302925213d tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 21:35:24 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-123ca411-4f0a-4167-b7f2-2d302925213d tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] LIGHTOS: no hostnqn found. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 21:35:24 user nova-compute[74337]: DEBUG os_brick.utils [None req-123ca411-4f0a-4167-b7f2-2d302925213d tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f34011b66e40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:35:24 user nova-compute[74337]: DEBUG nova.virt.block_device [None req-123ca411-4f0a-4167-b7f2-2d302925213d tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] [instance: d45e8ae8-371b-46ae-849d-d7f7d5bbd770] Updating existing volume attachment record: a795edb1-0ca9-4c02-a8c9-047a4b518ab6 {{(pid=74337) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 21:35:24 user nova-compute[74337]: DEBUG nova.network.neutron [None req-7f6d5438-2042-417c-abb9-8dd8d6ca8600 tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] Successfully updated port: e522a54f-9f6f-4224-a928-97d630fc5080 {{(pid=74337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 21:35:25 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-7f6d5438-2042-417c-abb9-8dd8d6ca8600 tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Acquiring lock "refresh_cache-8acc1b10-a541-4c06-aeb7-1ecf7a2457be" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:35:25 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-7f6d5438-2042-417c-abb9-8dd8d6ca8600 tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Acquired lock "refresh_cache-8acc1b10-a541-4c06-aeb7-1ecf7a2457be" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:35:25 user nova-compute[74337]: DEBUG nova.network.neutron [None req-7f6d5438-2042-417c-abb9-8dd8d6ca8600 tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] Building network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 21:35:25 user nova-compute[74337]: DEBUG nova.compute.manager [req-01184fdb-d901-4c68-a8c8-3baaf5056b3f req-af3aa10d-8bae-4d64-b8fa-82f027b71a9b service nova] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] Received event network-changed-e522a54f-9f6f-4224-a928-97d630fc5080 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:35:25 user nova-compute[74337]: DEBUG nova.compute.manager [req-01184fdb-d901-4c68-a8c8-3baaf5056b3f req-af3aa10d-8bae-4d64-b8fa-82f027b71a9b service nova] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] Refreshing instance network info cache due to event network-changed-e522a54f-9f6f-4224-a928-97d630fc5080. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 21:35:25 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-01184fdb-d901-4c68-a8c8-3baaf5056b3f req-af3aa10d-8bae-4d64-b8fa-82f027b71a9b service nova] Acquiring lock "refresh_cache-8acc1b10-a541-4c06-aeb7-1ecf7a2457be" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:35:25 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-bf16da09-b9a8-47e8-820a-4488afa64d25 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:35:25 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-bf16da09-b9a8-47e8-820a-4488afa64d25 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:35:25 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-bf16da09-b9a8-47e8-820a-4488afa64d25 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.487s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:35:25 user nova-compute[74337]: INFO nova.scheduler.client.report [None req-bf16da09-b9a8-47e8-820a-4488afa64d25 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Deleted allocations for instance 05b80b08-f66c-4cc6-b806-f25543536bfa
Oct 23 21:35:25 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-bf16da09-b9a8-47e8-820a-4488afa64d25 tempest-DeleteServersTestJSON-741709678 tempest-DeleteServersTestJSON-741709678-project-member] Lock "05b80b08-f66c-4cc6-b806-f25543536bfa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.472s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:35:25 user nova-compute[74337]: DEBUG nova.network.neutron [None req-7f6d5438-2042-417c-abb9-8dd8d6ca8600 tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] Updating instance_info_cache with network_info: [{"id": "530b7241-1498-47dc-8a6f-79e6c9cc850a", "address": "fa:16:3e:47:6a:0e", "network": {"id": "44c67162-ce40-4b2b-bc3e-07b0203e2083", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1341457246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84d7baedb5f74976be4b0cf308964086", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap530b7241-14", "ovs_interfaceid": "530b7241-1498-47dc-8a6f-79e6c9cc850a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e522a54f-9f6f-4224-a928-97d630fc5080", "address": "fa:16:3e:6d:56:bf", "network": {"id": "db77b1d7-f969-40a5-918c-5706fb1ec6bd", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1231224947", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "84d7baedb5f74976be4b0cf308964086", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape522a54f-9f", "ovs_interfaceid": "e522a54f-9f6f-4224-a928-97d630fc5080", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:35:25 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-7f6d5438-2042-417c-abb9-8dd8d6ca8600 tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Releasing lock "refresh_cache-8acc1b10-a541-4c06-aeb7-1ecf7a2457be" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:35:25 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-01184fdb-d901-4c68-a8c8-3baaf5056b3f req-af3aa10d-8bae-4d64-b8fa-82f027b71a9b service nova] Acquired lock "refresh_cache-8acc1b10-a541-4c06-aeb7-1ecf7a2457be" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:35:25 user nova-compute[74337]: DEBUG nova.network.neutron [req-01184fdb-d901-4c68-a8c8-3baaf5056b3f req-af3aa10d-8bae-4d64-b8fa-82f027b71a9b service nova] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] Refreshing network info cache for port e522a54f-9f6f-4224-a928-97d630fc5080 {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 21:35:25 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-7f6d5438-2042-417c-abb9-8dd8d6ca8600 tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T21:33:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1843796381',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1843796381',id=5,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAop3qssYFI+MVvFuH2+7gwm//7zwcdy6tYm9eD42fbRzv89CUtru1RL8WlSDZgdlRSrkM4Tb4QtCQmTEE7AA2YXPHv9z6iJ2d9asZLABlNx58K0PwTsdZsKKihbdIgMOg==',key_name='tempest-keypair-586099674',keypairs=<?>,launch_index=0,launched_at=2023-10-23T21:33:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='84d7baedb5f74976be4b0cf308964086',ramdisk_id='',reservation_id='r-4zf725dv',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2141482979',owner_user_name='tempest-TaggedAttachmentsTest-2141482979-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T21:33:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec1a4c2d1f9b4983ab9124c7f6056da6',uuid=8acc1b10-a541-4c06-aeb7-1ecf7a2457be,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e522a54f-9f6f-4224-a928-97d630fc5080", "address": "fa:16:3e:6d:56:bf", "network": {"id": "db77b1d7-f969-40a5-918c-5706fb1ec6bd", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1231224947", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "84d7baedb5f74976be4b0cf308964086", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape522a54f-9f", "ovs_interfaceid": "e522a54f-9f6f-4224-a928-97d630fc5080", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 21:35:25 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-7f6d5438-2042-417c-abb9-8dd8d6ca8600 tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Converting VIF {"id": "e522a54f-9f6f-4224-a928-97d630fc5080", "address": "fa:16:3e:6d:56:bf", "network": {"id": "db77b1d7-f969-40a5-918c-5706fb1ec6bd", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1231224947", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "84d7baedb5f74976be4b0cf308964086", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape522a54f-9f", "ovs_interfaceid": "e522a54f-9f6f-4224-a928-97d630fc5080", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:35:25 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-7f6d5438-2042-417c-abb9-8dd8d6ca8600 tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:56:bf,bridge_name='br-int',has_traffic_filtering=True,id=e522a54f-9f6f-4224-a928-97d630fc5080,network=Network(db77b1d7-f969-40a5-918c-5706fb1ec6bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape522a54f-9f') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:35:25 user nova-compute[74337]: DEBUG os_vif [None req-7f6d5438-2042-417c-abb9-8dd8d6ca8600 tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:56:bf,bridge_name='br-int',has_traffic_filtering=True,id=e522a54f-9f6f-4224-a928-97d630fc5080,network=Network(db77b1d7-f969-40a5-918c-5706fb1ec6bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape522a54f-9f') {{(pid=74337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 21:35:25 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:25 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:35:25 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 21:35:25 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:25 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd6aec43f-0c1f-5cf0-b695-6622a1d3841c', '_type': 'linux-noop'}}, row=False) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:35:25 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:25 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:35:25 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:25 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape522a54f-9f, may_exist=True, interface_attrs={}) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:35:25 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape522a54f-9f, col_values=(('qos', UUID('5b3356a2-e52a-4d67-8fc5-a5d8f207ce25')),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:35:25 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape522a54f-9f, col_values=(('external_ids', {'iface-id': 'e522a54f-9f6f-4224-a928-97d630fc5080', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6d:56:bf', 'vm-uuid': '8acc1b10-a541-4c06-aeb7-1ecf7a2457be'}),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:35:25 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:25 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:35:25 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:25 user nova-compute[74337]: INFO os_vif [None req-7f6d5438-2042-417c-abb9-8dd8d6ca8600 tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:56:bf,bridge_name='br-int',has_traffic_filtering=True,id=e522a54f-9f6f-4224-a928-97d630fc5080,network=Network(db77b1d7-f969-40a5-918c-5706fb1ec6bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape522a54f-9f')
Oct 23 21:35:25 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-7f6d5438-2042-417c-abb9-8dd8d6ca8600 tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T21:33:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1843796381',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1843796381',id=5,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAop3qssYFI+MVvFuH2+7gwm//7zwcdy6tYm9eD42fbRzv89CUtru1RL8WlSDZgdlRSrkM4Tb4QtCQmTEE7AA2YXPHv9z6iJ2d9asZLABlNx58K0PwTsdZsKKihbdIgMOg==',key_name='tempest-keypair-586099674',keypairs=<?>,launch_index=0,launched_at=2023-10-23T21:33:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='84d7baedb5f74976be4b0cf308964086',ramdisk_id='',reservation_id='r-4zf725dv',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2141482979',owner_user_name='tempest-TaggedAttachmentsTest-2141482979-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T21:33:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec1a4c2d1f9b4983ab9124c7f6056da6',uuid=8acc1b10-a541-4c06-aeb7-1ecf7a2457be,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e522a54f-9f6f-4224-a928-97d630fc5080", "address": "fa:16:3e:6d:56:bf", "network": {"id": "db77b1d7-f969-40a5-918c-5706fb1ec6bd", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1231224947", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "84d7baedb5f74976be4b0cf308964086", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape522a54f-9f", "ovs_interfaceid": "e522a54f-9f6f-4224-a928-97d630fc5080", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 21:35:25 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-7f6d5438-2042-417c-abb9-8dd8d6ca8600 tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Converting VIF {"id": "e522a54f-9f6f-4224-a928-97d630fc5080", "address": "fa:16:3e:6d:56:bf", "network": {"id": "db77b1d7-f969-40a5-918c-5706fb1ec6bd", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1231224947", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "84d7baedb5f74976be4b0cf308964086", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape522a54f-9f", "ovs_interfaceid": "e522a54f-9f6f-4224-a928-97d630fc5080", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:35:25 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-7f6d5438-2042-417c-abb9-8dd8d6ca8600 tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:56:bf,bridge_name='br-int',has_traffic_filtering=True,id=e522a54f-9f6f-4224-a928-97d630fc5080,network=Network(db77b1d7-f969-40a5-918c-5706fb1ec6bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape522a54f-9f') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:35:25 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-7f6d5438-2042-417c-abb9-8dd8d6ca8600 tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] attach device xml: <interface type="ethernet">
Oct 23 21:35:25 user nova-compute[74337]:   <mac address="fa:16:3e:6d:56:bf"/>
Oct 23 21:35:25 user nova-compute[74337]:   <model type="virtio"/>
Oct 23 21:35:25 user nova-compute[74337]:   <mtu size="1442"/>
Oct 23 21:35:25 user nova-compute[74337]:   <target dev="tape522a54f-9f"/>
Oct 23 21:35:25 user nova-compute[74337]: </interface>
Oct 23 21:35:25 user nova-compute[74337]:  {{(pid=74337) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 21:35:25 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:25 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:25 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:26 user nova-compute[74337]: DEBUG nova.compute.manager [req-e6b83e56-c652-49aa-afcb-e6bb5d37ff2d req-7dd947fb-8a68-4f5c-8e46-46e3587d56b0 service nova] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] Received event network-vif-plugged-e522a54f-9f6f-4224-a928-97d630fc5080 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:35:26 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-e6b83e56-c652-49aa-afcb-e6bb5d37ff2d req-7dd947fb-8a68-4f5c-8e46-46e3587d56b0 service nova] Acquiring lock "8acc1b10-a541-4c06-aeb7-1ecf7a2457be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:35:26 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-e6b83e56-c652-49aa-afcb-e6bb5d37ff2d req-7dd947fb-8a68-4f5c-8e46-46e3587d56b0 service nova] Lock "8acc1b10-a541-4c06-aeb7-1ecf7a2457be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:35:26 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-e6b83e56-c652-49aa-afcb-e6bb5d37ff2d req-7dd947fb-8a68-4f5c-8e46-46e3587d56b0 service nova] Lock "8acc1b10-a541-4c06-aeb7-1ecf7a2457be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:35:26 user nova-compute[74337]: DEBUG nova.compute.manager [req-e6b83e56-c652-49aa-afcb-e6bb5d37ff2d req-7dd947fb-8a68-4f5c-8e46-46e3587d56b0 service nova] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] No waiting events found dispatching network-vif-plugged-e522a54f-9f6f-4224-a928-97d630fc5080 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:35:26 user nova-compute[74337]: WARNING nova.compute.manager [req-e6b83e56-c652-49aa-afcb-e6bb5d37ff2d req-7dd947fb-8a68-4f5c-8e46-46e3587d56b0 service nova] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] Received unexpected event network-vif-plugged-e522a54f-9f6f-4224-a928-97d630fc5080 for instance with vm_state active and task_state None.
Oct 23 21:35:26 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-7f6d5438-2042-417c-abb9-8dd8d6ca8600 tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] No BDM found with device name vda, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 21:35:26 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-7f6d5438-2042-417c-abb9-8dd8d6ca8600 tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] No BDM found with device name hda, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 21:35:26 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-7f6d5438-2042-417c-abb9-8dd8d6ca8600 tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] No VIF found with MAC fa:16:3e:47:6a:0e, not building metadata {{(pid=74337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 21:35:26 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-7f6d5438-2042-417c-abb9-8dd8d6ca8600 tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 21:35:26 user nova-compute[74337]:   <nova:package version="0.0.0"/>
Oct 23 21:35:26 user nova-compute[74337]:   <nova:name>tempest-device-tagging-server-1843796381</nova:name>
Oct 23 21:35:26 user nova-compute[74337]:   <nova:creationTime>2023-10-23 21:35:26</nova:creationTime>
Oct 23 21:35:26 user nova-compute[74337]:   <nova:flavor name="m1.tiny">
Oct 23 21:35:26 user nova-compute[74337]:     <nova:memory>512</nova:memory>
Oct 23 21:35:26 user nova-compute[74337]:     <nova:disk>1</nova:disk>
Oct 23 21:35:26 user nova-compute[74337]:     <nova:swap>0</nova:swap>
Oct 23 21:35:26 user nova-compute[74337]:     <nova:ephemeral>0</nova:ephemeral>
Oct 23 21:35:26 user nova-compute[74337]:     <nova:vcpus>1</nova:vcpus>
Oct 23 21:35:26 user nova-compute[74337]:   </nova:flavor>
Oct 23 21:35:26 user nova-compute[74337]:   <nova:owner>
Oct 23 21:35:26 user nova-compute[74337]:     <nova:user uuid="ec1a4c2d1f9b4983ab9124c7f6056da6">tempest-TaggedAttachmentsTest-2141482979-project-member</nova:user>
Oct 23 21:35:26 user nova-compute[74337]:     <nova:project uuid="84d7baedb5f74976be4b0cf308964086">tempest-TaggedAttachmentsTest-2141482979</nova:project>
Oct 23 21:35:26 user nova-compute[74337]:   </nova:owner>
Oct 23 21:35:26 user nova-compute[74337]:   <nova:root type="image" uuid="d859d89d-998d-4109-b26a-0d6e28152932"/>
Oct 23 21:35:26 user nova-compute[74337]:   <nova:ports>
Oct 23 21:35:26 user nova-compute[74337]:     <nova:port uuid="530b7241-1498-47dc-8a6f-79e6c9cc850a">
Oct 23 21:35:26 user nova-compute[74337]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 23 21:35:26 user nova-compute[74337]:     </nova:port>
Oct 23 21:35:26 user nova-compute[74337]:     <nova:port uuid="e522a54f-9f6f-4224-a928-97d630fc5080">
Oct 23 21:35:26 user nova-compute[74337]:       <nova:ip type="fixed" address="10.10.10.139" ipVersion="4"/>
Oct 23 21:35:26 user nova-compute[74337]:     </nova:port>
Oct 23 21:35:26 user nova-compute[74337]:   </nova:ports>
Oct 23 21:35:26 user nova-compute[74337]: </nova:instance>
Oct 23 21:35:26 user nova-compute[74337]:  {{(pid=74337) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Oct 23 21:35:26 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-7f6d5438-2042-417c-abb9-8dd8d6ca8600 tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Lock "interface-8acc1b10-a541-4c06-aeb7-1ecf7a2457be-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 2.833s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:35:26 user nova-compute[74337]: DEBUG nova.network.neutron [req-01184fdb-d901-4c68-a8c8-3baaf5056b3f req-af3aa10d-8bae-4d64-b8fa-82f027b71a9b service nova] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] Updated VIF entry in instance network info cache for port e522a54f-9f6f-4224-a928-97d630fc5080. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 21:35:26 user nova-compute[74337]: DEBUG nova.network.neutron [req-01184fdb-d901-4c68-a8c8-3baaf5056b3f req-af3aa10d-8bae-4d64-b8fa-82f027b71a9b service nova] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] Updating instance_info_cache with network_info: [{"id": "530b7241-1498-47dc-8a6f-79e6c9cc850a", "address": "fa:16:3e:47:6a:0e", "network": {"id": "44c67162-ce40-4b2b-bc3e-07b0203e2083", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1341457246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84d7baedb5f74976be4b0cf308964086", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap530b7241-14", "ovs_interfaceid": "530b7241-1498-47dc-8a6f-79e6c9cc850a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e522a54f-9f6f-4224-a928-97d630fc5080", "address": "fa:16:3e:6d:56:bf", "network": {"id": "db77b1d7-f969-40a5-918c-5706fb1ec6bd", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1231224947", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "84d7baedb5f74976be4b0cf308964086", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape522a54f-9f", "ovs_interfaceid": "e522a54f-9f6f-4224-a928-97d630fc5080", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:35:26 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-01184fdb-d901-4c68-a8c8-3baaf5056b3f req-af3aa10d-8bae-4d64-b8fa-82f027b71a9b service nova] Releasing lock "refresh_cache-8acc1b10-a541-4c06-aeb7-1ecf7a2457be" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:35:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:27 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:28 user nova-compute[74337]: DEBUG nova.compute.manager [req-52e87370-419b-4d80-9407-196463dfdf96 req-4bf15d4b-4a38-4278-b63f-43ffa309c8da service nova] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] Received event network-vif-plugged-e522a54f-9f6f-4224-a928-97d630fc5080 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:35:28 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-52e87370-419b-4d80-9407-196463dfdf96 req-4bf15d4b-4a38-4278-b63f-43ffa309c8da service nova] Acquiring lock "8acc1b10-a541-4c06-aeb7-1ecf7a2457be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:35:28 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-52e87370-419b-4d80-9407-196463dfdf96 req-4bf15d4b-4a38-4278-b63f-43ffa309c8da service nova] Lock "8acc1b10-a541-4c06-aeb7-1ecf7a2457be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:35:28 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-52e87370-419b-4d80-9407-196463dfdf96 req-4bf15d4b-4a38-4278-b63f-43ffa309c8da service nova] Lock "8acc1b10-a541-4c06-aeb7-1ecf7a2457be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:35:28 user nova-compute[74337]: DEBUG nova.compute.manager [req-52e87370-419b-4d80-9407-196463dfdf96 req-4bf15d4b-4a38-4278-b63f-43ffa309c8da service nova] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] No waiting events found dispatching network-vif-plugged-e522a54f-9f6f-4224-a928-97d630fc5080 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:35:28 user nova-compute[74337]: WARNING nova.compute.manager [req-52e87370-419b-4d80-9407-196463dfdf96 req-4bf15d4b-4a38-4278-b63f-43ffa309c8da service nova] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] Received unexpected event network-vif-plugged-e522a54f-9f6f-4224-a928-97d630fc5080 for instance with vm_state active and task_state None.
Oct 23 21:35:29 user nova-compute[74337]: DEBUG nova.compute.manager [req-4f515035-e048-42e4-9779-306acab544d6 req-8cdeb670-0203-4d98-8ad6-5cd741c795df service nova] [instance: ff1c790c-2458-438e-95c7-7e1412fe05fc] Received event network-changed-ff6c7795-2085-4305-b0aa-72050c9b979b {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:35:29 user nova-compute[74337]: DEBUG nova.compute.manager [req-4f515035-e048-42e4-9779-306acab544d6 req-8cdeb670-0203-4d98-8ad6-5cd741c795df service nova] [instance: ff1c790c-2458-438e-95c7-7e1412fe05fc] Refreshing instance network info cache due to event network-changed-ff6c7795-2085-4305-b0aa-72050c9b979b. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 21:35:29 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-4f515035-e048-42e4-9779-306acab544d6 req-8cdeb670-0203-4d98-8ad6-5cd741c795df service nova] Acquiring lock "refresh_cache-ff1c790c-2458-438e-95c7-7e1412fe05fc" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:35:29 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-4f515035-e048-42e4-9779-306acab544d6 req-8cdeb670-0203-4d98-8ad6-5cd741c795df service nova] Acquired lock "refresh_cache-ff1c790c-2458-438e-95c7-7e1412fe05fc" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:35:29 user nova-compute[74337]: DEBUG nova.network.neutron [req-4f515035-e048-42e4-9779-306acab544d6 req-8cdeb670-0203-4d98-8ad6-5cd741c795df service nova] [instance: ff1c790c-2458-438e-95c7-7e1412fe05fc] Refreshing network info cache for port ff6c7795-2085-4305-b0aa-72050c9b979b {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 21:35:30 user nova-compute[74337]: DEBUG nova.network.neutron [req-4f515035-e048-42e4-9779-306acab544d6 req-8cdeb670-0203-4d98-8ad6-5cd741c795df service nova] [instance: ff1c790c-2458-438e-95c7-7e1412fe05fc] Updated VIF entry in instance network info cache for port ff6c7795-2085-4305-b0aa-72050c9b979b. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 21:35:30 user nova-compute[74337]: DEBUG nova.network.neutron [req-4f515035-e048-42e4-9779-306acab544d6 req-8cdeb670-0203-4d98-8ad6-5cd741c795df service nova] [instance: ff1c790c-2458-438e-95c7-7e1412fe05fc] Updating instance_info_cache with network_info: [{"id": "ff6c7795-2085-4305-b0aa-72050c9b979b", "address": "fa:16:3e:0c:4d:a8", "network": {"id": "44287c31-0a66-49b2-a43f-9197e80d754e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1903058995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8974716be54b402a8d6b91a30e71f480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff6c7795-20", "ovs_interfaceid": "ff6c7795-2085-4305-b0aa-72050c9b979b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:35:30 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-4f515035-e048-42e4-9779-306acab544d6 req-8cdeb670-0203-4d98-8ad6-5cd741c795df service nova] Releasing lock "refresh_cache-ff1c790c-2458-438e-95c7-7e1412fe05fc" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:35:30 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:32 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:33 user nova-compute[74337]: DEBUG nova.compute.manager [req-bdc80114-dfba-4a7d-a0ab-09484d1a15b1 req-bcf8b2de-1123-485c-a08a-a6dab7a09c47 service nova] [instance: 5a181593-8086-4ece-9f5b-5ccba0bfe91e] Received event network-changed-b1c5ce36-994a-4a4d-9027-6e3716b2d8f5 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:35:33 user nova-compute[74337]: DEBUG nova.compute.manager [req-bdc80114-dfba-4a7d-a0ab-09484d1a15b1 req-bcf8b2de-1123-485c-a08a-a6dab7a09c47 service nova] [instance: 5a181593-8086-4ece-9f5b-5ccba0bfe91e] Refreshing instance network info cache due to event network-changed-b1c5ce36-994a-4a4d-9027-6e3716b2d8f5. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 21:35:33 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-bdc80114-dfba-4a7d-a0ab-09484d1a15b1 req-bcf8b2de-1123-485c-a08a-a6dab7a09c47 service nova] Acquiring lock "refresh_cache-5a181593-8086-4ece-9f5b-5ccba0bfe91e" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:35:33 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-bdc80114-dfba-4a7d-a0ab-09484d1a15b1 req-bcf8b2de-1123-485c-a08a-a6dab7a09c47 service nova] Acquired lock "refresh_cache-5a181593-8086-4ece-9f5b-5ccba0bfe91e" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:35:33 user nova-compute[74337]: DEBUG nova.network.neutron [req-bdc80114-dfba-4a7d-a0ab-09484d1a15b1 req-bcf8b2de-1123-485c-a08a-a6dab7a09c47 service nova] [instance: 5a181593-8086-4ece-9f5b-5ccba0bfe91e] Refreshing network info cache for port b1c5ce36-994a-4a4d-9027-6e3716b2d8f5 {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 21:35:33 user nova-compute[74337]: DEBUG nova.network.neutron [req-bdc80114-dfba-4a7d-a0ab-09484d1a15b1 req-bcf8b2de-1123-485c-a08a-a6dab7a09c47 service nova] [instance: 5a181593-8086-4ece-9f5b-5ccba0bfe91e] Updated VIF entry in instance network info cache for port b1c5ce36-994a-4a4d-9027-6e3716b2d8f5. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 21:35:33 user nova-compute[74337]: DEBUG nova.network.neutron [req-bdc80114-dfba-4a7d-a0ab-09484d1a15b1 req-bcf8b2de-1123-485c-a08a-a6dab7a09c47 service nova] [instance: 5a181593-8086-4ece-9f5b-5ccba0bfe91e] Updating instance_info_cache with network_info: [{"id": "b1c5ce36-994a-4a4d-9027-6e3716b2d8f5", "address": "fa:16:3e:9a:56:5a", "network": {"id": "41a76d3f-a889-4294-bdc5-d9175a403158", "bridge": "br-int", "label": "tempest-TestVolumeSwap-237128553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "222c613ffcb647f183ef412107337c74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1c5ce36-99", "ovs_interfaceid": "b1c5ce36-994a-4a4d-9027-6e3716b2d8f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:35:33 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-bdc80114-dfba-4a7d-a0ab-09484d1a15b1 req-bcf8b2de-1123-485c-a08a-a6dab7a09c47 service nova] Releasing lock "refresh_cache-5a181593-8086-4ece-9f5b-5ccba0bfe91e" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:35:35 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:35 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-b7a2d4f3-30e3-4523-8957-76098f28464f tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Acquiring lock "8acc1b10-a541-4c06-aeb7-1ecf7a2457be" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:35:35 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-b7a2d4f3-30e3-4523-8957-76098f28464f tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Lock "8acc1b10-a541-4c06-aeb7-1ecf7a2457be" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:35:35 user nova-compute[74337]: DEBUG nova.objects.instance [None req-b7a2d4f3-30e3-4523-8957-76098f28464f tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Lazy-loading 'flavor' on Instance uuid 8acc1b10-a541-4c06-aeb7-1ecf7a2457be {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:35:35 user nova-compute[74337]: DEBUG nova.compute.manager [req-cfc59040-a5fc-4e6c-a51b-867676da207e req-b1ad82ab-eac4-4442-a61e-142acb2e015c service nova] [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d] Received event network-changed-36e0b911-4cb9-4b24-bcb2-e44022f7f3d4 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:35:35 user nova-compute[74337]: DEBUG nova.compute.manager [req-cfc59040-a5fc-4e6c-a51b-867676da207e req-b1ad82ab-eac4-4442-a61e-142acb2e015c service nova] [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d] Refreshing instance network info cache due to event network-changed-36e0b911-4cb9-4b24-bcb2-e44022f7f3d4. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 21:35:35 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-cfc59040-a5fc-4e6c-a51b-867676da207e req-b1ad82ab-eac4-4442-a61e-142acb2e015c service nova] Acquiring lock "refresh_cache-a4bf4723-1e3c-42f1-a422-9d9263b67e3d" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:35:35 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-cfc59040-a5fc-4e6c-a51b-867676da207e req-b1ad82ab-eac4-4442-a61e-142acb2e015c service nova] Acquired lock "refresh_cache-a4bf4723-1e3c-42f1-a422-9d9263b67e3d" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:35:35 user nova-compute[74337]: DEBUG nova.network.neutron [req-cfc59040-a5fc-4e6c-a51b-867676da207e req-b1ad82ab-eac4-4442-a61e-142acb2e015c service nova] [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d] Refreshing network info cache for port 36e0b911-4cb9-4b24-bcb2-e44022f7f3d4 {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 21:35:35 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-b7a2d4f3-30e3-4523-8957-76098f28464f tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Lock "8acc1b10-a541-4c06-aeb7-1ecf7a2457be" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:35:36 user nova-compute[74337]: DEBUG nova.network.neutron [req-cfc59040-a5fc-4e6c-a51b-867676da207e req-b1ad82ab-eac4-4442-a61e-142acb2e015c service nova] [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d] Updated VIF entry in instance network info cache for port 36e0b911-4cb9-4b24-bcb2-e44022f7f3d4. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 21:35:36 user nova-compute[74337]: DEBUG nova.network.neutron [req-cfc59040-a5fc-4e6c-a51b-867676da207e req-b1ad82ab-eac4-4442-a61e-142acb2e015c service nova] [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d] Updating instance_info_cache with network_info: [{"id": "36e0b911-4cb9-4b24-bcb2-e44022f7f3d4", "address": "fa:16:3e:9f:d4:56", "network": {"id": "0891479c-8d7d-4e74-be06-51d2ecbcdef8", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1955051047-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85815ae529d347c48efe797a4722025d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36e0b911-4c", "ovs_interfaceid": "36e0b911-4cb9-4b24-bcb2-e44022f7f3d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:35:36 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-cfc59040-a5fc-4e6c-a51b-867676da207e req-b1ad82ab-eac4-4442-a61e-142acb2e015c service nova] Releasing lock "refresh_cache-a4bf4723-1e3c-42f1-a422-9d9263b67e3d" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:35:36 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-26529aa8-c814-41d6-a5c9-56a21910ddc7 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Acquiring lock "5a181593-8086-4ece-9f5b-5ccba0bfe91e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:35:36 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-26529aa8-c814-41d6-a5c9-56a21910ddc7 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Lock "5a181593-8086-4ece-9f5b-5ccba0bfe91e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:35:36 user nova-compute[74337]: DEBUG nova.objects.instance [None req-26529aa8-c814-41d6-a5c9-56a21910ddc7 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Lazy-loading 'flavor' on Instance uuid 5a181593-8086-4ece-9f5b-5ccba0bfe91e {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:35:36 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-26529aa8-c814-41d6-a5c9-56a21910ddc7 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Lock "5a181593-8086-4ece-9f5b-5ccba0bfe91e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:35:36 user nova-compute[74337]: INFO nova.virt.block_device [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Booting with volume b8aea79a-53dd-4442-8470-dc68c6351496 at /dev/vdc
Oct 23 21:35:36 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4e356b53-325c-430d-a2e8-027becc1feec tempest-VolumesAssistedSnapshotsTest-1195398017 tempest-VolumesAssistedSnapshotsTest-1195398017-project-admin] Acquiring lock "a4bf4723-1e3c-42f1-a422-9d9263b67e3d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:35:36 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4e356b53-325c-430d-a2e8-027becc1feec tempest-VolumesAssistedSnapshotsTest-1195398017 tempest-VolumesAssistedSnapshotsTest-1195398017-project-admin] Lock "a4bf4723-1e3c-42f1-a422-9d9263b67e3d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:35:36 user nova-compute[74337]: DEBUG nova.objects.instance [None req-4e356b53-325c-430d-a2e8-027becc1feec tempest-VolumesAssistedSnapshotsTest-1195398017 tempest-VolumesAssistedSnapshotsTest-1195398017-project-admin] Lazy-loading 'flavor' on Instance uuid a4bf4723-1e3c-42f1-a422-9d9263b67e3d {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:35:36 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4e356b53-325c-430d-a2e8-027becc1feec tempest-VolumesAssistedSnapshotsTest-1195398017 tempest-VolumesAssistedSnapshotsTest-1195398017-project-admin] Lock "a4bf4723-1e3c-42f1-a422-9d9263b67e3d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.081s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:35:36 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-b7a2d4f3-30e3-4523-8957-76098f28464f tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Acquiring lock "8acc1b10-a541-4c06-aeb7-1ecf7a2457be" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:35:36 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-b7a2d4f3-30e3-4523-8957-76098f28464f tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Lock "8acc1b10-a541-4c06-aeb7-1ecf7a2457be" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:35:36 user nova-compute[74337]: INFO nova.compute.manager [None req-b7a2d4f3-30e3-4523-8957-76098f28464f tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] Attaching volume a5ca53bf-8b08-42d0-976a-cb925d353ee7 to /dev/vdb
Oct 23 21:35:36 user nova-compute[74337]: DEBUG os_brick.utils [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:35:36 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:36 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:36 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[265c8868-ace4-40dc-9641-ad02c2594a76]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f34011b66e40\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:36 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:36 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:36 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e393f0c-713c-4ec1-b411-0797fe0ccacc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:36 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:36 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:36 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d037d6-3110-495c-9015-3c7532c301c0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:36 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[78fed613-6bae-4c58-860a-7982d8094415]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:36 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Running cmd (subprocess): nvme version {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:36 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] 'nvme version' failed. Not Retrying. {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 21:35:36 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] nvme not present on system {{(pid=74337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 21:35:36 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:36 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 21:35:36 user nova-compute[74337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 21:35:36 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[7626f998-7c7f-4e19-a9db-c299599c5bf7]: (4, '') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:36 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 21:35:36 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 21:35:36 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] LIGHTOS: no hostnqn found. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 21:35:36 user nova-compute[74337]: DEBUG os_brick.utils [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f34011b66e40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:35:36 user nova-compute[74337]: DEBUG nova.virt.block_device [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Updating existing volume attachment record: d3064f9c-2f1c-49b0-b61e-7e4f16c10fbb {{(pid=74337) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 21:35:36 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-26529aa8-c814-41d6-a5c9-56a21910ddc7 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Acquiring lock "5a181593-8086-4ece-9f5b-5ccba0bfe91e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:35:36 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-26529aa8-c814-41d6-a5c9-56a21910ddc7 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Lock "5a181593-8086-4ece-9f5b-5ccba0bfe91e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:35:36 user nova-compute[74337]: INFO nova.compute.manager [None req-26529aa8-c814-41d6-a5c9-56a21910ddc7 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] [instance: 5a181593-8086-4ece-9f5b-5ccba0bfe91e] Attaching volume 06d4748a-a032-4937-a18b-c323e56f507f to /dev/vdb
Oct 23 21:35:36 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:36 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4e356b53-325c-430d-a2e8-027becc1feec tempest-VolumesAssistedSnapshotsTest-1195398017 tempest-VolumesAssistedSnapshotsTest-1195398017-project-admin] Acquiring lock "a4bf4723-1e3c-42f1-a422-9d9263b67e3d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:35:36 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4e356b53-325c-430d-a2e8-027becc1feec tempest-VolumesAssistedSnapshotsTest-1195398017 tempest-VolumesAssistedSnapshotsTest-1195398017-project-admin] Lock "a4bf4723-1e3c-42f1-a422-9d9263b67e3d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:35:36 user nova-compute[74337]: INFO nova.compute.manager [None req-4e356b53-325c-430d-a2e8-027becc1feec tempest-VolumesAssistedSnapshotsTest-1195398017 tempest-VolumesAssistedSnapshotsTest-1195398017-project-admin] [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d] Attaching volume d827c0c9-ec2a-45ec-927e-41fad52ffdb0 to /dev/vdb
Oct 23 21:35:37 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:40 user nova-compute[74337]: DEBUG os_brick.utils [None req-b7a2d4f3-30e3-4523-8957-76098f28464f tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:35:40 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:40 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:40 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f8f83e6-00e2-4aee-a169-351c3e2caa74]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f34011b66e40\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:40 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:40 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:40 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef2626a-6309-47a0-9bfe-d97001bf34bd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:40 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:40 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:40 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[490ca771-5e8e-461d-9123-991e1cce6966]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:40 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[1daf3e63-70a3-4b52-8469-d24c7ead78cf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:40 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-b7a2d4f3-30e3-4523-8957-76098f28464f tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Running cmd (subprocess): nvme version {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:40 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-b7a2d4f3-30e3-4523-8957-76098f28464f tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] 'nvme version' failed. Not Retrying. {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 21:35:40 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b7a2d4f3-30e3-4523-8957-76098f28464f tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] nvme not present on system {{(pid=74337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 21:35:40 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:40 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 21:35:40 user nova-compute[74337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 21:35:40 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[46eca90b-303b-4241-a494-44429eebe998]: (4, '') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:40 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-b7a2d4f3-30e3-4523-8957-76098f28464f tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 21:35:40 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-b7a2d4f3-30e3-4523-8957-76098f28464f tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 21:35:40 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-b7a2d4f3-30e3-4523-8957-76098f28464f tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] LIGHTOS: no hostnqn found. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 21:35:40 user nova-compute[74337]: DEBUG os_brick.utils [None req-b7a2d4f3-30e3-4523-8957-76098f28464f tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] <== get_connector_properties: return (107ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f34011b66e40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:35:40 user nova-compute[74337]: DEBUG nova.virt.block_device [None req-b7a2d4f3-30e3-4523-8957-76098f28464f tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] Updating existing volume attachment record: 10d14ca7-13b2-4dbf-bdff-a192db309c3d {{(pid=74337) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 21:35:40 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG os_brick.utils [None req-26529aa8-c814-41d6-a5c9-56a21910ddc7 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cbac8ac-38fe-44fe-a2cf-cdc1e8e9267d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f34011b66e40\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b27faf-abc2-4400-ad1d-26fe92202c33]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf4f54e3-a409-4a72-9556-443fab305622]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d09f9ab2-a475-4b13-8e17-cbc5ef6e3b8d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-26529aa8-c814-41d6-a5c9-56a21910ddc7 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Running cmd (subprocess): nvme version {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-26529aa8-c814-41d6-a5c9-56a21910ddc7 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] 'nvme version' failed. Not Retrying. {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-26529aa8-c814-41d6-a5c9-56a21910ddc7 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] nvme not present on system {{(pid=74337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG os_brick.utils [None req-4e356b53-325c-430d-a2e8-027becc1feec tempest-VolumesAssistedSnapshotsTest-1195398017 tempest-VolumesAssistedSnapshotsTest-1195398017-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 21:35:41 user nova-compute[74337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 21:35:41 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c7f5fd4-7949-44f8-b701-6174c3580cd7]: (4, '') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-26529aa8-c814-41d6-a5c9-56a21910ddc7 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-26529aa8-c814-41d6-a5c9-56a21910ddc7 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-26529aa8-c814-41d6-a5c9-56a21910ddc7 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] LIGHTOS: no hostnqn found. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG os_brick.utils [None req-26529aa8-c814-41d6-a5c9-56a21910ddc7 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f34011b66e40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG nova.virt.block_device [None req-26529aa8-c814-41d6-a5c9-56a21910ddc7 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] [instance: 5a181593-8086-4ece-9f5b-5ccba0bfe91e] Updating existing volume attachment record: 48076b27-60cb-47b1-92b8-f819d48422af {{(pid=74337) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9b80cd3-270e-4bf4-b154-bf6022e4a501]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f34011b66e40\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a289f9c-e4d8-4d3b-bc0e-a4c8692b595e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[81bd1535-a573-4526-9a7a-cb69ad8a4df2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbc64e27-ab80-43bd-bb80-5676137469fd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-4e356b53-325c-430d-a2e8-027becc1feec tempest-VolumesAssistedSnapshotsTest-1195398017 tempest-VolumesAssistedSnapshotsTest-1195398017-project-admin] Running cmd (subprocess): nvme version {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-4e356b53-325c-430d-a2e8-027becc1feec tempest-VolumesAssistedSnapshotsTest-1195398017 tempest-VolumesAssistedSnapshotsTest-1195398017-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4e356b53-325c-430d-a2e8-027becc1feec tempest-VolumesAssistedSnapshotsTest-1195398017 tempest-VolumesAssistedSnapshotsTest-1195398017-project-admin] nvme not present on system {{(pid=74337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG nova.compute.manager [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Start spawning the instance on the hypervisor. {{(pid=74337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Creating instance directory {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 21:35:41 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Creating image(s)
Oct 23 21:35:41 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Did not create local disks {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Ensure instance console log exists: /opt/stack/data/nova/instances/f1040399-0c5d-4a68-9ee0-4fbe45a42c55/console.log {{(pid=74337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Start _get_guest_xml network_info=[{"id": "58eb51e5-3d74-4162-93b8-66bdf176c1d5", "address": "fa:16:3e:53:ba:1b", "network": {"id": "54ea29fa-daa7-4818-8d2d-c90ee9a18a95", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1215215856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58eb51e5-3d", "ovs_interfaceid": "58eb51e5-3d74-4162-93b8-66bdf176c1d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dd8e8982-b86c-469a-aa55-72bb2ac9bb8b", "address": "fa:16:3e:67:90:76", "network": {"id": "8b22a426-2945-474d-b0e6-8c22bb5e57e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-57423842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd8e8982-b8", "ovs_interfaceid": "dd8e8982-b86c-469a-aa55-72bb2ac9bb8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e91aa55a-4a71-4090-bdde-88c4a648b60b", "address": "fa:16:3e:45:60:43", "network": {"id": "8b22a426-2945-474d-b0e6-8c22bb5e57e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-57423842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape91aa55a-4a", "ovs_interfaceid": "e91aa55a-4a71-4090-bdde-88c4a648b60b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ddee6c78-417b-494f-a9e1-f662c549f425", "address": "fa:16:3e:fb:ef:75", "network": {"id": "8b22a426-2945-474d-b0e6-8c22bb5e57e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-57423842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddee6c78-41", "ovs_interfaceid": "ddee6c78-417b-494f-a9e1-f662c549f425", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b1664585-4013-46f9-9738-33fd7b9a3161", "address": "fa:16:3e:e8:30:72", "network": {"id": "8b22a426-2945-474d-b0e6-8c22bb5e57e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-57423842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1664585-40", "ovs_interfaceid": "b1664585-4013-46f9-9738-33fd7b9a3161", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ba01b035-453b-4378-92fc-1d81b84363ff", "address": "fa:16:3e:89:cb:12", "network": {"id": "cd8ce1ca-56b3-48fa-bb57-54d0616aa7ca", "bridge": "br-int", "label": "tempest-device-tagging-net2-611360182", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba01b035-45", "ovs_interfaceid": "ba01b035-453b-4378-92fc-1d81b84363ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "248131be-39a9-430f-b27a-377d176d7846", "address": "fa:16:3e:5d:ae:b7", "network": {"id": "cd8ce1ca-56b3-48fa-bb57-54d0616aa7ca", "bridge": "br-int", "label": "tempest-device-tagging-net2-611360182", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap248131be-39", "ovs_interfaceid": "248131be-39a9-430f-b27a-377d176d7846", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T21:29:21Z,direct_url=<?>,disk_format='qcow2',id=d859d89d-998d-4109-b26a-0d6e28152932,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ff43462300764979a6cf688444336a56',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T21:29:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'c1b5c2e8-5d5f-4b41-9ea1-52608f008b08', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jfJFOLaK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f1040399-0c5d-4a68-9ee0-4fbe45a42c55', 'attached_at': '', 'detached_at': '', 'volume_id': '694e3124-c6ed-4079-82c0-18f56c369932', 'serial': '694e3124-c6ed-4079-82c0-18f56c369932'}, 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None}, {'attachment_id': 'da83b846-0a87-4920-8bfc-40a3675a9d51', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': 1, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ASuFjTKn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f1040399-0c5d-4a68-9ee0-4fbe45a42c55', 'attached_at': '', 'detached_at': '', 'volume_id': 'b9f5f7ce-c27e-4cf5-9da5-704ff383354b', 'serial': 'b9f5f7ce-c27e-4cf5-9da5-704ff383354b'}, 'guest_format': None, 'mount_device': '/dev/vdb', 'volume_type': None}, {'attachment_id': '331f7dbe-f549-4d6b-ac6d-9ee6ba3bef98', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': 2, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MbXvPrkW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f1040399-0c5d-4a68-9ee0-4fbe45a42c55', 'attached_at': '', 'detached_at': '', 'volume_id': '3b15e515-43f3-4748-a86a-bb348b5b38c0', 'serial': '3b15e515-43f3-4748-a86a-bb348b5b38c0'}, 'guest_format': None, 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 21:35:41 user nova-compute[74337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 21:35:41 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[21968058-d42b-41fe-9926-52b73cca5022]: (4, '') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-4e356b53-325c-430d-a2e8-027becc1feec tempest-VolumesAssistedSnapshotsTest-1195398017 tempest-VolumesAssistedSnapshotsTest-1195398017-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-4e356b53-325c-430d-a2e8-027becc1feec tempest-VolumesAssistedSnapshotsTest-1195398017 tempest-VolumesAssistedSnapshotsTest-1195398017-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-4e356b53-325c-430d-a2e8-027becc1feec tempest-VolumesAssistedSnapshotsTest-1195398017 tempest-VolumesAssistedSnapshotsTest-1195398017-project-admin] LIGHTOS: no hostnqn found. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG os_brick.utils [None req-4e356b53-325c-430d-a2e8-027becc1feec tempest-VolumesAssistedSnapshotsTest-1195398017 tempest-VolumesAssistedSnapshotsTest-1195398017-project-admin] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f34011b66e40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG nova.virt.block_device [None req-4e356b53-325c-430d-a2e8-027becc1feec tempest-VolumesAssistedSnapshotsTest-1195398017 tempest-VolumesAssistedSnapshotsTest-1195398017-project-admin] [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d] Updating existing volume attachment record: ef59f206-fb26-4b36-afe7-f6306bdb389b {{(pid=74337) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 21:35:41 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:35:41 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:35:41 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] CPU controller missing on host. {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] CPU controller found on host. {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T21:29:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T21:29:21Z,direct_url=<?>,disk_format='qcow2',id=d859d89d-998d-4109-b26a-0d6e28152932,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ff43462300764979a6cf688444336a56',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T21:29:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Flavor limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Image limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Flavor pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Image pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Got 1 possible topologies {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Calling os-brick to attach iSCSI Volume {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jfJFOLaK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:35:41 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:35:41 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:35:41 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:35:41 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:35:41 user nova-compute[74337]: INFO os_brick.initiator.connectors.iscsi [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 21:35:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 -p 172.16.0.220:3260 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[698630ea-a378-4153-9115-9af92a02fc4b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 21:35:41 user nova-compute[74337]:  {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 -p 172.16.0.220:3260 --interface default --op new {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[11553ef2-c6e2-4a8c-ae36-9242b84c85a1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932] added\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932] added
Oct 23 21:35:41 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d38ae5ef-4aa3-4f5a-8df4-9649f5e4b666]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[23cc57dc-86f9-40ec-9615-b8693176472e]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jfJFOLaK {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jfJFOLaK" returned: 0 in 0.022s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[1829c987-08a7-4b3a-b185-282d1f345464]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jfJFOLaK'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[08e3a777-00f2-42f4-b0ae-c031777d1f13]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f3c8d25-47f1-4043-9656-3f622a22c6d8]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 23 21:35:41 user nova-compute[74337]:  {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 23 21:35:41 user nova-compute[74337]:  {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:35:41 user nova-compute[74337]: WARNING os_brick.initiator.connectors.iscsi [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 23 21:35:41 user nova-compute[74337]: 
Oct 23 21:35:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 -p 172.16.0.220:3260 --login {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[69986f29-d4f2-420e-bd42-76c45bc78243]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932, portal: 172.16.0.220,3260]
Oct 23 21:35:41 user nova-compute[74337]: Login to [iface: default, target: iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932, portal: 172.16.0.220,3260] successful.
Oct 23 21:35:41 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[8399e8a7-29d5-4f01-991d-d636b53ec061]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f64dea7-e8a1-427c-8edf-579fe1140e23]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)
Oct 23 21:35:41 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)
Oct 23 21:35:41 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Connected to 172.16.0.220:3260 {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] HCTL ('33', '-', '-', 0) found on session 3 with lun 0 {{(pid=74337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c88a6d-951d-4f3c-9031-7f02d80fb661]: (4, ('- - 0', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:41 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Searching for a device in session 3 and hctl ['33', '*', '*', 0] yield: None {{(pid=74337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 21:35:42 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Searching for a device in session 3 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 21:35:42 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jfJFOLaK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 21:35:42 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:35:42 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '26138646530303566', 'path': '/dev/sdb'} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:35:42 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26138646530303566', 'path': '/dev/sdb'} {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 21:35:42 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Calling os-brick to attach iSCSI Volume {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 21:35:42 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ASuFjTKn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:35:42 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:35:42 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:35:42 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:35:42 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:35:42 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:35:42 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:35:42 user nova-compute[74337]: INFO os_brick.initiator.connectors.iscsi [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 21:35:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b -p 172.16.0.220:3260 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:42 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f909f44-3a57-4006-ab0a-2994d41abcd6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:42 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 21:35:42 user nova-compute[74337]:  {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:35:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b -p 172.16.0.220:3260 --interface default --op new {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:42 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f17cecb-449d-43a6-9e52-1a1dbbda7b9e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b] added\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:42 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b] added
Oct 23 21:35:42 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:35:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:42 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1a1453-017a-466d-bdbc-57e37ff40758]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:42 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:35:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:42 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd300ed1-34d1-4d8a-86d3-05f6033a694d]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:42 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:35:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ASuFjTKn {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ASuFjTKn" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:42 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d527be7f-cb73-475f-b530-5530786bb58c]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:42 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ASuFjTKn'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:35:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:42 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:42 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ea4302f-f959-4fb1-8031-7031c0aa7dfb]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:42 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:35:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:42 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9ccba9c-17bb-4554-912f-d46a6a960966]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:42 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)
Oct 23 21:35:42 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:35:42 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)
Oct 23 21:35:42 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:35:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b -p 172.16.0.220:3260 --login {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:42 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d55f4d0c-799b-4d77-8d76-b7821d50bbc2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:42 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b, portal: 172.16.0.220,3260]
Oct 23 21:35:42 user nova-compute[74337]: Login to [iface: default, target: iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b, portal: 172.16.0.220,3260] successful.
Oct 23 21:35:42 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:35:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:42 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c058142-296a-4439-b274-1f477c9d6df1]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:42 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:35:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:42 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[39546188-a738-4139-b9dc-965d625cf85a]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:42 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)
Oct 23 21:35:42 user nova-compute[74337]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b (non-flash)
Oct 23 21:35:42 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:35:42 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)
Oct 23 21:35:42 user nova-compute[74337]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b (non-flash)
Oct 23 21:35:42 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:35:42 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:35:42 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Connected to 172.16.0.220:3260 {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 21:35:42 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] HCTL ('34', '-', '-', 0) found on session 4 with lun 0 {{(pid=74337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 21:35:42 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 21:35:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:42 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[805a9b98-abbe-4457-8942-4b9f0ea68f6f]: (4, ('- - 0', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:42 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Searching for a device in session 4 and hctl ['34', '*', '*', 0] yield: None {{(pid=74337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 21:35:43 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Searching for a device in session 4 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 21:35:43 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ASuFjTKn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 21:35:43 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:35:44 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '23739373138656135', 'path': '/dev/sdc'} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:35:44 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23739373138656135', 'path': '/dev/sdc'} {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 21:35:44 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Calling os-brick to attach iSCSI Volume {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 21:35:44 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MbXvPrkW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:35:44 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:35:44 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:35:44 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:35:44 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:35:44 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:35:44 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:35:44 user nova-compute[74337]: INFO os_brick.initiator.connectors.iscsi [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 21:35:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 -p 172.16.0.220:3260 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:44 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2453361-440a-4345-ac55-ddd0351ac209]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:44 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 21:35:44 user nova-compute[74337]:  {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:35:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:44 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[71d04991-dc67-4ad6-ad01-600fc08c8f4f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0] added\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:44 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0] added
Oct 23 21:35:44 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:35:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:44 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[77ebae18-5c89-44a5-a5ff-01687206d531]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:44 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:35:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:44 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c357a96-1b30-4eb7-92a1-f380e7fb951d]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:44 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:35:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MbXvPrkW {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MbXvPrkW" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:44 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9b83695-5389-46ed-b73e-6004c50136b9]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:44 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MbXvPrkW'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:35:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:44 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-123ca411-4f0a-4167-b7f2-2d302925213d tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] [instance: d45e8ae8-371b-46ae-849d-d7f7d5bbd770] Calling os-brick to attach iSCSI Volume {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 21:35:44 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-123ca411-4f0a-4167-b7f2-2d302925213d tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2f364c63-50fe-482f-a6e7-c234b5b9bec9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kJhBuLVb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:35:44 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-123ca411-4f0a-4167-b7f2-2d302925213d tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:35:44 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-123ca411-4f0a-4167-b7f2-2d302925213d tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:35:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:44 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d7a20a1-ac5a-4bea-9fd2-6797ca0d2cce]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:44 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:35:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:44 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[adedf6c5-d356-48fd-b709-271cd2bb6007]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:44 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)
Oct 23 21:35:44 user nova-compute[74337]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b (non-flash)
Oct 23 21:35:44 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:35:44 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)
Oct 23 21:35:44 user nova-compute[74337]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b (non-flash)
Oct 23 21:35:44 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:35:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 -p 172.16.0.220:3260 --login {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:44 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[947eb74f-4bf9-448f-9eee-5e33144aee19]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:44 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0, portal: 172.16.0.220,3260]
Oct 23 21:35:44 user nova-compute[74337]: Login to [iface: default, target: iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0, portal: 172.16.0.220,3260] successful.
Oct 23 21:35:44 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:35:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:44 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a96f66f9-0a8e-4070-adee-5bf321ddcd61]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:44 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:35:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:44 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[47647c95-408e-4b82-8bb9-aaa19f4b319a]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:44 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)
Oct 23 21:35:44 user nova-compute[74337]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b (non-flash)
Oct 23 21:35:44 user nova-compute[74337]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 (non-flash)
Oct 23 21:35:44 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:35:44 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)
Oct 23 21:35:44 user nova-compute[74337]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b (non-flash)
Oct 23 21:35:44 user nova-compute[74337]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 (non-flash)
Oct 23 21:35:44 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:35:44 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:35:44 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Connected to 172.16.0.220:3260 {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 21:35:44 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] HCTL ('35', '-', '-', 0) found on session 5 with lun 0 {{(pid=74337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 21:35:44 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 21:35:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:44 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a8d9b56-d4e5-433f-b6e1-16361799714d]: (4, ('- - 0', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:44 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Searching for a device in session 5 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 21:35:44 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MbXvPrkW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.349s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] <== connect_volume: return (1351ms) {'type': 'block', 'scsi_wwn': '23939626439316364', 'path': '/dev/sdd'} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23939626439316364', 'path': '/dev/sdd'} {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-123ca411-4f0a-4167-b7f2-2d302925213d tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.205s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:35:45 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-123ca411-4f0a-4167-b7f2-2d302925213d tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:35:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-123ca411-4f0a-4167-b7f2-2d302925213d tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f364c63-50fe-482f-a6e7-c234b5b9bec9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-123ca411-4f0a-4167-b7f2-2d302925213d tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f364c63-50fe-482f-a6e7-c234b5b9bec9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:35:45 user nova-compute[74337]: INFO os_brick.initiator.connectors.iscsi [None req-123ca411-4f0a-4167-b7f2-2d302925213d tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 21:35:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f364c63-50fe-482f-a6e7-c234b5b9bec9 -p 172.16.0.220:3260 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f364c63-50fe-482f-a6e7-c234b5b9bec9 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[f09a01ff-2b68-4e03-81a8-13cc6f7e2e16]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-123ca411-4f0a-4167-b7f2-2d302925213d tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 21:35:45 user nova-compute[74337]:  {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f364c63-50fe-482f-a6e7-c234b5b9bec9 -p 172.16.0.220:3260 --interface default --op new {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T21:34:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1740777668',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1740777668',id=10,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL7gT0CgQVW+aggFc4MRTgwBLmYOdd7tdPrWKjG6l34UUQ4Chjs4aItkTVuYTlpnxWAi7sqwX1TxWwb7ynGRyVajhl0Oo0L2nrXhX5gh38tVYqC6LOCSwyWZPEvQEa8MnA==',key_name='tempest-keypair-1464629661',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1b3449d434445e7973d49183234beee',ramdisk_id='',reservation_id='r-y0xh0m83',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-491179426',owner_user_name='tempest-TaggedBootDevicesTest-491179426-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:34:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='06b6ce06ab564b719c3b09ee9bece960',uuid=f1040399-0c5d-4a68-9ee0-4fbe45a42c55,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "58eb51e5-3d74-4162-93b8-66bdf176c1d5", "address": "fa:16:3e:53:ba:1b", "network": {"id": "54ea29fa-daa7-4818-8d2d-c90ee9a18a95", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1215215856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58eb51e5-3d", "ovs_interfaceid": "58eb51e5-3d74-4162-93b8-66bdf176c1d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Converting VIF {"id": "58eb51e5-3d74-4162-93b8-66bdf176c1d5", "address": "fa:16:3e:53:ba:1b", "network": {"id": "54ea29fa-daa7-4818-8d2d-c90ee9a18a95", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1215215856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58eb51e5-3d", "ovs_interfaceid": "58eb51e5-3d74-4162-93b8-66bdf176c1d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:ba:1b,bridge_name='br-int',has_traffic_filtering=True,id=58eb51e5-3d74-4162-93b8-66bdf176c1d5,network=Network(54ea29fa-daa7-4818-8d2d-c90ee9a18a95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58eb51e5-3d') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T21:34:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1740777668',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1740777668',id=10,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL7gT0CgQVW+aggFc4MRTgwBLmYOdd7tdPrWKjG6l34UUQ4Chjs4aItkTVuYTlpnxWAi7sqwX1TxWwb7ynGRyVajhl0Oo0L2nrXhX5gh38tVYqC6LOCSwyWZPEvQEa8MnA==',key_name='tempest-keypair-1464629661',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1b3449d434445e7973d49183234beee',ramdisk_id='',reservation_id='r-y0xh0m83',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-491179426',owner_user_name='tempest-TaggedBootDevicesTest-491179426-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:34:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='06b6ce06ab564b719c3b09ee9bece960',uuid=f1040399-0c5d-4a68-9ee0-4fbe45a42c55,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dd8e8982-b86c-469a-aa55-72bb2ac9bb8b", "address": "fa:16:3e:67:90:76", "network": {"id": "8b22a426-2945-474d-b0e6-8c22bb5e57e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-57423842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd8e8982-b8", "ovs_interfaceid": "dd8e8982-b86c-469a-aa55-72bb2ac9bb8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Converting VIF {"id": "dd8e8982-b86c-469a-aa55-72bb2ac9bb8b", "address": "fa:16:3e:67:90:76", "network": {"id": "8b22a426-2945-474d-b0e6-8c22bb5e57e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-57423842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd8e8982-b8", "ovs_interfaceid": "dd8e8982-b86c-469a-aa55-72bb2ac9bb8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:90:76,bridge_name='br-int',has_traffic_filtering=True,id=dd8e8982-b86c-469a-aa55-72bb2ac9bb8b,network=Network(8b22a426-2945-474d-b0e6-8c22bb5e57e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdd8e8982-b8') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T21:34:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1740777668',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1740777668',id=10,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL7gT0CgQVW+aggFc4MRTgwBLmYOdd7tdPrWKjG6l34UUQ4Chjs4aItkTVuYTlpnxWAi7sqwX1TxWwb7ynGRyVajhl0Oo0L2nrXhX5gh38tVYqC6LOCSwyWZPEvQEa8MnA==',key_name='tempest-keypair-1464629661',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1b3449d434445e7973d49183234beee',ramdisk_id='',reservation_id='r-y0xh0m83',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-491179426',owner_user_name='tempest-TaggedBootDevicesTest-491179426-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:34:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='06b6ce06ab564b719c3b09ee9bece960',uuid=f1040399-0c5d-4a68-9ee0-4fbe45a42c55,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e91aa55a-4a71-4090-bdde-88c4a648b60b", "address": "fa:16:3e:45:60:43", "network": {"id": "8b22a426-2945-474d-b0e6-8c22bb5e57e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-57423842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape91aa55a-4a", "ovs_interfaceid": "e91aa55a-4a71-4090-bdde-88c4a648b60b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Converting VIF {"id": "e91aa55a-4a71-4090-bdde-88c4a648b60b", "address": "fa:16:3e:45:60:43", "network": {"id": "8b22a426-2945-474d-b0e6-8c22bb5e57e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-57423842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape91aa55a-4a", "ovs_interfaceid": "e91aa55a-4a71-4090-bdde-88c4a648b60b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:60:43,bridge_name='br-int',has_traffic_filtering=True,id=e91aa55a-4a71-4090-bdde-88c4a648b60b,network=Network(8b22a426-2945-474d-b0e6-8c22bb5e57e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape91aa55a-4a') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T21:34:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1740777668',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1740777668',id=10,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL7gT0CgQVW+aggFc4MRTgwBLmYOdd7tdPrWKjG6l34UUQ4Chjs4aItkTVuYTlpnxWAi7sqwX1TxWwb7ynGRyVajhl0Oo0L2nrXhX5gh38tVYqC6LOCSwyWZPEvQEa8MnA==',key_name='tempest-keypair-1464629661',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1b3449d434445e7973d49183234beee',ramdisk_id='',reservation_id='r-y0xh0m83',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-491179426',owner_user_name='tempest-TaggedBootDevicesTest-491179426-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:34:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='06b6ce06ab564b719c3b09ee9bece960',uuid=f1040399-0c5d-4a68-9ee0-4fbe45a42c55,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ddee6c78-417b-494f-a9e1-f662c549f425", "address": "fa:16:3e:fb:ef:75", "network": {"id": "8b22a426-2945-474d-b0e6-8c22bb5e57e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-57423842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddee6c78-41", "ovs_interfaceid": "ddee6c78-417b-494f-a9e1-f662c549f425", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Converting VIF {"id": "ddee6c78-417b-494f-a9e1-f662c549f425", "address": "fa:16:3e:fb:ef:75", "network": {"id": "8b22a426-2945-474d-b0e6-8c22bb5e57e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-57423842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddee6c78-41", "ovs_interfaceid": "ddee6c78-417b-494f-a9e1-f662c549f425", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:ef:75,bridge_name='br-int',has_traffic_filtering=True,id=ddee6c78-417b-494f-a9e1-f662c549f425,network=Network(8b22a426-2945-474d-b0e6-8c22bb5e57e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddee6c78-41') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T21:34:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1740777668',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1740777668',id=10,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL7gT0CgQVW+aggFc4MRTgwBLmYOdd7tdPrWKjG6l34UUQ4Chjs4aItkTVuYTlpnxWAi7sqwX1TxWwb7ynGRyVajhl0Oo0L2nrXhX5gh38tVYqC6LOCSwyWZPEvQEa8MnA==',key_name='tempest-keypair-1464629661',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1b3449d434445e7973d49183234beee',ramdisk_id='',reservation_id='r-y0xh0m83',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-491179426',owner_user_name='tempest-TaggedBootDevicesTest-491179426-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:34:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='06b6ce06ab564b719c3b09ee9bece960',uuid=f1040399-0c5d-4a68-9ee0-4fbe45a42c55,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b1664585-4013-46f9-9738-33fd7b9a3161", "address": "fa:16:3e:e8:30:72", "network": {"id": "8b22a426-2945-474d-b0e6-8c22bb5e57e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-57423842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1664585-40", "ovs_interfaceid": "b1664585-4013-46f9-9738-33fd7b9a3161", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Converting VIF {"id": "b1664585-4013-46f9-9738-33fd7b9a3161", "address": "fa:16:3e:e8:30:72", "network": {"id": "8b22a426-2945-474d-b0e6-8c22bb5e57e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-57423842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1664585-40", "ovs_interfaceid": "b1664585-4013-46f9-9738-33fd7b9a3161", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:30:72,bridge_name='br-int',has_traffic_filtering=True,id=b1664585-4013-46f9-9738-33fd7b9a3161,network=Network(8b22a426-2945-474d-b0e6-8c22bb5e57e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1664585-40') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T21:34:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1740777668',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1740777668',id=10,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL7gT0CgQVW+aggFc4MRTgwBLmYOdd7tdPrWKjG6l34UUQ4Chjs4aItkTVuYTlpnxWAi7sqwX1TxWwb7ynGRyVajhl0Oo0L2nrXhX5gh38tVYqC6LOCSwyWZPEvQEa8MnA==',key_name='tempest-keypair-1464629661',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1b3449d434445e7973d49183234beee',ramdisk_id='',reservation_id='r-y0xh0m83',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-491179426',owner_user_name='tempest-TaggedBootDevicesTest-491179426-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:34:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='06b6ce06ab564b719c3b09ee9bece960',uuid=f1040399-0c5d-4a68-9ee0-4fbe45a42c55,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba01b035-453b-4378-92fc-1d81b84363ff", "address": "fa:16:3e:89:cb:12", "network": {"id": "cd8ce1ca-56b3-48fa-bb57-54d0616aa7ca", "bridge": "br-int", "label": "tempest-device-tagging-net2-611360182", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba01b035-45", "ovs_interfaceid": "ba01b035-453b-4378-92fc-1d81b84363ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Converting VIF {"id": "ba01b035-453b-4378-92fc-1d81b84363ff", "address": "fa:16:3e:89:cb:12", "network": {"id": "cd8ce1ca-56b3-48fa-bb57-54d0616aa7ca", "bridge": "br-int", "label": "tempest-device-tagging-net2-611360182", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba01b035-45", "ovs_interfaceid": "ba01b035-453b-4378-92fc-1d81b84363ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:cb:12,bridge_name='br-int',has_traffic_filtering=True,id=ba01b035-453b-4378-92fc-1d81b84363ff,network=Network(cd8ce1ca-56b3-48fa-bb57-54d0616aa7ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba01b035-45') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T21:34:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1740777668',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1740777668',id=10,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL7gT0CgQVW+aggFc4MRTgwBLmYOdd7tdPrWKjG6l34UUQ4Chjs4aItkTVuYTlpnxWAi7sqwX1TxWwb7ynGRyVajhl0Oo0L2nrXhX5gh38tVYqC6LOCSwyWZPEvQEa8MnA==',key_name='tempest-keypair-1464629661',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1b3449d434445e7973d49183234beee',ramdisk_id='',reservation_id='r-y0xh0m83',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-491179426',owner_user_name='tempest-TaggedBootDevicesTest-491179426-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:34:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='06b6ce06ab564b719c3b09ee9bece960',uuid=f1040399-0c5d-4a68-9ee0-4fbe45a42c55,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "248131be-39a9-430f-b27a-377d176d7846", "address": "fa:16:3e:5d:ae:b7", "network": {"id": "cd8ce1ca-56b3-48fa-bb57-54d0616aa7ca", "bridge": "br-int", "label": "tempest-device-tagging-net2-611360182", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap248131be-39", "ovs_interfaceid": "248131be-39a9-430f-b27a-377d176d7846", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Converting VIF {"id": "248131be-39a9-430f-b27a-377d176d7846", "address": "fa:16:3e:5d:ae:b7", "network": {"id": "cd8ce1ca-56b3-48fa-bb57-54d0616aa7ca", "bridge": "br-int", "label": "tempest-device-tagging-net2-611360182", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap248131be-39", "ovs_interfaceid": "248131be-39a9-430f-b27a-377d176d7846", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:ae:b7,bridge_name='br-int',has_traffic_filtering=True,id=248131be-39a9-430f-b27a-377d176d7846,network=Network(cd8ce1ca-56b3-48fa-bb57-54d0616aa7ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap248131be-39') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG nova.objects.instance [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Lazy-loading 'pci_devices' on Instance uuid f1040399-0c5d-4a68-9ee0-4fbe45a42c55 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f364c63-50fe-482f-a6e7-c234b5b9bec9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a321e2-c0ea-4282-b934-a159aa0d93d7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2f364c63-50fe-482f-a6e7-c234b5b9bec9] added\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-123ca411-4f0a-4167-b7f2-2d302925213d tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2f364c63-50fe-482f-a6e7-c234b5b9bec9] added
Oct 23 21:35:45 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f364c63-50fe-482f-a6e7-c234b5b9bec9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] End _get_guest_xml xml=<domain type="kvm">
Oct 23 21:35:45 user nova-compute[74337]:   <uuid>f1040399-0c5d-4a68-9ee0-4fbe45a42c55</uuid>
Oct 23 21:35:45 user nova-compute[74337]:   <name>instance-0000000a</name>
Oct 23 21:35:45 user nova-compute[74337]:   <memory>524288</memory>
Oct 23 21:35:45 user nova-compute[74337]:   <vcpu>1</vcpu>
Oct 23 21:35:45 user nova-compute[74337]:   <metadata>
Oct 23 21:35:45 user nova-compute[74337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 21:35:45 user nova-compute[74337]:       <nova:package version="0.0.0"/>
Oct 23 21:35:45 user nova-compute[74337]:       <nova:name>tempest-device-tagging-server-1740777668</nova:name>
Oct 23 21:35:45 user nova-compute[74337]:       <nova:creationTime>2023-10-23 21:35:41</nova:creationTime>
Oct 23 21:35:45 user nova-compute[74337]:       <nova:flavor name="m1.tiny">
Oct 23 21:35:45 user nova-compute[74337]:         <nova:memory>512</nova:memory>
Oct 23 21:35:45 user nova-compute[74337]:         <nova:disk>1</nova:disk>
Oct 23 21:35:45 user nova-compute[74337]:         <nova:swap>0</nova:swap>
Oct 23 21:35:45 user nova-compute[74337]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 21:35:45 user nova-compute[74337]:         <nova:vcpus>1</nova:vcpus>
Oct 23 21:35:45 user nova-compute[74337]:       </nova:flavor>
Oct 23 21:35:45 user nova-compute[74337]:       <nova:owner>
Oct 23 21:35:45 user nova-compute[74337]:         <nova:user uuid="06b6ce06ab564b719c3b09ee9bece960">tempest-TaggedBootDevicesTest-491179426-project-member</nova:user>
Oct 23 21:35:45 user nova-compute[74337]:         <nova:project uuid="b1b3449d434445e7973d49183234beee">tempest-TaggedBootDevicesTest-491179426</nova:project>
Oct 23 21:35:45 user nova-compute[74337]:       </nova:owner>
Oct 23 21:35:45 user nova-compute[74337]:       <nova:root type="image" uuid="d859d89d-998d-4109-b26a-0d6e28152932"/>
Oct 23 21:35:45 user nova-compute[74337]:       <nova:ports>
Oct 23 21:35:45 user nova-compute[74337]:         <nova:port uuid="58eb51e5-3d74-4162-93b8-66bdf176c1d5">
Oct 23 21:35:45 user nova-compute[74337]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 23 21:35:45 user nova-compute[74337]:         </nova:port>
Oct 23 21:35:45 user nova-compute[74337]:         <nova:port uuid="dd8e8982-b86c-469a-aa55-72bb2ac9bb8b">
Oct 23 21:35:45 user nova-compute[74337]:           <nova:ip type="fixed" address="10.1.1.170" ipVersion="4"/>
Oct 23 21:35:45 user nova-compute[74337]:         </nova:port>
Oct 23 21:35:45 user nova-compute[74337]:         <nova:port uuid="e91aa55a-4a71-4090-bdde-88c4a648b60b">
Oct 23 21:35:45 user nova-compute[74337]:           <nova:ip type="fixed" address="10.1.1.219" ipVersion="4"/>
Oct 23 21:35:45 user nova-compute[74337]:         </nova:port>
Oct 23 21:35:45 user nova-compute[74337]:         <nova:port uuid="ddee6c78-417b-494f-a9e1-f662c549f425">
Oct 23 21:35:45 user nova-compute[74337]:           <nova:ip type="fixed" address="10.1.1.37" ipVersion="4"/>
Oct 23 21:35:45 user nova-compute[74337]:         </nova:port>
Oct 23 21:35:45 user nova-compute[74337]:         <nova:port uuid="b1664585-4013-46f9-9738-33fd7b9a3161">
Oct 23 21:35:45 user nova-compute[74337]:           <nova:ip type="fixed" address="10.1.1.235" ipVersion="4"/>
Oct 23 21:35:45 user nova-compute[74337]:         </nova:port>
Oct 23 21:35:45 user nova-compute[74337]:         <nova:port uuid="ba01b035-453b-4378-92fc-1d81b84363ff">
Oct 23 21:35:45 user nova-compute[74337]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Oct 23 21:35:45 user nova-compute[74337]:         </nova:port>
Oct 23 21:35:45 user nova-compute[74337]:         <nova:port uuid="248131be-39a9-430f-b27a-377d176d7846">
Oct 23 21:35:45 user nova-compute[74337]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Oct 23 21:35:45 user nova-compute[74337]:         </nova:port>
Oct 23 21:35:45 user nova-compute[74337]:       </nova:ports>
Oct 23 21:35:45 user nova-compute[74337]:     </nova:instance>
Oct 23 21:35:45 user nova-compute[74337]:   </metadata>
Oct 23 21:35:45 user nova-compute[74337]:   <sysinfo type="smbios">
Oct 23 21:35:45 user nova-compute[74337]:     <system>
Oct 23 21:35:45 user nova-compute[74337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 21:35:45 user nova-compute[74337]:       <entry name="product">OpenStack Nova</entry>
Oct 23 21:35:45 user nova-compute[74337]:       <entry name="version">0.0.0</entry>
Oct 23 21:35:45 user nova-compute[74337]:       <entry name="serial">f1040399-0c5d-4a68-9ee0-4fbe45a42c55</entry>
Oct 23 21:35:45 user nova-compute[74337]:       <entry name="uuid">f1040399-0c5d-4a68-9ee0-4fbe45a42c55</entry>
Oct 23 21:35:45 user nova-compute[74337]:       <entry name="family">Virtual Machine</entry>
Oct 23 21:35:45 user nova-compute[74337]:     </system>
Oct 23 21:35:45 user nova-compute[74337]:   </sysinfo>
Oct 23 21:35:45 user nova-compute[74337]:   <os>
Oct 23 21:35:45 user nova-compute[74337]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 21:35:45 user nova-compute[74337]:     <boot dev="hd"/>
Oct 23 21:35:45 user nova-compute[74337]:     <smbios mode="sysinfo"/>
Oct 23 21:35:45 user nova-compute[74337]:   </os>
Oct 23 21:35:45 user nova-compute[74337]:   <features>
Oct 23 21:35:45 user nova-compute[74337]:     <acpi/>
Oct 23 21:35:45 user nova-compute[74337]:     <apic/>
Oct 23 21:35:45 user nova-compute[74337]:     <vmcoreinfo/>
Oct 23 21:35:45 user nova-compute[74337]:   </features>
Oct 23 21:35:45 user nova-compute[74337]:   <clock offset="utc">
Oct 23 21:35:45 user nova-compute[74337]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 21:35:45 user nova-compute[74337]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 21:35:45 user nova-compute[74337]:     <timer name="hpet" present="no"/>
Oct 23 21:35:45 user nova-compute[74337]:   </clock>
Oct 23 21:35:45 user nova-compute[74337]:   <cpu mode="custom" match="exact">
Oct 23 21:35:45 user nova-compute[74337]:     <model>Nehalem</model>
Oct 23 21:35:45 user nova-compute[74337]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 21:35:45 user nova-compute[74337]:   </cpu>
Oct 23 21:35:45 user nova-compute[74337]:   <devices>
Oct 23 21:35:45 user nova-compute[74337]:     <disk type="file" device="cdrom">
Oct 23 21:35:45 user nova-compute[74337]:       <driver name="qemu" type="raw" cache="none"/>
Oct 23 21:35:45 user nova-compute[74337]:       <source file="/opt/stack/data/nova/instances/f1040399-0c5d-4a68-9ee0-4fbe45a42c55/disk.config"/>
Oct 23 21:35:45 user nova-compute[74337]:       <target dev="hda" bus="ide"/>
Oct 23 21:35:45 user nova-compute[74337]:     </disk>
Oct 23 21:35:45 user nova-compute[74337]:     <disk type="block" device="disk">
Oct 23 21:35:45 user nova-compute[74337]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 21:35:45 user nova-compute[74337]:       <source dev="/dev/sdb"/>
Oct 23 21:35:45 user nova-compute[74337]:       <target dev="vda" bus="virtio"/>
Oct 23 21:35:45 user nova-compute[74337]:       <serial>694e3124-c6ed-4079-82c0-18f56c369932</serial>
Oct 23 21:35:45 user nova-compute[74337]:     </disk>
Oct 23 21:35:45 user nova-compute[74337]:     <disk type="block" device="disk">
Oct 23 21:35:45 user nova-compute[74337]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 21:35:45 user nova-compute[74337]:       <source dev="/dev/sdc"/>
Oct 23 21:35:45 user nova-compute[74337]:       <target dev="vdb" bus="virtio"/>
Oct 23 21:35:45 user nova-compute[74337]:       <serial>b9f5f7ce-c27e-4cf5-9da5-704ff383354b</serial>
Oct 23 21:35:45 user nova-compute[74337]:     </disk>
Oct 23 21:35:45 user nova-compute[74337]:     <disk type="block" device="disk">
Oct 23 21:35:45 user nova-compute[74337]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 21:35:45 user nova-compute[74337]:       <source dev="/dev/sdd"/>
Oct 23 21:35:45 user nova-compute[74337]:       <target dev="vdc" bus="virtio"/>
Oct 23 21:35:45 user nova-compute[74337]:       <serial>3b15e515-43f3-4748-a86a-bb348b5b38c0</serial>
Oct 23 21:35:45 user nova-compute[74337]:     </disk>
Oct 23 21:35:45 user nova-compute[74337]:     <interface type="ethernet">
Oct 23 21:35:45 user nova-compute[74337]:       <mac address="fa:16:3e:53:ba:1b"/>
Oct 23 21:35:45 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:35:45 user nova-compute[74337]:       <mtu size="1442"/>
Oct 23 21:35:45 user nova-compute[74337]:       <target dev="tap58eb51e5-3d"/>
Oct 23 21:35:45 user nova-compute[74337]:     </interface>
Oct 23 21:35:45 user nova-compute[74337]:     <interface type="ethernet">
Oct 23 21:35:45 user nova-compute[74337]:       <mac address="fa:16:3e:67:90:76"/>
Oct 23 21:35:45 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:35:45 user nova-compute[74337]:       <mtu size="1442"/>
Oct 23 21:35:45 user nova-compute[74337]:       <target dev="tapdd8e8982-b8"/>
Oct 23 21:35:45 user nova-compute[74337]:     </interface>
Oct 23 21:35:45 user nova-compute[74337]:     <interface type="ethernet">
Oct 23 21:35:45 user nova-compute[74337]:       <mac address="fa:16:3e:45:60:43"/>
Oct 23 21:35:45 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:35:45 user nova-compute[74337]:       <mtu size="1442"/>
Oct 23 21:35:45 user nova-compute[74337]:       <target dev="tape91aa55a-4a"/>
Oct 23 21:35:45 user nova-compute[74337]:     </interface>
Oct 23 21:35:45 user nova-compute[74337]:     <interface type="ethernet">
Oct 23 21:35:45 user nova-compute[74337]:       <mac address="fa:16:3e:fb:ef:75"/>
Oct 23 21:35:45 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:35:45 user nova-compute[74337]:       <mtu size="1442"/>
Oct 23 21:35:45 user nova-compute[74337]:       <target dev="tapddee6c78-41"/>
Oct 23 21:35:45 user nova-compute[74337]:     </interface>
Oct 23 21:35:45 user nova-compute[74337]:     <interface type="ethernet">
Oct 23 21:35:45 user nova-compute[74337]:       <mac address="fa:16:3e:e8:30:72"/>
Oct 23 21:35:45 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:35:45 user nova-compute[74337]:       <mtu size="1442"/>
Oct 23 21:35:45 user nova-compute[74337]:       <target dev="tapb1664585-40"/>
Oct 23 21:35:45 user nova-compute[74337]:     </interface>
Oct 23 21:35:45 user nova-compute[74337]:     <interface type="ethernet">
Oct 23 21:35:45 user nova-compute[74337]:       <mac address="fa:16:3e:89:cb:12"/>
Oct 23 21:35:45 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:35:45 user nova-compute[74337]:       <mtu size="1442"/>
Oct 23 21:35:45 user nova-compute[74337]:       <target dev="tapba01b035-45"/>
Oct 23 21:35:45 user nova-compute[74337]:     </interface>
Oct 23 21:35:45 user nova-compute[74337]:     <interface type="ethernet">
Oct 23 21:35:45 user nova-compute[74337]:       <mac address="fa:16:3e:5d:ae:b7"/>
Oct 23 21:35:45 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:35:45 user nova-compute[74337]:       <mtu size="1442"/>
Oct 23 21:35:45 user nova-compute[74337]:       <target dev="tap248131be-39"/>
Oct 23 21:35:45 user nova-compute[74337]:     </interface>
Oct 23 21:35:45 user nova-compute[74337]:     <serial type="pty">
Oct 23 21:35:45 user nova-compute[74337]:       <log file="/opt/stack/data/nova/instances/f1040399-0c5d-4a68-9ee0-4fbe45a42c55/console.log" append="off"/>
Oct 23 21:35:45 user nova-compute[74337]:     </serial>
Oct 23 21:35:45 user nova-compute[74337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 21:35:45 user nova-compute[74337]:     <video>
Oct 23 21:35:45 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:35:45 user nova-compute[74337]:     </video>
Oct 23 21:35:45 user nova-compute[74337]:     <rng model="virtio">
Oct 23 21:35:45 user nova-compute[74337]:       <backend model="random">/dev/urandom</backend>
Oct 23 21:35:45 user nova-compute[74337]:     </rng>
Oct 23 21:35:45 user nova-compute[74337]:     <controller type="usb" index="0" model="none"/>
Oct 23 21:35:45 user nova-compute[74337]:     <memballoon model="virtio">
Oct 23 21:35:45 user nova-compute[74337]:       <stats period="10"/>
Oct 23 21:35:45 user nova-compute[74337]:     </memballoon>
Oct 23 21:35:45 user nova-compute[74337]:   </devices>
Oct 23 21:35:45 user nova-compute[74337]: </domain>
Oct 23 21:35:45 user nova-compute[74337]:  {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T21:34:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1740777668',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1740777668',id=10,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL7gT0CgQVW+aggFc4MRTgwBLmYOdd7tdPrWKjG6l34UUQ4Chjs4aItkTVuYTlpnxWAi7sqwX1TxWwb7ynGRyVajhl0Oo0L2nrXhX5gh38tVYqC6LOCSwyWZPEvQEa8MnA==',key_name='tempest-keypair-1464629661',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1b3449d434445e7973d49183234beee',ramdisk_id='',reservation_id='r-y0xh0m83',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-491179426',owner_user_name='tempest-TaggedBootDevicesTest-491179426-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:34:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='06b6ce06ab564b719c3b09ee9bece960',uuid=f1040399-0c5d-4a68-9ee0-4fbe45a42c55,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "58eb51e5-3d74-4162-93b8-66bdf176c1d5", "address": "fa:16:3e:53:ba:1b", "network": {"id": "54ea29fa-daa7-4818-8d2d-c90ee9a18a95", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1215215856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58eb51e5-3d", "ovs_interfaceid": "58eb51e5-3d74-4162-93b8-66bdf176c1d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Converting VIF {"id": "58eb51e5-3d74-4162-93b8-66bdf176c1d5", "address": "fa:16:3e:53:ba:1b", "network": {"id": "54ea29fa-daa7-4818-8d2d-c90ee9a18a95", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1215215856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58eb51e5-3d", "ovs_interfaceid": "58eb51e5-3d74-4162-93b8-66bdf176c1d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:ba:1b,bridge_name='br-int',has_traffic_filtering=True,id=58eb51e5-3d74-4162-93b8-66bdf176c1d5,network=Network(54ea29fa-daa7-4818-8d2d-c90ee9a18a95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58eb51e5-3d') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG os_vif [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:ba:1b,bridge_name='br-int',has_traffic_filtering=True,id=58eb51e5-3d74-4162-93b8-66bdf176c1d5,network=Network(54ea29fa-daa7-4818-8d2d-c90ee9a18a95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58eb51e5-3d') {{(pid=74337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f364c63-50fe-482f-a6e7-c234b5b9bec9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[f83ea1b5-a6a0-4f92-8feb-10cb18c7b127]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-123ca411-4f0a-4167-b7f2-2d302925213d tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8c5e13cf-0709-5bdf-abb1-d26801726918', '_type': 'linux-noop'}}, row=False) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f364c63-50fe-482f-a6e7-c234b5b9bec9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap58eb51e5-3d, may_exist=True, interface_attrs={}) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap58eb51e5-3d, col_values=(('qos', UUID('b8700a68-e53b-424e-903d-1721c40d1c13')),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap58eb51e5-3d, col_values=(('external_ids', {'iface-id': '58eb51e5-3d74-4162-93b8-66bdf176c1d5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:53:ba:1b', 'vm-uuid': 'f1040399-0c5d-4a68-9ee0-4fbe45a42c55'}),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f364c63-50fe-482f-a6e7-c234b5b9bec9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef2a0974-5ab5-4bc3-b69a-dfbe40a3a23a]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-123ca411-4f0a-4167-b7f2-2d302925213d tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f364c63-50fe-482f-a6e7-c234b5b9bec9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kJhBuLVb {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:45 user nova-compute[74337]: INFO os_vif [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:ba:1b,bridge_name='br-int',has_traffic_filtering=True,id=58eb51e5-3d74-4162-93b8-66bdf176c1d5,network=Network(54ea29fa-daa7-4818-8d2d-c90ee9a18a95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58eb51e5-3d')
Oct 23 21:35:45 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T21:34:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1740777668',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1740777668',id=10,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL7gT0CgQVW+aggFc4MRTgwBLmYOdd7tdPrWKjG6l34UUQ4Chjs4aItkTVuYTlpnxWAi7sqwX1TxWwb7ynGRyVajhl0Oo0L2nrXhX5gh38tVYqC6LOCSwyWZPEvQEa8MnA==',key_name='tempest-keypair-1464629661',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1b3449d434445e7973d49183234beee',ramdisk_id='',reservation_id='r-y0xh0m83',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-491179426',owner_user_name='tempest-TaggedBootDevicesTest-491179426-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:34:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='06b6ce06ab564b719c3b09ee9bece960',uuid=f1040399-0c5d-4a68-9ee0-4fbe45a42c55,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dd8e8982-b86c-469a-aa55-72bb2ac9bb8b", "address": "fa:16:3e:67:90:76", "network": {"id": "8b22a426-2945-474d-b0e6-8c22bb5e57e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-57423842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd8e8982-b8", "ovs_interfaceid": "dd8e8982-b86c-469a-aa55-72bb2ac9bb8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Converting VIF {"id": "dd8e8982-b86c-469a-aa55-72bb2ac9bb8b", "address": "fa:16:3e:67:90:76", "network": {"id": "8b22a426-2945-474d-b0e6-8c22bb5e57e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-57423842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd8e8982-b8", "ovs_interfaceid": "dd8e8982-b86c-469a-aa55-72bb2ac9bb8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:90:76,bridge_name='br-int',has_traffic_filtering=True,id=dd8e8982-b86c-469a-aa55-72bb2ac9bb8b,network=Network(8b22a426-2945-474d-b0e6-8c22bb5e57e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdd8e8982-b8') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG os_vif [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:90:76,bridge_name='br-int',has_traffic_filtering=True,id=dd8e8982-b86c-469a-aa55-72bb2ac9bb8b,network=Network(8b22a426-2945-474d-b0e6-8c22bb5e57e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdd8e8982-b8') {{(pid=74337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'aad0a5b8-a48d-528e-a148-9e17fa63dcd0', '_type': 'linux-noop'}}, row=False) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f364c63-50fe-482f-a6e7-c234b5b9bec9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kJhBuLVb" returned: 0 in 0.020s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[30dbbf78-f4cb-4e7b-b874-fc56d6dba7a0]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-123ca411-4f0a-4167-b7f2-2d302925213d tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kJhBuLVb'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f364c63-50fe-482f-a6e7-c234b5b9bec9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdd8e8982-b8, may_exist=True, interface_attrs={}) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdd8e8982-b8, col_values=(('qos', UUID('614523c6-2f25-4709-b90a-b7e7f7d14d0a')),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdd8e8982-b8, col_values=(('external_ids', {'iface-id': 'dd8e8982-b86c-469a-aa55-72bb2ac9bb8b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:67:90:76', 'vm-uuid': 'f1040399-0c5d-4a68-9ee0-4fbe45a42c55'}),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f364c63-50fe-482f-a6e7-c234b5b9bec9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c68f943-183e-4af6-8b90-1b37d100c152]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-123ca411-4f0a-4167-b7f2-2d302925213d tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:45 user nova-compute[74337]: INFO os_vif [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:90:76,bridge_name='br-int',has_traffic_filtering=True,id=dd8e8982-b86c-469a-aa55-72bb2ac9bb8b,network=Network(8b22a426-2945-474d-b0e6-8c22bb5e57e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdd8e8982-b8')
Oct 23 21:35:45 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T21:34:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1740777668',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1740777668',id=10,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL7gT0CgQVW+aggFc4MRTgwBLmYOdd7tdPrWKjG6l34UUQ4Chjs4aItkTVuYTlpnxWAi7sqwX1TxWwb7ynGRyVajhl0Oo0L2nrXhX5gh38tVYqC6LOCSwyWZPEvQEa8MnA==',key_name='tempest-keypair-1464629661',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1b3449d434445e7973d49183234beee',ramdisk_id='',reservation_id='r-y0xh0m83',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-491179426',owner_user_name='tempest-TaggedBootDevicesTest-491179426-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:34:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='06b6ce06ab564b719c3b09ee9bece960',uuid=f1040399-0c5d-4a68-9ee0-4fbe45a42c55,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e91aa55a-4a71-4090-bdde-88c4a648b60b", "address": "fa:16:3e:45:60:43", "network": {"id": "8b22a426-2945-474d-b0e6-8c22bb5e57e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-57423842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape91aa55a-4a", "ovs_interfaceid": "e91aa55a-4a71-4090-bdde-88c4a648b60b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Converting VIF {"id": "e91aa55a-4a71-4090-bdde-88c4a648b60b", "address": "fa:16:3e:45:60:43", "network": {"id": "8b22a426-2945-474d-b0e6-8c22bb5e57e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-57423842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape91aa55a-4a", "ovs_interfaceid": "e91aa55a-4a71-4090-bdde-88c4a648b60b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:60:43,bridge_name='br-int',has_traffic_filtering=True,id=e91aa55a-4a71-4090-bdde-88c4a648b60b,network=Network(8b22a426-2945-474d-b0e6-8c22bb5e57e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape91aa55a-4a') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG os_vif [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:60:43,bridge_name='br-int',has_traffic_filtering=True,id=e91aa55a-4a71-4090-bdde-88c4a648b60b,network=Network(8b22a426-2945-474d-b0e6-8c22bb5e57e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape91aa55a-4a') {{(pid=74337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d207e2-2f70-43ff-b8ea-df7a28d54015]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-123ca411-4f0a-4167-b7f2-2d302925213d tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)
Oct 23 21:35:45 user nova-compute[74337]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b (non-flash)
Oct 23 21:35:45 user nova-compute[74337]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 (non-flash)
Oct 23 21:35:45 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-123ca411-4f0a-4167-b7f2-2d302925213d tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)
Oct 23 21:35:45 user nova-compute[74337]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b (non-flash)
Oct 23 21:35:45 user nova-compute[74337]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 (non-flash)
Oct 23 21:35:45 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f364c63-50fe-482f-a6e7-c234b5b9bec9 -p 172.16.0.220:3260 --login {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2e926a74-9697-5877-be48-acb578a53f25', '_type': 'linux-noop'}}, row=False) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape91aa55a-4a, may_exist=True, interface_attrs={}) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape91aa55a-4a, col_values=(('qos', UUID('572a318d-289a-4a70-a5b5-5a8d3f4645e6')),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape91aa55a-4a, col_values=(('external_ids', {'iface-id': 'e91aa55a-4a71-4090-bdde-88c4a648b60b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:45:60:43', 'vm-uuid': 'f1040399-0c5d-4a68-9ee0-4fbe45a42c55'}),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:35:46 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f364c63-50fe-482f-a6e7-c234b5b9bec9 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:46 user nova-compute[74337]: INFO os_vif [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:60:43,bridge_name='br-int',has_traffic_filtering=True,id=e91aa55a-4a71-4090-bdde-88c4a648b60b,network=Network(8b22a426-2945-474d-b0e6-8c22bb5e57e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape91aa55a-4a')
Oct 23 21:35:46 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T21:34:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1740777668',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1740777668',id=10,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL7gT0CgQVW+aggFc4MRTgwBLmYOdd7tdPrWKjG6l34UUQ4Chjs4aItkTVuYTlpnxWAi7sqwX1TxWwb7ynGRyVajhl0Oo0L2nrXhX5gh38tVYqC6LOCSwyWZPEvQEa8MnA==',key_name='tempest-keypair-1464629661',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1b3449d434445e7973d49183234beee',ramdisk_id='',reservation_id='r-y0xh0m83',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-491179426',owner_user_name='tempest-TaggedBootDevicesTest-491179426-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:34:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='06b6ce06ab564b719c3b09ee9bece960',uuid=f1040399-0c5d-4a68-9ee0-4fbe45a42c55,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ddee6c78-417b-494f-a9e1-f662c549f425", "address": "fa:16:3e:fb:ef:75", "network": {"id": "8b22a426-2945-474d-b0e6-8c22bb5e57e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-57423842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddee6c78-41", "ovs_interfaceid": "ddee6c78-417b-494f-a9e1-f662c549f425", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 21:35:46 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Converting VIF {"id": "ddee6c78-417b-494f-a9e1-f662c549f425", "address": "fa:16:3e:fb:ef:75", "network": {"id": "8b22a426-2945-474d-b0e6-8c22bb5e57e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-57423842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddee6c78-41", "ovs_interfaceid": "ddee6c78-417b-494f-a9e1-f662c549f425", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:35:46 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:ef:75,bridge_name='br-int',has_traffic_filtering=True,id=ddee6c78-417b-494f-a9e1-f662c549f425,network=Network(8b22a426-2945-474d-b0e6-8c22bb5e57e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddee6c78-41') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:35:46 user nova-compute[74337]: DEBUG os_vif [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:ef:75,bridge_name='br-int',has_traffic_filtering=True,id=ddee6c78-417b-494f-a9e1-f662c549f425,network=Network(8b22a426-2945-474d-b0e6-8c22bb5e57e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddee6c78-41') {{(pid=74337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 21:35:46 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a742c6a5-1792-4a52-aa3d-b6b510176fdf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2f364c63-50fe-482f-a6e7-c234b5b9bec9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2f364c63-50fe-482f-a6e7-c234b5b9bec9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:35:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 21:35:46 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-123ca411-4f0a-4167-b7f2-2d302925213d tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2f364c63-50fe-482f-a6e7-c234b5b9bec9, portal: 172.16.0.220,3260]
Oct 23 21:35:46 user nova-compute[74337]: Login to [iface: default, target: iqn.2010-10.org.openstack:2f364c63-50fe-482f-a6e7-c234b5b9bec9, portal: 172.16.0.220,3260] successful.
Oct 23 21:35:46 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:35:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a4f7d04c-1bab-5d6c-88b5-76eafc48b423', '_type': 'linux-noop'}}, row=False) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:35:46 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f364c63-50fe-482f-a6e7-c234b5b9bec9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:35:46 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f364c63-50fe-482f-a6e7-c234b5b9bec9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:46 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[279bf808-3a66-473d-96b6-f0eab1a81712]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:46 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-123ca411-4f0a-4167-b7f2-2d302925213d tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:35:46 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapddee6c78-41, may_exist=True, interface_attrs={}) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:35:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapddee6c78-41, col_values=(('qos', UUID('75befdbe-df55-4183-bed2-cce2126a7006')),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:35:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapddee6c78-41, col_values=(('external_ids', {'iface-id': 'ddee6c78-417b-494f-a9e1-f662c549f425', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fb:ef:75', 'vm-uuid': 'f1040399-0c5d-4a68-9ee0-4fbe45a42c55'}),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:35:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:46 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:35:46 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b24338c-f594-4a25-8096-dc182087d717]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f364c63-50fe-482f-a6e7-c234b5b9bec9 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:46 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-123ca411-4f0a-4167-b7f2-2d302925213d tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)
Oct 23 21:35:46 user nova-compute[74337]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b (non-flash)
Oct 23 21:35:46 user nova-compute[74337]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 (non-flash)
Oct 23 21:35:46 user nova-compute[74337]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f364c63-50fe-482f-a6e7-c234b5b9bec9 (non-flash)
Oct 23 21:35:46 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:35:46 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-123ca411-4f0a-4167-b7f2-2d302925213d tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)
Oct 23 21:35:46 user nova-compute[74337]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b (non-flash)
Oct 23 21:35:46 user nova-compute[74337]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 (non-flash)
Oct 23 21:35:46 user nova-compute[74337]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f364c63-50fe-482f-a6e7-c234b5b9bec9 (non-flash)
Oct 23 21:35:46 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:35:46 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-123ca411-4f0a-4167-b7f2-2d302925213d tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f364c63-50fe-482f-a6e7-c234b5b9bec9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.680s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:35:46 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-123ca411-4f0a-4167-b7f2-2d302925213d tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Connected to 172.16.0.220:3260 {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 21:35:46 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-123ca411-4f0a-4167-b7f2-2d302925213d tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] HCTL ('36', '-', '-', 0) found on session 6 with lun 0 {{(pid=74337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 21:35:46 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-123ca411-4f0a-4167-b7f2-2d302925213d tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 21:35:46 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:46 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:46 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a352c135-c23c-49aa-9e6a-70cfb7478230]: (4, ('- - 0', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:35:46 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-123ca411-4f0a-4167-b7f2-2d302925213d tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: None {{(pid=74337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 21:35:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:46 user nova-compute[74337]: INFO os_vif [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:ef:75,bridge_name='br-int',has_traffic_filtering=True,id=ddee6c78-417b-494f-a9e1-f662c549f425,network=Network(8b22a426-2945-474d-b0e6-8c22bb5e57e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddee6c78-41')
Oct 23 21:35:46 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T21:34:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1740777668',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1740777668',id=10,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL7gT0CgQVW+aggFc4MRTgwBLmYOdd7tdPrWKjG6l34UUQ4Chjs4aItkTVuYTlpnxWAi7sqwX1TxWwb7ynGRyVajhl0Oo0L2nrXhX5gh38tVYqC6LOCSwyWZPEvQEa8MnA==',key_name='tempest-keypair-1464629661',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1b3449d434445e7973d49183234beee',ramdisk_id='',reservation_id='r-y0xh0m83',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-491179426',owner_user_name='tempest-TaggedBootDevicesTest-491179426-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:34:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='06b6ce06ab564b719c3b09ee9bece960',uuid=f1040399-0c5d-4a68-9ee0-4fbe45a42c55,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b1664585-4013-46f9-9738-33fd7b9a3161", "address": "fa:16:3e:e8:30:72", "network": {"id": "8b22a426-2945-474d-b0e6-8c22bb5e57e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-57423842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1664585-40", "ovs_interfaceid": "b1664585-4013-46f9-9738-33fd7b9a3161", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 21:35:46 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Converting VIF {"id": "b1664585-4013-46f9-9738-33fd7b9a3161", "address": "fa:16:3e:e8:30:72", "network": {"id": "8b22a426-2945-474d-b0e6-8c22bb5e57e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-57423842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1664585-40", "ovs_interfaceid": "b1664585-4013-46f9-9738-33fd7b9a3161", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:35:46 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:30:72,bridge_name='br-int',has_traffic_filtering=True,id=b1664585-4013-46f9-9738-33fd7b9a3161,network=Network(8b22a426-2945-474d-b0e6-8c22bb5e57e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1664585-40') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:35:46 user nova-compute[74337]: DEBUG os_vif [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:30:72,bridge_name='br-int',has_traffic_filtering=True,id=b1664585-4013-46f9-9738-33fd7b9a3161,network=Network(8b22a426-2945-474d-b0e6-8c22bb5e57e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1664585-40') {{(pid=74337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 21:35:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:35:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 21:35:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '98c6df7e-b8bc-574d-9d0f-283c13178344', '_type': 'linux-noop'}}, row=False) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:35:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:35:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb1664585-40, may_exist=True, interface_attrs={}) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:35:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb1664585-40, col_values=(('qos', UUID('d8375770-107a-4532-937f-f003a4914ebd')),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:35:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb1664585-40, col_values=(('external_ids', {'iface-id': 'b1664585-4013-46f9-9738-33fd7b9a3161', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e8:30:72', 'vm-uuid': 'f1040399-0c5d-4a68-9ee0-4fbe45a42c55'}),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:35:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:35:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:46 user nova-compute[74337]: INFO os_vif [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:30:72,bridge_name='br-int',has_traffic_filtering=True,id=b1664585-4013-46f9-9738-33fd7b9a3161,network=Network(8b22a426-2945-474d-b0e6-8c22bb5e57e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1664585-40')
Oct 23 21:35:46 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T21:34:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1740777668',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1740777668',id=10,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL7gT0CgQVW+aggFc4MRTgwBLmYOdd7tdPrWKjG6l34UUQ4Chjs4aItkTVuYTlpnxWAi7sqwX1TxWwb7ynGRyVajhl0Oo0L2nrXhX5gh38tVYqC6LOCSwyWZPEvQEa8MnA==',key_name='tempest-keypair-1464629661',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1b3449d434445e7973d49183234beee',ramdisk_id='',reservation_id='r-y0xh0m83',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-491179426',owner_user_name='tempest-TaggedBootDevicesTest-491179426-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:34:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='06b6ce06ab564b719c3b09ee9bece960',uuid=f1040399-0c5d-4a68-9ee0-4fbe45a42c55,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba01b035-453b-4378-92fc-1d81b84363ff", "address": "fa:16:3e:89:cb:12", "network": {"id": "cd8ce1ca-56b3-48fa-bb57-54d0616aa7ca", "bridge": "br-int", "label": "tempest-device-tagging-net2-611360182", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba01b035-45", "ovs_interfaceid": "ba01b035-453b-4378-92fc-1d81b84363ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 21:35:46 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Converting VIF {"id": "ba01b035-453b-4378-92fc-1d81b84363ff", "address": "fa:16:3e:89:cb:12", "network": {"id": "cd8ce1ca-56b3-48fa-bb57-54d0616aa7ca", "bridge": "br-int", "label": "tempest-device-tagging-net2-611360182", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba01b035-45", "ovs_interfaceid": "ba01b035-453b-4378-92fc-1d81b84363ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:35:46 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:cb:12,bridge_name='br-int',has_traffic_filtering=True,id=ba01b035-453b-4378-92fc-1d81b84363ff,network=Network(cd8ce1ca-56b3-48fa-bb57-54d0616aa7ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba01b035-45') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:35:46 user nova-compute[74337]: DEBUG os_vif [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:cb:12,bridge_name='br-int',has_traffic_filtering=True,id=ba01b035-453b-4378-92fc-1d81b84363ff,network=Network(cd8ce1ca-56b3-48fa-bb57-54d0616aa7ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba01b035-45') {{(pid=74337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 21:35:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:35:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 21:35:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3dad4c28-a4fe-5dab-b8bb-254e95476e14', '_type': 'linux-noop'}}, row=False) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:35:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:35:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapba01b035-45, may_exist=True, interface_attrs={}) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:35:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapba01b035-45, col_values=(('qos', UUID('eb9986a2-f248-4295-89fd-b99e18beaac0')),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:35:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapba01b035-45, col_values=(('external_ids', {'iface-id': 'ba01b035-453b-4378-92fc-1d81b84363ff', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:89:cb:12', 'vm-uuid': 'f1040399-0c5d-4a68-9ee0-4fbe45a42c55'}),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:35:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:35:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:46 user nova-compute[74337]: INFO os_vif [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:cb:12,bridge_name='br-int',has_traffic_filtering=True,id=ba01b035-453b-4378-92fc-1d81b84363ff,network=Network(cd8ce1ca-56b3-48fa-bb57-54d0616aa7ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba01b035-45')
Oct 23 21:35:46 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T21:34:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1740777668',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1740777668',id=10,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL7gT0CgQVW+aggFc4MRTgwBLmYOdd7tdPrWKjG6l34UUQ4Chjs4aItkTVuYTlpnxWAi7sqwX1TxWwb7ynGRyVajhl0Oo0L2nrXhX5gh38tVYqC6LOCSwyWZPEvQEa8MnA==',key_name='tempest-keypair-1464629661',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1b3449d434445e7973d49183234beee',ramdisk_id='',reservation_id='r-y0xh0m83',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-491179426',owner_user_name='tempest-TaggedBootDevicesTest-491179426-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:34:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='06b6ce06ab564b719c3b09ee9bece960',uuid=f1040399-0c5d-4a68-9ee0-4fbe45a42c55,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "248131be-39a9-430f-b27a-377d176d7846", "address": "fa:16:3e:5d:ae:b7", "network": {"id": "cd8ce1ca-56b3-48fa-bb57-54d0616aa7ca", "bridge": "br-int", "label": "tempest-device-tagging-net2-611360182", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap248131be-39", "ovs_interfaceid": "248131be-39a9-430f-b27a-377d176d7846", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 21:35:46 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Converting VIF {"id": "248131be-39a9-430f-b27a-377d176d7846", "address": "fa:16:3e:5d:ae:b7", "network": {"id": "cd8ce1ca-56b3-48fa-bb57-54d0616aa7ca", "bridge": "br-int", "label": "tempest-device-tagging-net2-611360182", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap248131be-39", "ovs_interfaceid": "248131be-39a9-430f-b27a-377d176d7846", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:35:46 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:ae:b7,bridge_name='br-int',has_traffic_filtering=True,id=248131be-39a9-430f-b27a-377d176d7846,network=Network(cd8ce1ca-56b3-48fa-bb57-54d0616aa7ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap248131be-39') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:35:46 user nova-compute[74337]: DEBUG os_vif [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:ae:b7,bridge_name='br-int',has_traffic_filtering=True,id=248131be-39a9-430f-b27a-377d176d7846,network=Network(cd8ce1ca-56b3-48fa-bb57-54d0616aa7ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap248131be-39') {{(pid=74337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 21:35:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:35:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 21:35:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8669e3e6-e8a7-5e37-a522-b76d8dc0db7f', '_type': 'linux-noop'}}, row=False) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:35:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:35:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap248131be-39, may_exist=True, interface_attrs={}) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:35:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap248131be-39, col_values=(('qos', UUID('7ca21ab5-09c6-453e-942c-5c20ee06e444')),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:35:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap248131be-39, col_values=(('external_ids', {'iface-id': '248131be-39a9-430f-b27a-377d176d7846', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5d:ae:b7', 'vm-uuid': 'f1040399-0c5d-4a68-9ee0-4fbe45a42c55'}),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:35:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:35:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:46 user nova-compute[74337]: INFO os_vif [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:ae:b7,bridge_name='br-int',has_traffic_filtering=True,id=248131be-39a9-430f-b27a-377d176d7846,network=Network(cd8ce1ca-56b3-48fa-bb57-54d0616aa7ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap248131be-39')
Oct 23 21:35:46 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] No BDM found with device name hda, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 21:35:46 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 21:35:46 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] No VIF found with MAC fa:16:3e:53:ba:1b, not building metadata {{(pid=74337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 21:35:46 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] No VIF found with MAC fa:16:3e:e8:30:72, not building metadata {{(pid=74337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 21:35:46 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Using config drive
Oct 23 21:35:46 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Creating config drive at /opt/stack/data/nova/instances/f1040399-0c5d-4a68-9ee0-4fbe45a42c55/disk.config
Oct 23 21:35:46 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f1040399-0c5d-4a68-9ee0-4fbe45a42c55/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpiuwht_3f {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:35:46 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f1040399-0c5d-4a68-9ee0-4fbe45a42c55/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpiuwht_3f" returned: 0 in 0.066s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:35:47 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-123ca411-4f0a-4167-b7f2-2d302925213d tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 21:35:47 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-123ca411-4f0a-4167-b7f2-2d302925213d tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:2f364c63-50fe-482f-a6e7-c234b5b9bec9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kJhBuLVb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 21:35:47 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-123ca411-4f0a-4167-b7f2-2d302925213d tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.714s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:35:47 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-123ca411-4f0a-4167-b7f2-2d302925213d tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] <== connect_volume: return (2919ms) {'type': 'block', 'scsi_wwn': '23134643238646333', 'path': '/dev/sde'} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:35:47 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-123ca411-4f0a-4167-b7f2-2d302925213d tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] [instance: d45e8ae8-371b-46ae-849d-d7f7d5bbd770] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23134643238646333', 'path': '/dev/sde'} {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 21:35:47 user nova-compute[74337]: DEBUG nova.objects.instance [None req-123ca411-4f0a-4167-b7f2-2d302925213d tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Lazy-loading 'flavor' on Instance uuid d45e8ae8-371b-46ae-849d-d7f7d5bbd770 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:35:47 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-123ca411-4f0a-4167-b7f2-2d302925213d tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 21:35:47 user nova-compute[74337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 21:35:47 user nova-compute[74337]:   <source dev="/dev/sde"/>
Oct 23 21:35:47 user nova-compute[74337]:   <target dev="vdb" bus="virtio"/>
Oct 23 21:35:47 user nova-compute[74337]:   <serial>2f364c63-50fe-482f-a6e7-c234b5b9bec9</serial>
Oct 23 21:35:47 user nova-compute[74337]: </disk>
Oct 23 21:35:47 user nova-compute[74337]:  {{(pid=74337) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 21:35:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:48 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-123ca411-4f0a-4167-b7f2-2d302925213d tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] No BDM found with device name vda, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 21:35:48 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-123ca411-4f0a-4167-b7f2-2d302925213d tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 21:35:48 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-123ca411-4f0a-4167-b7f2-2d302925213d tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] No VIF found with MAC fa:16:3e:9b:5f:a0, not building metadata {{(pid=74337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 21:35:48 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:48 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:48 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:48 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:48 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:48 user nova-compute[74337]: DEBUG nova.compute.manager [req-a4718a6f-7a1f-48ce-ae07-18f1b461bbfd req-77b2d9ee-9a9d-42f5-b672-3bca4b799edc service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Received event network-vif-plugged-58eb51e5-3d74-4162-93b8-66bdf176c1d5 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:35:48 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-a4718a6f-7a1f-48ce-ae07-18f1b461bbfd req-77b2d9ee-9a9d-42f5-b672-3bca4b799edc service nova] Acquiring lock "f1040399-0c5d-4a68-9ee0-4fbe45a42c55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:35:48 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-a4718a6f-7a1f-48ce-ae07-18f1b461bbfd req-77b2d9ee-9a9d-42f5-b672-3bca4b799edc service nova] Lock "f1040399-0c5d-4a68-9ee0-4fbe45a42c55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:35:48 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-a4718a6f-7a1f-48ce-ae07-18f1b461bbfd req-77b2d9ee-9a9d-42f5-b672-3bca4b799edc service nova] Lock "f1040399-0c5d-4a68-9ee0-4fbe45a42c55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:35:48 user nova-compute[74337]: DEBUG nova.compute.manager [req-a4718a6f-7a1f-48ce-ae07-18f1b461bbfd req-77b2d9ee-9a9d-42f5-b672-3bca4b799edc service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] No waiting events found dispatching network-vif-plugged-58eb51e5-3d74-4162-93b8-66bdf176c1d5 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:35:48 user nova-compute[74337]: WARNING nova.compute.manager [req-a4718a6f-7a1f-48ce-ae07-18f1b461bbfd req-77b2d9ee-9a9d-42f5-b672-3bca4b799edc service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Received unexpected event network-vif-plugged-58eb51e5-3d74-4162-93b8-66bdf176c1d5 for instance with vm_state building and task_state spawning.
Oct 23 21:35:48 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:49 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:49 user nova-compute[74337]: DEBUG nova.compute.manager [req-0a719b65-45d6-4c1f-8a0f-dc7da607aefe req-f7d2ea18-b5d8-4421-af1c-116a4f09a6bd service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Received event network-vif-plugged-dd8e8982-b86c-469a-aa55-72bb2ac9bb8b {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:35:49 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-0a719b65-45d6-4c1f-8a0f-dc7da607aefe req-f7d2ea18-b5d8-4421-af1c-116a4f09a6bd service nova] Acquiring lock "f1040399-0c5d-4a68-9ee0-4fbe45a42c55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:35:49 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-0a719b65-45d6-4c1f-8a0f-dc7da607aefe req-f7d2ea18-b5d8-4421-af1c-116a4f09a6bd service nova] Lock "f1040399-0c5d-4a68-9ee0-4fbe45a42c55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:35:49 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-0a719b65-45d6-4c1f-8a0f-dc7da607aefe req-f7d2ea18-b5d8-4421-af1c-116a4f09a6bd service nova] Lock "f1040399-0c5d-4a68-9ee0-4fbe45a42c55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:35:49 user nova-compute[74337]: DEBUG nova.compute.manager [req-0a719b65-45d6-4c1f-8a0f-dc7da607aefe req-f7d2ea18-b5d8-4421-af1c-116a4f09a6bd service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] No waiting events found dispatching network-vif-plugged-dd8e8982-b86c-469a-aa55-72bb2ac9bb8b {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:35:49 user nova-compute[74337]: WARNING nova.compute.manager [req-0a719b65-45d6-4c1f-8a0f-dc7da607aefe req-f7d2ea18-b5d8-4421-af1c-116a4f09a6bd service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Received unexpected event network-vif-plugged-dd8e8982-b86c-469a-aa55-72bb2ac9bb8b for instance with vm_state building and task_state spawning.
Oct 23 21:35:49 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:49 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:49 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:49 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:49 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:49 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:49 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:49 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:49 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:49 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:49 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:49 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:49 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:50 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:50 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:50 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:50 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:50 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:50 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:50 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:50 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:50 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:50 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:50 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:50 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:50 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:50 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:50 user nova-compute[74337]: DEBUG nova.compute.manager [req-2785edec-4ce2-4dc6-b2f3-7c780a05cb87 req-1ad343a1-a40c-45b4-a08d-dcb20a81fb90 service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Received event network-vif-plugged-58eb51e5-3d74-4162-93b8-66bdf176c1d5 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:35:50 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-2785edec-4ce2-4dc6-b2f3-7c780a05cb87 req-1ad343a1-a40c-45b4-a08d-dcb20a81fb90 service nova] Acquiring lock "f1040399-0c5d-4a68-9ee0-4fbe45a42c55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:35:50 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-2785edec-4ce2-4dc6-b2f3-7c780a05cb87 req-1ad343a1-a40c-45b4-a08d-dcb20a81fb90 service nova] Lock "f1040399-0c5d-4a68-9ee0-4fbe45a42c55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:35:50 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-2785edec-4ce2-4dc6-b2f3-7c780a05cb87 req-1ad343a1-a40c-45b4-a08d-dcb20a81fb90 service nova] Lock "f1040399-0c5d-4a68-9ee0-4fbe45a42c55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:35:50 user nova-compute[74337]: DEBUG nova.compute.manager [req-2785edec-4ce2-4dc6-b2f3-7c780a05cb87 req-1ad343a1-a40c-45b4-a08d-dcb20a81fb90 service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] No waiting events found dispatching network-vif-plugged-58eb51e5-3d74-4162-93b8-66bdf176c1d5 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:35:50 user nova-compute[74337]: WARNING nova.compute.manager [req-2785edec-4ce2-4dc6-b2f3-7c780a05cb87 req-1ad343a1-a40c-45b4-a08d-dcb20a81fb90 service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Received unexpected event network-vif-plugged-58eb51e5-3d74-4162-93b8-66bdf176c1d5 for instance with vm_state building and task_state spawning.
Oct 23 21:35:50 user nova-compute[74337]: DEBUG nova.compute.manager [req-2785edec-4ce2-4dc6-b2f3-7c780a05cb87 req-1ad343a1-a40c-45b4-a08d-dcb20a81fb90 service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Received event network-vif-plugged-e91aa55a-4a71-4090-bdde-88c4a648b60b {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:35:50 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-2785edec-4ce2-4dc6-b2f3-7c780a05cb87 req-1ad343a1-a40c-45b4-a08d-dcb20a81fb90 service nova] Acquiring lock "f1040399-0c5d-4a68-9ee0-4fbe45a42c55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:35:50 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-2785edec-4ce2-4dc6-b2f3-7c780a05cb87 req-1ad343a1-a40c-45b4-a08d-dcb20a81fb90 service nova] Lock "f1040399-0c5d-4a68-9ee0-4fbe45a42c55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:35:50 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-2785edec-4ce2-4dc6-b2f3-7c780a05cb87 req-1ad343a1-a40c-45b4-a08d-dcb20a81fb90 service nova] Lock "f1040399-0c5d-4a68-9ee0-4fbe45a42c55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:35:50 user nova-compute[74337]: DEBUG nova.compute.manager [req-2785edec-4ce2-4dc6-b2f3-7c780a05cb87 req-1ad343a1-a40c-45b4-a08d-dcb20a81fb90 service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] No waiting events found dispatching network-vif-plugged-e91aa55a-4a71-4090-bdde-88c4a648b60b {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:35:50 user nova-compute[74337]: WARNING nova.compute.manager [req-2785edec-4ce2-4dc6-b2f3-7c780a05cb87 req-1ad343a1-a40c-45b4-a08d-dcb20a81fb90 service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Received unexpected event network-vif-plugged-e91aa55a-4a71-4090-bdde-88c4a648b60b for instance with vm_state building and task_state spawning.
Oct 23 21:35:50 user nova-compute[74337]: DEBUG nova.compute.manager [req-2785edec-4ce2-4dc6-b2f3-7c780a05cb87 req-1ad343a1-a40c-45b4-a08d-dcb20a81fb90 service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Received event network-vif-plugged-e91aa55a-4a71-4090-bdde-88c4a648b60b {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:35:50 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-2785edec-4ce2-4dc6-b2f3-7c780a05cb87 req-1ad343a1-a40c-45b4-a08d-dcb20a81fb90 service nova] Acquiring lock "f1040399-0c5d-4a68-9ee0-4fbe45a42c55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:35:50 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-2785edec-4ce2-4dc6-b2f3-7c780a05cb87 req-1ad343a1-a40c-45b4-a08d-dcb20a81fb90 service nova] Lock "f1040399-0c5d-4a68-9ee0-4fbe45a42c55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:35:50 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-2785edec-4ce2-4dc6-b2f3-7c780a05cb87 req-1ad343a1-a40c-45b4-a08d-dcb20a81fb90 service nova] Lock "f1040399-0c5d-4a68-9ee0-4fbe45a42c55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:35:50 user nova-compute[74337]: DEBUG nova.compute.manager [req-2785edec-4ce2-4dc6-b2f3-7c780a05cb87 req-1ad343a1-a40c-45b4-a08d-dcb20a81fb90 service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] No waiting events found dispatching network-vif-plugged-e91aa55a-4a71-4090-bdde-88c4a648b60b {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:35:50 user nova-compute[74337]: WARNING nova.compute.manager [req-2785edec-4ce2-4dc6-b2f3-7c780a05cb87 req-1ad343a1-a40c-45b4-a08d-dcb20a81fb90 service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Received unexpected event network-vif-plugged-e91aa55a-4a71-4090-bdde-88c4a648b60b for instance with vm_state building and task_state spawning.
Oct 23 21:35:50 user nova-compute[74337]: DEBUG nova.compute.manager [req-2785edec-4ce2-4dc6-b2f3-7c780a05cb87 req-1ad343a1-a40c-45b4-a08d-dcb20a81fb90 service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Received event network-vif-plugged-b1664585-4013-46f9-9738-33fd7b9a3161 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:35:50 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-2785edec-4ce2-4dc6-b2f3-7c780a05cb87 req-1ad343a1-a40c-45b4-a08d-dcb20a81fb90 service nova] Acquiring lock "f1040399-0c5d-4a68-9ee0-4fbe45a42c55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:35:50 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-2785edec-4ce2-4dc6-b2f3-7c780a05cb87 req-1ad343a1-a40c-45b4-a08d-dcb20a81fb90 service nova] Lock "f1040399-0c5d-4a68-9ee0-4fbe45a42c55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:35:50 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-2785edec-4ce2-4dc6-b2f3-7c780a05cb87 req-1ad343a1-a40c-45b4-a08d-dcb20a81fb90 service nova] Lock "f1040399-0c5d-4a68-9ee0-4fbe45a42c55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:35:50 user nova-compute[74337]: DEBUG nova.compute.manager [req-2785edec-4ce2-4dc6-b2f3-7c780a05cb87 req-1ad343a1-a40c-45b4-a08d-dcb20a81fb90 service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] No waiting events found dispatching network-vif-plugged-b1664585-4013-46f9-9738-33fd7b9a3161 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:35:50 user nova-compute[74337]: WARNING nova.compute.manager [req-2785edec-4ce2-4dc6-b2f3-7c780a05cb87 req-1ad343a1-a40c-45b4-a08d-dcb20a81fb90 service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Received unexpected event network-vif-plugged-b1664585-4013-46f9-9738-33fd7b9a3161 for instance with vm_state building and task_state spawning.
Oct 23 21:35:50 user nova-compute[74337]: DEBUG nova.compute.manager [req-2785edec-4ce2-4dc6-b2f3-7c780a05cb87 req-1ad343a1-a40c-45b4-a08d-dcb20a81fb90 service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Received event network-vif-plugged-b1664585-4013-46f9-9738-33fd7b9a3161 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:35:50 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-2785edec-4ce2-4dc6-b2f3-7c780a05cb87 req-1ad343a1-a40c-45b4-a08d-dcb20a81fb90 service nova] Acquiring lock "f1040399-0c5d-4a68-9ee0-4fbe45a42c55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:35:50 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-2785edec-4ce2-4dc6-b2f3-7c780a05cb87 req-1ad343a1-a40c-45b4-a08d-dcb20a81fb90 service nova] Lock "f1040399-0c5d-4a68-9ee0-4fbe45a42c55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:35:50 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-2785edec-4ce2-4dc6-b2f3-7c780a05cb87 req-1ad343a1-a40c-45b4-a08d-dcb20a81fb90 service nova] Lock "f1040399-0c5d-4a68-9ee0-4fbe45a42c55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:35:50 user nova-compute[74337]: DEBUG nova.compute.manager [req-2785edec-4ce2-4dc6-b2f3-7c780a05cb87 req-1ad343a1-a40c-45b4-a08d-dcb20a81fb90 service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] No waiting events found dispatching network-vif-plugged-b1664585-4013-46f9-9738-33fd7b9a3161 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:35:50 user nova-compute[74337]: WARNING nova.compute.manager [req-2785edec-4ce2-4dc6-b2f3-7c780a05cb87 req-1ad343a1-a40c-45b4-a08d-dcb20a81fb90 service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Received unexpected event network-vif-plugged-b1664585-4013-46f9-9738-33fd7b9a3161 for instance with vm_state building and task_state spawning.
Oct 23 21:35:50 user nova-compute[74337]: DEBUG nova.compute.manager [req-4dd89f5e-1319-4d44-b399-8c43f0fef57e req-60fa3338-9fe7-4423-b168-59183faf3855 service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Received event network-vif-plugged-248131be-39a9-430f-b27a-377d176d7846 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:35:50 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-4dd89f5e-1319-4d44-b399-8c43f0fef57e req-60fa3338-9fe7-4423-b168-59183faf3855 service nova] Acquiring lock "f1040399-0c5d-4a68-9ee0-4fbe45a42c55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:35:50 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-4dd89f5e-1319-4d44-b399-8c43f0fef57e req-60fa3338-9fe7-4423-b168-59183faf3855 service nova] Lock "f1040399-0c5d-4a68-9ee0-4fbe45a42c55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:35:50 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-4dd89f5e-1319-4d44-b399-8c43f0fef57e req-60fa3338-9fe7-4423-b168-59183faf3855 service nova] Lock "f1040399-0c5d-4a68-9ee0-4fbe45a42c55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:35:50 user nova-compute[74337]: DEBUG nova.compute.manager [req-4dd89f5e-1319-4d44-b399-8c43f0fef57e req-60fa3338-9fe7-4423-b168-59183faf3855 service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] No waiting events found dispatching network-vif-plugged-248131be-39a9-430f-b27a-377d176d7846 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:35:50 user nova-compute[74337]: WARNING nova.compute.manager [req-4dd89f5e-1319-4d44-b399-8c43f0fef57e req-60fa3338-9fe7-4423-b168-59183faf3855 service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Received unexpected event network-vif-plugged-248131be-39a9-430f-b27a-377d176d7846 for instance with vm_state building and task_state spawning.
Oct 23 21:35:50 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:51 user nova-compute[74337]: DEBUG nova.compute.manager [req-95b6ebc9-e407-42ec-8450-437cf52ed1f0 req-7a981208-9fa8-469e-8d46-19927657ff3a service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Received event network-vif-plugged-dd8e8982-b86c-469a-aa55-72bb2ac9bb8b {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:35:51 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-95b6ebc9-e407-42ec-8450-437cf52ed1f0 req-7a981208-9fa8-469e-8d46-19927657ff3a service nova] Acquiring lock "f1040399-0c5d-4a68-9ee0-4fbe45a42c55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:35:51 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-95b6ebc9-e407-42ec-8450-437cf52ed1f0 req-7a981208-9fa8-469e-8d46-19927657ff3a service nova] Lock "f1040399-0c5d-4a68-9ee0-4fbe45a42c55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:35:51 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-95b6ebc9-e407-42ec-8450-437cf52ed1f0 req-7a981208-9fa8-469e-8d46-19927657ff3a service nova] Lock "f1040399-0c5d-4a68-9ee0-4fbe45a42c55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:35:51 user nova-compute[74337]: DEBUG nova.compute.manager [req-95b6ebc9-e407-42ec-8450-437cf52ed1f0 req-7a981208-9fa8-469e-8d46-19927657ff3a service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] No waiting events found dispatching network-vif-plugged-dd8e8982-b86c-469a-aa55-72bb2ac9bb8b {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:35:51 user nova-compute[74337]: WARNING nova.compute.manager [req-95b6ebc9-e407-42ec-8450-437cf52ed1f0 req-7a981208-9fa8-469e-8d46-19927657ff3a service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Received unexpected event network-vif-plugged-dd8e8982-b86c-469a-aa55-72bb2ac9bb8b for instance with vm_state building and task_state spawning.
Oct 23 21:35:51 user nova-compute[74337]: DEBUG nova.compute.manager [req-95b6ebc9-e407-42ec-8450-437cf52ed1f0 req-7a981208-9fa8-469e-8d46-19927657ff3a service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Received event network-vif-plugged-ddee6c78-417b-494f-a9e1-f662c549f425 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:35:51 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-95b6ebc9-e407-42ec-8450-437cf52ed1f0 req-7a981208-9fa8-469e-8d46-19927657ff3a service nova] Acquiring lock "f1040399-0c5d-4a68-9ee0-4fbe45a42c55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:35:51 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-95b6ebc9-e407-42ec-8450-437cf52ed1f0 req-7a981208-9fa8-469e-8d46-19927657ff3a service nova] Lock "f1040399-0c5d-4a68-9ee0-4fbe45a42c55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:35:51 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-95b6ebc9-e407-42ec-8450-437cf52ed1f0 req-7a981208-9fa8-469e-8d46-19927657ff3a service nova] Lock "f1040399-0c5d-4a68-9ee0-4fbe45a42c55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:35:51 user nova-compute[74337]: DEBUG nova.compute.manager [req-95b6ebc9-e407-42ec-8450-437cf52ed1f0 req-7a981208-9fa8-469e-8d46-19927657ff3a service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] No waiting events found dispatching network-vif-plugged-ddee6c78-417b-494f-a9e1-f662c549f425 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:35:51 user nova-compute[74337]: WARNING nova.compute.manager [req-95b6ebc9-e407-42ec-8450-437cf52ed1f0 req-7a981208-9fa8-469e-8d46-19927657ff3a service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Received unexpected event network-vif-plugged-ddee6c78-417b-494f-a9e1-f662c549f425 for instance with vm_state building and task_state spawning.
Oct 23 21:35:51 user nova-compute[74337]: DEBUG nova.compute.manager [req-95b6ebc9-e407-42ec-8450-437cf52ed1f0 req-7a981208-9fa8-469e-8d46-19927657ff3a service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Received event network-vif-plugged-ddee6c78-417b-494f-a9e1-f662c549f425 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:35:51 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-95b6ebc9-e407-42ec-8450-437cf52ed1f0 req-7a981208-9fa8-469e-8d46-19927657ff3a service nova] Acquiring lock "f1040399-0c5d-4a68-9ee0-4fbe45a42c55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:35:51 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-95b6ebc9-e407-42ec-8450-437cf52ed1f0 req-7a981208-9fa8-469e-8d46-19927657ff3a service nova] Lock "f1040399-0c5d-4a68-9ee0-4fbe45a42c55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:35:51 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-95b6ebc9-e407-42ec-8450-437cf52ed1f0 req-7a981208-9fa8-469e-8d46-19927657ff3a service nova] Lock "f1040399-0c5d-4a68-9ee0-4fbe45a42c55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:35:51 user nova-compute[74337]: DEBUG nova.compute.manager [req-95b6ebc9-e407-42ec-8450-437cf52ed1f0 req-7a981208-9fa8-469e-8d46-19927657ff3a service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] No waiting events found dispatching network-vif-plugged-ddee6c78-417b-494f-a9e1-f662c549f425 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:35:51 user nova-compute[74337]: WARNING nova.compute.manager [req-95b6ebc9-e407-42ec-8450-437cf52ed1f0 req-7a981208-9fa8-469e-8d46-19927657ff3a service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Received unexpected event network-vif-plugged-ddee6c78-417b-494f-a9e1-f662c549f425 for instance with vm_state building and task_state spawning.
Oct 23 21:35:51 user nova-compute[74337]: DEBUG nova.compute.manager [req-95b6ebc9-e407-42ec-8450-437cf52ed1f0 req-7a981208-9fa8-469e-8d46-19927657ff3a service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Received event network-vif-plugged-ba01b035-453b-4378-92fc-1d81b84363ff {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:35:51 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-95b6ebc9-e407-42ec-8450-437cf52ed1f0 req-7a981208-9fa8-469e-8d46-19927657ff3a service nova] Acquiring lock "f1040399-0c5d-4a68-9ee0-4fbe45a42c55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:35:51 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-95b6ebc9-e407-42ec-8450-437cf52ed1f0 req-7a981208-9fa8-469e-8d46-19927657ff3a service nova] Lock "f1040399-0c5d-4a68-9ee0-4fbe45a42c55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:35:51 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-95b6ebc9-e407-42ec-8450-437cf52ed1f0 req-7a981208-9fa8-469e-8d46-19927657ff3a service nova] Lock "f1040399-0c5d-4a68-9ee0-4fbe45a42c55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:35:51 user nova-compute[74337]: DEBUG nova.compute.manager [req-95b6ebc9-e407-42ec-8450-437cf52ed1f0 req-7a981208-9fa8-469e-8d46-19927657ff3a service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] No waiting events found dispatching network-vif-plugged-ba01b035-453b-4378-92fc-1d81b84363ff {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:35:51 user nova-compute[74337]: WARNING nova.compute.manager [req-95b6ebc9-e407-42ec-8450-437cf52ed1f0 req-7a981208-9fa8-469e-8d46-19927657ff3a service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Received unexpected event network-vif-plugged-ba01b035-453b-4378-92fc-1d81b84363ff for instance with vm_state building and task_state spawning.
Oct 23 21:35:51 user nova-compute[74337]: DEBUG nova.compute.manager [req-95b6ebc9-e407-42ec-8450-437cf52ed1f0 req-7a981208-9fa8-469e-8d46-19927657ff3a service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Received event network-vif-plugged-ba01b035-453b-4378-92fc-1d81b84363ff {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:35:51 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-95b6ebc9-e407-42ec-8450-437cf52ed1f0 req-7a981208-9fa8-469e-8d46-19927657ff3a service nova] Acquiring lock "f1040399-0c5d-4a68-9ee0-4fbe45a42c55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:35:51 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-95b6ebc9-e407-42ec-8450-437cf52ed1f0 req-7a981208-9fa8-469e-8d46-19927657ff3a service nova] Lock "f1040399-0c5d-4a68-9ee0-4fbe45a42c55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:35:51 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-95b6ebc9-e407-42ec-8450-437cf52ed1f0 req-7a981208-9fa8-469e-8d46-19927657ff3a service nova] Lock "f1040399-0c5d-4a68-9ee0-4fbe45a42c55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:35:51 user nova-compute[74337]: DEBUG nova.compute.manager [req-95b6ebc9-e407-42ec-8450-437cf52ed1f0 req-7a981208-9fa8-469e-8d46-19927657ff3a service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] No waiting events found dispatching network-vif-plugged-ba01b035-453b-4378-92fc-1d81b84363ff {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:35:51 user nova-compute[74337]: WARNING nova.compute.manager [req-95b6ebc9-e407-42ec-8450-437cf52ed1f0 req-7a981208-9fa8-469e-8d46-19927657ff3a service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Received unexpected event network-vif-plugged-ba01b035-453b-4378-92fc-1d81b84363ff for instance with vm_state building and task_state spawning.
Oct 23 21:35:51 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:51 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:51 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:51 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:51 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:51 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:51 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:52 user nova-compute[74337]: DEBUG nova.compute.manager [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Instance event wait completed in 0 seconds for  {{(pid=74337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 21:35:52 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Guest created on hypervisor {{(pid=74337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 21:35:52 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Instance spawned successfully.
Oct 23 21:35:52 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 21:35:52 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Found default for hw_cdrom_bus of ide {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:35:52 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Found default for hw_disk_bus of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:35:52 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Found default for hw_input_bus of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:35:52 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Found default for hw_pointer_model of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:35:52 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Found default for hw_video_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:35:52 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Found default for hw_vif_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:35:52 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:52 user nova-compute[74337]: INFO nova.compute.manager [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Took 11.59 seconds to spawn the instance on the hypervisor.
Oct 23 21:35:52 user nova-compute[74337]: DEBUG nova.compute.manager [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Checking state {{(pid=74337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 21:35:52 user nova-compute[74337]: DEBUG nova.compute.manager [req-da2b43a9-53e5-449b-888f-02fe1d099076 req-44d2e2f0-db0c-49fc-a2b6-851e3c92250e service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Received event network-vif-plugged-248131be-39a9-430f-b27a-377d176d7846 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:35:52 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-da2b43a9-53e5-449b-888f-02fe1d099076 req-44d2e2f0-db0c-49fc-a2b6-851e3c92250e service nova] Acquiring lock "f1040399-0c5d-4a68-9ee0-4fbe45a42c55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:35:52 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-da2b43a9-53e5-449b-888f-02fe1d099076 req-44d2e2f0-db0c-49fc-a2b6-851e3c92250e service nova] Lock "f1040399-0c5d-4a68-9ee0-4fbe45a42c55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:35:52 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-da2b43a9-53e5-449b-888f-02fe1d099076 req-44d2e2f0-db0c-49fc-a2b6-851e3c92250e service nova] Lock "f1040399-0c5d-4a68-9ee0-4fbe45a42c55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:35:52 user nova-compute[74337]: DEBUG nova.compute.manager [req-da2b43a9-53e5-449b-888f-02fe1d099076 req-44d2e2f0-db0c-49fc-a2b6-851e3c92250e service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] No waiting events found dispatching network-vif-plugged-248131be-39a9-430f-b27a-377d176d7846 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:35:52 user nova-compute[74337]: WARNING nova.compute.manager [req-da2b43a9-53e5-449b-888f-02fe1d099076 req-44d2e2f0-db0c-49fc-a2b6-851e3c92250e service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Received unexpected event network-vif-plugged-248131be-39a9-430f-b27a-377d176d7846 for instance with vm_state building and task_state spawning.
Oct 23 21:35:53 user nova-compute[74337]: INFO nova.compute.manager [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Took 72.62 seconds to build instance.
Oct 23 21:35:53 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4f424e0d-9492-4abe-9c29-a7bf764335a4 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Lock "f1040399-0c5d-4a68-9ee0-4fbe45a42c55" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 72.726s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:35:54 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:35:56 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:56 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:35:56 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 21:35:57 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:35:57 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:35:58 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:35:58 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Starting heal instance info cache {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 21:35:58 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "refresh_cache-d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:35:58 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquired lock "refresh_cache-d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:35:58 user nova-compute[74337]: DEBUG nova.network.neutron [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Forcefully refreshing network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 21:35:59 user nova-compute[74337]: DEBUG nova.network.neutron [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Updating instance_info_cache with network_info: [{"id": "872b2a23-8054-4d26-b798-c0099d1c9a91", "address": "fa:16:3e:30:a6:90", "network": {"id": "b6a24032-0229-4ebe-83a3-8804e494838c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1472404179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17117e60d0d9484d80c0bc8de393921c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap872b2a23-80", "ovs_interfaceid": "872b2a23-8054-4d26-b798-c0099d1c9a91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:35:59 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Releasing lock "refresh_cache-d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:35:59 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Updated the network info_cache for instance {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 21:35:59 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:35:59 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:35:59 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:36:00 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:36:00 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:36:00 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:36:00 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:36:00 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Auditing locally available compute resources for user (node: user) {{(pid=74337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 21:36:00 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a181593-8086-4ece-9f5b-5ccba0bfe91e/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:00 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a181593-8086-4ece-9f5b-5ccba0bfe91e/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:00 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a181593-8086-4ece-9f5b-5ccba0bfe91e/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a181593-8086-4ece-9f5b-5ccba0bfe91e/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8acc1b10-a541-4c06-aeb7-1ecf7a2457be/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8acc1b10-a541-4c06-aeb7-1ecf7a2457be/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8acc1b10-a541-4c06-aeb7-1ecf7a2457be/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:01 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8acc1b10-a541-4c06-aeb7-1ecf7a2457be/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:01 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7a2d4f3-30e3-4523-8957-76098f28464f tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] Calling os-brick to attach iSCSI Volume {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 21:36:01 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a2d4f3-30e3-4523-8957-76098f28464f tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a5ca53bf-8b08-42d0-976a-cb925d353ee7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YeSqLRPW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:36:01 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-b7a2d4f3-30e3-4523-8957-76098f28464f tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:36:01 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-b7a2d4f3-30e3-4523-8957-76098f28464f tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:36:01 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-b7a2d4f3-30e3-4523-8957-76098f28464f tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:36:01 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-b7a2d4f3-30e3-4523-8957-76098f28464f tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:36:01 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-b7a2d4f3-30e3-4523-8957-76098f28464f tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5ca53bf-8b08-42d0-976a-cb925d353ee7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:36:01 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-b7a2d4f3-30e3-4523-8957-76098f28464f tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5ca53bf-8b08-42d0-976a-cb925d353ee7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:36:01 user nova-compute[74337]: INFO os_brick.initiator.connectors.iscsi [None req-b7a2d4f3-30e3-4523-8957-76098f28464f tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 21:36:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d45e8ae8-371b-46ae-849d-d7f7d5bbd770/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5ca53bf-8b08-42d0-976a-cb925d353ee7 -p 172.16.0.220:3260 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5ca53bf-8b08-42d0-976a-cb925d353ee7 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:01 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c8518b-bc5f-411b-8d2d-cf7747d13007]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:01 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a2d4f3-30e3-4523-8957-76098f28464f tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 21:36:01 user nova-compute[74337]:  {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:36:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5ca53bf-8b08-42d0-976a-cb925d353ee7 -p 172.16.0.220:3260 --interface default --op new {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5ca53bf-8b08-42d0-976a-cb925d353ee7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:01 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a472be-a2e9-4c56-81d7-900b0e8acae8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a5ca53bf-8b08-42d0-976a-cb925d353ee7] added\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:01 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a2d4f3-30e3-4523-8957-76098f28464f tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a5ca53bf-8b08-42d0-976a-cb925d353ee7] added
Oct 23 21:36:01 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:36:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5ca53bf-8b08-42d0-976a-cb925d353ee7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5ca53bf-8b08-42d0-976a-cb925d353ee7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:01 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb62dff9-9708-41ac-8d9d-48f34748f311]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:01 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a2d4f3-30e3-4523-8957-76098f28464f tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:36:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5ca53bf-8b08-42d0-976a-cb925d353ee7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5ca53bf-8b08-42d0-976a-cb925d353ee7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:01 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[8df69507-c25d-4a1f-86f5-6010bdc3a13d]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:01 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a2d4f3-30e3-4523-8957-76098f28464f tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:36:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5ca53bf-8b08-42d0-976a-cb925d353ee7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YeSqLRPW {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5ca53bf-8b08-42d0-976a-cb925d353ee7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YeSqLRPW" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:01 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[3450847c-a1e8-4d93-a9ab-6bd67887c893]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:01 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a2d4f3-30e3-4523-8957-76098f28464f tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YeSqLRPW'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:36:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5ca53bf-8b08-42d0-976a-cb925d353ee7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5ca53bf-8b08-42d0-976a-cb925d353ee7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:01 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f983b2-4362-4c5c-9ce5-7cc63d18906b]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:01 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a2d4f3-30e3-4523-8957-76098f28464f tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:36:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:01 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-89df2314-cb98-4794-bbcc-6690d53a7ceb tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Acquiring lock "ff1c790c-2458-438e-95c7-7e1412fe05fc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:36:01 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-89df2314-cb98-4794-bbcc-6690d53a7ceb tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Lock "ff1c790c-2458-438e-95c7-7e1412fe05fc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:36:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:01 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[0874bd97-1153-41df-be61-b18cf619dd8f]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f364c63-50fe-482f-a6e7-c234b5b9bec9 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:01 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a2d4f3-30e3-4523-8957-76098f28464f tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)
Oct 23 21:36:01 user nova-compute[74337]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b (non-flash)
Oct 23 21:36:01 user nova-compute[74337]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 (non-flash)
Oct 23 21:36:01 user nova-compute[74337]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f364c63-50fe-482f-a6e7-c234b5b9bec9 (non-flash)
Oct 23 21:36:01 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:36:01 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a2d4f3-30e3-4523-8957-76098f28464f tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)
Oct 23 21:36:01 user nova-compute[74337]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b (non-flash)
Oct 23 21:36:01 user nova-compute[74337]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 (non-flash)
Oct 23 21:36:01 user nova-compute[74337]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f364c63-50fe-482f-a6e7-c234b5b9bec9 (non-flash)
Oct 23 21:36:01 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:36:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5ca53bf-8b08-42d0-976a-cb925d353ee7 -p 172.16.0.220:3260 --login {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:01 user nova-compute[74337]: DEBUG nova.objects.instance [None req-89df2314-cb98-4794-bbcc-6690d53a7ceb tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Lazy-loading 'flavor' on Instance uuid ff1c790c-2458-438e-95c7-7e1412fe05fc {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:36:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d45e8ae8-371b-46ae-849d-d7f7d5bbd770/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d45e8ae8-371b-46ae-849d-d7f7d5bbd770/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5ca53bf-8b08-42d0-976a-cb925d353ee7 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:01 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd95c960-1781-4e6b-a909-0d7c08694fd6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a5ca53bf-8b08-42d0-976a-cb925d353ee7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a5ca53bf-8b08-42d0-976a-cb925d353ee7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:01 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a2d4f3-30e3-4523-8957-76098f28464f tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a5ca53bf-8b08-42d0-976a-cb925d353ee7, portal: 172.16.0.220,3260]
Oct 23 21:36:01 user nova-compute[74337]: Login to [iface: default, target: iqn.2010-10.org.openstack:a5ca53bf-8b08-42d0-976a-cb925d353ee7, portal: 172.16.0.220,3260] successful.
Oct 23 21:36:01 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:36:01 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-89df2314-cb98-4794-bbcc-6690d53a7ceb tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Lock "ff1c790c-2458-438e-95c7-7e1412fe05fc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.085s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:36:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5ca53bf-8b08-42d0-976a-cb925d353ee7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5ca53bf-8b08-42d0-976a-cb925d353ee7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:01 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e18b15d-df61-46bd-9c74-bed3a61bc0d4]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:01 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a2d4f3-30e3-4523-8957-76098f28464f tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:36:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:01 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[74289a43-a544-40d4-9599-2b6fbe68aa51]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f364c63-50fe-482f-a6e7-c234b5b9bec9 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5ca53bf-8b08-42d0-976a-cb925d353ee7 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:01 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a2d4f3-30e3-4523-8957-76098f28464f tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)
Oct 23 21:36:01 user nova-compute[74337]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b (non-flash)
Oct 23 21:36:01 user nova-compute[74337]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 (non-flash)
Oct 23 21:36:01 user nova-compute[74337]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f364c63-50fe-482f-a6e7-c234b5b9bec9 (non-flash)
Oct 23 21:36:01 user nova-compute[74337]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5ca53bf-8b08-42d0-976a-cb925d353ee7 (non-flash)
Oct 23 21:36:01 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:36:01 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a2d4f3-30e3-4523-8957-76098f28464f tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)
Oct 23 21:36:01 user nova-compute[74337]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b (non-flash)
Oct 23 21:36:01 user nova-compute[74337]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 (non-flash)
Oct 23 21:36:01 user nova-compute[74337]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f364c63-50fe-482f-a6e7-c234b5b9bec9 (non-flash)
Oct 23 21:36:01 user nova-compute[74337]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5ca53bf-8b08-42d0-976a-cb925d353ee7 (non-flash)
Oct 23 21:36:01 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:36:01 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-b7a2d4f3-30e3-4523-8957-76098f28464f tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5ca53bf-8b08-42d0-976a-cb925d353ee7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:36:01 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a2d4f3-30e3-4523-8957-76098f28464f tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Connected to 172.16.0.220:3260 {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 21:36:01 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-b7a2d4f3-30e3-4523-8957-76098f28464f tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=74337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 21:36:01 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-b7a2d4f3-30e3-4523-8957-76098f28464f tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 21:36:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:01 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1229731-98bc-4a67-9f99-715441e7327e]: (4, ('- - 0', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:01 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-b7a2d4f3-30e3-4523-8957-76098f28464f tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 21:36:01 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a2d4f3-30e3-4523-8957-76098f28464f tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:a5ca53bf-8b08-42d0-976a-cb925d353ee7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YeSqLRPW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 21:36:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d45e8ae8-371b-46ae-849d-d7f7d5bbd770/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:01 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 21:36:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:01 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-123ca411-4f0a-4167-b7f2-2d302925213d tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Lock "d45e8ae8-371b-46ae-849d-d7f7d5bbd770" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 41.029s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:36:02 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:02 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:02 user nova-compute[74337]: DEBUG nova.compute.manager [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Start spawning the instance on the hypervisor. {{(pid=74337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 21:36:02 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Creating instance directory {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 21:36:02 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Creating image(s)
Oct 23 21:36:02 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Did not create local disks {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 23 21:36:02 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Ensure instance console log exists: /opt/stack/data/nova/instances/04c02325-7ce4-45c2-819b-c656e93c96ca/console.log {{(pid=74337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 21:36:02 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:36:02 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:36:02 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:36:02 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Start _get_guest_xml network_info=[{"id": "2ea512c9-8ab6-49a3-9f77-14bcd380f8e8", "address": "fa:16:3e:75:d8:7f", "network": {"id": "e5fd79cb-72f1-4d32-a604-b9518e375fcd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-840255736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46b2b924f3a4461ba09eb54ee42f4649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ea512c9-8a", "ovs_interfaceid": "2ea512c9-8ab6-49a3-9f77-14bcd380f8e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2727b3bf-35e4-485a-b44b-66406b7d1597", "address": "fa:16:3e:e2:6e:58", "network": {"id": "8a3d7452-cadc-4728-a772-801d6a5c4770", "bridge": "br-int", "label": "tempest-device-tagging-net1-560176148", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46b2b924f3a4461ba09eb54ee42f4649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2727b3bf-35", "ovs_interfaceid": "2727b3bf-35e4-485a-b44b-66406b7d1597", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9141d0eb-5e49-4a83-993f-3eac6a526dfd", "address": "fa:16:3e:1f:61:c0", "network": {"id": "8a3d7452-cadc-4728-a772-801d6a5c4770", "bridge": "br-int", "label": "tempest-device-tagging-net1-560176148", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46b2b924f3a4461ba09eb54ee42f4649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9141d0eb-5e", "ovs_interfaceid": "9141d0eb-5e49-4a83-993f-3eac6a526dfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4da5a263-b3c7-49ba-b2e1-d54cbb5f0f0e", "address": "fa:16:3e:2d:65:73", "network": {"id": "8a3d7452-cadc-4728-a772-801d6a5c4770", "bridge": "br-int", "label": "tempest-device-tagging-net1-560176148", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46b2b924f3a4461ba09eb54ee42f4649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4da5a263-b3", "ovs_interfaceid": "4da5a263-b3c7-49ba-b2e1-d54cbb5f0f0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d35e88b3-1ad6-42dc-9b9f-281cb0e99dc8", "address": "fa:16:3e:51:c9:d7", "network": {"id": "8a3d7452-cadc-4728-a772-801d6a5c4770", "bridge": "br-int", "label": "tempest-device-tagging-net1-560176148", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46b2b924f3a4461ba09eb54ee42f4649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd35e88b3-1a", "ovs_interfaceid": "d35e88b3-1ad6-42dc-9b9f-281cb0e99dc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "78d439bc-58eb-4984-86f7-e9610cd8c17f", "address": "fa:16:3e:a3:26:2f", "network": {"id": "1f1cb866-1870-48d7-8866-ac73e71c8ef4", "bridge": "br-int", "label": "tempest-device-tagging-net2-663589537", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "46b2b924f3a4461ba09eb54ee42f4649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78d439bc-58", "ovs_interfaceid": "78d439bc-58eb-4984-86f7-e9610cd8c17f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "870087f8-5e43-4e98-a6ab-b65529f9fa6b", "address": "fa:16:3e:96:be:1f", "network": {"id": "1f1cb866-1870-48d7-8866-ac73e71c8ef4", "bridge": "br-int", "label": "tempest-device-tagging-net2-663589537", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "46b2b924f3a4461ba09eb54ee42f4649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap870087f8-5e", "ovs_interfaceid": "870087f8-5e43-4e98-a6ab-b65529f9fa6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T21:29:21Z,direct_url=<?>,disk_format='qcow2',id=d859d89d-998d-4109-b26a-0d6e28152932,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ff43462300764979a6cf688444336a56',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T21:29:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '283cdf3d-98ed-40e0-a2b8-bb1f31c06239', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LxQKtqSs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '04c02325-7ce4-45c2-819b-c656e93c96ca', 'attached_at': '', 'detached_at': '', 'volume_id': '64864579-6ad1-4796-a620-c2c1ee8a702a', 'serial': '64864579-6ad1-4796-a620-c2c1ee8a702a'}, 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None}, {'attachment_id': 'dcc75ca3-e611-4f00-811a-31e943f54bb4', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': 1, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ohumOZdz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '04c02325-7ce4-45c2-819b-c656e93c96ca', 'attached_at': '', 'detached_at': '', 'volume_id': '0865a5a4-aa44-450e-8451-0d5e8b14f661', 'serial': '0865a5a4-aa44-450e-8451-0d5e8b14f661'}, 'guest_format': None, 'mount_device': '/dev/vdb', 'volume_type': None}, {'attachment_id': 'd3064f9c-2f1c-49b0-b61e-7e4f16c10fbb', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': 2, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ROKFtlJc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '04c02325-7ce4-45c2-819b-c656e93c96ca', 'attached_at': '', 'detached_at': '', 'volume_id': 'b8aea79a-53dd-4442-8470-dc68c6351496', 'serial': 'b8aea79a-53dd-4442-8470-dc68c6351496'}, 'guest_format': None, 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 21:36:02 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:36:02 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:36:02 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 21:36:02 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] CPU controller missing on host. {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 21:36:02 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 21:36:02 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] CPU controller found on host. {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 21:36:02 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 21:36:02 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T21:29:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T21:29:21Z,direct_url=<?>,disk_format='qcow2',id=d859d89d-998d-4109-b26a-0d6e28152932,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ff43462300764979a6cf688444336a56',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T21:29:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 21:36:02 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Flavor limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 21:36:02 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Image limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 21:36:02 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Flavor pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 21:36:02 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Image pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 21:36:02 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 21:36:02 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 21:36:02 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 21:36:02 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Got 1 possible topologies {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 21:36:02 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 21:36:02 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 21:36:02 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Calling os-brick to attach iSCSI Volume {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 21:36:02 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LxQKtqSs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:36:02 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:36:02 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:36:02 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:02 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4bf4723-1e3c-42f1-a422-9d9263b67e3d/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:02 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4bf4723-1e3c-42f1-a422-9d9263b67e3d/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:02 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4bf4723-1e3c-42f1-a422-9d9263b67e3d/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:02 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-89df2314-cb98-4794-bbcc-6690d53a7ceb tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Acquiring lock "ff1c790c-2458-438e-95c7-7e1412fe05fc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:36:02 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-89df2314-cb98-4794-bbcc-6690d53a7ceb tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Lock "ff1c790c-2458-438e-95c7-7e1412fe05fc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:36:02 user nova-compute[74337]: INFO nova.compute.manager [None req-89df2314-cb98-4794-bbcc-6690d53a7ceb tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] [instance: ff1c790c-2458-438e-95c7-7e1412fe05fc] Attaching volume 37bd5655-eaa0-4702-882b-73a73d1ba948 to /dev/sdc
Oct 23 21:36:02 user nova-compute[74337]: DEBUG os_brick.utils [None req-89df2314-cb98-4794-bbcc-6690d53a7ceb tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:36:02 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4bf4723-1e3c-42f1-a422-9d9263b67e3d/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:02 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:02 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf6270ba-7a4e-40c4-b7fd-c62a44125c89/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:02 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:02 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d64f576-e979-4907-a184-7f885b20f6d5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f34011b66e40\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:02 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:02 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:02 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8db6592-59d0-4f77-a0f4-2795b2c77845]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:02 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:02 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:02 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad0891a-9087-4ba8-a95d-92f300a9c22a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:02 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[834d9fc0-3b9c-470b-9b8f-3708eadac8de]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:02 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-89df2314-cb98-4794-bbcc-6690d53a7ceb tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Running cmd (subprocess): nvme version {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:02 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-89df2314-cb98-4794-bbcc-6690d53a7ceb tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] 'nvme version' failed. Not Retrying. {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 21:36:02 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-89df2314-cb98-4794-bbcc-6690d53a7ceb tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] nvme not present on system {{(pid=74337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 21:36:02 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:02 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:02 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 21:36:02 user nova-compute[74337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 21:36:02 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f2f4adb-1300-49f5-9eb3-cac98c862401]: (4, '') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:02 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-89df2314-cb98-4794-bbcc-6690d53a7ceb tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 21:36:02 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-89df2314-cb98-4794-bbcc-6690d53a7ceb tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 21:36:02 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-89df2314-cb98-4794-bbcc-6690d53a7ceb tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] LIGHTOS: no hostnqn found. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 21:36:02 user nova-compute[74337]: DEBUG os_brick.utils [None req-89df2314-cb98-4794-bbcc-6690d53a7ceb tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] <== get_connector_properties: return (157ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f34011b66e40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:36:02 user nova-compute[74337]: DEBUG nova.virt.block_device [None req-89df2314-cb98-4794-bbcc-6690d53a7ceb tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] [instance: ff1c790c-2458-438e-95c7-7e1412fe05fc] Updating existing volume attachment record: 2088d909-db2b-47c9-8e8c-f03b58e1e7ee {{(pid=74337) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 21:36:02 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-b7a2d4f3-30e3-4523-8957-76098f28464f tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.361s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:36:02 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a2d4f3-30e3-4523-8957-76098f28464f tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] <== connect_volume: return (1363ms) {'type': 'block', 'scsi_wwn': '26239373163383163', 'path': '/dev/sdf'} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:36:02 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7a2d4f3-30e3-4523-8957-76098f28464f tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26239373163383163', 'path': '/dev/sdf'} {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 21:36:02 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.640s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:36:02 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:36:02 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:36:02 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:36:02 user nova-compute[74337]: INFO os_brick.initiator.connectors.iscsi [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 21:36:02 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a -p 172.16.0.220:3260 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:02 user nova-compute[74337]: DEBUG nova.objects.instance [None req-b7a2d4f3-30e3-4523-8957-76098f28464f tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Lazy-loading 'flavor' on Instance uuid 8acc1b10-a541-4c06-aeb7-1ecf7a2457be {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:36:02 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf6270ba-7a4e-40c4-b7fd-c62a44125c89/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:02 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf6270ba-7a4e-40c4-b7fd-c62a44125c89/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:02 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:02 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[700cc8bb-1c13-4406-8738-3980aba7ba2e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:02 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 21:36:02 user nova-compute[74337]:  {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:36:02 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a -p 172.16.0.220:3260 --interface default --op new {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:02 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-b7a2d4f3-30e3-4523-8957-76098f28464f tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 21:36:02 user nova-compute[74337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 21:36:02 user nova-compute[74337]:   <source dev="/dev/sdf"/>
Oct 23 21:36:02 user nova-compute[74337]:   <target dev="vdb" bus="virtio"/>
Oct 23 21:36:02 user nova-compute[74337]:   <serial>a5ca53bf-8b08-42d0-976a-cb925d353ee7</serial>
Oct 23 21:36:02 user nova-compute[74337]: </disk>
Oct 23 21:36:02 user nova-compute[74337]:  {{(pid=74337) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 21:36:02 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:02 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5c2107d-6e4f-4136-8203-7e929aab4acf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a] added\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:02 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a] added
Oct 23 21:36:02 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:36:02 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:02 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:02 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c92f1d17-e481-41c1-9a2e-aba43770b160]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:02 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:36:03 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:03 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.034s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:03 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[7537a260-a669-4693-843f-0af9df774550]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:03 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:36:03 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LxQKtqSs {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:03 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LxQKtqSs" returned: 0 in 0.030s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:03 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[5692bade-d0bb-4d20-8c8b-85d746851be9]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:03 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LxQKtqSs'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:36:03 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:03 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:03 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[fab07c01-978d-4903-be5c-101c96be1925]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:03 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:36:03 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:03 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:03 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[28361222-24cd-44c7-b971-3c3d23b7bbaa]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f364c63-50fe-482f-a6e7-c234b5b9bec9 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5ca53bf-8b08-42d0-976a-cb925d353ee7 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:03 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)
Oct 23 21:36:03 user nova-compute[74337]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b (non-flash)
Oct 23 21:36:03 user nova-compute[74337]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 (non-flash)
Oct 23 21:36:03 user nova-compute[74337]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f364c63-50fe-482f-a6e7-c234b5b9bec9 (non-flash)
Oct 23 21:36:03 user nova-compute[74337]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5ca53bf-8b08-42d0-976a-cb925d353ee7 (non-flash)
Oct 23 21:36:03 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:36:03 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)
Oct 23 21:36:03 user nova-compute[74337]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b (non-flash)
Oct 23 21:36:03 user nova-compute[74337]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 (non-flash)
Oct 23 21:36:03 user nova-compute[74337]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f364c63-50fe-482f-a6e7-c234b5b9bec9 (non-flash)
Oct 23 21:36:03 user nova-compute[74337]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5ca53bf-8b08-42d0-976a-cb925d353ee7 (non-flash)
Oct 23 21:36:03 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:36:03 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a -p 172.16.0.220:3260 --login {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:03 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf6270ba-7a4e-40c4-b7fd-c62a44125c89/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:03 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2075057e-81db-424a-bb20-662d77faafed/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:03 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:03 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce2a101-ee09-464b-af20-5f3ec113d659]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:03 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a, portal: 172.16.0.220,3260]
Oct 23 21:36:03 user nova-compute[74337]: Login to [iface: default, target: iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a, portal: 172.16.0.220,3260] successful.
Oct 23 21:36:03 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:36:03 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:03 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:03 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[04a30447-bfe6-4767-96a3-ceeee2301eaa]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:03 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:36:03 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:03 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:03 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e32ca7-67f4-4d7b-b47e-b5d071b98302]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f364c63-50fe-482f-a6e7-c234b5b9bec9 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5ca53bf-8b08-42d0-976a-cb925d353ee7 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:03 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)
Oct 23 21:36:03 user nova-compute[74337]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b (non-flash)
Oct 23 21:36:03 user nova-compute[74337]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 (non-flash)
Oct 23 21:36:03 user nova-compute[74337]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f364c63-50fe-482f-a6e7-c234b5b9bec9 (non-flash)
Oct 23 21:36:03 user nova-compute[74337]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5ca53bf-8b08-42d0-976a-cb925d353ee7 (non-flash)
Oct 23 21:36:03 user nova-compute[74337]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a (non-flash)
Oct 23 21:36:03 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:36:03 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)
Oct 23 21:36:03 user nova-compute[74337]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b (non-flash)
Oct 23 21:36:03 user nova-compute[74337]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 (non-flash)
Oct 23 21:36:03 user nova-compute[74337]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f364c63-50fe-482f-a6e7-c234b5b9bec9 (non-flash)
Oct 23 21:36:03 user nova-compute[74337]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5ca53bf-8b08-42d0-976a-cb925d353ee7 (non-flash)
Oct 23 21:36:03 user nova-compute[74337]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a (non-flash)
Oct 23 21:36:03 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:36:03 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.421s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:36:03 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Connected to 172.16.0.220:3260 {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 21:36:03 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=74337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 21:36:03 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 21:36:03 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:03 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.020s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:03 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[34037191-05f6-4976-bcbe-9a66f2e68ea7]: (4, ('- - 0', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:03 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 21:36:03 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LxQKtqSs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 21:36:03 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2075057e-81db-424a-bb20-662d77faafed/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:03 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2075057e-81db-424a-bb20-662d77faafed/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:03 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-b7a2d4f3-30e3-4523-8957-76098f28464f tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] No BDM found with device name vda, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 21:36:03 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-b7a2d4f3-30e3-4523-8957-76098f28464f tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] No BDM found with device name hda, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 21:36:03 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-b7a2d4f3-30e3-4523-8957-76098f28464f tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] No VIF found with MAC fa:16:3e:47:6a:0e, not building metadata {{(pid=74337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 21:36:03 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2075057e-81db-424a-bb20-662d77faafed/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:03 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 21:36:03 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 21:36:03 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=74337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 21:36:03 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff1c790c-2458-438e-95c7-7e1412fe05fc/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:03 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff1c790c-2458-438e-95c7-7e1412fe05fc/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:03 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff1c790c-2458-438e-95c7-7e1412fe05fc/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:04 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff1c790c-2458-438e-95c7-7e1412fe05fc/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:04 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.654s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:36:04 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] <== connect_volume: return (2295ms) {'type': 'block', 'scsi_wwn': '26638323231363839', 'path': '/dev/sdg'} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:36:04 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26638323231363839', 'path': '/dev/sdg'} {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 21:36:04 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:36:04 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:36:04 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Hypervisor/Node resource view: name=user free_ram=7719MB free_disk=25.561077117919922GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 21:36:04 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:36:04 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:36:04 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Calling os-brick to attach iSCSI Volume {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 21:36:04 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ohumOZdz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:36:04 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:36:04 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:36:04 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:36:04 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:36:04 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:36:04 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:36:04 user nova-compute[74337]: INFO os_brick.initiator.connectors.iscsi [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 21:36:04 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661 -p 172.16.0.220:3260 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:04 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:04 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[425a0f4f-a8e9-4390-878d-b21ab2cbeafa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:04 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 21:36:04 user nova-compute[74337]:  {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:36:04 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661 -p 172.16.0.220:3260 --interface default --op new {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:04 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:04 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[54a7f4f7-3237-4733-9291-87e20a797e87]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661] added\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:04 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661] added
Oct 23 21:36:04 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:36:04 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:04 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:04 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[573d8977-1011-42e8-8e9d-2eb452cf2670]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:04 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:36:04 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:04 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:04 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[4711235b-59b3-4042-b123-119732394617]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:04 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:36:04 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ohumOZdz {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:04 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance cf6270ba-7a4e-40c4-b7fd-c62a44125c89 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:36:04 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:36:04 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance d45e8ae8-371b-46ae-849d-d7f7d5bbd770 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:36:04 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 8acc1b10-a541-4c06-aeb7-1ecf7a2457be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:36:04 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance ff1c790c-2458-438e-95c7-7e1412fe05fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:36:04 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 5a181593-8086-4ece-9f5b-5ccba0bfe91e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:36:04 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance a4bf4723-1e3c-42f1-a422-9d9263b67e3d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:36:04 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 2075057e-81db-424a-bb20-662d77faafed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:36:04 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance f1040399-0c5d-4a68-9ee0-4fbe45a42c55 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:36:04 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 04c02325-7ce4-45c2-819b-c656e93c96ca actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:36:04 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 21:36:04 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 21:36:04 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ohumOZdz" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:04 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c65ae965-16f2-488e-a2e4-cfe8dc52c838]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:04 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ohumOZdz'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:36:04 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:04 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:04 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[8459dc20-0a05-487e-bff7-09fc29d10660]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:04 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:36:04 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:04 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:04 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd2456e-afcd-46d6-b3cf-33d56ed28205]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f364c63-50fe-482f-a6e7-c234b5b9bec9 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5ca53bf-8b08-42d0-976a-cb925d353ee7 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:04 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)
Oct 23 21:36:04 user nova-compute[74337]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b (non-flash)
Oct 23 21:36:04 user nova-compute[74337]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 (non-flash)
Oct 23 21:36:04 user nova-compute[74337]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f364c63-50fe-482f-a6e7-c234b5b9bec9 (non-flash)
Oct 23 21:36:04 user nova-compute[74337]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5ca53bf-8b08-42d0-976a-cb925d353ee7 (non-flash)
Oct 23 21:36:04 user nova-compute[74337]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a (non-flash)
Oct 23 21:36:04 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:36:04 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)
Oct 23 21:36:04 user nova-compute[74337]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b (non-flash)
Oct 23 21:36:04 user nova-compute[74337]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 (non-flash)
Oct 23 21:36:04 user nova-compute[74337]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f364c63-50fe-482f-a6e7-c234b5b9bec9 (non-flash)
Oct 23 21:36:04 user nova-compute[74337]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5ca53bf-8b08-42d0-976a-cb925d353ee7 (non-flash)
Oct 23 21:36:04 user nova-compute[74337]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a (non-flash)
Oct 23 21:36:04 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:36:04 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661 -p 172.16.0.220:3260 --login {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:04 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:04 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[19cb3382-175c-4a36-8f8a-dfee3c6a52f9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:04 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661, portal: 172.16.0.220,3260]
Oct 23 21:36:04 user nova-compute[74337]: Login to [iface: default, target: iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661, portal: 172.16.0.220,3260] successful.
Oct 23 21:36:04 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:36:04 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:04 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:04 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a7a4c78-9b50-46d5-87c7-ef209c012e05]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:04 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:36:04 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:04 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:04 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d76a0130-11e5-4172-9a95-4b38263faa8f]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f364c63-50fe-482f-a6e7-c234b5b9bec9 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5ca53bf-8b08-42d0-976a-cb925d353ee7 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:04 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)
Oct 23 21:36:04 user nova-compute[74337]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b (non-flash)
Oct 23 21:36:04 user nova-compute[74337]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 (non-flash)
Oct 23 21:36:04 user nova-compute[74337]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f364c63-50fe-482f-a6e7-c234b5b9bec9 (non-flash)
Oct 23 21:36:04 user nova-compute[74337]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5ca53bf-8b08-42d0-976a-cb925d353ee7 (non-flash)
Oct 23 21:36:04 user nova-compute[74337]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a (non-flash)
Oct 23 21:36:04 user nova-compute[74337]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661 (non-flash)
Oct 23 21:36:04 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:36:04 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)
Oct 23 21:36:04 user nova-compute[74337]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b (non-flash)
Oct 23 21:36:04 user nova-compute[74337]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 (non-flash)
Oct 23 21:36:04 user nova-compute[74337]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f364c63-50fe-482f-a6e7-c234b5b9bec9 (non-flash)
Oct 23 21:36:04 user nova-compute[74337]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5ca53bf-8b08-42d0-976a-cb925d353ee7 (non-flash)
Oct 23 21:36:04 user nova-compute[74337]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a (non-flash)
Oct 23 21:36:04 user nova-compute[74337]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661 (non-flash)
Oct 23 21:36:04 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:36:04 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.339s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:36:04 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Connected to 172.16.0.220:3260 {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 21:36:04 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=74337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 21:36:04 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=74337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 21:36:04 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:04 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.021s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:04 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb0de6ea-40f2-420d-8229-db57194d99ac]: (4, ('- - 0', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:04 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 21:36:04 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ohumOZdz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 21:36:04 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:36:04 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:36:05 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Compute_service record updated for user:user {{(pid=74337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 21:36:05 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.509s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:36:05 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26529aa8-c814-41d6-a5c9-56a21910ddc7 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] [instance: 5a181593-8086-4ece-9f5b-5ccba0bfe91e] Calling os-brick to attach iSCSI Volume {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 21:36:05 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-26529aa8-c814-41d6-a5c9-56a21910ddc7 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wfjRXToB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:36:05 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-26529aa8-c814-41d6-a5c9-56a21910ddc7 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:36:05 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-26529aa8-c814-41d6-a5c9-56a21910ddc7 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:36:05 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-b7a2d4f3-30e3-4523-8957-76098f28464f tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Lock "8acc1b10-a541-4c06-aeb7-1ecf7a2457be" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 28.999s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:36:05 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.395s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:36:05 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] <== connect_volume: return (1397ms) {'type': 'block', 'scsi_wwn': '23863346437373334', 'path': '/dev/sdh'} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:36:05 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23863346437373334', 'path': '/dev/sdh'} {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 21:36:05 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-26529aa8-c814-41d6-a5c9-56a21910ddc7 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.533s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:36:05 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-26529aa8-c814-41d6-a5c9-56a21910ddc7 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:36:05 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-26529aa8-c814-41d6-a5c9-56a21910ddc7 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:36:05 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-26529aa8-c814-41d6-a5c9-56a21910ddc7 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:36:05 user nova-compute[74337]: INFO os_brick.initiator.connectors.iscsi [None req-26529aa8-c814-41d6-a5c9-56a21910ddc7 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 21:36:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f -p 172.16.0.220:3260 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:05 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[0532834a-995d-4334-9f08-ff5287dd7841]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:05 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-26529aa8-c814-41d6-a5c9-56a21910ddc7 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 21:36:05 user nova-compute[74337]:  {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:36:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f -p 172.16.0.220:3260 --interface default --op new {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:05 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Calling os-brick to attach iSCSI Volume {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 21:36:05 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ROKFtlJc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:36:05 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:36:05 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:36:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:06 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[182138e3-e372-493e-adf3-98104fcef250]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f] added\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:06 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-26529aa8-c814-41d6-a5c9-56a21910ddc7 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f] added
Oct 23 21:36:06 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:36:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:06 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:36:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:06 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eff4dd6-04aa-414f-99dc-2b2373b78cd3]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:06 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-26529aa8-c814-41d6-a5c9-56a21910ddc7 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:36:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:06 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b314462-cc53-4cb9-b43e-af8ee3d37b3b]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:06 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-26529aa8-c814-41d6-a5c9-56a21910ddc7 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:36:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wfjRXToB {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wfjRXToB" returned: 0 in 0.022s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:06 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d352af-4b07-46f3-b8f9-2e1ff0f583ee]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:06 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-26529aa8-c814-41d6-a5c9-56a21910ddc7 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wfjRXToB'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:36:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:06 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[19bd89d9-021d-47cc-a590-060af710d930]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:06 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-26529aa8-c814-41d6-a5c9-56a21910ddc7 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:36:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:06 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b25195e6-9df5-47e8-b81c-277090e7bc30]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f364c63-50fe-482f-a6e7-c234b5b9bec9 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5ca53bf-8b08-42d0-976a-cb925d353ee7 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:06 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-26529aa8-c814-41d6-a5c9-56a21910ddc7 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)
Oct 23 21:36:06 user nova-compute[74337]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b (non-flash)
Oct 23 21:36:06 user nova-compute[74337]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 (non-flash)
Oct 23 21:36:06 user nova-compute[74337]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f364c63-50fe-482f-a6e7-c234b5b9bec9 (non-flash)
Oct 23 21:36:06 user nova-compute[74337]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5ca53bf-8b08-42d0-976a-cb925d353ee7 (non-flash)
Oct 23 21:36:06 user nova-compute[74337]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a (non-flash)
Oct 23 21:36:06 user nova-compute[74337]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661 (non-flash)
Oct 23 21:36:06 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:36:06 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-26529aa8-c814-41d6-a5c9-56a21910ddc7 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)
Oct 23 21:36:06 user nova-compute[74337]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b (non-flash)
Oct 23 21:36:06 user nova-compute[74337]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 (non-flash)
Oct 23 21:36:06 user nova-compute[74337]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f364c63-50fe-482f-a6e7-c234b5b9bec9 (non-flash)
Oct 23 21:36:06 user nova-compute[74337]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5ca53bf-8b08-42d0-976a-cb925d353ee7 (non-flash)
Oct 23 21:36:06 user nova-compute[74337]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a (non-flash)
Oct 23 21:36:06 user nova-compute[74337]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661 (non-flash)
Oct 23 21:36:06 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:36:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f -p 172.16.0.220:3260 --login {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:06 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[5815f48e-12fa-4e1a-ac52-315ebaaa5fc9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:06 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-26529aa8-c814-41d6-a5c9-56a21910ddc7 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f, portal: 172.16.0.220,3260]
Oct 23 21:36:06 user nova-compute[74337]: Login to [iface: default, target: iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f, portal: 172.16.0.220,3260] successful.
Oct 23 21:36:06 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:36:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:06 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4978792-e8e7-4bc1-867b-0a2e94ec0ea0]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:06 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-26529aa8-c814-41d6-a5c9-56a21910ddc7 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:36:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:06 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4db6427-c8cf-4ed0-864c-14652d6ce591]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f364c63-50fe-482f-a6e7-c234b5b9bec9 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5ca53bf-8b08-42d0-976a-cb925d353ee7 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:06 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-26529aa8-c814-41d6-a5c9-56a21910ddc7 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f (non-flash)
Oct 23 21:36:06 user nova-compute[74337]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)
Oct 23 21:36:06 user nova-compute[74337]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b (non-flash)
Oct 23 21:36:06 user nova-compute[74337]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 (non-flash)
Oct 23 21:36:06 user nova-compute[74337]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f364c63-50fe-482f-a6e7-c234b5b9bec9 (non-flash)
Oct 23 21:36:06 user nova-compute[74337]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5ca53bf-8b08-42d0-976a-cb925d353ee7 (non-flash)
Oct 23 21:36:06 user nova-compute[74337]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a (non-flash)
Oct 23 21:36:06 user nova-compute[74337]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661 (non-flash)
Oct 23 21:36:06 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:36:06 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-26529aa8-c814-41d6-a5c9-56a21910ddc7 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f (non-flash)
Oct 23 21:36:06 user nova-compute[74337]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)
Oct 23 21:36:06 user nova-compute[74337]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b (non-flash)
Oct 23 21:36:06 user nova-compute[74337]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 (non-flash)
Oct 23 21:36:06 user nova-compute[74337]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f364c63-50fe-482f-a6e7-c234b5b9bec9 (non-flash)
Oct 23 21:36:06 user nova-compute[74337]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5ca53bf-8b08-42d0-976a-cb925d353ee7 (non-flash)
Oct 23 21:36:06 user nova-compute[74337]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a (non-flash)
Oct 23 21:36:06 user nova-compute[74337]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661 (non-flash)
Oct 23 21:36:06 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:36:06 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-26529aa8-c814-41d6-a5c9-56a21910ddc7 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.325s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:36:06 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-26529aa8-c814-41d6-a5c9-56a21910ddc7 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Connected to 172.16.0.220:3260 {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 21:36:06 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-26529aa8-c814-41d6-a5c9-56a21910ddc7 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] HCTL ('40', '-', '-', 0) found on session 10 with lun 0 {{(pid=74337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 21:36:06 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-26529aa8-c814-41d6-a5c9-56a21910ddc7 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=74337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 21:36:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.020s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:06 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8fb7285-22a7-4726-a817-7f4c162da48f]: (4, ('- - 0', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:06 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-26529aa8-c814-41d6-a5c9-56a21910ddc7 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Searching for a device in session 10 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=74337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 21:36:06 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-26529aa8-c814-41d6-a5c9-56a21910ddc7 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wfjRXToB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 21:36:06 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-0d7dd564-4f5e-4591-917b-08d3fe1d119c tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Acquiring lock "d45e8ae8-371b-46ae-849d-d7f7d5bbd770" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:36:06 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-0d7dd564-4f5e-4591-917b-08d3fe1d119c tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Lock "d45e8ae8-371b-46ae-849d-d7f7d5bbd770" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:36:06 user nova-compute[74337]: INFO nova.compute.manager [None req-0d7dd564-4f5e-4591-917b-08d3fe1d119c tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] [instance: d45e8ae8-371b-46ae-849d-d7f7d5bbd770] Detaching volume 2f364c63-50fe-482f-a6e7-c234b5b9bec9
Oct 23 21:36:06 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:06 user nova-compute[74337]: INFO nova.virt.block_device [None req-0d7dd564-4f5e-4591-917b-08d3fe1d119c tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] [instance: d45e8ae8-371b-46ae-849d-d7f7d5bbd770] Attempting to driver detach volume 2f364c63-50fe-482f-a6e7-c234b5b9bec9 from mountpoint /dev/vdb
Oct 23 21:36:06 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-0d7dd564-4f5e-4591-917b-08d3fe1d119c tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Attempting to detach device vdb from instance d45e8ae8-371b-46ae-849d-d7f7d5bbd770 from the persistent domain config. {{(pid=74337) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 21:36:06 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-0d7dd564-4f5e-4591-917b-08d3fe1d119c tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 21:36:06 user nova-compute[74337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 21:36:06 user nova-compute[74337]:   <source dev="/dev/sde"/>
Oct 23 21:36:06 user nova-compute[74337]:   <target dev="vdb" bus="virtio"/>
Oct 23 21:36:06 user nova-compute[74337]:   <serial>2f364c63-50fe-482f-a6e7-c234b5b9bec9</serial>
Oct 23 21:36:06 user nova-compute[74337]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 21:36:06 user nova-compute[74337]: </disk>
Oct 23 21:36:06 user nova-compute[74337]:  {{(pid=74337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 21:36:06 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-0d7dd564-4f5e-4591-917b-08d3fe1d119c tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Successfully detached device vdb from instance d45e8ae8-371b-46ae-849d-d7f7d5bbd770 from the persistent domain config.
Oct 23 21:36:06 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-0d7dd564-4f5e-4591-917b-08d3fe1d119c tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d45e8ae8-371b-46ae-849d-d7f7d5bbd770 from the live domain config. {{(pid=74337) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 21:36:06 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-0d7dd564-4f5e-4591-917b-08d3fe1d119c tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 21:36:06 user nova-compute[74337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 21:36:06 user nova-compute[74337]:   <source dev="/dev/sde"/>
Oct 23 21:36:06 user nova-compute[74337]:   <target dev="vdb" bus="virtio"/>
Oct 23 21:36:06 user nova-compute[74337]:   <serial>2f364c63-50fe-482f-a6e7-c234b5b9bec9</serial>
Oct 23 21:36:06 user nova-compute[74337]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 21:36:06 user nova-compute[74337]: </disk>
Oct 23 21:36:06 user nova-compute[74337]:  {{(pid=74337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 21:36:07 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-0d7dd564-4f5e-4591-917b-08d3fe1d119c tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d45e8ae8-371b-46ae-849d-d7f7d5bbd770 {{(pid=74337) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 21:36:07 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-26529aa8-c814-41d6-a5c9-56a21910ddc7 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.364s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:36:07 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-26529aa8-c814-41d6-a5c9-56a21910ddc7 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] <== connect_volume: return (1897ms) {'type': 'block', 'scsi_wwn': '23765313736323238', 'path': '/dev/sdi'} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:36:07 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26529aa8-c814-41d6-a5c9-56a21910ddc7 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] [instance: 5a181593-8086-4ece-9f5b-5ccba0bfe91e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23765313736323238', 'path': '/dev/sdi'} {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 21:36:07 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.333s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:36:07 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:36:07 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:36:07 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:36:07 user nova-compute[74337]: INFO os_brick.initiator.connectors.iscsi [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 21:36:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496 -p 172.16.0.220:3260 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:07 user nova-compute[74337]: DEBUG nova.objects.instance [None req-26529aa8-c814-41d6-a5c9-56a21910ddc7 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Lazy-loading 'flavor' on Instance uuid 5a181593-8086-4ece-9f5b-5ccba0bfe91e {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:36:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:07 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[71cce219-7771-4082-a3c0-085d50d9be36]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:07 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 21:36:07 user nova-compute[74337]:  {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:36:07 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-26529aa8-c814-41d6-a5c9-56a21910ddc7 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 21:36:07 user nova-compute[74337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 21:36:07 user nova-compute[74337]:   <source dev="/dev/sdi"/>
Oct 23 21:36:07 user nova-compute[74337]:   <target dev="vdb" bus="virtio"/>
Oct 23 21:36:07 user nova-compute[74337]:   <serial>06d4748a-a032-4937-a18b-c323e56f507f</serial>
Oct 23 21:36:07 user nova-compute[74337]: </disk>
Oct 23 21:36:07 user nova-compute[74337]:  {{(pid=74337) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 21:36:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496 -p 172.16.0.220:3260 --interface default --op new {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:07 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[983db82f-d85e-43b9-b8cb-c7c3bd60652d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496] added\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:07 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496] added
Oct 23 21:36:07 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:36:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:07 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[5085cb35-5c72-42a5-84f9-4b96aa0089ec]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:07 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:36:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:07 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6de5cff2-f371-4aa0-b374-5557dbf64c97]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:07 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:36:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ROKFtlJc {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ROKFtlJc" returned: 0 in 0.024s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:07 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c17f97-7737-43b1-bd2e-5c66bb923d82]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:07 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ROKFtlJc'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:36:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:07 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[9011aa53-e846-4433-b473-03cc0694f58a]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:07 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:36:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:07 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[709563e8-bb27-4657-abee-591291f4b292]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f364c63-50fe-482f-a6e7-c234b5b9bec9 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5ca53bf-8b08-42d0-976a-cb925d353ee7 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:07 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f (non-flash)
Oct 23 21:36:07 user nova-compute[74337]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)
Oct 23 21:36:07 user nova-compute[74337]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b (non-flash)
Oct 23 21:36:07 user nova-compute[74337]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 (non-flash)
Oct 23 21:36:07 user nova-compute[74337]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f364c63-50fe-482f-a6e7-c234b5b9bec9 (non-flash)
Oct 23 21:36:07 user nova-compute[74337]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5ca53bf-8b08-42d0-976a-cb925d353ee7 (non-flash)
Oct 23 21:36:07 user nova-compute[74337]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a (non-flash)
Oct 23 21:36:07 user nova-compute[74337]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661 (non-flash)
Oct 23 21:36:07 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:36:07 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f (non-flash)
Oct 23 21:36:07 user nova-compute[74337]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)
Oct 23 21:36:07 user nova-compute[74337]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b (non-flash)
Oct 23 21:36:07 user nova-compute[74337]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 (non-flash)
Oct 23 21:36:07 user nova-compute[74337]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f364c63-50fe-482f-a6e7-c234b5b9bec9 (non-flash)
Oct 23 21:36:07 user nova-compute[74337]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5ca53bf-8b08-42d0-976a-cb925d353ee7 (non-flash)
Oct 23 21:36:07 user nova-compute[74337]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a (non-flash)
Oct 23 21:36:07 user nova-compute[74337]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661 (non-flash)
Oct 23 21:36:07 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:36:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496 -p 172.16.0.220:3260 --login {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496 -p 172.16.0.220:3260 --login" returned: 0 in 0.093s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:07 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[957cd1f5-f255-4822-b743-6d0cc3c66280]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:07 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496, portal: 172.16.0.220,3260]
Oct 23 21:36:07 user nova-compute[74337]: Login to [iface: default, target: iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496, portal: 172.16.0.220,3260] successful.
Oct 23 21:36:07 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:36:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:07 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead4c90a-6a19-49bd-bd69-fd6f2bd24bed]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:07 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:36:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:07 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-b8cbe48b-aaa8-4098-b2f9-5cfbb8fc7d1e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Acquiring lock "8acc1b10-a541-4c06-aeb7-1ecf7a2457be" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:36:07 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-b8cbe48b-aaa8-4098-b2f9-5cfbb8fc7d1e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Lock "8acc1b10-a541-4c06-aeb7-1ecf7a2457be" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:36:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:07 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[470f7836-a75b-42b1-abec-34e6695cd5ac]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f364c63-50fe-482f-a6e7-c234b5b9bec9 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5ca53bf-8b08-42d0-976a-cb925d353ee7 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:07 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f (non-flash)
Oct 23 21:36:07 user nova-compute[74337]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496 (non-flash)
Oct 23 21:36:07 user nova-compute[74337]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)
Oct 23 21:36:07 user nova-compute[74337]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b (non-flash)
Oct 23 21:36:07 user nova-compute[74337]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 (non-flash)
Oct 23 21:36:07 user nova-compute[74337]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f364c63-50fe-482f-a6e7-c234b5b9bec9 (non-flash)
Oct 23 21:36:07 user nova-compute[74337]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5ca53bf-8b08-42d0-976a-cb925d353ee7 (non-flash)
Oct 23 21:36:07 user nova-compute[74337]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a (non-flash)
Oct 23 21:36:07 user nova-compute[74337]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661 (non-flash)
Oct 23 21:36:07 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:36:07 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f (non-flash)
Oct 23 21:36:07 user nova-compute[74337]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496 (non-flash)
Oct 23 21:36:07 user nova-compute[74337]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)
Oct 23 21:36:07 user nova-compute[74337]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b (non-flash)
Oct 23 21:36:07 user nova-compute[74337]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 (non-flash)
Oct 23 21:36:07 user nova-compute[74337]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f364c63-50fe-482f-a6e7-c234b5b9bec9 (non-flash)
Oct 23 21:36:07 user nova-compute[74337]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5ca53bf-8b08-42d0-976a-cb925d353ee7 (non-flash)
Oct 23 21:36:07 user nova-compute[74337]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a (non-flash)
Oct 23 21:36:07 user nova-compute[74337]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661 (non-flash)
Oct 23 21:36:07 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:36:07 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.382s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:36:07 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Connected to 172.16.0.220:3260 {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 21:36:07 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] HCTL ('41', '-', '-', 0) found on session 11 with lun 0 {{(pid=74337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 21:36:07 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=74337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 21:36:07 user nova-compute[74337]: INFO nova.compute.manager [None req-b8cbe48b-aaa8-4098-b2f9-5cfbb8fc7d1e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] Detaching volume a5ca53bf-8b08-42d0-976a-cb925d353ee7
Oct 23 21:36:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:07 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e9a8f8-4310-4c24-9984-06055e9163a5]: (4, ('- - 0', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:07 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Searching for a device in session 11 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=74337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 21:36:07 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ROKFtlJc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 21:36:07 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-26529aa8-c814-41d6-a5c9-56a21910ddc7 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] No BDM found with device name vda, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 21:36:07 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-26529aa8-c814-41d6-a5c9-56a21910ddc7 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 21:36:07 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-26529aa8-c814-41d6-a5c9-56a21910ddc7 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] No VIF found with MAC fa:16:3e:9a:56:5a, not building metadata {{(pid=74337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 21:36:07 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:08 user nova-compute[74337]: INFO nova.virt.block_device [None req-b8cbe48b-aaa8-4098-b2f9-5cfbb8fc7d1e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] Attempting to driver detach volume a5ca53bf-8b08-42d0-976a-cb925d353ee7 from mountpoint /dev/vdb
Oct 23 21:36:08 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-b8cbe48b-aaa8-4098-b2f9-5cfbb8fc7d1e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Attempting to detach device vdb from instance 8acc1b10-a541-4c06-aeb7-1ecf7a2457be from the persistent domain config. {{(pid=74337) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 21:36:08 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-b8cbe48b-aaa8-4098-b2f9-5cfbb8fc7d1e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 21:36:08 user nova-compute[74337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 21:36:08 user nova-compute[74337]:   <source dev="/dev/sdf"/>
Oct 23 21:36:08 user nova-compute[74337]:   <target dev="vdb" bus="virtio"/>
Oct 23 21:36:08 user nova-compute[74337]:   <serial>a5ca53bf-8b08-42d0-976a-cb925d353ee7</serial>
Oct 23 21:36:08 user nova-compute[74337]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 23 21:36:08 user nova-compute[74337]: </disk>
Oct 23 21:36:08 user nova-compute[74337]:  {{(pid=74337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 21:36:08 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-b8cbe48b-aaa8-4098-b2f9-5cfbb8fc7d1e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Successfully detached device vdb from instance 8acc1b10-a541-4c06-aeb7-1ecf7a2457be from the persistent domain config.
Oct 23 21:36:08 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-b8cbe48b-aaa8-4098-b2f9-5cfbb8fc7d1e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8acc1b10-a541-4c06-aeb7-1ecf7a2457be from the live domain config. {{(pid=74337) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 21:36:08 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-b8cbe48b-aaa8-4098-b2f9-5cfbb8fc7d1e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 21:36:08 user nova-compute[74337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 21:36:08 user nova-compute[74337]:   <source dev="/dev/sdf"/>
Oct 23 21:36:08 user nova-compute[74337]:   <target dev="vdb" bus="virtio"/>
Oct 23 21:36:08 user nova-compute[74337]:   <serial>a5ca53bf-8b08-42d0-976a-cb925d353ee7</serial>
Oct 23 21:36:08 user nova-compute[74337]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 23 21:36:08 user nova-compute[74337]: </disk>
Oct 23 21:36:08 user nova-compute[74337]:  {{(pid=74337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 21:36:08 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-26529aa8-c814-41d6-a5c9-56a21910ddc7 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Lock "5a181593-8086-4ece-9f5b-5ccba0bfe91e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 31.315s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:36:08 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-b8cbe48b-aaa8-4098-b2f9-5cfbb8fc7d1e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8acc1b10-a541-4c06-aeb7-1ecf7a2457be {{(pid=74337) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 21:36:08 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.429s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:36:08 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] <== connect_volume: return (2763ms) {'type': 'block', 'scsi_wwn': '26236326164373166', 'path': '/dev/sdj'} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:36:08 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26236326164373166', 'path': '/dev/sdj'} {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 21:36:08 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T21:34:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-605341238',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-605341238',id=11,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKmnJ7mFnPC72zwxOhbZBqQQcw8wKcBQrJU/kXbtycxWGrYKWY4ryrk3P1/UrfZxJmArjpq8PnfjCzLxm5CSleEJWdCvoG6Fk25LMsRefGname4N0hV8zcfbkPovW5pJmA==',key_name='tempest-keypair-290861577',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46b2b924f3a4461ba09eb54ee42f4649',ramdisk_id='',reservation_id='r-gnrgh800',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-66532269',owner_user_name='tempest-TaggedBootDevicesTest_v242-66532269-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:34:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fdc4cfd43887413eabd86770e724e2b8',uuid=04c02325-7ce4-45c2-819b-c656e93c96ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ea512c9-8ab6-49a3-9f77-14bcd380f8e8", "address": "fa:16:3e:75:d8:7f", "network": {"id": "e5fd79cb-72f1-4d32-a604-b9518e375fcd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-840255736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46b2b924f3a4461ba09eb54ee42f4649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ea512c9-8a", "ovs_interfaceid": "2ea512c9-8ab6-49a3-9f77-14bcd380f8e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 21:36:08 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Converting VIF {"id": "2ea512c9-8ab6-49a3-9f77-14bcd380f8e8", "address": "fa:16:3e:75:d8:7f", "network": {"id": "e5fd79cb-72f1-4d32-a604-b9518e375fcd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-840255736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46b2b924f3a4461ba09eb54ee42f4649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ea512c9-8a", "ovs_interfaceid": "2ea512c9-8ab6-49a3-9f77-14bcd380f8e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:36:08 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:d8:7f,bridge_name='br-int',has_traffic_filtering=True,id=2ea512c9-8ab6-49a3-9f77-14bcd380f8e8,network=Network(e5fd79cb-72f1-4d32-a604-b9518e375fcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ea512c9-8a') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:36:08 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T21:34:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-605341238',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-605341238',id=11,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKmnJ7mFnPC72zwxOhbZBqQQcw8wKcBQrJU/kXbtycxWGrYKWY4ryrk3P1/UrfZxJmArjpq8PnfjCzLxm5CSleEJWdCvoG6Fk25LMsRefGname4N0hV8zcfbkPovW5pJmA==',key_name='tempest-keypair-290861577',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46b2b924f3a4461ba09eb54ee42f4649',ramdisk_id='',reservation_id='r-gnrgh800',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-66532269',owner_user_name='tempest-TaggedBootDevicesTest_v242-66532269-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:34:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fdc4cfd43887413eabd86770e724e2b8',uuid=04c02325-7ce4-45c2-819b-c656e93c96ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2727b3bf-35e4-485a-b44b-66406b7d1597", "address": "fa:16:3e:e2:6e:58", "network": {"id": "8a3d7452-cadc-4728-a772-801d6a5c4770", "bridge": "br-int", "label": "tempest-device-tagging-net1-560176148", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46b2b924f3a4461ba09eb54ee42f4649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2727b3bf-35", "ovs_interfaceid": "2727b3bf-35e4-485a-b44b-66406b7d1597", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 21:36:08 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Converting VIF {"id": "2727b3bf-35e4-485a-b44b-66406b7d1597", "address": "fa:16:3e:e2:6e:58", "network": {"id": "8a3d7452-cadc-4728-a772-801d6a5c4770", "bridge": "br-int", "label": "tempest-device-tagging-net1-560176148", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46b2b924f3a4461ba09eb54ee42f4649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2727b3bf-35", "ovs_interfaceid": "2727b3bf-35e4-485a-b44b-66406b7d1597", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:36:08 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:6e:58,bridge_name='br-int',has_traffic_filtering=True,id=2727b3bf-35e4-485a-b44b-66406b7d1597,network=Network(8a3d7452-cadc-4728-a772-801d6a5c4770),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2727b3bf-35') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:36:08 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T21:34:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-605341238',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-605341238',id=11,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKmnJ7mFnPC72zwxOhbZBqQQcw8wKcBQrJU/kXbtycxWGrYKWY4ryrk3P1/UrfZxJmArjpq8PnfjCzLxm5CSleEJWdCvoG6Fk25LMsRefGname4N0hV8zcfbkPovW5pJmA==',key_name='tempest-keypair-290861577',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46b2b924f3a4461ba09eb54ee42f4649',ramdisk_id='',reservation_id='r-gnrgh800',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-66532269',owner_user_name='tempest-TaggedBootDevicesTest_v242-66532269-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:34:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fdc4cfd43887413eabd86770e724e2b8',uuid=04c02325-7ce4-45c2-819b-c656e93c96ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9141d0eb-5e49-4a83-993f-3eac6a526dfd", "address": "fa:16:3e:1f:61:c0", "network": {"id": "8a3d7452-cadc-4728-a772-801d6a5c4770", "bridge": "br-int", "label": "tempest-device-tagging-net1-560176148", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46b2b924f3a4461ba09eb54ee42f4649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9141d0eb-5e", "ovs_interfaceid": "9141d0eb-5e49-4a83-993f-3eac6a526dfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 21:36:08 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Converting VIF {"id": "9141d0eb-5e49-4a83-993f-3eac6a526dfd", "address": "fa:16:3e:1f:61:c0", "network": {"id": "8a3d7452-cadc-4728-a772-801d6a5c4770", "bridge": "br-int", "label": "tempest-device-tagging-net1-560176148", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46b2b924f3a4461ba09eb54ee42f4649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9141d0eb-5e", "ovs_interfaceid": "9141d0eb-5e49-4a83-993f-3eac6a526dfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:36:08 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:61:c0,bridge_name='br-int',has_traffic_filtering=True,id=9141d0eb-5e49-4a83-993f-3eac6a526dfd,network=Network(8a3d7452-cadc-4728-a772-801d6a5c4770),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9141d0eb-5e') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:36:08 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T21:34:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-605341238',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-605341238',id=11,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKmnJ7mFnPC72zwxOhbZBqQQcw8wKcBQrJU/kXbtycxWGrYKWY4ryrk3P1/UrfZxJmArjpq8PnfjCzLxm5CSleEJWdCvoG6Fk25LMsRefGname4N0hV8zcfbkPovW5pJmA==',key_name='tempest-keypair-290861577',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46b2b924f3a4461ba09eb54ee42f4649',ramdisk_id='',reservation_id='r-gnrgh800',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-66532269',owner_user_name='tempest-TaggedBootDevicesTest_v242-66532269-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:34:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fdc4cfd43887413eabd86770e724e2b8',uuid=04c02325-7ce4-45c2-819b-c656e93c96ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4da5a263-b3c7-49ba-b2e1-d54cbb5f0f0e", "address": "fa:16:3e:2d:65:73", "network": {"id": "8a3d7452-cadc-4728-a772-801d6a5c4770", "bridge": "br-int", "label": "tempest-device-tagging-net1-560176148", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46b2b924f3a4461ba09eb54ee42f4649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4da5a263-b3", "ovs_interfaceid": "4da5a263-b3c7-49ba-b2e1-d54cbb5f0f0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 21:36:08 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Converting VIF {"id": "4da5a263-b3c7-49ba-b2e1-d54cbb5f0f0e", "address": "fa:16:3e:2d:65:73", "network": {"id": "8a3d7452-cadc-4728-a772-801d6a5c4770", "bridge": "br-int", "label": "tempest-device-tagging-net1-560176148", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46b2b924f3a4461ba09eb54ee42f4649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4da5a263-b3", "ovs_interfaceid": "4da5a263-b3c7-49ba-b2e1-d54cbb5f0f0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:36:08 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:65:73,bridge_name='br-int',has_traffic_filtering=True,id=4da5a263-b3c7-49ba-b2e1-d54cbb5f0f0e,network=Network(8a3d7452-cadc-4728-a772-801d6a5c4770),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4da5a263-b3') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:36:08 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T21:34:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-605341238',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-605341238',id=11,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKmnJ7mFnPC72zwxOhbZBqQQcw8wKcBQrJU/kXbtycxWGrYKWY4ryrk3P1/UrfZxJmArjpq8PnfjCzLxm5CSleEJWdCvoG6Fk25LMsRefGname4N0hV8zcfbkPovW5pJmA==',key_name='tempest-keypair-290861577',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46b2b924f3a4461ba09eb54ee42f4649',ramdisk_id='',reservation_id='r-gnrgh800',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-66532269',owner_user_name='tempest-TaggedBootDevicesTest_v242-66532269-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:34:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fdc4cfd43887413eabd86770e724e2b8',uuid=04c02325-7ce4-45c2-819b-c656e93c96ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d35e88b3-1ad6-42dc-9b9f-281cb0e99dc8", "address": "fa:16:3e:51:c9:d7", "network": {"id": "8a3d7452-cadc-4728-a772-801d6a5c4770", "bridge": "br-int", "label": "tempest-device-tagging-net1-560176148", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46b2b924f3a4461ba09eb54ee42f4649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd35e88b3-1a", "ovs_interfaceid": "d35e88b3-1ad6-42dc-9b9f-281cb0e99dc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 21:36:08 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Converting VIF {"id": "d35e88b3-1ad6-42dc-9b9f-281cb0e99dc8", "address": "fa:16:3e:51:c9:d7", "network": {"id": "8a3d7452-cadc-4728-a772-801d6a5c4770", "bridge": "br-int", "label": "tempest-device-tagging-net1-560176148", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46b2b924f3a4461ba09eb54ee42f4649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd35e88b3-1a", "ovs_interfaceid": "d35e88b3-1ad6-42dc-9b9f-281cb0e99dc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:36:08 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:c9:d7,bridge_name='br-int',has_traffic_filtering=True,id=d35e88b3-1ad6-42dc-9b9f-281cb0e99dc8,network=Network(8a3d7452-cadc-4728-a772-801d6a5c4770),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd35e88b3-1a') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:36:08 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T21:34:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-605341238',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-605341238',id=11,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKmnJ7mFnPC72zwxOhbZBqQQcw8wKcBQrJU/kXbtycxWGrYKWY4ryrk3P1/UrfZxJmArjpq8PnfjCzLxm5CSleEJWdCvoG6Fk25LMsRefGname4N0hV8zcfbkPovW5pJmA==',key_name='tempest-keypair-290861577',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46b2b924f3a4461ba09eb54ee42f4649',ramdisk_id='',reservation_id='r-gnrgh800',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-66532269',owner_user_name='tempest-TaggedBootDevicesTest_v242-66532269-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:34:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fdc4cfd43887413eabd86770e724e2b8',uuid=04c02325-7ce4-45c2-819b-c656e93c96ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "78d439bc-58eb-4984-86f7-e9610cd8c17f", "address": "fa:16:3e:a3:26:2f", "network": {"id": "1f1cb866-1870-48d7-8866-ac73e71c8ef4", "bridge": "br-int", "label": "tempest-device-tagging-net2-663589537", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "46b2b924f3a4461ba09eb54ee42f4649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78d439bc-58", "ovs_interfaceid": "78d439bc-58eb-4984-86f7-e9610cd8c17f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 21:36:08 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Converting VIF {"id": "78d439bc-58eb-4984-86f7-e9610cd8c17f", "address": "fa:16:3e:a3:26:2f", "network": {"id": "1f1cb866-1870-48d7-8866-ac73e71c8ef4", "bridge": "br-int", "label": "tempest-device-tagging-net2-663589537", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "46b2b924f3a4461ba09eb54ee42f4649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78d439bc-58", "ovs_interfaceid": "78d439bc-58eb-4984-86f7-e9610cd8c17f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:36:08 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:26:2f,bridge_name='br-int',has_traffic_filtering=True,id=78d439bc-58eb-4984-86f7-e9610cd8c17f,network=Network(1f1cb866-1870-48d7-8866-ac73e71c8ef4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78d439bc-58') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:36:08 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T21:34:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-605341238',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-605341238',id=11,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKmnJ7mFnPC72zwxOhbZBqQQcw8wKcBQrJU/kXbtycxWGrYKWY4ryrk3P1/UrfZxJmArjpq8PnfjCzLxm5CSleEJWdCvoG6Fk25LMsRefGname4N0hV8zcfbkPovW5pJmA==',key_name='tempest-keypair-290861577',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46b2b924f3a4461ba09eb54ee42f4649',ramdisk_id='',reservation_id='r-gnrgh800',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-66532269',owner_user_name='tempest-TaggedBootDevicesTest_v242-66532269-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:34:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fdc4cfd43887413eabd86770e724e2b8',uuid=04c02325-7ce4-45c2-819b-c656e93c96ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "870087f8-5e43-4e98-a6ab-b65529f9fa6b", "address": "fa:16:3e:96:be:1f", "network": {"id": "1f1cb866-1870-48d7-8866-ac73e71c8ef4", "bridge": "br-int", "label": "tempest-device-tagging-net2-663589537", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "46b2b924f3a4461ba09eb54ee42f4649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap870087f8-5e", "ovs_interfaceid": "870087f8-5e43-4e98-a6ab-b65529f9fa6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 21:36:08 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Converting VIF {"id": "870087f8-5e43-4e98-a6ab-b65529f9fa6b", "address": "fa:16:3e:96:be:1f", "network": {"id": "1f1cb866-1870-48d7-8866-ac73e71c8ef4", "bridge": "br-int", "label": "tempest-device-tagging-net2-663589537", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "46b2b924f3a4461ba09eb54ee42f4649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap870087f8-5e", "ovs_interfaceid": "870087f8-5e43-4e98-a6ab-b65529f9fa6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:36:08 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:be:1f,bridge_name='br-int',has_traffic_filtering=True,id=870087f8-5e43-4e98-a6ab-b65529f9fa6b,network=Network(1f1cb866-1870-48d7-8866-ac73e71c8ef4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap870087f8-5e') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:36:08 user nova-compute[74337]: DEBUG nova.objects.instance [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Lazy-loading 'pci_devices' on Instance uuid 04c02325-7ce4-45c2-819b-c656e93c96ca {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:36:08 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] End _get_guest_xml xml=<domain type="kvm">
Oct 23 21:36:08 user nova-compute[74337]:   <uuid>04c02325-7ce4-45c2-819b-c656e93c96ca</uuid>
Oct 23 21:36:08 user nova-compute[74337]:   <name>instance-0000000b</name>
Oct 23 21:36:08 user nova-compute[74337]:   <memory>524288</memory>
Oct 23 21:36:08 user nova-compute[74337]:   <vcpu>1</vcpu>
Oct 23 21:36:08 user nova-compute[74337]:   <metadata>
Oct 23 21:36:08 user nova-compute[74337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 21:36:08 user nova-compute[74337]:       <nova:package version="0.0.0"/>
Oct 23 21:36:08 user nova-compute[74337]:       <nova:name>tempest-device-tagging-server-605341238</nova:name>
Oct 23 21:36:08 user nova-compute[74337]:       <nova:creationTime>2023-10-23 21:36:02</nova:creationTime>
Oct 23 21:36:08 user nova-compute[74337]:       <nova:flavor name="m1.tiny">
Oct 23 21:36:08 user nova-compute[74337]:         <nova:memory>512</nova:memory>
Oct 23 21:36:08 user nova-compute[74337]:         <nova:disk>1</nova:disk>
Oct 23 21:36:08 user nova-compute[74337]:         <nova:swap>0</nova:swap>
Oct 23 21:36:08 user nova-compute[74337]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 21:36:08 user nova-compute[74337]:         <nova:vcpus>1</nova:vcpus>
Oct 23 21:36:08 user nova-compute[74337]:       </nova:flavor>
Oct 23 21:36:08 user nova-compute[74337]:       <nova:owner>
Oct 23 21:36:08 user nova-compute[74337]:         <nova:user uuid="fdc4cfd43887413eabd86770e724e2b8">tempest-TaggedBootDevicesTest_v242-66532269-project-member</nova:user>
Oct 23 21:36:08 user nova-compute[74337]:         <nova:project uuid="46b2b924f3a4461ba09eb54ee42f4649">tempest-TaggedBootDevicesTest_v242-66532269</nova:project>
Oct 23 21:36:08 user nova-compute[74337]:       </nova:owner>
Oct 23 21:36:08 user nova-compute[74337]:       <nova:root type="image" uuid="d859d89d-998d-4109-b26a-0d6e28152932"/>
Oct 23 21:36:08 user nova-compute[74337]:       <nova:ports>
Oct 23 21:36:08 user nova-compute[74337]:         <nova:port uuid="2ea512c9-8ab6-49a3-9f77-14bcd380f8e8">
Oct 23 21:36:08 user nova-compute[74337]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 23 21:36:08 user nova-compute[74337]:         </nova:port>
Oct 23 21:36:08 user nova-compute[74337]:         <nova:port uuid="2727b3bf-35e4-485a-b44b-66406b7d1597">
Oct 23 21:36:08 user nova-compute[74337]:           <nova:ip type="fixed" address="10.1.1.230" ipVersion="4"/>
Oct 23 21:36:08 user nova-compute[74337]:         </nova:port>
Oct 23 21:36:08 user nova-compute[74337]:         <nova:port uuid="9141d0eb-5e49-4a83-993f-3eac6a526dfd">
Oct 23 21:36:08 user nova-compute[74337]:           <nova:ip type="fixed" address="10.1.1.42" ipVersion="4"/>
Oct 23 21:36:08 user nova-compute[74337]:         </nova:port>
Oct 23 21:36:08 user nova-compute[74337]:         <nova:port uuid="4da5a263-b3c7-49ba-b2e1-d54cbb5f0f0e">
Oct 23 21:36:08 user nova-compute[74337]:           <nova:ip type="fixed" address="10.1.1.17" ipVersion="4"/>
Oct 23 21:36:08 user nova-compute[74337]:         </nova:port>
Oct 23 21:36:08 user nova-compute[74337]:         <nova:port uuid="d35e88b3-1ad6-42dc-9b9f-281cb0e99dc8">
Oct 23 21:36:08 user nova-compute[74337]:           <nova:ip type="fixed" address="10.1.1.15" ipVersion="4"/>
Oct 23 21:36:08 user nova-compute[74337]:         </nova:port>
Oct 23 21:36:08 user nova-compute[74337]:         <nova:port uuid="78d439bc-58eb-4984-86f7-e9610cd8c17f">
Oct 23 21:36:08 user nova-compute[74337]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Oct 23 21:36:08 user nova-compute[74337]:         </nova:port>
Oct 23 21:36:08 user nova-compute[74337]:         <nova:port uuid="870087f8-5e43-4e98-a6ab-b65529f9fa6b">
Oct 23 21:36:08 user nova-compute[74337]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Oct 23 21:36:08 user nova-compute[74337]:         </nova:port>
Oct 23 21:36:08 user nova-compute[74337]:       </nova:ports>
Oct 23 21:36:08 user nova-compute[74337]:     </nova:instance>
Oct 23 21:36:08 user nova-compute[74337]:   </metadata>
Oct 23 21:36:08 user nova-compute[74337]:   <sysinfo type="smbios">
Oct 23 21:36:08 user nova-compute[74337]:     <system>
Oct 23 21:36:08 user nova-compute[74337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 21:36:08 user nova-compute[74337]:       <entry name="product">OpenStack Nova</entry>
Oct 23 21:36:08 user nova-compute[74337]:       <entry name="version">0.0.0</entry>
Oct 23 21:36:08 user nova-compute[74337]:       <entry name="serial">04c02325-7ce4-45c2-819b-c656e93c96ca</entry>
Oct 23 21:36:08 user nova-compute[74337]:       <entry name="uuid">04c02325-7ce4-45c2-819b-c656e93c96ca</entry>
Oct 23 21:36:08 user nova-compute[74337]:       <entry name="family">Virtual Machine</entry>
Oct 23 21:36:08 user nova-compute[74337]:     </system>
Oct 23 21:36:08 user nova-compute[74337]:   </sysinfo>
Oct 23 21:36:08 user nova-compute[74337]:   <os>
Oct 23 21:36:08 user nova-compute[74337]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 21:36:08 user nova-compute[74337]:     <boot dev="hd"/>
Oct 23 21:36:08 user nova-compute[74337]:     <smbios mode="sysinfo"/>
Oct 23 21:36:08 user nova-compute[74337]:   </os>
Oct 23 21:36:08 user nova-compute[74337]:   <features>
Oct 23 21:36:08 user nova-compute[74337]:     <acpi/>
Oct 23 21:36:08 user nova-compute[74337]:     <apic/>
Oct 23 21:36:08 user nova-compute[74337]:     <vmcoreinfo/>
Oct 23 21:36:08 user nova-compute[74337]:   </features>
Oct 23 21:36:08 user nova-compute[74337]:   <clock offset="utc">
Oct 23 21:36:08 user nova-compute[74337]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 21:36:08 user nova-compute[74337]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 21:36:08 user nova-compute[74337]:     <timer name="hpet" present="no"/>
Oct 23 21:36:08 user nova-compute[74337]:   </clock>
Oct 23 21:36:08 user nova-compute[74337]:   <cpu mode="custom" match="exact">
Oct 23 21:36:08 user nova-compute[74337]:     <model>Nehalem</model>
Oct 23 21:36:08 user nova-compute[74337]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 21:36:08 user nova-compute[74337]:   </cpu>
Oct 23 21:36:08 user nova-compute[74337]:   <devices>
Oct 23 21:36:08 user nova-compute[74337]:     <disk type="file" device="cdrom">
Oct 23 21:36:08 user nova-compute[74337]:       <driver name="qemu" type="raw" cache="none"/>
Oct 23 21:36:08 user nova-compute[74337]:       <source file="/opt/stack/data/nova/instances/04c02325-7ce4-45c2-819b-c656e93c96ca/disk.config"/>
Oct 23 21:36:08 user nova-compute[74337]:       <target dev="hda" bus="ide"/>
Oct 23 21:36:08 user nova-compute[74337]:     </disk>
Oct 23 21:36:08 user nova-compute[74337]:     <disk type="block" device="disk">
Oct 23 21:36:08 user nova-compute[74337]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 21:36:08 user nova-compute[74337]:       <source dev="/dev/sdg"/>
Oct 23 21:36:08 user nova-compute[74337]:       <target dev="vda" bus="virtio"/>
Oct 23 21:36:08 user nova-compute[74337]:       <serial>64864579-6ad1-4796-a620-c2c1ee8a702a</serial>
Oct 23 21:36:08 user nova-compute[74337]:     </disk>
Oct 23 21:36:08 user nova-compute[74337]:     <disk type="block" device="disk">
Oct 23 21:36:08 user nova-compute[74337]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 21:36:08 user nova-compute[74337]:       <source dev="/dev/sdh"/>
Oct 23 21:36:08 user nova-compute[74337]:       <target dev="vdb" bus="virtio"/>
Oct 23 21:36:08 user nova-compute[74337]:       <serial>0865a5a4-aa44-450e-8451-0d5e8b14f661</serial>
Oct 23 21:36:08 user nova-compute[74337]:     </disk>
Oct 23 21:36:08 user nova-compute[74337]:     <disk type="block" device="disk">
Oct 23 21:36:08 user nova-compute[74337]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 21:36:08 user nova-compute[74337]:       <source dev="/dev/sdj"/>
Oct 23 21:36:08 user nova-compute[74337]:       <target dev="vdc" bus="virtio"/>
Oct 23 21:36:08 user nova-compute[74337]:       <serial>b8aea79a-53dd-4442-8470-dc68c6351496</serial>
Oct 23 21:36:08 user nova-compute[74337]:     </disk>
Oct 23 21:36:08 user nova-compute[74337]:     <interface type="ethernet">
Oct 23 21:36:08 user nova-compute[74337]:       <mac address="fa:16:3e:75:d8:7f"/>
Oct 23 21:36:08 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:36:08 user nova-compute[74337]:       <mtu size="1442"/>
Oct 23 21:36:08 user nova-compute[74337]:       <target dev="tap2ea512c9-8a"/>
Oct 23 21:36:08 user nova-compute[74337]:     </interface>
Oct 23 21:36:08 user nova-compute[74337]:     <interface type="ethernet">
Oct 23 21:36:08 user nova-compute[74337]:       <mac address="fa:16:3e:e2:6e:58"/>
Oct 23 21:36:08 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:36:08 user nova-compute[74337]:       <mtu size="1442"/>
Oct 23 21:36:08 user nova-compute[74337]:       <target dev="tap2727b3bf-35"/>
Oct 23 21:36:08 user nova-compute[74337]:     </interface>
Oct 23 21:36:08 user nova-compute[74337]:     <interface type="ethernet">
Oct 23 21:36:08 user nova-compute[74337]:       <mac address="fa:16:3e:1f:61:c0"/>
Oct 23 21:36:08 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:36:08 user nova-compute[74337]:       <mtu size="1442"/>
Oct 23 21:36:08 user nova-compute[74337]:       <target dev="tap9141d0eb-5e"/>
Oct 23 21:36:08 user nova-compute[74337]:     </interface>
Oct 23 21:36:08 user nova-compute[74337]:     <interface type="ethernet">
Oct 23 21:36:08 user nova-compute[74337]:       <mac address="fa:16:3e:2d:65:73"/>
Oct 23 21:36:08 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:36:08 user nova-compute[74337]:       <mtu size="1442"/>
Oct 23 21:36:08 user nova-compute[74337]:       <target dev="tap4da5a263-b3"/>
Oct 23 21:36:08 user nova-compute[74337]:     </interface>
Oct 23 21:36:08 user nova-compute[74337]:     <interface type="ethernet">
Oct 23 21:36:08 user nova-compute[74337]:       <mac address="fa:16:3e:51:c9:d7"/>
Oct 23 21:36:08 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:36:08 user nova-compute[74337]:       <mtu size="1442"/>
Oct 23 21:36:08 user nova-compute[74337]:       <target dev="tapd35e88b3-1a"/>
Oct 23 21:36:08 user nova-compute[74337]:     </interface>
Oct 23 21:36:08 user nova-compute[74337]:     <interface type="ethernet">
Oct 23 21:36:08 user nova-compute[74337]:       <mac address="fa:16:3e:a3:26:2f"/>
Oct 23 21:36:08 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:36:08 user nova-compute[74337]:       <mtu size="1442"/>
Oct 23 21:36:08 user nova-compute[74337]:       <target dev="tap78d439bc-58"/>
Oct 23 21:36:08 user nova-compute[74337]:     </interface>
Oct 23 21:36:08 user nova-compute[74337]:     <interface type="ethernet">
Oct 23 21:36:08 user nova-compute[74337]:       <mac address="fa:16:3e:96:be:1f"/>
Oct 23 21:36:08 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:36:08 user nova-compute[74337]:       <mtu size="1442"/>
Oct 23 21:36:08 user nova-compute[74337]:       <target dev="tap870087f8-5e"/>
Oct 23 21:36:08 user nova-compute[74337]:     </interface>
Oct 23 21:36:08 user nova-compute[74337]:     <serial type="pty">
Oct 23 21:36:08 user nova-compute[74337]:       <log file="/opt/stack/data/nova/instances/04c02325-7ce4-45c2-819b-c656e93c96ca/console.log" append="off"/>
Oct 23 21:36:08 user nova-compute[74337]:     </serial>
Oct 23 21:36:08 user nova-compute[74337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 21:36:08 user nova-compute[74337]:     <video>
Oct 23 21:36:08 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:36:08 user nova-compute[74337]:     </video>
Oct 23 21:36:08 user nova-compute[74337]:     <rng model="virtio">
Oct 23 21:36:08 user nova-compute[74337]:       <backend model="random">/dev/urandom</backend>
Oct 23 21:36:08 user nova-compute[74337]:     </rng>
Oct 23 21:36:08 user nova-compute[74337]:     <controller type="usb" index="0" model="none"/>
Oct 23 21:36:08 user nova-compute[74337]:     <memballoon model="virtio">
Oct 23 21:36:08 user nova-compute[74337]:       <stats period="10"/>
Oct 23 21:36:08 user nova-compute[74337]:     </memballoon>
Oct 23 21:36:08 user nova-compute[74337]:   </devices>
Oct 23 21:36:08 user nova-compute[74337]: </domain>
Oct 23 21:36:08 user nova-compute[74337]:  {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 21:36:08 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T21:34:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-605341238',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-605341238',id=11,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKmnJ7mFnPC72zwxOhbZBqQQcw8wKcBQrJU/kXbtycxWGrYKWY4ryrk3P1/UrfZxJmArjpq8PnfjCzLxm5CSleEJWdCvoG6Fk25LMsRefGname4N0hV8zcfbkPovW5pJmA==',key_name='tempest-keypair-290861577',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46b2b924f3a4461ba09eb54ee42f4649',ramdisk_id='',reservation_id='r-gnrgh800',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-66532269',owner_user_name='tempest-TaggedBootDevicesTest_v242-66532269-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:34:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fdc4cfd43887413eabd86770e724e2b8',uuid=04c02325-7ce4-45c2-819b-c656e93c96ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ea512c9-8ab6-49a3-9f77-14bcd380f8e8", "address": "fa:16:3e:75:d8:7f", "network": {"id": "e5fd79cb-72f1-4d32-a604-b9518e375fcd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-840255736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46b2b924f3a4461ba09eb54ee42f4649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ea512c9-8a", "ovs_interfaceid": "2ea512c9-8ab6-49a3-9f77-14bcd380f8e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 21:36:08 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Converting VIF {"id": "2ea512c9-8ab6-49a3-9f77-14bcd380f8e8", "address": "fa:16:3e:75:d8:7f", "network": {"id": "e5fd79cb-72f1-4d32-a604-b9518e375fcd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-840255736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46b2b924f3a4461ba09eb54ee42f4649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ea512c9-8a", "ovs_interfaceid": "2ea512c9-8ab6-49a3-9f77-14bcd380f8e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:36:08 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:d8:7f,bridge_name='br-int',has_traffic_filtering=True,id=2ea512c9-8ab6-49a3-9f77-14bcd380f8e8,network=Network(e5fd79cb-72f1-4d32-a604-b9518e375fcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ea512c9-8a') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:36:08 user nova-compute[74337]: DEBUG os_vif [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:d8:7f,bridge_name='br-int',has_traffic_filtering=True,id=2ea512c9-8ab6-49a3-9f77-14bcd380f8e8,network=Network(e5fd79cb-72f1-4d32-a604-b9518e375fcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ea512c9-8a') {{(pid=74337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 21:36:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:36:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 21:36:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '54d72727-a86e-54d1-b959-df12ed525b24', '_type': 'linux-noop'}}, row=False) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:36:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:36:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2ea512c9-8a, may_exist=True, interface_attrs={}) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:36:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2ea512c9-8a, col_values=(('qos', UUID('d9710e9a-390d-48ec-8365-a6b5e79ff6a0')),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:36:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2ea512c9-8a, col_values=(('external_ids', {'iface-id': '2ea512c9-8ab6-49a3-9f77-14bcd380f8e8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:75:d8:7f', 'vm-uuid': '04c02325-7ce4-45c2-819b-c656e93c96ca'}),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:36:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:36:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:08 user nova-compute[74337]: INFO os_vif [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:d8:7f,bridge_name='br-int',has_traffic_filtering=True,id=2ea512c9-8ab6-49a3-9f77-14bcd380f8e8,network=Network(e5fd79cb-72f1-4d32-a604-b9518e375fcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ea512c9-8a')
Oct 23 21:36:08 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T21:34:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-605341238',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-605341238',id=11,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKmnJ7mFnPC72zwxOhbZBqQQcw8wKcBQrJU/kXbtycxWGrYKWY4ryrk3P1/UrfZxJmArjpq8PnfjCzLxm5CSleEJWdCvoG6Fk25LMsRefGname4N0hV8zcfbkPovW5pJmA==',key_name='tempest-keypair-290861577',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46b2b924f3a4461ba09eb54ee42f4649',ramdisk_id='',reservation_id='r-gnrgh800',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-66532269',owner_user_name='tempest-TaggedBootDevicesTest_v242-66532269-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:34:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fdc4cfd43887413eabd86770e724e2b8',uuid=04c02325-7ce4-45c2-819b-c656e93c96ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2727b3bf-35e4-485a-b44b-66406b7d1597", "address": "fa:16:3e:e2:6e:58", "network": {"id": "8a3d7452-cadc-4728-a772-801d6a5c4770", "bridge": "br-int", "label": "tempest-device-tagging-net1-560176148", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46b2b924f3a4461ba09eb54ee42f4649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2727b3bf-35", "ovs_interfaceid": "2727b3bf-35e4-485a-b44b-66406b7d1597", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 21:36:08 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Converting VIF {"id": "2727b3bf-35e4-485a-b44b-66406b7d1597", "address": "fa:16:3e:e2:6e:58", "network": {"id": "8a3d7452-cadc-4728-a772-801d6a5c4770", "bridge": "br-int", "label": "tempest-device-tagging-net1-560176148", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46b2b924f3a4461ba09eb54ee42f4649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2727b3bf-35", "ovs_interfaceid": "2727b3bf-35e4-485a-b44b-66406b7d1597", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:36:08 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:6e:58,bridge_name='br-int',has_traffic_filtering=True,id=2727b3bf-35e4-485a-b44b-66406b7d1597,network=Network(8a3d7452-cadc-4728-a772-801d6a5c4770),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2727b3bf-35') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:36:08 user nova-compute[74337]: DEBUG os_vif [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:6e:58,bridge_name='br-int',has_traffic_filtering=True,id=2727b3bf-35e4-485a-b44b-66406b7d1597,network=Network(8a3d7452-cadc-4728-a772-801d6a5c4770),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2727b3bf-35') {{(pid=74337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 21:36:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:36:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 21:36:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '228e454b-b1e4-58c7-869f-a7eff5ed0d1a', '_type': 'linux-noop'}}, row=False) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:36:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:36:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2727b3bf-35, may_exist=True, interface_attrs={}) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:36:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2727b3bf-35, col_values=(('qos', UUID('ff385cdb-69c0-4af8-93b9-e9f39aa5037e')),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:36:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2727b3bf-35, col_values=(('external_ids', {'iface-id': '2727b3bf-35e4-485a-b44b-66406b7d1597', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e2:6e:58', 'vm-uuid': '04c02325-7ce4-45c2-819b-c656e93c96ca'}),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:36:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:36:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:08 user nova-compute[74337]: INFO os_vif [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:6e:58,bridge_name='br-int',has_traffic_filtering=True,id=2727b3bf-35e4-485a-b44b-66406b7d1597,network=Network(8a3d7452-cadc-4728-a772-801d6a5c4770),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2727b3bf-35')
Oct 23 21:36:08 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T21:34:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-605341238',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-605341238',id=11,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKmnJ7mFnPC72zwxOhbZBqQQcw8wKcBQrJU/kXbtycxWGrYKWY4ryrk3P1/UrfZxJmArjpq8PnfjCzLxm5CSleEJWdCvoG6Fk25LMsRefGname4N0hV8zcfbkPovW5pJmA==',key_name='tempest-keypair-290861577',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46b2b924f3a4461ba09eb54ee42f4649',ramdisk_id='',reservation_id='r-gnrgh800',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-66532269',owner_user_name='tempest-TaggedBootDevicesTest_v242-66532269-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:34:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fdc4cfd43887413eabd86770e724e2b8',uuid=04c02325-7ce4-45c2-819b-c656e93c96ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9141d0eb-5e49-4a83-993f-3eac6a526dfd", "address": "fa:16:3e:1f:61:c0", "network": {"id": "8a3d7452-cadc-4728-a772-801d6a5c4770", "bridge": "br-int", "label": "tempest-device-tagging-net1-560176148", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46b2b924f3a4461ba09eb54ee42f4649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9141d0eb-5e", "ovs_interfaceid": "9141d0eb-5e49-4a83-993f-3eac6a526dfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 21:36:08 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Converting VIF {"id": "9141d0eb-5e49-4a83-993f-3eac6a526dfd", "address": "fa:16:3e:1f:61:c0", "network": {"id": "8a3d7452-cadc-4728-a772-801d6a5c4770", "bridge": "br-int", "label": "tempest-device-tagging-net1-560176148", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46b2b924f3a4461ba09eb54ee42f4649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9141d0eb-5e", "ovs_interfaceid": "9141d0eb-5e49-4a83-993f-3eac6a526dfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:36:08 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:61:c0,bridge_name='br-int',has_traffic_filtering=True,id=9141d0eb-5e49-4a83-993f-3eac6a526dfd,network=Network(8a3d7452-cadc-4728-a772-801d6a5c4770),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9141d0eb-5e') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:36:08 user nova-compute[74337]: DEBUG os_vif [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:61:c0,bridge_name='br-int',has_traffic_filtering=True,id=9141d0eb-5e49-4a83-993f-3eac6a526dfd,network=Network(8a3d7452-cadc-4728-a772-801d6a5c4770),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9141d0eb-5e') {{(pid=74337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 21:36:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:36:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 21:36:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bf5cfa6f-97fb-548c-94b4-e90f6f405027', '_type': 'linux-noop'}}, row=False) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:36:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:36:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9141d0eb-5e, may_exist=True, interface_attrs={}) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:36:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9141d0eb-5e, col_values=(('qos', UUID('11a7b627-4b79-4871-bafd-d3062e92f3f8')),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:36:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9141d0eb-5e, col_values=(('external_ids', {'iface-id': '9141d0eb-5e49-4a83-993f-3eac6a526dfd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:61:c0', 'vm-uuid': '04c02325-7ce4-45c2-819b-c656e93c96ca'}),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:36:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:36:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:09 user nova-compute[74337]: INFO os_vif [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:61:c0,bridge_name='br-int',has_traffic_filtering=True,id=9141d0eb-5e49-4a83-993f-3eac6a526dfd,network=Network(8a3d7452-cadc-4728-a772-801d6a5c4770),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9141d0eb-5e')
Oct 23 21:36:09 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T21:34:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-605341238',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-605341238',id=11,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKmnJ7mFnPC72zwxOhbZBqQQcw8wKcBQrJU/kXbtycxWGrYKWY4ryrk3P1/UrfZxJmArjpq8PnfjCzLxm5CSleEJWdCvoG6Fk25LMsRefGname4N0hV8zcfbkPovW5pJmA==',key_name='tempest-keypair-290861577',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46b2b924f3a4461ba09eb54ee42f4649',ramdisk_id='',reservation_id='r-gnrgh800',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-66532269',owner_user_name='tempest-TaggedBootDevicesTest_v242-66532269-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:34:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fdc4cfd43887413eabd86770e724e2b8',uuid=04c02325-7ce4-45c2-819b-c656e93c96ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4da5a263-b3c7-49ba-b2e1-d54cbb5f0f0e", "address": "fa:16:3e:2d:65:73", "network": {"id": "8a3d7452-cadc-4728-a772-801d6a5c4770", "bridge": "br-int", "label": "tempest-device-tagging-net1-560176148", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46b2b924f3a4461ba09eb54ee42f4649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4da5a263-b3", "ovs_interfaceid": "4da5a263-b3c7-49ba-b2e1-d54cbb5f0f0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 21:36:09 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Converting VIF {"id": "4da5a263-b3c7-49ba-b2e1-d54cbb5f0f0e", "address": "fa:16:3e:2d:65:73", "network": {"id": "8a3d7452-cadc-4728-a772-801d6a5c4770", "bridge": "br-int", "label": "tempest-device-tagging-net1-560176148", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46b2b924f3a4461ba09eb54ee42f4649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4da5a263-b3", "ovs_interfaceid": "4da5a263-b3c7-49ba-b2e1-d54cbb5f0f0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:36:09 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:65:73,bridge_name='br-int',has_traffic_filtering=True,id=4da5a263-b3c7-49ba-b2e1-d54cbb5f0f0e,network=Network(8a3d7452-cadc-4728-a772-801d6a5c4770),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4da5a263-b3') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:36:09 user nova-compute[74337]: DEBUG os_vif [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:65:73,bridge_name='br-int',has_traffic_filtering=True,id=4da5a263-b3c7-49ba-b2e1-d54cbb5f0f0e,network=Network(8a3d7452-cadc-4728-a772-801d6a5c4770),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4da5a263-b3') {{(pid=74337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 21:36:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:36:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 21:36:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '438fc826-72fa-5144-83f5-80f072f71397', '_type': 'linux-noop'}}, row=False) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:36:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:36:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4da5a263-b3, may_exist=True, interface_attrs={}) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:36:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4da5a263-b3, col_values=(('qos', UUID('2c16d81e-7958-41c2-8ccb-8516bfcf6c71')),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:36:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4da5a263-b3, col_values=(('external_ids', {'iface-id': '4da5a263-b3c7-49ba-b2e1-d54cbb5f0f0e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2d:65:73', 'vm-uuid': '04c02325-7ce4-45c2-819b-c656e93c96ca'}),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:36:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:36:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:09 user nova-compute[74337]: INFO os_vif [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:65:73,bridge_name='br-int',has_traffic_filtering=True,id=4da5a263-b3c7-49ba-b2e1-d54cbb5f0f0e,network=Network(8a3d7452-cadc-4728-a772-801d6a5c4770),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4da5a263-b3')
Oct 23 21:36:09 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T21:34:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-605341238',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-605341238',id=11,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKmnJ7mFnPC72zwxOhbZBqQQcw8wKcBQrJU/kXbtycxWGrYKWY4ryrk3P1/UrfZxJmArjpq8PnfjCzLxm5CSleEJWdCvoG6Fk25LMsRefGname4N0hV8zcfbkPovW5pJmA==',key_name='tempest-keypair-290861577',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46b2b924f3a4461ba09eb54ee42f4649',ramdisk_id='',reservation_id='r-gnrgh800',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-66532269',owner_user_name='tempest-TaggedBootDevicesTest_v242-66532269-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:34:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fdc4cfd43887413eabd86770e724e2b8',uuid=04c02325-7ce4-45c2-819b-c656e93c96ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d35e88b3-1ad6-42dc-9b9f-281cb0e99dc8", "address": "fa:16:3e:51:c9:d7", "network": {"id": "8a3d7452-cadc-4728-a772-801d6a5c4770", "bridge": "br-int", "label": "tempest-device-tagging-net1-560176148", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46b2b924f3a4461ba09eb54ee42f4649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd35e88b3-1a", "ovs_interfaceid": "d35e88b3-1ad6-42dc-9b9f-281cb0e99dc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 21:36:09 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Converting VIF {"id": "d35e88b3-1ad6-42dc-9b9f-281cb0e99dc8", "address": "fa:16:3e:51:c9:d7", "network": {"id": "8a3d7452-cadc-4728-a772-801d6a5c4770", "bridge": "br-int", "label": "tempest-device-tagging-net1-560176148", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46b2b924f3a4461ba09eb54ee42f4649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd35e88b3-1a", "ovs_interfaceid": "d35e88b3-1ad6-42dc-9b9f-281cb0e99dc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:36:09 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:c9:d7,bridge_name='br-int',has_traffic_filtering=True,id=d35e88b3-1ad6-42dc-9b9f-281cb0e99dc8,network=Network(8a3d7452-cadc-4728-a772-801d6a5c4770),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd35e88b3-1a') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:36:09 user nova-compute[74337]: DEBUG os_vif [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:c9:d7,bridge_name='br-int',has_traffic_filtering=True,id=d35e88b3-1ad6-42dc-9b9f-281cb0e99dc8,network=Network(8a3d7452-cadc-4728-a772-801d6a5c4770),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd35e88b3-1a') {{(pid=74337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 21:36:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:36:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 21:36:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8e9b6baf-1942-574c-9d81-4d319e9c7a06', '_type': 'linux-noop'}}, row=False) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:36:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:36:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd35e88b3-1a, may_exist=True, interface_attrs={}) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:36:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd35e88b3-1a, col_values=(('qos', UUID('780f7271-391b-42f8-954f-5a45e32465cc')),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:36:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd35e88b3-1a, col_values=(('external_ids', {'iface-id': 'd35e88b3-1ad6-42dc-9b9f-281cb0e99dc8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:51:c9:d7', 'vm-uuid': '04c02325-7ce4-45c2-819b-c656e93c96ca'}),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:36:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:36:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:09 user nova-compute[74337]: INFO os_vif [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:c9:d7,bridge_name='br-int',has_traffic_filtering=True,id=d35e88b3-1ad6-42dc-9b9f-281cb0e99dc8,network=Network(8a3d7452-cadc-4728-a772-801d6a5c4770),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd35e88b3-1a')
Oct 23 21:36:09 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T21:34:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-605341238',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-605341238',id=11,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKmnJ7mFnPC72zwxOhbZBqQQcw8wKcBQrJU/kXbtycxWGrYKWY4ryrk3P1/UrfZxJmArjpq8PnfjCzLxm5CSleEJWdCvoG6Fk25LMsRefGname4N0hV8zcfbkPovW5pJmA==',key_name='tempest-keypair-290861577',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46b2b924f3a4461ba09eb54ee42f4649',ramdisk_id='',reservation_id='r-gnrgh800',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-66532269',owner_user_name='tempest-TaggedBootDevicesTest_v242-66532269-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:34:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fdc4cfd43887413eabd86770e724e2b8',uuid=04c02325-7ce4-45c2-819b-c656e93c96ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "78d439bc-58eb-4984-86f7-e9610cd8c17f", "address": "fa:16:3e:a3:26:2f", "network": {"id": "1f1cb866-1870-48d7-8866-ac73e71c8ef4", "bridge": "br-int", "label": "tempest-device-tagging-net2-663589537", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "46b2b924f3a4461ba09eb54ee42f4649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78d439bc-58", "ovs_interfaceid": "78d439bc-58eb-4984-86f7-e9610cd8c17f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 21:36:09 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Converting VIF {"id": "78d439bc-58eb-4984-86f7-e9610cd8c17f", "address": "fa:16:3e:a3:26:2f", "network": {"id": "1f1cb866-1870-48d7-8866-ac73e71c8ef4", "bridge": "br-int", "label": "tempest-device-tagging-net2-663589537", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "46b2b924f3a4461ba09eb54ee42f4649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78d439bc-58", "ovs_interfaceid": "78d439bc-58eb-4984-86f7-e9610cd8c17f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:36:09 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:26:2f,bridge_name='br-int',has_traffic_filtering=True,id=78d439bc-58eb-4984-86f7-e9610cd8c17f,network=Network(1f1cb866-1870-48d7-8866-ac73e71c8ef4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78d439bc-58') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:36:09 user nova-compute[74337]: DEBUG os_vif [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:26:2f,bridge_name='br-int',has_traffic_filtering=True,id=78d439bc-58eb-4984-86f7-e9610cd8c17f,network=Network(1f1cb866-1870-48d7-8866-ac73e71c8ef4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78d439bc-58') {{(pid=74337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 21:36:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:36:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 21:36:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5c83f83a-e044-5db2-b798-3b2b597e75b7', '_type': 'linux-noop'}}, row=False) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:36:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:36:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap78d439bc-58, may_exist=True, interface_attrs={}) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:36:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap78d439bc-58, col_values=(('qos', UUID('0eae635b-4789-4a14-bcb2-04e7ae0b678b')),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:36:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap78d439bc-58, col_values=(('external_ids', {'iface-id': '78d439bc-58eb-4984-86f7-e9610cd8c17f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a3:26:2f', 'vm-uuid': '04c02325-7ce4-45c2-819b-c656e93c96ca'}),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:36:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:36:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:09 user nova-compute[74337]: INFO os_vif [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:26:2f,bridge_name='br-int',has_traffic_filtering=True,id=78d439bc-58eb-4984-86f7-e9610cd8c17f,network=Network(1f1cb866-1870-48d7-8866-ac73e71c8ef4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78d439bc-58')
Oct 23 21:36:09 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T21:34:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-605341238',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-605341238',id=11,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKmnJ7mFnPC72zwxOhbZBqQQcw8wKcBQrJU/kXbtycxWGrYKWY4ryrk3P1/UrfZxJmArjpq8PnfjCzLxm5CSleEJWdCvoG6Fk25LMsRefGname4N0hV8zcfbkPovW5pJmA==',key_name='tempest-keypair-290861577',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46b2b924f3a4461ba09eb54ee42f4649',ramdisk_id='',reservation_id='r-gnrgh800',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-66532269',owner_user_name='tempest-TaggedBootDevicesTest_v242-66532269-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:34:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fdc4cfd43887413eabd86770e724e2b8',uuid=04c02325-7ce4-45c2-819b-c656e93c96ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "870087f8-5e43-4e98-a6ab-b65529f9fa6b", "address": "fa:16:3e:96:be:1f", "network": {"id": "1f1cb866-1870-48d7-8866-ac73e71c8ef4", "bridge": "br-int", "label": "tempest-device-tagging-net2-663589537", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "46b2b924f3a4461ba09eb54ee42f4649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap870087f8-5e", "ovs_interfaceid": "870087f8-5e43-4e98-a6ab-b65529f9fa6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 21:36:09 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Converting VIF {"id": "870087f8-5e43-4e98-a6ab-b65529f9fa6b", "address": "fa:16:3e:96:be:1f", "network": {"id": "1f1cb866-1870-48d7-8866-ac73e71c8ef4", "bridge": "br-int", "label": "tempest-device-tagging-net2-663589537", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "46b2b924f3a4461ba09eb54ee42f4649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap870087f8-5e", "ovs_interfaceid": "870087f8-5e43-4e98-a6ab-b65529f9fa6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:36:09 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:be:1f,bridge_name='br-int',has_traffic_filtering=True,id=870087f8-5e43-4e98-a6ab-b65529f9fa6b,network=Network(1f1cb866-1870-48d7-8866-ac73e71c8ef4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap870087f8-5e') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:36:09 user nova-compute[74337]: DEBUG os_vif [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:be:1f,bridge_name='br-int',has_traffic_filtering=True,id=870087f8-5e43-4e98-a6ab-b65529f9fa6b,network=Network(1f1cb866-1870-48d7-8866-ac73e71c8ef4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap870087f8-5e') {{(pid=74337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 21:36:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:36:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 21:36:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '21c49673-e8a6-5142-a1ac-93cc4364640d', '_type': 'linux-noop'}}, row=False) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:36:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:36:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap870087f8-5e, may_exist=True, interface_attrs={}) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:36:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap870087f8-5e, col_values=(('qos', UUID('7ec1550b-bbb1-4f5b-bf0b-0fdd9c8c964f')),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:36:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap870087f8-5e, col_values=(('external_ids', {'iface-id': '870087f8-5e43-4e98-a6ab-b65529f9fa6b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:96:be:1f', 'vm-uuid': '04c02325-7ce4-45c2-819b-c656e93c96ca'}),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:36:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:36:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:09 user nova-compute[74337]: INFO os_vif [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:be:1f,bridge_name='br-int',has_traffic_filtering=True,id=870087f8-5e43-4e98-a6ab-b65529f9fa6b,network=Network(1f1cb866-1870-48d7-8866-ac73e71c8ef4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap870087f8-5e')
Oct 23 21:36:09 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] No BDM found with device name hda, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 21:36:09 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 21:36:09 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] No VIF found with MAC fa:16:3e:75:d8:7f, not building metadata {{(pid=74337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 21:36:09 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] No VIF found with MAC fa:16:3e:51:c9:d7, not building metadata {{(pid=74337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 21:36:09 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Using config drive
Oct 23 21:36:09 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-0a00da61-54f6-43fa-b9b2-ae5559acc918 tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] Acquiring lock "5a181593-8086-4ece-9f5b-5ccba0bfe91e" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:36:09 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-0a00da61-54f6-43fa-b9b2-ae5559acc918 tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] Lock "5a181593-8086-4ece-9f5b-5ccba0bfe91e" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:36:09 user nova-compute[74337]: DEBUG os_brick.utils [None req-0a00da61-54f6-43fa-b9b2-ae5559acc918 tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:36:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:09 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[afa76e22-221d-4189-9438-0548ed0a7dca]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f34011b66e40\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:09 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[910bca4d-528e-49bb-aa23-15e458fcf3e7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:09 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef1a7709-9702-4538-a33d-0e2c3f5db084]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:09 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[04eeb704-6d0c-4493-a81a-7f57c4f29626]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-0a00da61-54f6-43fa-b9b2-ae5559acc918 tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] Running cmd (subprocess): nvme version {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-0a00da61-54f6-43fa-b9b2-ae5559acc918 tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 21:36:09 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Creating config drive at /opt/stack/data/nova/instances/04c02325-7ce4-45c2-819b-c656e93c96ca/disk.config
Oct 23 21:36:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/04c02325-7ce4-45c2-819b-c656e93c96ca/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpbs04odl6 {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:09 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0a00da61-54f6-43fa-b9b2-ae5559acc918 tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] nvme not present on system {{(pid=74337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 21:36:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 21:36:09 user nova-compute[74337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 21:36:09 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c762b8-be8d-4cb8-af7d-dbfda72cb6f2]: (4, '') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:09 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-0a00da61-54f6-43fa-b9b2-ae5559acc918 tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 21:36:09 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-0a00da61-54f6-43fa-b9b2-ae5559acc918 tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 21:36:09 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-0a00da61-54f6-43fa-b9b2-ae5559acc918 tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] LIGHTOS: no hostnqn found. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 21:36:09 user nova-compute[74337]: DEBUG os_brick.utils [None req-0a00da61-54f6-43fa-b9b2-ae5559acc918 tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] <== get_connector_properties: return (195ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f34011b66e40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:36:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/04c02325-7ce4-45c2-819b-c656e93c96ca/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpbs04odl6" returned: 0 in 0.072s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:10 user nova-compute[74337]: INFO nova.compute.manager [None req-0a00da61-54f6-43fa-b9b2-ae5559acc918 tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] [instance: 5a181593-8086-4ece-9f5b-5ccba0bfe91e] Swapping volume 06d4748a-a032-4937-a18b-c323e56f507f for 0d948adf-16c8-4098-aec1-e616613d545c
Oct 23 21:36:11 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:11 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:11 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:11 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:11 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:11 user nova-compute[74337]: DEBUG nova.compute.manager [req-9e67894a-d4f4-44e5-8626-97f15761e722 req-6d6a0247-c985-4be0-88d6-e2451929c2c8 service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Received event network-vif-plugged-2ea512c9-8ab6-49a3-9f77-14bcd380f8e8 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:36:11 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-9e67894a-d4f4-44e5-8626-97f15761e722 req-6d6a0247-c985-4be0-88d6-e2451929c2c8 service nova] Acquiring lock "04c02325-7ce4-45c2-819b-c656e93c96ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:36:11 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-9e67894a-d4f4-44e5-8626-97f15761e722 req-6d6a0247-c985-4be0-88d6-e2451929c2c8 service nova] Lock "04c02325-7ce4-45c2-819b-c656e93c96ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:36:11 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-9e67894a-d4f4-44e5-8626-97f15761e722 req-6d6a0247-c985-4be0-88d6-e2451929c2c8 service nova] Lock "04c02325-7ce4-45c2-819b-c656e93c96ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:36:11 user nova-compute[74337]: DEBUG nova.compute.manager [req-9e67894a-d4f4-44e5-8626-97f15761e722 req-6d6a0247-c985-4be0-88d6-e2451929c2c8 service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] No waiting events found dispatching network-vif-plugged-2ea512c9-8ab6-49a3-9f77-14bcd380f8e8 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:36:11 user nova-compute[74337]: WARNING nova.compute.manager [req-9e67894a-d4f4-44e5-8626-97f15761e722 req-6d6a0247-c985-4be0-88d6-e2451929c2c8 service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Received unexpected event network-vif-plugged-2ea512c9-8ab6-49a3-9f77-14bcd380f8e8 for instance with vm_state building and task_state spawning.
Oct 23 21:36:11 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:12 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:12 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:12 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:12 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:12 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:12 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:12 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:12 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:12 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:12 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:12 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:12 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:12 user nova-compute[74337]: DEBUG nova.compute.manager [req-bce58c43-9b09-4959-a608-1aaafc677777 req-afa74284-24d9-488e-bba8-c66839526703 service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Received event network-vif-plugged-4da5a263-b3c7-49ba-b2e1-d54cbb5f0f0e {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:36:12 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-bce58c43-9b09-4959-a608-1aaafc677777 req-afa74284-24d9-488e-bba8-c66839526703 service nova] Acquiring lock "04c02325-7ce4-45c2-819b-c656e93c96ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:36:12 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-bce58c43-9b09-4959-a608-1aaafc677777 req-afa74284-24d9-488e-bba8-c66839526703 service nova] Lock "04c02325-7ce4-45c2-819b-c656e93c96ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:36:12 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-bce58c43-9b09-4959-a608-1aaafc677777 req-afa74284-24d9-488e-bba8-c66839526703 service nova] Lock "04c02325-7ce4-45c2-819b-c656e93c96ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:36:12 user nova-compute[74337]: DEBUG nova.compute.manager [req-bce58c43-9b09-4959-a608-1aaafc677777 req-afa74284-24d9-488e-bba8-c66839526703 service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] No waiting events found dispatching network-vif-plugged-4da5a263-b3c7-49ba-b2e1-d54cbb5f0f0e {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:36:12 user nova-compute[74337]: WARNING nova.compute.manager [req-bce58c43-9b09-4959-a608-1aaafc677777 req-afa74284-24d9-488e-bba8-c66839526703 service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Received unexpected event network-vif-plugged-4da5a263-b3c7-49ba-b2e1-d54cbb5f0f0e for instance with vm_state building and task_state spawning.
Oct 23 21:36:12 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:12 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:12 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:13 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:13 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:13 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:13 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:13 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:13 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:13 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:13 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:13 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:13 user nova-compute[74337]: DEBUG nova.compute.manager [req-40116eee-073a-44c8-b5fa-9781e05e9a23 req-680bbf50-e7d9-4cb7-b85b-a469f6323f36 service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Received event network-vif-plugged-d35e88b3-1ad6-42dc-9b9f-281cb0e99dc8 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:36:13 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-40116eee-073a-44c8-b5fa-9781e05e9a23 req-680bbf50-e7d9-4cb7-b85b-a469f6323f36 service nova] Acquiring lock "04c02325-7ce4-45c2-819b-c656e93c96ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:36:13 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-40116eee-073a-44c8-b5fa-9781e05e9a23 req-680bbf50-e7d9-4cb7-b85b-a469f6323f36 service nova] Lock "04c02325-7ce4-45c2-819b-c656e93c96ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:36:13 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-40116eee-073a-44c8-b5fa-9781e05e9a23 req-680bbf50-e7d9-4cb7-b85b-a469f6323f36 service nova] Lock "04c02325-7ce4-45c2-819b-c656e93c96ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:36:13 user nova-compute[74337]: DEBUG nova.compute.manager [req-40116eee-073a-44c8-b5fa-9781e05e9a23 req-680bbf50-e7d9-4cb7-b85b-a469f6323f36 service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] No waiting events found dispatching network-vif-plugged-d35e88b3-1ad6-42dc-9b9f-281cb0e99dc8 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:36:13 user nova-compute[74337]: WARNING nova.compute.manager [req-40116eee-073a-44c8-b5fa-9781e05e9a23 req-680bbf50-e7d9-4cb7-b85b-a469f6323f36 service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Received unexpected event network-vif-plugged-d35e88b3-1ad6-42dc-9b9f-281cb0e99dc8 for instance with vm_state building and task_state spawning.
Oct 23 21:36:13 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:13 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:13 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:13 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:13 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:13 user nova-compute[74337]: DEBUG nova.compute.manager [req-ce8ce55e-1592-484f-8b37-d66b7af7da5c req-546a2d7c-e470-4af6-8409-3de0d0aeeccb service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Received event network-vif-plugged-2ea512c9-8ab6-49a3-9f77-14bcd380f8e8 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:36:13 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ce8ce55e-1592-484f-8b37-d66b7af7da5c req-546a2d7c-e470-4af6-8409-3de0d0aeeccb service nova] Acquiring lock "04c02325-7ce4-45c2-819b-c656e93c96ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:36:13 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ce8ce55e-1592-484f-8b37-d66b7af7da5c req-546a2d7c-e470-4af6-8409-3de0d0aeeccb service nova] Lock "04c02325-7ce4-45c2-819b-c656e93c96ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:36:13 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ce8ce55e-1592-484f-8b37-d66b7af7da5c req-546a2d7c-e470-4af6-8409-3de0d0aeeccb service nova] Lock "04c02325-7ce4-45c2-819b-c656e93c96ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:36:13 user nova-compute[74337]: DEBUG nova.compute.manager [req-ce8ce55e-1592-484f-8b37-d66b7af7da5c req-546a2d7c-e470-4af6-8409-3de0d0aeeccb service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] No waiting events found dispatching network-vif-plugged-2ea512c9-8ab6-49a3-9f77-14bcd380f8e8 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:36:13 user nova-compute[74337]: WARNING nova.compute.manager [req-ce8ce55e-1592-484f-8b37-d66b7af7da5c req-546a2d7c-e470-4af6-8409-3de0d0aeeccb service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Received unexpected event network-vif-plugged-2ea512c9-8ab6-49a3-9f77-14bcd380f8e8 for instance with vm_state building and task_state spawning.
Oct 23 21:36:13 user nova-compute[74337]: DEBUG nova.compute.manager [req-ce8ce55e-1592-484f-8b37-d66b7af7da5c req-546a2d7c-e470-4af6-8409-3de0d0aeeccb service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Received event network-vif-plugged-2727b3bf-35e4-485a-b44b-66406b7d1597 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:36:13 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ce8ce55e-1592-484f-8b37-d66b7af7da5c req-546a2d7c-e470-4af6-8409-3de0d0aeeccb service nova] Acquiring lock "04c02325-7ce4-45c2-819b-c656e93c96ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:36:13 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ce8ce55e-1592-484f-8b37-d66b7af7da5c req-546a2d7c-e470-4af6-8409-3de0d0aeeccb service nova] Lock "04c02325-7ce4-45c2-819b-c656e93c96ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:36:13 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ce8ce55e-1592-484f-8b37-d66b7af7da5c req-546a2d7c-e470-4af6-8409-3de0d0aeeccb service nova] Lock "04c02325-7ce4-45c2-819b-c656e93c96ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:36:13 user nova-compute[74337]: DEBUG nova.compute.manager [req-ce8ce55e-1592-484f-8b37-d66b7af7da5c req-546a2d7c-e470-4af6-8409-3de0d0aeeccb service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] No waiting events found dispatching network-vif-plugged-2727b3bf-35e4-485a-b44b-66406b7d1597 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:36:13 user nova-compute[74337]: WARNING nova.compute.manager [req-ce8ce55e-1592-484f-8b37-d66b7af7da5c req-546a2d7c-e470-4af6-8409-3de0d0aeeccb service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Received unexpected event network-vif-plugged-2727b3bf-35e4-485a-b44b-66406b7d1597 for instance with vm_state building and task_state spawning.
Oct 23 21:36:13 user nova-compute[74337]: DEBUG nova.compute.manager [req-ce8ce55e-1592-484f-8b37-d66b7af7da5c req-546a2d7c-e470-4af6-8409-3de0d0aeeccb service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Received event network-vif-plugged-2727b3bf-35e4-485a-b44b-66406b7d1597 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:36:13 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ce8ce55e-1592-484f-8b37-d66b7af7da5c req-546a2d7c-e470-4af6-8409-3de0d0aeeccb service nova] Acquiring lock "04c02325-7ce4-45c2-819b-c656e93c96ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:36:13 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ce8ce55e-1592-484f-8b37-d66b7af7da5c req-546a2d7c-e470-4af6-8409-3de0d0aeeccb service nova] Lock "04c02325-7ce4-45c2-819b-c656e93c96ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:36:13 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ce8ce55e-1592-484f-8b37-d66b7af7da5c req-546a2d7c-e470-4af6-8409-3de0d0aeeccb service nova] Lock "04c02325-7ce4-45c2-819b-c656e93c96ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:36:13 user nova-compute[74337]: DEBUG nova.compute.manager [req-ce8ce55e-1592-484f-8b37-d66b7af7da5c req-546a2d7c-e470-4af6-8409-3de0d0aeeccb service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] No waiting events found dispatching network-vif-plugged-2727b3bf-35e4-485a-b44b-66406b7d1597 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:36:13 user nova-compute[74337]: WARNING nova.compute.manager [req-ce8ce55e-1592-484f-8b37-d66b7af7da5c req-546a2d7c-e470-4af6-8409-3de0d0aeeccb service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Received unexpected event network-vif-plugged-2727b3bf-35e4-485a-b44b-66406b7d1597 for instance with vm_state building and task_state spawning.
Oct 23 21:36:13 user nova-compute[74337]: DEBUG nova.compute.manager [req-ce8ce55e-1592-484f-8b37-d66b7af7da5c req-546a2d7c-e470-4af6-8409-3de0d0aeeccb service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Received event network-vif-plugged-9141d0eb-5e49-4a83-993f-3eac6a526dfd {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:36:13 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ce8ce55e-1592-484f-8b37-d66b7af7da5c req-546a2d7c-e470-4af6-8409-3de0d0aeeccb service nova] Acquiring lock "04c02325-7ce4-45c2-819b-c656e93c96ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:36:13 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ce8ce55e-1592-484f-8b37-d66b7af7da5c req-546a2d7c-e470-4af6-8409-3de0d0aeeccb service nova] Lock "04c02325-7ce4-45c2-819b-c656e93c96ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:36:13 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ce8ce55e-1592-484f-8b37-d66b7af7da5c req-546a2d7c-e470-4af6-8409-3de0d0aeeccb service nova] Lock "04c02325-7ce4-45c2-819b-c656e93c96ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:36:13 user nova-compute[74337]: DEBUG nova.compute.manager [req-ce8ce55e-1592-484f-8b37-d66b7af7da5c req-546a2d7c-e470-4af6-8409-3de0d0aeeccb service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] No waiting events found dispatching network-vif-plugged-9141d0eb-5e49-4a83-993f-3eac6a526dfd {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:36:13 user nova-compute[74337]: WARNING nova.compute.manager [req-ce8ce55e-1592-484f-8b37-d66b7af7da5c req-546a2d7c-e470-4af6-8409-3de0d0aeeccb service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Received unexpected event network-vif-plugged-9141d0eb-5e49-4a83-993f-3eac6a526dfd for instance with vm_state building and task_state spawning.
Oct 23 21:36:13 user nova-compute[74337]: DEBUG nova.compute.manager [req-ce8ce55e-1592-484f-8b37-d66b7af7da5c req-546a2d7c-e470-4af6-8409-3de0d0aeeccb service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Received event network-vif-plugged-9141d0eb-5e49-4a83-993f-3eac6a526dfd {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:36:13 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ce8ce55e-1592-484f-8b37-d66b7af7da5c req-546a2d7c-e470-4af6-8409-3de0d0aeeccb service nova] Acquiring lock "04c02325-7ce4-45c2-819b-c656e93c96ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:36:13 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ce8ce55e-1592-484f-8b37-d66b7af7da5c req-546a2d7c-e470-4af6-8409-3de0d0aeeccb service nova] Lock "04c02325-7ce4-45c2-819b-c656e93c96ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:36:13 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ce8ce55e-1592-484f-8b37-d66b7af7da5c req-546a2d7c-e470-4af6-8409-3de0d0aeeccb service nova] Lock "04c02325-7ce4-45c2-819b-c656e93c96ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:36:13 user nova-compute[74337]: DEBUG nova.compute.manager [req-ce8ce55e-1592-484f-8b37-d66b7af7da5c req-546a2d7c-e470-4af6-8409-3de0d0aeeccb service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] No waiting events found dispatching network-vif-plugged-9141d0eb-5e49-4a83-993f-3eac6a526dfd {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:36:13 user nova-compute[74337]: WARNING nova.compute.manager [req-ce8ce55e-1592-484f-8b37-d66b7af7da5c req-546a2d7c-e470-4af6-8409-3de0d0aeeccb service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Received unexpected event network-vif-plugged-9141d0eb-5e49-4a83-993f-3eac6a526dfd for instance with vm_state building and task_state spawning.
Oct 23 21:36:13 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:13 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:14 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:14 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:14 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:14 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:14 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:14 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:14 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:14 user nova-compute[74337]: DEBUG nova.compute.manager [req-043fdba2-6c85-4541-8e0a-44ee1d402f92 req-3fb5e6df-fba6-49ed-816f-410527a3f5c5 service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Received event network-vif-plugged-4da5a263-b3c7-49ba-b2e1-d54cbb5f0f0e {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:36:14 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-043fdba2-6c85-4541-8e0a-44ee1d402f92 req-3fb5e6df-fba6-49ed-816f-410527a3f5c5 service nova] Acquiring lock "04c02325-7ce4-45c2-819b-c656e93c96ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:36:14 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-043fdba2-6c85-4541-8e0a-44ee1d402f92 req-3fb5e6df-fba6-49ed-816f-410527a3f5c5 service nova] Lock "04c02325-7ce4-45c2-819b-c656e93c96ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:36:14 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-043fdba2-6c85-4541-8e0a-44ee1d402f92 req-3fb5e6df-fba6-49ed-816f-410527a3f5c5 service nova] Lock "04c02325-7ce4-45c2-819b-c656e93c96ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:36:14 user nova-compute[74337]: DEBUG nova.compute.manager [req-043fdba2-6c85-4541-8e0a-44ee1d402f92 req-3fb5e6df-fba6-49ed-816f-410527a3f5c5 service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] No waiting events found dispatching network-vif-plugged-4da5a263-b3c7-49ba-b2e1-d54cbb5f0f0e {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:36:14 user nova-compute[74337]: WARNING nova.compute.manager [req-043fdba2-6c85-4541-8e0a-44ee1d402f92 req-3fb5e6df-fba6-49ed-816f-410527a3f5c5 service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Received unexpected event network-vif-plugged-4da5a263-b3c7-49ba-b2e1-d54cbb5f0f0e for instance with vm_state building and task_state spawning.
Oct 23 21:36:14 user nova-compute[74337]: DEBUG nova.compute.manager [req-043fdba2-6c85-4541-8e0a-44ee1d402f92 req-3fb5e6df-fba6-49ed-816f-410527a3f5c5 service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Received event network-vif-plugged-78d439bc-58eb-4984-86f7-e9610cd8c17f {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:36:14 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-043fdba2-6c85-4541-8e0a-44ee1d402f92 req-3fb5e6df-fba6-49ed-816f-410527a3f5c5 service nova] Acquiring lock "04c02325-7ce4-45c2-819b-c656e93c96ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:36:14 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-043fdba2-6c85-4541-8e0a-44ee1d402f92 req-3fb5e6df-fba6-49ed-816f-410527a3f5c5 service nova] Lock "04c02325-7ce4-45c2-819b-c656e93c96ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:36:14 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-043fdba2-6c85-4541-8e0a-44ee1d402f92 req-3fb5e6df-fba6-49ed-816f-410527a3f5c5 service nova] Lock "04c02325-7ce4-45c2-819b-c656e93c96ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:36:14 user nova-compute[74337]: DEBUG nova.compute.manager [req-043fdba2-6c85-4541-8e0a-44ee1d402f92 req-3fb5e6df-fba6-49ed-816f-410527a3f5c5 service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] No waiting events found dispatching network-vif-plugged-78d439bc-58eb-4984-86f7-e9610cd8c17f {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:36:14 user nova-compute[74337]: WARNING nova.compute.manager [req-043fdba2-6c85-4541-8e0a-44ee1d402f92 req-3fb5e6df-fba6-49ed-816f-410527a3f5c5 service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Received unexpected event network-vif-plugged-78d439bc-58eb-4984-86f7-e9610cd8c17f for instance with vm_state building and task_state spawning.
Oct 23 21:36:14 user nova-compute[74337]: DEBUG nova.compute.manager [req-043fdba2-6c85-4541-8e0a-44ee1d402f92 req-3fb5e6df-fba6-49ed-816f-410527a3f5c5 service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Received event network-vif-plugged-78d439bc-58eb-4984-86f7-e9610cd8c17f {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:36:14 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-043fdba2-6c85-4541-8e0a-44ee1d402f92 req-3fb5e6df-fba6-49ed-816f-410527a3f5c5 service nova] Acquiring lock "04c02325-7ce4-45c2-819b-c656e93c96ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:36:14 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-043fdba2-6c85-4541-8e0a-44ee1d402f92 req-3fb5e6df-fba6-49ed-816f-410527a3f5c5 service nova] Lock "04c02325-7ce4-45c2-819b-c656e93c96ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:36:14 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-043fdba2-6c85-4541-8e0a-44ee1d402f92 req-3fb5e6df-fba6-49ed-816f-410527a3f5c5 service nova] Lock "04c02325-7ce4-45c2-819b-c656e93c96ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:36:14 user nova-compute[74337]: DEBUG nova.compute.manager [req-043fdba2-6c85-4541-8e0a-44ee1d402f92 req-3fb5e6df-fba6-49ed-816f-410527a3f5c5 service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] No waiting events found dispatching network-vif-plugged-78d439bc-58eb-4984-86f7-e9610cd8c17f {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:36:14 user nova-compute[74337]: WARNING nova.compute.manager [req-043fdba2-6c85-4541-8e0a-44ee1d402f92 req-3fb5e6df-fba6-49ed-816f-410527a3f5c5 service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Received unexpected event network-vif-plugged-78d439bc-58eb-4984-86f7-e9610cd8c17f for instance with vm_state building and task_state spawning.
Oct 23 21:36:15 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:15 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:15 user nova-compute[74337]: DEBUG nova.compute.manager [req-84107de9-0679-47e8-b5e7-3e1a0b4ce26a req-b22eb185-6025-48e7-b098-7b4e4ede865c service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Received event network-vif-plugged-d35e88b3-1ad6-42dc-9b9f-281cb0e99dc8 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:36:15 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-84107de9-0679-47e8-b5e7-3e1a0b4ce26a req-b22eb185-6025-48e7-b098-7b4e4ede865c service nova] Acquiring lock "04c02325-7ce4-45c2-819b-c656e93c96ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:36:15 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-84107de9-0679-47e8-b5e7-3e1a0b4ce26a req-b22eb185-6025-48e7-b098-7b4e4ede865c service nova] Lock "04c02325-7ce4-45c2-819b-c656e93c96ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:36:15 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-84107de9-0679-47e8-b5e7-3e1a0b4ce26a req-b22eb185-6025-48e7-b098-7b4e4ede865c service nova] Lock "04c02325-7ce4-45c2-819b-c656e93c96ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:36:15 user nova-compute[74337]: DEBUG nova.compute.manager [req-84107de9-0679-47e8-b5e7-3e1a0b4ce26a req-b22eb185-6025-48e7-b098-7b4e4ede865c service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] No waiting events found dispatching network-vif-plugged-d35e88b3-1ad6-42dc-9b9f-281cb0e99dc8 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:36:15 user nova-compute[74337]: WARNING nova.compute.manager [req-84107de9-0679-47e8-b5e7-3e1a0b4ce26a req-b22eb185-6025-48e7-b098-7b4e4ede865c service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Received unexpected event network-vif-plugged-d35e88b3-1ad6-42dc-9b9f-281cb0e99dc8 for instance with vm_state building and task_state spawning.
Oct 23 21:36:15 user nova-compute[74337]: DEBUG nova.compute.manager [req-84107de9-0679-47e8-b5e7-3e1a0b4ce26a req-b22eb185-6025-48e7-b098-7b4e4ede865c service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Received event network-vif-plugged-870087f8-5e43-4e98-a6ab-b65529f9fa6b {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:36:15 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-84107de9-0679-47e8-b5e7-3e1a0b4ce26a req-b22eb185-6025-48e7-b098-7b4e4ede865c service nova] Acquiring lock "04c02325-7ce4-45c2-819b-c656e93c96ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:36:15 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-84107de9-0679-47e8-b5e7-3e1a0b4ce26a req-b22eb185-6025-48e7-b098-7b4e4ede865c service nova] Lock "04c02325-7ce4-45c2-819b-c656e93c96ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:36:15 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-84107de9-0679-47e8-b5e7-3e1a0b4ce26a req-b22eb185-6025-48e7-b098-7b4e4ede865c service nova] Lock "04c02325-7ce4-45c2-819b-c656e93c96ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:36:15 user nova-compute[74337]: DEBUG nova.compute.manager [req-84107de9-0679-47e8-b5e7-3e1a0b4ce26a req-b22eb185-6025-48e7-b098-7b4e4ede865c service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] No waiting events found dispatching network-vif-plugged-870087f8-5e43-4e98-a6ab-b65529f9fa6b {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:36:15 user nova-compute[74337]: WARNING nova.compute.manager [req-84107de9-0679-47e8-b5e7-3e1a0b4ce26a req-b22eb185-6025-48e7-b098-7b4e4ede865c service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Received unexpected event network-vif-plugged-870087f8-5e43-4e98-a6ab-b65529f9fa6b for instance with vm_state building and task_state spawning.
Oct 23 21:36:15 user nova-compute[74337]: DEBUG nova.compute.manager [req-84107de9-0679-47e8-b5e7-3e1a0b4ce26a req-b22eb185-6025-48e7-b098-7b4e4ede865c service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Received event network-vif-plugged-870087f8-5e43-4e98-a6ab-b65529f9fa6b {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:36:15 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-84107de9-0679-47e8-b5e7-3e1a0b4ce26a req-b22eb185-6025-48e7-b098-7b4e4ede865c service nova] Acquiring lock "04c02325-7ce4-45c2-819b-c656e93c96ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:36:15 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-84107de9-0679-47e8-b5e7-3e1a0b4ce26a req-b22eb185-6025-48e7-b098-7b4e4ede865c service nova] Lock "04c02325-7ce4-45c2-819b-c656e93c96ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:36:15 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-84107de9-0679-47e8-b5e7-3e1a0b4ce26a req-b22eb185-6025-48e7-b098-7b4e4ede865c service nova] Lock "04c02325-7ce4-45c2-819b-c656e93c96ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:36:15 user nova-compute[74337]: DEBUG nova.compute.manager [req-84107de9-0679-47e8-b5e7-3e1a0b4ce26a req-b22eb185-6025-48e7-b098-7b4e4ede865c service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] No waiting events found dispatching network-vif-plugged-870087f8-5e43-4e98-a6ab-b65529f9fa6b {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:36:15 user nova-compute[74337]: WARNING nova.compute.manager [req-84107de9-0679-47e8-b5e7-3e1a0b4ce26a req-b22eb185-6025-48e7-b098-7b4e4ede865c service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Received unexpected event network-vif-plugged-870087f8-5e43-4e98-a6ab-b65529f9fa6b for instance with vm_state building and task_state spawning.
Oct 23 21:36:15 user nova-compute[74337]: DEBUG nova.compute.manager [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Instance event wait completed in 0 seconds for  {{(pid=74337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 21:36:16 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Guest created on hypervisor {{(pid=74337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 21:36:16 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Instance spawned successfully.
Oct 23 21:36:16 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 21:36:16 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Found default for hw_cdrom_bus of ide {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:36:16 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Found default for hw_disk_bus of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:36:16 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Found default for hw_input_bus of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:36:16 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Found default for hw_pointer_model of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:36:16 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Found default for hw_video_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:36:16 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Found default for hw_vif_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:36:16 user nova-compute[74337]: INFO nova.compute.manager [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Took 13.98 seconds to spawn the instance on the hypervisor.
Oct 23 21:36:16 user nova-compute[74337]: DEBUG nova.compute.manager [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Checking state {{(pid=74337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 21:36:16 user nova-compute[74337]: INFO nova.compute.manager [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Took 79.55 seconds to build instance.
Oct 23 21:36:16 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-e3ff0ead-421b-48cb-a1a9-d180e8f5cac3 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Lock "04c02325-7ce4-45c2-819b-c656e93c96ca" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 79.647s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:36:17 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:19 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:22 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:24 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:27 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-0d7dd564-4f5e-4591-917b-08d3fe1d119c tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d45e8ae8-371b-46ae-849d-d7f7d5bbd770 is timed out.
Oct 23 21:36:27 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-0d7dd564-4f5e-4591-917b-08d3fe1d119c tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Successfully detached device vdb from instance d45e8ae8-371b-46ae-849d-d7f7d5bbd770 from the live domain config.
Oct 23 21:36:27 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d7dd564-4f5e-4591-917b-08d3fe1d119c tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] [instance: d45e8ae8-371b-46ae-849d-d7f7d5bbd770] calling os-brick to detach iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 21:36:27 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d7dd564-4f5e-4591-917b-08d3fe1d119c tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, {'target_iqn': 'iqn.2010-10.org.openstack:2f364c63-50fe-482f-a6e7-c234b5b9bec9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kJhBuLVb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:36:27 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-0d7dd564-4f5e-4591-917b-08d3fe1d119c tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:36:27 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-0d7dd564-4f5e-4591-917b-08d3fe1d119c tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:36:27 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-0d7dd564-4f5e-4591-917b-08d3fe1d119c tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:36:27 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:27 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:27 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a97e1bf6-2847-48f6-b543-b79f82214c2d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a5ca53bf-8b08-42d0-976a-cb925d353ee7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f364c63-50fe-482f-a6e7-c234b5b9bec9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:27 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d7dd564-4f5e-4591-917b-08d3fe1d119c tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 21:36:27 user nova-compute[74337]: No targets found.
Oct 23 21:36:27 user nova-compute[74337]: iSNS:
Oct 23 21:36:27 user nova-compute[74337]: No targets found.
Oct 23 21:36:27 user nova-compute[74337]: STATIC:
Oct 23 21:36:27 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a
Oct 23 21:36:27 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:36:27 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:36:27 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661
Oct 23 21:36:27 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:36:27 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:36:27 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496
Oct 23 21:36:27 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:36:27 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:36:27 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:a5ca53bf-8b08-42d0-976a-cb925d353ee7
Oct 23 21:36:27 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:36:27 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:36:27 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b
Oct 23 21:36:27 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:36:27 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:36:27 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932
Oct 23 21:36:27 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:36:27 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:36:27 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:2f364c63-50fe-482f-a6e7-c234b5b9bec9
Oct 23 21:36:27 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:36:27 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:36:27 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f
Oct 23 21:36:27 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:36:27 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:36:27 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0
Oct 23 21:36:27 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:36:27 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:36:27 user nova-compute[74337]: FIRMWARE:
Oct 23 21:36:27 user nova-compute[74337]: No targets found.
Oct 23 21:36:27 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:36:27 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d7dd564-4f5e-4591-917b-08d3fe1d119c tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 21:36:27 user nova-compute[74337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 21:36:27 user nova-compute[74337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 21:36:27 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d7dd564-4f5e-4591-917b-08d3fe1d119c tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f364c63-50fe-482f-a6e7-c234b5b9bec9', 0)] {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 21:36:27 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:27 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:27 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc5d2c1-cf97-427a-b488-9a65504e9c85]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f364c63-50fe-482f-a6e7-c234b5b9bec9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5ca53bf-8b08-42d0-976a-cb925d353ee7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:27 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:27 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:27 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[383762fe-1ff4-425a-b2eb-0d9fdb24e65a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f364c63-50fe-482f-a6e7-c234b5b9bec9 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5ca53bf-8b08-42d0-976a-cb925d353ee7 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:27 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d7dd564-4f5e-4591-917b-08d3fe1d119c tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f (non-flash)
Oct 23 21:36:27 user nova-compute[74337]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496 (non-flash)
Oct 23 21:36:27 user nova-compute[74337]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)
Oct 23 21:36:27 user nova-compute[74337]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b (non-flash)
Oct 23 21:36:27 user nova-compute[74337]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 (non-flash)
Oct 23 21:36:27 user nova-compute[74337]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f364c63-50fe-482f-a6e7-c234b5b9bec9 (non-flash)
Oct 23 21:36:27 user nova-compute[74337]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5ca53bf-8b08-42d0-976a-cb925d353ee7 (non-flash)
Oct 23 21:36:27 user nova-compute[74337]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a (non-flash)
Oct 23 21:36:27 user nova-compute[74337]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661 (non-flash)
Oct 23 21:36:27 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:36:27 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d7dd564-4f5e-4591-917b-08d3fe1d119c tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f (non-flash)
Oct 23 21:36:27 user nova-compute[74337]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496 (non-flash)
Oct 23 21:36:27 user nova-compute[74337]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)
Oct 23 21:36:27 user nova-compute[74337]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b (non-flash)
Oct 23 21:36:27 user nova-compute[74337]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 (non-flash)
Oct 23 21:36:27 user nova-compute[74337]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f364c63-50fe-482f-a6e7-c234b5b9bec9 (non-flash)
Oct 23 21:36:27 user nova-compute[74337]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5ca53bf-8b08-42d0-976a-cb925d353ee7 (non-flash)
Oct 23 21:36:27 user nova-compute[74337]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a (non-flash)
Oct 23 21:36:27 user nova-compute[74337]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661 (non-flash)
Oct 23 21:36:27 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:36:27 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d7dd564-4f5e-4591-917b-08d3fe1d119c tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5ef443b1c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f364c63-50fe-482f-a6e7-c234b5b9bec9'): ({'sde'}, set())}) {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 21:36:27 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-0d7dd564-4f5e-4591-917b-08d3fe1d119c tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Removing single pathed devices sde {{(pid=74337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 21:36:27 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:27 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:27 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[611fcdb8-75fa-4495-afe5-1ced053e0e48]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:27 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:27 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:27 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d18b689f-5c17-4501-a1ae-930e33168a51]: (4, ('ok\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:27 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-0d7dd564-4f5e-4591-917b-08d3fe1d119c tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Flushing IO for device /dev/sde {{(pid=74337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 21:36:27 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:27 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:27 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f8ed917-9dfa-496d-b5bb-8e1e2e06d788]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:27 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-0d7dd564-4f5e-4591-917b-08d3fe1d119c tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 21:36:27 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:27 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.044s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:27 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc4dcdb9-b170-44f8-b8e3-b757b4a34197]: (4, ('1', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:27 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-0d7dd564-4f5e-4591-917b-08d3fe1d119c tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 21:36:27 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-0d7dd564-4f5e-4591-917b-08d3fe1d119c tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] SCSI volumes sde have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 21:36:27 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d7dd564-4f5e-4591-917b-08d3fe1d119c tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f364c63-50fe-482f-a6e7-c234b5b9bec9')] {{(pid=74337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 21:36:27 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f364c63-50fe-482f-a6e7-c234b5b9bec9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:27 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f364c63-50fe-482f-a6e7-c234b5b9bec9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:27 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bb21cca-cffb-4626-b199-e67306ea2828]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:27 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d7dd564-4f5e-4591-917b-08d3fe1d119c tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:36:27 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f364c63-50fe-482f-a6e7-c234b5b9bec9 -p 172.16.0.220:3260 --logout {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:27 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f364c63-50fe-482f-a6e7-c234b5b9bec9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:27 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb38f53-0899-4939-8cdc-890a8fa8a821]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:2f364c63-50fe-482f-a6e7-c234b5b9bec9, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:2f364c63-50fe-482f-a6e7-c234b5b9bec9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:27 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d7dd564-4f5e-4591-917b-08d3fe1d119c tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:2f364c63-50fe-482f-a6e7-c234b5b9bec9, portal: 172.16.0.220,3260]
Oct 23 21:36:27 user nova-compute[74337]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:2f364c63-50fe-482f-a6e7-c234b5b9bec9, portal: 172.16.0.220,3260] successful.
Oct 23 21:36:27 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:36:27 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f364c63-50fe-482f-a6e7-c234b5b9bec9 -p 172.16.0.220:3260 --op delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:27 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f364c63-50fe-482f-a6e7-c234b5b9bec9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:27 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf5e33f-45de-475f-acaa-de516f0876c9]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:27 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d7dd564-4f5e-4591-917b-08d3fe1d119c tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:36:27 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-0d7dd564-4f5e-4591-917b-08d3fe1d119c tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:36:27 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d7dd564-4f5e-4591-917b-08d3fe1d119c tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] <== disconnect_volume: return (343ms) None {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:36:27 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d7dd564-4f5e-4591-917b-08d3fe1d119c tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] [instance: d45e8ae8-371b-46ae-849d-d7f7d5bbd770] Disconnected iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 21:36:27 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:28 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-b8cbe48b-aaa8-4098-b2f9-5cfbb8fc7d1e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8acc1b10-a541-4c06-aeb7-1ecf7a2457be is timed out.
Oct 23 21:36:28 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-b8cbe48b-aaa8-4098-b2f9-5cfbb8fc7d1e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Successfully detached device vdb from instance 8acc1b10-a541-4c06-aeb7-1ecf7a2457be from the live domain config.
Oct 23 21:36:28 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8cbe48b-aaa8-4098-b2f9-5cfbb8fc7d1e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] calling os-brick to detach iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 21:36:28 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8cbe48b-aaa8-4098-b2f9-5cfbb8fc7d1e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, {'target_iqn': 'iqn.2010-10.org.openstack:a5ca53bf-8b08-42d0-976a-cb925d353ee7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YeSqLRPW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:36:28 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-b8cbe48b-aaa8-4098-b2f9-5cfbb8fc7d1e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:36:28 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-b8cbe48b-aaa8-4098-b2f9-5cfbb8fc7d1e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:36:28 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-b8cbe48b-aaa8-4098-b2f9-5cfbb8fc7d1e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:36:28 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:28 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:28 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a3a5f89-3fcd-470c-8fc7-dd992c01b618]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a5ca53bf-8b08-42d0-976a-cb925d353ee7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:28 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8cbe48b-aaa8-4098-b2f9-5cfbb8fc7d1e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 21:36:28 user nova-compute[74337]: No targets found.
Oct 23 21:36:28 user nova-compute[74337]: iSNS:
Oct 23 21:36:28 user nova-compute[74337]: No targets found.
Oct 23 21:36:28 user nova-compute[74337]: STATIC:
Oct 23 21:36:28 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a
Oct 23 21:36:28 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:36:28 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:36:28 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661
Oct 23 21:36:28 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:36:28 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:36:28 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496
Oct 23 21:36:28 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:36:28 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:36:28 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:a5ca53bf-8b08-42d0-976a-cb925d353ee7
Oct 23 21:36:28 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:36:28 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:36:28 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b
Oct 23 21:36:28 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:36:28 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:36:28 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932
Oct 23 21:36:28 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:36:28 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:36:28 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f
Oct 23 21:36:28 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:36:28 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:36:28 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0
Oct 23 21:36:28 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:36:28 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:36:28 user nova-compute[74337]: FIRMWARE:
Oct 23 21:36:28 user nova-compute[74337]: No targets found.
Oct 23 21:36:28 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:36:28 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8cbe48b-aaa8-4098-b2f9-5cfbb8fc7d1e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 21:36:28 user nova-compute[74337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 21:36:28 user nova-compute[74337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 21:36:28 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8cbe48b-aaa8-4098-b2f9-5cfbb8fc7d1e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5ca53bf-8b08-42d0-976a-cb925d353ee7', 0)] {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 21:36:28 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:28 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:28 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8282f96-51ad-43cd-9d7a-64955f6e50ec]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5ca53bf-8b08-42d0-976a-cb925d353ee7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:28 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:28 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:28 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c493d0fe-cc9d-48dc-8e3e-71d51db4f690]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5ca53bf-8b08-42d0-976a-cb925d353ee7 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:28 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8cbe48b-aaa8-4098-b2f9-5cfbb8fc7d1e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f (non-flash)
Oct 23 21:36:28 user nova-compute[74337]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496 (non-flash)
Oct 23 21:36:28 user nova-compute[74337]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)
Oct 23 21:36:28 user nova-compute[74337]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b (non-flash)
Oct 23 21:36:28 user nova-compute[74337]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 (non-flash)
Oct 23 21:36:28 user nova-compute[74337]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5ca53bf-8b08-42d0-976a-cb925d353ee7 (non-flash)
Oct 23 21:36:28 user nova-compute[74337]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a (non-flash)
Oct 23 21:36:28 user nova-compute[74337]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661 (non-flash)
Oct 23 21:36:28 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:36:28 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8cbe48b-aaa8-4098-b2f9-5cfbb8fc7d1e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f (non-flash)
Oct 23 21:36:28 user nova-compute[74337]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496 (non-flash)
Oct 23 21:36:28 user nova-compute[74337]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)
Oct 23 21:36:28 user nova-compute[74337]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b (non-flash)
Oct 23 21:36:28 user nova-compute[74337]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 (non-flash)
Oct 23 21:36:28 user nova-compute[74337]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5ca53bf-8b08-42d0-976a-cb925d353ee7 (non-flash)
Oct 23 21:36:28 user nova-compute[74337]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a (non-flash)
Oct 23 21:36:28 user nova-compute[74337]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661 (non-flash)
Oct 23 21:36:28 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:36:28 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8cbe48b-aaa8-4098-b2f9-5cfbb8fc7d1e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5ef4288af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5ca53bf-8b08-42d0-976a-cb925d353ee7'): ({'sdf'}, set())}) {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 21:36:28 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-b8cbe48b-aaa8-4098-b2f9-5cfbb8fc7d1e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Removing single pathed devices sdf {{(pid=74337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 21:36:28 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:28 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:28 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[400d7e56-f507-40f0-b48e-15b0d0347f33]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:28 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:28 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:28 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba80ee5-7b06-4644-97df-511ac8c59888]: (4, ('ok\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:28 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-b8cbe48b-aaa8-4098-b2f9-5cfbb8fc7d1e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Flushing IO for device /dev/sdf {{(pid=74337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 21:36:28 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:28 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:28 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c736c82-59f4-41e0-8157-c0e1a3c39216]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:28 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-b8cbe48b-aaa8-4098-b2f9-5cfbb8fc7d1e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 21:36:28 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:28 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.031s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:28 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec4da6c-8ee1-4dfc-b290-f068082fc688]: (4, ('1', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:28 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-b8cbe48b-aaa8-4098-b2f9-5cfbb8fc7d1e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 21:36:28 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-b8cbe48b-aaa8-4098-b2f9-5cfbb8fc7d1e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] SCSI volumes sdf have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 21:36:28 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8cbe48b-aaa8-4098-b2f9-5cfbb8fc7d1e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5ca53bf-8b08-42d0-976a-cb925d353ee7')] {{(pid=74337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 21:36:28 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5ca53bf-8b08-42d0-976a-cb925d353ee7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:28 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5ca53bf-8b08-42d0-976a-cb925d353ee7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:28 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[507d143d-3de5-4047-802d-7e55b3b0e1b5]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:28 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8cbe48b-aaa8-4098-b2f9-5cfbb8fc7d1e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:36:28 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5ca53bf-8b08-42d0-976a-cb925d353ee7 -p 172.16.0.220:3260 --logout {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:28 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5ca53bf-8b08-42d0-976a-cb925d353ee7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:28 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[465c229f-25c7-450e-be49-e9f571899516]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:a5ca53bf-8b08-42d0-976a-cb925d353ee7, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:a5ca53bf-8b08-42d0-976a-cb925d353ee7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:28 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8cbe48b-aaa8-4098-b2f9-5cfbb8fc7d1e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:a5ca53bf-8b08-42d0-976a-cb925d353ee7, portal: 172.16.0.220,3260]
Oct 23 21:36:28 user nova-compute[74337]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:a5ca53bf-8b08-42d0-976a-cb925d353ee7, portal: 172.16.0.220,3260] successful.
Oct 23 21:36:28 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:36:28 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5ca53bf-8b08-42d0-976a-cb925d353ee7 -p 172.16.0.220:3260 --op delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:28 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5ca53bf-8b08-42d0-976a-cb925d353ee7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:28 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f3d0935-9f17-4108-a600-10da7560512c]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:28 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8cbe48b-aaa8-4098-b2f9-5cfbb8fc7d1e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:36:28 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-b8cbe48b-aaa8-4098-b2f9-5cfbb8fc7d1e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:36:28 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8cbe48b-aaa8-4098-b2f9-5cfbb8fc7d1e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] <== disconnect_volume: return (338ms) None {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:36:28 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8cbe48b-aaa8-4098-b2f9-5cfbb8fc7d1e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] Disconnected iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 21:36:29 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:31 user nova-compute[74337]: DEBUG nova.compute.manager [None req-0a00da61-54f6-43fa-b9b2-ae5559acc918 tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] [instance: 5a181593-8086-4ece-9f5b-5ccba0bfe91e] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0d948adf-16c8-4098-aec1-e616613d545c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kDwXYnUr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5a181593-8086-4ece-9f5b-5ccba0bfe91e', 'attached_at': '', 'detached_at': '', 'volume_id': '0d948adf-16c8-4098-aec1-e616613d545c', 'serial': '0d948adf-16c8-4098-aec1-e616613d545c'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wfjRXToB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, 'status': 'reserved', 'instance': '5a181593-8086-4ece-9f5b-5ccba0bfe91e', 'attached_at': '', 'detached_at': '', 'volume_id': '06d4748a-a032-4937-a18b-c323e56f507f', 'serial'} {{(pid=74337) _swap_volume /opt/stack/nova/nova/compute/manager.py:7781}}
Oct 23 21:36:31 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a00da61-54f6-43fa-b9b2-ae5559acc918 tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] [instance: 5a181593-8086-4ece-9f5b-5ccba0bfe91e] Calling os-brick to attach iSCSI Volume {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 21:36:31 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a00da61-54f6-43fa-b9b2-ae5559acc918 tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0d948adf-16c8-4098-aec1-e616613d545c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kDwXYnUr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:36:31 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-0a00da61-54f6-43fa-b9b2-ae5559acc918 tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:36:31 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-0a00da61-54f6-43fa-b9b2-ae5559acc918 tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:36:31 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-0a00da61-54f6-43fa-b9b2-ae5559acc918 tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:36:31 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-0a00da61-54f6-43fa-b9b2-ae5559acc918 tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:36:31 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-0a00da61-54f6-43fa-b9b2-ae5559acc918 tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d948adf-16c8-4098-aec1-e616613d545c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:36:31 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-0a00da61-54f6-43fa-b9b2-ae5559acc918 tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d948adf-16c8-4098-aec1-e616613d545c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:36:31 user nova-compute[74337]: INFO os_brick.initiator.connectors.iscsi [None req-0a00da61-54f6-43fa-b9b2-ae5559acc918 tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 21:36:31 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d948adf-16c8-4098-aec1-e616613d545c -p 172.16.0.220:3260 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:31 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d948adf-16c8-4098-aec1-e616613d545c -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:31 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[974f7b84-d27e-4ce2-9e05-f776b5a7360f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:31 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a00da61-54f6-43fa-b9b2-ae5559acc918 tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 21:36:31 user nova-compute[74337]:  {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:36:31 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d948adf-16c8-4098-aec1-e616613d545c -p 172.16.0.220:3260 --interface default --op new {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:31 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d948adf-16c8-4098-aec1-e616613d545c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:31 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[72653430-c1ce-4e92-aadd-0cd00f9fd5d4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0d948adf-16c8-4098-aec1-e616613d545c] added\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:31 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a00da61-54f6-43fa-b9b2-ae5559acc918 tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0d948adf-16c8-4098-aec1-e616613d545c] added
Oct 23 21:36:31 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:36:31 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d948adf-16c8-4098-aec1-e616613d545c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:31 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d948adf-16c8-4098-aec1-e616613d545c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:31 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[039910bb-153f-4b0f-bf5e-f294f23dda26]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:31 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a00da61-54f6-43fa-b9b2-ae5559acc918 tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:36:31 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d948adf-16c8-4098-aec1-e616613d545c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:31 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d948adf-16c8-4098-aec1-e616613d545c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:31 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b30ed7f-a094-44e0-b489-bffae2160044]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:31 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a00da61-54f6-43fa-b9b2-ae5559acc918 tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:36:31 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d948adf-16c8-4098-aec1-e616613d545c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kDwXYnUr {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:31 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d948adf-16c8-4098-aec1-e616613d545c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kDwXYnUr" returned: 0 in 0.022s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:31 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b95cacd1-4e72-4159-b2cb-2a01e62cac6c]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:31 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a00da61-54f6-43fa-b9b2-ae5559acc918 tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kDwXYnUr'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:36:31 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d948adf-16c8-4098-aec1-e616613d545c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:31 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d948adf-16c8-4098-aec1-e616613d545c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:31 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e32d8785-c504-465b-a9fa-5b2836cd0d31]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:31 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a00da61-54f6-43fa-b9b2-ae5559acc918 tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:36:31 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:31 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:31 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b97ab7f-cef8-48c0-815c-70f76858b31c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:31 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a00da61-54f6-43fa-b9b2-ae5559acc918 tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f (non-flash)
Oct 23 21:36:31 user nova-compute[74337]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496 (non-flash)
Oct 23 21:36:31 user nova-compute[74337]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)
Oct 23 21:36:31 user nova-compute[74337]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b (non-flash)
Oct 23 21:36:31 user nova-compute[74337]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 (non-flash)
Oct 23 21:36:31 user nova-compute[74337]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a (non-flash)
Oct 23 21:36:31 user nova-compute[74337]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661 (non-flash)
Oct 23 21:36:31 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:36:31 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a00da61-54f6-43fa-b9b2-ae5559acc918 tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f (non-flash)
Oct 23 21:36:31 user nova-compute[74337]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496 (non-flash)
Oct 23 21:36:31 user nova-compute[74337]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)
Oct 23 21:36:31 user nova-compute[74337]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b (non-flash)
Oct 23 21:36:31 user nova-compute[74337]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 (non-flash)
Oct 23 21:36:31 user nova-compute[74337]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a (non-flash)
Oct 23 21:36:31 user nova-compute[74337]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661 (non-flash)
Oct 23 21:36:31 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:36:31 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d948adf-16c8-4098-aec1-e616613d545c -p 172.16.0.220:3260 --login {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:32 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d948adf-16c8-4098-aec1-e616613d545c -p 172.16.0.220:3260 --login" returned: 0 in 0.100s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:32 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[0942a0c3-f4b5-46fb-b49d-b249db6e9551]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0d948adf-16c8-4098-aec1-e616613d545c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0d948adf-16c8-4098-aec1-e616613d545c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:32 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a00da61-54f6-43fa-b9b2-ae5559acc918 tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0d948adf-16c8-4098-aec1-e616613d545c, portal: 172.16.0.220,3260]
Oct 23 21:36:32 user nova-compute[74337]: Login to [iface: default, target: iqn.2010-10.org.openstack:0d948adf-16c8-4098-aec1-e616613d545c, portal: 172.16.0.220,3260] successful.
Oct 23 21:36:32 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:36:32 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d948adf-16c8-4098-aec1-e616613d545c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:32 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d948adf-16c8-4098-aec1-e616613d545c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:32 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb90375-ead1-4368-a36e-691cdc64172b]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:32 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a00da61-54f6-43fa-b9b2-ae5559acc918 tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:36:32 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:32 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:32 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a288075b-294f-43b8-a2cb-d949d3f9e373]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d948adf-16c8-4098-aec1-e616613d545c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:32 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a00da61-54f6-43fa-b9b2-ae5559acc918 tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f (non-flash)
Oct 23 21:36:32 user nova-compute[74337]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496 (non-flash)
Oct 23 21:36:32 user nova-compute[74337]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d948adf-16c8-4098-aec1-e616613d545c (non-flash)
Oct 23 21:36:32 user nova-compute[74337]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)
Oct 23 21:36:32 user nova-compute[74337]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b (non-flash)
Oct 23 21:36:32 user nova-compute[74337]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 (non-flash)
Oct 23 21:36:32 user nova-compute[74337]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a (non-flash)
Oct 23 21:36:32 user nova-compute[74337]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661 (non-flash)
Oct 23 21:36:32 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:36:32 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a00da61-54f6-43fa-b9b2-ae5559acc918 tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f (non-flash)
Oct 23 21:36:32 user nova-compute[74337]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496 (non-flash)
Oct 23 21:36:32 user nova-compute[74337]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d948adf-16c8-4098-aec1-e616613d545c (non-flash)
Oct 23 21:36:32 user nova-compute[74337]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)
Oct 23 21:36:32 user nova-compute[74337]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b (non-flash)
Oct 23 21:36:32 user nova-compute[74337]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 (non-flash)
Oct 23 21:36:32 user nova-compute[74337]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a (non-flash)
Oct 23 21:36:32 user nova-compute[74337]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661 (non-flash)
Oct 23 21:36:32 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:36:32 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-0a00da61-54f6-43fa-b9b2-ae5559acc918 tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d948adf-16c8-4098-aec1-e616613d545c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.365s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:36:32 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a00da61-54f6-43fa-b9b2-ae5559acc918 tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] Connected to 172.16.0.220:3260 {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 21:36:32 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-0a00da61-54f6-43fa-b9b2-ae5559acc918 tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] HCTL ('36', '-', '-', 0) found on session 12 with lun 0 {{(pid=74337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 21:36:32 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-0a00da61-54f6-43fa-b9b2-ae5559acc918 tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] Scanning host 36 c: -, t: -, l: 0) {{(pid=74337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 21:36:32 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:32 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:32 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b879b1d7-44fa-4af5-a966-4775ae20cfaa]: (4, ('- - 0', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:32 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-0a00da61-54f6-43fa-b9b2-ae5559acc918 tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] Searching for a device in session 12 and hctl ['36', '*', '*', 0] yield: None {{(pid=74337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 21:36:32 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-b2051122-f43c-4d02-b46f-5449007d141a tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] Acquiring lock "2075057e-81db-424a-bb20-662d77faafed" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:36:32 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-b2051122-f43c-4d02-b46f-5449007d141a tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] Lock "2075057e-81db-424a-bb20-662d77faafed" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:36:32 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-b2051122-f43c-4d02-b46f-5449007d141a tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] Acquiring lock "2075057e-81db-424a-bb20-662d77faafed-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:36:32 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-b2051122-f43c-4d02-b46f-5449007d141a tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] Lock "2075057e-81db-424a-bb20-662d77faafed-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:36:32 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-b2051122-f43c-4d02-b46f-5449007d141a tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] Lock "2075057e-81db-424a-bb20-662d77faafed-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:36:32 user nova-compute[74337]: INFO nova.compute.manager [None req-b2051122-f43c-4d02-b46f-5449007d141a tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] [instance: 2075057e-81db-424a-bb20-662d77faafed] Terminating instance
Oct 23 21:36:32 user nova-compute[74337]: DEBUG nova.compute.manager [None req-b2051122-f43c-4d02-b46f-5449007d141a tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] [instance: 2075057e-81db-424a-bb20-662d77faafed] Start destroying the instance on the hypervisor. {{(pid=74337) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 21:36:32 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:32 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:32 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:32 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:32 user nova-compute[74337]: DEBUG nova.compute.manager [req-4a75c201-3ea2-4c8a-a1f1-131a24e3659c req-dec22d54-d567-4641-9f7a-e3af02c1f5b1 service nova] [instance: 2075057e-81db-424a-bb20-662d77faafed] Received event network-vif-unplugged-603e30f8-b216-49f6-ae75-5c60b4e602f8 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:36:32 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-4a75c201-3ea2-4c8a-a1f1-131a24e3659c req-dec22d54-d567-4641-9f7a-e3af02c1f5b1 service nova] Acquiring lock "2075057e-81db-424a-bb20-662d77faafed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:36:32 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-4a75c201-3ea2-4c8a-a1f1-131a24e3659c req-dec22d54-d567-4641-9f7a-e3af02c1f5b1 service nova] Lock "2075057e-81db-424a-bb20-662d77faafed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:36:32 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-4a75c201-3ea2-4c8a-a1f1-131a24e3659c req-dec22d54-d567-4641-9f7a-e3af02c1f5b1 service nova] Lock "2075057e-81db-424a-bb20-662d77faafed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:36:32 user nova-compute[74337]: DEBUG nova.compute.manager [req-4a75c201-3ea2-4c8a-a1f1-131a24e3659c req-dec22d54-d567-4641-9f7a-e3af02c1f5b1 service nova] [instance: 2075057e-81db-424a-bb20-662d77faafed] No waiting events found dispatching network-vif-unplugged-603e30f8-b216-49f6-ae75-5c60b4e602f8 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:36:32 user nova-compute[74337]: DEBUG nova.compute.manager [req-4a75c201-3ea2-4c8a-a1f1-131a24e3659c req-dec22d54-d567-4641-9f7a-e3af02c1f5b1 service nova] [instance: 2075057e-81db-424a-bb20-662d77faafed] Received event network-vif-unplugged-603e30f8-b216-49f6-ae75-5c60b4e602f8 for instance with task_state deleting. {{(pid=74337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 21:36:32 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: 2075057e-81db-424a-bb20-662d77faafed] Instance destroyed successfully.
Oct 23 21:36:32 user nova-compute[74337]: DEBUG nova.objects.instance [None req-b2051122-f43c-4d02-b46f-5449007d141a tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] Lazy-loading 'resources' on Instance uuid 2075057e-81db-424a-bb20-662d77faafed {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:36:32 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-b2051122-f43c-4d02-b46f-5449007d141a tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:33:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2074914789',display_name='tempest-VolumesActionsTest-instance-2074914789',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2074914789',id=9,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-23T21:33:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aad79ba1168a4c3bb9b7f5ebcdce0529',ramdisk_id='',reservation_id='r-r5lf5ril',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-2062236964',owner_user_name='tempest-VolumesActionsTest-2062236964-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T21:33:57Z,user_data=None,user_id='4ac397ba607f4facb455b04bc440f9b5',uuid=2075057e-81db-424a-bb20-662d77faafed,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "603e30f8-b216-49f6-ae75-5c60b4e602f8", "address": "fa:16:3e:be:de:06", "network": {"id": "5f59b94c-5047-4031-9579-fa4c76353e70", "bridge": "br-int", "label": "tempest-VolumesActionsTest-72235572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aad79ba1168a4c3bb9b7f5ebcdce0529", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap603e30f8-b2", "ovs_interfaceid": "603e30f8-b216-49f6-ae75-5c60b4e602f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 21:36:32 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-b2051122-f43c-4d02-b46f-5449007d141a tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] Converting VIF {"id": "603e30f8-b216-49f6-ae75-5c60b4e602f8", "address": "fa:16:3e:be:de:06", "network": {"id": "5f59b94c-5047-4031-9579-fa4c76353e70", "bridge": "br-int", "label": "tempest-VolumesActionsTest-72235572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aad79ba1168a4c3bb9b7f5ebcdce0529", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap603e30f8-b2", "ovs_interfaceid": "603e30f8-b216-49f6-ae75-5c60b4e602f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:36:32 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-b2051122-f43c-4d02-b46f-5449007d141a tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:de:06,bridge_name='br-int',has_traffic_filtering=True,id=603e30f8-b216-49f6-ae75-5c60b4e602f8,network=Network(5f59b94c-5047-4031-9579-fa4c76353e70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap603e30f8-b2') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:36:32 user nova-compute[74337]: DEBUG os_vif [None req-b2051122-f43c-4d02-b46f-5449007d141a tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:de:06,bridge_name='br-int',has_traffic_filtering=True,id=603e30f8-b216-49f6-ae75-5c60b4e602f8,network=Network(5f59b94c-5047-4031-9579-fa4c76353e70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap603e30f8-b2') {{(pid=74337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 21:36:32 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:32 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap603e30f8-b2, bridge=br-int, if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:36:32 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:32 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:32 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:32 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=968b8281-4c5d-4f22-ac7e-03822e437bcc) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:36:32 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:32 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:32 user nova-compute[74337]: INFO os_vif [None req-b2051122-f43c-4d02-b46f-5449007d141a tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:de:06,bridge_name='br-int',has_traffic_filtering=True,id=603e30f8-b216-49f6-ae75-5c60b4e602f8,network=Network(5f59b94c-5047-4031-9579-fa4c76353e70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap603e30f8-b2')
Oct 23 21:36:32 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-b2051122-f43c-4d02-b46f-5449007d141a tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] [instance: 2075057e-81db-424a-bb20-662d77faafed] Deleting instance files /opt/stack/data/nova/instances/2075057e-81db-424a-bb20-662d77faafed_del
Oct 23 21:36:32 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-b2051122-f43c-4d02-b46f-5449007d141a tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] [instance: 2075057e-81db-424a-bb20-662d77faafed] Deletion of /opt/stack/data/nova/instances/2075057e-81db-424a-bb20-662d77faafed_del complete
Oct 23 21:36:33 user nova-compute[74337]: INFO nova.compute.manager [None req-b2051122-f43c-4d02-b46f-5449007d141a tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] [instance: 2075057e-81db-424a-bb20-662d77faafed] Took 0.85 seconds to destroy the instance on the hypervisor.
Oct 23 21:36:33 user nova-compute[74337]: DEBUG oslo.service.loopingcall [None req-b2051122-f43c-4d02-b46f-5449007d141a tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74337) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 21:36:33 user nova-compute[74337]: DEBUG nova.compute.manager [-] [instance: 2075057e-81db-424a-bb20-662d77faafed] Deallocating network for instance {{(pid=74337) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 21:36:33 user nova-compute[74337]: DEBUG nova.network.neutron [-] [instance: 2075057e-81db-424a-bb20-662d77faafed] deallocate_for_instance() {{(pid=74337) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 21:36:33 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-0a00da61-54f6-43fa-b9b2-ae5559acc918 tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] Searching for a device in session 12 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 21:36:33 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a00da61-54f6-43fa-b9b2-ae5559acc918 tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:0d948adf-16c8-4098-aec1-e616613d545c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kDwXYnUr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 21:36:33 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-0a00da61-54f6-43fa-b9b2-ae5559acc918 tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.395s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:36:33 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a00da61-54f6-43fa-b9b2-ae5559acc918 tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] <== connect_volume: return (1396ms) {'type': 'block', 'scsi_wwn': '26634316631316531', 'path': '/dev/sde'} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:36:33 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a00da61-54f6-43fa-b9b2-ae5559acc918 tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] [instance: 5a181593-8086-4ece-9f5b-5ccba0bfe91e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26634316631316531', 'path': '/dev/sde'} {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 21:36:33 user nova-compute[74337]: DEBUG nova.objects.instance [None req-0a00da61-54f6-43fa-b9b2-ae5559acc918 tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] Lazy-loading 'flavor' on Instance uuid 5a181593-8086-4ece-9f5b-5ccba0bfe91e {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:36:33 user nova-compute[74337]: DEBUG nova.network.neutron [-] [instance: 2075057e-81db-424a-bb20-662d77faafed] Updating instance_info_cache with network_info: [] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:36:33 user nova-compute[74337]: INFO nova.compute.manager [-] [instance: 2075057e-81db-424a-bb20-662d77faafed] Took 0.57 seconds to deallocate network for instance.
Oct 23 21:36:33 user nova-compute[74337]: DEBUG nova.compute.manager [req-b7eb650d-bc39-4975-942a-94479af92eef req-44b0a342-7454-489c-b9b5-ea8bcc742358 service nova] [instance: 2075057e-81db-424a-bb20-662d77faafed] Received event network-vif-deleted-603e30f8-b216-49f6-ae75-5c60b4e602f8 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:36:33 user nova-compute[74337]: INFO nova.compute.manager [req-b7eb650d-bc39-4975-942a-94479af92eef req-44b0a342-7454-489c-b9b5-ea8bcc742358 service nova] [instance: 2075057e-81db-424a-bb20-662d77faafed] Neutron deleted interface 603e30f8-b216-49f6-ae75-5c60b4e602f8; detaching it from the instance and deleting it from the info cache
Oct 23 21:36:33 user nova-compute[74337]: DEBUG nova.network.neutron [req-b7eb650d-bc39-4975-942a-94479af92eef req-44b0a342-7454-489c-b9b5-ea8bcc742358 service nova] [instance: 2075057e-81db-424a-bb20-662d77faafed] Updating instance_info_cache with network_info: [] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:36:33 user nova-compute[74337]: DEBUG nova.compute.manager [req-b7eb650d-bc39-4975-942a-94479af92eef req-44b0a342-7454-489c-b9b5-ea8bcc742358 service nova] [instance: 2075057e-81db-424a-bb20-662d77faafed] Detach interface failed, port_id=603e30f8-b216-49f6-ae75-5c60b4e602f8, reason: Instance 2075057e-81db-424a-bb20-662d77faafed could not be found. {{(pid=74337) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 23 21:36:33 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-b2051122-f43c-4d02-b46f-5449007d141a tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:36:33 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-b2051122-f43c-4d02-b46f-5449007d141a tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:36:33 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-0a00da61-54f6-43fa-b9b2-ae5559acc918 tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=74337) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 21:36:34 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-b2051122-f43c-4d02-b46f-5449007d141a tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:36:34 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-b2051122-f43c-4d02-b46f-5449007d141a tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:36:34 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-b2051122-f43c-4d02-b46f-5449007d141a tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.352s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:36:34 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-0a00da61-54f6-43fa-b9b2-ae5559acc918 tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=74337) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 21:36:34 user nova-compute[74337]: INFO nova.scheduler.client.report [None req-b2051122-f43c-4d02-b46f-5449007d141a tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] Deleted allocations for instance 2075057e-81db-424a-bb20-662d77faafed
Oct 23 21:36:34 user nova-compute[74337]: DEBUG nova.compute.manager [req-705faf22-80d4-4fcb-b47a-1d392b7ed18d req-ecb10d65-17b7-4479-a17c-db2d5b9025f8 service nova] [instance: 2075057e-81db-424a-bb20-662d77faafed] Received event network-vif-plugged-603e30f8-b216-49f6-ae75-5c60b4e602f8 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:36:34 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-705faf22-80d4-4fcb-b47a-1d392b7ed18d req-ecb10d65-17b7-4479-a17c-db2d5b9025f8 service nova] Acquiring lock "2075057e-81db-424a-bb20-662d77faafed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:36:34 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-705faf22-80d4-4fcb-b47a-1d392b7ed18d req-ecb10d65-17b7-4479-a17c-db2d5b9025f8 service nova] Lock "2075057e-81db-424a-bb20-662d77faafed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:36:34 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-705faf22-80d4-4fcb-b47a-1d392b7ed18d req-ecb10d65-17b7-4479-a17c-db2d5b9025f8 service nova] Lock "2075057e-81db-424a-bb20-662d77faafed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:36:34 user nova-compute[74337]: DEBUG nova.compute.manager [req-705faf22-80d4-4fcb-b47a-1d392b7ed18d req-ecb10d65-17b7-4479-a17c-db2d5b9025f8 service nova] [instance: 2075057e-81db-424a-bb20-662d77faafed] No waiting events found dispatching network-vif-plugged-603e30f8-b216-49f6-ae75-5c60b4e602f8 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:36:34 user nova-compute[74337]: WARNING nova.compute.manager [req-705faf22-80d4-4fcb-b47a-1d392b7ed18d req-ecb10d65-17b7-4479-a17c-db2d5b9025f8 service nova] [instance: 2075057e-81db-424a-bb20-662d77faafed] Received unexpected event network-vif-plugged-603e30f8-b216-49f6-ae75-5c60b4e602f8 for instance with vm_state deleted and task_state None.
Oct 23 21:36:34 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-b2051122-f43c-4d02-b46f-5449007d141a tempest-VolumesActionsTest-2062236964 tempest-VolumesActionsTest-2062236964-project-member] Lock "2075057e-81db-424a-bb20-662d77faafed" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.390s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:36:34 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-0a00da61-54f6-43fa-b9b2-ae5559acc918 tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] COPY block job progress, current cursor: 26214400 final cursor: 1073741824 {{(pid=74337) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 21:36:35 user nova-compute[74337]: DEBUG nova.objects.instance [None req-0d7dd564-4f5e-4591-917b-08d3fe1d119c tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Lazy-loading 'flavor' on Instance uuid d45e8ae8-371b-46ae-849d-d7f7d5bbd770 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:36:35 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-0d7dd564-4f5e-4591-917b-08d3fe1d119c tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Lock "d45e8ae8-371b-46ae-849d-d7f7d5bbd770" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 28.676s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:36:35 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-0a00da61-54f6-43fa-b9b2-ae5559acc918 tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] COPY block job progress, current cursor: 190840832 final cursor: 1073741824 {{(pid=74337) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 21:36:35 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:35 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-0a00da61-54f6-43fa-b9b2-ae5559acc918 tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] COPY block job progress, current cursor: 250609664 final cursor: 1073741824 {{(pid=74337) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 21:36:36 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-0a00da61-54f6-43fa-b9b2-ae5559acc918 tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] COPY block job progress, current cursor: 396361728 final cursor: 1073741824 {{(pid=74337) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 21:36:36 user nova-compute[74337]: DEBUG nova.objects.instance [None req-b8cbe48b-aaa8-4098-b2f9-5cfbb8fc7d1e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Lazy-loading 'flavor' on Instance uuid 8acc1b10-a541-4c06-aeb7-1ecf7a2457be {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:36:36 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-b8cbe48b-aaa8-4098-b2f9-5cfbb8fc7d1e tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Lock "8acc1b10-a541-4c06-aeb7-1ecf7a2457be" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 28.809s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:36:36 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-0a00da61-54f6-43fa-b9b2-ae5559acc918 tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] COPY block job progress, current cursor: 528482304 final cursor: 1073741824 {{(pid=74337) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 21:36:37 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-24f2dab4-e01c-4b8e-997c-adb9627134a5 tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Acquiring lock "interface-8acc1b10-a541-4c06-aeb7-1ecf7a2457be-e522a54f-9f6f-4224-a928-97d630fc5080" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:36:37 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-24f2dab4-e01c-4b8e-997c-adb9627134a5 tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Lock "interface-8acc1b10-a541-4c06-aeb7-1ecf7a2457be-e522a54f-9f6f-4224-a928-97d630fc5080" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:36:37 user nova-compute[74337]: DEBUG nova.objects.instance [None req-24f2dab4-e01c-4b8e-997c-adb9627134a5 tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Lazy-loading 'flavor' on Instance uuid 8acc1b10-a541-4c06-aeb7-1ecf7a2457be {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:36:37 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-24f2dab4-e01c-4b8e-997c-adb9627134a5 tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T21:33:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1843796381',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1843796381',id=5,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAop3qssYFI+MVvFuH2+7gwm//7zwcdy6tYm9eD42fbRzv89CUtru1RL8WlSDZgdlRSrkM4Tb4QtCQmTEE7AA2YXPHv9z6iJ2d9asZLABlNx58K0PwTsdZsKKihbdIgMOg==',key_name='tempest-keypair-586099674',keypairs=<?>,launch_index=0,launched_at=2023-10-23T21:33:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='84d7baedb5f74976be4b0cf308964086',ramdisk_id='',reservation_id='r-4zf725dv',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2141482979',owner_user_name='tempest-TaggedAttachmentsTest-2141482979-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T21:33:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec1a4c2d1f9b4983ab9124c7f6056da6',uuid=8acc1b10-a541-4c06-aeb7-1ecf7a2457be,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e522a54f-9f6f-4224-a928-97d630fc5080", "address": "fa:16:3e:6d:56:bf", "network": {"id": "db77b1d7-f969-40a5-918c-5706fb1ec6bd", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1231224947", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "84d7baedb5f74976be4b0cf308964086", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape522a54f-9f", "ovs_interfaceid": "e522a54f-9f6f-4224-a928-97d630fc5080", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 21:36:37 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-24f2dab4-e01c-4b8e-997c-adb9627134a5 tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Converting VIF {"id": "e522a54f-9f6f-4224-a928-97d630fc5080", "address": "fa:16:3e:6d:56:bf", "network": {"id": "db77b1d7-f969-40a5-918c-5706fb1ec6bd", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1231224947", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "84d7baedb5f74976be4b0cf308964086", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape522a54f-9f", "ovs_interfaceid": "e522a54f-9f6f-4224-a928-97d630fc5080", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:36:37 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-24f2dab4-e01c-4b8e-997c-adb9627134a5 tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:56:bf,bridge_name='br-int',has_traffic_filtering=True,id=e522a54f-9f6f-4224-a928-97d630fc5080,network=Network(db77b1d7-f969-40a5-918c-5706fb1ec6bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape522a54f-9f') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:36:37 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-24f2dab4-e01c-4b8e-997c-adb9627134a5 tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:6d:56:bf"/><model type="virtio"/><mtu size="1442"/><target dev="tape522a54f-9f"/></interface> {{(pid=74337) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 23 21:36:37 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-24f2dab4-e01c-4b8e-997c-adb9627134a5 tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:6d:56:bf"/><model type="virtio"/><mtu size="1442"/><target dev="tape522a54f-9f"/></interface> {{(pid=74337) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 23 21:36:37 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-24f2dab4-e01c-4b8e-997c-adb9627134a5 tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Attempting to detach device tape522a54f-9f from instance 8acc1b10-a541-4c06-aeb7-1ecf7a2457be from the persistent domain config. {{(pid=74337) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 21:36:37 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-24f2dab4-e01c-4b8e-997c-adb9627134a5 tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] detach device xml: <interface type="ethernet">
Oct 23 21:36:37 user nova-compute[74337]:   <mac address="fa:16:3e:6d:56:bf"/>
Oct 23 21:36:37 user nova-compute[74337]:   <model type="virtio"/>
Oct 23 21:36:37 user nova-compute[74337]:   <mtu size="1442"/>
Oct 23 21:36:37 user nova-compute[74337]:   <target dev="tape522a54f-9f"/>
Oct 23 21:36:37 user nova-compute[74337]: </interface>
Oct 23 21:36:37 user nova-compute[74337]:  {{(pid=74337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 21:36:37 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-24f2dab4-e01c-4b8e-997c-adb9627134a5 tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:6d:56:bf"/><model type="virtio"/><mtu size="1442"/><target dev="tape522a54f-9f"/></interface> {{(pid=74337) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 23 21:36:37 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-24f2dab4-e01c-4b8e-997c-adb9627134a5 tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:6d:56:bf"/><model type="virtio"/><mtu size="1442"/><target dev="tape522a54f-9f"/></interface>not found in domain: <domain type='kvm' id='5'>
Oct 23 21:36:37 user nova-compute[74337]:   <name>instance-00000005</name>
Oct 23 21:36:37 user nova-compute[74337]:   <uuid>8acc1b10-a541-4c06-aeb7-1ecf7a2457be</uuid>
Oct 23 21:36:37 user nova-compute[74337]:   <metadata>
Oct 23 21:36:37 user nova-compute[74337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 21:36:37 user nova-compute[74337]:   <nova:package version="0.0.0"/>
Oct 23 21:36:37 user nova-compute[74337]:   <nova:name>tempest-device-tagging-server-1843796381</nova:name>
Oct 23 21:36:37 user nova-compute[74337]:   <nova:creationTime>2023-10-23 21:35:26</nova:creationTime>
Oct 23 21:36:37 user nova-compute[74337]:   <nova:flavor name="m1.tiny">
Oct 23 21:36:37 user nova-compute[74337]:     <nova:memory>512</nova:memory>
Oct 23 21:36:37 user nova-compute[74337]:     <nova:disk>1</nova:disk>
Oct 23 21:36:37 user nova-compute[74337]:     <nova:swap>0</nova:swap>
Oct 23 21:36:37 user nova-compute[74337]:     <nova:ephemeral>0</nova:ephemeral>
Oct 23 21:36:37 user nova-compute[74337]:     <nova:vcpus>1</nova:vcpus>
Oct 23 21:36:37 user nova-compute[74337]:   </nova:flavor>
Oct 23 21:36:37 user nova-compute[74337]:   <nova:owner>
Oct 23 21:36:37 user nova-compute[74337]:     <nova:user uuid="ec1a4c2d1f9b4983ab9124c7f6056da6">tempest-TaggedAttachmentsTest-2141482979-project-member</nova:user>
Oct 23 21:36:37 user nova-compute[74337]:     <nova:project uuid="84d7baedb5f74976be4b0cf308964086">tempest-TaggedAttachmentsTest-2141482979</nova:project>
Oct 23 21:36:37 user nova-compute[74337]:   </nova:owner>
Oct 23 21:36:37 user nova-compute[74337]:   <nova:root type="image" uuid="d859d89d-998d-4109-b26a-0d6e28152932"/>
Oct 23 21:36:37 user nova-compute[74337]:   <nova:ports>
Oct 23 21:36:37 user nova-compute[74337]:     <nova:port uuid="530b7241-1498-47dc-8a6f-79e6c9cc850a">
Oct 23 21:36:37 user nova-compute[74337]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 23 21:36:37 user nova-compute[74337]:     </nova:port>
Oct 23 21:36:37 user nova-compute[74337]:     <nova:port uuid="e522a54f-9f6f-4224-a928-97d630fc5080">
Oct 23 21:36:37 user nova-compute[74337]:       <nova:ip type="fixed" address="10.10.10.139" ipVersion="4"/>
Oct 23 21:36:37 user nova-compute[74337]:     </nova:port>
Oct 23 21:36:37 user nova-compute[74337]:   </nova:ports>
Oct 23 21:36:37 user nova-compute[74337]: </nova:instance>
Oct 23 21:36:37 user nova-compute[74337]:   </metadata>
Oct 23 21:36:37 user nova-compute[74337]:   <memory unit='KiB'>524288</memory>
Oct 23 21:36:37 user nova-compute[74337]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 23 21:36:37 user nova-compute[74337]:   <vcpu placement='static'>1</vcpu>
Oct 23 21:36:37 user nova-compute[74337]:   <resource>
Oct 23 21:36:37 user nova-compute[74337]:     <partition>/machine</partition>
Oct 23 21:36:37 user nova-compute[74337]:   </resource>
Oct 23 21:36:37 user nova-compute[74337]:   <sysinfo type='smbios'>
Oct 23 21:36:37 user nova-compute[74337]:     <system>
Oct 23 21:36:37 user nova-compute[74337]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 23 21:36:37 user nova-compute[74337]:       <entry name='product'>OpenStack Nova</entry>
Oct 23 21:36:37 user nova-compute[74337]:       <entry name='version'>0.0.0</entry>
Oct 23 21:36:37 user nova-compute[74337]:       <entry name='serial'>8acc1b10-a541-4c06-aeb7-1ecf7a2457be</entry>
Oct 23 21:36:37 user nova-compute[74337]:       <entry name='uuid'>8acc1b10-a541-4c06-aeb7-1ecf7a2457be</entry>
Oct 23 21:36:37 user nova-compute[74337]:       <entry name='family'>Virtual Machine</entry>
Oct 23 21:36:37 user nova-compute[74337]:     </system>
Oct 23 21:36:37 user nova-compute[74337]:   </sysinfo>
Oct 23 21:36:37 user nova-compute[74337]:   <os>
Oct 23 21:36:37 user nova-compute[74337]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 23 21:36:37 user nova-compute[74337]:     <boot dev='hd'/>
Oct 23 21:36:37 user nova-compute[74337]:     <smbios mode='sysinfo'/>
Oct 23 21:36:37 user nova-compute[74337]:   </os>
Oct 23 21:36:37 user nova-compute[74337]:   <features>
Oct 23 21:36:37 user nova-compute[74337]:     <acpi/>
Oct 23 21:36:37 user nova-compute[74337]:     <apic/>
Oct 23 21:36:37 user nova-compute[74337]:     <vmcoreinfo state='on'/>
Oct 23 21:36:37 user nova-compute[74337]:   </features>
Oct 23 21:36:37 user nova-compute[74337]:   <cpu mode='custom' match='exact' check='full'>
Oct 23 21:36:37 user nova-compute[74337]:     <model fallback='forbid'>Nehalem</model>
Oct 23 21:36:37 user nova-compute[74337]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 23 21:36:37 user nova-compute[74337]:     <feature policy='require' name='vme'/>
Oct 23 21:36:37 user nova-compute[74337]:     <feature policy='require' name='x2apic'/>
Oct 23 21:36:37 user nova-compute[74337]:     <feature policy='require' name='hypervisor'/>
Oct 23 21:36:37 user nova-compute[74337]:   </cpu>
Oct 23 21:36:37 user nova-compute[74337]:   <clock offset='utc'>
Oct 23 21:36:37 user nova-compute[74337]:     <timer name='pit' tickpolicy='delay'/>
Oct 23 21:36:37 user nova-compute[74337]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 23 21:36:37 user nova-compute[74337]:     <timer name='hpet' present='no'/>
Oct 23 21:36:37 user nova-compute[74337]:   </clock>
Oct 23 21:36:37 user nova-compute[74337]:   <on_poweroff>destroy</on_poweroff>
Oct 23 21:36:37 user nova-compute[74337]:   <on_reboot>restart</on_reboot>
Oct 23 21:36:37 user nova-compute[74337]:   <on_crash>destroy</on_crash>
Oct 23 21:36:37 user nova-compute[74337]:   <devices>
Oct 23 21:36:37 user nova-compute[74337]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 23 21:36:37 user nova-compute[74337]:     <disk type='file' device='disk'>
Oct 23 21:36:37 user nova-compute[74337]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 23 21:36:37 user nova-compute[74337]:       <source file='/opt/stack/data/nova/instances/8acc1b10-a541-4c06-aeb7-1ecf7a2457be/disk' index='2'/>
Oct 23 21:36:37 user nova-compute[74337]:       <backingStore type='file' index='3'>
Oct 23 21:36:37 user nova-compute[74337]:         <format type='raw'/>
Oct 23 21:36:37 user nova-compute[74337]:         <source file='/opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7'/>
Oct 23 21:36:37 user nova-compute[74337]:         <backingStore/>
Oct 23 21:36:37 user nova-compute[74337]:       </backingStore>
Oct 23 21:36:37 user nova-compute[74337]:       <target dev='vda' bus='virtio'/>
Oct 23 21:36:37 user nova-compute[74337]:       <alias name='virtio-disk0'/>
Oct 23 21:36:37 user nova-compute[74337]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 23 21:36:37 user nova-compute[74337]:     </disk>
Oct 23 21:36:37 user nova-compute[74337]:     <disk type='file' device='cdrom'>
Oct 23 21:36:37 user nova-compute[74337]:       <driver name='qemu' type='raw' cache='none'/>
Oct 23 21:36:37 user nova-compute[74337]:       <source file='/opt/stack/data/nova/instances/8acc1b10-a541-4c06-aeb7-1ecf7a2457be/disk.config' index='1'/>
Oct 23 21:36:37 user nova-compute[74337]:       <backingStore/>
Oct 23 21:36:37 user nova-compute[74337]:       <target dev='hda' bus='ide'/>
Oct 23 21:36:37 user nova-compute[74337]:       <readonly/>
Oct 23 21:36:37 user nova-compute[74337]:       <alias name='ide0-0-0'/>
Oct 23 21:36:37 user nova-compute[74337]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 23 21:36:37 user nova-compute[74337]:     </disk>
Oct 23 21:36:37 user nova-compute[74337]:     <controller type='usb' index='0' model='none'>
Oct 23 21:36:37 user nova-compute[74337]:       <alias name='usb'/>
Oct 23 21:36:37 user nova-compute[74337]:     </controller>
Oct 23 21:36:37 user nova-compute[74337]:     <controller type='pci' index='0' model='pci-root'>
Oct 23 21:36:37 user nova-compute[74337]:       <alias name='pci.0'/>
Oct 23 21:36:37 user nova-compute[74337]:     </controller>
Oct 23 21:36:37 user nova-compute[74337]:     <controller type='ide' index='0'>
Oct 23 21:36:37 user nova-compute[74337]:       <alias name='ide'/>
Oct 23 21:36:37 user nova-compute[74337]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 23 21:36:37 user nova-compute[74337]:     </controller>
Oct 23 21:36:37 user nova-compute[74337]:     <interface type='ethernet'>
Oct 23 21:36:37 user nova-compute[74337]:       <mac address='fa:16:3e:47:6a:0e'/>
Oct 23 21:36:37 user nova-compute[74337]:       <target dev='tap530b7241-14'/>
Oct 23 21:36:37 user nova-compute[74337]:       <model type='virtio'/>
Oct 23 21:36:37 user nova-compute[74337]:       <mtu size='1442'/>
Oct 23 21:36:37 user nova-compute[74337]:       <alias name='net0'/>
Oct 23 21:36:37 user nova-compute[74337]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 23 21:36:37 user nova-compute[74337]:     </interface>
Oct 23 21:36:37 user nova-compute[74337]:     <interface type='ethernet'>
Oct 23 21:36:37 user nova-compute[74337]:       <mac address='fa:16:3e:6d:56:bf'/>
Oct 23 21:36:37 user nova-compute[74337]:       <target dev='tape522a54f-9f'/>
Oct 23 21:36:37 user nova-compute[74337]:       <model type='virtio'/>
Oct 23 21:36:37 user nova-compute[74337]:       <mtu size='1442'/>
Oct 23 21:36:37 user nova-compute[74337]:       <alias name='net1'/>
Oct 23 21:36:37 user nova-compute[74337]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Oct 23 21:36:37 user nova-compute[74337]:     </interface>
Oct 23 21:36:37 user nova-compute[74337]:     <serial type='pty'>
Oct 23 21:36:37 user nova-compute[74337]:       <source path='/dev/pts/4'/>
Oct 23 21:36:37 user nova-compute[74337]:       <log file='/opt/stack/data/nova/instances/8acc1b10-a541-4c06-aeb7-1ecf7a2457be/console.log' append='off'/>
Oct 23 21:36:37 user nova-compute[74337]:       <target type='isa-serial' port='0'>
Oct 23 21:36:37 user nova-compute[74337]:         <model name='isa-serial'/>
Oct 23 21:36:37 user nova-compute[74337]:       </target>
Oct 23 21:36:37 user nova-compute[74337]:       <alias name='serial0'/>
Oct 23 21:36:37 user nova-compute[74337]:     </serial>
Oct 23 21:36:37 user nova-compute[74337]:     <console type='pty' tty='/dev/pts/4'>
Oct 23 21:36:37 user nova-compute[74337]:       <source path='/dev/pts/4'/>
Oct 23 21:36:37 user nova-compute[74337]:       <log file='/opt/stack/data/nova/instances/8acc1b10-a541-4c06-aeb7-1ecf7a2457be/console.log' append='off'/>
Oct 23 21:36:37 user nova-compute[74337]:       <target type='serial' port='0'/>
Oct 23 21:36:37 user nova-compute[74337]:       <alias name='serial0'/>
Oct 23 21:36:37 user nova-compute[74337]:     </console>
Oct 23 21:36:37 user nova-compute[74337]:     <input type='mouse' bus='ps2'>
Oct 23 21:36:37 user nova-compute[74337]:       <alias name='input0'/>
Oct 23 21:36:37 user nova-compute[74337]:     </input>
Oct 23 21:36:37 user nova-compute[74337]:     <input type='keyboard' bus='ps2'>
Oct 23 21:36:37 user nova-compute[74337]:       <alias name='input1'/>
Oct 23 21:36:37 user nova-compute[74337]:     </input>
Oct 23 21:36:37 user nova-compute[74337]:     <graphics type='vnc' port='5904' autoport='yes' listen='0.0.0.0'>
Oct 23 21:36:37 user nova-compute[74337]:       <listen type='address' address='0.0.0.0'/>
Oct 23 21:36:37 user nova-compute[74337]:     </graphics>
Oct 23 21:36:37 user nova-compute[74337]:     <audio id='1' type='none'/>
Oct 23 21:36:37 user nova-compute[74337]:     <video>
Oct 23 21:36:37 user nova-compute[74337]:       <model type='virtio' heads='1' primary='yes'/>
Oct 23 21:36:37 user nova-compute[74337]:       <alias name='video0'/>
Oct 23 21:36:37 user nova-compute[74337]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 23 21:36:37 user nova-compute[74337]:     </video>
Oct 23 21:36:37 user nova-compute[74337]:     <memballoon model='virtio'>
Oct 23 21:36:37 user nova-compute[74337]:       <stats period='10'/>
Oct 23 21:36:37 user nova-compute[74337]:       <alias name='balloon0'/>
Oct 23 21:36:37 user nova-compute[74337]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 23 21:36:37 user nova-compute[74337]:     </memballoon>
Oct 23 21:36:37 user nova-compute[74337]:     <rng model='virtio'>
Oct 23 21:36:37 user nova-compute[74337]:       <backend model='random'>/dev/urandom</backend>
Oct 23 21:36:37 user nova-compute[74337]:       <alias name='rng0'/>
Oct 23 21:36:37 user nova-compute[74337]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 23 21:36:37 user nova-compute[74337]:     </rng>
Oct 23 21:36:37 user nova-compute[74337]:   </devices>
Oct 23 21:36:37 user nova-compute[74337]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 23 21:36:37 user nova-compute[74337]:     <label>libvirt-8acc1b10-a541-4c06-aeb7-1ecf7a2457be</label>
Oct 23 21:36:37 user nova-compute[74337]:     <imagelabel>libvirt-8acc1b10-a541-4c06-aeb7-1ecf7a2457be</imagelabel>
Oct 23 21:36:37 user nova-compute[74337]:   </seclabel>
Oct 23 21:36:37 user nova-compute[74337]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 23 21:36:37 user nova-compute[74337]:     <label>+64055:+108</label>
Oct 23 21:36:37 user nova-compute[74337]:     <imagelabel>+64055:+108</imagelabel>
Oct 23 21:36:37 user nova-compute[74337]:   </seclabel>
Oct 23 21:36:37 user nova-compute[74337]: </domain>
Oct 23 21:36:37 user nova-compute[74337]:  {{(pid=74337) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 23 21:36:37 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-24f2dab4-e01c-4b8e-997c-adb9627134a5 tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Successfully detached device tape522a54f-9f from instance 8acc1b10-a541-4c06-aeb7-1ecf7a2457be from the persistent domain config.
Oct 23 21:36:37 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-24f2dab4-e01c-4b8e-997c-adb9627134a5 tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] (1/8): Attempting to detach device tape522a54f-9f with device alias net1 from instance 8acc1b10-a541-4c06-aeb7-1ecf7a2457be from the live domain config. {{(pid=74337) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 21:36:37 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-24f2dab4-e01c-4b8e-997c-adb9627134a5 tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] detach device xml: <interface type="ethernet">
Oct 23 21:36:37 user nova-compute[74337]:   <mac address="fa:16:3e:6d:56:bf"/>
Oct 23 21:36:37 user nova-compute[74337]:   <model type="virtio"/>
Oct 23 21:36:37 user nova-compute[74337]:   <mtu size="1442"/>
Oct 23 21:36:37 user nova-compute[74337]:   <target dev="tape522a54f-9f"/>
Oct 23 21:36:37 user nova-compute[74337]: </interface>
Oct 23 21:36:37 user nova-compute[74337]:  {{(pid=74337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 21:36:37 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-0a00da61-54f6-43fa-b9b2-ae5559acc918 tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] COPY block job progress, current cursor: 697303040 final cursor: 1073741824 {{(pid=74337) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 21:36:37 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:37 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-24f2dab4-e01c-4b8e-997c-adb9627134a5 tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Start waiting for the detach event from libvirt for device tape522a54f-9f with device alias net1 for instance 8acc1b10-a541-4c06-aeb7-1ecf7a2457be {{(pid=74337) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 21:36:37 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:37 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:37 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:37 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:37 user nova-compute[74337]: DEBUG nova.compute.manager [req-84ead7eb-e3fb-4c0c-962e-04fdf0e441ee req-e9a96c00-2380-4dd8-8d1d-add0647614d9 service nova] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] Received event network-vif-unplugged-e522a54f-9f6f-4224-a928-97d630fc5080 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:36:37 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-84ead7eb-e3fb-4c0c-962e-04fdf0e441ee req-e9a96c00-2380-4dd8-8d1d-add0647614d9 service nova] Acquiring lock "8acc1b10-a541-4c06-aeb7-1ecf7a2457be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:36:37 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-84ead7eb-e3fb-4c0c-962e-04fdf0e441ee req-e9a96c00-2380-4dd8-8d1d-add0647614d9 service nova] Lock "8acc1b10-a541-4c06-aeb7-1ecf7a2457be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:36:37 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-84ead7eb-e3fb-4c0c-962e-04fdf0e441ee req-e9a96c00-2380-4dd8-8d1d-add0647614d9 service nova] Lock "8acc1b10-a541-4c06-aeb7-1ecf7a2457be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:36:37 user nova-compute[74337]: DEBUG nova.compute.manager [req-84ead7eb-e3fb-4c0c-962e-04fdf0e441ee req-e9a96c00-2380-4dd8-8d1d-add0647614d9 service nova] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] No waiting events found dispatching network-vif-unplugged-e522a54f-9f6f-4224-a928-97d630fc5080 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:36:37 user nova-compute[74337]: WARNING nova.compute.manager [req-84ead7eb-e3fb-4c0c-962e-04fdf0e441ee req-e9a96c00-2380-4dd8-8d1d-add0647614d9 service nova] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] Received unexpected event network-vif-unplugged-e522a54f-9f6f-4224-a928-97d630fc5080 for instance with vm_state active and task_state None.
Oct 23 21:36:37 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-0a00da61-54f6-43fa-b9b2-ae5559acc918 tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] COPY block job progress, current cursor: 862978048 final cursor: 1073741824 {{(pid=74337) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 21:36:37 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:37 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:38 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-0a00da61-54f6-43fa-b9b2-ae5559acc918 tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] COPY block job progress, current cursor: 924844032 final cursor: 1073741824 {{(pid=74337) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 21:36:38 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-0a00da61-54f6-43fa-b9b2-ae5559acc918 tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] COPY block job progress, current cursor: 946864128 final cursor: 1073741824 {{(pid=74337) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 21:36:39 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-0a00da61-54f6-43fa-b9b2-ae5559acc918 tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] COPY block job progress, current cursor: 1015021568 final cursor: 1073741824 {{(pid=74337) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 21:36:39 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:39 user nova-compute[74337]: DEBUG nova.compute.manager [req-6e4f6c27-9385-4c30-a9b8-8800e08ce01c req-3c626586-5c10-4063-b513-91c6e4b8e1fd service nova] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] Received event network-vif-plugged-e522a54f-9f6f-4224-a928-97d630fc5080 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:36:39 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-6e4f6c27-9385-4c30-a9b8-8800e08ce01c req-3c626586-5c10-4063-b513-91c6e4b8e1fd service nova] Acquiring lock "8acc1b10-a541-4c06-aeb7-1ecf7a2457be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:36:39 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-6e4f6c27-9385-4c30-a9b8-8800e08ce01c req-3c626586-5c10-4063-b513-91c6e4b8e1fd service nova] Lock "8acc1b10-a541-4c06-aeb7-1ecf7a2457be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:36:39 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-6e4f6c27-9385-4c30-a9b8-8800e08ce01c req-3c626586-5c10-4063-b513-91c6e4b8e1fd service nova] Lock "8acc1b10-a541-4c06-aeb7-1ecf7a2457be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:36:39 user nova-compute[74337]: DEBUG nova.compute.manager [req-6e4f6c27-9385-4c30-a9b8-8800e08ce01c req-3c626586-5c10-4063-b513-91c6e4b8e1fd service nova] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] No waiting events found dispatching network-vif-plugged-e522a54f-9f6f-4224-a928-97d630fc5080 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:36:39 user nova-compute[74337]: WARNING nova.compute.manager [req-6e4f6c27-9385-4c30-a9b8-8800e08ce01c req-3c626586-5c10-4063-b513-91c6e4b8e1fd service nova] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] Received unexpected event network-vif-plugged-e522a54f-9f6f-4224-a928-97d630fc5080 for instance with vm_state active and task_state None.
Oct 23 21:36:39 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-0a00da61-54f6-43fa-b9b2-ae5559acc918 tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74337) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 21:36:40 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a00da61-54f6-43fa-b9b2-ae5559acc918 tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] [instance: 5a181593-8086-4ece-9f5b-5ccba0bfe91e] calling os-brick to detach iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 21:36:40 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a00da61-54f6-43fa-b9b2-ae5559acc918 tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, {'target_iqn': 'iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wfjRXToB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:36:40 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-0a00da61-54f6-43fa-b9b2-ae5559acc918 tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:36:40 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-0a00da61-54f6-43fa-b9b2-ae5559acc918 tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:36:40 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-0a00da61-54f6-43fa-b9b2-ae5559acc918 tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:36:40 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:40 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:40 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2031da3-f91e-4e65-b606-8c6325bbfa12]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0d948adf-16c8-4098-aec1-e616613d545c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:40 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a00da61-54f6-43fa-b9b2-ae5559acc918 tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 21:36:40 user nova-compute[74337]: No targets found.
Oct 23 21:36:40 user nova-compute[74337]: iSNS:
Oct 23 21:36:40 user nova-compute[74337]: No targets found.
Oct 23 21:36:40 user nova-compute[74337]: STATIC:
Oct 23 21:36:40 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a
Oct 23 21:36:40 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:36:40 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:36:40 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:0d948adf-16c8-4098-aec1-e616613d545c
Oct 23 21:36:40 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:36:40 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:36:40 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661
Oct 23 21:36:40 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:36:40 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:36:40 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496
Oct 23 21:36:40 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:36:40 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:36:40 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b
Oct 23 21:36:40 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:36:40 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:36:40 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932
Oct 23 21:36:40 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:36:40 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:36:40 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f
Oct 23 21:36:40 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:36:40 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:36:40 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0
Oct 23 21:36:40 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:36:40 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:36:40 user nova-compute[74337]: FIRMWARE:
Oct 23 21:36:40 user nova-compute[74337]: No targets found.
Oct 23 21:36:40 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:36:40 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a00da61-54f6-43fa-b9b2-ae5559acc918 tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 21:36:40 user nova-compute[74337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 21:36:40 user nova-compute[74337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 21:36:40 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a00da61-54f6-43fa-b9b2-ae5559acc918 tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f', 0)] {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 21:36:40 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:40 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:40 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6939ed52-89c6-4c85-9e32-1f0df5cfe33a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d948adf-16c8-4098-aec1-e616613d545c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:40 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:40 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:40 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c22655cd-1d8c-4b54-ab84-80773cbec4d4]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d948adf-16c8-4098-aec1-e616613d545c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:40 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a00da61-54f6-43fa-b9b2-ae5559acc918 tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f (non-flash)
Oct 23 21:36:40 user nova-compute[74337]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496 (non-flash)
Oct 23 21:36:40 user nova-compute[74337]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d948adf-16c8-4098-aec1-e616613d545c (non-flash)
Oct 23 21:36:40 user nova-compute[74337]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)
Oct 23 21:36:40 user nova-compute[74337]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b (non-flash)
Oct 23 21:36:40 user nova-compute[74337]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 (non-flash)
Oct 23 21:36:40 user nova-compute[74337]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a (non-flash)
Oct 23 21:36:40 user nova-compute[74337]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661 (non-flash)
Oct 23 21:36:40 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:36:40 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a00da61-54f6-43fa-b9b2-ae5559acc918 tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f (non-flash)
Oct 23 21:36:40 user nova-compute[74337]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496 (non-flash)
Oct 23 21:36:40 user nova-compute[74337]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d948adf-16c8-4098-aec1-e616613d545c (non-flash)
Oct 23 21:36:40 user nova-compute[74337]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)
Oct 23 21:36:40 user nova-compute[74337]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b (non-flash)
Oct 23 21:36:40 user nova-compute[74337]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 (non-flash)
Oct 23 21:36:40 user nova-compute[74337]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a (non-flash)
Oct 23 21:36:40 user nova-compute[74337]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661 (non-flash)
Oct 23 21:36:40 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:36:40 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a00da61-54f6-43fa-b9b2-ae5559acc918 tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5eec751990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f'): ({'sdi'}, set())}) {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 21:36:40 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-0a00da61-54f6-43fa-b9b2-ae5559acc918 tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] Removing single pathed devices sdi {{(pid=74337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 21:36:40 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:40 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:40 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[1840636c-bffd-474d-b2ea-b03c2bf0680d]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:40 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:40 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.022s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:40 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f5e9462-517d-42fe-9900-990e4a70ce53]: (4, ('ok\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:40 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-0a00da61-54f6-43fa-b9b2-ae5559acc918 tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] Flushing IO for device /dev/sdi {{(pid=74337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 21:36:40 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:40 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.013s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:40 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[832498e1-ccd2-4500-aefe-bb079082119f]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:40 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-0a00da61-54f6-43fa-b9b2-ae5559acc918 tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=74337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 21:36:40 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:40 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.038s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:40 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a47c30-7e69-45b7-9bdb-6409633e2161]: (4, ('1', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:40 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-0a00da61-54f6-43fa-b9b2-ae5559acc918 tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] Checking to see if SCSI volumes sdi have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 21:36:40 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-0a00da61-54f6-43fa-b9b2-ae5559acc918 tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] SCSI volumes sdi have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 21:36:40 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a00da61-54f6-43fa-b9b2-ae5559acc918 tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f')] {{(pid=74337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 21:36:40 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:40 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:40 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fed66a6-ce54-4313-bd42-abff2ad6eaa7]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:40 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a00da61-54f6-43fa-b9b2-ae5559acc918 tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:36:40 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f -p 172.16.0.220:3260 --logout {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:40 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:40 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed96716-68a1-4190-a6b6-4063c57c79d9]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:40 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a00da61-54f6-43fa-b9b2-ae5559acc918 tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f, portal: 172.16.0.220,3260]
Oct 23 21:36:40 user nova-compute[74337]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f, portal: 172.16.0.220,3260] successful.
Oct 23 21:36:40 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:36:40 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f -p 172.16.0.220:3260 --op delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:40 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:40 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d657a40-c191-4da2-8003-1b3fbe56a591]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:40 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a00da61-54f6-43fa-b9b2-ae5559acc918 tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:36:40 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-0a00da61-54f6-43fa-b9b2-ae5559acc918 tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.439s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:36:40 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a00da61-54f6-43fa-b9b2-ae5559acc918 tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] <== disconnect_volume: return (441ms) None {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:36:40 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a00da61-54f6-43fa-b9b2-ae5559acc918 tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] [instance: 5a181593-8086-4ece-9f5b-5ccba0bfe91e] Disconnected iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 21:36:40 user nova-compute[74337]: DEBUG nova.compute.manager [None req-0a00da61-54f6-43fa-b9b2-ae5559acc918 tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0d948adf-16c8-4098-aec1-e616613d545c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kDwXYnUr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '5a181593-8086-4ece-9f5b-5ccba0bfe91e', 'attached_at': '', 'detached_at': '', 'volume_id': '0d948adf-16c8-4098-aec1-e616613d545c', 'serial'} {{(pid=74337) _swap_volume /opt/stack/nova/nova/compute/manager.py:7790}}
Oct 23 21:36:40 user nova-compute[74337]: DEBUG nova.compute.manager [None req-0a00da61-54f6-43fa-b9b2-ae5559acc918 tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] [instance: 5a181593-8086-4ece-9f5b-5ccba0bfe91e] swap_volume: removing Cinder connection for volume 06d4748a-a032-4937-a18b-c323e56f507f {{(pid=74337) _swap_volume /opt/stack/nova/nova/compute/manager.py:7835}}
Oct 23 21:36:41 user nova-compute[74337]: DEBUG nova.compute.manager [None req-0a00da61-54f6-43fa-b9b2-ae5559acc918 tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] [instance: 5a181593-8086-4ece-9f5b-5ccba0bfe91e] swap_volume: Updating volume 06d4748a-a032-4937-a18b-c323e56f507f BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:0d948adf-16c8-4098-aec1-e616613d545c", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "kDwXYnUr", "auth_password": "MtOAaCEI1G20es", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sde", "volume_id": "0d948adf-16c8-4098-aec1-e616613d545c"}, "status": "reserved", "instance": "5a181593-8086-4ece-9f5b-5ccba0bfe91e", "attached_at": "", "detached_at": "", "volume_id": "0d948adf-16c8-4098-aec1-e616613d545c", "serial": "0d948adf-16c8-4098-aec1-e616613d545c"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '0d948adf-16c8-4098-aec1-e616613d545c', 'no_device': None, 'attachment_id': 'aee1dd71-33ec-4f1a-8b3e-82baaba5beaf'} {{(pid=74337) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7983}}
Oct 23 21:36:41 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-0a00da61-54f6-43fa-b9b2-ae5559acc918 tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] Lock "5a181593-8086-4ece-9f5b-5ccba0bfe91e" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 31.922s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:36:42 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-50886065-ed29-4f15-ae11-2b48468600ee tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] Acquiring lock "5a181593-8086-4ece-9f5b-5ccba0bfe91e" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:36:42 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-50886065-ed29-4f15-ae11-2b48468600ee tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] Lock "5a181593-8086-4ece-9f5b-5ccba0bfe91e" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:36:42 user nova-compute[74337]: DEBUG os_brick.utils [None req-50886065-ed29-4f15-ae11-2b48468600ee tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:36:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:42 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[f66e5349-d0d7-46cd-b950-987be6071f3c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f34011b66e40\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:42 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c0c7d3-f436-437a-ada1-0aa55bdeb20e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:42 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6feaf09e-2f8a-47f7-968c-24dc587ae284]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:42 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[64bbe0ca-e77e-4ebb-9c65-4c173a104080]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-50886065-ed29-4f15-ae11-2b48468600ee tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] Running cmd (subprocess): nvme version {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-50886065-ed29-4f15-ae11-2b48468600ee tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 21:36:42 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-50886065-ed29-4f15-ae11-2b48468600ee tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] nvme not present on system {{(pid=74337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 21:36:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 21:36:42 user nova-compute[74337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 21:36:42 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d736f04d-33fb-4fbd-a7e2-a5abf5244bea]: (4, '') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:42 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-50886065-ed29-4f15-ae11-2b48468600ee tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 21:36:42 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-50886065-ed29-4f15-ae11-2b48468600ee tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 21:36:42 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-50886065-ed29-4f15-ae11-2b48468600ee tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] LIGHTOS: no hostnqn found. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 21:36:42 user nova-compute[74337]: DEBUG os_brick.utils [None req-50886065-ed29-4f15-ae11-2b48468600ee tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f34011b66e40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:36:42 user nova-compute[74337]: INFO nova.compute.manager [None req-50886065-ed29-4f15-ae11-2b48468600ee tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] [instance: 5a181593-8086-4ece-9f5b-5ccba0bfe91e] Swapping volume 0d948adf-16c8-4098-aec1-e616613d545c for 06d4748a-a032-4937-a18b-c323e56f507f
Oct 23 21:36:42 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:42 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:42 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:43 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e356b53-325c-430d-a2e8-027becc1feec tempest-VolumesAssistedSnapshotsTest-1195398017 tempest-VolumesAssistedSnapshotsTest-1195398017-project-admin] [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d] Calling os-brick to attach iSCSI Volume {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 21:36:43 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e356b53-325c-430d-a2e8-027becc1feec tempest-VolumesAssistedSnapshotsTest-1195398017 tempest-VolumesAssistedSnapshotsTest-1195398017-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d827c0c9-ec2a-45ec-927e-41fad52ffdb0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LVfUYWGS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:36:43 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-4e356b53-325c-430d-a2e8-027becc1feec tempest-VolumesAssistedSnapshotsTest-1195398017 tempest-VolumesAssistedSnapshotsTest-1195398017-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:36:43 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-4e356b53-325c-430d-a2e8-027becc1feec tempest-VolumesAssistedSnapshotsTest-1195398017 tempest-VolumesAssistedSnapshotsTest-1195398017-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:36:43 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-4e356b53-325c-430d-a2e8-027becc1feec tempest-VolumesAssistedSnapshotsTest-1195398017 tempest-VolumesAssistedSnapshotsTest-1195398017-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:36:43 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-4e356b53-325c-430d-a2e8-027becc1feec tempest-VolumesAssistedSnapshotsTest-1195398017 tempest-VolumesAssistedSnapshotsTest-1195398017-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:36:43 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-4e356b53-325c-430d-a2e8-027becc1feec tempest-VolumesAssistedSnapshotsTest-1195398017 tempest-VolumesAssistedSnapshotsTest-1195398017-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d827c0c9-ec2a-45ec-927e-41fad52ffdb0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:36:43 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-4e356b53-325c-430d-a2e8-027becc1feec tempest-VolumesAssistedSnapshotsTest-1195398017 tempest-VolumesAssistedSnapshotsTest-1195398017-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d827c0c9-ec2a-45ec-927e-41fad52ffdb0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:36:43 user nova-compute[74337]: INFO os_brick.initiator.connectors.iscsi [None req-4e356b53-325c-430d-a2e8-027becc1feec tempest-VolumesAssistedSnapshotsTest-1195398017 tempest-VolumesAssistedSnapshotsTest-1195398017-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 21:36:43 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d827c0c9-ec2a-45ec-927e-41fad52ffdb0 -p 172.16.0.220:3260 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:43 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d827c0c9-ec2a-45ec-927e-41fad52ffdb0 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:43 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b7034e8-6427-40a3-aeb1-056e5b4671eb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:43 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e356b53-325c-430d-a2e8-027becc1feec tempest-VolumesAssistedSnapshotsTest-1195398017 tempest-VolumesAssistedSnapshotsTest-1195398017-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 21:36:43 user nova-compute[74337]:  {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:36:43 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d827c0c9-ec2a-45ec-927e-41fad52ffdb0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:43 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d827c0c9-ec2a-45ec-927e-41fad52ffdb0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:43 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[9015fd42-b3fe-4e7a-941f-91fb3d4ddabe]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d827c0c9-ec2a-45ec-927e-41fad52ffdb0] added\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:43 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e356b53-325c-430d-a2e8-027becc1feec tempest-VolumesAssistedSnapshotsTest-1195398017 tempest-VolumesAssistedSnapshotsTest-1195398017-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d827c0c9-ec2a-45ec-927e-41fad52ffdb0] added
Oct 23 21:36:43 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:36:43 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d827c0c9-ec2a-45ec-927e-41fad52ffdb0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:43 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d827c0c9-ec2a-45ec-927e-41fad52ffdb0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:43 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a865d55-f1e7-492a-9743-ca1b3310a7d3]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:43 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e356b53-325c-430d-a2e8-027becc1feec tempest-VolumesAssistedSnapshotsTest-1195398017 tempest-VolumesAssistedSnapshotsTest-1195398017-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:36:43 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d827c0c9-ec2a-45ec-927e-41fad52ffdb0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:43 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89df2314-cb98-4794-bbcc-6690d53a7ceb tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] [instance: ff1c790c-2458-438e-95c7-7e1412fe05fc] Calling os-brick to attach iSCSI Volume {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 21:36:43 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-89df2314-cb98-4794-bbcc-6690d53a7ceb tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:37bd5655-eaa0-4702-882b-73a73d1ba948', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ousQMLEd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:36:43 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-89df2314-cb98-4794-bbcc-6690d53a7ceb tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:36:43 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-89df2314-cb98-4794-bbcc-6690d53a7ceb tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:36:43 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d827c0c9-ec2a-45ec-927e-41fad52ffdb0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:43 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ddb7304-21ee-487c-8319-516f2b5486bc]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:43 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e356b53-325c-430d-a2e8-027becc1feec tempest-VolumesAssistedSnapshotsTest-1195398017 tempest-VolumesAssistedSnapshotsTest-1195398017-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:36:43 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d827c0c9-ec2a-45ec-927e-41fad52ffdb0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LVfUYWGS {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:43 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d827c0c9-ec2a-45ec-927e-41fad52ffdb0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LVfUYWGS" returned: 0 in 0.023s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:43 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b3a5fe5-0ddb-4910-a958-c6d4f2be1f96]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:43 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e356b53-325c-430d-a2e8-027becc1feec tempest-VolumesAssistedSnapshotsTest-1195398017 tempest-VolumesAssistedSnapshotsTest-1195398017-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LVfUYWGS'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:36:43 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d827c0c9-ec2a-45ec-927e-41fad52ffdb0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:43 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d827c0c9-ec2a-45ec-927e-41fad52ffdb0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:43 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[9244a901-75dd-485b-8280-71fde62d67d9]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:43 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e356b53-325c-430d-a2e8-027becc1feec tempest-VolumesAssistedSnapshotsTest-1195398017 tempest-VolumesAssistedSnapshotsTest-1195398017-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:36:43 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:43 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:43 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bfe081c-fb50-4eac-8c9c-eb67a571dbe4]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d948adf-16c8-4098-aec1-e616613d545c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:43 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e356b53-325c-430d-a2e8-027becc1feec tempest-VolumesAssistedSnapshotsTest-1195398017 tempest-VolumesAssistedSnapshotsTest-1195398017-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496 (non-flash)
Oct 23 21:36:43 user nova-compute[74337]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d948adf-16c8-4098-aec1-e616613d545c (non-flash)
Oct 23 21:36:43 user nova-compute[74337]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)
Oct 23 21:36:43 user nova-compute[74337]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b (non-flash)
Oct 23 21:36:43 user nova-compute[74337]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 (non-flash)
Oct 23 21:36:43 user nova-compute[74337]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a (non-flash)
Oct 23 21:36:43 user nova-compute[74337]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661 (non-flash)
Oct 23 21:36:43 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:36:43 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e356b53-325c-430d-a2e8-027becc1feec tempest-VolumesAssistedSnapshotsTest-1195398017 tempest-VolumesAssistedSnapshotsTest-1195398017-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496 (non-flash)
Oct 23 21:36:43 user nova-compute[74337]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d948adf-16c8-4098-aec1-e616613d545c (non-flash)
Oct 23 21:36:43 user nova-compute[74337]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)
Oct 23 21:36:43 user nova-compute[74337]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b (non-flash)
Oct 23 21:36:43 user nova-compute[74337]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 (non-flash)
Oct 23 21:36:43 user nova-compute[74337]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a (non-flash)
Oct 23 21:36:43 user nova-compute[74337]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661 (non-flash)
Oct 23 21:36:43 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:36:43 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d827c0c9-ec2a-45ec-927e-41fad52ffdb0 -p 172.16.0.220:3260 --login {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:43 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d827c0c9-ec2a-45ec-927e-41fad52ffdb0 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:43 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b9edef6-1213-45f1-8b08-75a902a8f5ff]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d827c0c9-ec2a-45ec-927e-41fad52ffdb0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d827c0c9-ec2a-45ec-927e-41fad52ffdb0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:43 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e356b53-325c-430d-a2e8-027becc1feec tempest-VolumesAssistedSnapshotsTest-1195398017 tempest-VolumesAssistedSnapshotsTest-1195398017-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d827c0c9-ec2a-45ec-927e-41fad52ffdb0, portal: 172.16.0.220,3260]
Oct 23 21:36:43 user nova-compute[74337]: Login to [iface: default, target: iqn.2010-10.org.openstack:d827c0c9-ec2a-45ec-927e-41fad52ffdb0, portal: 172.16.0.220,3260] successful.
Oct 23 21:36:43 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:36:43 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d827c0c9-ec2a-45ec-927e-41fad52ffdb0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:43 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d827c0c9-ec2a-45ec-927e-41fad52ffdb0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:43 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[40de4859-e5aa-459b-9125-3231c7bd64fc]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:43 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e356b53-325c-430d-a2e8-027becc1feec tempest-VolumesAssistedSnapshotsTest-1195398017 tempest-VolumesAssistedSnapshotsTest-1195398017-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:36:43 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:43 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:43 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[22d28c23-c370-4437-9962-1405d2724432]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d948adf-16c8-4098-aec1-e616613d545c (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d827c0c9-ec2a-45ec-927e-41fad52ffdb0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:43 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e356b53-325c-430d-a2e8-027becc1feec tempest-VolumesAssistedSnapshotsTest-1195398017 tempest-VolumesAssistedSnapshotsTest-1195398017-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496 (non-flash)
Oct 23 21:36:43 user nova-compute[74337]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d948adf-16c8-4098-aec1-e616613d545c (non-flash)
Oct 23 21:36:43 user nova-compute[74337]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d827c0c9-ec2a-45ec-927e-41fad52ffdb0 (non-flash)
Oct 23 21:36:43 user nova-compute[74337]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)
Oct 23 21:36:43 user nova-compute[74337]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b (non-flash)
Oct 23 21:36:43 user nova-compute[74337]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 (non-flash)
Oct 23 21:36:43 user nova-compute[74337]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a (non-flash)
Oct 23 21:36:43 user nova-compute[74337]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661 (non-flash)
Oct 23 21:36:43 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:36:43 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e356b53-325c-430d-a2e8-027becc1feec tempest-VolumesAssistedSnapshotsTest-1195398017 tempest-VolumesAssistedSnapshotsTest-1195398017-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496 (non-flash)
Oct 23 21:36:43 user nova-compute[74337]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d948adf-16c8-4098-aec1-e616613d545c (non-flash)
Oct 23 21:36:43 user nova-compute[74337]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d827c0c9-ec2a-45ec-927e-41fad52ffdb0 (non-flash)
Oct 23 21:36:43 user nova-compute[74337]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)
Oct 23 21:36:43 user nova-compute[74337]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b (non-flash)
Oct 23 21:36:43 user nova-compute[74337]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 (non-flash)
Oct 23 21:36:43 user nova-compute[74337]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a (non-flash)
Oct 23 21:36:43 user nova-compute[74337]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661 (non-flash)
Oct 23 21:36:43 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:36:43 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-4e356b53-325c-430d-a2e8-027becc1feec tempest-VolumesAssistedSnapshotsTest-1195398017 tempest-VolumesAssistedSnapshotsTest-1195398017-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d827c0c9-ec2a-45ec-927e-41fad52ffdb0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.336s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:36:43 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e356b53-325c-430d-a2e8-027becc1feec tempest-VolumesAssistedSnapshotsTest-1195398017 tempest-VolumesAssistedSnapshotsTest-1195398017-project-admin] Connected to 172.16.0.220:3260 {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 21:36:43 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-4e356b53-325c-430d-a2e8-027becc1feec tempest-VolumesAssistedSnapshotsTest-1195398017 tempest-VolumesAssistedSnapshotsTest-1195398017-project-admin] HCTL ('37', '-', '-', 0) found on session 13 with lun 0 {{(pid=74337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 21:36:43 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-4e356b53-325c-430d-a2e8-027becc1feec tempest-VolumesAssistedSnapshotsTest-1195398017 tempest-VolumesAssistedSnapshotsTest-1195398017-project-admin] Scanning host 37 c: -, t: -, l: 0) {{(pid=74337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 21:36:43 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:43 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:43 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[522c7982-2172-41e1-aa21-0e318c6a213f]: (4, ('- - 0', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:43 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-4e356b53-325c-430d-a2e8-027becc1feec tempest-VolumesAssistedSnapshotsTest-1195398017 tempest-VolumesAssistedSnapshotsTest-1195398017-project-admin] Searching for a device in session 13 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 21:36:43 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e356b53-325c-430d-a2e8-027becc1feec tempest-VolumesAssistedSnapshotsTest-1195398017 tempest-VolumesAssistedSnapshotsTest-1195398017-project-admin] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:d827c0c9-ec2a-45ec-927e-41fad52ffdb0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LVfUYWGS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 21:36:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:44 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-4e356b53-325c-430d-a2e8-027becc1feec tempest-VolumesAssistedSnapshotsTest-1195398017 tempest-VolumesAssistedSnapshotsTest-1195398017-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.379s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:36:44 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e356b53-325c-430d-a2e8-027becc1feec tempest-VolumesAssistedSnapshotsTest-1195398017 tempest-VolumesAssistedSnapshotsTest-1195398017-project-admin] <== connect_volume: return (1383ms) {'type': 'block', 'scsi_wwn': '23939626232353461', 'path': '/dev/sdf'} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:36:44 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e356b53-325c-430d-a2e8-027becc1feec tempest-VolumesAssistedSnapshotsTest-1195398017 tempest-VolumesAssistedSnapshotsTest-1195398017-project-admin] [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23939626232353461', 'path': '/dev/sdf'} {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 21:36:44 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-89df2314-cb98-4794-bbcc-6690d53a7ceb tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.293s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:36:44 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-89df2314-cb98-4794-bbcc-6690d53a7ceb tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:36:44 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-89df2314-cb98-4794-bbcc-6690d53a7ceb tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37bd5655-eaa0-4702-882b-73a73d1ba948" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:36:44 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-89df2314-cb98-4794-bbcc-6690d53a7ceb tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37bd5655-eaa0-4702-882b-73a73d1ba948" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:36:44 user nova-compute[74337]: INFO os_brick.initiator.connectors.iscsi [None req-89df2314-cb98-4794-bbcc-6690d53a7ceb tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 21:36:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37bd5655-eaa0-4702-882b-73a73d1ba948 -p 172.16.0.220:3260 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:44 user nova-compute[74337]: DEBUG nova.objects.instance [None req-4e356b53-325c-430d-a2e8-027becc1feec tempest-VolumesAssistedSnapshotsTest-1195398017 tempest-VolumesAssistedSnapshotsTest-1195398017-project-admin] Lazy-loading 'flavor' on Instance uuid a4bf4723-1e3c-42f1-a422-9d9263b67e3d {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:36:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37bd5655-eaa0-4702-882b-73a73d1ba948 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:45 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7847243-84c2-4d6b-b701-e10543881685]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-89df2314-cb98-4794-bbcc-6690d53a7ceb tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 21:36:45 user nova-compute[74337]:  {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:36:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37bd5655-eaa0-4702-882b-73a73d1ba948 -p 172.16.0.220:3260 --interface default --op new {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:45 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-4e356b53-325c-430d-a2e8-027becc1feec tempest-VolumesAssistedSnapshotsTest-1195398017 tempest-VolumesAssistedSnapshotsTest-1195398017-project-admin] attach device xml: <disk type="block" device="disk">
Oct 23 21:36:45 user nova-compute[74337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 21:36:45 user nova-compute[74337]:   <source dev="/dev/sdf"/>
Oct 23 21:36:45 user nova-compute[74337]:   <target dev="vdb" bus="virtio"/>
Oct 23 21:36:45 user nova-compute[74337]:   <serial>d827c0c9-ec2a-45ec-927e-41fad52ffdb0</serial>
Oct 23 21:36:45 user nova-compute[74337]: </disk>
Oct 23 21:36:45 user nova-compute[74337]:  {{(pid=74337) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 21:36:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37bd5655-eaa0-4702-882b-73a73d1ba948 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:45 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac842cd-e485-47ad-bc91-9fdb8a534207]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:37bd5655-eaa0-4702-882b-73a73d1ba948] added\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-89df2314-cb98-4794-bbcc-6690d53a7ceb tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:37bd5655-eaa0-4702-882b-73a73d1ba948] added
Oct 23 21:36:45 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:36:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37bd5655-eaa0-4702-882b-73a73d1ba948 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37bd5655-eaa0-4702-882b-73a73d1ba948 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:45 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b8f447f-5919-47e8-96ff-be2eb029bc11]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-89df2314-cb98-4794-bbcc-6690d53a7ceb tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:36:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37bd5655-eaa0-4702-882b-73a73d1ba948 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37bd5655-eaa0-4702-882b-73a73d1ba948 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:45 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[132411a4-4910-49dd-a50f-d01a07c35600]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-89df2314-cb98-4794-bbcc-6690d53a7ceb tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:36:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37bd5655-eaa0-4702-882b-73a73d1ba948 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ousQMLEd {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37bd5655-eaa0-4702-882b-73a73d1ba948 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ousQMLEd" returned: 0 in 0.021s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:45 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4417d5e-56bd-489a-8f39-6ad7e69b6252]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-89df2314-cb98-4794-bbcc-6690d53a7ceb tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ousQMLEd'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:36:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37bd5655-eaa0-4702-882b-73a73d1ba948 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37bd5655-eaa0-4702-882b-73a73d1ba948 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:45 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[037b6a39-bedd-4dd0-8728-538130f3e256]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-89df2314-cb98-4794-bbcc-6690d53a7ceb tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:36:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:45 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bc2a4dd-886c-4109-b98f-c88b9afce6a6]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d948adf-16c8-4098-aec1-e616613d545c (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d827c0c9-ec2a-45ec-927e-41fad52ffdb0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-89df2314-cb98-4794-bbcc-6690d53a7ceb tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496 (non-flash)
Oct 23 21:36:45 user nova-compute[74337]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d948adf-16c8-4098-aec1-e616613d545c (non-flash)
Oct 23 21:36:45 user nova-compute[74337]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d827c0c9-ec2a-45ec-927e-41fad52ffdb0 (non-flash)
Oct 23 21:36:45 user nova-compute[74337]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)
Oct 23 21:36:45 user nova-compute[74337]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b (non-flash)
Oct 23 21:36:45 user nova-compute[74337]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 (non-flash)
Oct 23 21:36:45 user nova-compute[74337]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a (non-flash)
Oct 23 21:36:45 user nova-compute[74337]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661 (non-flash)
Oct 23 21:36:45 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:36:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-89df2314-cb98-4794-bbcc-6690d53a7ceb tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496 (non-flash)
Oct 23 21:36:45 user nova-compute[74337]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d948adf-16c8-4098-aec1-e616613d545c (non-flash)
Oct 23 21:36:45 user nova-compute[74337]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d827c0c9-ec2a-45ec-927e-41fad52ffdb0 (non-flash)
Oct 23 21:36:45 user nova-compute[74337]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)
Oct 23 21:36:45 user nova-compute[74337]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b (non-flash)
Oct 23 21:36:45 user nova-compute[74337]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 (non-flash)
Oct 23 21:36:45 user nova-compute[74337]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a (non-flash)
Oct 23 21:36:45 user nova-compute[74337]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661 (non-flash)
Oct 23 21:36:45 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:36:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37bd5655-eaa0-4702-882b-73a73d1ba948 -p 172.16.0.220:3260 --login {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37bd5655-eaa0-4702-882b-73a73d1ba948 -p 172.16.0.220:3260 --login" returned: 0 in 0.092s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:45 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[42366544-e9cd-40da-8ead-39f57a1dfa61]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:37bd5655-eaa0-4702-882b-73a73d1ba948, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:37bd5655-eaa0-4702-882b-73a73d1ba948, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-89df2314-cb98-4794-bbcc-6690d53a7ceb tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:37bd5655-eaa0-4702-882b-73a73d1ba948, portal: 172.16.0.220,3260]
Oct 23 21:36:45 user nova-compute[74337]: Login to [iface: default, target: iqn.2010-10.org.openstack:37bd5655-eaa0-4702-882b-73a73d1ba948, portal: 172.16.0.220,3260] successful.
Oct 23 21:36:45 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:36:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37bd5655-eaa0-4702-882b-73a73d1ba948 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37bd5655-eaa0-4702-882b-73a73d1ba948 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:45 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a432d6b-c4e6-4520-a5af-8e6fea2fb501]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-89df2314-cb98-4794-bbcc-6690d53a7ceb tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:36:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:45 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae1a64d5-dcea-4f4b-a818-5402308fc2f1]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d948adf-16c8-4098-aec1-e616613d545c (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d827c0c9-ec2a-45ec-927e-41fad52ffdb0 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37bd5655-eaa0-4702-882b-73a73d1ba948 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-89df2314-cb98-4794-bbcc-6690d53a7ceb tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496 (non-flash)
Oct 23 21:36:45 user nova-compute[74337]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d948adf-16c8-4098-aec1-e616613d545c (non-flash)
Oct 23 21:36:45 user nova-compute[74337]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d827c0c9-ec2a-45ec-927e-41fad52ffdb0 (non-flash)
Oct 23 21:36:45 user nova-compute[74337]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37bd5655-eaa0-4702-882b-73a73d1ba948 (non-flash)
Oct 23 21:36:45 user nova-compute[74337]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)
Oct 23 21:36:45 user nova-compute[74337]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b (non-flash)
Oct 23 21:36:45 user nova-compute[74337]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 (non-flash)
Oct 23 21:36:45 user nova-compute[74337]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a (non-flash)
Oct 23 21:36:45 user nova-compute[74337]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661 (non-flash)
Oct 23 21:36:45 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:36:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-89df2314-cb98-4794-bbcc-6690d53a7ceb tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496 (non-flash)
Oct 23 21:36:45 user nova-compute[74337]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d948adf-16c8-4098-aec1-e616613d545c (non-flash)
Oct 23 21:36:45 user nova-compute[74337]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d827c0c9-ec2a-45ec-927e-41fad52ffdb0 (non-flash)
Oct 23 21:36:45 user nova-compute[74337]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37bd5655-eaa0-4702-882b-73a73d1ba948 (non-flash)
Oct 23 21:36:45 user nova-compute[74337]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)
Oct 23 21:36:45 user nova-compute[74337]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b (non-flash)
Oct 23 21:36:45 user nova-compute[74337]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 (non-flash)
Oct 23 21:36:45 user nova-compute[74337]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a (non-flash)
Oct 23 21:36:45 user nova-compute[74337]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661 (non-flash)
Oct 23 21:36:45 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:36:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-89df2314-cb98-4794-bbcc-6690d53a7ceb tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37bd5655-eaa0-4702-882b-73a73d1ba948" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.344s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:36:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-89df2314-cb98-4794-bbcc-6690d53a7ceb tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Connected to 172.16.0.220:3260 {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 21:36:45 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-89df2314-cb98-4794-bbcc-6690d53a7ceb tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] HCTL ('40', '-', '-', 0) found on session 14 with lun 0 {{(pid=74337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 21:36:45 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-89df2314-cb98-4794-bbcc-6690d53a7ceb tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=74337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 21:36:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.016s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:45 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[f966f271-cafc-48df-83ff-3a821c835f45]: (4, ('- - 0', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:45 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-89df2314-cb98-4794-bbcc-6690d53a7ceb tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Searching for a device in session 14 and hctl ['40', '*', '*', 0] yield: None {{(pid=74337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 21:36:45 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-4e356b53-325c-430d-a2e8-027becc1feec tempest-VolumesAssistedSnapshotsTest-1195398017 tempest-VolumesAssistedSnapshotsTest-1195398017-project-admin] No BDM found with device name vda, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 21:36:45 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-4e356b53-325c-430d-a2e8-027becc1feec tempest-VolumesAssistedSnapshotsTest-1195398017 tempest-VolumesAssistedSnapshotsTest-1195398017-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 21:36:45 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-4e356b53-325c-430d-a2e8-027becc1feec tempest-VolumesAssistedSnapshotsTest-1195398017 tempest-VolumesAssistedSnapshotsTest-1195398017-project-admin] No VIF found with MAC fa:16:3e:9f:d4:56, not building metadata {{(pid=74337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 21:36:45 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4e356b53-325c-430d-a2e8-027becc1feec tempest-VolumesAssistedSnapshotsTest-1195398017 tempest-VolumesAssistedSnapshotsTest-1195398017-project-admin] Lock "a4bf4723-1e3c-42f1-a422-9d9263b67e3d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 68.668s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:36:46 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-cb4743e3-5252-4d80-8682-ad43f4bb5467 tempest-VolumesAssistedSnapshotsTest-183441574 tempest-VolumesAssistedSnapshotsTest-183441574-project] [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d] volume_snapshot_create: create_info: {'snapshot_id': '8fa1ec55-7aff-4d33-9553-94a3f2adb748', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=74337) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Oct 23 21:36:46 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-cb4743e3-5252-4d80-8682-ad43f4bb5467 tempest-VolumesAssistedSnapshotsTest-183441574 tempest-VolumesAssistedSnapshotsTest-183441574-project] [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d] snap xml: <domainsnapshot>
Oct 23 21:36:46 user nova-compute[74337]:   <disks>
Oct 23 21:36:46 user nova-compute[74337]:     <disk name="/dev/sdf" snapshot="external" type="file">
Oct 23 21:36:46 user nova-compute[74337]:       <source file="/dev/new_file"/>
Oct 23 21:36:46 user nova-compute[74337]:     </disk>
Oct 23 21:36:46 user nova-compute[74337]:     <disk name="vda" snapshot="no"/>
Oct 23 21:36:46 user nova-compute[74337]:   </disks>
Oct 23 21:36:46 user nova-compute[74337]: </domainsnapshot>
Oct 23 21:36:46 user nova-compute[74337]:  {{(pid=74337) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Oct 23 21:36:46 user nova-compute[74337]: DEBUG nova.objects.instance [None req-cb4743e3-5252-4d80-8682-ad43f4bb5467 tempest-VolumesAssistedSnapshotsTest-183441574 tempest-VolumesAssistedSnapshotsTest-183441574-project] Lazy-loading 'system_metadata' on Instance uuid a4bf4723-1e3c-42f1-a422-9d9263b67e3d {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:36:46 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-cb4743e3-5252-4d80-8682-ad43f4bb5467 tempest-VolumesAssistedSnapshotsTest-183441574 tempest-VolumesAssistedSnapshotsTest-183441574-project] [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver [None req-cb4743e3-5252-4d80-8682-ad43f4bb5467 tempest-VolumesAssistedSnapshotsTest-183441574 tempest-VolumesAssistedSnapshotsTest-183441574-project] [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d] Traceback (most recent call last):
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d]     rv = execute(f, *args, **kwargs)
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d]     six.reraise(c, e, tb)
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d]     raise value
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d]     rv = meth(*args, **kwargs)
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d] 
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver [None req-cb4743e3-5252-4d80-8682-ad43f4bb5467 tempest-VolumesAssistedSnapshotsTest-183441574 tempest-VolumesAssistedSnapshotsTest-183441574-project] [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d] Traceback (most recent call last):
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d]     self._volume_snapshot_create(context, instance, guest,
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d]     rv = execute(f, *args, **kwargs)
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d]     six.reraise(c, e, tb)
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d]     raise value
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d]     rv = meth(*args, **kwargs)
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d] 
Oct 23 21:36:46 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-71609a27-2847-4eee-9e70-ef66c31f3e8d tempest-VolumesAssistedSnapshotsTest-183441574 tempest-VolumesAssistedSnapshotsTest-183441574-project] [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d] volume_snapshot_delete: delete_info: {'volume_id': 'd827c0c9-ec2a-45ec-927e-41fad52ffdb0'} {{(pid=74337) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver [None req-71609a27-2847-4eee-9e70-ef66c31f3e8d tempest-VolumesAssistedSnapshotsTest-183441574 tempest-VolumesAssistedSnapshotsTest-183441574-project] [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d] Traceback (most recent call last):
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d]     self._volume_snapshot_delete(context, instance, volume_id,
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d]     if delete_info['type'] != 'qcow2':
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d] KeyError: 'type'
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d] 
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver [None req-cb4743e3-5252-4d80-8682-ad43f4bb5467 tempest-VolumesAssistedSnapshotsTest-183441574 tempest-VolumesAssistedSnapshotsTest-183441574-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 8fa1ec55-7aff-4d33-9553-94a3f2adb748 could not be found.
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver     raise value
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver 
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver 
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 8fa1ec55-7aff-4d33-9553-94a3f2adb748 could not be found. (HTTP 404) (Request-ID: req-b227886b-0665-40cf-a65a-0b9a76e70398)
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver 
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver 
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 8fa1ec55-7aff-4d33-9553-94a3f2adb748 could not be found.
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver 
Oct 23 21:36:46 user nova-compute[74337]: ERROR oslo_messaging.rpc.server [None req-cb4743e3-5252-4d80-8682-ad43f4bb5467 tempest-VolumesAssistedSnapshotsTest-183441574 tempest-VolumesAssistedSnapshotsTest-183441574-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 23 21:36:46 user nova-compute[74337]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 23 21:36:46 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 23 21:36:46 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 23 21:36:46 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 23 21:36:46 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 23 21:36:46 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 23 21:36:46 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 23 21:36:46 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Oct 23 21:36:46 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Oct 23 21:36:46 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 23 21:36:46 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 23 21:36:46 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 23 21:36:46 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 23 21:36:46 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 23 21:36:46 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 23 21:36:46 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 23 21:36:46 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 23 21:36:46 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4504, in volume_snapshot_create
Oct 23 21:36:46 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Oct 23 21:36:46 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Oct 23 21:36:46 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 23 21:36:46 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 23 21:36:46 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 23 21:36:46 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 23 21:36:46 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 23 21:36:46 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 23 21:36:46 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Oct 23 21:36:46 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 23 21:36:46 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 23 21:36:46 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 23 21:36:46 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 23 21:36:46 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 23 21:36:46 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 23 21:36:46 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 23 21:36:46 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Oct 23 21:36:46 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 23 21:36:46 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Oct 23 21:36:46 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 23 21:36:46 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     raise value
Oct 23 21:36:46 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 23 21:36:46 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Oct 23 21:36:46 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 23 21:36:46 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 23 21:36:46 user nova-compute[74337]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 23 21:36:46 user nova-compute[74337]: ERROR oslo_messaging.rpc.server 
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver [None req-71609a27-2847-4eee-9e70-ef66c31f3e8d tempest-VolumesAssistedSnapshotsTest-183441574 tempest-VolumesAssistedSnapshotsTest-183441574-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver 
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver 
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-2e370109-ab7f-4872-bf5b-c9433aee1a02)
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver 
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver 
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Oct 23 21:36:46 user nova-compute[74337]: ERROR nova.virt.libvirt.driver 
Oct 23 21:36:46 user nova-compute[74337]: ERROR oslo_messaging.rpc.server [None req-71609a27-2847-4eee-9e70-ef66c31f3e8d tempest-VolumesAssistedSnapshotsTest-183441574 tempest-VolumesAssistedSnapshotsTest-183441574-project] Exception during message handling: KeyError: 'type'
Oct 23 21:36:46 user nova-compute[74337]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 23 21:36:46 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 23 21:36:46 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 23 21:36:46 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 23 21:36:46 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 23 21:36:46 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 23 21:36:46 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 23 21:36:46 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Oct 23 21:36:46 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Oct 23 21:36:46 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 23 21:36:46 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 23 21:36:46 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 23 21:36:46 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 23 21:36:46 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 23 21:36:46 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 23 21:36:46 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 23 21:36:46 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 23 21:36:46 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4516, in volume_snapshot_delete
Oct 23 21:36:46 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Oct 23 21:36:46 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Oct 23 21:36:46 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 23 21:36:46 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 23 21:36:46 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 23 21:36:46 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 23 21:36:46 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 23 21:36:46 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 23 21:36:46 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Oct 23 21:36:46 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 23 21:36:46 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Oct 23 21:36:46 user nova-compute[74337]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Oct 23 21:36:46 user nova-compute[74337]: ERROR oslo_messaging.rpc.server 
Oct 23 21:36:46 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-89df2314-cb98-4794-bbcc-6690d53a7ceb tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Searching for a device in session 14 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=74337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 21:36:46 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-89df2314-cb98-4794-bbcc-6690d53a7ceb tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:37bd5655-eaa0-4702-882b-73a73d1ba948', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ousQMLEd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 21:36:46 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-89df2314-cb98-4794-bbcc-6690d53a7ceb tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.376s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:36:46 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-89df2314-cb98-4794-bbcc-6690d53a7ceb tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] <== connect_volume: return (2668ms) {'type': 'block', 'scsi_wwn': '23939373637383937', 'path': '/dev/sdi'} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:36:46 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89df2314-cb98-4794-bbcc-6690d53a7ceb tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] [instance: ff1c790c-2458-438e-95c7-7e1412fe05fc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23939373637383937', 'path': '/dev/sdi'} {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 21:36:46 user nova-compute[74337]: DEBUG nova.objects.instance [None req-89df2314-cb98-4794-bbcc-6690d53a7ceb tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Lazy-loading 'flavor' on Instance uuid ff1c790c-2458-438e-95c7-7e1412fe05fc {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:36:46 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-89df2314-cb98-4794-bbcc-6690d53a7ceb tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 21:36:46 user nova-compute[74337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 21:36:46 user nova-compute[74337]:   <source dev="/dev/sdi"/>
Oct 23 21:36:46 user nova-compute[74337]:   <target dev="sdc" bus="scsi"/>
Oct 23 21:36:46 user nova-compute[74337]:   <serial>37bd5655-eaa0-4702-882b-73a73d1ba948</serial>
Oct 23 21:36:46 user nova-compute[74337]:   <address type="drive" controller="0" unit="2"/>
Oct 23 21:36:46 user nova-compute[74337]: </disk>
Oct 23 21:36:46 user nova-compute[74337]:  {{(pid=74337) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 21:36:46 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-f6dfa12c-47ce-4af4-bbc0-ed5683d04952 tempest-VolumesAssistedSnapshotsTest-1195398017 tempest-VolumesAssistedSnapshotsTest-1195398017-project-admin] Acquiring lock "a4bf4723-1e3c-42f1-a422-9d9263b67e3d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:36:46 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-f6dfa12c-47ce-4af4-bbc0-ed5683d04952 tempest-VolumesAssistedSnapshotsTest-1195398017 tempest-VolumesAssistedSnapshotsTest-1195398017-project-admin] Lock "a4bf4723-1e3c-42f1-a422-9d9263b67e3d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:36:46 user nova-compute[74337]: INFO nova.compute.manager [None req-f6dfa12c-47ce-4af4-bbc0-ed5683d04952 tempest-VolumesAssistedSnapshotsTest-1195398017 tempest-VolumesAssistedSnapshotsTest-1195398017-project-admin] [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d] Detaching volume d827c0c9-ec2a-45ec-927e-41fad52ffdb0
Oct 23 21:36:46 user nova-compute[74337]: INFO nova.virt.block_device [None req-f6dfa12c-47ce-4af4-bbc0-ed5683d04952 tempest-VolumesAssistedSnapshotsTest-1195398017 tempest-VolumesAssistedSnapshotsTest-1195398017-project-admin] [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d] Attempting to driver detach volume d827c0c9-ec2a-45ec-927e-41fad52ffdb0 from mountpoint /dev/vdb
Oct 23 21:36:46 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-f6dfa12c-47ce-4af4-bbc0-ed5683d04952 tempest-VolumesAssistedSnapshotsTest-1195398017 tempest-VolumesAssistedSnapshotsTest-1195398017-project-admin] Attempting to detach device vdb from instance a4bf4723-1e3c-42f1-a422-9d9263b67e3d from the persistent domain config. {{(pid=74337) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 21:36:46 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-f6dfa12c-47ce-4af4-bbc0-ed5683d04952 tempest-VolumesAssistedSnapshotsTest-1195398017 tempest-VolumesAssistedSnapshotsTest-1195398017-project-admin] detach device xml: <disk type="block" device="disk">
Oct 23 21:36:46 user nova-compute[74337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 21:36:46 user nova-compute[74337]:   <source dev="/dev/sdf"/>
Oct 23 21:36:46 user nova-compute[74337]:   <target dev="vdb" bus="virtio"/>
Oct 23 21:36:46 user nova-compute[74337]:   <serial>d827c0c9-ec2a-45ec-927e-41fad52ffdb0</serial>
Oct 23 21:36:46 user nova-compute[74337]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 21:36:46 user nova-compute[74337]: </disk>
Oct 23 21:36:46 user nova-compute[74337]:  {{(pid=74337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 21:36:46 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-f6dfa12c-47ce-4af4-bbc0-ed5683d04952 tempest-VolumesAssistedSnapshotsTest-1195398017 tempest-VolumesAssistedSnapshotsTest-1195398017-project-admin] Successfully detached device vdb from instance a4bf4723-1e3c-42f1-a422-9d9263b67e3d from the persistent domain config.
Oct 23 21:36:46 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-f6dfa12c-47ce-4af4-bbc0-ed5683d04952 tempest-VolumesAssistedSnapshotsTest-1195398017 tempest-VolumesAssistedSnapshotsTest-1195398017-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a4bf4723-1e3c-42f1-a422-9d9263b67e3d from the live domain config. {{(pid=74337) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 21:36:46 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-f6dfa12c-47ce-4af4-bbc0-ed5683d04952 tempest-VolumesAssistedSnapshotsTest-1195398017 tempest-VolumesAssistedSnapshotsTest-1195398017-project-admin] detach device xml: <disk type="block" device="disk">
Oct 23 21:36:46 user nova-compute[74337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 21:36:46 user nova-compute[74337]:   <source dev="/dev/sdf"/>
Oct 23 21:36:46 user nova-compute[74337]:   <target dev="vdb" bus="virtio"/>
Oct 23 21:36:46 user nova-compute[74337]:   <serial>d827c0c9-ec2a-45ec-927e-41fad52ffdb0</serial>
Oct 23 21:36:46 user nova-compute[74337]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 21:36:46 user nova-compute[74337]: </disk>
Oct 23 21:36:46 user nova-compute[74337]:  {{(pid=74337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 21:36:46 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-89df2314-cb98-4794-bbcc-6690d53a7ceb tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] No BDM found with device name sda, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 21:36:46 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-89df2314-cb98-4794-bbcc-6690d53a7ceb tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 21:36:46 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-89df2314-cb98-4794-bbcc-6690d53a7ceb tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] No BDM found with device name sdc, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 21:36:46 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-89df2314-cb98-4794-bbcc-6690d53a7ceb tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] No VIF found with MAC fa:16:3e:0c:4d:a8, not building metadata {{(pid=74337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 21:36:47 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-89df2314-cb98-4794-bbcc-6690d53a7ceb tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Lock "ff1c790c-2458-438e-95c7-7e1412fe05fc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 44.528s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:36:47 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-f6dfa12c-47ce-4af4-bbc0-ed5683d04952 tempest-VolumesAssistedSnapshotsTest-1195398017 tempest-VolumesAssistedSnapshotsTest-1195398017-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a4bf4723-1e3c-42f1-a422-9d9263b67e3d {{(pid=74337) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 21:36:47 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-742ef6ad-a389-447b-b3ec-d54a27d28ba9 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Acquiring lock "00f757cf-e5dd-476f-81c6-670ed2bf6938" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:36:47 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-742ef6ad-a389-447b-b3ec-d54a27d28ba9 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Lock "00f757cf-e5dd-476f-81c6-670ed2bf6938" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:36:47 user nova-compute[74337]: DEBUG nova.compute.manager [None req-742ef6ad-a389-447b-b3ec-d54a27d28ba9 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938] Starting instance... {{(pid=74337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 21:36:47 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-742ef6ad-a389-447b-b3ec-d54a27d28ba9 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:36:47 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-742ef6ad-a389-447b-b3ec-d54a27d28ba9 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:36:47 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-742ef6ad-a389-447b-b3ec-d54a27d28ba9 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 21:36:47 user nova-compute[74337]: INFO nova.compute.claims [None req-742ef6ad-a389-447b-b3ec-d54a27d28ba9 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938] Claim successful on node user
Oct 23 21:36:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:48 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-742ef6ad-a389-447b-b3ec-d54a27d28ba9 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:36:48 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-742ef6ad-a389-447b-b3ec-d54a27d28ba9 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:36:48 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-ff15c914-d6ce-4aa3-b555-f2e10f9364f6 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Acquiring lock "ff1c790c-2458-438e-95c7-7e1412fe05fc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:36:48 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-ff15c914-d6ce-4aa3-b555-f2e10f9364f6 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Lock "ff1c790c-2458-438e-95c7-7e1412fe05fc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:36:48 user nova-compute[74337]: INFO nova.compute.manager [None req-ff15c914-d6ce-4aa3-b555-f2e10f9364f6 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] [instance: ff1c790c-2458-438e-95c7-7e1412fe05fc] Detaching volume 37bd5655-eaa0-4702-882b-73a73d1ba948
Oct 23 21:36:48 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-742ef6ad-a389-447b-b3ec-d54a27d28ba9 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.462s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:36:48 user nova-compute[74337]: DEBUG nova.compute.manager [None req-742ef6ad-a389-447b-b3ec-d54a27d28ba9 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938] Start building networks asynchronously for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 21:36:48 user nova-compute[74337]: INFO nova.virt.block_device [None req-ff15c914-d6ce-4aa3-b555-f2e10f9364f6 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] [instance: ff1c790c-2458-438e-95c7-7e1412fe05fc] Attempting to driver detach volume 37bd5655-eaa0-4702-882b-73a73d1ba948 from mountpoint /dev/sdc
Oct 23 21:36:48 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-ff15c914-d6ce-4aa3-b555-f2e10f9364f6 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Attempting to detach device sdc from instance ff1c790c-2458-438e-95c7-7e1412fe05fc from the persistent domain config. {{(pid=74337) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 21:36:48 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-ff15c914-d6ce-4aa3-b555-f2e10f9364f6 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 21:36:48 user nova-compute[74337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 21:36:48 user nova-compute[74337]:   <source dev="/dev/sdi"/>
Oct 23 21:36:48 user nova-compute[74337]:   <target dev="sdc" bus="scsi"/>
Oct 23 21:36:48 user nova-compute[74337]:   <serial>37bd5655-eaa0-4702-882b-73a73d1ba948</serial>
Oct 23 21:36:48 user nova-compute[74337]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Oct 23 21:36:48 user nova-compute[74337]: </disk>
Oct 23 21:36:48 user nova-compute[74337]:  {{(pid=74337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 21:36:48 user nova-compute[74337]: DEBUG nova.compute.manager [None req-742ef6ad-a389-447b-b3ec-d54a27d28ba9 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938] Allocating IP information in the background. {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 21:36:48 user nova-compute[74337]: DEBUG nova.network.neutron [None req-742ef6ad-a389-447b-b3ec-d54a27d28ba9 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938] allocate_for_instance() {{(pid=74337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 21:36:48 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-ff15c914-d6ce-4aa3-b555-f2e10f9364f6 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Successfully detached device sdc from instance ff1c790c-2458-438e-95c7-7e1412fe05fc from the persistent domain config.
Oct 23 21:36:48 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-ff15c914-d6ce-4aa3-b555-f2e10f9364f6 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance ff1c790c-2458-438e-95c7-7e1412fe05fc from the live domain config. {{(pid=74337) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 21:36:48 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-ff15c914-d6ce-4aa3-b555-f2e10f9364f6 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 21:36:48 user nova-compute[74337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 21:36:48 user nova-compute[74337]:   <source dev="/dev/sdi"/>
Oct 23 21:36:48 user nova-compute[74337]:   <target dev="sdc" bus="scsi"/>
Oct 23 21:36:48 user nova-compute[74337]:   <serial>37bd5655-eaa0-4702-882b-73a73d1ba948</serial>
Oct 23 21:36:48 user nova-compute[74337]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Oct 23 21:36:48 user nova-compute[74337]: </disk>
Oct 23 21:36:48 user nova-compute[74337]:  {{(pid=74337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 21:36:48 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-742ef6ad-a389-447b-b3ec-d54a27d28ba9 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 21:36:48 user nova-compute[74337]: DEBUG nova.compute.manager [None req-742ef6ad-a389-447b-b3ec-d54a27d28ba9 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938] Start building block device mappings for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 21:36:48 user nova-compute[74337]: DEBUG nova.policy [None req-742ef6ad-a389-447b-b3ec-d54a27d28ba9 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6ddd5c407fbe440e85111213c4c2dd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd8afde978624cf8a2356e8ce8b4d3f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74337) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 21:36:48 user nova-compute[74337]: DEBUG nova.compute.manager [None req-742ef6ad-a389-447b-b3ec-d54a27d28ba9 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938] Start spawning the instance on the hypervisor. {{(pid=74337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 21:36:48 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-742ef6ad-a389-447b-b3ec-d54a27d28ba9 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938] Creating instance directory {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 21:36:48 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-742ef6ad-a389-447b-b3ec-d54a27d28ba9 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938] Creating image(s)
Oct 23 21:36:48 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-742ef6ad-a389-447b-b3ec-d54a27d28ba9 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Acquiring lock "/opt/stack/data/nova/instances/00f757cf-e5dd-476f-81c6-670ed2bf6938/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:36:48 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-742ef6ad-a389-447b-b3ec-d54a27d28ba9 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Lock "/opt/stack/data/nova/instances/00f757cf-e5dd-476f-81c6-670ed2bf6938/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:36:48 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-742ef6ad-a389-447b-b3ec-d54a27d28ba9 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Lock "/opt/stack/data/nova/instances/00f757cf-e5dd-476f-81c6-670ed2bf6938/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:36:48 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-742ef6ad-a389-447b-b3ec-d54a27d28ba9 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:48 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-742ef6ad-a389-447b-b3ec-d54a27d28ba9 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.190s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:48 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-742ef6ad-a389-447b-b3ec-d54a27d28ba9 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Acquiring lock "fc7b140751b8c385de81623e40fb09ce09374ab7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:36:48 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-742ef6ad-a389-447b-b3ec-d54a27d28ba9 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Lock "fc7b140751b8c385de81623e40fb09ce09374ab7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:36:48 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-742ef6ad-a389-447b-b3ec-d54a27d28ba9 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:48 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-ff15c914-d6ce-4aa3-b555-f2e10f9364f6 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance ff1c790c-2458-438e-95c7-7e1412fe05fc {{(pid=74337) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 21:36:49 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-742ef6ad-a389-447b-b3ec-d54a27d28ba9 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.178s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:49 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-742ef6ad-a389-447b-b3ec-d54a27d28ba9 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7,backing_fmt=raw /opt/stack/data/nova/instances/00f757cf-e5dd-476f-81c6-670ed2bf6938/disk 1073741824 {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:49 user nova-compute[74337]: DEBUG nova.network.neutron [None req-742ef6ad-a389-447b-b3ec-d54a27d28ba9 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938] Successfully created port: 9034e8d2-9a0e-42b6-9a38-49877881f0d3 {{(pid=74337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 21:36:49 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-742ef6ad-a389-447b-b3ec-d54a27d28ba9 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7,backing_fmt=raw /opt/stack/data/nova/instances/00f757cf-e5dd-476f-81c6-670ed2bf6938/disk 1073741824" returned: 0 in 0.058s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:49 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-742ef6ad-a389-447b-b3ec-d54a27d28ba9 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Lock "fc7b140751b8c385de81623e40fb09ce09374ab7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:36:49 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-742ef6ad-a389-447b-b3ec-d54a27d28ba9 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:49 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-742ef6ad-a389-447b-b3ec-d54a27d28ba9 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.187s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:49 user nova-compute[74337]: DEBUG nova.virt.disk.api [None req-742ef6ad-a389-447b-b3ec-d54a27d28ba9 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Checking if we can resize image /opt/stack/data/nova/instances/00f757cf-e5dd-476f-81c6-670ed2bf6938/disk. size=1073741824 {{(pid=74337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 21:36:49 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-742ef6ad-a389-447b-b3ec-d54a27d28ba9 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00f757cf-e5dd-476f-81c6-670ed2bf6938/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:49 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-742ef6ad-a389-447b-b3ec-d54a27d28ba9 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00f757cf-e5dd-476f-81c6-670ed2bf6938/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:49 user nova-compute[74337]: DEBUG nova.virt.disk.api [None req-742ef6ad-a389-447b-b3ec-d54a27d28ba9 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Cannot resize image /opt/stack/data/nova/instances/00f757cf-e5dd-476f-81c6-670ed2bf6938/disk to a smaller size. {{(pid=74337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 21:36:49 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-742ef6ad-a389-447b-b3ec-d54a27d28ba9 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938] Created local disks {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 21:36:49 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-742ef6ad-a389-447b-b3ec-d54a27d28ba9 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938] Ensure instance console log exists: /opt/stack/data/nova/instances/00f757cf-e5dd-476f-81c6-670ed2bf6938/console.log {{(pid=74337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 21:36:49 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-742ef6ad-a389-447b-b3ec-d54a27d28ba9 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:36:49 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-742ef6ad-a389-447b-b3ec-d54a27d28ba9 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:36:49 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-742ef6ad-a389-447b-b3ec-d54a27d28ba9 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:36:49 user nova-compute[74337]: DEBUG nova.network.neutron [None req-742ef6ad-a389-447b-b3ec-d54a27d28ba9 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938] Successfully updated port: 9034e8d2-9a0e-42b6-9a38-49877881f0d3 {{(pid=74337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 21:36:49 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-742ef6ad-a389-447b-b3ec-d54a27d28ba9 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Acquiring lock "refresh_cache-00f757cf-e5dd-476f-81c6-670ed2bf6938" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:36:49 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-742ef6ad-a389-447b-b3ec-d54a27d28ba9 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Acquired lock "refresh_cache-00f757cf-e5dd-476f-81c6-670ed2bf6938" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:36:49 user nova-compute[74337]: DEBUG nova.network.neutron [None req-742ef6ad-a389-447b-b3ec-d54a27d28ba9 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938] Building network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 21:36:49 user nova-compute[74337]: DEBUG nova.compute.manager [req-da54e95c-7daa-4d94-9888-43edb16313b4 req-4a98294c-e725-4bce-8224-daf0f1b353b9 service nova] [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938] Received event network-changed-9034e8d2-9a0e-42b6-9a38-49877881f0d3 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:36:49 user nova-compute[74337]: DEBUG nova.compute.manager [req-da54e95c-7daa-4d94-9888-43edb16313b4 req-4a98294c-e725-4bce-8224-daf0f1b353b9 service nova] [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938] Refreshing instance network info cache due to event network-changed-9034e8d2-9a0e-42b6-9a38-49877881f0d3. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 21:36:49 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-da54e95c-7daa-4d94-9888-43edb16313b4 req-4a98294c-e725-4bce-8224-daf0f1b353b9 service nova] Acquiring lock "refresh_cache-00f757cf-e5dd-476f-81c6-670ed2bf6938" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:36:49 user nova-compute[74337]: DEBUG nova.network.neutron [None req-742ef6ad-a389-447b-b3ec-d54a27d28ba9 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938] Instance cache missing network info. {{(pid=74337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 21:36:50 user nova-compute[74337]: DEBUG nova.network.neutron [None req-742ef6ad-a389-447b-b3ec-d54a27d28ba9 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938] Updating instance_info_cache with network_info: [{"id": "9034e8d2-9a0e-42b6-9a38-49877881f0d3", "address": "fa:16:3e:43:34:d0", "network": {"id": "0feb8c56-c17f-47d0-9796-91d4bd20e81d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1399506675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd8afde978624cf8a2356e8ce8b4d3f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9034e8d2-9a", "ovs_interfaceid": "9034e8d2-9a0e-42b6-9a38-49877881f0d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:36:50 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-742ef6ad-a389-447b-b3ec-d54a27d28ba9 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Releasing lock "refresh_cache-00f757cf-e5dd-476f-81c6-670ed2bf6938" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:36:50 user nova-compute[74337]: DEBUG nova.compute.manager [None req-742ef6ad-a389-447b-b3ec-d54a27d28ba9 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938] Instance network_info: |[{"id": "9034e8d2-9a0e-42b6-9a38-49877881f0d3", "address": "fa:16:3e:43:34:d0", "network": {"id": "0feb8c56-c17f-47d0-9796-91d4bd20e81d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1399506675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd8afde978624cf8a2356e8ce8b4d3f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9034e8d2-9a", "ovs_interfaceid": "9034e8d2-9a0e-42b6-9a38-49877881f0d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 21:36:50 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-da54e95c-7daa-4d94-9888-43edb16313b4 req-4a98294c-e725-4bce-8224-daf0f1b353b9 service nova] Acquired lock "refresh_cache-00f757cf-e5dd-476f-81c6-670ed2bf6938" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:36:50 user nova-compute[74337]: DEBUG nova.network.neutron [req-da54e95c-7daa-4d94-9888-43edb16313b4 req-4a98294c-e725-4bce-8224-daf0f1b353b9 service nova] [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938] Refreshing network info cache for port 9034e8d2-9a0e-42b6-9a38-49877881f0d3 {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 21:36:50 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-742ef6ad-a389-447b-b3ec-d54a27d28ba9 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938] Start _get_guest_xml network_info=[{"id": "9034e8d2-9a0e-42b6-9a38-49877881f0d3", "address": "fa:16:3e:43:34:d0", "network": {"id": "0feb8c56-c17f-47d0-9796-91d4bd20e81d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1399506675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd8afde978624cf8a2356e8ce8b4d3f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9034e8d2-9a", "ovs_interfaceid": "9034e8d2-9a0e-42b6-9a38-49877881f0d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T21:29:21Z,direct_url=<?>,disk_format='qcow2',id=d859d89d-998d-4109-b26a-0d6e28152932,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ff43462300764979a6cf688444336a56',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T21:29:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'image_id': 'd859d89d-998d-4109-b26a-0d6e28152932'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 21:36:50 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-742ef6ad-a389-447b-b3ec-d54a27d28ba9 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:36:50 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-742ef6ad-a389-447b-b3ec-d54a27d28ba9 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:36:50 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-742ef6ad-a389-447b-b3ec-d54a27d28ba9 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 21:36:50 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-742ef6ad-a389-447b-b3ec-d54a27d28ba9 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] CPU controller missing on host. {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 21:36:50 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-742ef6ad-a389-447b-b3ec-d54a27d28ba9 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 21:36:50 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-742ef6ad-a389-447b-b3ec-d54a27d28ba9 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] CPU controller found on host. {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 21:36:50 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-742ef6ad-a389-447b-b3ec-d54a27d28ba9 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 21:36:50 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-742ef6ad-a389-447b-b3ec-d54a27d28ba9 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T21:29:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T21:29:21Z,direct_url=<?>,disk_format='qcow2',id=d859d89d-998d-4109-b26a-0d6e28152932,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ff43462300764979a6cf688444336a56',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T21:29:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 21:36:50 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-742ef6ad-a389-447b-b3ec-d54a27d28ba9 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Flavor limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 21:36:50 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-742ef6ad-a389-447b-b3ec-d54a27d28ba9 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Image limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 21:36:50 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-742ef6ad-a389-447b-b3ec-d54a27d28ba9 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Flavor pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 21:36:50 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-742ef6ad-a389-447b-b3ec-d54a27d28ba9 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Image pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 21:36:50 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-742ef6ad-a389-447b-b3ec-d54a27d28ba9 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 21:36:50 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-742ef6ad-a389-447b-b3ec-d54a27d28ba9 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 21:36:50 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-742ef6ad-a389-447b-b3ec-d54a27d28ba9 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 21:36:50 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-742ef6ad-a389-447b-b3ec-d54a27d28ba9 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Got 1 possible topologies {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 21:36:50 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-742ef6ad-a389-447b-b3ec-d54a27d28ba9 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 21:36:50 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-742ef6ad-a389-447b-b3ec-d54a27d28ba9 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 21:36:50 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-742ef6ad-a389-447b-b3ec-d54a27d28ba9 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:36:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-333947415',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-333947415',id=12,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMRrEl7LEoNd8U+hfyJLPPNLjY7QCrquZZ9/0Pwg7nr+hXI91t4451IRFet8aERqxR96rboEIpSmotN9ndjRC9k4yeRPFf2e3MGh0dPoW6GW/TMDKJ4wkCSx2cWsJY9rWA==',key_name='tempest-keypair-1196853898',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dd8afde978624cf8a2356e8ce8b4d3f2',ramdisk_id='',reservation_id='r-cg9v0l0q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-338191707',owner_user_name='tempest-AttachVolumeShelveTestJSON-338191707-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:36:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ddd5c407fbe440e85111213c4c2dd46',uuid=00f757cf-e5dd-476f-81c6-670ed2bf6938,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9034e8d2-9a0e-42b6-9a38-49877881f0d3", "address": "fa:16:3e:43:34:d0", "network": {"id": "0feb8c56-c17f-47d0-9796-91d4bd20e81d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1399506675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd8afde978624cf8a2356e8ce8b4d3f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9034e8d2-9a", "ovs_interfaceid": "9034e8d2-9a0e-42b6-9a38-49877881f0d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 21:36:50 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-742ef6ad-a389-447b-b3ec-d54a27d28ba9 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Converting VIF {"id": "9034e8d2-9a0e-42b6-9a38-49877881f0d3", "address": "fa:16:3e:43:34:d0", "network": {"id": "0feb8c56-c17f-47d0-9796-91d4bd20e81d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1399506675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd8afde978624cf8a2356e8ce8b4d3f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9034e8d2-9a", "ovs_interfaceid": "9034e8d2-9a0e-42b6-9a38-49877881f0d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:36:50 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-742ef6ad-a389-447b-b3ec-d54a27d28ba9 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:34:d0,bridge_name='br-int',has_traffic_filtering=True,id=9034e8d2-9a0e-42b6-9a38-49877881f0d3,network=Network(0feb8c56-c17f-47d0-9796-91d4bd20e81d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9034e8d2-9a') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:36:50 user nova-compute[74337]: DEBUG nova.objects.instance [None req-742ef6ad-a389-447b-b3ec-d54a27d28ba9 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Lazy-loading 'pci_devices' on Instance uuid 00f757cf-e5dd-476f-81c6-670ed2bf6938 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:36:50 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-742ef6ad-a389-447b-b3ec-d54a27d28ba9 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938] End _get_guest_xml xml=<domain type="kvm">
Oct 23 21:36:50 user nova-compute[74337]:   <uuid>00f757cf-e5dd-476f-81c6-670ed2bf6938</uuid>
Oct 23 21:36:50 user nova-compute[74337]:   <name>instance-0000000c</name>
Oct 23 21:36:50 user nova-compute[74337]:   <memory>524288</memory>
Oct 23 21:36:50 user nova-compute[74337]:   <vcpu>1</vcpu>
Oct 23 21:36:50 user nova-compute[74337]:   <metadata>
Oct 23 21:36:50 user nova-compute[74337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 21:36:50 user nova-compute[74337]:       <nova:package version="0.0.0"/>
Oct 23 21:36:50 user nova-compute[74337]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-333947415</nova:name>
Oct 23 21:36:50 user nova-compute[74337]:       <nova:creationTime>2023-10-23 21:36:50</nova:creationTime>
Oct 23 21:36:50 user nova-compute[74337]:       <nova:flavor name="m1.tiny">
Oct 23 21:36:50 user nova-compute[74337]:         <nova:memory>512</nova:memory>
Oct 23 21:36:50 user nova-compute[74337]:         <nova:disk>1</nova:disk>
Oct 23 21:36:50 user nova-compute[74337]:         <nova:swap>0</nova:swap>
Oct 23 21:36:50 user nova-compute[74337]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 21:36:50 user nova-compute[74337]:         <nova:vcpus>1</nova:vcpus>
Oct 23 21:36:50 user nova-compute[74337]:       </nova:flavor>
Oct 23 21:36:50 user nova-compute[74337]:       <nova:owner>
Oct 23 21:36:50 user nova-compute[74337]:         <nova:user uuid="6ddd5c407fbe440e85111213c4c2dd46">tempest-AttachVolumeShelveTestJSON-338191707-project-member</nova:user>
Oct 23 21:36:50 user nova-compute[74337]:         <nova:project uuid="dd8afde978624cf8a2356e8ce8b4d3f2">tempest-AttachVolumeShelveTestJSON-338191707</nova:project>
Oct 23 21:36:50 user nova-compute[74337]:       </nova:owner>
Oct 23 21:36:50 user nova-compute[74337]:       <nova:root type="image" uuid="d859d89d-998d-4109-b26a-0d6e28152932"/>
Oct 23 21:36:50 user nova-compute[74337]:       <nova:ports>
Oct 23 21:36:50 user nova-compute[74337]:         <nova:port uuid="9034e8d2-9a0e-42b6-9a38-49877881f0d3">
Oct 23 21:36:50 user nova-compute[74337]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 23 21:36:50 user nova-compute[74337]:         </nova:port>
Oct 23 21:36:50 user nova-compute[74337]:       </nova:ports>
Oct 23 21:36:50 user nova-compute[74337]:     </nova:instance>
Oct 23 21:36:50 user nova-compute[74337]:   </metadata>
Oct 23 21:36:50 user nova-compute[74337]:   <sysinfo type="smbios">
Oct 23 21:36:50 user nova-compute[74337]:     <system>
Oct 23 21:36:50 user nova-compute[74337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 21:36:50 user nova-compute[74337]:       <entry name="product">OpenStack Nova</entry>
Oct 23 21:36:50 user nova-compute[74337]:       <entry name="version">0.0.0</entry>
Oct 23 21:36:50 user nova-compute[74337]:       <entry name="serial">00f757cf-e5dd-476f-81c6-670ed2bf6938</entry>
Oct 23 21:36:50 user nova-compute[74337]:       <entry name="uuid">00f757cf-e5dd-476f-81c6-670ed2bf6938</entry>
Oct 23 21:36:50 user nova-compute[74337]:       <entry name="family">Virtual Machine</entry>
Oct 23 21:36:50 user nova-compute[74337]:     </system>
Oct 23 21:36:50 user nova-compute[74337]:   </sysinfo>
Oct 23 21:36:50 user nova-compute[74337]:   <os>
Oct 23 21:36:50 user nova-compute[74337]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 21:36:50 user nova-compute[74337]:     <boot dev="hd"/>
Oct 23 21:36:50 user nova-compute[74337]:     <smbios mode="sysinfo"/>
Oct 23 21:36:50 user nova-compute[74337]:   </os>
Oct 23 21:36:50 user nova-compute[74337]:   <features>
Oct 23 21:36:50 user nova-compute[74337]:     <acpi/>
Oct 23 21:36:50 user nova-compute[74337]:     <apic/>
Oct 23 21:36:50 user nova-compute[74337]:     <vmcoreinfo/>
Oct 23 21:36:50 user nova-compute[74337]:   </features>
Oct 23 21:36:50 user nova-compute[74337]:   <clock offset="utc">
Oct 23 21:36:50 user nova-compute[74337]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 21:36:50 user nova-compute[74337]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 21:36:50 user nova-compute[74337]:     <timer name="hpet" present="no"/>
Oct 23 21:36:50 user nova-compute[74337]:   </clock>
Oct 23 21:36:50 user nova-compute[74337]:   <cpu mode="custom" match="exact">
Oct 23 21:36:50 user nova-compute[74337]:     <model>Nehalem</model>
Oct 23 21:36:50 user nova-compute[74337]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 21:36:50 user nova-compute[74337]:   </cpu>
Oct 23 21:36:50 user nova-compute[74337]:   <devices>
Oct 23 21:36:50 user nova-compute[74337]:     <disk type="file" device="disk">
Oct 23 21:36:50 user nova-compute[74337]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 21:36:50 user nova-compute[74337]:       <source file="/opt/stack/data/nova/instances/00f757cf-e5dd-476f-81c6-670ed2bf6938/disk"/>
Oct 23 21:36:50 user nova-compute[74337]:       <target dev="vda" bus="virtio"/>
Oct 23 21:36:50 user nova-compute[74337]:     </disk>
Oct 23 21:36:50 user nova-compute[74337]:     <interface type="ethernet">
Oct 23 21:36:50 user nova-compute[74337]:       <mac address="fa:16:3e:43:34:d0"/>
Oct 23 21:36:50 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:36:50 user nova-compute[74337]:       <mtu size="1442"/>
Oct 23 21:36:50 user nova-compute[74337]:       <target dev="tap9034e8d2-9a"/>
Oct 23 21:36:50 user nova-compute[74337]:     </interface>
Oct 23 21:36:50 user nova-compute[74337]:     <serial type="pty">
Oct 23 21:36:50 user nova-compute[74337]:       <log file="/opt/stack/data/nova/instances/00f757cf-e5dd-476f-81c6-670ed2bf6938/console.log" append="off"/>
Oct 23 21:36:50 user nova-compute[74337]:     </serial>
Oct 23 21:36:50 user nova-compute[74337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 21:36:50 user nova-compute[74337]:     <video>
Oct 23 21:36:50 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:36:50 user nova-compute[74337]:     </video>
Oct 23 21:36:50 user nova-compute[74337]:     <rng model="virtio">
Oct 23 21:36:50 user nova-compute[74337]:       <backend model="random">/dev/urandom</backend>
Oct 23 21:36:50 user nova-compute[74337]:     </rng>
Oct 23 21:36:50 user nova-compute[74337]:     <controller type="usb" index="0" model="none"/>
Oct 23 21:36:50 user nova-compute[74337]:     <memballoon model="virtio">
Oct 23 21:36:50 user nova-compute[74337]:       <stats period="10"/>
Oct 23 21:36:50 user nova-compute[74337]:     </memballoon>
Oct 23 21:36:50 user nova-compute[74337]:   </devices>
Oct 23 21:36:50 user nova-compute[74337]: </domain>
Oct 23 21:36:50 user nova-compute[74337]:  {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 21:36:50 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-742ef6ad-a389-447b-b3ec-d54a27d28ba9 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:36:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-333947415',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-333947415',id=12,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMRrEl7LEoNd8U+hfyJLPPNLjY7QCrquZZ9/0Pwg7nr+hXI91t4451IRFet8aERqxR96rboEIpSmotN9ndjRC9k4yeRPFf2e3MGh0dPoW6GW/TMDKJ4wkCSx2cWsJY9rWA==',key_name='tempest-keypair-1196853898',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dd8afde978624cf8a2356e8ce8b4d3f2',ramdisk_id='',reservation_id='r-cg9v0l0q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-338191707',owner_user_name='tempest-AttachVolumeShelveTestJSON-338191707-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:36:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ddd5c407fbe440e85111213c4c2dd46',uuid=00f757cf-e5dd-476f-81c6-670ed2bf6938,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9034e8d2-9a0e-42b6-9a38-49877881f0d3", "address": "fa:16:3e:43:34:d0", "network": {"id": "0feb8c56-c17f-47d0-9796-91d4bd20e81d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1399506675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd8afde978624cf8a2356e8ce8b4d3f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9034e8d2-9a", "ovs_interfaceid": "9034e8d2-9a0e-42b6-9a38-49877881f0d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 21:36:50 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-742ef6ad-a389-447b-b3ec-d54a27d28ba9 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Converting VIF {"id": "9034e8d2-9a0e-42b6-9a38-49877881f0d3", "address": "fa:16:3e:43:34:d0", "network": {"id": "0feb8c56-c17f-47d0-9796-91d4bd20e81d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1399506675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd8afde978624cf8a2356e8ce8b4d3f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9034e8d2-9a", "ovs_interfaceid": "9034e8d2-9a0e-42b6-9a38-49877881f0d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:36:50 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-742ef6ad-a389-447b-b3ec-d54a27d28ba9 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:34:d0,bridge_name='br-int',has_traffic_filtering=True,id=9034e8d2-9a0e-42b6-9a38-49877881f0d3,network=Network(0feb8c56-c17f-47d0-9796-91d4bd20e81d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9034e8d2-9a') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:36:50 user nova-compute[74337]: DEBUG os_vif [None req-742ef6ad-a389-447b-b3ec-d54a27d28ba9 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:34:d0,bridge_name='br-int',has_traffic_filtering=True,id=9034e8d2-9a0e-42b6-9a38-49877881f0d3,network=Network(0feb8c56-c17f-47d0-9796-91d4bd20e81d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9034e8d2-9a') {{(pid=74337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 21:36:50 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:50 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:36:50 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 21:36:50 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:50 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7d37cf1c-1704-5a50-9d84-82014974bffe', '_type': 'linux-noop'}}, row=False) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:36:50 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:50 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:36:50 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:50 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:50 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9034e8d2-9a, may_exist=True, interface_attrs={}) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:36:50 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9034e8d2-9a, col_values=(('qos', UUID('8d1b8db3-70de-4cb2-b32c-bbe2796d31ad')),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:36:50 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9034e8d2-9a, col_values=(('external_ids', {'iface-id': '9034e8d2-9a0e-42b6-9a38-49877881f0d3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:43:34:d0', 'vm-uuid': '00f757cf-e5dd-476f-81c6-670ed2bf6938'}),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:36:50 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:50 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:36:50 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:50 user nova-compute[74337]: INFO os_vif [None req-742ef6ad-a389-447b-b3ec-d54a27d28ba9 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:34:d0,bridge_name='br-int',has_traffic_filtering=True,id=9034e8d2-9a0e-42b6-9a38-49877881f0d3,network=Network(0feb8c56-c17f-47d0-9796-91d4bd20e81d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9034e8d2-9a')
Oct 23 21:36:50 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-742ef6ad-a389-447b-b3ec-d54a27d28ba9 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] No BDM found with device name vda, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 21:36:50 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-742ef6ad-a389-447b-b3ec-d54a27d28ba9 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] No VIF found with MAC fa:16:3e:43:34:d0, not building metadata {{(pid=74337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 21:36:50 user nova-compute[74337]: DEBUG nova.network.neutron [req-da54e95c-7daa-4d94-9888-43edb16313b4 req-4a98294c-e725-4bce-8224-daf0f1b353b9 service nova] [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938] Updated VIF entry in instance network info cache for port 9034e8d2-9a0e-42b6-9a38-49877881f0d3. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 21:36:50 user nova-compute[74337]: DEBUG nova.network.neutron [req-da54e95c-7daa-4d94-9888-43edb16313b4 req-4a98294c-e725-4bce-8224-daf0f1b353b9 service nova] [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938] Updating instance_info_cache with network_info: [{"id": "9034e8d2-9a0e-42b6-9a38-49877881f0d3", "address": "fa:16:3e:43:34:d0", "network": {"id": "0feb8c56-c17f-47d0-9796-91d4bd20e81d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1399506675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd8afde978624cf8a2356e8ce8b4d3f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9034e8d2-9a", "ovs_interfaceid": "9034e8d2-9a0e-42b6-9a38-49877881f0d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:36:50 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-da54e95c-7daa-4d94-9888-43edb16313b4 req-4a98294c-e725-4bce-8224-daf0f1b353b9 service nova] Releasing lock "refresh_cache-00f757cf-e5dd-476f-81c6-670ed2bf6938" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:36:51 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:51 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:51 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:51 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:51 user nova-compute[74337]: DEBUG nova.compute.manager [req-eb124929-1d48-40ff-8a0c-bb19585fe198 req-99853730-b04c-4bcd-a412-a26402e0d495 service nova] [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938] Received event network-vif-plugged-9034e8d2-9a0e-42b6-9a38-49877881f0d3 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:36:51 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-eb124929-1d48-40ff-8a0c-bb19585fe198 req-99853730-b04c-4bcd-a412-a26402e0d495 service nova] Acquiring lock "00f757cf-e5dd-476f-81c6-670ed2bf6938-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:36:51 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-eb124929-1d48-40ff-8a0c-bb19585fe198 req-99853730-b04c-4bcd-a412-a26402e0d495 service nova] Lock "00f757cf-e5dd-476f-81c6-670ed2bf6938-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:36:51 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-eb124929-1d48-40ff-8a0c-bb19585fe198 req-99853730-b04c-4bcd-a412-a26402e0d495 service nova] Lock "00f757cf-e5dd-476f-81c6-670ed2bf6938-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:36:51 user nova-compute[74337]: DEBUG nova.compute.manager [req-eb124929-1d48-40ff-8a0c-bb19585fe198 req-99853730-b04c-4bcd-a412-a26402e0d495 service nova] [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938] No waiting events found dispatching network-vif-plugged-9034e8d2-9a0e-42b6-9a38-49877881f0d3 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:36:51 user nova-compute[74337]: WARNING nova.compute.manager [req-eb124929-1d48-40ff-8a0c-bb19585fe198 req-99853730-b04c-4bcd-a412-a26402e0d495 service nova] [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938] Received unexpected event network-vif-plugged-9034e8d2-9a0e-42b6-9a38-49877881f0d3 for instance with vm_state building and task_state spawning.
Oct 23 21:36:52 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-adfdde1d-973f-408a-9f75-57c47592ed4a tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] Acquiring lock "cf6270ba-7a4e-40c4-b7fd-c62a44125c89" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:36:52 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-adfdde1d-973f-408a-9f75-57c47592ed4a tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] Lock "cf6270ba-7a4e-40c4-b7fd-c62a44125c89" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:36:52 user nova-compute[74337]: DEBUG nova.objects.instance [None req-adfdde1d-973f-408a-9f75-57c47592ed4a tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] Lazy-loading 'flavor' on Instance uuid cf6270ba-7a4e-40c4-b7fd-c62a44125c89 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:36:52 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-adfdde1d-973f-408a-9f75-57c47592ed4a tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] Lock "cf6270ba-7a4e-40c4-b7fd-c62a44125c89" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:36:52 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:52 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:52 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:52 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:52 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:52 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-adfdde1d-973f-408a-9f75-57c47592ed4a tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] Acquiring lock "cf6270ba-7a4e-40c4-b7fd-c62a44125c89" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:36:52 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-adfdde1d-973f-408a-9f75-57c47592ed4a tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] Lock "cf6270ba-7a4e-40c4-b7fd-c62a44125c89" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:36:52 user nova-compute[74337]: INFO nova.compute.manager [None req-adfdde1d-973f-408a-9f75-57c47592ed4a tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89] Attaching volume eb9f2e36-dc9f-4bc1-a362-c6298e206611 to /dev/vdb
Oct 23 21:36:52 user nova-compute[74337]: DEBUG os_brick.utils [None req-adfdde1d-973f-408a-9f75-57c47592ed4a tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:36:52 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:52 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:52 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3fddf11-e3a7-4def-b1c3-ec458c7690fd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f34011b66e40\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:52 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:52 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:52 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5a497cb-83ff-4411-9396-73bdbb467639]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:52 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:52 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:52 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[497913b3-74ac-4071-90a8-a979d5c1edce]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:52 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6b8a842-fedf-427a-9b1e-b6f85f32243f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:52 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-adfdde1d-973f-408a-9f75-57c47592ed4a tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] Running cmd (subprocess): nvme version {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:52 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-adfdde1d-973f-408a-9f75-57c47592ed4a tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] 'nvme version' failed. Not Retrying. {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 21:36:52 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-adfdde1d-973f-408a-9f75-57c47592ed4a tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] nvme not present on system {{(pid=74337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 21:36:52 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:52 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 21:36:52 user nova-compute[74337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 21:36:52 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[5744b62a-25b8-4ad0-824a-7eea1dd39ccd]: (4, '') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:52 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-adfdde1d-973f-408a-9f75-57c47592ed4a tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 21:36:52 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-adfdde1d-973f-408a-9f75-57c47592ed4a tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 21:36:52 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-adfdde1d-973f-408a-9f75-57c47592ed4a tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] LIGHTOS: no hostnqn found. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 21:36:52 user nova-compute[74337]: DEBUG os_brick.utils [None req-adfdde1d-973f-408a-9f75-57c47592ed4a tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f34011b66e40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:36:52 user nova-compute[74337]: DEBUG nova.virt.block_device [None req-adfdde1d-973f-408a-9f75-57c47592ed4a tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89] Updating existing volume attachment record: c6a57788-9fc1-499c-a48f-bd65ad534666 {{(pid=74337) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 21:36:52 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:53 user nova-compute[74337]: DEBUG nova.compute.manager [None req-742ef6ad-a389-447b-b3ec-d54a27d28ba9 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938] Instance event wait completed in 0 seconds for  {{(pid=74337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 21:36:53 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-742ef6ad-a389-447b-b3ec-d54a27d28ba9 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938] Guest created on hypervisor {{(pid=74337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 21:36:53 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938] Instance spawned successfully.
Oct 23 21:36:53 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-742ef6ad-a389-447b-b3ec-d54a27d28ba9 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 21:36:53 user nova-compute[74337]: DEBUG nova.compute.manager [req-fb867e07-4415-4c2a-abfa-6d43a35ffd89 req-85158139-3d2c-45aa-8d5b-d7ed0d6b0d64 service nova] [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938] Received event network-vif-plugged-9034e8d2-9a0e-42b6-9a38-49877881f0d3 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:36:53 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-fb867e07-4415-4c2a-abfa-6d43a35ffd89 req-85158139-3d2c-45aa-8d5b-d7ed0d6b0d64 service nova] Acquiring lock "00f757cf-e5dd-476f-81c6-670ed2bf6938-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:36:53 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-fb867e07-4415-4c2a-abfa-6d43a35ffd89 req-85158139-3d2c-45aa-8d5b-d7ed0d6b0d64 service nova] Lock "00f757cf-e5dd-476f-81c6-670ed2bf6938-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:36:53 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-fb867e07-4415-4c2a-abfa-6d43a35ffd89 req-85158139-3d2c-45aa-8d5b-d7ed0d6b0d64 service nova] Lock "00f757cf-e5dd-476f-81c6-670ed2bf6938-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:36:53 user nova-compute[74337]: DEBUG nova.compute.manager [req-fb867e07-4415-4c2a-abfa-6d43a35ffd89 req-85158139-3d2c-45aa-8d5b-d7ed0d6b0d64 service nova] [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938] No waiting events found dispatching network-vif-plugged-9034e8d2-9a0e-42b6-9a38-49877881f0d3 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:36:53 user nova-compute[74337]: WARNING nova.compute.manager [req-fb867e07-4415-4c2a-abfa-6d43a35ffd89 req-85158139-3d2c-45aa-8d5b-d7ed0d6b0d64 service nova] [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938] Received unexpected event network-vif-plugged-9034e8d2-9a0e-42b6-9a38-49877881f0d3 for instance with vm_state building and task_state spawning.
Oct 23 21:36:53 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-742ef6ad-a389-447b-b3ec-d54a27d28ba9 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938] Found default for hw_cdrom_bus of ide {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:36:53 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-742ef6ad-a389-447b-b3ec-d54a27d28ba9 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938] Found default for hw_disk_bus of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:36:53 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-742ef6ad-a389-447b-b3ec-d54a27d28ba9 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938] Found default for hw_input_bus of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:36:53 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-742ef6ad-a389-447b-b3ec-d54a27d28ba9 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938] Found default for hw_pointer_model of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:36:53 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-742ef6ad-a389-447b-b3ec-d54a27d28ba9 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938] Found default for hw_video_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:36:53 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-742ef6ad-a389-447b-b3ec-d54a27d28ba9 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938] Found default for hw_vif_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:36:54 user nova-compute[74337]: INFO nova.compute.manager [None req-742ef6ad-a389-447b-b3ec-d54a27d28ba9 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938] Took 5.42 seconds to spawn the instance on the hypervisor.
Oct 23 21:36:54 user nova-compute[74337]: DEBUG nova.compute.manager [None req-742ef6ad-a389-447b-b3ec-d54a27d28ba9 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938] Checking state {{(pid=74337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 21:36:54 user nova-compute[74337]: INFO nova.compute.manager [None req-742ef6ad-a389-447b-b3ec-d54a27d28ba9 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938] Took 6.39 seconds to build instance.
Oct 23 21:36:54 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-742ef6ad-a389-447b-b3ec-d54a27d28ba9 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Lock "00f757cf-e5dd-476f-81c6-670ed2bf6938" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.484s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:36:54 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:36:54 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:36:55 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:57 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-24f2dab4-e01c-4b8e-997c-adb9627134a5 tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Waiting for libvirt event about the detach of device tape522a54f-9f with device alias net1 from instance 8acc1b10-a541-4c06-aeb7-1ecf7a2457be is timed out.
Oct 23 21:36:57 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-24f2dab4-e01c-4b8e-997c-adb9627134a5 tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:6d:56:bf"/><model type="virtio"/><mtu size="1442"/><target dev="tape522a54f-9f"/></interface> {{(pid=74337) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 23 21:36:57 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-24f2dab4-e01c-4b8e-997c-adb9627134a5 tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:6d:56:bf"/><model type="virtio"/><mtu size="1442"/><target dev="tape522a54f-9f"/></interface>not found in domain: <domain type='kvm' id='5'>
Oct 23 21:36:57 user nova-compute[74337]:   <name>instance-00000005</name>
Oct 23 21:36:57 user nova-compute[74337]:   <uuid>8acc1b10-a541-4c06-aeb7-1ecf7a2457be</uuid>
Oct 23 21:36:57 user nova-compute[74337]:   <metadata>
Oct 23 21:36:57 user nova-compute[74337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 21:36:57 user nova-compute[74337]:   <nova:package version="0.0.0"/>
Oct 23 21:36:57 user nova-compute[74337]:   <nova:name>tempest-device-tagging-server-1843796381</nova:name>
Oct 23 21:36:57 user nova-compute[74337]:   <nova:creationTime>2023-10-23 21:35:26</nova:creationTime>
Oct 23 21:36:57 user nova-compute[74337]:   <nova:flavor name="m1.tiny">
Oct 23 21:36:57 user nova-compute[74337]:     <nova:memory>512</nova:memory>
Oct 23 21:36:57 user nova-compute[74337]:     <nova:disk>1</nova:disk>
Oct 23 21:36:57 user nova-compute[74337]:     <nova:swap>0</nova:swap>
Oct 23 21:36:57 user nova-compute[74337]:     <nova:ephemeral>0</nova:ephemeral>
Oct 23 21:36:57 user nova-compute[74337]:     <nova:vcpus>1</nova:vcpus>
Oct 23 21:36:57 user nova-compute[74337]:   </nova:flavor>
Oct 23 21:36:57 user nova-compute[74337]:   <nova:owner>
Oct 23 21:36:57 user nova-compute[74337]:     <nova:user uuid="ec1a4c2d1f9b4983ab9124c7f6056da6">tempest-TaggedAttachmentsTest-2141482979-project-member</nova:user>
Oct 23 21:36:57 user nova-compute[74337]:     <nova:project uuid="84d7baedb5f74976be4b0cf308964086">tempest-TaggedAttachmentsTest-2141482979</nova:project>
Oct 23 21:36:57 user nova-compute[74337]:   </nova:owner>
Oct 23 21:36:57 user nova-compute[74337]:   <nova:root type="image" uuid="d859d89d-998d-4109-b26a-0d6e28152932"/>
Oct 23 21:36:57 user nova-compute[74337]:   <nova:ports>
Oct 23 21:36:57 user nova-compute[74337]:     <nova:port uuid="530b7241-1498-47dc-8a6f-79e6c9cc850a">
Oct 23 21:36:57 user nova-compute[74337]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 23 21:36:57 user nova-compute[74337]:     </nova:port>
Oct 23 21:36:57 user nova-compute[74337]:     <nova:port uuid="e522a54f-9f6f-4224-a928-97d630fc5080">
Oct 23 21:36:57 user nova-compute[74337]:       <nova:ip type="fixed" address="10.10.10.139" ipVersion="4"/>
Oct 23 21:36:57 user nova-compute[74337]:     </nova:port>
Oct 23 21:36:57 user nova-compute[74337]:   </nova:ports>
Oct 23 21:36:57 user nova-compute[74337]: </nova:instance>
Oct 23 21:36:57 user nova-compute[74337]:   </metadata>
Oct 23 21:36:57 user nova-compute[74337]:   <memory unit='KiB'>524288</memory>
Oct 23 21:36:57 user nova-compute[74337]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 23 21:36:57 user nova-compute[74337]:   <vcpu placement='static'>1</vcpu>
Oct 23 21:36:57 user nova-compute[74337]:   <resource>
Oct 23 21:36:57 user nova-compute[74337]:     <partition>/machine</partition>
Oct 23 21:36:57 user nova-compute[74337]:   </resource>
Oct 23 21:36:57 user nova-compute[74337]:   <sysinfo type='smbios'>
Oct 23 21:36:57 user nova-compute[74337]:     <system>
Oct 23 21:36:57 user nova-compute[74337]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 23 21:36:57 user nova-compute[74337]:       <entry name='product'>OpenStack Nova</entry>
Oct 23 21:36:57 user nova-compute[74337]:       <entry name='version'>0.0.0</entry>
Oct 23 21:36:57 user nova-compute[74337]:       <entry name='serial'>8acc1b10-a541-4c06-aeb7-1ecf7a2457be</entry>
Oct 23 21:36:57 user nova-compute[74337]:       <entry name='uuid'>8acc1b10-a541-4c06-aeb7-1ecf7a2457be</entry>
Oct 23 21:36:57 user nova-compute[74337]:       <entry name='family'>Virtual Machine</entry>
Oct 23 21:36:57 user nova-compute[74337]:     </system>
Oct 23 21:36:57 user nova-compute[74337]:   </sysinfo>
Oct 23 21:36:57 user nova-compute[74337]:   <os>
Oct 23 21:36:57 user nova-compute[74337]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 23 21:36:57 user nova-compute[74337]:     <boot dev='hd'/>
Oct 23 21:36:57 user nova-compute[74337]:     <smbios mode='sysinfo'/>
Oct 23 21:36:57 user nova-compute[74337]:   </os>
Oct 23 21:36:57 user nova-compute[74337]:   <features>
Oct 23 21:36:57 user nova-compute[74337]:     <acpi/>
Oct 23 21:36:57 user nova-compute[74337]:     <apic/>
Oct 23 21:36:57 user nova-compute[74337]:     <vmcoreinfo state='on'/>
Oct 23 21:36:57 user nova-compute[74337]:   </features>
Oct 23 21:36:57 user nova-compute[74337]:   <cpu mode='custom' match='exact' check='full'>
Oct 23 21:36:57 user nova-compute[74337]:     <model fallback='forbid'>Nehalem</model>
Oct 23 21:36:57 user nova-compute[74337]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 23 21:36:57 user nova-compute[74337]:     <feature policy='require' name='vme'/>
Oct 23 21:36:57 user nova-compute[74337]:     <feature policy='require' name='x2apic'/>
Oct 23 21:36:57 user nova-compute[74337]:     <feature policy='require' name='hypervisor'/>
Oct 23 21:36:57 user nova-compute[74337]:   </cpu>
Oct 23 21:36:57 user nova-compute[74337]:   <clock offset='utc'>
Oct 23 21:36:57 user nova-compute[74337]:     <timer name='pit' tickpolicy='delay'/>
Oct 23 21:36:57 user nova-compute[74337]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 23 21:36:57 user nova-compute[74337]:     <timer name='hpet' present='no'/>
Oct 23 21:36:57 user nova-compute[74337]:   </clock>
Oct 23 21:36:57 user nova-compute[74337]:   <on_poweroff>destroy</on_poweroff>
Oct 23 21:36:57 user nova-compute[74337]:   <on_reboot>restart</on_reboot>
Oct 23 21:36:57 user nova-compute[74337]:   <on_crash>destroy</on_crash>
Oct 23 21:36:57 user nova-compute[74337]:   <devices>
Oct 23 21:36:57 user nova-compute[74337]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 23 21:36:57 user nova-compute[74337]:     <disk type='file' device='disk'>
Oct 23 21:36:57 user nova-compute[74337]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 23 21:36:57 user nova-compute[74337]:       <source file='/opt/stack/data/nova/instances/8acc1b10-a541-4c06-aeb7-1ecf7a2457be/disk' index='2'/>
Oct 23 21:36:57 user nova-compute[74337]:       <backingStore type='file' index='3'>
Oct 23 21:36:57 user nova-compute[74337]:         <format type='raw'/>
Oct 23 21:36:57 user nova-compute[74337]:         <source file='/opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7'/>
Oct 23 21:36:57 user nova-compute[74337]:         <backingStore/>
Oct 23 21:36:57 user nova-compute[74337]:       </backingStore>
Oct 23 21:36:57 user nova-compute[74337]:       <target dev='vda' bus='virtio'/>
Oct 23 21:36:57 user nova-compute[74337]:       <alias name='virtio-disk0'/>
Oct 23 21:36:57 user nova-compute[74337]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 23 21:36:57 user nova-compute[74337]:     </disk>
Oct 23 21:36:57 user nova-compute[74337]:     <disk type='file' device='cdrom'>
Oct 23 21:36:57 user nova-compute[74337]:       <driver name='qemu' type='raw' cache='none'/>
Oct 23 21:36:57 user nova-compute[74337]:       <source file='/opt/stack/data/nova/instances/8acc1b10-a541-4c06-aeb7-1ecf7a2457be/disk.config' index='1'/>
Oct 23 21:36:57 user nova-compute[74337]:       <backingStore/>
Oct 23 21:36:57 user nova-compute[74337]:       <target dev='hda' bus='ide'/>
Oct 23 21:36:57 user nova-compute[74337]:       <readonly/>
Oct 23 21:36:57 user nova-compute[74337]:       <alias name='ide0-0-0'/>
Oct 23 21:36:57 user nova-compute[74337]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 23 21:36:57 user nova-compute[74337]:     </disk>
Oct 23 21:36:57 user nova-compute[74337]:     <controller type='usb' index='0' model='none'>
Oct 23 21:36:57 user nova-compute[74337]:       <alias name='usb'/>
Oct 23 21:36:57 user nova-compute[74337]:     </controller>
Oct 23 21:36:57 user nova-compute[74337]:     <controller type='pci' index='0' model='pci-root'>
Oct 23 21:36:57 user nova-compute[74337]:       <alias name='pci.0'/>
Oct 23 21:36:57 user nova-compute[74337]:     </controller>
Oct 23 21:36:57 user nova-compute[74337]:     <controller type='ide' index='0'>
Oct 23 21:36:57 user nova-compute[74337]:       <alias name='ide'/>
Oct 23 21:36:57 user nova-compute[74337]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 23 21:36:57 user nova-compute[74337]:     </controller>
Oct 23 21:36:57 user nova-compute[74337]:     <interface type='ethernet'>
Oct 23 21:36:57 user nova-compute[74337]:       <mac address='fa:16:3e:47:6a:0e'/>
Oct 23 21:36:57 user nova-compute[74337]:       <target dev='tap530b7241-14'/>
Oct 23 21:36:57 user nova-compute[74337]:       <model type='virtio'/>
Oct 23 21:36:57 user nova-compute[74337]:       <mtu size='1442'/>
Oct 23 21:36:57 user nova-compute[74337]:       <alias name='net0'/>
Oct 23 21:36:57 user nova-compute[74337]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 23 21:36:57 user nova-compute[74337]:     </interface>
Oct 23 21:36:57 user nova-compute[74337]:     <serial type='pty'>
Oct 23 21:36:57 user nova-compute[74337]:       <source path='/dev/pts/4'/>
Oct 23 21:36:57 user nova-compute[74337]:       <log file='/opt/stack/data/nova/instances/8acc1b10-a541-4c06-aeb7-1ecf7a2457be/console.log' append='off'/>
Oct 23 21:36:57 user nova-compute[74337]:       <target type='isa-serial' port='0'>
Oct 23 21:36:57 user nova-compute[74337]:         <model name='isa-serial'/>
Oct 23 21:36:57 user nova-compute[74337]:       </target>
Oct 23 21:36:57 user nova-compute[74337]:       <alias name='serial0'/>
Oct 23 21:36:57 user nova-compute[74337]:     </serial>
Oct 23 21:36:57 user nova-compute[74337]:     <console type='pty' tty='/dev/pts/4'>
Oct 23 21:36:57 user nova-compute[74337]:       <source path='/dev/pts/4'/>
Oct 23 21:36:57 user nova-compute[74337]:       <log file='/opt/stack/data/nova/instances/8acc1b10-a541-4c06-aeb7-1ecf7a2457be/console.log' append='off'/>
Oct 23 21:36:57 user nova-compute[74337]:       <target type='serial' port='0'/>
Oct 23 21:36:57 user nova-compute[74337]:       <alias name='serial0'/>
Oct 23 21:36:57 user nova-compute[74337]:     </console>
Oct 23 21:36:57 user nova-compute[74337]:     <input type='mouse' bus='ps2'>
Oct 23 21:36:57 user nova-compute[74337]:       <alias name='input0'/>
Oct 23 21:36:57 user nova-compute[74337]:     </input>
Oct 23 21:36:57 user nova-compute[74337]:     <input type='keyboard' bus='ps2'>
Oct 23 21:36:57 user nova-compute[74337]:       <alias name='input1'/>
Oct 23 21:36:57 user nova-compute[74337]:     </input>
Oct 23 21:36:57 user nova-compute[74337]:     <graphics type='vnc' port='5904' autoport='yes' listen='0.0.0.0'>
Oct 23 21:36:57 user nova-compute[74337]:       <listen type='address' address='0.0.0.0'/>
Oct 23 21:36:57 user nova-compute[74337]:     </graphics>
Oct 23 21:36:57 user nova-compute[74337]:     <audio id='1' type='none'/>
Oct 23 21:36:57 user nova-compute[74337]:     <video>
Oct 23 21:36:57 user nova-compute[74337]:       <model type='virtio' heads='1' primary='yes'/>
Oct 23 21:36:57 user nova-compute[74337]:       <alias name='video0'/>
Oct 23 21:36:57 user nova-compute[74337]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 23 21:36:57 user nova-compute[74337]:     </video>
Oct 23 21:36:57 user nova-compute[74337]:     <memballoon model='virtio'>
Oct 23 21:36:57 user nova-compute[74337]:       <stats period='10'/>
Oct 23 21:36:57 user nova-compute[74337]:       <alias name='balloon0'/>
Oct 23 21:36:57 user nova-compute[74337]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 23 21:36:57 user nova-compute[74337]:     </memballoon>
Oct 23 21:36:57 user nova-compute[74337]:     <rng model='virtio'>
Oct 23 21:36:57 user nova-compute[74337]:       <backend model='random'>/dev/urandom</backend>
Oct 23 21:36:57 user nova-compute[74337]:       <alias name='rng0'/>
Oct 23 21:36:57 user nova-compute[74337]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 23 21:36:57 user nova-compute[74337]:     </rng>
Oct 23 21:36:57 user nova-compute[74337]:   </devices>
Oct 23 21:36:57 user nova-compute[74337]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 23 21:36:57 user nova-compute[74337]:     <label>libvirt-8acc1b10-a541-4c06-aeb7-1ecf7a2457be</label>
Oct 23 21:36:57 user nova-compute[74337]:     <imagelabel>libvirt-8acc1b10-a541-4c06-aeb7-1ecf7a2457be</imagelabel>
Oct 23 21:36:57 user nova-compute[74337]:   </seclabel>
Oct 23 21:36:57 user nova-compute[74337]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 23 21:36:57 user nova-compute[74337]:     <label>+64055:+108</label>
Oct 23 21:36:57 user nova-compute[74337]:     <imagelabel>+64055:+108</imagelabel>
Oct 23 21:36:57 user nova-compute[74337]:   </seclabel>
Oct 23 21:36:57 user nova-compute[74337]: </domain>
Oct 23 21:36:57 user nova-compute[74337]:  {{(pid=74337) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 23 21:36:57 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-24f2dab4-e01c-4b8e-997c-adb9627134a5 tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Successfully detached device tape522a54f-9f from instance 8acc1b10-a541-4c06-aeb7-1ecf7a2457be from the live domain config.
Oct 23 21:36:57 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-24f2dab4-e01c-4b8e-997c-adb9627134a5 tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T21:33:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1843796381',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1843796381',id=5,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAop3qssYFI+MVvFuH2+7gwm//7zwcdy6tYm9eD42fbRzv89CUtru1RL8WlSDZgdlRSrkM4Tb4QtCQmTEE7AA2YXPHv9z6iJ2d9asZLABlNx58K0PwTsdZsKKihbdIgMOg==',key_name='tempest-keypair-586099674',keypairs=<?>,launch_index=0,launched_at=2023-10-23T21:33:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='84d7baedb5f74976be4b0cf308964086',ramdisk_id='',reservation_id='r-4zf725dv',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2141482979',owner_user_name='tempest-TaggedAttachmentsTest-2141482979-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T21:33:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec1a4c2d1f9b4983ab9124c7f6056da6',uuid=8acc1b10-a541-4c06-aeb7-1ecf7a2457be,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e522a54f-9f6f-4224-a928-97d630fc5080", "address": "fa:16:3e:6d:56:bf", "network": {"id": "db77b1d7-f969-40a5-918c-5706fb1ec6bd", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1231224947", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "84d7baedb5f74976be4b0cf308964086", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape522a54f-9f", "ovs_interfaceid": "e522a54f-9f6f-4224-a928-97d630fc5080", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 21:36:57 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-24f2dab4-e01c-4b8e-997c-adb9627134a5 tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Converting VIF {"id": "e522a54f-9f6f-4224-a928-97d630fc5080", "address": "fa:16:3e:6d:56:bf", "network": {"id": "db77b1d7-f969-40a5-918c-5706fb1ec6bd", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1231224947", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "84d7baedb5f74976be4b0cf308964086", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape522a54f-9f", "ovs_interfaceid": "e522a54f-9f6f-4224-a928-97d630fc5080", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:36:57 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-24f2dab4-e01c-4b8e-997c-adb9627134a5 tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:56:bf,bridge_name='br-int',has_traffic_filtering=True,id=e522a54f-9f6f-4224-a928-97d630fc5080,network=Network(db77b1d7-f969-40a5-918c-5706fb1ec6bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape522a54f-9f') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:36:57 user nova-compute[74337]: DEBUG os_vif [None req-24f2dab4-e01c-4b8e-997c-adb9627134a5 tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:56:bf,bridge_name='br-int',has_traffic_filtering=True,id=e522a54f-9f6f-4224-a928-97d630fc5080,network=Network(db77b1d7-f969-40a5-918c-5706fb1ec6bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape522a54f-9f') {{(pid=74337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 21:36:57 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:57 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape522a54f-9f, bridge=br-int, if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:36:57 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:57 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:57 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:57 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5b3356a2-e52a-4d67-8fc5-a5d8f207ce25) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:36:57 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:57 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:57 user nova-compute[74337]: INFO os_vif [None req-24f2dab4-e01c-4b8e-997c-adb9627134a5 tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:56:bf,bridge_name='br-int',has_traffic_filtering=True,id=e522a54f-9f6f-4224-a928-97d630fc5080,network=Network(db77b1d7-f969-40a5-918c-5706fb1ec6bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape522a54f-9f')
Oct 23 21:36:57 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-24f2dab4-e01c-4b8e-997c-adb9627134a5 tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 21:36:57 user nova-compute[74337]:   <nova:package version="0.0.0"/>
Oct 23 21:36:57 user nova-compute[74337]:   <nova:name>tempest-device-tagging-server-1843796381</nova:name>
Oct 23 21:36:57 user nova-compute[74337]:   <nova:creationTime>2023-10-23 21:36:57</nova:creationTime>
Oct 23 21:36:57 user nova-compute[74337]:   <nova:flavor name="m1.tiny">
Oct 23 21:36:57 user nova-compute[74337]:     <nova:memory>512</nova:memory>
Oct 23 21:36:57 user nova-compute[74337]:     <nova:disk>1</nova:disk>
Oct 23 21:36:57 user nova-compute[74337]:     <nova:swap>0</nova:swap>
Oct 23 21:36:57 user nova-compute[74337]:     <nova:ephemeral>0</nova:ephemeral>
Oct 23 21:36:57 user nova-compute[74337]:     <nova:vcpus>1</nova:vcpus>
Oct 23 21:36:57 user nova-compute[74337]:   </nova:flavor>
Oct 23 21:36:57 user nova-compute[74337]:   <nova:owner>
Oct 23 21:36:57 user nova-compute[74337]:     <nova:user uuid="ec1a4c2d1f9b4983ab9124c7f6056da6">tempest-TaggedAttachmentsTest-2141482979-project-member</nova:user>
Oct 23 21:36:57 user nova-compute[74337]:     <nova:project uuid="84d7baedb5f74976be4b0cf308964086">tempest-TaggedAttachmentsTest-2141482979</nova:project>
Oct 23 21:36:57 user nova-compute[74337]:   </nova:owner>
Oct 23 21:36:57 user nova-compute[74337]:   <nova:root type="image" uuid="d859d89d-998d-4109-b26a-0d6e28152932"/>
Oct 23 21:36:57 user nova-compute[74337]:   <nova:ports>
Oct 23 21:36:57 user nova-compute[74337]:     <nova:port uuid="530b7241-1498-47dc-8a6f-79e6c9cc850a">
Oct 23 21:36:57 user nova-compute[74337]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 23 21:36:57 user nova-compute[74337]:     </nova:port>
Oct 23 21:36:57 user nova-compute[74337]:   </nova:ports>
Oct 23 21:36:57 user nova-compute[74337]: </nova:instance>
Oct 23 21:36:57 user nova-compute[74337]:  {{(pid=74337) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Oct 23 21:36:57 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-38698931-8b4e-42b5-8b4e-91745e8a6e38 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Acquiring lock "b193f267-2ca2-47c5-bd6c-397b1e041d4a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:36:57 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-38698931-8b4e-42b5-8b4e-91745e8a6e38 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Lock "b193f267-2ca2-47c5-bd6c-397b1e041d4a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:36:57 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:57 user nova-compute[74337]: DEBUG nova.compute.manager [None req-38698931-8b4e-42b5-8b4e-91745e8a6e38 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] [instance: b193f267-2ca2-47c5-bd6c-397b1e041d4a] Starting instance... {{(pid=74337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 21:36:58 user nova-compute[74337]: DEBUG nova.compute.manager [req-d44f3010-f2bc-4e4d-8b0d-d54a37946644 req-243c76a9-0da8-4b38-b13d-df2ab99258b9 service nova] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] Received event network-vif-deleted-e522a54f-9f6f-4224-a928-97d630fc5080 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:36:58 user nova-compute[74337]: INFO nova.compute.manager [req-d44f3010-f2bc-4e4d-8b0d-d54a37946644 req-243c76a9-0da8-4b38-b13d-df2ab99258b9 service nova] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] Neutron deleted interface e522a54f-9f6f-4224-a928-97d630fc5080; detaching it from the instance and deleting it from the info cache
Oct 23 21:36:58 user nova-compute[74337]: DEBUG nova.network.neutron [req-d44f3010-f2bc-4e4d-8b0d-d54a37946644 req-243c76a9-0da8-4b38-b13d-df2ab99258b9 service nova] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] Updating instance_info_cache with network_info: [{"id": "530b7241-1498-47dc-8a6f-79e6c9cc850a", "address": "fa:16:3e:47:6a:0e", "network": {"id": "44c67162-ce40-4b2b-bc3e-07b0203e2083", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1341457246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84d7baedb5f74976be4b0cf308964086", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap530b7241-14", "ovs_interfaceid": "530b7241-1498-47dc-8a6f-79e6c9cc850a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:36:58 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-38698931-8b4e-42b5-8b4e-91745e8a6e38 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:36:58 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-38698931-8b4e-42b5-8b4e-91745e8a6e38 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:36:58 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-38698931-8b4e-42b5-8b4e-91745e8a6e38 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 21:36:58 user nova-compute[74337]: INFO nova.compute.claims [None req-38698931-8b4e-42b5-8b4e-91745e8a6e38 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] [instance: b193f267-2ca2-47c5-bd6c-397b1e041d4a] Claim successful on node user
Oct 23 21:36:58 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-24f2dab4-e01c-4b8e-997c-adb9627134a5 tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Acquiring lock "refresh_cache-8acc1b10-a541-4c06-aeb7-1ecf7a2457be" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:36:58 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-24f2dab4-e01c-4b8e-997c-adb9627134a5 tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Acquired lock "refresh_cache-8acc1b10-a541-4c06-aeb7-1ecf7a2457be" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:36:58 user nova-compute[74337]: DEBUG nova.network.neutron [None req-24f2dab4-e01c-4b8e-997c-adb9627134a5 tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] Building network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 21:36:58 user nova-compute[74337]: DEBUG nova.objects.instance [req-d44f3010-f2bc-4e4d-8b0d-d54a37946644 req-243c76a9-0da8-4b38-b13d-df2ab99258b9 service nova] Lazy-loading 'system_metadata' on Instance uuid 8acc1b10-a541-4c06-aeb7-1ecf7a2457be {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:36:58 user nova-compute[74337]: DEBUG nova.objects.instance [req-d44f3010-f2bc-4e4d-8b0d-d54a37946644 req-243c76a9-0da8-4b38-b13d-df2ab99258b9 service nova] Lazy-loading 'flavor' on Instance uuid 8acc1b10-a541-4c06-aeb7-1ecf7a2457be {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:36:58 user nova-compute[74337]: DEBUG nova.objects.base [req-d44f3010-f2bc-4e4d-8b0d-d54a37946644 req-243c76a9-0da8-4b38-b13d-df2ab99258b9 service nova] Object Instance<8acc1b10-a541-4c06-aeb7-1ecf7a2457be> lazy-loaded attributes: system_metadata,flavor {{(pid=74337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 21:36:58 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [req-d44f3010-f2bc-4e4d-8b0d-d54a37946644 req-243c76a9-0da8-4b38-b13d-df2ab99258b9 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T21:33:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1843796381',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1843796381',id=5,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAop3qssYFI+MVvFuH2+7gwm//7zwcdy6tYm9eD42fbRzv89CUtru1RL8WlSDZgdlRSrkM4Tb4QtCQmTEE7AA2YXPHv9z6iJ2d9asZLABlNx58K0PwTsdZsKKihbdIgMOg==',key_name='tempest-keypair-586099674',keypairs=<?>,launch_index=0,launched_at=2023-10-23T21:33:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='84d7baedb5f74976be4b0cf308964086',ramdisk_id='',reservation_id='r-4zf725dv',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2141482979',owner_user_name='tempest-TaggedAttachmentsTest-2141482979-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T21:33:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec1a4c2d1f9b4983ab9124c7f6056da6',uuid=8acc1b10-a541-4c06-aeb7-1ecf7a2457be,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e522a54f-9f6f-4224-a928-97d630fc5080", "address": "fa:16:3e:6d:56:bf", "network": {"id": "db77b1d7-f969-40a5-918c-5706fb1ec6bd", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1231224947", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "84d7baedb5f74976be4b0cf308964086", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape522a54f-9f", "ovs_interfaceid": "e522a54f-9f6f-4224-a928-97d630fc5080", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 21:36:58 user nova-compute[74337]: DEBUG nova.network.os_vif_util [req-d44f3010-f2bc-4e4d-8b0d-d54a37946644 req-243c76a9-0da8-4b38-b13d-df2ab99258b9 service nova] Converting VIF {"id": "e522a54f-9f6f-4224-a928-97d630fc5080", "address": "fa:16:3e:6d:56:bf", "network": {"id": "db77b1d7-f969-40a5-918c-5706fb1ec6bd", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1231224947", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "84d7baedb5f74976be4b0cf308964086", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape522a54f-9f", "ovs_interfaceid": "e522a54f-9f6f-4224-a928-97d630fc5080", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:36:58 user nova-compute[74337]: DEBUG nova.network.os_vif_util [req-d44f3010-f2bc-4e4d-8b0d-d54a37946644 req-243c76a9-0da8-4b38-b13d-df2ab99258b9 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:56:bf,bridge_name='br-int',has_traffic_filtering=True,id=e522a54f-9f6f-4224-a928-97d630fc5080,network=Network(db77b1d7-f969-40a5-918c-5706fb1ec6bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape522a54f-9f') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:36:58 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [req-d44f3010-f2bc-4e4d-8b0d-d54a37946644 req-243c76a9-0da8-4b38-b13d-df2ab99258b9 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:6d:56:bf"/><model type="virtio"/><mtu size="1442"/><target dev="tape522a54f-9f"/></interface> {{(pid=74337) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 23 21:36:58 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [req-d44f3010-f2bc-4e4d-8b0d-d54a37946644 req-243c76a9-0da8-4b38-b13d-df2ab99258b9 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:6d:56:bf"/><model type="virtio"/><mtu size="1442"/><target dev="tape522a54f-9f"/></interface>not found in domain: <domain type='kvm' id='5'>
Oct 23 21:36:58 user nova-compute[74337]:   <name>instance-00000005</name>
Oct 23 21:36:58 user nova-compute[74337]:   <uuid>8acc1b10-a541-4c06-aeb7-1ecf7a2457be</uuid>
Oct 23 21:36:58 user nova-compute[74337]:   <metadata>
Oct 23 21:36:58 user nova-compute[74337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 21:36:58 user nova-compute[74337]:   <nova:package version="0.0.0"/>
Oct 23 21:36:58 user nova-compute[74337]:   <nova:name>tempest-device-tagging-server-1843796381</nova:name>
Oct 23 21:36:58 user nova-compute[74337]:   <nova:creationTime>2023-10-23 21:36:57</nova:creationTime>
Oct 23 21:36:58 user nova-compute[74337]:   <nova:flavor name="m1.tiny">
Oct 23 21:36:58 user nova-compute[74337]:     <nova:memory>512</nova:memory>
Oct 23 21:36:58 user nova-compute[74337]:     <nova:disk>1</nova:disk>
Oct 23 21:36:58 user nova-compute[74337]:     <nova:swap>0</nova:swap>
Oct 23 21:36:58 user nova-compute[74337]:     <nova:ephemeral>0</nova:ephemeral>
Oct 23 21:36:58 user nova-compute[74337]:     <nova:vcpus>1</nova:vcpus>
Oct 23 21:36:58 user nova-compute[74337]:   </nova:flavor>
Oct 23 21:36:58 user nova-compute[74337]:   <nova:owner>
Oct 23 21:36:58 user nova-compute[74337]:     <nova:user uuid="ec1a4c2d1f9b4983ab9124c7f6056da6">tempest-TaggedAttachmentsTest-2141482979-project-member</nova:user>
Oct 23 21:36:58 user nova-compute[74337]:     <nova:project uuid="84d7baedb5f74976be4b0cf308964086">tempest-TaggedAttachmentsTest-2141482979</nova:project>
Oct 23 21:36:58 user nova-compute[74337]:   </nova:owner>
Oct 23 21:36:58 user nova-compute[74337]:   <nova:root type="image" uuid="d859d89d-998d-4109-b26a-0d6e28152932"/>
Oct 23 21:36:58 user nova-compute[74337]:   <nova:ports>
Oct 23 21:36:58 user nova-compute[74337]:     <nova:port uuid="530b7241-1498-47dc-8a6f-79e6c9cc850a">
Oct 23 21:36:58 user nova-compute[74337]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 23 21:36:58 user nova-compute[74337]:     </nova:port>
Oct 23 21:36:58 user nova-compute[74337]:   </nova:ports>
Oct 23 21:36:58 user nova-compute[74337]: </nova:instance>
Oct 23 21:36:58 user nova-compute[74337]:   </metadata>
Oct 23 21:36:58 user nova-compute[74337]:   <memory unit='KiB'>524288</memory>
Oct 23 21:36:58 user nova-compute[74337]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 23 21:36:58 user nova-compute[74337]:   <vcpu placement='static'>1</vcpu>
Oct 23 21:36:58 user nova-compute[74337]:   <resource>
Oct 23 21:36:58 user nova-compute[74337]:     <partition>/machine</partition>
Oct 23 21:36:58 user nova-compute[74337]:   </resource>
Oct 23 21:36:58 user nova-compute[74337]:   <sysinfo type='smbios'>
Oct 23 21:36:58 user nova-compute[74337]:     <system>
Oct 23 21:36:58 user nova-compute[74337]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 23 21:36:58 user nova-compute[74337]:       <entry name='product'>OpenStack Nova</entry>
Oct 23 21:36:58 user nova-compute[74337]:       <entry name='version'>0.0.0</entry>
Oct 23 21:36:58 user nova-compute[74337]:       <entry name='serial'>8acc1b10-a541-4c06-aeb7-1ecf7a2457be</entry>
Oct 23 21:36:58 user nova-compute[74337]:       <entry name='uuid'>8acc1b10-a541-4c06-aeb7-1ecf7a2457be</entry>
Oct 23 21:36:58 user nova-compute[74337]:       <entry name='family'>Virtual Machine</entry>
Oct 23 21:36:58 user nova-compute[74337]:     </system>
Oct 23 21:36:58 user nova-compute[74337]:   </sysinfo>
Oct 23 21:36:58 user nova-compute[74337]:   <os>
Oct 23 21:36:58 user nova-compute[74337]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 23 21:36:58 user nova-compute[74337]:     <boot dev='hd'/>
Oct 23 21:36:58 user nova-compute[74337]:     <smbios mode='sysinfo'/>
Oct 23 21:36:58 user nova-compute[74337]:   </os>
Oct 23 21:36:58 user nova-compute[74337]:   <features>
Oct 23 21:36:58 user nova-compute[74337]:     <acpi/>
Oct 23 21:36:58 user nova-compute[74337]:     <apic/>
Oct 23 21:36:58 user nova-compute[74337]:     <vmcoreinfo state='on'/>
Oct 23 21:36:58 user nova-compute[74337]:   </features>
Oct 23 21:36:58 user nova-compute[74337]:   <cpu mode='custom' match='exact' check='full'>
Oct 23 21:36:58 user nova-compute[74337]:     <model fallback='forbid'>Nehalem</model>
Oct 23 21:36:58 user nova-compute[74337]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 23 21:36:58 user nova-compute[74337]:     <feature policy='require' name='vme'/>
Oct 23 21:36:58 user nova-compute[74337]:     <feature policy='require' name='x2apic'/>
Oct 23 21:36:58 user nova-compute[74337]:     <feature policy='require' name='hypervisor'/>
Oct 23 21:36:58 user nova-compute[74337]:   </cpu>
Oct 23 21:36:58 user nova-compute[74337]:   <clock offset='utc'>
Oct 23 21:36:58 user nova-compute[74337]:     <timer name='pit' tickpolicy='delay'/>
Oct 23 21:36:58 user nova-compute[74337]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 23 21:36:58 user nova-compute[74337]:     <timer name='hpet' present='no'/>
Oct 23 21:36:58 user nova-compute[74337]:   </clock>
Oct 23 21:36:58 user nova-compute[74337]:   <on_poweroff>destroy</on_poweroff>
Oct 23 21:36:58 user nova-compute[74337]:   <on_reboot>restart</on_reboot>
Oct 23 21:36:58 user nova-compute[74337]:   <on_crash>destroy</on_crash>
Oct 23 21:36:58 user nova-compute[74337]:   <devices>
Oct 23 21:36:58 user nova-compute[74337]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 23 21:36:58 user nova-compute[74337]:     <disk type='file' device='disk'>
Oct 23 21:36:58 user nova-compute[74337]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 23 21:36:58 user nova-compute[74337]:       <source file='/opt/stack/data/nova/instances/8acc1b10-a541-4c06-aeb7-1ecf7a2457be/disk' index='2'/>
Oct 23 21:36:58 user nova-compute[74337]:       <backingStore type='file' index='3'>
Oct 23 21:36:58 user nova-compute[74337]:         <format type='raw'/>
Oct 23 21:36:58 user nova-compute[74337]:         <source file='/opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7'/>
Oct 23 21:36:58 user nova-compute[74337]:         <backingStore/>
Oct 23 21:36:58 user nova-compute[74337]:       </backingStore>
Oct 23 21:36:58 user nova-compute[74337]:       <target dev='vda' bus='virtio'/>
Oct 23 21:36:58 user nova-compute[74337]:       <alias name='virtio-disk0'/>
Oct 23 21:36:58 user nova-compute[74337]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 23 21:36:58 user nova-compute[74337]:     </disk>
Oct 23 21:36:58 user nova-compute[74337]:     <disk type='file' device='cdrom'>
Oct 23 21:36:58 user nova-compute[74337]:       <driver name='qemu' type='raw' cache='none'/>
Oct 23 21:36:58 user nova-compute[74337]:       <source file='/opt/stack/data/nova/instances/8acc1b10-a541-4c06-aeb7-1ecf7a2457be/disk.config' index='1'/>
Oct 23 21:36:58 user nova-compute[74337]:       <backingStore/>
Oct 23 21:36:58 user nova-compute[74337]:       <target dev='hda' bus='ide'/>
Oct 23 21:36:58 user nova-compute[74337]:       <readonly/>
Oct 23 21:36:58 user nova-compute[74337]:       <alias name='ide0-0-0'/>
Oct 23 21:36:58 user nova-compute[74337]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 23 21:36:58 user nova-compute[74337]:     </disk>
Oct 23 21:36:58 user nova-compute[74337]:     <controller type='usb' index='0' model='none'>
Oct 23 21:36:58 user nova-compute[74337]:       <alias name='usb'/>
Oct 23 21:36:58 user nova-compute[74337]:     </controller>
Oct 23 21:36:58 user nova-compute[74337]:     <controller type='pci' index='0' model='pci-root'>
Oct 23 21:36:58 user nova-compute[74337]:       <alias name='pci.0'/>
Oct 23 21:36:58 user nova-compute[74337]:     </controller>
Oct 23 21:36:58 user nova-compute[74337]:     <controller type='ide' index='0'>
Oct 23 21:36:58 user nova-compute[74337]:       <alias name='ide'/>
Oct 23 21:36:58 user nova-compute[74337]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 23 21:36:58 user nova-compute[74337]:     </controller>
Oct 23 21:36:58 user nova-compute[74337]:     <interface type='ethernet'>
Oct 23 21:36:58 user nova-compute[74337]:       <mac address='fa:16:3e:47:6a:0e'/>
Oct 23 21:36:58 user nova-compute[74337]:       <target dev='tap530b7241-14'/>
Oct 23 21:36:58 user nova-compute[74337]:       <model type='virtio'/>
Oct 23 21:36:58 user nova-compute[74337]:       <mtu size='1442'/>
Oct 23 21:36:58 user nova-compute[74337]:       <alias name='net0'/>
Oct 23 21:36:58 user nova-compute[74337]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 23 21:36:58 user nova-compute[74337]:     </interface>
Oct 23 21:36:58 user nova-compute[74337]:     <serial type='pty'>
Oct 23 21:36:58 user nova-compute[74337]:       <source path='/dev/pts/4'/>
Oct 23 21:36:58 user nova-compute[74337]:       <log file='/opt/stack/data/nova/instances/8acc1b10-a541-4c06-aeb7-1ecf7a2457be/console.log' append='off'/>
Oct 23 21:36:58 user nova-compute[74337]:       <target type='isa-serial' port='0'>
Oct 23 21:36:58 user nova-compute[74337]:         <model name='isa-serial'/>
Oct 23 21:36:58 user nova-compute[74337]:       </target>
Oct 23 21:36:58 user nova-compute[74337]:       <alias name='serial0'/>
Oct 23 21:36:58 user nova-compute[74337]:     </serial>
Oct 23 21:36:58 user nova-compute[74337]:     <console type='pty' tty='/dev/pts/4'>
Oct 23 21:36:58 user nova-compute[74337]:       <source path='/dev/pts/4'/>
Oct 23 21:36:58 user nova-compute[74337]:       <log file='/opt/stack/data/nova/instances/8acc1b10-a541-4c06-aeb7-1ecf7a2457be/console.log' append='off'/>
Oct 23 21:36:58 user nova-compute[74337]:       <target type='serial' port='0'/>
Oct 23 21:36:58 user nova-compute[74337]:       <alias name='serial0'/>
Oct 23 21:36:58 user nova-compute[74337]:     </console>
Oct 23 21:36:58 user nova-compute[74337]:     <input type='mouse' bus='ps2'>
Oct 23 21:36:58 user nova-compute[74337]:       <alias name='input0'/>
Oct 23 21:36:58 user nova-compute[74337]:     </input>
Oct 23 21:36:58 user nova-compute[74337]:     <input type='keyboard' bus='ps2'>
Oct 23 21:36:58 user nova-compute[74337]:       <alias name='input1'/>
Oct 23 21:36:58 user nova-compute[74337]:     </input>
Oct 23 21:36:58 user nova-compute[74337]:     <graphics type='vnc' port='5904' autoport='yes' listen='0.0.0.0'>
Oct 23 21:36:58 user nova-compute[74337]:       <listen type='address' address='0.0.0.0'/>
Oct 23 21:36:58 user nova-compute[74337]:     </graphics>
Oct 23 21:36:58 user nova-compute[74337]:     <audio id='1' type='none'/>
Oct 23 21:36:58 user nova-compute[74337]:     <video>
Oct 23 21:36:58 user nova-compute[74337]:       <model type='virtio' heads='1' primary='yes'/>
Oct 23 21:36:58 user nova-compute[74337]:       <alias name='video0'/>
Oct 23 21:36:58 user nova-compute[74337]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 23 21:36:58 user nova-compute[74337]:     </video>
Oct 23 21:36:58 user nova-compute[74337]:     <memballoon model='virtio'>
Oct 23 21:36:58 user nova-compute[74337]:       <stats period='10'/>
Oct 23 21:36:58 user nova-compute[74337]:       <alias name='balloon0'/>
Oct 23 21:36:58 user nova-compute[74337]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 23 21:36:58 user nova-compute[74337]:     </memballoon>
Oct 23 21:36:58 user nova-compute[74337]:     <rng model='virtio'>
Oct 23 21:36:58 user nova-compute[74337]:       <backend model='random'>/dev/urandom</backend>
Oct 23 21:36:58 user nova-compute[74337]:       <alias name='rng0'/>
Oct 23 21:36:58 user nova-compute[74337]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 23 21:36:58 user nova-compute[74337]:     </rng>
Oct 23 21:36:58 user nova-compute[74337]:   </devices>
Oct 23 21:36:58 user nova-compute[74337]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 23 21:36:58 user nova-compute[74337]:     <label>libvirt-8acc1b10-a541-4c06-aeb7-1ecf7a2457be</label>
Oct 23 21:36:58 user nova-compute[74337]:     <imagelabel>libvirt-8acc1b10-a541-4c06-aeb7-1ecf7a2457be</imagelabel>
Oct 23 21:36:58 user nova-compute[74337]:   </seclabel>
Oct 23 21:36:58 user nova-compute[74337]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 23 21:36:58 user nova-compute[74337]:     <label>+64055:+108</label>
Oct 23 21:36:58 user nova-compute[74337]:     <imagelabel>+64055:+108</imagelabel>
Oct 23 21:36:58 user nova-compute[74337]:   </seclabel>
Oct 23 21:36:58 user nova-compute[74337]: </domain>
Oct 23 21:36:58 user nova-compute[74337]:  {{(pid=74337) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 23 21:36:58 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [req-d44f3010-f2bc-4e4d-8b0d-d54a37946644 req-243c76a9-0da8-4b38-b13d-df2ab99258b9 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:6d:56:bf"/><model type="virtio"/><mtu size="1442"/><target dev="tape522a54f-9f"/></interface> {{(pid=74337) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 23 21:36:58 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [req-d44f3010-f2bc-4e4d-8b0d-d54a37946644 req-243c76a9-0da8-4b38-b13d-df2ab99258b9 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:6d:56:bf"/><model type="virtio"/><mtu size="1442"/><target dev="tape522a54f-9f"/></interface>not found in domain: <domain type='kvm' id='5'>
Oct 23 21:36:58 user nova-compute[74337]:   <name>instance-00000005</name>
Oct 23 21:36:58 user nova-compute[74337]:   <uuid>8acc1b10-a541-4c06-aeb7-1ecf7a2457be</uuid>
Oct 23 21:36:58 user nova-compute[74337]:   <metadata>
Oct 23 21:36:58 user nova-compute[74337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 21:36:58 user nova-compute[74337]:   <nova:package version="0.0.0"/>
Oct 23 21:36:58 user nova-compute[74337]:   <nova:name>tempest-device-tagging-server-1843796381</nova:name>
Oct 23 21:36:58 user nova-compute[74337]:   <nova:creationTime>2023-10-23 21:36:57</nova:creationTime>
Oct 23 21:36:58 user nova-compute[74337]:   <nova:flavor name="m1.tiny">
Oct 23 21:36:58 user nova-compute[74337]:     <nova:memory>512</nova:memory>
Oct 23 21:36:58 user nova-compute[74337]:     <nova:disk>1</nova:disk>
Oct 23 21:36:58 user nova-compute[74337]:     <nova:swap>0</nova:swap>
Oct 23 21:36:58 user nova-compute[74337]:     <nova:ephemeral>0</nova:ephemeral>
Oct 23 21:36:58 user nova-compute[74337]:     <nova:vcpus>1</nova:vcpus>
Oct 23 21:36:58 user nova-compute[74337]:   </nova:flavor>
Oct 23 21:36:58 user nova-compute[74337]:   <nova:owner>
Oct 23 21:36:58 user nova-compute[74337]:     <nova:user uuid="ec1a4c2d1f9b4983ab9124c7f6056da6">tempest-TaggedAttachmentsTest-2141482979-project-member</nova:user>
Oct 23 21:36:58 user nova-compute[74337]:     <nova:project uuid="84d7baedb5f74976be4b0cf308964086">tempest-TaggedAttachmentsTest-2141482979</nova:project>
Oct 23 21:36:58 user nova-compute[74337]:   </nova:owner>
Oct 23 21:36:58 user nova-compute[74337]:   <nova:root type="image" uuid="d859d89d-998d-4109-b26a-0d6e28152932"/>
Oct 23 21:36:58 user nova-compute[74337]:   <nova:ports>
Oct 23 21:36:58 user nova-compute[74337]:     <nova:port uuid="530b7241-1498-47dc-8a6f-79e6c9cc850a">
Oct 23 21:36:58 user nova-compute[74337]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 23 21:36:58 user nova-compute[74337]:     </nova:port>
Oct 23 21:36:58 user nova-compute[74337]:   </nova:ports>
Oct 23 21:36:58 user nova-compute[74337]: </nova:instance>
Oct 23 21:36:58 user nova-compute[74337]:   </metadata>
Oct 23 21:36:58 user nova-compute[74337]:   <memory unit='KiB'>524288</memory>
Oct 23 21:36:58 user nova-compute[74337]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 23 21:36:58 user nova-compute[74337]:   <vcpu placement='static'>1</vcpu>
Oct 23 21:36:58 user nova-compute[74337]:   <resource>
Oct 23 21:36:58 user nova-compute[74337]:     <partition>/machine</partition>
Oct 23 21:36:58 user nova-compute[74337]:   </resource>
Oct 23 21:36:58 user nova-compute[74337]:   <sysinfo type='smbios'>
Oct 23 21:36:58 user nova-compute[74337]:     <system>
Oct 23 21:36:58 user nova-compute[74337]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 23 21:36:58 user nova-compute[74337]:       <entry name='product'>OpenStack Nova</entry>
Oct 23 21:36:58 user nova-compute[74337]:       <entry name='version'>0.0.0</entry>
Oct 23 21:36:58 user nova-compute[74337]:       <entry name='serial'>8acc1b10-a541-4c06-aeb7-1ecf7a2457be</entry>
Oct 23 21:36:58 user nova-compute[74337]:       <entry name='uuid'>8acc1b10-a541-4c06-aeb7-1ecf7a2457be</entry>
Oct 23 21:36:58 user nova-compute[74337]:       <entry name='family'>Virtual Machine</entry>
Oct 23 21:36:58 user nova-compute[74337]:     </system>
Oct 23 21:36:58 user nova-compute[74337]:   </sysinfo>
Oct 23 21:36:58 user nova-compute[74337]:   <os>
Oct 23 21:36:58 user nova-compute[74337]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 23 21:36:58 user nova-compute[74337]:     <boot dev='hd'/>
Oct 23 21:36:58 user nova-compute[74337]:     <smbios mode='sysinfo'/>
Oct 23 21:36:58 user nova-compute[74337]:   </os>
Oct 23 21:36:58 user nova-compute[74337]:   <features>
Oct 23 21:36:58 user nova-compute[74337]:     <acpi/>
Oct 23 21:36:58 user nova-compute[74337]:     <apic/>
Oct 23 21:36:58 user nova-compute[74337]:     <vmcoreinfo state='on'/>
Oct 23 21:36:58 user nova-compute[74337]:   </features>
Oct 23 21:36:58 user nova-compute[74337]:   <cpu mode='custom' match='exact' check='full'>
Oct 23 21:36:58 user nova-compute[74337]:     <model fallback='forbid'>Nehalem</model>
Oct 23 21:36:58 user nova-compute[74337]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 23 21:36:58 user nova-compute[74337]:     <feature policy='require' name='vme'/>
Oct 23 21:36:58 user nova-compute[74337]:     <feature policy='require' name='x2apic'/>
Oct 23 21:36:58 user nova-compute[74337]:     <feature policy='require' name='hypervisor'/>
Oct 23 21:36:58 user nova-compute[74337]:   </cpu>
Oct 23 21:36:58 user nova-compute[74337]:   <clock offset='utc'>
Oct 23 21:36:58 user nova-compute[74337]:     <timer name='pit' tickpolicy='delay'/>
Oct 23 21:36:58 user nova-compute[74337]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 23 21:36:58 user nova-compute[74337]:     <timer name='hpet' present='no'/>
Oct 23 21:36:58 user nova-compute[74337]:   </clock>
Oct 23 21:36:58 user nova-compute[74337]:   <on_poweroff>destroy</on_poweroff>
Oct 23 21:36:58 user nova-compute[74337]:   <on_reboot>restart</on_reboot>
Oct 23 21:36:58 user nova-compute[74337]:   <on_crash>destroy</on_crash>
Oct 23 21:36:58 user nova-compute[74337]:   <devices>
Oct 23 21:36:58 user nova-compute[74337]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 23 21:36:58 user nova-compute[74337]:     <disk type='file' device='disk'>
Oct 23 21:36:58 user nova-compute[74337]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 23 21:36:58 user nova-compute[74337]:       <source file='/opt/stack/data/nova/instances/8acc1b10-a541-4c06-aeb7-1ecf7a2457be/disk' index='2'/>
Oct 23 21:36:58 user nova-compute[74337]:       <backingStore type='file' index='3'>
Oct 23 21:36:58 user nova-compute[74337]:         <format type='raw'/>
Oct 23 21:36:58 user nova-compute[74337]:         <source file='/opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7'/>
Oct 23 21:36:58 user nova-compute[74337]:         <backingStore/>
Oct 23 21:36:58 user nova-compute[74337]:       </backingStore>
Oct 23 21:36:58 user nova-compute[74337]:       <target dev='vda' bus='virtio'/>
Oct 23 21:36:58 user nova-compute[74337]:       <alias name='virtio-disk0'/>
Oct 23 21:36:58 user nova-compute[74337]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 23 21:36:58 user nova-compute[74337]:     </disk>
Oct 23 21:36:58 user nova-compute[74337]:     <disk type='file' device='cdrom'>
Oct 23 21:36:58 user nova-compute[74337]:       <driver name='qemu' type='raw' cache='none'/>
Oct 23 21:36:58 user nova-compute[74337]:       <source file='/opt/stack/data/nova/instances/8acc1b10-a541-4c06-aeb7-1ecf7a2457be/disk.config' index='1'/>
Oct 23 21:36:58 user nova-compute[74337]:       <backingStore/>
Oct 23 21:36:58 user nova-compute[74337]:       <target dev='hda' bus='ide'/>
Oct 23 21:36:58 user nova-compute[74337]:       <readonly/>
Oct 23 21:36:58 user nova-compute[74337]:       <alias name='ide0-0-0'/>
Oct 23 21:36:58 user nova-compute[74337]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 23 21:36:58 user nova-compute[74337]:     </disk>
Oct 23 21:36:58 user nova-compute[74337]:     <controller type='usb' index='0' model='none'>
Oct 23 21:36:58 user nova-compute[74337]:       <alias name='usb'/>
Oct 23 21:36:58 user nova-compute[74337]:     </controller>
Oct 23 21:36:58 user nova-compute[74337]:     <controller type='pci' index='0' model='pci-root'>
Oct 23 21:36:58 user nova-compute[74337]:       <alias name='pci.0'/>
Oct 23 21:36:58 user nova-compute[74337]:     </controller>
Oct 23 21:36:58 user nova-compute[74337]:     <controller type='ide' index='0'>
Oct 23 21:36:58 user nova-compute[74337]:       <alias name='ide'/>
Oct 23 21:36:58 user nova-compute[74337]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 23 21:36:58 user nova-compute[74337]:     </controller>
Oct 23 21:36:58 user nova-compute[74337]:     <interface type='ethernet'>
Oct 23 21:36:58 user nova-compute[74337]:       <mac address='fa:16:3e:47:6a:0e'/>
Oct 23 21:36:58 user nova-compute[74337]:       <target dev='tap530b7241-14'/>
Oct 23 21:36:58 user nova-compute[74337]:       <model type='virtio'/>
Oct 23 21:36:58 user nova-compute[74337]:       <mtu size='1442'/>
Oct 23 21:36:58 user nova-compute[74337]:       <alias name='net0'/>
Oct 23 21:36:58 user nova-compute[74337]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 23 21:36:58 user nova-compute[74337]:     </interface>
Oct 23 21:36:58 user nova-compute[74337]:     <serial type='pty'>
Oct 23 21:36:58 user nova-compute[74337]:       <source path='/dev/pts/4'/>
Oct 23 21:36:58 user nova-compute[74337]:       <log file='/opt/stack/data/nova/instances/8acc1b10-a541-4c06-aeb7-1ecf7a2457be/console.log' append='off'/>
Oct 23 21:36:58 user nova-compute[74337]:       <target type='isa-serial' port='0'>
Oct 23 21:36:58 user nova-compute[74337]:         <model name='isa-serial'/>
Oct 23 21:36:58 user nova-compute[74337]:       </target>
Oct 23 21:36:58 user nova-compute[74337]:       <alias name='serial0'/>
Oct 23 21:36:58 user nova-compute[74337]:     </serial>
Oct 23 21:36:58 user nova-compute[74337]:     <console type='pty' tty='/dev/pts/4'>
Oct 23 21:36:58 user nova-compute[74337]:       <source path='/dev/pts/4'/>
Oct 23 21:36:58 user nova-compute[74337]:       <log file='/opt/stack/data/nova/instances/8acc1b10-a541-4c06-aeb7-1ecf7a2457be/console.log' append='off'/>
Oct 23 21:36:58 user nova-compute[74337]:       <target type='serial' port='0'/>
Oct 23 21:36:58 user nova-compute[74337]:       <alias name='serial0'/>
Oct 23 21:36:58 user nova-compute[74337]:     </console>
Oct 23 21:36:58 user nova-compute[74337]:     <input type='mouse' bus='ps2'>
Oct 23 21:36:58 user nova-compute[74337]:       <alias name='input0'/>
Oct 23 21:36:58 user nova-compute[74337]:     </input>
Oct 23 21:36:58 user nova-compute[74337]:     <input type='keyboard' bus='ps2'>
Oct 23 21:36:58 user nova-compute[74337]:       <alias name='input1'/>
Oct 23 21:36:58 user nova-compute[74337]:     </input>
Oct 23 21:36:58 user nova-compute[74337]:     <graphics type='vnc' port='5904' autoport='yes' listen='0.0.0.0'>
Oct 23 21:36:58 user nova-compute[74337]:       <listen type='address' address='0.0.0.0'/>
Oct 23 21:36:58 user nova-compute[74337]:     </graphics>
Oct 23 21:36:58 user nova-compute[74337]:     <audio id='1' type='none'/>
Oct 23 21:36:58 user nova-compute[74337]:     <video>
Oct 23 21:36:58 user nova-compute[74337]:       <model type='virtio' heads='1' primary='yes'/>
Oct 23 21:36:58 user nova-compute[74337]:       <alias name='video0'/>
Oct 23 21:36:58 user nova-compute[74337]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 23 21:36:58 user nova-compute[74337]:     </video>
Oct 23 21:36:58 user nova-compute[74337]:     <memballoon model='virtio'>
Oct 23 21:36:58 user nova-compute[74337]:       <stats period='10'/>
Oct 23 21:36:58 user nova-compute[74337]:       <alias name='balloon0'/>
Oct 23 21:36:58 user nova-compute[74337]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 23 21:36:58 user nova-compute[74337]:     </memballoon>
Oct 23 21:36:58 user nova-compute[74337]:     <rng model='virtio'>
Oct 23 21:36:58 user nova-compute[74337]:       <backend model='random'>/dev/urandom</backend>
Oct 23 21:36:58 user nova-compute[74337]:       <alias name='rng0'/>
Oct 23 21:36:58 user nova-compute[74337]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 23 21:36:58 user nova-compute[74337]:     </rng>
Oct 23 21:36:58 user nova-compute[74337]:   </devices>
Oct 23 21:36:58 user nova-compute[74337]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 23 21:36:58 user nova-compute[74337]:     <label>libvirt-8acc1b10-a541-4c06-aeb7-1ecf7a2457be</label>
Oct 23 21:36:58 user nova-compute[74337]:     <imagelabel>libvirt-8acc1b10-a541-4c06-aeb7-1ecf7a2457be</imagelabel>
Oct 23 21:36:58 user nova-compute[74337]:   </seclabel>
Oct 23 21:36:58 user nova-compute[74337]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 23 21:36:58 user nova-compute[74337]:     <label>+64055:+108</label>
Oct 23 21:36:58 user nova-compute[74337]:     <imagelabel>+64055:+108</imagelabel>
Oct 23 21:36:58 user nova-compute[74337]:   </seclabel>
Oct 23 21:36:58 user nova-compute[74337]: </domain>
Oct 23 21:36:58 user nova-compute[74337]:  {{(pid=74337) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 23 21:36:58 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [req-d44f3010-f2bc-4e4d-8b0d-d54a37946644 req-243c76a9-0da8-4b38-b13d-df2ab99258b9 service nova] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] Detaching interface fa:16:3e:6d:56:bf failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tape522a54f-9f' not found.
Oct 23 21:36:58 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [req-d44f3010-f2bc-4e4d-8b0d-d54a37946644 req-243c76a9-0da8-4b38-b13d-df2ab99258b9 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T21:33:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1843796381',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1843796381',id=5,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAop3qssYFI+MVvFuH2+7gwm//7zwcdy6tYm9eD42fbRzv89CUtru1RL8WlSDZgdlRSrkM4Tb4QtCQmTEE7AA2YXPHv9z6iJ2d9asZLABlNx58K0PwTsdZsKKihbdIgMOg==',key_name='tempest-keypair-586099674',keypairs=<?>,launch_index=0,launched_at=2023-10-23T21:33:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='84d7baedb5f74976be4b0cf308964086',ramdisk_id='',reservation_id='r-4zf725dv',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2141482979',owner_user_name='tempest-TaggedAttachmentsTest-2141482979-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T21:33:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec1a4c2d1f9b4983ab9124c7f6056da6',uuid=8acc1b10-a541-4c06-aeb7-1ecf7a2457be,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e522a54f-9f6f-4224-a928-97d630fc5080", "address": "fa:16:3e:6d:56:bf", "network": {"id": "db77b1d7-f969-40a5-918c-5706fb1ec6bd", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1231224947", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "84d7baedb5f74976be4b0cf308964086", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape522a54f-9f", "ovs_interfaceid": "e522a54f-9f6f-4224-a928-97d630fc5080", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 21:36:58 user nova-compute[74337]: DEBUG nova.network.os_vif_util [req-d44f3010-f2bc-4e4d-8b0d-d54a37946644 req-243c76a9-0da8-4b38-b13d-df2ab99258b9 service nova] Converting VIF {"id": "e522a54f-9f6f-4224-a928-97d630fc5080", "address": "fa:16:3e:6d:56:bf", "network": {"id": "db77b1d7-f969-40a5-918c-5706fb1ec6bd", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1231224947", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "84d7baedb5f74976be4b0cf308964086", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape522a54f-9f", "ovs_interfaceid": "e522a54f-9f6f-4224-a928-97d630fc5080", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:36:58 user nova-compute[74337]: DEBUG nova.network.os_vif_util [req-d44f3010-f2bc-4e4d-8b0d-d54a37946644 req-243c76a9-0da8-4b38-b13d-df2ab99258b9 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:56:bf,bridge_name='br-int',has_traffic_filtering=True,id=e522a54f-9f6f-4224-a928-97d630fc5080,network=Network(db77b1d7-f969-40a5-918c-5706fb1ec6bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape522a54f-9f') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:36:58 user nova-compute[74337]: DEBUG os_vif [req-d44f3010-f2bc-4e4d-8b0d-d54a37946644 req-243c76a9-0da8-4b38-b13d-df2ab99258b9 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:56:bf,bridge_name='br-int',has_traffic_filtering=True,id=e522a54f-9f6f-4224-a928-97d630fc5080,network=Network(db77b1d7-f969-40a5-918c-5706fb1ec6bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape522a54f-9f') {{(pid=74337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 21:36:58 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:36:58 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape522a54f-9f, bridge=br-int, if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:36:58 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 21:36:58 user nova-compute[74337]: INFO os_vif [req-d44f3010-f2bc-4e4d-8b0d-d54a37946644 req-243c76a9-0da8-4b38-b13d-df2ab99258b9 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:56:bf,bridge_name='br-int',has_traffic_filtering=True,id=e522a54f-9f6f-4224-a928-97d630fc5080,network=Network(db77b1d7-f969-40a5-918c-5706fb1ec6bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape522a54f-9f')
Oct 23 21:36:58 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [req-d44f3010-f2bc-4e4d-8b0d-d54a37946644 req-243c76a9-0da8-4b38-b13d-df2ab99258b9 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 21:36:58 user nova-compute[74337]:   <nova:package version="0.0.0"/>
Oct 23 21:36:58 user nova-compute[74337]:   <nova:name>tempest-device-tagging-server-1843796381</nova:name>
Oct 23 21:36:58 user nova-compute[74337]:   <nova:creationTime>2023-10-23 21:36:58</nova:creationTime>
Oct 23 21:36:58 user nova-compute[74337]:   <nova:flavor name="m1.tiny">
Oct 23 21:36:58 user nova-compute[74337]:     <nova:memory>512</nova:memory>
Oct 23 21:36:58 user nova-compute[74337]:     <nova:disk>1</nova:disk>
Oct 23 21:36:58 user nova-compute[74337]:     <nova:swap>0</nova:swap>
Oct 23 21:36:58 user nova-compute[74337]:     <nova:ephemeral>0</nova:ephemeral>
Oct 23 21:36:58 user nova-compute[74337]:     <nova:vcpus>1</nova:vcpus>
Oct 23 21:36:58 user nova-compute[74337]:   </nova:flavor>
Oct 23 21:36:58 user nova-compute[74337]:   <nova:owner>
Oct 23 21:36:58 user nova-compute[74337]:     <nova:user uuid="ec1a4c2d1f9b4983ab9124c7f6056da6">tempest-TaggedAttachmentsTest-2141482979-project-member</nova:user>
Oct 23 21:36:58 user nova-compute[74337]:     <nova:project uuid="84d7baedb5f74976be4b0cf308964086">tempest-TaggedAttachmentsTest-2141482979</nova:project>
Oct 23 21:36:58 user nova-compute[74337]:   </nova:owner>
Oct 23 21:36:58 user nova-compute[74337]:   <nova:root type="image" uuid="d859d89d-998d-4109-b26a-0d6e28152932"/>
Oct 23 21:36:58 user nova-compute[74337]:   <nova:ports>
Oct 23 21:36:58 user nova-compute[74337]:     <nova:port uuid="530b7241-1498-47dc-8a6f-79e6c9cc850a">
Oct 23 21:36:58 user nova-compute[74337]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 23 21:36:58 user nova-compute[74337]:     </nova:port>
Oct 23 21:36:58 user nova-compute[74337]:   </nova:ports>
Oct 23 21:36:58 user nova-compute[74337]: </nova:instance>
Oct 23 21:36:58 user nova-compute[74337]:  {{(pid=74337) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Oct 23 21:36:58 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:36:58 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Starting heal instance info cache {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 21:36:58 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-c5ea4e55-3476-4b19-9916-a5f684857ad5 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Acquiring lock "d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:36:58 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-c5ea4e55-3476-4b19-9916-a5f684857ad5 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Lock "d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:36:58 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "refresh_cache-d45e8ae8-371b-46ae-849d-d7f7d5bbd770" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:36:58 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquired lock "refresh_cache-d45e8ae8-371b-46ae-849d-d7f7d5bbd770" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:36:58 user nova-compute[74337]: DEBUG nova.network.neutron [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: d45e8ae8-371b-46ae-849d-d7f7d5bbd770] Forcefully refreshing network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 21:36:58 user nova-compute[74337]: DEBUG nova.objects.instance [None req-c5ea4e55-3476-4b19-9916-a5f684857ad5 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Lazy-loading 'flavor' on Instance uuid d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:36:58 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-c5ea4e55-3476-4b19-9916-a5f684857ad5 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Lock "d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.072s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:36:58 user nova-compute[74337]: DEBUG nova.network.neutron [None req-24f2dab4-e01c-4b8e-997c-adb9627134a5 tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] Updating instance_info_cache with network_info: [{"id": "530b7241-1498-47dc-8a6f-79e6c9cc850a", "address": "fa:16:3e:47:6a:0e", "network": {"id": "44c67162-ce40-4b2b-bc3e-07b0203e2083", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1341457246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84d7baedb5f74976be4b0cf308964086", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap530b7241-14", "ovs_interfaceid": "530b7241-1498-47dc-8a6f-79e6c9cc850a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:36:58 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-24f2dab4-e01c-4b8e-997c-adb9627134a5 tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Releasing lock "refresh_cache-8acc1b10-a541-4c06-aeb7-1ecf7a2457be" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:36:58 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-38698931-8b4e-42b5-8b4e-91745e8a6e38 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:36:58 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-38698931-8b4e-42b5-8b4e-91745e8a6e38 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:36:58 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-24f2dab4-e01c-4b8e-997c-adb9627134a5 tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Lock "interface-8acc1b10-a541-4c06-aeb7-1ecf7a2457be-e522a54f-9f6f-4224-a928-97d630fc5080" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.817s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:36:58 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-c5ea4e55-3476-4b19-9916-a5f684857ad5 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Acquiring lock "d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:36:58 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-c5ea4e55-3476-4b19-9916-a5f684857ad5 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Lock "d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:36:58 user nova-compute[74337]: INFO nova.compute.manager [None req-c5ea4e55-3476-4b19-9916-a5f684857ad5 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Attaching volume 61659946-05f4-49d5-9e10-69b68340b522 to /dev/vdb
Oct 23 21:36:58 user nova-compute[74337]: DEBUG os_brick.utils [None req-c5ea4e55-3476-4b19-9916-a5f684857ad5 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:36:58 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:59 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.027s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:59 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ecbb7a1-1f9e-4725-8f5d-2430b0dd95b9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f34011b66e40\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:59 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-38698931-8b4e-42b5-8b4e-91745e8a6e38 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.877s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:36:59 user nova-compute[74337]: DEBUG nova.compute.manager [None req-38698931-8b4e-42b5-8b4e-91745e8a6e38 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] [instance: b193f267-2ca2-47c5-bd6c-397b1e041d4a] Start building networks asynchronously for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 21:36:59 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:59 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:59 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[80045e6a-823e-4483-aead-4c229009b2cc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:59 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:59 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:59 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[371b93e5-9ef6-448b-8d32-ccccfc4d12aa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:59 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffad7fa9-58a0-4212-8461-5d48f867715b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:59 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-c5ea4e55-3476-4b19-9916-a5f684857ad5 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Running cmd (subprocess): nvme version {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:59 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-c5ea4e55-3476-4b19-9916-a5f684857ad5 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] 'nvme version' failed. Not Retrying. {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 21:36:59 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c5ea4e55-3476-4b19-9916-a5f684857ad5 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] nvme not present on system {{(pid=74337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 21:36:59 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:59 user nova-compute[74337]: DEBUG nova.compute.manager [None req-38698931-8b4e-42b5-8b4e-91745e8a6e38 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] [instance: b193f267-2ca2-47c5-bd6c-397b1e041d4a] Allocating IP information in the background. {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 21:36:59 user nova-compute[74337]: DEBUG nova.network.neutron [None req-38698931-8b4e-42b5-8b4e-91745e8a6e38 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] [instance: b193f267-2ca2-47c5-bd6c-397b1e041d4a] allocate_for_instance() {{(pid=74337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 21:36:59 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 21:36:59 user nova-compute[74337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 21:36:59 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[1017537a-a79b-401d-9d7e-00ba0f042b98]: (4, '') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:36:59 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-c5ea4e55-3476-4b19-9916-a5f684857ad5 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 21:36:59 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-c5ea4e55-3476-4b19-9916-a5f684857ad5 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 21:36:59 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-c5ea4e55-3476-4b19-9916-a5f684857ad5 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] LIGHTOS: no hostnqn found. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 21:36:59 user nova-compute[74337]: DEBUG os_brick.utils [None req-c5ea4e55-3476-4b19-9916-a5f684857ad5 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] <== get_connector_properties: return (169ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f34011b66e40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:36:59 user nova-compute[74337]: DEBUG nova.virt.block_device [None req-c5ea4e55-3476-4b19-9916-a5f684857ad5 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Updating existing volume attachment record: b4b5c8a0-c9e3-4c7d-afc2-d386ff3b8f57 {{(pid=74337) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 21:36:59 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-38698931-8b4e-42b5-8b4e-91745e8a6e38 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] [instance: b193f267-2ca2-47c5-bd6c-397b1e041d4a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 21:36:59 user nova-compute[74337]: DEBUG nova.compute.manager [None req-38698931-8b4e-42b5-8b4e-91745e8a6e38 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] [instance: b193f267-2ca2-47c5-bd6c-397b1e041d4a] Start building block device mappings for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 21:36:59 user nova-compute[74337]: DEBUG nova.network.neutron [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: d45e8ae8-371b-46ae-849d-d7f7d5bbd770] Updating instance_info_cache with network_info: [{"id": "7ac73679-68b0-430f-8d77-68438fbb52f0", "address": "fa:16:3e:9b:5f:a0", "network": {"id": "9fa29b5e-b3c7-4890-9d82-d9524e4cb78a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-89037375-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "997b9ab7d2794438be79f11bb972be47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ac73679-68", "ovs_interfaceid": "7ac73679-68b0-430f-8d77-68438fbb52f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:36:59 user nova-compute[74337]: DEBUG nova.policy [None req-38698931-8b4e-42b5-8b4e-91745e8a6e38 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1106b04eeefe488c9ead914063b88d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '997b9ab7d2794438be79f11bb972be47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74337) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 21:36:59 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Releasing lock "refresh_cache-d45e8ae8-371b-46ae-849d-d7f7d5bbd770" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:36:59 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: d45e8ae8-371b-46ae-849d-d7f7d5bbd770] Updated the network info_cache for instance {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 21:36:59 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:36:59 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:36:59 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:36:59 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 21:36:59 user nova-compute[74337]: DEBUG nova.compute.manager [None req-38698931-8b4e-42b5-8b4e-91745e8a6e38 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] [instance: b193f267-2ca2-47c5-bd6c-397b1e041d4a] Start spawning the instance on the hypervisor. {{(pid=74337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 21:36:59 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-38698931-8b4e-42b5-8b4e-91745e8a6e38 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] [instance: b193f267-2ca2-47c5-bd6c-397b1e041d4a] Creating instance directory {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 21:36:59 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-38698931-8b4e-42b5-8b4e-91745e8a6e38 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] [instance: b193f267-2ca2-47c5-bd6c-397b1e041d4a] Creating image(s)
Oct 23 21:36:59 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-38698931-8b4e-42b5-8b4e-91745e8a6e38 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Acquiring lock "/opt/stack/data/nova/instances/b193f267-2ca2-47c5-bd6c-397b1e041d4a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:36:59 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-38698931-8b4e-42b5-8b4e-91745e8a6e38 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Lock "/opt/stack/data/nova/instances/b193f267-2ca2-47c5-bd6c-397b1e041d4a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:36:59 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-38698931-8b4e-42b5-8b4e-91745e8a6e38 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Lock "/opt/stack/data/nova/instances/b193f267-2ca2-47c5-bd6c-397b1e041d4a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:36:59 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-38698931-8b4e-42b5-8b4e-91745e8a6e38 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:59 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-38698931-8b4e-42b5-8b4e-91745e8a6e38 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.207s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:59 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-38698931-8b4e-42b5-8b4e-91745e8a6e38 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Acquiring lock "fc7b140751b8c385de81623e40fb09ce09374ab7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:36:59 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-38698931-8b4e-42b5-8b4e-91745e8a6e38 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Lock "fc7b140751b8c385de81623e40fb09ce09374ab7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:36:59 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-38698931-8b4e-42b5-8b4e-91745e8a6e38 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:59 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-38698931-8b4e-42b5-8b4e-91745e8a6e38 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.222s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:59 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-38698931-8b4e-42b5-8b4e-91745e8a6e38 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7,backing_fmt=raw /opt/stack/data/nova/instances/b193f267-2ca2-47c5-bd6c-397b1e041d4a/disk 1073741824 {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:36:59 user nova-compute[74337]: DEBUG nova.network.neutron [None req-38698931-8b4e-42b5-8b4e-91745e8a6e38 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] [instance: b193f267-2ca2-47c5-bd6c-397b1e041d4a] Successfully created port: f2fe3e4e-05fe-4b23-8ce5-08dbc1e350f5 {{(pid=74337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 21:36:59 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-38698931-8b4e-42b5-8b4e-91745e8a6e38 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7,backing_fmt=raw /opt/stack/data/nova/instances/b193f267-2ca2-47c5-bd6c-397b1e041d4a/disk 1073741824" returned: 0 in 0.071s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:36:59 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-38698931-8b4e-42b5-8b4e-91745e8a6e38 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Lock "fc7b140751b8c385de81623e40fb09ce09374ab7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.298s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:36:59 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-38698931-8b4e-42b5-8b4e-91745e8a6e38 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:00 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-38698931-8b4e-42b5-8b4e-91745e8a6e38 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.208s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:00 user nova-compute[74337]: DEBUG nova.virt.disk.api [None req-38698931-8b4e-42b5-8b4e-91745e8a6e38 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b193f267-2ca2-47c5-bd6c-397b1e041d4a/disk. size=1073741824 {{(pid=74337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 21:37:00 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-38698931-8b4e-42b5-8b4e-91745e8a6e38 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b193f267-2ca2-47c5-bd6c-397b1e041d4a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:00 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-38698931-8b4e-42b5-8b4e-91745e8a6e38 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b193f267-2ca2-47c5-bd6c-397b1e041d4a/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:00 user nova-compute[74337]: DEBUG nova.virt.disk.api [None req-38698931-8b4e-42b5-8b4e-91745e8a6e38 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Cannot resize image /opt/stack/data/nova/instances/b193f267-2ca2-47c5-bd6c-397b1e041d4a/disk to a smaller size. {{(pid=74337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 21:37:00 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-38698931-8b4e-42b5-8b4e-91745e8a6e38 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] [instance: b193f267-2ca2-47c5-bd6c-397b1e041d4a] Created local disks {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 21:37:00 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-38698931-8b4e-42b5-8b4e-91745e8a6e38 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] [instance: b193f267-2ca2-47c5-bd6c-397b1e041d4a] Ensure instance console log exists: /opt/stack/data/nova/instances/b193f267-2ca2-47c5-bd6c-397b1e041d4a/console.log {{(pid=74337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 21:37:00 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-38698931-8b4e-42b5-8b4e-91745e8a6e38 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:37:00 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-38698931-8b4e-42b5-8b4e-91745e8a6e38 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:37:00 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-38698931-8b4e-42b5-8b4e-91745e8a6e38 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:37:00 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:37:00 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:37:00 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:37:00 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:37:00 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:37:00 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Auditing locally available compute resources for user (node: user) {{(pid=74337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 21:37:00 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a181593-8086-4ece-9f5b-5ccba0bfe91e/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:00 user nova-compute[74337]: DEBUG nova.network.neutron [None req-38698931-8b4e-42b5-8b4e-91745e8a6e38 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] [instance: b193f267-2ca2-47c5-bd6c-397b1e041d4a] Successfully updated port: f2fe3e4e-05fe-4b23-8ce5-08dbc1e350f5 {{(pid=74337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 21:37:00 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-38698931-8b4e-42b5-8b4e-91745e8a6e38 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Acquiring lock "refresh_cache-b193f267-2ca2-47c5-bd6c-397b1e041d4a" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:37:00 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-38698931-8b4e-42b5-8b4e-91745e8a6e38 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Acquired lock "refresh_cache-b193f267-2ca2-47c5-bd6c-397b1e041d4a" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:37:00 user nova-compute[74337]: DEBUG nova.network.neutron [None req-38698931-8b4e-42b5-8b4e-91745e8a6e38 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] [instance: b193f267-2ca2-47c5-bd6c-397b1e041d4a] Building network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 21:37:00 user nova-compute[74337]: DEBUG nova.compute.manager [req-c4ce1872-8de6-4d0d-bafa-88b465457325 req-c70fa7bd-7659-49d3-80cb-eb9bbf06e465 service nova] [instance: b193f267-2ca2-47c5-bd6c-397b1e041d4a] Received event network-changed-f2fe3e4e-05fe-4b23-8ce5-08dbc1e350f5 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:37:00 user nova-compute[74337]: DEBUG nova.compute.manager [req-c4ce1872-8de6-4d0d-bafa-88b465457325 req-c70fa7bd-7659-49d3-80cb-eb9bbf06e465 service nova] [instance: b193f267-2ca2-47c5-bd6c-397b1e041d4a] Refreshing instance network info cache due to event network-changed-f2fe3e4e-05fe-4b23-8ce5-08dbc1e350f5. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 21:37:00 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-c4ce1872-8de6-4d0d-bafa-88b465457325 req-c70fa7bd-7659-49d3-80cb-eb9bbf06e465 service nova] Acquiring lock "refresh_cache-b193f267-2ca2-47c5-bd6c-397b1e041d4a" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:37:00 user nova-compute[74337]: DEBUG nova.network.neutron [None req-38698931-8b4e-42b5-8b4e-91745e8a6e38 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] [instance: b193f267-2ca2-47c5-bd6c-397b1e041d4a] Instance cache missing network info. {{(pid=74337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 21:37:00 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a181593-8086-4ece-9f5b-5ccba0bfe91e/disk --force-share --output=json" returned: 0 in 0.285s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:00 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a181593-8086-4ece-9f5b-5ccba0bfe91e/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a181593-8086-4ece-9f5b-5ccba0bfe91e/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:01 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 21:37:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8acc1b10-a541-4c06-aeb7-1ecf7a2457be/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:01 user nova-compute[74337]: DEBUG nova.network.neutron [None req-38698931-8b4e-42b5-8b4e-91745e8a6e38 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] [instance: b193f267-2ca2-47c5-bd6c-397b1e041d4a] Updating instance_info_cache with network_info: [{"id": "f2fe3e4e-05fe-4b23-8ce5-08dbc1e350f5", "address": "fa:16:3e:8a:70:da", "network": {"id": "9fa29b5e-b3c7-4890-9d82-d9524e4cb78a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-89037375-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "997b9ab7d2794438be79f11bb972be47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2fe3e4e-05", "ovs_interfaceid": "f2fe3e4e-05fe-4b23-8ce5-08dbc1e350f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:37:01 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-38698931-8b4e-42b5-8b4e-91745e8a6e38 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Releasing lock "refresh_cache-b193f267-2ca2-47c5-bd6c-397b1e041d4a" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:37:01 user nova-compute[74337]: DEBUG nova.compute.manager [None req-38698931-8b4e-42b5-8b4e-91745e8a6e38 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] [instance: b193f267-2ca2-47c5-bd6c-397b1e041d4a] Instance network_info: |[{"id": "f2fe3e4e-05fe-4b23-8ce5-08dbc1e350f5", "address": "fa:16:3e:8a:70:da", "network": {"id": "9fa29b5e-b3c7-4890-9d82-d9524e4cb78a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-89037375-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "997b9ab7d2794438be79f11bb972be47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2fe3e4e-05", "ovs_interfaceid": "f2fe3e4e-05fe-4b23-8ce5-08dbc1e350f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 21:37:01 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-c4ce1872-8de6-4d0d-bafa-88b465457325 req-c70fa7bd-7659-49d3-80cb-eb9bbf06e465 service nova] Acquired lock "refresh_cache-b193f267-2ca2-47c5-bd6c-397b1e041d4a" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:37:01 user nova-compute[74337]: DEBUG nova.network.neutron [req-c4ce1872-8de6-4d0d-bafa-88b465457325 req-c70fa7bd-7659-49d3-80cb-eb9bbf06e465 service nova] [instance: b193f267-2ca2-47c5-bd6c-397b1e041d4a] Refreshing network info cache for port f2fe3e4e-05fe-4b23-8ce5-08dbc1e350f5 {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 21:37:01 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-38698931-8b4e-42b5-8b4e-91745e8a6e38 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] [instance: b193f267-2ca2-47c5-bd6c-397b1e041d4a] Start _get_guest_xml network_info=[{"id": "f2fe3e4e-05fe-4b23-8ce5-08dbc1e350f5", "address": "fa:16:3e:8a:70:da", "network": {"id": "9fa29b5e-b3c7-4890-9d82-d9524e4cb78a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-89037375-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "997b9ab7d2794438be79f11bb972be47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2fe3e4e-05", "ovs_interfaceid": "f2fe3e4e-05fe-4b23-8ce5-08dbc1e350f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T21:29:21Z,direct_url=<?>,disk_format='qcow2',id=d859d89d-998d-4109-b26a-0d6e28152932,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ff43462300764979a6cf688444336a56',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T21:29:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'image_id': 'd859d89d-998d-4109-b26a-0d6e28152932'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 21:37:01 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-38698931-8b4e-42b5-8b4e-91745e8a6e38 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:37:01 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-38698931-8b4e-42b5-8b4e-91745e8a6e38 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:37:01 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-38698931-8b4e-42b5-8b4e-91745e8a6e38 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 21:37:01 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-38698931-8b4e-42b5-8b4e-91745e8a6e38 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] CPU controller missing on host. {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 21:37:01 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-38698931-8b4e-42b5-8b4e-91745e8a6e38 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 21:37:01 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-38698931-8b4e-42b5-8b4e-91745e8a6e38 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] CPU controller found on host. {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 21:37:01 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-38698931-8b4e-42b5-8b4e-91745e8a6e38 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 21:37:01 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-38698931-8b4e-42b5-8b4e-91745e8a6e38 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T21:29:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T21:29:21Z,direct_url=<?>,disk_format='qcow2',id=d859d89d-998d-4109-b26a-0d6e28152932,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ff43462300764979a6cf688444336a56',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T21:29:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 21:37:01 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-38698931-8b4e-42b5-8b4e-91745e8a6e38 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Flavor limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 21:37:01 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-38698931-8b4e-42b5-8b4e-91745e8a6e38 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Image limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 21:37:01 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-38698931-8b4e-42b5-8b4e-91745e8a6e38 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Flavor pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 21:37:01 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-38698931-8b4e-42b5-8b4e-91745e8a6e38 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Image pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 21:37:01 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-38698931-8b4e-42b5-8b4e-91745e8a6e38 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 21:37:01 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-38698931-8b4e-42b5-8b4e-91745e8a6e38 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 21:37:01 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-38698931-8b4e-42b5-8b4e-91745e8a6e38 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 21:37:01 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-38698931-8b4e-42b5-8b4e-91745e8a6e38 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Got 1 possible topologies {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 21:37:01 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-38698931-8b4e-42b5-8b4e-91745e8a6e38 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 21:37:01 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-38698931-8b4e-42b5-8b4e-91745e8a6e38 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 21:37:01 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-38698931-8b4e-42b5-8b4e-91745e8a6e38 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:36:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-670537481',display_name='tempest-VolumesAdminNegativeTest-server-670537481',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-670537481',id=13,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='997b9ab7d2794438be79f11bb972be47',ramdisk_id='',reservation_id='r-5eipq1eo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-547225907',owner_user_name='tempest-VolumesAdminNegativeTest-547225907-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:36:59Z,user_data=None,user_id='1106b04eeefe488c9ead914063b88d33',uuid=b193f267-2ca2-47c5-bd6c-397b1e041d4a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f2fe3e4e-05fe-4b23-8ce5-08dbc1e350f5", "address": "fa:16:3e:8a:70:da", "network": {"id": "9fa29b5e-b3c7-4890-9d82-d9524e4cb78a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-89037375-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "997b9ab7d2794438be79f11bb972be47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2fe3e4e-05", "ovs_interfaceid": "f2fe3e4e-05fe-4b23-8ce5-08dbc1e350f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 21:37:01 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-38698931-8b4e-42b5-8b4e-91745e8a6e38 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Converting VIF {"id": "f2fe3e4e-05fe-4b23-8ce5-08dbc1e350f5", "address": "fa:16:3e:8a:70:da", "network": {"id": "9fa29b5e-b3c7-4890-9d82-d9524e4cb78a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-89037375-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "997b9ab7d2794438be79f11bb972be47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2fe3e4e-05", "ovs_interfaceid": "f2fe3e4e-05fe-4b23-8ce5-08dbc1e350f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:37:01 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-38698931-8b4e-42b5-8b4e-91745e8a6e38 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:70:da,bridge_name='br-int',has_traffic_filtering=True,id=f2fe3e4e-05fe-4b23-8ce5-08dbc1e350f5,network=Network(9fa29b5e-b3c7-4890-9d82-d9524e4cb78a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2fe3e4e-05') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:37:01 user nova-compute[74337]: DEBUG nova.objects.instance [None req-38698931-8b4e-42b5-8b4e-91745e8a6e38 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Lazy-loading 'pci_devices' on Instance uuid b193f267-2ca2-47c5-bd6c-397b1e041d4a {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:37:01 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-38698931-8b4e-42b5-8b4e-91745e8a6e38 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] [instance: b193f267-2ca2-47c5-bd6c-397b1e041d4a] End _get_guest_xml xml=<domain type="kvm">
Oct 23 21:37:01 user nova-compute[74337]:   <uuid>b193f267-2ca2-47c5-bd6c-397b1e041d4a</uuid>
Oct 23 21:37:01 user nova-compute[74337]:   <name>instance-0000000d</name>
Oct 23 21:37:01 user nova-compute[74337]:   <memory>524288</memory>
Oct 23 21:37:01 user nova-compute[74337]:   <vcpu>1</vcpu>
Oct 23 21:37:01 user nova-compute[74337]:   <metadata>
Oct 23 21:37:01 user nova-compute[74337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 21:37:01 user nova-compute[74337]:       <nova:package version="0.0.0"/>
Oct 23 21:37:01 user nova-compute[74337]:       <nova:name>tempest-VolumesAdminNegativeTest-server-670537481</nova:name>
Oct 23 21:37:01 user nova-compute[74337]:       <nova:creationTime>2023-10-23 21:37:01</nova:creationTime>
Oct 23 21:37:01 user nova-compute[74337]:       <nova:flavor name="m1.tiny">
Oct 23 21:37:01 user nova-compute[74337]:         <nova:memory>512</nova:memory>
Oct 23 21:37:01 user nova-compute[74337]:         <nova:disk>1</nova:disk>
Oct 23 21:37:01 user nova-compute[74337]:         <nova:swap>0</nova:swap>
Oct 23 21:37:01 user nova-compute[74337]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 21:37:01 user nova-compute[74337]:         <nova:vcpus>1</nova:vcpus>
Oct 23 21:37:01 user nova-compute[74337]:       </nova:flavor>
Oct 23 21:37:01 user nova-compute[74337]:       <nova:owner>
Oct 23 21:37:01 user nova-compute[74337]:         <nova:user uuid="1106b04eeefe488c9ead914063b88d33">tempest-VolumesAdminNegativeTest-547225907-project-member</nova:user>
Oct 23 21:37:01 user nova-compute[74337]:         <nova:project uuid="997b9ab7d2794438be79f11bb972be47">tempest-VolumesAdminNegativeTest-547225907</nova:project>
Oct 23 21:37:01 user nova-compute[74337]:       </nova:owner>
Oct 23 21:37:01 user nova-compute[74337]:       <nova:root type="image" uuid="d859d89d-998d-4109-b26a-0d6e28152932"/>
Oct 23 21:37:01 user nova-compute[74337]:       <nova:ports>
Oct 23 21:37:01 user nova-compute[74337]:         <nova:port uuid="f2fe3e4e-05fe-4b23-8ce5-08dbc1e350f5">
Oct 23 21:37:01 user nova-compute[74337]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 23 21:37:01 user nova-compute[74337]:         </nova:port>
Oct 23 21:37:01 user nova-compute[74337]:       </nova:ports>
Oct 23 21:37:01 user nova-compute[74337]:     </nova:instance>
Oct 23 21:37:01 user nova-compute[74337]:   </metadata>
Oct 23 21:37:01 user nova-compute[74337]:   <sysinfo type="smbios">
Oct 23 21:37:01 user nova-compute[74337]:     <system>
Oct 23 21:37:01 user nova-compute[74337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 21:37:01 user nova-compute[74337]:       <entry name="product">OpenStack Nova</entry>
Oct 23 21:37:01 user nova-compute[74337]:       <entry name="version">0.0.0</entry>
Oct 23 21:37:01 user nova-compute[74337]:       <entry name="serial">b193f267-2ca2-47c5-bd6c-397b1e041d4a</entry>
Oct 23 21:37:01 user nova-compute[74337]:       <entry name="uuid">b193f267-2ca2-47c5-bd6c-397b1e041d4a</entry>
Oct 23 21:37:01 user nova-compute[74337]:       <entry name="family">Virtual Machine</entry>
Oct 23 21:37:01 user nova-compute[74337]:     </system>
Oct 23 21:37:01 user nova-compute[74337]:   </sysinfo>
Oct 23 21:37:01 user nova-compute[74337]:   <os>
Oct 23 21:37:01 user nova-compute[74337]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 21:37:01 user nova-compute[74337]:     <boot dev="hd"/>
Oct 23 21:37:01 user nova-compute[74337]:     <smbios mode="sysinfo"/>
Oct 23 21:37:01 user nova-compute[74337]:   </os>
Oct 23 21:37:01 user nova-compute[74337]:   <features>
Oct 23 21:37:01 user nova-compute[74337]:     <acpi/>
Oct 23 21:37:01 user nova-compute[74337]:     <apic/>
Oct 23 21:37:01 user nova-compute[74337]:     <vmcoreinfo/>
Oct 23 21:37:01 user nova-compute[74337]:   </features>
Oct 23 21:37:01 user nova-compute[74337]:   <clock offset="utc">
Oct 23 21:37:01 user nova-compute[74337]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 21:37:01 user nova-compute[74337]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 21:37:01 user nova-compute[74337]:     <timer name="hpet" present="no"/>
Oct 23 21:37:01 user nova-compute[74337]:   </clock>
Oct 23 21:37:01 user nova-compute[74337]:   <cpu mode="custom" match="exact">
Oct 23 21:37:01 user nova-compute[74337]:     <model>Nehalem</model>
Oct 23 21:37:01 user nova-compute[74337]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 21:37:01 user nova-compute[74337]:   </cpu>
Oct 23 21:37:01 user nova-compute[74337]:   <devices>
Oct 23 21:37:01 user nova-compute[74337]:     <disk type="file" device="disk">
Oct 23 21:37:01 user nova-compute[74337]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 21:37:01 user nova-compute[74337]:       <source file="/opt/stack/data/nova/instances/b193f267-2ca2-47c5-bd6c-397b1e041d4a/disk"/>
Oct 23 21:37:01 user nova-compute[74337]:       <target dev="vda" bus="virtio"/>
Oct 23 21:37:01 user nova-compute[74337]:     </disk>
Oct 23 21:37:01 user nova-compute[74337]:     <interface type="ethernet">
Oct 23 21:37:01 user nova-compute[74337]:       <mac address="fa:16:3e:8a:70:da"/>
Oct 23 21:37:01 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:37:01 user nova-compute[74337]:       <mtu size="1442"/>
Oct 23 21:37:01 user nova-compute[74337]:       <target dev="tapf2fe3e4e-05"/>
Oct 23 21:37:01 user nova-compute[74337]:     </interface>
Oct 23 21:37:01 user nova-compute[74337]:     <serial type="pty">
Oct 23 21:37:01 user nova-compute[74337]:       <log file="/opt/stack/data/nova/instances/b193f267-2ca2-47c5-bd6c-397b1e041d4a/console.log" append="off"/>
Oct 23 21:37:01 user nova-compute[74337]:     </serial>
Oct 23 21:37:01 user nova-compute[74337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 21:37:01 user nova-compute[74337]:     <video>
Oct 23 21:37:01 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:37:01 user nova-compute[74337]:     </video>
Oct 23 21:37:01 user nova-compute[74337]:     <rng model="virtio">
Oct 23 21:37:01 user nova-compute[74337]:       <backend model="random">/dev/urandom</backend>
Oct 23 21:37:01 user nova-compute[74337]:     </rng>
Oct 23 21:37:01 user nova-compute[74337]:     <controller type="usb" index="0" model="none"/>
Oct 23 21:37:01 user nova-compute[74337]:     <memballoon model="virtio">
Oct 23 21:37:01 user nova-compute[74337]:       <stats period="10"/>
Oct 23 21:37:01 user nova-compute[74337]:     </memballoon>
Oct 23 21:37:01 user nova-compute[74337]:   </devices>
Oct 23 21:37:01 user nova-compute[74337]: </domain>
Oct 23 21:37:01 user nova-compute[74337]:  {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 21:37:01 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-38698931-8b4e-42b5-8b4e-91745e8a6e38 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:36:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-670537481',display_name='tempest-VolumesAdminNegativeTest-server-670537481',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-670537481',id=13,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='997b9ab7d2794438be79f11bb972be47',ramdisk_id='',reservation_id='r-5eipq1eo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-547225907',owner_user_name='tempest-VolumesAdminNegativeTest-547225907-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:36:59Z,user_data=None,user_id='1106b04eeefe488c9ead914063b88d33',uuid=b193f267-2ca2-47c5-bd6c-397b1e041d4a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f2fe3e4e-05fe-4b23-8ce5-08dbc1e350f5", "address": "fa:16:3e:8a:70:da", "network": {"id": "9fa29b5e-b3c7-4890-9d82-d9524e4cb78a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-89037375-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "997b9ab7d2794438be79f11bb972be47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2fe3e4e-05", "ovs_interfaceid": "f2fe3e4e-05fe-4b23-8ce5-08dbc1e350f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 21:37:01 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-38698931-8b4e-42b5-8b4e-91745e8a6e38 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Converting VIF {"id": "f2fe3e4e-05fe-4b23-8ce5-08dbc1e350f5", "address": "fa:16:3e:8a:70:da", "network": {"id": "9fa29b5e-b3c7-4890-9d82-d9524e4cb78a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-89037375-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "997b9ab7d2794438be79f11bb972be47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2fe3e4e-05", "ovs_interfaceid": "f2fe3e4e-05fe-4b23-8ce5-08dbc1e350f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:37:01 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-38698931-8b4e-42b5-8b4e-91745e8a6e38 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:70:da,bridge_name='br-int',has_traffic_filtering=True,id=f2fe3e4e-05fe-4b23-8ce5-08dbc1e350f5,network=Network(9fa29b5e-b3c7-4890-9d82-d9524e4cb78a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2fe3e4e-05') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:37:01 user nova-compute[74337]: DEBUG os_vif [None req-38698931-8b4e-42b5-8b4e-91745e8a6e38 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:70:da,bridge_name='br-int',has_traffic_filtering=True,id=f2fe3e4e-05fe-4b23-8ce5-08dbc1e350f5,network=Network(9fa29b5e-b3c7-4890-9d82-d9524e4cb78a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2fe3e4e-05') {{(pid=74337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 21:37:01 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:01 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:37:01 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 21:37:01 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:01 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b9bcfeb1-75af-5e6c-bfc7-36d383f397a2', '_type': 'linux-noop'}}, row=False) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:37:01 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:01 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8acc1b10-a541-4c06-aeb7-1ecf7a2457be/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8acc1b10-a541-4c06-aeb7-1ecf7a2457be/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:01 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:01 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf2fe3e4e-05, may_exist=True, interface_attrs={}) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:37:01 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf2fe3e4e-05, col_values=(('qos', UUID('c26e6413-b9a7-4cc4-bf70-0379d960ed37')),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:37:01 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf2fe3e4e-05, col_values=(('external_ids', {'iface-id': 'f2fe3e4e-05fe-4b23-8ce5-08dbc1e350f5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8a:70:da', 'vm-uuid': 'b193f267-2ca2-47c5-bd6c-397b1e041d4a'}),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:37:01 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:01 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:37:01 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:01 user nova-compute[74337]: INFO os_vif [None req-38698931-8b4e-42b5-8b4e-91745e8a6e38 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:70:da,bridge_name='br-int',has_traffic_filtering=True,id=f2fe3e4e-05fe-4b23-8ce5-08dbc1e350f5,network=Network(9fa29b5e-b3c7-4890-9d82-d9524e4cb78a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2fe3e4e-05')
Oct 23 21:37:01 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-38698931-8b4e-42b5-8b4e-91745e8a6e38 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] No BDM found with device name vda, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 21:37:01 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-38698931-8b4e-42b5-8b4e-91745e8a6e38 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] No VIF found with MAC fa:16:3e:8a:70:da, not building metadata {{(pid=74337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 21:37:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8acc1b10-a541-4c06-aeb7-1ecf7a2457be/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d45e8ae8-371b-46ae-849d-d7f7d5bbd770/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:01 user nova-compute[74337]: DEBUG nova.network.neutron [req-c4ce1872-8de6-4d0d-bafa-88b465457325 req-c70fa7bd-7659-49d3-80cb-eb9bbf06e465 service nova] [instance: b193f267-2ca2-47c5-bd6c-397b1e041d4a] Updated VIF entry in instance network info cache for port f2fe3e4e-05fe-4b23-8ce5-08dbc1e350f5. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 21:37:01 user nova-compute[74337]: DEBUG nova.network.neutron [req-c4ce1872-8de6-4d0d-bafa-88b465457325 req-c70fa7bd-7659-49d3-80cb-eb9bbf06e465 service nova] [instance: b193f267-2ca2-47c5-bd6c-397b1e041d4a] Updating instance_info_cache with network_info: [{"id": "f2fe3e4e-05fe-4b23-8ce5-08dbc1e350f5", "address": "fa:16:3e:8a:70:da", "network": {"id": "9fa29b5e-b3c7-4890-9d82-d9524e4cb78a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-89037375-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "997b9ab7d2794438be79f11bb972be47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2fe3e4e-05", "ovs_interfaceid": "f2fe3e4e-05fe-4b23-8ce5-08dbc1e350f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:37:01 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-c4ce1872-8de6-4d0d-bafa-88b465457325 req-c70fa7bd-7659-49d3-80cb-eb9bbf06e465 service nova] Releasing lock "refresh_cache-b193f267-2ca2-47c5-bd6c-397b1e041d4a" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:37:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d45e8ae8-371b-46ae-849d-d7f7d5bbd770/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d45e8ae8-371b-46ae-849d-d7f7d5bbd770/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:02 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d45e8ae8-371b-46ae-849d-d7f7d5bbd770/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:02 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:02 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:02 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:02 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:02 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4bf4723-1e3c-42f1-a422-9d9263b67e3d/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:02 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4bf4723-1e3c-42f1-a422-9d9263b67e3d/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:02 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4bf4723-1e3c-42f1-a422-9d9263b67e3d/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:02 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4bf4723-1e3c-42f1-a422-9d9263b67e3d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:02 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf6270ba-7a4e-40c4-b7fd-c62a44125c89/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:03 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:03 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:03 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf6270ba-7a4e-40c4-b7fd-c62a44125c89/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:03 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf6270ba-7a4e-40c4-b7fd-c62a44125c89/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:03 user nova-compute[74337]: DEBUG nova.compute.manager [req-621f87d8-1703-4470-950a-7af1e9199436 req-883c1b76-2eac-4af5-b798-56202f761a6d service nova] [instance: b193f267-2ca2-47c5-bd6c-397b1e041d4a] Received event network-vif-plugged-f2fe3e4e-05fe-4b23-8ce5-08dbc1e350f5 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:37:03 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-621f87d8-1703-4470-950a-7af1e9199436 req-883c1b76-2eac-4af5-b798-56202f761a6d service nova] Acquiring lock "b193f267-2ca2-47c5-bd6c-397b1e041d4a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:37:03 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-621f87d8-1703-4470-950a-7af1e9199436 req-883c1b76-2eac-4af5-b798-56202f761a6d service nova] Lock "b193f267-2ca2-47c5-bd6c-397b1e041d4a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:37:03 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-621f87d8-1703-4470-950a-7af1e9199436 req-883c1b76-2eac-4af5-b798-56202f761a6d service nova] Lock "b193f267-2ca2-47c5-bd6c-397b1e041d4a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:37:03 user nova-compute[74337]: DEBUG nova.compute.manager [req-621f87d8-1703-4470-950a-7af1e9199436 req-883c1b76-2eac-4af5-b798-56202f761a6d service nova] [instance: b193f267-2ca2-47c5-bd6c-397b1e041d4a] No waiting events found dispatching network-vif-plugged-f2fe3e4e-05fe-4b23-8ce5-08dbc1e350f5 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:37:03 user nova-compute[74337]: WARNING nova.compute.manager [req-621f87d8-1703-4470-950a-7af1e9199436 req-883c1b76-2eac-4af5-b798-56202f761a6d service nova] [instance: b193f267-2ca2-47c5-bd6c-397b1e041d4a] Received unexpected event network-vif-plugged-f2fe3e4e-05fe-4b23-8ce5-08dbc1e350f5 for instance with vm_state building and task_state spawning.
Oct 23 21:37:03 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:03 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:03 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf6270ba-7a4e-40c4-b7fd-c62a44125c89/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:03 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=74337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 21:37:03 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=74337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 21:37:03 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] skipping disk /dev/sdj (vdc) as it is a volume {{(pid=74337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 21:37:03 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 21:37:03 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 21:37:03 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=74337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 21:37:03 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff1c790c-2458-438e-95c7-7e1412fe05fc/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:03 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff1c790c-2458-438e-95c7-7e1412fe05fc/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:03 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff1c790c-2458-438e-95c7-7e1412fe05fc/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:03 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff1c790c-2458-438e-95c7-7e1412fe05fc/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:03 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00f757cf-e5dd-476f-81c6-670ed2bf6938/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:04 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00f757cf-e5dd-476f-81c6-670ed2bf6938/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:04 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00f757cf-e5dd-476f-81c6-670ed2bf6938/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:04 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00f757cf-e5dd-476f-81c6-670ed2bf6938/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:05 user nova-compute[74337]: DEBUG nova.compute.manager [None req-50886065-ed29-4f15-ae11-2b48468600ee tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] [instance: 5a181593-8086-4ece-9f5b-5ccba0bfe91e] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wfjRXToB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5a181593-8086-4ece-9f5b-5ccba0bfe91e', 'attached_at': '', 'detached_at': '', 'volume_id': '06d4748a-a032-4937-a18b-c323e56f507f', 'serial': '06d4748a-a032-4937-a18b-c323e56f507f'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0d948adf-16c8-4098-aec1-e616613d545c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kDwXYnUr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'volume_id': '0d948adf-16c8-4098-aec1-e616613d545c'}, 'status': 'reserved', 'instance': '5a181593-8086-4ece-9f5b-5ccba0bfe91e', 'attached_at': '', 'detached_at': '', 'volume_id': '0d948adf-16c8-4098-aec1-e616613d545c', 'serial'} {{(pid=74337) _swap_volume /opt/stack/nova/nova/compute/manager.py:7781}}
Oct 23 21:37:05 user nova-compute[74337]: DEBUG nova.compute.manager [req-d37a2064-2e97-43be-af37-0f9654070a20 req-55c8617c-ae5f-43b9-9c7d-70ed7d09da9a service nova] [instance: b193f267-2ca2-47c5-bd6c-397b1e041d4a] Received event network-vif-plugged-f2fe3e4e-05fe-4b23-8ce5-08dbc1e350f5 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:37:05 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-d37a2064-2e97-43be-af37-0f9654070a20 req-55c8617c-ae5f-43b9-9c7d-70ed7d09da9a service nova] Acquiring lock "b193f267-2ca2-47c5-bd6c-397b1e041d4a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:37:05 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-d37a2064-2e97-43be-af37-0f9654070a20 req-55c8617c-ae5f-43b9-9c7d-70ed7d09da9a service nova] Lock "b193f267-2ca2-47c5-bd6c-397b1e041d4a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:37:05 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-d37a2064-2e97-43be-af37-0f9654070a20 req-55c8617c-ae5f-43b9-9c7d-70ed7d09da9a service nova] Lock "b193f267-2ca2-47c5-bd6c-397b1e041d4a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:37:05 user nova-compute[74337]: DEBUG nova.compute.manager [req-d37a2064-2e97-43be-af37-0f9654070a20 req-55c8617c-ae5f-43b9-9c7d-70ed7d09da9a service nova] [instance: b193f267-2ca2-47c5-bd6c-397b1e041d4a] No waiting events found dispatching network-vif-plugged-f2fe3e4e-05fe-4b23-8ce5-08dbc1e350f5 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:37:05 user nova-compute[74337]: WARNING nova.compute.manager [req-d37a2064-2e97-43be-af37-0f9654070a20 req-55c8617c-ae5f-43b9-9c7d-70ed7d09da9a service nova] [instance: b193f267-2ca2-47c5-bd6c-397b1e041d4a] Received unexpected event network-vif-plugged-f2fe3e4e-05fe-4b23-8ce5-08dbc1e350f5 for instance with vm_state building and task_state spawning.
Oct 23 21:37:05 user nova-compute[74337]: DEBUG nova.compute.manager [None req-38698931-8b4e-42b5-8b4e-91745e8a6e38 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] [instance: b193f267-2ca2-47c5-bd6c-397b1e041d4a] Instance event wait completed in 0 seconds for  {{(pid=74337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 21:37:05 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-38698931-8b4e-42b5-8b4e-91745e8a6e38 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] [instance: b193f267-2ca2-47c5-bd6c-397b1e041d4a] Guest created on hypervisor {{(pid=74337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 21:37:05 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50886065-ed29-4f15-ae11-2b48468600ee tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] [instance: 5a181593-8086-4ece-9f5b-5ccba0bfe91e] Calling os-brick to attach iSCSI Volume {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 21:37:05 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-50886065-ed29-4f15-ae11-2b48468600ee tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wfjRXToB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:37:05 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-50886065-ed29-4f15-ae11-2b48468600ee tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:37:05 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-50886065-ed29-4f15-ae11-2b48468600ee tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:37:05 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-50886065-ed29-4f15-ae11-2b48468600ee tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:37:05 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-50886065-ed29-4f15-ae11-2b48468600ee tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:37:05 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-50886065-ed29-4f15-ae11-2b48468600ee tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:37:05 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-50886065-ed29-4f15-ae11-2b48468600ee tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:37:05 user nova-compute[74337]: INFO os_brick.initiator.connectors.iscsi [None req-50886065-ed29-4f15-ae11-2b48468600ee tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 21:37:05 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: b193f267-2ca2-47c5-bd6c-397b1e041d4a] Instance spawned successfully.
Oct 23 21:37:05 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-38698931-8b4e-42b5-8b4e-91745e8a6e38 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] [instance: b193f267-2ca2-47c5-bd6c-397b1e041d4a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 21:37:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f -p 172.16.0.220:3260 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:05 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:37:05 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:37:05 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Hypervisor/Node resource view: name=user free_ram=7693MB free_disk=25.557525634765625GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 21:37:05 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:37:05 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:37:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:05 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[49a5a636-73fb-4415-bb85-c4f10970a5f6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:05 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-50886065-ed29-4f15-ae11-2b48468600ee tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 21:37:05 user nova-compute[74337]:  {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:37:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f -p 172.16.0.220:3260 --interface default --op new {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:05 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-38698931-8b4e-42b5-8b4e-91745e8a6e38 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] [instance: b193f267-2ca2-47c5-bd6c-397b1e041d4a] Found default for hw_cdrom_bus of ide {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:37:05 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-38698931-8b4e-42b5-8b4e-91745e8a6e38 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] [instance: b193f267-2ca2-47c5-bd6c-397b1e041d4a] Found default for hw_disk_bus of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:37:05 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-38698931-8b4e-42b5-8b4e-91745e8a6e38 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] [instance: b193f267-2ca2-47c5-bd6c-397b1e041d4a] Found default for hw_input_bus of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:37:05 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-38698931-8b4e-42b5-8b4e-91745e8a6e38 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] [instance: b193f267-2ca2-47c5-bd6c-397b1e041d4a] Found default for hw_pointer_model of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:37:05 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-38698931-8b4e-42b5-8b4e-91745e8a6e38 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] [instance: b193f267-2ca2-47c5-bd6c-397b1e041d4a] Found default for hw_video_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:37:05 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-38698931-8b4e-42b5-8b4e-91745e8a6e38 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] [instance: b193f267-2ca2-47c5-bd6c-397b1e041d4a] Found default for hw_vif_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:37:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:05 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad64e76-9598-485b-bf48-e2bc76b577ae]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f] added\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:05 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-50886065-ed29-4f15-ae11-2b48468600ee tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f] added
Oct 23 21:37:05 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:37:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:05 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[44165532-7e05-4bf7-a291-bea5483811d7]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:05 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-50886065-ed29-4f15-ae11-2b48468600ee tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:37:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:05 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4be083e-8a07-4054-92a0-582f7db199ac]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:05 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-50886065-ed29-4f15-ae11-2b48468600ee tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:37:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wfjRXToB {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:05 user nova-compute[74337]: INFO nova.compute.manager [None req-38698931-8b4e-42b5-8b4e-91745e8a6e38 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] [instance: b193f267-2ca2-47c5-bd6c-397b1e041d4a] Took 6.57 seconds to spawn the instance on the hypervisor.
Oct 23 21:37:05 user nova-compute[74337]: DEBUG nova.compute.manager [None req-38698931-8b4e-42b5-8b4e-91745e8a6e38 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] [instance: b193f267-2ca2-47c5-bd6c-397b1e041d4a] Checking state {{(pid=74337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 21:37:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wfjRXToB" returned: 0 in 0.026s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:05 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[89afd8cf-1128-4ca9-9795-d381d2d0054f]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:05 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-50886065-ed29-4f15-ae11-2b48468600ee tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wfjRXToB'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:37:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:05 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance cf6270ba-7a4e-40c4-b7fd-c62a44125c89 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:37:05 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:37:05 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance d45e8ae8-371b-46ae-849d-d7f7d5bbd770 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:37:05 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 8acc1b10-a541-4c06-aeb7-1ecf7a2457be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:37:05 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance ff1c790c-2458-438e-95c7-7e1412fe05fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:37:05 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 5a181593-8086-4ece-9f5b-5ccba0bfe91e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:37:05 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance a4bf4723-1e3c-42f1-a422-9d9263b67e3d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:37:05 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance f1040399-0c5d-4a68-9ee0-4fbe45a42c55 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:37:05 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 04c02325-7ce4-45c2-819b-c656e93c96ca actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:37:05 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 00f757cf-e5dd-476f-81c6-670ed2bf6938 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:37:05 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance b193f267-2ca2-47c5-bd6c-397b1e041d4a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:37:05 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 21:37:05 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 21:37:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.048s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:06 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb4ddb5-0e37-483f-8374-676b354647d4]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:06 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-50886065-ed29-4f15-ae11-2b48468600ee tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:37:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:06 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a897fe-7b63-4c06-b89f-ab8f1f6f1efd]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d948adf-16c8-4098-aec1-e616613d545c (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d827c0c9-ec2a-45ec-927e-41fad52ffdb0 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37bd5655-eaa0-4702-882b-73a73d1ba948 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:06 user nova-compute[74337]: INFO nova.compute.manager [None req-38698931-8b4e-42b5-8b4e-91745e8a6e38 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] [instance: b193f267-2ca2-47c5-bd6c-397b1e041d4a] Took 7.96 seconds to build instance.
Oct 23 21:37:06 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-50886065-ed29-4f15-ae11-2b48468600ee tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496 (non-flash)
Oct 23 21:37:06 user nova-compute[74337]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d948adf-16c8-4098-aec1-e616613d545c (non-flash)
Oct 23 21:37:06 user nova-compute[74337]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d827c0c9-ec2a-45ec-927e-41fad52ffdb0 (non-flash)
Oct 23 21:37:06 user nova-compute[74337]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37bd5655-eaa0-4702-882b-73a73d1ba948 (non-flash)
Oct 23 21:37:06 user nova-compute[74337]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)
Oct 23 21:37:06 user nova-compute[74337]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b (non-flash)
Oct 23 21:37:06 user nova-compute[74337]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 (non-flash)
Oct 23 21:37:06 user nova-compute[74337]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a (non-flash)
Oct 23 21:37:06 user nova-compute[74337]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661 (non-flash)
Oct 23 21:37:06 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:37:06 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-50886065-ed29-4f15-ae11-2b48468600ee tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496 (non-flash)
Oct 23 21:37:06 user nova-compute[74337]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d948adf-16c8-4098-aec1-e616613d545c (non-flash)
Oct 23 21:37:06 user nova-compute[74337]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d827c0c9-ec2a-45ec-927e-41fad52ffdb0 (non-flash)
Oct 23 21:37:06 user nova-compute[74337]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37bd5655-eaa0-4702-882b-73a73d1ba948 (non-flash)
Oct 23 21:37:06 user nova-compute[74337]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)
Oct 23 21:37:06 user nova-compute[74337]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b (non-flash)
Oct 23 21:37:06 user nova-compute[74337]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 (non-flash)
Oct 23 21:37:06 user nova-compute[74337]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a (non-flash)
Oct 23 21:37:06 user nova-compute[74337]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661 (non-flash)
Oct 23 21:37:06 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:37:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f -p 172.16.0.220:3260 --login {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:06 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-38698931-8b4e-42b5-8b4e-91745e8a6e38 tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Lock "b193f267-2ca2-47c5-bd6c-397b1e041d4a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.113s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:37:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f -p 172.16.0.220:3260 --login" returned: 0 in 0.105s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:06 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba629e5-6cfe-4ebb-9a50-f68bdbadd3ec]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:06 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-50886065-ed29-4f15-ae11-2b48468600ee tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f, portal: 172.16.0.220,3260]
Oct 23 21:37:06 user nova-compute[74337]: Login to [iface: default, target: iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f, portal: 172.16.0.220,3260] successful.
Oct 23 21:37:06 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:37:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:06 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[66d23472-7334-4248-9e03-f18dbbe42858]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:06 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-50886065-ed29-4f15-ae11-2b48468600ee tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:37:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:06 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[82da8e5c-8e3f-415d-957c-f1530869d812]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d948adf-16c8-4098-aec1-e616613d545c (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d827c0c9-ec2a-45ec-927e-41fad52ffdb0 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37bd5655-eaa0-4702-882b-73a73d1ba948 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:06 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-50886065-ed29-4f15-ae11-2b48468600ee tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496 (non-flash)
Oct 23 21:37:06 user nova-compute[74337]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d948adf-16c8-4098-aec1-e616613d545c (non-flash)
Oct 23 21:37:06 user nova-compute[74337]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d827c0c9-ec2a-45ec-927e-41fad52ffdb0 (non-flash)
Oct 23 21:37:06 user nova-compute[74337]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37bd5655-eaa0-4702-882b-73a73d1ba948 (non-flash)
Oct 23 21:37:06 user nova-compute[74337]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f (non-flash)
Oct 23 21:37:06 user nova-compute[74337]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)
Oct 23 21:37:06 user nova-compute[74337]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b (non-flash)
Oct 23 21:37:06 user nova-compute[74337]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 (non-flash)
Oct 23 21:37:06 user nova-compute[74337]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a (non-flash)
Oct 23 21:37:06 user nova-compute[74337]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661 (non-flash)
Oct 23 21:37:06 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:37:06 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-50886065-ed29-4f15-ae11-2b48468600ee tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496 (non-flash)
Oct 23 21:37:06 user nova-compute[74337]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d948adf-16c8-4098-aec1-e616613d545c (non-flash)
Oct 23 21:37:06 user nova-compute[74337]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d827c0c9-ec2a-45ec-927e-41fad52ffdb0 (non-flash)
Oct 23 21:37:06 user nova-compute[74337]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37bd5655-eaa0-4702-882b-73a73d1ba948 (non-flash)
Oct 23 21:37:06 user nova-compute[74337]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f (non-flash)
Oct 23 21:37:06 user nova-compute[74337]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)
Oct 23 21:37:06 user nova-compute[74337]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b (non-flash)
Oct 23 21:37:06 user nova-compute[74337]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 (non-flash)
Oct 23 21:37:06 user nova-compute[74337]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a (non-flash)
Oct 23 21:37:06 user nova-compute[74337]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661 (non-flash)
Oct 23 21:37:06 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:37:06 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-50886065-ed29-4f15-ae11-2b48468600ee tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.449s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:37:06 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-50886065-ed29-4f15-ae11-2b48468600ee tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] Connected to 172.16.0.220:3260 {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 21:37:06 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-50886065-ed29-4f15-ae11-2b48468600ee tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] HCTL ('42', '-', '-', 0) found on session 15 with lun 0 {{(pid=74337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 21:37:06 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-50886065-ed29-4f15-ae11-2b48468600ee tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] Scanning host 42 c: -, t: -, l: 0) {{(pid=74337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 21:37:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.025s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:06 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d757502d-2824-4cf8-bd69-616502272228]: (4, ('- - 0', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:06 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-50886065-ed29-4f15-ae11-2b48468600ee tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] Searching for a device in session 15 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=74337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 21:37:06 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-50886065-ed29-4f15-ae11-2b48468600ee tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] Connected to sdk using {'target_iqn': 'iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wfjRXToB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 21:37:06 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:37:06 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:37:06 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Compute_service record updated for user:user {{(pid=74337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 21:37:06 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.648s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:37:06 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:07 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-f6dfa12c-47ce-4af4-bbc0-ed5683d04952 tempest-VolumesAssistedSnapshotsTest-1195398017 tempest-VolumesAssistedSnapshotsTest-1195398017-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a4bf4723-1e3c-42f1-a422-9d9263b67e3d is timed out.
Oct 23 21:37:07 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-f6dfa12c-47ce-4af4-bbc0-ed5683d04952 tempest-VolumesAssistedSnapshotsTest-1195398017 tempest-VolumesAssistedSnapshotsTest-1195398017-project-admin] Successfully detached device vdb from instance a4bf4723-1e3c-42f1-a422-9d9263b67e3d from the live domain config.
Oct 23 21:37:07 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6dfa12c-47ce-4af4-bbc0-ed5683d04952 tempest-VolumesAssistedSnapshotsTest-1195398017 tempest-VolumesAssistedSnapshotsTest-1195398017-project-admin] [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d] calling os-brick to detach iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 21:37:07 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6dfa12c-47ce-4af4-bbc0-ed5683d04952 tempest-VolumesAssistedSnapshotsTest-1195398017 tempest-VolumesAssistedSnapshotsTest-1195398017-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, {'target_iqn': 'iqn.2010-10.org.openstack:d827c0c9-ec2a-45ec-927e-41fad52ffdb0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LVfUYWGS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:37:07 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-f6dfa12c-47ce-4af4-bbc0-ed5683d04952 tempest-VolumesAssistedSnapshotsTest-1195398017 tempest-VolumesAssistedSnapshotsTest-1195398017-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:37:07 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-f6dfa12c-47ce-4af4-bbc0-ed5683d04952 tempest-VolumesAssistedSnapshotsTest-1195398017 tempest-VolumesAssistedSnapshotsTest-1195398017-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:37:07 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-50886065-ed29-4f15-ae11-2b48468600ee tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.500s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:37:07 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-50886065-ed29-4f15-ae11-2b48468600ee tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] <== connect_volume: return (1501ms) {'type': 'block', 'scsi_wwn': '23765313736323238', 'path': '/dev/sdk'} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:37:07 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50886065-ed29-4f15-ae11-2b48468600ee tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] [instance: 5a181593-8086-4ece-9f5b-5ccba0bfe91e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23765313736323238', 'path': '/dev/sdk'} {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 21:37:07 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-f6dfa12c-47ce-4af4-bbc0-ed5683d04952 tempest-VolumesAssistedSnapshotsTest-1195398017 tempest-VolumesAssistedSnapshotsTest-1195398017-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.217s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:37:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:07 user nova-compute[74337]: DEBUG nova.objects.instance [None req-50886065-ed29-4f15-ae11-2b48468600ee tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] Lazy-loading 'flavor' on Instance uuid 5a181593-8086-4ece-9f5b-5ccba0bfe91e {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:37:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.035s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:07 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff838c9b-f5ea-4e5c-be6d-3f7055c65ef6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0d948adf-16c8-4098-aec1-e616613d545c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d827c0c9-ec2a-45ec-927e-41fad52ffdb0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:37bd5655-eaa0-4702-882b-73a73d1ba948\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:07 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6dfa12c-47ce-4af4-bbc0-ed5683d04952 tempest-VolumesAssistedSnapshotsTest-1195398017 tempest-VolumesAssistedSnapshotsTest-1195398017-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 21:37:07 user nova-compute[74337]: No targets found.
Oct 23 21:37:07 user nova-compute[74337]: iSNS:
Oct 23 21:37:07 user nova-compute[74337]: No targets found.
Oct 23 21:37:07 user nova-compute[74337]: STATIC:
Oct 23 21:37:07 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a
Oct 23 21:37:07 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:37:07 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:37:07 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:0d948adf-16c8-4098-aec1-e616613d545c
Oct 23 21:37:07 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:37:07 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:37:07 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:d827c0c9-ec2a-45ec-927e-41fad52ffdb0
Oct 23 21:37:07 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:37:07 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:37:07 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661
Oct 23 21:37:07 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:37:07 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:37:07 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496
Oct 23 21:37:07 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:37:07 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:37:07 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b
Oct 23 21:37:07 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:37:07 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:37:07 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932
Oct 23 21:37:07 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:37:07 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:37:07 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f
Oct 23 21:37:07 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:37:07 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:37:07 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0
Oct 23 21:37:07 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:37:07 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:37:07 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:37bd5655-eaa0-4702-882b-73a73d1ba948
Oct 23 21:37:07 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:37:07 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:37:07 user nova-compute[74337]: FIRMWARE:
Oct 23 21:37:07 user nova-compute[74337]: No targets found.
Oct 23 21:37:07 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:37:07 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6dfa12c-47ce-4af4-bbc0-ed5683d04952 tempest-VolumesAssistedSnapshotsTest-1195398017 tempest-VolumesAssistedSnapshotsTest-1195398017-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 21:37:07 user nova-compute[74337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 21:37:07 user nova-compute[74337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 21:37:07 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6dfa12c-47ce-4af4-bbc0-ed5683d04952 tempest-VolumesAssistedSnapshotsTest-1195398017 tempest-VolumesAssistedSnapshotsTest-1195398017-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d827c0c9-ec2a-45ec-927e-41fad52ffdb0', 0)] {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 21:37:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:07 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bae9b40-d650-474d-b74c-b9d9d13f342a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d948adf-16c8-4098-aec1-e616613d545c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37bd5655-eaa0-4702-882b-73a73d1ba948\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d827c0c9-ec2a-45ec-927e-41fad52ffdb0\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:07 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5dcd094-572c-4b68-a841-a414e06275c4]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d948adf-16c8-4098-aec1-e616613d545c (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d827c0c9-ec2a-45ec-927e-41fad52ffdb0 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37bd5655-eaa0-4702-882b-73a73d1ba948 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:07 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6dfa12c-47ce-4af4-bbc0-ed5683d04952 tempest-VolumesAssistedSnapshotsTest-1195398017 tempest-VolumesAssistedSnapshotsTest-1195398017-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496 (non-flash)
Oct 23 21:37:07 user nova-compute[74337]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d948adf-16c8-4098-aec1-e616613d545c (non-flash)
Oct 23 21:37:07 user nova-compute[74337]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d827c0c9-ec2a-45ec-927e-41fad52ffdb0 (non-flash)
Oct 23 21:37:07 user nova-compute[74337]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37bd5655-eaa0-4702-882b-73a73d1ba948 (non-flash)
Oct 23 21:37:07 user nova-compute[74337]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f (non-flash)
Oct 23 21:37:07 user nova-compute[74337]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)
Oct 23 21:37:07 user nova-compute[74337]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b (non-flash)
Oct 23 21:37:07 user nova-compute[74337]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 (non-flash)
Oct 23 21:37:07 user nova-compute[74337]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a (non-flash)
Oct 23 21:37:07 user nova-compute[74337]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661 (non-flash)
Oct 23 21:37:07 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:37:07 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6dfa12c-47ce-4af4-bbc0-ed5683d04952 tempest-VolumesAssistedSnapshotsTest-1195398017 tempest-VolumesAssistedSnapshotsTest-1195398017-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496 (non-flash)
Oct 23 21:37:07 user nova-compute[74337]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d948adf-16c8-4098-aec1-e616613d545c (non-flash)
Oct 23 21:37:07 user nova-compute[74337]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d827c0c9-ec2a-45ec-927e-41fad52ffdb0 (non-flash)
Oct 23 21:37:07 user nova-compute[74337]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37bd5655-eaa0-4702-882b-73a73d1ba948 (non-flash)
Oct 23 21:37:07 user nova-compute[74337]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f (non-flash)
Oct 23 21:37:07 user nova-compute[74337]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)
Oct 23 21:37:07 user nova-compute[74337]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b (non-flash)
Oct 23 21:37:07 user nova-compute[74337]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 (non-flash)
Oct 23 21:37:07 user nova-compute[74337]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a (non-flash)
Oct 23 21:37:07 user nova-compute[74337]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661 (non-flash)
Oct 23 21:37:07 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:37:07 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6dfa12c-47ce-4af4-bbc0-ed5683d04952 tempest-VolumesAssistedSnapshotsTest-1195398017 tempest-VolumesAssistedSnapshotsTest-1195398017-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5ef5664af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d827c0c9-ec2a-45ec-927e-41fad52ffdb0'): ({'sdf'}, set())}) {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 21:37:07 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-f6dfa12c-47ce-4af4-bbc0-ed5683d04952 tempest-VolumesAssistedSnapshotsTest-1195398017 tempest-VolumesAssistedSnapshotsTest-1195398017-project-admin] Removing single pathed devices sdf {{(pid=74337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 21:37:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:07 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbd53827-9ae3-41c3-ba37-748a44468029]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:07 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:37:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.023s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:07 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:37:07 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b71418-c666-4cdc-b712-7aebaddce697]: (4, ('ok\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:07 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-f6dfa12c-47ce-4af4-bbc0-ed5683d04952 tempest-VolumesAssistedSnapshotsTest-1195398017 tempest-VolumesAssistedSnapshotsTest-1195398017-project-admin] Flushing IO for device /dev/sdf {{(pid=74337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 21:37:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:07 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[0875629b-4c50-4847-ab4b-857015e58997]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:07 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-f6dfa12c-47ce-4af4-bbc0-ed5683d04952 tempest-VolumesAssistedSnapshotsTest-1195398017 tempest-VolumesAssistedSnapshotsTest-1195398017-project-admin] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 21:37:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.060s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:07 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[588e7c31-b4d4-496e-9c96-42ab7d1a5c67]: (4, ('1', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:07 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-f6dfa12c-47ce-4af4-bbc0-ed5683d04952 tempest-VolumesAssistedSnapshotsTest-1195398017 tempest-VolumesAssistedSnapshotsTest-1195398017-project-admin] Checking to see if SCSI volumes sdf have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 21:37:07 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-f6dfa12c-47ce-4af4-bbc0-ed5683d04952 tempest-VolumesAssistedSnapshotsTest-1195398017 tempest-VolumesAssistedSnapshotsTest-1195398017-project-admin] SCSI volumes sdf have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 21:37:07 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6dfa12c-47ce-4af4-bbc0-ed5683d04952 tempest-VolumesAssistedSnapshotsTest-1195398017 tempest-VolumesAssistedSnapshotsTest-1195398017-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d827c0c9-ec2a-45ec-927e-41fad52ffdb0')] {{(pid=74337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 21:37:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d827c0c9-ec2a-45ec-927e-41fad52ffdb0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d827c0c9-ec2a-45ec-927e-41fad52ffdb0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:07 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7375518-21b4-4ff1-9fba-1497fe0aa268]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:07 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6dfa12c-47ce-4af4-bbc0-ed5683d04952 tempest-VolumesAssistedSnapshotsTest-1195398017 tempest-VolumesAssistedSnapshotsTest-1195398017-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:37:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d827c0c9-ec2a-45ec-927e-41fad52ffdb0 -p 172.16.0.220:3260 --logout {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d827c0c9-ec2a-45ec-927e-41fad52ffdb0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:07 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c892eac9-8829-474a-bfff-e7a5a6c823a0]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:d827c0c9-ec2a-45ec-927e-41fad52ffdb0, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:d827c0c9-ec2a-45ec-927e-41fad52ffdb0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:07 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6dfa12c-47ce-4af4-bbc0-ed5683d04952 tempest-VolumesAssistedSnapshotsTest-1195398017 tempest-VolumesAssistedSnapshotsTest-1195398017-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:d827c0c9-ec2a-45ec-927e-41fad52ffdb0, portal: 172.16.0.220,3260]
Oct 23 21:37:07 user nova-compute[74337]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:d827c0c9-ec2a-45ec-927e-41fad52ffdb0, portal: 172.16.0.220,3260] successful.
Oct 23 21:37:07 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:37:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d827c0c9-ec2a-45ec-927e-41fad52ffdb0 -p 172.16.0.220:3260 --op delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d827c0c9-ec2a-45ec-927e-41fad52ffdb0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.042s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:07 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1690de0-d662-4732-904c-0fc78c002aa3]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:07 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6dfa12c-47ce-4af4-bbc0-ed5683d04952 tempest-VolumesAssistedSnapshotsTest-1195398017 tempest-VolumesAssistedSnapshotsTest-1195398017-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:37:07 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-f6dfa12c-47ce-4af4-bbc0-ed5683d04952 tempest-VolumesAssistedSnapshotsTest-1195398017 tempest-VolumesAssistedSnapshotsTest-1195398017-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.431s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:37:07 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6dfa12c-47ce-4af4-bbc0-ed5683d04952 tempest-VolumesAssistedSnapshotsTest-1195398017 tempest-VolumesAssistedSnapshotsTest-1195398017-project-admin] <== disconnect_volume: return (648ms) None {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:37:07 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6dfa12c-47ce-4af4-bbc0-ed5683d04952 tempest-VolumesAssistedSnapshotsTest-1195398017 tempest-VolumesAssistedSnapshotsTest-1195398017-project-admin] [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d] Disconnected iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 21:37:07 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-50886065-ed29-4f15-ae11-2b48468600ee tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] COPY block job progress, current cursor: 7340032 final cursor: 1073741824 {{(pid=74337) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 21:37:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:08 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-50886065-ed29-4f15-ae11-2b48468600ee tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] COPY block job progress, current cursor: 128974848 final cursor: 1073741824 {{(pid=74337) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 21:37:08 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-50886065-ed29-4f15-ae11-2b48468600ee tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] COPY block job progress, current cursor: 204472320 final cursor: 1073741824 {{(pid=74337) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 21:37:08 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-ff15c914-d6ce-4aa3-b555-f2e10f9364f6 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance ff1c790c-2458-438e-95c7-7e1412fe05fc is timed out.
Oct 23 21:37:08 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-ff15c914-d6ce-4aa3-b555-f2e10f9364f6 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Successfully detached device sdc from instance ff1c790c-2458-438e-95c7-7e1412fe05fc from the live domain config.
Oct 23 21:37:08 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff15c914-d6ce-4aa3-b555-f2e10f9364f6 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] [instance: ff1c790c-2458-438e-95c7-7e1412fe05fc] calling os-brick to detach iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 21:37:08 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff15c914-d6ce-4aa3-b555-f2e10f9364f6 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, {'target_iqn': 'iqn.2010-10.org.openstack:37bd5655-eaa0-4702-882b-73a73d1ba948', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ousQMLEd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:37:08 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-ff15c914-d6ce-4aa3-b555-f2e10f9364f6 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:37:08 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-ff15c914-d6ce-4aa3-b555-f2e10f9364f6 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:37:08 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-ff15c914-d6ce-4aa3-b555-f2e10f9364f6 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:37:08 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:08 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:08 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[66e980b0-be8a-4cae-bf0b-38ddce1ca260]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0d948adf-16c8-4098-aec1-e616613d545c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:37bd5655-eaa0-4702-882b-73a73d1ba948\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:08 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff15c914-d6ce-4aa3-b555-f2e10f9364f6 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 21:37:08 user nova-compute[74337]: No targets found.
Oct 23 21:37:08 user nova-compute[74337]: iSNS:
Oct 23 21:37:08 user nova-compute[74337]: No targets found.
Oct 23 21:37:08 user nova-compute[74337]: STATIC:
Oct 23 21:37:08 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a
Oct 23 21:37:08 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:37:08 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:37:08 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:0d948adf-16c8-4098-aec1-e616613d545c
Oct 23 21:37:08 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:37:08 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:37:08 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661
Oct 23 21:37:08 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:37:08 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:37:08 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496
Oct 23 21:37:08 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:37:08 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:37:08 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b
Oct 23 21:37:08 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:37:08 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:37:08 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932
Oct 23 21:37:08 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:37:08 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:37:08 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f
Oct 23 21:37:08 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:37:08 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:37:08 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0
Oct 23 21:37:08 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:37:08 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:37:08 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:37bd5655-eaa0-4702-882b-73a73d1ba948
Oct 23 21:37:08 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:37:08 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:37:08 user nova-compute[74337]: FIRMWARE:
Oct 23 21:37:08 user nova-compute[74337]: No targets found.
Oct 23 21:37:08 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:37:08 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff15c914-d6ce-4aa3-b555-f2e10f9364f6 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 21:37:08 user nova-compute[74337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 21:37:08 user nova-compute[74337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 21:37:08 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff15c914-d6ce-4aa3-b555-f2e10f9364f6 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37bd5655-eaa0-4702-882b-73a73d1ba948', 0)] {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 21:37:08 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:08 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.035s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:08 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6964ee88-d2f5-41e4-9935-aa12364f5c6d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d948adf-16c8-4098-aec1-e616613d545c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37bd5655-eaa0-4702-882b-73a73d1ba948\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:08 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.071s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:09 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[879bfe89-7d4f-4d13-b6a2-6f133f3ba846]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d948adf-16c8-4098-aec1-e616613d545c (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37bd5655-eaa0-4702-882b-73a73d1ba948 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:09 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff15c914-d6ce-4aa3-b555-f2e10f9364f6 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496 (non-flash)
Oct 23 21:37:09 user nova-compute[74337]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d948adf-16c8-4098-aec1-e616613d545c (non-flash)
Oct 23 21:37:09 user nova-compute[74337]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37bd5655-eaa0-4702-882b-73a73d1ba948 (non-flash)
Oct 23 21:37:09 user nova-compute[74337]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f (non-flash)
Oct 23 21:37:09 user nova-compute[74337]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)
Oct 23 21:37:09 user nova-compute[74337]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b (non-flash)
Oct 23 21:37:09 user nova-compute[74337]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 (non-flash)
Oct 23 21:37:09 user nova-compute[74337]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a (non-flash)
Oct 23 21:37:09 user nova-compute[74337]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661 (non-flash)
Oct 23 21:37:09 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:37:09 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff15c914-d6ce-4aa3-b555-f2e10f9364f6 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496 (non-flash)
Oct 23 21:37:09 user nova-compute[74337]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d948adf-16c8-4098-aec1-e616613d545c (non-flash)
Oct 23 21:37:09 user nova-compute[74337]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37bd5655-eaa0-4702-882b-73a73d1ba948 (non-flash)
Oct 23 21:37:09 user nova-compute[74337]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f (non-flash)
Oct 23 21:37:09 user nova-compute[74337]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)
Oct 23 21:37:09 user nova-compute[74337]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b (non-flash)
Oct 23 21:37:09 user nova-compute[74337]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 (non-flash)
Oct 23 21:37:09 user nova-compute[74337]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a (non-flash)
Oct 23 21:37:09 user nova-compute[74337]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661 (non-flash)
Oct 23 21:37:09 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:37:09 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff15c914-d6ce-4aa3-b555-f2e10f9364f6 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5ef45b6ef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37bd5655-eaa0-4702-882b-73a73d1ba948'): ({'sdi'}, set())}) {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 21:37:09 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-ff15c914-d6ce-4aa3-b555-f2e10f9364f6 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Removing single pathed devices sdi {{(pid=74337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 21:37:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.032s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:09 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf623d6-0ed2-4878-8fa0-a5c72970ad10]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.023s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:09 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfb93c51-7793-4aac-9274-b0e74a221af1]: (4, ('ok\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:09 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-ff15c914-d6ce-4aa3-b555-f2e10f9364f6 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Flushing IO for device /dev/sdi {{(pid=74337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 21:37:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.014s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:09 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e4ccc49-0f0a-4434-bcd0-ccb172788de1]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:09 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-ff15c914-d6ce-4aa3-b555-f2e10f9364f6 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=74337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 21:37:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.128s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:09 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d30461d-ffd6-4bc5-abbc-15f8023e8994]: (4, ('1', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:09 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-ff15c914-d6ce-4aa3-b555-f2e10f9364f6 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 21:37:09 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-ff15c914-d6ce-4aa3-b555-f2e10f9364f6 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] SCSI volumes sdi have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 21:37:09 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff15c914-d6ce-4aa3-b555-f2e10f9364f6 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37bd5655-eaa0-4702-882b-73a73d1ba948')] {{(pid=74337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 21:37:09 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-50886065-ed29-4f15-ae11-2b48468600ee tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] COPY block job progress, current cursor: 286261248 final cursor: 1073741824 {{(pid=74337) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 21:37:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37bd5655-eaa0-4702-882b-73a73d1ba948 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37bd5655-eaa0-4702-882b-73a73d1ba948 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.065s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:09 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9ef0893-b1f2-40a6-8012-5aa82b540bd3]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:09 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff15c914-d6ce-4aa3-b555-f2e10f9364f6 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:37:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37bd5655-eaa0-4702-882b-73a73d1ba948 -p 172.16.0.220:3260 --logout {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:09 user nova-compute[74337]: DEBUG nova.objects.instance [None req-f6dfa12c-47ce-4af4-bbc0-ed5683d04952 tempest-VolumesAssistedSnapshotsTest-1195398017 tempest-VolumesAssistedSnapshotsTest-1195398017-project-admin] Lazy-loading 'flavor' on Instance uuid a4bf4723-1e3c-42f1-a422-9d9263b67e3d {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:37:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37bd5655-eaa0-4702-882b-73a73d1ba948 -p 172.16.0.220:3260 --logout" returned: 0 in 0.094s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:09 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[2845faed-02b7-47c0-9719-afd66dc35303]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:37bd5655-eaa0-4702-882b-73a73d1ba948, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:37bd5655-eaa0-4702-882b-73a73d1ba948, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:09 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff15c914-d6ce-4aa3-b555-f2e10f9364f6 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:37bd5655-eaa0-4702-882b-73a73d1ba948, portal: 172.16.0.220,3260]
Oct 23 21:37:09 user nova-compute[74337]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:37bd5655-eaa0-4702-882b-73a73d1ba948, portal: 172.16.0.220,3260] successful.
Oct 23 21:37:09 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:37:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37bd5655-eaa0-4702-882b-73a73d1ba948 -p 172.16.0.220:3260 --op delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37bd5655-eaa0-4702-882b-73a73d1ba948 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.050s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:09 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea5cd49f-fce1-4f67-9309-c581991ee75a]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:09 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff15c914-d6ce-4aa3-b555-f2e10f9364f6 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:37:09 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-ff15c914-d6ce-4aa3-b555-f2e10f9364f6 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.703s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:37:09 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff15c914-d6ce-4aa3-b555-f2e10f9364f6 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] <== disconnect_volume: return (705ms) None {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:37:09 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff15c914-d6ce-4aa3-b555-f2e10f9364f6 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] [instance: ff1c790c-2458-438e-95c7-7e1412fe05fc] Disconnected iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 21:37:09 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-f6dfa12c-47ce-4af4-bbc0-ed5683d04952 tempest-VolumesAssistedSnapshotsTest-1195398017 tempest-VolumesAssistedSnapshotsTest-1195398017-project-admin] Lock "a4bf4723-1e3c-42f1-a422-9d9263b67e3d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.145s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:37:09 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-50886065-ed29-4f15-ae11-2b48468600ee tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] COPY block job progress, current cursor: 429916160 final cursor: 1073741824 {{(pid=74337) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 21:37:10 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-50886065-ed29-4f15-ae11-2b48468600ee tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] COPY block job progress, current cursor: 559939584 final cursor: 1073741824 {{(pid=74337) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 21:37:10 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-50886065-ed29-4f15-ae11-2b48468600ee tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] COPY block job progress, current cursor: 715128832 final cursor: 1073741824 {{(pid=74337) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 21:37:11 user nova-compute[74337]: DEBUG nova.objects.instance [None req-ff15c914-d6ce-4aa3-b555-f2e10f9364f6 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Lazy-loading 'flavor' on Instance uuid ff1c790c-2458-438e-95c7-7e1412fe05fc {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:37:11 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-ff15c914-d6ce-4aa3-b555-f2e10f9364f6 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Lock "ff1c790c-2458-438e-95c7-7e1412fe05fc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.927s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:37:11 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-50886065-ed29-4f15-ae11-2b48468600ee tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] COPY block job progress, current cursor: 858783744 final cursor: 1073741824 {{(pid=74337) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 21:37:11 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:11 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-50886065-ed29-4f15-ae11-2b48468600ee tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] COPY block job progress, current cursor: 1024458752 final cursor: 1073741824 {{(pid=74337) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 21:37:12 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-151e1df8-1137-4736-a08f-16902558f648 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Acquiring lock "ff1c790c-2458-438e-95c7-7e1412fe05fc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:37:12 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-151e1df8-1137-4736-a08f-16902558f648 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Lock "ff1c790c-2458-438e-95c7-7e1412fe05fc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:37:12 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-151e1df8-1137-4736-a08f-16902558f648 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Acquiring lock "ff1c790c-2458-438e-95c7-7e1412fe05fc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:37:12 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-151e1df8-1137-4736-a08f-16902558f648 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Lock "ff1c790c-2458-438e-95c7-7e1412fe05fc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:37:12 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-151e1df8-1137-4736-a08f-16902558f648 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Lock "ff1c790c-2458-438e-95c7-7e1412fe05fc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:37:12 user nova-compute[74337]: INFO nova.compute.manager [None req-151e1df8-1137-4736-a08f-16902558f648 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] [instance: ff1c790c-2458-438e-95c7-7e1412fe05fc] Terminating instance
Oct 23 21:37:12 user nova-compute[74337]: DEBUG nova.compute.manager [None req-151e1df8-1137-4736-a08f-16902558f648 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] [instance: ff1c790c-2458-438e-95c7-7e1412fe05fc] Start destroying the instance on the hypervisor. {{(pid=74337) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 21:37:12 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:12 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:12 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:12 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:12 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:12 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-50886065-ed29-4f15-ae11-2b48468600ee tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74337) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 21:37:12 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50886065-ed29-4f15-ae11-2b48468600ee tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] [instance: 5a181593-8086-4ece-9f5b-5ccba0bfe91e] calling os-brick to detach iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 21:37:12 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-50886065-ed29-4f15-ae11-2b48468600ee tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, {'target_iqn': 'iqn.2010-10.org.openstack:0d948adf-16c8-4098-aec1-e616613d545c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kDwXYnUr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'volume_id': '0d948adf-16c8-4098-aec1-e616613d545c'}, None), 'kwargs': False}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:37:12 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-50886065-ed29-4f15-ae11-2b48468600ee tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:37:12 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-50886065-ed29-4f15-ae11-2b48468600ee tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:37:12 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-50886065-ed29-4f15-ae11-2b48468600ee tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:37:12 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:12 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:12 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f909810-731d-464c-a55a-90350db6159d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0d948adf-16c8-4098-aec1-e616613d545c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:12 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-50886065-ed29-4f15-ae11-2b48468600ee tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 21:37:12 user nova-compute[74337]: No targets found.
Oct 23 21:37:12 user nova-compute[74337]: iSNS:
Oct 23 21:37:12 user nova-compute[74337]: No targets found.
Oct 23 21:37:12 user nova-compute[74337]: STATIC:
Oct 23 21:37:12 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a
Oct 23 21:37:12 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:37:12 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:37:12 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:0d948adf-16c8-4098-aec1-e616613d545c
Oct 23 21:37:12 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:37:12 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:37:12 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661
Oct 23 21:37:12 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:37:12 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:37:12 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496
Oct 23 21:37:12 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:37:12 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:37:12 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b
Oct 23 21:37:12 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:37:12 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:37:12 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932
Oct 23 21:37:12 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:37:12 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:37:12 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f
Oct 23 21:37:12 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:37:12 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:37:12 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0
Oct 23 21:37:12 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:37:12 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:37:12 user nova-compute[74337]: FIRMWARE:
Oct 23 21:37:12 user nova-compute[74337]: No targets found.
Oct 23 21:37:12 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:37:12 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-50886065-ed29-4f15-ae11-2b48468600ee tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 21:37:12 user nova-compute[74337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 21:37:12 user nova-compute[74337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 21:37:12 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-50886065-ed29-4f15-ae11-2b48468600ee tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d948adf-16c8-4098-aec1-e616613d545c', 0)] {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 21:37:12 user nova-compute[74337]: DEBUG nova.compute.manager [req-3c4e2561-a3bb-41eb-a659-499d11e8cb39 req-eb16df8a-1dd4-46d2-8528-b4ef242a3c05 service nova] [instance: ff1c790c-2458-438e-95c7-7e1412fe05fc] Received event network-vif-unplugged-ff6c7795-2085-4305-b0aa-72050c9b979b {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:37:12 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-3c4e2561-a3bb-41eb-a659-499d11e8cb39 req-eb16df8a-1dd4-46d2-8528-b4ef242a3c05 service nova] Acquiring lock "ff1c790c-2458-438e-95c7-7e1412fe05fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:37:12 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-3c4e2561-a3bb-41eb-a659-499d11e8cb39 req-eb16df8a-1dd4-46d2-8528-b4ef242a3c05 service nova] Lock "ff1c790c-2458-438e-95c7-7e1412fe05fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:37:12 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-3c4e2561-a3bb-41eb-a659-499d11e8cb39 req-eb16df8a-1dd4-46d2-8528-b4ef242a3c05 service nova] Lock "ff1c790c-2458-438e-95c7-7e1412fe05fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:37:12 user nova-compute[74337]: DEBUG nova.compute.manager [req-3c4e2561-a3bb-41eb-a659-499d11e8cb39 req-eb16df8a-1dd4-46d2-8528-b4ef242a3c05 service nova] [instance: ff1c790c-2458-438e-95c7-7e1412fe05fc] No waiting events found dispatching network-vif-unplugged-ff6c7795-2085-4305-b0aa-72050c9b979b {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:37:12 user nova-compute[74337]: DEBUG nova.compute.manager [req-3c4e2561-a3bb-41eb-a659-499d11e8cb39 req-eb16df8a-1dd4-46d2-8528-b4ef242a3c05 service nova] [instance: ff1c790c-2458-438e-95c7-7e1412fe05fc] Received event network-vif-unplugged-ff6c7795-2085-4305-b0aa-72050c9b979b for instance with task_state deleting. {{(pid=74337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 21:37:12 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:12 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.039s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:12 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7afed76-a1a6-4e3f-8903-30102b84c713]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d948adf-16c8-4098-aec1-e616613d545c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:12 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:12 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:12 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca8886be-a42f-4bc2-8b68-b7baa58bea67]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d948adf-16c8-4098-aec1-e616613d545c (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:12 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-50886065-ed29-4f15-ae11-2b48468600ee tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496 (non-flash)
Oct 23 21:37:12 user nova-compute[74337]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d948adf-16c8-4098-aec1-e616613d545c (non-flash)
Oct 23 21:37:12 user nova-compute[74337]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f (non-flash)
Oct 23 21:37:12 user nova-compute[74337]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)
Oct 23 21:37:12 user nova-compute[74337]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b (non-flash)
Oct 23 21:37:12 user nova-compute[74337]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 (non-flash)
Oct 23 21:37:12 user nova-compute[74337]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a (non-flash)
Oct 23 21:37:12 user nova-compute[74337]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661 (non-flash)
Oct 23 21:37:12 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:37:12 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-50886065-ed29-4f15-ae11-2b48468600ee tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496 (non-flash)
Oct 23 21:37:12 user nova-compute[74337]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d948adf-16c8-4098-aec1-e616613d545c (non-flash)
Oct 23 21:37:12 user nova-compute[74337]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f (non-flash)
Oct 23 21:37:12 user nova-compute[74337]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)
Oct 23 21:37:12 user nova-compute[74337]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b (non-flash)
Oct 23 21:37:12 user nova-compute[74337]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 (non-flash)
Oct 23 21:37:12 user nova-compute[74337]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a (non-flash)
Oct 23 21:37:12 user nova-compute[74337]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661 (non-flash)
Oct 23 21:37:12 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:37:12 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-50886065-ed29-4f15-ae11-2b48468600ee tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5eec3c16c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d948adf-16c8-4098-aec1-e616613d545c'): ({'sde'}, set())}) {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 21:37:12 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-50886065-ed29-4f15-ae11-2b48468600ee tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] Removing single pathed devices sde {{(pid=74337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 21:37:12 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:12 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:12 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad881082-7107-4570-9eb0-b42ed4c60a63]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:12 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:12 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:12 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[57789435-dbc3-4564-92de-90e283bf96b3]: (4, ('ok\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:12 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-50886065-ed29-4f15-ae11-2b48468600ee tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] Flushing IO for device /dev/sde {{(pid=74337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 21:37:12 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:12 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:12 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8350dcc-7bc6-4d8f-81c0-a18b154758b2]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:12 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-50886065-ed29-4f15-ae11-2b48468600ee tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 21:37:12 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:12 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.040s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:12 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[131256e5-5956-45ff-946e-87746a1753dc]: (4, ('1', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:12 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-50886065-ed29-4f15-ae11-2b48468600ee tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] Checking to see if SCSI volumes sde have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 21:37:12 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-50886065-ed29-4f15-ae11-2b48468600ee tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] SCSI volumes sde have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 21:37:12 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-50886065-ed29-4f15-ae11-2b48468600ee tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d948adf-16c8-4098-aec1-e616613d545c')] {{(pid=74337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 21:37:12 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d948adf-16c8-4098-aec1-e616613d545c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:12 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d948adf-16c8-4098-aec1-e616613d545c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:12 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a4c8951-00a6-49e2-9e73-604238ab24c7]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:12 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-50886065-ed29-4f15-ae11-2b48468600ee tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:37:12 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d948adf-16c8-4098-aec1-e616613d545c -p 172.16.0.220:3260 --logout {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:12 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d948adf-16c8-4098-aec1-e616613d545c -p 172.16.0.220:3260 --logout" returned: 0 in 0.093s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:12 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c46f66c9-2d95-4506-92da-7a4befe1f369]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:0d948adf-16c8-4098-aec1-e616613d545c, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:0d948adf-16c8-4098-aec1-e616613d545c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:12 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-50886065-ed29-4f15-ae11-2b48468600ee tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:0d948adf-16c8-4098-aec1-e616613d545c, portal: 172.16.0.220,3260]
Oct 23 21:37:12 user nova-compute[74337]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:0d948adf-16c8-4098-aec1-e616613d545c, portal: 172.16.0.220,3260] successful.
Oct 23 21:37:12 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:37:12 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d948adf-16c8-4098-aec1-e616613d545c -p 172.16.0.220:3260 --op delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:13 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d948adf-16c8-4098-aec1-e616613d545c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.049s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:13 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[67496bad-e5dc-40a8-b52f-648df3290c52]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:13 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-50886065-ed29-4f15-ae11-2b48468600ee tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:37:13 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-50886065-ed29-4f15-ae11-2b48468600ee tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.413s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:37:13 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-50886065-ed29-4f15-ae11-2b48468600ee tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] <== disconnect_volume: return (414ms) None {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:37:13 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50886065-ed29-4f15-ae11-2b48468600ee tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] [instance: 5a181593-8086-4ece-9f5b-5ccba0bfe91e] Disconnected iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 21:37:13 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:13 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: ff1c790c-2458-438e-95c7-7e1412fe05fc] Instance destroyed successfully.
Oct 23 21:37:13 user nova-compute[74337]: DEBUG nova.objects.instance [None req-151e1df8-1137-4736-a08f-16902558f648 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Lazy-loading 'resources' on Instance uuid ff1c790c-2458-438e-95c7-7e1412fe05fc {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:37:13 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-151e1df8-1137-4736-a08f-16902558f648 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T21:33:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-908688255',display_name='tempest-AttachSCSIVolumeTestJSON-server-908688255',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-908688255',id=6,image_ref='42a1517e-ef22-4f53-800d-106330acefbc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPd/iziWr420mTBtexQB4JLh3y8nMF7b3lC+/orZ3nWa+5WnD0Xmmnhsi/7IDK797OWZ0kYksxXSw3CGKqjBoRTEb2oV6oL9K/CdufbDV0xMehjtw5wOx0IPRPI0cilhhg==',key_name='tempest-keypair-327531323',keypairs=<?>,launch_index=0,launched_at=2023-10-23T21:33:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8974716be54b402a8d6b91a30e71f480',ramdisk_id='',reservation_id='r-jwzeai7b',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='42a1517e-ef22-4f53-800d-106330acefbc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-305936041',owner_user_name='tempest-AttachSCSIVolumeTestJSON-305936041-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T21:33:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9275fe8f8ca0498aa0a743a3165e30d3',uuid=ff1c790c-2458-438e-95c7-7e1412fe05fc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ff6c7795-2085-4305-b0aa-72050c9b979b", "address": "fa:16:3e:0c:4d:a8", "network": {"id": "44287c31-0a66-49b2-a43f-9197e80d754e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1903058995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8974716be54b402a8d6b91a30e71f480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff6c7795-20", "ovs_interfaceid": "ff6c7795-2085-4305-b0aa-72050c9b979b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 21:37:13 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-151e1df8-1137-4736-a08f-16902558f648 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Converting VIF {"id": "ff6c7795-2085-4305-b0aa-72050c9b979b", "address": "fa:16:3e:0c:4d:a8", "network": {"id": "44287c31-0a66-49b2-a43f-9197e80d754e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1903058995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8974716be54b402a8d6b91a30e71f480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff6c7795-20", "ovs_interfaceid": "ff6c7795-2085-4305-b0aa-72050c9b979b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:37:13 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-151e1df8-1137-4736-a08f-16902558f648 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0c:4d:a8,bridge_name='br-int',has_traffic_filtering=True,id=ff6c7795-2085-4305-b0aa-72050c9b979b,network=Network(44287c31-0a66-49b2-a43f-9197e80d754e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff6c7795-20') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:37:13 user nova-compute[74337]: DEBUG os_vif [None req-151e1df8-1137-4736-a08f-16902558f648 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:4d:a8,bridge_name='br-int',has_traffic_filtering=True,id=ff6c7795-2085-4305-b0aa-72050c9b979b,network=Network(44287c31-0a66-49b2-a43f-9197e80d754e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff6c7795-20') {{(pid=74337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 21:37:13 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:13 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapff6c7795-20, bridge=br-int, if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:37:13 user nova-compute[74337]: DEBUG nova.compute.manager [None req-50886065-ed29-4f15-ae11-2b48468600ee tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wfjRXToB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, 'status': 'reserved', 'instance': '5a181593-8086-4ece-9f5b-5ccba0bfe91e', 'attached_at': '', 'detached_at': '', 'volume_id': '06d4748a-a032-4937-a18b-c323e56f507f', 'serial'} {{(pid=74337) _swap_volume /opt/stack/nova/nova/compute/manager.py:7790}}
Oct 23 21:37:13 user nova-compute[74337]: DEBUG nova.compute.manager [None req-50886065-ed29-4f15-ae11-2b48468600ee tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] [instance: 5a181593-8086-4ece-9f5b-5ccba0bfe91e] swap_volume: removing Cinder connection for volume 0d948adf-16c8-4098-aec1-e616613d545c {{(pid=74337) _swap_volume /opt/stack/nova/nova/compute/manager.py:7835}}
Oct 23 21:37:13 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:37:13 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:13 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c792d37b-a9a6-4733-b74f-3be79d726083) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:37:13 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:13 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:13 user nova-compute[74337]: INFO os_vif [None req-151e1df8-1137-4736-a08f-16902558f648 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:4d:a8,bridge_name='br-int',has_traffic_filtering=True,id=ff6c7795-2085-4305-b0aa-72050c9b979b,network=Network(44287c31-0a66-49b2-a43f-9197e80d754e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff6c7795-20')
Oct 23 21:37:13 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-151e1df8-1137-4736-a08f-16902558f648 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] [instance: ff1c790c-2458-438e-95c7-7e1412fe05fc] Deleting instance files /opt/stack/data/nova/instances/ff1c790c-2458-438e-95c7-7e1412fe05fc_del
Oct 23 21:37:13 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-151e1df8-1137-4736-a08f-16902558f648 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] [instance: ff1c790c-2458-438e-95c7-7e1412fe05fc] Deletion of /opt/stack/data/nova/instances/ff1c790c-2458-438e-95c7-7e1412fe05fc_del complete
Oct 23 21:37:13 user nova-compute[74337]: INFO nova.compute.manager [None req-151e1df8-1137-4736-a08f-16902558f648 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] [instance: ff1c790c-2458-438e-95c7-7e1412fe05fc] Took 0.98 seconds to destroy the instance on the hypervisor.
Oct 23 21:37:13 user nova-compute[74337]: DEBUG oslo.service.loopingcall [None req-151e1df8-1137-4736-a08f-16902558f648 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74337) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 21:37:13 user nova-compute[74337]: DEBUG nova.compute.manager [-] [instance: ff1c790c-2458-438e-95c7-7e1412fe05fc] Deallocating network for instance {{(pid=74337) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 21:37:13 user nova-compute[74337]: DEBUG nova.network.neutron [-] [instance: ff1c790c-2458-438e-95c7-7e1412fe05fc] deallocate_for_instance() {{(pid=74337) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 21:37:14 user nova-compute[74337]: DEBUG nova.compute.manager [None req-50886065-ed29-4f15-ae11-2b48468600ee tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] [instance: 5a181593-8086-4ece-9f5b-5ccba0bfe91e] swap_volume: Updating volume 0d948adf-16c8-4098-aec1-e616613d545c BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "wfjRXToB", "auth_password": "3VR8sA4mXkf69M", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdk", "volume_id": "06d4748a-a032-4937-a18b-c323e56f507f"}, "status": "reserved", "instance": "5a181593-8086-4ece-9f5b-5ccba0bfe91e", "attached_at": "", "detached_at": "", "volume_id": "06d4748a-a032-4937-a18b-c323e56f507f", "serial": "06d4748a-a032-4937-a18b-c323e56f507f"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '06d4748a-a032-4937-a18b-c323e56f507f', 'no_device': None, 'attachment_id': 'f4c2595e-18e6-43c7-9673-4433c8bcb5bd'} {{(pid=74337) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7983}}
Oct 23 21:37:14 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-50886065-ed29-4f15-ae11-2b48468600ee tempest-TestVolumeSwap-1996752464 tempest-TestVolumeSwap-1996752464-project-admin] Lock "5a181593-8086-4ece-9f5b-5ccba0bfe91e" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 31.690s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:37:14 user nova-compute[74337]: DEBUG nova.network.neutron [-] [instance: ff1c790c-2458-438e-95c7-7e1412fe05fc] Updating instance_info_cache with network_info: [] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:37:14 user nova-compute[74337]: DEBUG nova.compute.manager [req-68fdb870-a86c-4456-a516-e94a06551ef7 req-94e56948-ac7e-415e-96f0-8e5ac5117e7f service nova] [instance: ff1c790c-2458-438e-95c7-7e1412fe05fc] Received event network-vif-deleted-ff6c7795-2085-4305-b0aa-72050c9b979b {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:37:14 user nova-compute[74337]: INFO nova.compute.manager [req-68fdb870-a86c-4456-a516-e94a06551ef7 req-94e56948-ac7e-415e-96f0-8e5ac5117e7f service nova] [instance: ff1c790c-2458-438e-95c7-7e1412fe05fc] Neutron deleted interface ff6c7795-2085-4305-b0aa-72050c9b979b; detaching it from the instance and deleting it from the info cache
Oct 23 21:37:14 user nova-compute[74337]: DEBUG nova.network.neutron [req-68fdb870-a86c-4456-a516-e94a06551ef7 req-94e56948-ac7e-415e-96f0-8e5ac5117e7f service nova] [instance: ff1c790c-2458-438e-95c7-7e1412fe05fc] Updating instance_info_cache with network_info: [] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:37:14 user nova-compute[74337]: INFO nova.compute.manager [-] [instance: ff1c790c-2458-438e-95c7-7e1412fe05fc] Took 0.89 seconds to deallocate network for instance.
Oct 23 21:37:14 user nova-compute[74337]: DEBUG nova.compute.manager [req-68fdb870-a86c-4456-a516-e94a06551ef7 req-94e56948-ac7e-415e-96f0-8e5ac5117e7f service nova] [instance: ff1c790c-2458-438e-95c7-7e1412fe05fc] Detach interface failed, port_id=ff6c7795-2085-4305-b0aa-72050c9b979b, reason: Instance ff1c790c-2458-438e-95c7-7e1412fe05fc could not be found. {{(pid=74337) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 23 21:37:14 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-151e1df8-1137-4736-a08f-16902558f648 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:37:14 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-151e1df8-1137-4736-a08f-16902558f648 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:37:14 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-151e1df8-1137-4736-a08f-16902558f648 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:37:14 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-151e1df8-1137-4736-a08f-16902558f648 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:37:14 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-151e1df8-1137-4736-a08f-16902558f648 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.421s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:37:14 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-8986f5b9-1a52-4929-a0e3-14b800ba6363 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Acquiring lock "5a181593-8086-4ece-9f5b-5ccba0bfe91e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:37:14 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-8986f5b9-1a52-4929-a0e3-14b800ba6363 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Lock "5a181593-8086-4ece-9f5b-5ccba0bfe91e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:37:14 user nova-compute[74337]: INFO nova.compute.manager [None req-8986f5b9-1a52-4929-a0e3-14b800ba6363 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] [instance: 5a181593-8086-4ece-9f5b-5ccba0bfe91e] Detaching volume 06d4748a-a032-4937-a18b-c323e56f507f
Oct 23 21:37:14 user nova-compute[74337]: DEBUG nova.compute.manager [req-b1f828ed-da85-4ba3-b869-c77b7eef7857 req-a338af2d-c04e-41e3-b65c-acaff3b436b5 service nova] [instance: ff1c790c-2458-438e-95c7-7e1412fe05fc] Received event network-vif-plugged-ff6c7795-2085-4305-b0aa-72050c9b979b {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:37:14 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-b1f828ed-da85-4ba3-b869-c77b7eef7857 req-a338af2d-c04e-41e3-b65c-acaff3b436b5 service nova] Acquiring lock "ff1c790c-2458-438e-95c7-7e1412fe05fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:37:14 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-b1f828ed-da85-4ba3-b869-c77b7eef7857 req-a338af2d-c04e-41e3-b65c-acaff3b436b5 service nova] Lock "ff1c790c-2458-438e-95c7-7e1412fe05fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:37:14 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-b1f828ed-da85-4ba3-b869-c77b7eef7857 req-a338af2d-c04e-41e3-b65c-acaff3b436b5 service nova] Lock "ff1c790c-2458-438e-95c7-7e1412fe05fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:37:14 user nova-compute[74337]: DEBUG nova.compute.manager [req-b1f828ed-da85-4ba3-b869-c77b7eef7857 req-a338af2d-c04e-41e3-b65c-acaff3b436b5 service nova] [instance: ff1c790c-2458-438e-95c7-7e1412fe05fc] No waiting events found dispatching network-vif-plugged-ff6c7795-2085-4305-b0aa-72050c9b979b {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:37:14 user nova-compute[74337]: WARNING nova.compute.manager [req-b1f828ed-da85-4ba3-b869-c77b7eef7857 req-a338af2d-c04e-41e3-b65c-acaff3b436b5 service nova] [instance: ff1c790c-2458-438e-95c7-7e1412fe05fc] Received unexpected event network-vif-plugged-ff6c7795-2085-4305-b0aa-72050c9b979b for instance with vm_state deleted and task_state None.
Oct 23 21:37:14 user nova-compute[74337]: INFO nova.scheduler.client.report [None req-151e1df8-1137-4736-a08f-16902558f648 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Deleted allocations for instance ff1c790c-2458-438e-95c7-7e1412fe05fc
Oct 23 21:37:14 user nova-compute[74337]: INFO nova.virt.block_device [None req-8986f5b9-1a52-4929-a0e3-14b800ba6363 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] [instance: 5a181593-8086-4ece-9f5b-5ccba0bfe91e] Attempting to driver detach volume 06d4748a-a032-4937-a18b-c323e56f507f from mountpoint /dev/vdb
Oct 23 21:37:14 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-8986f5b9-1a52-4929-a0e3-14b800ba6363 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Attempting to detach device vdb from instance 5a181593-8086-4ece-9f5b-5ccba0bfe91e from the persistent domain config. {{(pid=74337) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 21:37:14 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-8986f5b9-1a52-4929-a0e3-14b800ba6363 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 21:37:14 user nova-compute[74337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 21:37:14 user nova-compute[74337]:   <source dev="/dev/sdk"/>
Oct 23 21:37:14 user nova-compute[74337]:   <target dev="vdb" bus="virtio"/>
Oct 23 21:37:14 user nova-compute[74337]:   <serial>06d4748a-a032-4937-a18b-c323e56f507f</serial>
Oct 23 21:37:14 user nova-compute[74337]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 21:37:14 user nova-compute[74337]: </disk>
Oct 23 21:37:14 user nova-compute[74337]:  {{(pid=74337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 21:37:14 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-8986f5b9-1a52-4929-a0e3-14b800ba6363 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Successfully detached device vdb from instance 5a181593-8086-4ece-9f5b-5ccba0bfe91e from the persistent domain config.
Oct 23 21:37:14 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-8986f5b9-1a52-4929-a0e3-14b800ba6363 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5a181593-8086-4ece-9f5b-5ccba0bfe91e from the live domain config. {{(pid=74337) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 21:37:14 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-8986f5b9-1a52-4929-a0e3-14b800ba6363 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 21:37:14 user nova-compute[74337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 21:37:14 user nova-compute[74337]:   <source dev="/dev/sdk"/>
Oct 23 21:37:14 user nova-compute[74337]:   <target dev="vdb" bus="virtio"/>
Oct 23 21:37:14 user nova-compute[74337]:   <serial>06d4748a-a032-4937-a18b-c323e56f507f</serial>
Oct 23 21:37:14 user nova-compute[74337]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 21:37:14 user nova-compute[74337]: </disk>
Oct 23 21:37:14 user nova-compute[74337]:  {{(pid=74337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 21:37:14 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-151e1df8-1137-4736-a08f-16902558f648 tempest-AttachSCSIVolumeTestJSON-305936041 tempest-AttachSCSIVolumeTestJSON-305936041-project-member] Lock "ff1c790c-2458-438e-95c7-7e1412fe05fc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.581s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:37:15 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-8986f5b9-1a52-4929-a0e3-14b800ba6363 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5a181593-8086-4ece-9f5b-5ccba0bfe91e {{(pid=74337) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 21:37:18 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:18 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:21 user nova-compute[74337]: ERROR nova.volume.cinder [None req-adfdde1d-973f-408a-9f75-57c47592ed4a tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] Update attachment failed for attachment c6a57788-9fc1-499c-a48f-bd65ad534666. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-ff4a57bf-0d52-4be3-9651-9bd6272bf40b) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-ff4a57bf-0d52-4be3-9651-9bd6272bf40b)
Oct 23 21:37:21 user nova-compute[74337]: ERROR nova.compute.manager [None req-adfdde1d-973f-408a-9f75-57c47592ed4a tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89] Failed to attach eb9f2e36-dc9f-4bc1-a362-c6298e206611 at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-ff4a57bf-0d52-4be3-9651-9bd6272bf40b)
Oct 23 21:37:21 user nova-compute[74337]: ERROR nova.compute.manager [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89] Traceback (most recent call last):
Oct 23 21:37:21 user nova-compute[74337]: ERROR nova.compute.manager [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89]   File "/opt/stack/nova/nova/compute/manager.py", line 7566, in _attach_volume
Oct 23 21:37:21 user nova-compute[74337]: ERROR nova.compute.manager [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89]     bdm.attach(context, instance, self.volume_api, self.driver,
Oct 23 21:37:21 user nova-compute[74337]: ERROR nova.compute.manager [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Oct 23 21:37:21 user nova-compute[74337]: ERROR nova.compute.manager [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89]     ret_val = method(obj, context, *args, **kwargs)
Oct 23 21:37:21 user nova-compute[74337]: ERROR nova.compute.manager [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Oct 23 21:37:21 user nova-compute[74337]: ERROR nova.compute.manager [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89]     self._do_attach(context, instance, volume, volume_api,
Oct 23 21:37:21 user nova-compute[74337]: ERROR nova.compute.manager [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Oct 23 21:37:21 user nova-compute[74337]: ERROR nova.compute.manager [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89]     self._volume_attach(context, volume, connector, instance,
Oct 23 21:37:21 user nova-compute[74337]: ERROR nova.compute.manager [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Oct 23 21:37:21 user nova-compute[74337]: ERROR nova.compute.manager [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89]     connection_info = volume_api.attachment_update(
Oct 23 21:37:21 user nova-compute[74337]: ERROR nova.compute.manager [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 23 21:37:21 user nova-compute[74337]: ERROR nova.compute.manager [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89]     res = method(self, ctx, *args, **kwargs)
Oct 23 21:37:21 user nova-compute[74337]: ERROR nova.compute.manager [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 23 21:37:21 user nova-compute[74337]: ERROR nova.compute.manager [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89]     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 23 21:37:21 user nova-compute[74337]: ERROR nova.compute.manager [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 23 21:37:21 user nova-compute[74337]: ERROR nova.compute.manager [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89]     with excutils.save_and_reraise_exception():
Oct 23 21:37:21 user nova-compute[74337]: ERROR nova.compute.manager [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 23 21:37:21 user nova-compute[74337]: ERROR nova.compute.manager [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89]     self.force_reraise()
Oct 23 21:37:21 user nova-compute[74337]: ERROR nova.compute.manager [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 23 21:37:21 user nova-compute[74337]: ERROR nova.compute.manager [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89]     raise self.value
Oct 23 21:37:21 user nova-compute[74337]: ERROR nova.compute.manager [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 23 21:37:21 user nova-compute[74337]: ERROR nova.compute.manager [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89]     context, '3.44', skip_version_check=True).attachments.update(
Oct 23 21:37:21 user nova-compute[74337]: ERROR nova.compute.manager [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 23 21:37:21 user nova-compute[74337]: ERROR nova.compute.manager [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89]     return method.func(obj, *args, **kwargs)
Oct 23 21:37:21 user nova-compute[74337]: ERROR nova.compute.manager [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 23 21:37:21 user nova-compute[74337]: ERROR nova.compute.manager [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89]     resp = self._update('/attachments/%s' % id, body)
Oct 23 21:37:21 user nova-compute[74337]: ERROR nova.compute.manager [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 23 21:37:21 user nova-compute[74337]: ERROR nova.compute.manager [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89]     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 23 21:37:21 user nova-compute[74337]: ERROR nova.compute.manager [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 23 21:37:21 user nova-compute[74337]: ERROR nova.compute.manager [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89]     return self._cs_request(url, 'PUT', **kwargs)
Oct 23 21:37:21 user nova-compute[74337]: ERROR nova.compute.manager [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 23 21:37:21 user nova-compute[74337]: ERROR nova.compute.manager [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89]     return self.request(url, method, **kwargs)
Oct 23 21:37:21 user nova-compute[74337]: ERROR nova.compute.manager [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 23 21:37:21 user nova-compute[74337]: ERROR nova.compute.manager [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89]     raise exceptions.from_response(resp, body)
Oct 23 21:37:21 user nova-compute[74337]: ERROR nova.compute.manager [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-ff4a57bf-0d52-4be3-9651-9bd6272bf40b)
Oct 23 21:37:21 user nova-compute[74337]: ERROR nova.compute.manager [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89] 
Oct 23 21:37:21 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-adfdde1d-973f-408a-9f75-57c47592ed4a tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] Lock "cf6270ba-7a4e-40c4-b7fd-c62a44125c89" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 29.279s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:37:21 user nova-compute[74337]: ERROR oslo_messaging.rpc.server [None req-adfdde1d-973f-408a-9f75-57c47592ed4a tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-ff4a57bf-0d52-4be3-9651-9bd6272bf40b)
Oct 23 21:37:21 user nova-compute[74337]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 23 21:37:21 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 23 21:37:21 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 23 21:37:21 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 23 21:37:21 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 23 21:37:21 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 23 21:37:21 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 23 21:37:21 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 23 21:37:21 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 23 21:37:21 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 23 21:37:21 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 23 21:37:21 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 23 21:37:21 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 23 21:37:21 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 23 21:37:21 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 23 21:37:21 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Oct 23 21:37:21 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 23 21:37:21 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Oct 23 21:37:21 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 23 21:37:21 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 23 21:37:21 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 23 21:37:21 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 23 21:37:21 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 23 21:37:21 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Oct 23 21:37:21 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 23 21:37:21 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7552, in attach_volume
Oct 23 21:37:21 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Oct 23 21:37:21 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Oct 23 21:37:21 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Oct 23 21:37:21 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7549, in do_attach_volume
Oct 23 21:37:21 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 23 21:37:21 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 23 21:37:21 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 23 21:37:21 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 23 21:37:21 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 23 21:37:21 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7547, in do_attach_volume
Oct 23 21:37:21 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Oct 23 21:37:21 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7569, in _attach_volume
Oct 23 21:37:21 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 23 21:37:21 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 23 21:37:21 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 23 21:37:21 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 23 21:37:21 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 23 21:37:21 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7566, in _attach_volume
Oct 23 21:37:21 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Oct 23 21:37:21 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Oct 23 21:37:21 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Oct 23 21:37:21 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Oct 23 21:37:21 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Oct 23 21:37:21 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Oct 23 21:37:21 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Oct 23 21:37:21 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Oct 23 21:37:21 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Oct 23 21:37:21 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 23 21:37:21 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Oct 23 21:37:21 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 23 21:37:21 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 23 21:37:21 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 23 21:37:21 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 23 21:37:21 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 23 21:37:21 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 23 21:37:21 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 23 21:37:21 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 23 21:37:21 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 23 21:37:21 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Oct 23 21:37:21 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 23 21:37:21 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Oct 23 21:37:21 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 23 21:37:21 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Oct 23 21:37:21 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 23 21:37:21 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 23 21:37:21 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 23 21:37:21 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Oct 23 21:37:21 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 23 21:37:21 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Oct 23 21:37:21 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 23 21:37:21 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Oct 23 21:37:21 user nova-compute[74337]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-ff4a57bf-0d52-4be3-9651-9bd6272bf40b)
Oct 23 21:37:21 user nova-compute[74337]: ERROR oslo_messaging.rpc.server 
Oct 23 21:37:21 user nova-compute[74337]: DEBUG nova.compute.manager [req-495a641a-f330-4371-bb26-23387b4a1c1d req-894ab299-64f9-4270-8ff8-e2f9d92eef24 service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Received event network-changed-58eb51e5-3d74-4162-93b8-66bdf176c1d5 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:37:21 user nova-compute[74337]: DEBUG nova.compute.manager [req-495a641a-f330-4371-bb26-23387b4a1c1d req-894ab299-64f9-4270-8ff8-e2f9d92eef24 service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Refreshing instance network info cache due to event network-changed-58eb51e5-3d74-4162-93b8-66bdf176c1d5. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 21:37:21 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-495a641a-f330-4371-bb26-23387b4a1c1d req-894ab299-64f9-4270-8ff8-e2f9d92eef24 service nova] Acquiring lock "refresh_cache-f1040399-0c5d-4a68-9ee0-4fbe45a42c55" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:37:21 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-495a641a-f330-4371-bb26-23387b4a1c1d req-894ab299-64f9-4270-8ff8-e2f9d92eef24 service nova] Acquired lock "refresh_cache-f1040399-0c5d-4a68-9ee0-4fbe45a42c55" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:37:21 user nova-compute[74337]: DEBUG nova.network.neutron [req-495a641a-f330-4371-bb26-23387b4a1c1d req-894ab299-64f9-4270-8ff8-e2f9d92eef24 service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Refreshing network info cache for port 58eb51e5-3d74-4162-93b8-66bdf176c1d5 {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 21:37:22 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5ea4e55-3476-4b19-9916-a5f684857ad5 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Calling os-brick to attach iSCSI Volume {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 21:37:22 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5ea4e55-3476-4b19-9916-a5f684857ad5 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cQHBUDwS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:37:22 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-c5ea4e55-3476-4b19-9916-a5f684857ad5 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:37:22 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-c5ea4e55-3476-4b19-9916-a5f684857ad5 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:37:22 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-c5ea4e55-3476-4b19-9916-a5f684857ad5 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:37:22 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-c5ea4e55-3476-4b19-9916-a5f684857ad5 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:37:22 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-c5ea4e55-3476-4b19-9916-a5f684857ad5 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:37:22 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-c5ea4e55-3476-4b19-9916-a5f684857ad5 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:37:22 user nova-compute[74337]: INFO os_brick.initiator.connectors.iscsi [None req-c5ea4e55-3476-4b19-9916-a5f684857ad5 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 21:37:22 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 -p 172.16.0.220:3260 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:22 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:22 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[1186441a-57ce-49df-b762-6043c2b65234]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:22 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5ea4e55-3476-4b19-9916-a5f684857ad5 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 21:37:22 user nova-compute[74337]:  {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:37:22 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 -p 172.16.0.220:3260 --interface default --op new {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:22 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:22 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[547598d1-21a6-43c2-8e57-ea8c1aa696ed]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522] added\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:22 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5ea4e55-3476-4b19-9916-a5f684857ad5 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522] added
Oct 23 21:37:22 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:37:22 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:22 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:22 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce1d962d-721b-42f8-b775-4bb02430fe18]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:22 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5ea4e55-3476-4b19-9916-a5f684857ad5 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:37:22 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:22 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:22 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[35feae1e-661a-4676-8224-9c0ac3bd4dce]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:22 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5ea4e55-3476-4b19-9916-a5f684857ad5 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:37:22 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cQHBUDwS {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:22 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cQHBUDwS" returned: 0 in 0.024s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:22 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[7950f367-614e-418e-81f7-a5ae4a2ddd5d]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:22 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5ea4e55-3476-4b19-9916-a5f684857ad5 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cQHBUDwS'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:37:22 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:22 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:22 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c9de5aa-2486-4e43-8356-5ce733a634f1]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:22 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5ea4e55-3476-4b19-9916-a5f684857ad5 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:37:22 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:22 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:22 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[bab9d1d6-d285-43b4-b97a-5a79f6863582]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:22 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5ea4e55-3476-4b19-9916-a5f684857ad5 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496 (non-flash)
Oct 23 21:37:22 user nova-compute[74337]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f (non-flash)
Oct 23 21:37:22 user nova-compute[74337]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)
Oct 23 21:37:22 user nova-compute[74337]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b (non-flash)
Oct 23 21:37:22 user nova-compute[74337]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 (non-flash)
Oct 23 21:37:22 user nova-compute[74337]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a (non-flash)
Oct 23 21:37:22 user nova-compute[74337]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661 (non-flash)
Oct 23 21:37:22 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:37:22 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5ea4e55-3476-4b19-9916-a5f684857ad5 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496 (non-flash)
Oct 23 21:37:22 user nova-compute[74337]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f (non-flash)
Oct 23 21:37:22 user nova-compute[74337]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)
Oct 23 21:37:22 user nova-compute[74337]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b (non-flash)
Oct 23 21:37:22 user nova-compute[74337]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 (non-flash)
Oct 23 21:37:22 user nova-compute[74337]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a (non-flash)
Oct 23 21:37:22 user nova-compute[74337]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661 (non-flash)
Oct 23 21:37:22 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:37:22 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 -p 172.16.0.220:3260 --login {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:22 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:22 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2774746-26f9-4db3-9cc4-61cdd010d08d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:22 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5ea4e55-3476-4b19-9916-a5f684857ad5 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522, portal: 172.16.0.220,3260]
Oct 23 21:37:22 user nova-compute[74337]: Login to [iface: default, target: iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522, portal: 172.16.0.220,3260] successful.
Oct 23 21:37:22 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:37:22 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:22 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:22 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[3885f40c-4f64-479b-b39d-8b5bb5b570cc]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:22 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5ea4e55-3476-4b19-9916-a5f684857ad5 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:37:22 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:22 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:22 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb26a42d-2403-4463-ae0e-22dfea183966]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:22 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5ea4e55-3476-4b19-9916-a5f684857ad5 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496 (non-flash)
Oct 23 21:37:22 user nova-compute[74337]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f (non-flash)
Oct 23 21:37:22 user nova-compute[74337]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 (non-flash)
Oct 23 21:37:22 user nova-compute[74337]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)
Oct 23 21:37:22 user nova-compute[74337]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b (non-flash)
Oct 23 21:37:22 user nova-compute[74337]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 (non-flash)
Oct 23 21:37:22 user nova-compute[74337]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a (non-flash)
Oct 23 21:37:22 user nova-compute[74337]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661 (non-flash)
Oct 23 21:37:22 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:37:22 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5ea4e55-3476-4b19-9916-a5f684857ad5 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496 (non-flash)
Oct 23 21:37:22 user nova-compute[74337]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f (non-flash)
Oct 23 21:37:22 user nova-compute[74337]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 (non-flash)
Oct 23 21:37:22 user nova-compute[74337]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)
Oct 23 21:37:22 user nova-compute[74337]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b (non-flash)
Oct 23 21:37:22 user nova-compute[74337]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 (non-flash)
Oct 23 21:37:22 user nova-compute[74337]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a (non-flash)
Oct 23 21:37:22 user nova-compute[74337]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661 (non-flash)
Oct 23 21:37:22 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:37:22 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-c5ea4e55-3476-4b19-9916-a5f684857ad5 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.354s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:37:22 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5ea4e55-3476-4b19-9916-a5f684857ad5 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Connected to 172.16.0.220:3260 {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 21:37:22 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-c5ea4e55-3476-4b19-9916-a5f684857ad5 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] HCTL ('36', '-', '-', 0) found on session 16 with lun 0 {{(pid=74337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 21:37:22 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-c5ea4e55-3476-4b19-9916-a5f684857ad5 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 21:37:22 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:22 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.022s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:22 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[224dc014-8330-45a5-b6e6-c59a522b1467]: (4, ('- - 0', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:22 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-c5ea4e55-3476-4b19-9916-a5f684857ad5 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Searching for a device in session 16 and hctl ['36', '*', '*', 0] yield: None {{(pid=74337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 21:37:22 user nova-compute[74337]: DEBUG nova.network.neutron [req-495a641a-f330-4371-bb26-23387b4a1c1d req-894ab299-64f9-4270-8ff8-e2f9d92eef24 service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Updated VIF entry in instance network info cache for port 58eb51e5-3d74-4162-93b8-66bdf176c1d5. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 21:37:22 user nova-compute[74337]: DEBUG nova.network.neutron [req-495a641a-f330-4371-bb26-23387b4a1c1d req-894ab299-64f9-4270-8ff8-e2f9d92eef24 service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Updating instance_info_cache with network_info: [{"id": "58eb51e5-3d74-4162-93b8-66bdf176c1d5", "address": "fa:16:3e:53:ba:1b", "network": {"id": "54ea29fa-daa7-4818-8d2d-c90ee9a18a95", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1215215856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58eb51e5-3d", "ovs_interfaceid": "58eb51e5-3d74-4162-93b8-66bdf176c1d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dd8e8982-b86c-469a-aa55-72bb2ac9bb8b", "address": "fa:16:3e:67:90:76", "network": {"id": "8b22a426-2945-474d-b0e6-8c22bb5e57e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-57423842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd8e8982-b8", "ovs_interfaceid": "dd8e8982-b86c-469a-aa55-72bb2ac9bb8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e91aa55a-4a71-4090-bdde-88c4a648b60b", "address": "fa:16:3e:45:60:43", "network": {"id": "8b22a426-2945-474d-b0e6-8c22bb5e57e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-57423842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape91aa55a-4a", "ovs_interfaceid": "e91aa55a-4a71-4090-bdde-88c4a648b60b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ddee6c78-417b-494f-a9e1-f662c549f425", "address": "fa:16:3e:fb:ef:75", "network": {"id": "8b22a426-2945-474d-b0e6-8c22bb5e57e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-57423842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddee6c78-41", "ovs_interfaceid": "ddee6c78-417b-494f-a9e1-f662c549f425", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b1664585-4013-46f9-9738-33fd7b9a3161", "address": "fa:16:3e:e8:30:72", "network": {"id": "8b22a426-2945-474d-b0e6-8c22bb5e57e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-57423842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1664585-40", "ovs_interfaceid": "b1664585-4013-46f9-9738-33fd7b9a3161", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ba01b035-453b-4378-92fc-1d81b84363ff", "address": "fa:16:3e:89:cb:12", "network": {"id": "cd8ce1ca-56b3-48fa-bb57-54d0616aa7ca", "bridge": "br-int", "label": "tempest-device-tagging-net2-611360182", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba01b035-45", "ovs_interfaceid": "ba01b035-453b-4378-92fc-1d81b84363ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "248131be-39a9-430f-b27a-377d176d7846", "address": "fa:16:3e:5d:ae:b7", "network": {"id": "cd8ce1ca-56b3-48fa-bb57-54d0616aa7ca", "bridge": "br-int", "label": "tempest-device-tagging-net2-611360182", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap248131be-39", "ovs_interfaceid": "248131be-39a9-430f-b27a-377d176d7846", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:37:22 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-495a641a-f330-4371-bb26-23387b4a1c1d req-894ab299-64f9-4270-8ff8-e2f9d92eef24 service nova] Releasing lock "refresh_cache-f1040399-0c5d-4a68-9ee0-4fbe45a42c55" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:37:23 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:23 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:23 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-c5ea4e55-3476-4b19-9916-a5f684857ad5 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Searching for a device in session 16 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 21:37:23 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5ea4e55-3476-4b19-9916-a5f684857ad5 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cQHBUDwS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 21:37:23 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-c5ea4e55-3476-4b19-9916-a5f684857ad5 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.393s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:37:23 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5ea4e55-3476-4b19-9916-a5f684857ad5 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] <== connect_volume: return (1395ms) {'type': 'block', 'scsi_wwn': '23137393363343964', 'path': '/dev/sde'} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:37:23 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5ea4e55-3476-4b19-9916-a5f684857ad5 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23137393363343964', 'path': '/dev/sde'} {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 21:37:23 user nova-compute[74337]: DEBUG nova.objects.instance [None req-c5ea4e55-3476-4b19-9916-a5f684857ad5 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Lazy-loading 'flavor' on Instance uuid d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:37:23 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-c5ea4e55-3476-4b19-9916-a5f684857ad5 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 21:37:23 user nova-compute[74337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 21:37:23 user nova-compute[74337]:   <source dev="/dev/sde"/>
Oct 23 21:37:23 user nova-compute[74337]:   <target dev="vdb" bus="virtio"/>
Oct 23 21:37:23 user nova-compute[74337]:   <serial>61659946-05f4-49d5-9e10-69b68340b522</serial>
Oct 23 21:37:23 user nova-compute[74337]: </disk>
Oct 23 21:37:23 user nova-compute[74337]:  {{(pid=74337) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 21:37:23 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-c5ea4e55-3476-4b19-9916-a5f684857ad5 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] No BDM found with device name vda, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 21:37:23 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-c5ea4e55-3476-4b19-9916-a5f684857ad5 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 21:37:23 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-c5ea4e55-3476-4b19-9916-a5f684857ad5 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] No VIF found with MAC fa:16:3e:30:a6:90, not building metadata {{(pid=74337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 21:37:24 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-c5ea4e55-3476-4b19-9916-a5f684857ad5 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Lock "d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.177s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:37:24 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Acquiring lock "f1040399-0c5d-4a68-9ee0-4fbe45a42c55" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:37:24 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Lock "f1040399-0c5d-4a68-9ee0-4fbe45a42c55" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:37:24 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Acquiring lock "f1040399-0c5d-4a68-9ee0-4fbe45a42c55-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:37:24 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Lock "f1040399-0c5d-4a68-9ee0-4fbe45a42c55-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:37:24 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Lock "f1040399-0c5d-4a68-9ee0-4fbe45a42c55-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:37:24 user nova-compute[74337]: INFO nova.compute.manager [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Terminating instance
Oct 23 21:37:24 user nova-compute[74337]: DEBUG nova.compute.manager [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Start destroying the instance on the hypervisor. {{(pid=74337) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 21:37:24 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:24 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:24 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:24 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:24 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:24 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:24 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:24 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:24 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:24 user nova-compute[74337]: DEBUG nova.compute.manager [req-ebd77451-7df3-4219-9ef5-2d05dfffe380 req-efdb13bb-0e8e-4cdb-89f8-5e226ae4b53e service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Received event network-vif-unplugged-58eb51e5-3d74-4162-93b8-66bdf176c1d5 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:37:24 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ebd77451-7df3-4219-9ef5-2d05dfffe380 req-efdb13bb-0e8e-4cdb-89f8-5e226ae4b53e service nova] Acquiring lock "f1040399-0c5d-4a68-9ee0-4fbe45a42c55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:37:24 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ebd77451-7df3-4219-9ef5-2d05dfffe380 req-efdb13bb-0e8e-4cdb-89f8-5e226ae4b53e service nova] Lock "f1040399-0c5d-4a68-9ee0-4fbe45a42c55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:37:24 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ebd77451-7df3-4219-9ef5-2d05dfffe380 req-efdb13bb-0e8e-4cdb-89f8-5e226ae4b53e service nova] Lock "f1040399-0c5d-4a68-9ee0-4fbe45a42c55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:37:24 user nova-compute[74337]: DEBUG nova.compute.manager [req-ebd77451-7df3-4219-9ef5-2d05dfffe380 req-efdb13bb-0e8e-4cdb-89f8-5e226ae4b53e service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] No waiting events found dispatching network-vif-unplugged-58eb51e5-3d74-4162-93b8-66bdf176c1d5 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:37:24 user nova-compute[74337]: DEBUG nova.compute.manager [req-ebd77451-7df3-4219-9ef5-2d05dfffe380 req-efdb13bb-0e8e-4cdb-89f8-5e226ae4b53e service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Received event network-vif-unplugged-58eb51e5-3d74-4162-93b8-66bdf176c1d5 for instance with task_state deleting. {{(pid=74337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 21:37:24 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:24 user nova-compute[74337]: DEBUG nova.compute.manager [req-fc5e1c7c-1dbc-4bce-a358-a8bdfdb9f312 req-1a6ae133-706d-4d44-ac11-e2a29d1e35df service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Received event network-vif-unplugged-dd8e8982-b86c-469a-aa55-72bb2ac9bb8b {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:37:24 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-fc5e1c7c-1dbc-4bce-a358-a8bdfdb9f312 req-1a6ae133-706d-4d44-ac11-e2a29d1e35df service nova] Acquiring lock "f1040399-0c5d-4a68-9ee0-4fbe45a42c55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:37:24 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-fc5e1c7c-1dbc-4bce-a358-a8bdfdb9f312 req-1a6ae133-706d-4d44-ac11-e2a29d1e35df service nova] Lock "f1040399-0c5d-4a68-9ee0-4fbe45a42c55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:37:24 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-fc5e1c7c-1dbc-4bce-a358-a8bdfdb9f312 req-1a6ae133-706d-4d44-ac11-e2a29d1e35df service nova] Lock "f1040399-0c5d-4a68-9ee0-4fbe45a42c55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:37:24 user nova-compute[74337]: DEBUG nova.compute.manager [req-fc5e1c7c-1dbc-4bce-a358-a8bdfdb9f312 req-1a6ae133-706d-4d44-ac11-e2a29d1e35df service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] No waiting events found dispatching network-vif-unplugged-dd8e8982-b86c-469a-aa55-72bb2ac9bb8b {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:37:24 user nova-compute[74337]: DEBUG nova.compute.manager [req-fc5e1c7c-1dbc-4bce-a358-a8bdfdb9f312 req-1a6ae133-706d-4d44-ac11-e2a29d1e35df service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Received event network-vif-unplugged-dd8e8982-b86c-469a-aa55-72bb2ac9bb8b for instance with task_state deleting. {{(pid=74337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 21:37:24 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:24 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:24 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:24 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:24 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:25 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:25 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:25 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:25 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:25 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:25 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:25 user nova-compute[74337]: DEBUG nova.compute.manager [req-256545bd-88ce-4c69-8e34-4d1d75511ca1 req-35604862-f615-40b2-a293-873e83e555f1 service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Received event network-vif-unplugged-248131be-39a9-430f-b27a-377d176d7846 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:37:25 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-256545bd-88ce-4c69-8e34-4d1d75511ca1 req-35604862-f615-40b2-a293-873e83e555f1 service nova] Acquiring lock "f1040399-0c5d-4a68-9ee0-4fbe45a42c55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:37:25 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-256545bd-88ce-4c69-8e34-4d1d75511ca1 req-35604862-f615-40b2-a293-873e83e555f1 service nova] Lock "f1040399-0c5d-4a68-9ee0-4fbe45a42c55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:37:25 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-256545bd-88ce-4c69-8e34-4d1d75511ca1 req-35604862-f615-40b2-a293-873e83e555f1 service nova] Lock "f1040399-0c5d-4a68-9ee0-4fbe45a42c55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:37:25 user nova-compute[74337]: DEBUG nova.compute.manager [req-256545bd-88ce-4c69-8e34-4d1d75511ca1 req-35604862-f615-40b2-a293-873e83e555f1 service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] No waiting events found dispatching network-vif-unplugged-248131be-39a9-430f-b27a-377d176d7846 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:37:25 user nova-compute[74337]: DEBUG nova.compute.manager [req-256545bd-88ce-4c69-8e34-4d1d75511ca1 req-35604862-f615-40b2-a293-873e83e555f1 service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Received event network-vif-unplugged-248131be-39a9-430f-b27a-377d176d7846 for instance with task_state deleting. {{(pid=74337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 21:37:25 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:25 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:26 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Instance destroyed successfully.
Oct 23 21:37:26 user nova-compute[74337]: DEBUG nova.objects.instance [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Lazy-loading 'resources' on Instance uuid f1040399-0c5d-4a68-9ee0-4fbe45a42c55 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T21:34:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1740777668',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1740777668',id=10,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL7gT0CgQVW+aggFc4MRTgwBLmYOdd7tdPrWKjG6l34UUQ4Chjs4aItkTVuYTlpnxWAi7sqwX1TxWwb7ynGRyVajhl0Oo0L2nrXhX5gh38tVYqC6LOCSwyWZPEvQEa8MnA==',key_name='tempest-keypair-1464629661',keypairs=<?>,launch_index=0,launched_at=2023-10-23T21:35:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b1b3449d434445e7973d49183234beee',ramdisk_id='',reservation_id='r-y0xh0m83',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-491179426',owner_user_name='tempest-TaggedBootDevicesTest-491179426-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T21:35:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='06b6ce06ab564b719c3b09ee9bece960',uuid=f1040399-0c5d-4a68-9ee0-4fbe45a42c55,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "58eb51e5-3d74-4162-93b8-66bdf176c1d5", "address": "fa:16:3e:53:ba:1b", "network": {"id": "54ea29fa-daa7-4818-8d2d-c90ee9a18a95", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1215215856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58eb51e5-3d", "ovs_interfaceid": "58eb51e5-3d74-4162-93b8-66bdf176c1d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Converting VIF {"id": "58eb51e5-3d74-4162-93b8-66bdf176c1d5", "address": "fa:16:3e:53:ba:1b", "network": {"id": "54ea29fa-daa7-4818-8d2d-c90ee9a18a95", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1215215856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58eb51e5-3d", "ovs_interfaceid": "58eb51e5-3d74-4162-93b8-66bdf176c1d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:53:ba:1b,bridge_name='br-int',has_traffic_filtering=True,id=58eb51e5-3d74-4162-93b8-66bdf176c1d5,network=Network(54ea29fa-daa7-4818-8d2d-c90ee9a18a95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58eb51e5-3d') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG os_vif [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:ba:1b,bridge_name='br-int',has_traffic_filtering=True,id=58eb51e5-3d74-4162-93b8-66bdf176c1d5,network=Network(54ea29fa-daa7-4818-8d2d-c90ee9a18a95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58eb51e5-3d') {{(pid=74337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap58eb51e5-3d, bridge=br-int, if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b8700a68-e53b-424e-903d-1721c40d1c13) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:26 user nova-compute[74337]: INFO os_vif [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:ba:1b,bridge_name='br-int',has_traffic_filtering=True,id=58eb51e5-3d74-4162-93b8-66bdf176c1d5,network=Network(54ea29fa-daa7-4818-8d2d-c90ee9a18a95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58eb51e5-3d')
Oct 23 21:37:26 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T21:34:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1740777668',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1740777668',id=10,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL7gT0CgQVW+aggFc4MRTgwBLmYOdd7tdPrWKjG6l34UUQ4Chjs4aItkTVuYTlpnxWAi7sqwX1TxWwb7ynGRyVajhl0Oo0L2nrXhX5gh38tVYqC6LOCSwyWZPEvQEa8MnA==',key_name='tempest-keypair-1464629661',keypairs=<?>,launch_index=0,launched_at=2023-10-23T21:35:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b1b3449d434445e7973d49183234beee',ramdisk_id='',reservation_id='r-y0xh0m83',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-491179426',owner_user_name='tempest-TaggedBootDevicesTest-491179426-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T21:35:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='06b6ce06ab564b719c3b09ee9bece960',uuid=f1040399-0c5d-4a68-9ee0-4fbe45a42c55,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dd8e8982-b86c-469a-aa55-72bb2ac9bb8b", "address": "fa:16:3e:67:90:76", "network": {"id": "8b22a426-2945-474d-b0e6-8c22bb5e57e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-57423842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd8e8982-b8", "ovs_interfaceid": "dd8e8982-b86c-469a-aa55-72bb2ac9bb8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Converting VIF {"id": "dd8e8982-b86c-469a-aa55-72bb2ac9bb8b", "address": "fa:16:3e:67:90:76", "network": {"id": "8b22a426-2945-474d-b0e6-8c22bb5e57e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-57423842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd8e8982-b8", "ovs_interfaceid": "dd8e8982-b86c-469a-aa55-72bb2ac9bb8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:90:76,bridge_name='br-int',has_traffic_filtering=True,id=dd8e8982-b86c-469a-aa55-72bb2ac9bb8b,network=Network(8b22a426-2945-474d-b0e6-8c22bb5e57e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdd8e8982-b8') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG os_vif [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:90:76,bridge_name='br-int',has_traffic_filtering=True,id=dd8e8982-b86c-469a-aa55-72bb2ac9bb8b,network=Network(8b22a426-2945-474d-b0e6-8c22bb5e57e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdd8e8982-b8') {{(pid=74337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdd8e8982-b8, bridge=br-int, if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=614523c6-2f25-4709-b90a-b7e7f7d14d0a) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:26 user nova-compute[74337]: INFO os_vif [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:90:76,bridge_name='br-int',has_traffic_filtering=True,id=dd8e8982-b86c-469a-aa55-72bb2ac9bb8b,network=Network(8b22a426-2945-474d-b0e6-8c22bb5e57e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdd8e8982-b8')
Oct 23 21:37:26 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T21:34:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1740777668',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1740777668',id=10,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL7gT0CgQVW+aggFc4MRTgwBLmYOdd7tdPrWKjG6l34UUQ4Chjs4aItkTVuYTlpnxWAi7sqwX1TxWwb7ynGRyVajhl0Oo0L2nrXhX5gh38tVYqC6LOCSwyWZPEvQEa8MnA==',key_name='tempest-keypair-1464629661',keypairs=<?>,launch_index=0,launched_at=2023-10-23T21:35:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b1b3449d434445e7973d49183234beee',ramdisk_id='',reservation_id='r-y0xh0m83',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-491179426',owner_user_name='tempest-TaggedBootDevicesTest-491179426-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T21:35:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='06b6ce06ab564b719c3b09ee9bece960',uuid=f1040399-0c5d-4a68-9ee0-4fbe45a42c55,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e91aa55a-4a71-4090-bdde-88c4a648b60b", "address": "fa:16:3e:45:60:43", "network": {"id": "8b22a426-2945-474d-b0e6-8c22bb5e57e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-57423842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape91aa55a-4a", "ovs_interfaceid": "e91aa55a-4a71-4090-bdde-88c4a648b60b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Converting VIF {"id": "e91aa55a-4a71-4090-bdde-88c4a648b60b", "address": "fa:16:3e:45:60:43", "network": {"id": "8b22a426-2945-474d-b0e6-8c22bb5e57e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-57423842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape91aa55a-4a", "ovs_interfaceid": "e91aa55a-4a71-4090-bdde-88c4a648b60b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:60:43,bridge_name='br-int',has_traffic_filtering=True,id=e91aa55a-4a71-4090-bdde-88c4a648b60b,network=Network(8b22a426-2945-474d-b0e6-8c22bb5e57e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape91aa55a-4a') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG os_vif [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:60:43,bridge_name='br-int',has_traffic_filtering=True,id=e91aa55a-4a71-4090-bdde-88c4a648b60b,network=Network(8b22a426-2945-474d-b0e6-8c22bb5e57e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape91aa55a-4a') {{(pid=74337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape91aa55a-4a, bridge=br-int, if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=572a318d-289a-4a70-a5b5-5a8d3f4645e6) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:26 user nova-compute[74337]: INFO os_vif [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:60:43,bridge_name='br-int',has_traffic_filtering=True,id=e91aa55a-4a71-4090-bdde-88c4a648b60b,network=Network(8b22a426-2945-474d-b0e6-8c22bb5e57e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape91aa55a-4a')
Oct 23 21:37:26 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T21:34:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1740777668',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1740777668',id=10,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL7gT0CgQVW+aggFc4MRTgwBLmYOdd7tdPrWKjG6l34UUQ4Chjs4aItkTVuYTlpnxWAi7sqwX1TxWwb7ynGRyVajhl0Oo0L2nrXhX5gh38tVYqC6LOCSwyWZPEvQEa8MnA==',key_name='tempest-keypair-1464629661',keypairs=<?>,launch_index=0,launched_at=2023-10-23T21:35:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b1b3449d434445e7973d49183234beee',ramdisk_id='',reservation_id='r-y0xh0m83',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-491179426',owner_user_name='tempest-TaggedBootDevicesTest-491179426-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T21:35:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='06b6ce06ab564b719c3b09ee9bece960',uuid=f1040399-0c5d-4a68-9ee0-4fbe45a42c55,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ddee6c78-417b-494f-a9e1-f662c549f425", "address": "fa:16:3e:fb:ef:75", "network": {"id": "8b22a426-2945-474d-b0e6-8c22bb5e57e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-57423842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddee6c78-41", "ovs_interfaceid": "ddee6c78-417b-494f-a9e1-f662c549f425", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Converting VIF {"id": "ddee6c78-417b-494f-a9e1-f662c549f425", "address": "fa:16:3e:fb:ef:75", "network": {"id": "8b22a426-2945-474d-b0e6-8c22bb5e57e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-57423842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddee6c78-41", "ovs_interfaceid": "ddee6c78-417b-494f-a9e1-f662c549f425", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:ef:75,bridge_name='br-int',has_traffic_filtering=True,id=ddee6c78-417b-494f-a9e1-f662c549f425,network=Network(8b22a426-2945-474d-b0e6-8c22bb5e57e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddee6c78-41') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG os_vif [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:ef:75,bridge_name='br-int',has_traffic_filtering=True,id=ddee6c78-417b-494f-a9e1-f662c549f425,network=Network(8b22a426-2945-474d-b0e6-8c22bb5e57e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddee6c78-41') {{(pid=74337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapddee6c78-41, bridge=br-int, if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=75befdbe-df55-4183-bed2-cce2126a7006) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:26 user nova-compute[74337]: INFO os_vif [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:ef:75,bridge_name='br-int',has_traffic_filtering=True,id=ddee6c78-417b-494f-a9e1-f662c549f425,network=Network(8b22a426-2945-474d-b0e6-8c22bb5e57e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddee6c78-41')
Oct 23 21:37:26 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T21:34:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1740777668',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1740777668',id=10,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL7gT0CgQVW+aggFc4MRTgwBLmYOdd7tdPrWKjG6l34UUQ4Chjs4aItkTVuYTlpnxWAi7sqwX1TxWwb7ynGRyVajhl0Oo0L2nrXhX5gh38tVYqC6LOCSwyWZPEvQEa8MnA==',key_name='tempest-keypair-1464629661',keypairs=<?>,launch_index=0,launched_at=2023-10-23T21:35:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b1b3449d434445e7973d49183234beee',ramdisk_id='',reservation_id='r-y0xh0m83',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-491179426',owner_user_name='tempest-TaggedBootDevicesTest-491179426-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T21:35:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='06b6ce06ab564b719c3b09ee9bece960',uuid=f1040399-0c5d-4a68-9ee0-4fbe45a42c55,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b1664585-4013-46f9-9738-33fd7b9a3161", "address": "fa:16:3e:e8:30:72", "network": {"id": "8b22a426-2945-474d-b0e6-8c22bb5e57e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-57423842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1664585-40", "ovs_interfaceid": "b1664585-4013-46f9-9738-33fd7b9a3161", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Converting VIF {"id": "b1664585-4013-46f9-9738-33fd7b9a3161", "address": "fa:16:3e:e8:30:72", "network": {"id": "8b22a426-2945-474d-b0e6-8c22bb5e57e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-57423842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1664585-40", "ovs_interfaceid": "b1664585-4013-46f9-9738-33fd7b9a3161", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:30:72,bridge_name='br-int',has_traffic_filtering=True,id=b1664585-4013-46f9-9738-33fd7b9a3161,network=Network(8b22a426-2945-474d-b0e6-8c22bb5e57e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1664585-40') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG os_vif [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:30:72,bridge_name='br-int',has_traffic_filtering=True,id=b1664585-4013-46f9-9738-33fd7b9a3161,network=Network(8b22a426-2945-474d-b0e6-8c22bb5e57e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1664585-40') {{(pid=74337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb1664585-40, bridge=br-int, if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d8375770-107a-4532-937f-f003a4914ebd) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:26 user nova-compute[74337]: INFO os_vif [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:30:72,bridge_name='br-int',has_traffic_filtering=True,id=b1664585-4013-46f9-9738-33fd7b9a3161,network=Network(8b22a426-2945-474d-b0e6-8c22bb5e57e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1664585-40')
Oct 23 21:37:26 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T21:34:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1740777668',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1740777668',id=10,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL7gT0CgQVW+aggFc4MRTgwBLmYOdd7tdPrWKjG6l34UUQ4Chjs4aItkTVuYTlpnxWAi7sqwX1TxWwb7ynGRyVajhl0Oo0L2nrXhX5gh38tVYqC6LOCSwyWZPEvQEa8MnA==',key_name='tempest-keypair-1464629661',keypairs=<?>,launch_index=0,launched_at=2023-10-23T21:35:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b1b3449d434445e7973d49183234beee',ramdisk_id='',reservation_id='r-y0xh0m83',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-491179426',owner_user_name='tempest-TaggedBootDevicesTest-491179426-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T21:35:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='06b6ce06ab564b719c3b09ee9bece960',uuid=f1040399-0c5d-4a68-9ee0-4fbe45a42c55,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ba01b035-453b-4378-92fc-1d81b84363ff", "address": "fa:16:3e:89:cb:12", "network": {"id": "cd8ce1ca-56b3-48fa-bb57-54d0616aa7ca", "bridge": "br-int", "label": "tempest-device-tagging-net2-611360182", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba01b035-45", "ovs_interfaceid": "ba01b035-453b-4378-92fc-1d81b84363ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Converting VIF {"id": "ba01b035-453b-4378-92fc-1d81b84363ff", "address": "fa:16:3e:89:cb:12", "network": {"id": "cd8ce1ca-56b3-48fa-bb57-54d0616aa7ca", "bridge": "br-int", "label": "tempest-device-tagging-net2-611360182", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba01b035-45", "ovs_interfaceid": "ba01b035-453b-4378-92fc-1d81b84363ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:cb:12,bridge_name='br-int',has_traffic_filtering=True,id=ba01b035-453b-4378-92fc-1d81b84363ff,network=Network(cd8ce1ca-56b3-48fa-bb57-54d0616aa7ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba01b035-45') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG os_vif [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:cb:12,bridge_name='br-int',has_traffic_filtering=True,id=ba01b035-453b-4378-92fc-1d81b84363ff,network=Network(cd8ce1ca-56b3-48fa-bb57-54d0616aa7ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba01b035-45') {{(pid=74337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapba01b035-45, bridge=br-int, if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=eb9986a2-f248-4295-89fd-b99e18beaac0) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:26 user nova-compute[74337]: INFO os_vif [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:cb:12,bridge_name='br-int',has_traffic_filtering=True,id=ba01b035-453b-4378-92fc-1d81b84363ff,network=Network(cd8ce1ca-56b3-48fa-bb57-54d0616aa7ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba01b035-45')
Oct 23 21:37:26 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T21:34:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1740777668',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1740777668',id=10,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL7gT0CgQVW+aggFc4MRTgwBLmYOdd7tdPrWKjG6l34UUQ4Chjs4aItkTVuYTlpnxWAi7sqwX1TxWwb7ynGRyVajhl0Oo0L2nrXhX5gh38tVYqC6LOCSwyWZPEvQEa8MnA==',key_name='tempest-keypair-1464629661',keypairs=<?>,launch_index=0,launched_at=2023-10-23T21:35:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b1b3449d434445e7973d49183234beee',ramdisk_id='',reservation_id='r-y0xh0m83',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-491179426',owner_user_name='tempest-TaggedBootDevicesTest-491179426-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T21:35:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='06b6ce06ab564b719c3b09ee9bece960',uuid=f1040399-0c5d-4a68-9ee0-4fbe45a42c55,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "248131be-39a9-430f-b27a-377d176d7846", "address": "fa:16:3e:5d:ae:b7", "network": {"id": "cd8ce1ca-56b3-48fa-bb57-54d0616aa7ca", "bridge": "br-int", "label": "tempest-device-tagging-net2-611360182", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap248131be-39", "ovs_interfaceid": "248131be-39a9-430f-b27a-377d176d7846", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Converting VIF {"id": "248131be-39a9-430f-b27a-377d176d7846", "address": "fa:16:3e:5d:ae:b7", "network": {"id": "cd8ce1ca-56b3-48fa-bb57-54d0616aa7ca", "bridge": "br-int", "label": "tempest-device-tagging-net2-611360182", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap248131be-39", "ovs_interfaceid": "248131be-39a9-430f-b27a-377d176d7846", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:ae:b7,bridge_name='br-int',has_traffic_filtering=True,id=248131be-39a9-430f-b27a-377d176d7846,network=Network(cd8ce1ca-56b3-48fa-bb57-54d0616aa7ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap248131be-39') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG os_vif [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:ae:b7,bridge_name='br-int',has_traffic_filtering=True,id=248131be-39a9-430f-b27a-377d176d7846,network=Network(cd8ce1ca-56b3-48fa-bb57-54d0616aa7ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap248131be-39') {{(pid=74337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap248131be-39, bridge=br-int, if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7ca21ab5-09c6-453e-942c-5c20ee06e444) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:37:26 user nova-compute[74337]: INFO os_vif [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:ae:b7,bridge_name='br-int',has_traffic_filtering=True,id=248131be-39a9-430f-b27a-377d176d7846,network=Network(cd8ce1ca-56b3-48fa-bb57-54d0616aa7ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap248131be-39')
Oct 23 21:37:26 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] calling os-brick to detach iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, {'target_iqn': 'iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MbXvPrkW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:37:26 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:37:26 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e30f449d-d817-452d-b218-ab2a19170bce]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 21:37:26 user nova-compute[74337]: No targets found.
Oct 23 21:37:26 user nova-compute[74337]: iSNS:
Oct 23 21:37:26 user nova-compute[74337]: No targets found.
Oct 23 21:37:26 user nova-compute[74337]: STATIC:
Oct 23 21:37:26 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a
Oct 23 21:37:26 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:37:26 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:37:26 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661
Oct 23 21:37:26 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:37:26 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:37:26 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496
Oct 23 21:37:26 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:37:26 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:37:26 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b
Oct 23 21:37:26 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:37:26 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:37:26 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932
Oct 23 21:37:26 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:37:26 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:37:26 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f
Oct 23 21:37:26 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:37:26 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:37:26 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0
Oct 23 21:37:26 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:37:26 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:37:26 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522
Oct 23 21:37:26 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:37:26 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:37:26 user nova-compute[74337]: FIRMWARE:
Oct 23 21:37:26 user nova-compute[74337]: No targets found.
Oct 23 21:37:26 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 21:37:26 user nova-compute[74337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 21:37:26 user nova-compute[74337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0', 0)] {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f68ce66-ed46-4263-bb0e-2ebd2597bc3c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG nova.compute.manager [req-66e5e901-4aee-4e73-96fa-01d14cd4fd8c req-07889973-0355-49cb-9f2d-9cf8376642a8 service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Received event network-vif-plugged-58eb51e5-3d74-4162-93b8-66bdf176c1d5 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-66e5e901-4aee-4e73-96fa-01d14cd4fd8c req-07889973-0355-49cb-9f2d-9cf8376642a8 service nova] Acquiring lock "f1040399-0c5d-4a68-9ee0-4fbe45a42c55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-66e5e901-4aee-4e73-96fa-01d14cd4fd8c req-07889973-0355-49cb-9f2d-9cf8376642a8 service nova] Lock "f1040399-0c5d-4a68-9ee0-4fbe45a42c55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-66e5e901-4aee-4e73-96fa-01d14cd4fd8c req-07889973-0355-49cb-9f2d-9cf8376642a8 service nova] Lock "f1040399-0c5d-4a68-9ee0-4fbe45a42c55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG nova.compute.manager [req-66e5e901-4aee-4e73-96fa-01d14cd4fd8c req-07889973-0355-49cb-9f2d-9cf8376642a8 service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] No waiting events found dispatching network-vif-plugged-58eb51e5-3d74-4162-93b8-66bdf176c1d5 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:37:26 user nova-compute[74337]: WARNING nova.compute.manager [req-66e5e901-4aee-4e73-96fa-01d14cd4fd8c req-07889973-0355-49cb-9f2d-9cf8376642a8 service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Received unexpected event network-vif-plugged-58eb51e5-3d74-4162-93b8-66bdf176c1d5 for instance with vm_state active and task_state deleting.
Oct 23 21:37:26 user nova-compute[74337]: DEBUG nova.compute.manager [req-66e5e901-4aee-4e73-96fa-01d14cd4fd8c req-07889973-0355-49cb-9f2d-9cf8376642a8 service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Received event network-vif-unplugged-e91aa55a-4a71-4090-bdde-88c4a648b60b {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-66e5e901-4aee-4e73-96fa-01d14cd4fd8c req-07889973-0355-49cb-9f2d-9cf8376642a8 service nova] Acquiring lock "f1040399-0c5d-4a68-9ee0-4fbe45a42c55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-66e5e901-4aee-4e73-96fa-01d14cd4fd8c req-07889973-0355-49cb-9f2d-9cf8376642a8 service nova] Lock "f1040399-0c5d-4a68-9ee0-4fbe45a42c55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-66e5e901-4aee-4e73-96fa-01d14cd4fd8c req-07889973-0355-49cb-9f2d-9cf8376642a8 service nova] Lock "f1040399-0c5d-4a68-9ee0-4fbe45a42c55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG nova.compute.manager [req-66e5e901-4aee-4e73-96fa-01d14cd4fd8c req-07889973-0355-49cb-9f2d-9cf8376642a8 service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] No waiting events found dispatching network-vif-unplugged-e91aa55a-4a71-4090-bdde-88c4a648b60b {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG nova.compute.manager [req-66e5e901-4aee-4e73-96fa-01d14cd4fd8c req-07889973-0355-49cb-9f2d-9cf8376642a8 service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Received event network-vif-unplugged-e91aa55a-4a71-4090-bdde-88c4a648b60b for instance with task_state deleting. {{(pid=74337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG nova.compute.manager [req-66e5e901-4aee-4e73-96fa-01d14cd4fd8c req-07889973-0355-49cb-9f2d-9cf8376642a8 service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Received event network-vif-plugged-e91aa55a-4a71-4090-bdde-88c4a648b60b {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-66e5e901-4aee-4e73-96fa-01d14cd4fd8c req-07889973-0355-49cb-9f2d-9cf8376642a8 service nova] Acquiring lock "f1040399-0c5d-4a68-9ee0-4fbe45a42c55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-66e5e901-4aee-4e73-96fa-01d14cd4fd8c req-07889973-0355-49cb-9f2d-9cf8376642a8 service nova] Lock "f1040399-0c5d-4a68-9ee0-4fbe45a42c55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-66e5e901-4aee-4e73-96fa-01d14cd4fd8c req-07889973-0355-49cb-9f2d-9cf8376642a8 service nova] Lock "f1040399-0c5d-4a68-9ee0-4fbe45a42c55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG nova.compute.manager [req-66e5e901-4aee-4e73-96fa-01d14cd4fd8c req-07889973-0355-49cb-9f2d-9cf8376642a8 service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] No waiting events found dispatching network-vif-plugged-e91aa55a-4a71-4090-bdde-88c4a648b60b {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:37:26 user nova-compute[74337]: WARNING nova.compute.manager [req-66e5e901-4aee-4e73-96fa-01d14cd4fd8c req-07889973-0355-49cb-9f2d-9cf8376642a8 service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Received unexpected event network-vif-plugged-e91aa55a-4a71-4090-bdde-88c4a648b60b for instance with vm_state active and task_state deleting.
Oct 23 21:37:26 user nova-compute[74337]: DEBUG nova.compute.manager [req-66e5e901-4aee-4e73-96fa-01d14cd4fd8c req-07889973-0355-49cb-9f2d-9cf8376642a8 service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Received event network-vif-unplugged-b1664585-4013-46f9-9738-33fd7b9a3161 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-66e5e901-4aee-4e73-96fa-01d14cd4fd8c req-07889973-0355-49cb-9f2d-9cf8376642a8 service nova] Acquiring lock "f1040399-0c5d-4a68-9ee0-4fbe45a42c55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-66e5e901-4aee-4e73-96fa-01d14cd4fd8c req-07889973-0355-49cb-9f2d-9cf8376642a8 service nova] Lock "f1040399-0c5d-4a68-9ee0-4fbe45a42c55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-66e5e901-4aee-4e73-96fa-01d14cd4fd8c req-07889973-0355-49cb-9f2d-9cf8376642a8 service nova] Lock "f1040399-0c5d-4a68-9ee0-4fbe45a42c55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG nova.compute.manager [req-66e5e901-4aee-4e73-96fa-01d14cd4fd8c req-07889973-0355-49cb-9f2d-9cf8376642a8 service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] No waiting events found dispatching network-vif-unplugged-b1664585-4013-46f9-9738-33fd7b9a3161 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG nova.compute.manager [req-66e5e901-4aee-4e73-96fa-01d14cd4fd8c req-07889973-0355-49cb-9f2d-9cf8376642a8 service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Received event network-vif-unplugged-b1664585-4013-46f9-9738-33fd7b9a3161 for instance with task_state deleting. {{(pid=74337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG nova.compute.manager [req-66e5e901-4aee-4e73-96fa-01d14cd4fd8c req-07889973-0355-49cb-9f2d-9cf8376642a8 service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Received event network-vif-plugged-b1664585-4013-46f9-9738-33fd7b9a3161 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-66e5e901-4aee-4e73-96fa-01d14cd4fd8c req-07889973-0355-49cb-9f2d-9cf8376642a8 service nova] Acquiring lock "f1040399-0c5d-4a68-9ee0-4fbe45a42c55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-66e5e901-4aee-4e73-96fa-01d14cd4fd8c req-07889973-0355-49cb-9f2d-9cf8376642a8 service nova] Lock "f1040399-0c5d-4a68-9ee0-4fbe45a42c55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-66e5e901-4aee-4e73-96fa-01d14cd4fd8c req-07889973-0355-49cb-9f2d-9cf8376642a8 service nova] Lock "f1040399-0c5d-4a68-9ee0-4fbe45a42c55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG nova.compute.manager [req-66e5e901-4aee-4e73-96fa-01d14cd4fd8c req-07889973-0355-49cb-9f2d-9cf8376642a8 service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] No waiting events found dispatching network-vif-plugged-b1664585-4013-46f9-9738-33fd7b9a3161 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:37:26 user nova-compute[74337]: WARNING nova.compute.manager [req-66e5e901-4aee-4e73-96fa-01d14cd4fd8c req-07889973-0355-49cb-9f2d-9cf8376642a8 service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Received unexpected event network-vif-plugged-b1664585-4013-46f9-9738-33fd7b9a3161 for instance with vm_state active and task_state deleting.
Oct 23 21:37:26 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6784a715-c110-40f8-ac1b-38f5ac7cfff6]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496 (non-flash)
Oct 23 21:37:26 user nova-compute[74337]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f (non-flash)
Oct 23 21:37:26 user nova-compute[74337]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 (non-flash)
Oct 23 21:37:26 user nova-compute[74337]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)
Oct 23 21:37:26 user nova-compute[74337]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b (non-flash)
Oct 23 21:37:26 user nova-compute[74337]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 (non-flash)
Oct 23 21:37:26 user nova-compute[74337]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a (non-flash)
Oct 23 21:37:26 user nova-compute[74337]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661 (non-flash)
Oct 23 21:37:26 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496 (non-flash)
Oct 23 21:37:26 user nova-compute[74337]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f (non-flash)
Oct 23 21:37:26 user nova-compute[74337]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 (non-flash)
Oct 23 21:37:26 user nova-compute[74337]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)
Oct 23 21:37:26 user nova-compute[74337]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b (non-flash)
Oct 23 21:37:26 user nova-compute[74337]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 (non-flash)
Oct 23 21:37:26 user nova-compute[74337]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a (non-flash)
Oct 23 21:37:26 user nova-compute[74337]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661 (non-flash)
Oct 23 21:37:26 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5eec385870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0'): ({'sdd'}, set())}) {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Removing single pathed devices sdd {{(pid=74337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG nova.compute.manager [req-a1f55345-145a-4441-b2ae-0caf1df65853 req-8e8b39d7-5e1a-4e69-b4d5-1e033dd9cede service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Received event network-vif-plugged-dd8e8982-b86c-469a-aa55-72bb2ac9bb8b {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-a1f55345-145a-4441-b2ae-0caf1df65853 req-8e8b39d7-5e1a-4e69-b4d5-1e033dd9cede service nova] Acquiring lock "f1040399-0c5d-4a68-9ee0-4fbe45a42c55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-a1f55345-145a-4441-b2ae-0caf1df65853 req-8e8b39d7-5e1a-4e69-b4d5-1e033dd9cede service nova] Lock "f1040399-0c5d-4a68-9ee0-4fbe45a42c55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-a1f55345-145a-4441-b2ae-0caf1df65853 req-8e8b39d7-5e1a-4e69-b4d5-1e033dd9cede service nova] Lock "f1040399-0c5d-4a68-9ee0-4fbe45a42c55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG nova.compute.manager [req-a1f55345-145a-4441-b2ae-0caf1df65853 req-8e8b39d7-5e1a-4e69-b4d5-1e033dd9cede service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] No waiting events found dispatching network-vif-plugged-dd8e8982-b86c-469a-aa55-72bb2ac9bb8b {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:37:26 user nova-compute[74337]: WARNING nova.compute.manager [req-a1f55345-145a-4441-b2ae-0caf1df65853 req-8e8b39d7-5e1a-4e69-b4d5-1e033dd9cede service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Received unexpected event network-vif-plugged-dd8e8982-b86c-469a-aa55-72bb2ac9bb8b for instance with vm_state active and task_state deleting.
Oct 23 21:37:26 user nova-compute[74337]: DEBUG nova.compute.manager [req-a1f55345-145a-4441-b2ae-0caf1df65853 req-8e8b39d7-5e1a-4e69-b4d5-1e033dd9cede service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Received event network-vif-unplugged-ddee6c78-417b-494f-a9e1-f662c549f425 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-a1f55345-145a-4441-b2ae-0caf1df65853 req-8e8b39d7-5e1a-4e69-b4d5-1e033dd9cede service nova] Acquiring lock "f1040399-0c5d-4a68-9ee0-4fbe45a42c55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-a1f55345-145a-4441-b2ae-0caf1df65853 req-8e8b39d7-5e1a-4e69-b4d5-1e033dd9cede service nova] Lock "f1040399-0c5d-4a68-9ee0-4fbe45a42c55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-a1f55345-145a-4441-b2ae-0caf1df65853 req-8e8b39d7-5e1a-4e69-b4d5-1e033dd9cede service nova] Lock "f1040399-0c5d-4a68-9ee0-4fbe45a42c55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG nova.compute.manager [req-a1f55345-145a-4441-b2ae-0caf1df65853 req-8e8b39d7-5e1a-4e69-b4d5-1e033dd9cede service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] No waiting events found dispatching network-vif-unplugged-ddee6c78-417b-494f-a9e1-f662c549f425 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG nova.compute.manager [req-a1f55345-145a-4441-b2ae-0caf1df65853 req-8e8b39d7-5e1a-4e69-b4d5-1e033dd9cede service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Received event network-vif-unplugged-ddee6c78-417b-494f-a9e1-f662c549f425 for instance with task_state deleting. {{(pid=74337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG nova.compute.manager [req-a1f55345-145a-4441-b2ae-0caf1df65853 req-8e8b39d7-5e1a-4e69-b4d5-1e033dd9cede service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Received event network-vif-plugged-ddee6c78-417b-494f-a9e1-f662c549f425 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-a1f55345-145a-4441-b2ae-0caf1df65853 req-8e8b39d7-5e1a-4e69-b4d5-1e033dd9cede service nova] Acquiring lock "f1040399-0c5d-4a68-9ee0-4fbe45a42c55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-a1f55345-145a-4441-b2ae-0caf1df65853 req-8e8b39d7-5e1a-4e69-b4d5-1e033dd9cede service nova] Lock "f1040399-0c5d-4a68-9ee0-4fbe45a42c55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-a1f55345-145a-4441-b2ae-0caf1df65853 req-8e8b39d7-5e1a-4e69-b4d5-1e033dd9cede service nova] Lock "f1040399-0c5d-4a68-9ee0-4fbe45a42c55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG nova.compute.manager [req-a1f55345-145a-4441-b2ae-0caf1df65853 req-8e8b39d7-5e1a-4e69-b4d5-1e033dd9cede service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] No waiting events found dispatching network-vif-plugged-ddee6c78-417b-494f-a9e1-f662c549f425 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:37:26 user nova-compute[74337]: WARNING nova.compute.manager [req-a1f55345-145a-4441-b2ae-0caf1df65853 req-8e8b39d7-5e1a-4e69-b4d5-1e033dd9cede service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Received unexpected event network-vif-plugged-ddee6c78-417b-494f-a9e1-f662c549f425 for instance with vm_state active and task_state deleting.
Oct 23 21:37:26 user nova-compute[74337]: DEBUG nova.compute.manager [req-a1f55345-145a-4441-b2ae-0caf1df65853 req-8e8b39d7-5e1a-4e69-b4d5-1e033dd9cede service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Received event network-vif-unplugged-ba01b035-453b-4378-92fc-1d81b84363ff {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-a1f55345-145a-4441-b2ae-0caf1df65853 req-8e8b39d7-5e1a-4e69-b4d5-1e033dd9cede service nova] Acquiring lock "f1040399-0c5d-4a68-9ee0-4fbe45a42c55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-a1f55345-145a-4441-b2ae-0caf1df65853 req-8e8b39d7-5e1a-4e69-b4d5-1e033dd9cede service nova] Lock "f1040399-0c5d-4a68-9ee0-4fbe45a42c55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-a1f55345-145a-4441-b2ae-0caf1df65853 req-8e8b39d7-5e1a-4e69-b4d5-1e033dd9cede service nova] Lock "f1040399-0c5d-4a68-9ee0-4fbe45a42c55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG nova.compute.manager [req-a1f55345-145a-4441-b2ae-0caf1df65853 req-8e8b39d7-5e1a-4e69-b4d5-1e033dd9cede service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] No waiting events found dispatching network-vif-unplugged-ba01b035-453b-4378-92fc-1d81b84363ff {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG nova.compute.manager [req-a1f55345-145a-4441-b2ae-0caf1df65853 req-8e8b39d7-5e1a-4e69-b4d5-1e033dd9cede service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Received event network-vif-unplugged-ba01b035-453b-4378-92fc-1d81b84363ff for instance with task_state deleting. {{(pid=74337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG nova.compute.manager [req-a1f55345-145a-4441-b2ae-0caf1df65853 req-8e8b39d7-5e1a-4e69-b4d5-1e033dd9cede service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Received event network-vif-plugged-ba01b035-453b-4378-92fc-1d81b84363ff {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-a1f55345-145a-4441-b2ae-0caf1df65853 req-8e8b39d7-5e1a-4e69-b4d5-1e033dd9cede service nova] Acquiring lock "f1040399-0c5d-4a68-9ee0-4fbe45a42c55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-a1f55345-145a-4441-b2ae-0caf1df65853 req-8e8b39d7-5e1a-4e69-b4d5-1e033dd9cede service nova] Lock "f1040399-0c5d-4a68-9ee0-4fbe45a42c55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-a1f55345-145a-4441-b2ae-0caf1df65853 req-8e8b39d7-5e1a-4e69-b4d5-1e033dd9cede service nova] Lock "f1040399-0c5d-4a68-9ee0-4fbe45a42c55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG nova.compute.manager [req-a1f55345-145a-4441-b2ae-0caf1df65853 req-8e8b39d7-5e1a-4e69-b4d5-1e033dd9cede service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] No waiting events found dispatching network-vif-plugged-ba01b035-453b-4378-92fc-1d81b84363ff {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:37:26 user nova-compute[74337]: WARNING nova.compute.manager [req-a1f55345-145a-4441-b2ae-0caf1df65853 req-8e8b39d7-5e1a-4e69-b4d5-1e033dd9cede service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Received unexpected event network-vif-plugged-ba01b035-453b-4378-92fc-1d81b84363ff for instance with vm_state active and task_state deleting.
Oct 23 21:37:26 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f6d2d00-bbfc-4ba3-809f-6f091c59533b]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c13ba46-2e63-483d-9489-d08d45fc4cf1]: (4, ('ok\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Flushing IO for device /dev/sdd {{(pid=74337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6501c31-d3cd-486b-ad2a-a3b90abf97c6]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef102159-31b8-47ae-83dc-592ec530b86e]: (4, ('1', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] SCSI volumes sdd have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0')] {{(pid=74337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG nova.compute.manager [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Stashing vm_state: active {{(pid=74337) _prep_resize /opt/stack/nova/nova/compute/manager.py:5614}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[4620275d-ffd3-4330-8756-4024f20f06f3]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:37:26 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 -p 172.16.0.220:3260 --logout {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.086s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[47edc880-326e-427c-894d-7117b201655a]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0, portal: 172.16.0.220,3260]
Oct 23 21:37:27 user nova-compute[74337]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0, portal: 172.16.0.220,3260] successful.
Oct 23 21:37:27 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 -p 172.16.0.220:3260 --op delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b15e515-43f3-4748-a86a-bb348b5b38c0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[153f8a3e-b4ff-47ad-a07e-cf02d3b48858]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.387s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] <== disconnect_volume: return (390ms) None {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Disconnected iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 21:37:27 user nova-compute[74337]: INFO nova.compute.claims [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Claim successful on node user
Oct 23 21:37:27 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] calling os-brick to detach iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, {'target_iqn': 'iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jfJFOLaK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:37:27 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:37:27 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[df5ca5e8-d575-4b49-a38f-96e4e8ebe078]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 21:37:27 user nova-compute[74337]: No targets found.
Oct 23 21:37:27 user nova-compute[74337]: iSNS:
Oct 23 21:37:27 user nova-compute[74337]: No targets found.
Oct 23 21:37:27 user nova-compute[74337]: STATIC:
Oct 23 21:37:27 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a
Oct 23 21:37:27 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:37:27 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:37:27 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661
Oct 23 21:37:27 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:37:27 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:37:27 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496
Oct 23 21:37:27 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:37:27 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:37:27 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b
Oct 23 21:37:27 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:37:27 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:37:27 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932
Oct 23 21:37:27 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:37:27 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:37:27 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f
Oct 23 21:37:27 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:37:27 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:37:27 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522
Oct 23 21:37:27 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:37:27 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:37:27 user nova-compute[74337]: FIRMWARE:
Oct 23 21:37:27 user nova-compute[74337]: No targets found.
Oct 23 21:37:27 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 21:37:27 user nova-compute[74337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 21:37:27 user nova-compute[74337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932', 0)] {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 21:37:27 user nova-compute[74337]: INFO nova.compute.resource_tracker [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Updating resource usage from migration 07b7bb7a-337b-4151-b2c9-4386a51c5bbf
Oct 23 21:37:27 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcc41790-974d-49be-8684-917c9b9c973b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c44f8f-9e94-4e00-a075-f357832c53b2]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496 (non-flash)
Oct 23 21:37:27 user nova-compute[74337]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f (non-flash)
Oct 23 21:37:27 user nova-compute[74337]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 (non-flash)
Oct 23 21:37:27 user nova-compute[74337]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)
Oct 23 21:37:27 user nova-compute[74337]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b (non-flash)
Oct 23 21:37:27 user nova-compute[74337]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a (non-flash)
Oct 23 21:37:27 user nova-compute[74337]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661 (non-flash)
Oct 23 21:37:27 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496 (non-flash)
Oct 23 21:37:27 user nova-compute[74337]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f (non-flash)
Oct 23 21:37:27 user nova-compute[74337]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 (non-flash)
Oct 23 21:37:27 user nova-compute[74337]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 (non-flash)
Oct 23 21:37:27 user nova-compute[74337]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b (non-flash)
Oct 23 21:37:27 user nova-compute[74337]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a (non-flash)
Oct 23 21:37:27 user nova-compute[74337]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661 (non-flash)
Oct 23 21:37:27 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5eec752f80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932'): ({'sdb'}, set())}) {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Removing single pathed devices sdb {{(pid=74337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e92894-458d-4adf-aeef-69ae378caa5d]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6628fa2a-4ec6-4a5f-b9e2-b4e629aee9e2]: (4, ('ok\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Flushing IO for device /dev/sdb {{(pid=74337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b7314e-fda7-4539-bcbe-50170ed64c9c]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f31de5-635a-41b4-99b1-72d2b03c3c30]: (4, ('1', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] SCSI volumes sdb have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932')] {{(pid=74337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dd10234-d937-4b64-aca8-26a280c1850f]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 -p 172.16.0.220:3260 --logout {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG nova.compute.manager [req-f8f561fe-35ea-48b9-88b9-dc708ab430cf req-ba1701ed-ee0a-42b1-8628-ddb8a2e9d1fa service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Received event network-vif-plugged-248131be-39a9-430f-b27a-377d176d7846 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-f8f561fe-35ea-48b9-88b9-dc708ab430cf req-ba1701ed-ee0a-42b1-8628-ddb8a2e9d1fa service nova] Acquiring lock "f1040399-0c5d-4a68-9ee0-4fbe45a42c55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-f8f561fe-35ea-48b9-88b9-dc708ab430cf req-ba1701ed-ee0a-42b1-8628-ddb8a2e9d1fa service nova] Lock "f1040399-0c5d-4a68-9ee0-4fbe45a42c55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-f8f561fe-35ea-48b9-88b9-dc708ab430cf req-ba1701ed-ee0a-42b1-8628-ddb8a2e9d1fa service nova] Lock "f1040399-0c5d-4a68-9ee0-4fbe45a42c55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG nova.compute.manager [req-f8f561fe-35ea-48b9-88b9-dc708ab430cf req-ba1701ed-ee0a-42b1-8628-ddb8a2e9d1fa service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] No waiting events found dispatching network-vif-plugged-248131be-39a9-430f-b27a-377d176d7846 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:37:27 user nova-compute[74337]: WARNING nova.compute.manager [req-f8f561fe-35ea-48b9-88b9-dc708ab430cf req-ba1701ed-ee0a-42b1-8628-ddb8a2e9d1fa service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Received unexpected event network-vif-plugged-248131be-39a9-430f-b27a-377d176d7846 for instance with vm_state active and task_state deleting.
Oct 23 21:37:27 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b602990a-e784-4166-bcff-65053c1bb49d]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932, portal: 172.16.0.220,3260]
Oct 23 21:37:27 user nova-compute[74337]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932, portal: 172.16.0.220,3260] successful.
Oct 23 21:37:27 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 -p 172.16.0.220:3260 --op delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:694e3124-c6ed-4079-82c0-18f56c369932 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[1204103a-ccad-40d3-a1b4-a8fb159671a6]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.375s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] <== disconnect_volume: return (375ms) None {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Disconnected iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] calling os-brick to detach iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, {'target_iqn': 'iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ASuFjTKn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:37:27 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:37:27 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcc8b859-093d-415c-b18c-7d44ed547e61]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 21:37:27 user nova-compute[74337]: No targets found.
Oct 23 21:37:27 user nova-compute[74337]: iSNS:
Oct 23 21:37:27 user nova-compute[74337]: No targets found.
Oct 23 21:37:27 user nova-compute[74337]: STATIC:
Oct 23 21:37:27 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a
Oct 23 21:37:27 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:37:27 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:37:27 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661
Oct 23 21:37:27 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:37:27 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:37:27 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496
Oct 23 21:37:27 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:37:27 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:37:27 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b
Oct 23 21:37:27 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:37:27 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:37:27 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f
Oct 23 21:37:27 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:37:27 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:37:27 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522
Oct 23 21:37:27 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:37:27 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:37:27 user nova-compute[74337]: FIRMWARE:
Oct 23 21:37:27 user nova-compute[74337]: No targets found.
Oct 23 21:37:27 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 21:37:27 user nova-compute[74337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 21:37:27 user nova-compute[74337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b', 0)] {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f3942b0-23b5-498d-8f4c-cbd93f2b4d0a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.521s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:37:27 user nova-compute[74337]: INFO nova.compute.manager [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Migrating
Oct 23 21:37:27 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Acquired lock "compute-rpcapi-router" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc9dcbc-0fd3-4fa0-ab0c-4d399b4a3bbd]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496 (non-flash)
Oct 23 21:37:27 user nova-compute[74337]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f (non-flash)
Oct 23 21:37:27 user nova-compute[74337]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 (non-flash)
Oct 23 21:37:27 user nova-compute[74337]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b (non-flash)
Oct 23 21:37:27 user nova-compute[74337]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a (non-flash)
Oct 23 21:37:27 user nova-compute[74337]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661 (non-flash)
Oct 23 21:37:27 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496 (non-flash)
Oct 23 21:37:27 user nova-compute[74337]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f (non-flash)
Oct 23 21:37:27 user nova-compute[74337]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 (non-flash)
Oct 23 21:37:27 user nova-compute[74337]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b (non-flash)
Oct 23 21:37:27 user nova-compute[74337]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a (non-flash)
Oct 23 21:37:27 user nova-compute[74337]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661 (non-flash)
Oct 23 21:37:27 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5eec3b8ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b'): ({'sdc'}, set())}) {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Removing single pathed devices sdc {{(pid=74337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:27 user nova-compute[74337]: INFO nova.compute.rpcapi [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Oct 23 21:37:27 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Releasing lock "compute-rpcapi-router" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[80cde175-5065-4455-91e3-22df7c5ca486]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Acquiring lock "refresh_cache-d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Acquired lock "refresh_cache-d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG nova.network.neutron [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Building network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[934a081b-49a1-4b37-8f64-adb8d9752e52]: (4, ('ok\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Flushing IO for device /dev/sdc {{(pid=74337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[79822baa-10bd-4195-9516-1e807cb37596]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a47b527-c887-485d-8cc0-db230bfd5488]: (4, ('1', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] SCSI volumes sdc have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b')] {{(pid=74337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b30a605-58a0-4903-a4e9-367beab6baff]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b -p 172.16.0.220:3260 --logout {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6cc40e8-3a0b-4e8a-b379-7009108c095a]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b, portal: 172.16.0.220,3260]
Oct 23 21:37:27 user nova-compute[74337]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b, portal: 172.16.0.220,3260] successful.
Oct 23 21:37:27 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b -p 172.16.0.220:3260 --op delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9f5f7ce-c27e-4cf5-9da5-704ff383354b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e3a7f3e-a0be-4fcf-bd95-b967acb16796]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.358s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] <== disconnect_volume: return (359ms) None {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Disconnected iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 21:37:27 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Deleting instance files /opt/stack/data/nova/instances/f1040399-0c5d-4a68-9ee0-4fbe45a42c55_del
Oct 23 21:37:27 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Deletion of /opt/stack/data/nova/instances/f1040399-0c5d-4a68-9ee0-4fbe45a42c55_del complete
Oct 23 21:37:27 user nova-compute[74337]: INFO nova.compute.manager [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Took 3.66 seconds to destroy the instance on the hypervisor.
Oct 23 21:37:27 user nova-compute[74337]: DEBUG oslo.service.loopingcall [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74337) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG nova.compute.manager [-] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Deallocating network for instance {{(pid=74337) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 21:37:27 user nova-compute[74337]: DEBUG nova.network.neutron [-] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] deallocate_for_instance() {{(pid=74337) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 21:37:28 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:28 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4d28a9c6-259a-4863-ab3d-16b6cacc9010 tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Acquiring lock "8acc1b10-a541-4c06-aeb7-1ecf7a2457be" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:37:28 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4d28a9c6-259a-4863-ab3d-16b6cacc9010 tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Lock "8acc1b10-a541-4c06-aeb7-1ecf7a2457be" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:37:28 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4d28a9c6-259a-4863-ab3d-16b6cacc9010 tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Acquiring lock "8acc1b10-a541-4c06-aeb7-1ecf7a2457be-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:37:28 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4d28a9c6-259a-4863-ab3d-16b6cacc9010 tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Lock "8acc1b10-a541-4c06-aeb7-1ecf7a2457be-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:37:28 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4d28a9c6-259a-4863-ab3d-16b6cacc9010 tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Lock "8acc1b10-a541-4c06-aeb7-1ecf7a2457be-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:37:28 user nova-compute[74337]: INFO nova.compute.manager [None req-4d28a9c6-259a-4863-ab3d-16b6cacc9010 tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] Terminating instance
Oct 23 21:37:28 user nova-compute[74337]: DEBUG nova.compute.manager [None req-4d28a9c6-259a-4863-ab3d-16b6cacc9010 tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] Start destroying the instance on the hypervisor. {{(pid=74337) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 21:37:28 user nova-compute[74337]: DEBUG nova.network.neutron [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Updating instance_info_cache with network_info: [{"id": "872b2a23-8054-4d26-b798-c0099d1c9a91", "address": "fa:16:3e:30:a6:90", "network": {"id": "b6a24032-0229-4ebe-83a3-8804e494838c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1472404179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17117e60d0d9484d80c0bc8de393921c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap872b2a23-80", "ovs_interfaceid": "872b2a23-8054-4d26-b798-c0099d1c9a91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:37:28 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:28 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Releasing lock "refresh_cache-d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:37:28 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:28 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:28 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:28 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:28 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Starting migrate_disk_and_power_off {{(pid=74337) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Oct 23 21:37:28 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:28 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:28 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:28 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:28 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:28 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:28 user nova-compute[74337]: DEBUG nova.compute.manager [req-855b7cff-b1b5-4e7e-9e3e-2b992d2415e8 req-fe2f29fb-e418-4b11-83f8-83cc322fea7f service nova] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] Received event network-vif-unplugged-530b7241-1498-47dc-8a6f-79e6c9cc850a {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:37:28 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-855b7cff-b1b5-4e7e-9e3e-2b992d2415e8 req-fe2f29fb-e418-4b11-83f8-83cc322fea7f service nova] Acquiring lock "8acc1b10-a541-4c06-aeb7-1ecf7a2457be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:37:28 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-855b7cff-b1b5-4e7e-9e3e-2b992d2415e8 req-fe2f29fb-e418-4b11-83f8-83cc322fea7f service nova] Lock "8acc1b10-a541-4c06-aeb7-1ecf7a2457be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:37:28 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-855b7cff-b1b5-4e7e-9e3e-2b992d2415e8 req-fe2f29fb-e418-4b11-83f8-83cc322fea7f service nova] Lock "8acc1b10-a541-4c06-aeb7-1ecf7a2457be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:37:28 user nova-compute[74337]: DEBUG nova.compute.manager [req-855b7cff-b1b5-4e7e-9e3e-2b992d2415e8 req-fe2f29fb-e418-4b11-83f8-83cc322fea7f service nova] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] No waiting events found dispatching network-vif-unplugged-530b7241-1498-47dc-8a6f-79e6c9cc850a {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:37:28 user nova-compute[74337]: DEBUG nova.compute.manager [req-855b7cff-b1b5-4e7e-9e3e-2b992d2415e8 req-fe2f29fb-e418-4b11-83f8-83cc322fea7f service nova] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] Received event network-vif-unplugged-530b7241-1498-47dc-8a6f-79e6c9cc850a for instance with task_state deleting. {{(pid=74337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 21:37:28 user nova-compute[74337]: DEBUG nova.compute.manager [req-855b7cff-b1b5-4e7e-9e3e-2b992d2415e8 req-fe2f29fb-e418-4b11-83f8-83cc322fea7f service nova] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] Received event network-vif-plugged-530b7241-1498-47dc-8a6f-79e6c9cc850a {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:37:28 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-855b7cff-b1b5-4e7e-9e3e-2b992d2415e8 req-fe2f29fb-e418-4b11-83f8-83cc322fea7f service nova] Acquiring lock "8acc1b10-a541-4c06-aeb7-1ecf7a2457be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:37:28 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-855b7cff-b1b5-4e7e-9e3e-2b992d2415e8 req-fe2f29fb-e418-4b11-83f8-83cc322fea7f service nova] Lock "8acc1b10-a541-4c06-aeb7-1ecf7a2457be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:37:28 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-855b7cff-b1b5-4e7e-9e3e-2b992d2415e8 req-fe2f29fb-e418-4b11-83f8-83cc322fea7f service nova] Lock "8acc1b10-a541-4c06-aeb7-1ecf7a2457be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:37:28 user nova-compute[74337]: DEBUG nova.compute.manager [req-855b7cff-b1b5-4e7e-9e3e-2b992d2415e8 req-fe2f29fb-e418-4b11-83f8-83cc322fea7f service nova] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] No waiting events found dispatching network-vif-plugged-530b7241-1498-47dc-8a6f-79e6c9cc850a {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:37:28 user nova-compute[74337]: WARNING nova.compute.manager [req-855b7cff-b1b5-4e7e-9e3e-2b992d2415e8 req-fe2f29fb-e418-4b11-83f8-83cc322fea7f service nova] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] Received unexpected event network-vif-plugged-530b7241-1498-47dc-8a6f-79e6c9cc850a for instance with vm_state active and task_state deleting.
Oct 23 21:37:28 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:28 user nova-compute[74337]: DEBUG nova.compute.manager [req-8ddd7a51-8009-49cb-a475-c1bd8489dd87 req-6a61a9b5-d9ce-4c82-b08b-e2eec920b6a1 service nova] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Received event network-vif-unplugged-872b2a23-8054-4d26-b798-c0099d1c9a91 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:37:28 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-8ddd7a51-8009-49cb-a475-c1bd8489dd87 req-6a61a9b5-d9ce-4c82-b08b-e2eec920b6a1 service nova] Acquiring lock "d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:37:28 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-8ddd7a51-8009-49cb-a475-c1bd8489dd87 req-6a61a9b5-d9ce-4c82-b08b-e2eec920b6a1 service nova] Lock "d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:37:28 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-8ddd7a51-8009-49cb-a475-c1bd8489dd87 req-6a61a9b5-d9ce-4c82-b08b-e2eec920b6a1 service nova] Lock "d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:37:28 user nova-compute[74337]: DEBUG nova.compute.manager [req-8ddd7a51-8009-49cb-a475-c1bd8489dd87 req-6a61a9b5-d9ce-4c82-b08b-e2eec920b6a1 service nova] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] No waiting events found dispatching network-vif-unplugged-872b2a23-8054-4d26-b798-c0099d1c9a91 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:37:28 user nova-compute[74337]: WARNING nova.compute.manager [req-8ddd7a51-8009-49cb-a475-c1bd8489dd87 req-6a61a9b5-d9ce-4c82-b08b-e2eec920b6a1 service nova] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Received unexpected event network-vif-unplugged-872b2a23-8054-4d26-b798-c0099d1c9a91 for instance with vm_state active and task_state resize_migrating.
Oct 23 21:37:28 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:29 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] Instance destroyed successfully.
Oct 23 21:37:29 user nova-compute[74337]: DEBUG nova.objects.instance [None req-4d28a9c6-259a-4863-ab3d-16b6cacc9010 tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Lazy-loading 'resources' on Instance uuid 8acc1b10-a541-4c06-aeb7-1ecf7a2457be {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:37:29 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-4d28a9c6-259a-4863-ab3d-16b6cacc9010 tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T21:33:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1843796381',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1843796381',id=5,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAop3qssYFI+MVvFuH2+7gwm//7zwcdy6tYm9eD42fbRzv89CUtru1RL8WlSDZgdlRSrkM4Tb4QtCQmTEE7AA2YXPHv9z6iJ2d9asZLABlNx58K0PwTsdZsKKihbdIgMOg==',key_name='tempest-keypair-586099674',keypairs=<?>,launch_index=0,launched_at=2023-10-23T21:33:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='84d7baedb5f74976be4b0cf308964086',ramdisk_id='',reservation_id='r-4zf725dv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2141482979',owner_user_name='tempest-TaggedAttachmentsTest-2141482979-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T21:33:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec1a4c2d1f9b4983ab9124c7f6056da6',uuid=8acc1b10-a541-4c06-aeb7-1ecf7a2457be,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "530b7241-1498-47dc-8a6f-79e6c9cc850a", "address": "fa:16:3e:47:6a:0e", "network": {"id": "44c67162-ce40-4b2b-bc3e-07b0203e2083", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1341457246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84d7baedb5f74976be4b0cf308964086", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap530b7241-14", "ovs_interfaceid": "530b7241-1498-47dc-8a6f-79e6c9cc850a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 21:37:29 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-4d28a9c6-259a-4863-ab3d-16b6cacc9010 tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Converting VIF {"id": "530b7241-1498-47dc-8a6f-79e6c9cc850a", "address": "fa:16:3e:47:6a:0e", "network": {"id": "44c67162-ce40-4b2b-bc3e-07b0203e2083", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1341457246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84d7baedb5f74976be4b0cf308964086", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap530b7241-14", "ovs_interfaceid": "530b7241-1498-47dc-8a6f-79e6c9cc850a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:37:29 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-4d28a9c6-259a-4863-ab3d-16b6cacc9010 tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:47:6a:0e,bridge_name='br-int',has_traffic_filtering=True,id=530b7241-1498-47dc-8a6f-79e6c9cc850a,network=Network(44c67162-ce40-4b2b-bc3e-07b0203e2083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap530b7241-14') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:37:29 user nova-compute[74337]: DEBUG os_vif [None req-4d28a9c6-259a-4863-ab3d-16b6cacc9010 tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:6a:0e,bridge_name='br-int',has_traffic_filtering=True,id=530b7241-1498-47dc-8a6f-79e6c9cc850a,network=Network(44c67162-ce40-4b2b-bc3e-07b0203e2083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap530b7241-14') {{(pid=74337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 21:37:29 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:29 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap530b7241-14, bridge=br-int, if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:37:29 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:37:29 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:29 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:29 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a09a86d7-aa6d-47ac-bc41-12861ecf850b) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:37:29 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:37:29 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Instance destroyed successfully.
Oct 23 21:37:29 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:33:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1887044710',display_name='tempest-ServerActionsTestOtherB-server-1887044710',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1887044710',id=3,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHU30kXpNK56Ek7qPPN2svMqEvJefmquCorzEt/taRsaipSAkpLIVwB8P5vsm9bHgo5LnJ4I5wS/V9f0J2TYkkYbtKjnjylT3HdP3iz0AGKDmStPt9PuAI+hC3gVCHen5Q==',key_name='tempest-keypair-1524952332',keypairs=<?>,launch_index=0,launched_at=2023-10-23T21:33:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='17117e60d0d9484d80c0bc8de393921c',ramdisk_id='',reservation_id='r-1ao5mr6t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1301864789',owner_user_name='tempest-ServerActionsTestOtherB-1301864789-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:37:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='92570d8849c646d882017142cac1b674',uuid=d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "872b2a23-8054-4d26-b798-c0099d1c9a91", "address": "fa:16:3e:30:a6:90", "network": {"id": "b6a24032-0229-4ebe-83a3-8804e494838c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1472404179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1472404179-network", "vif_mac": "fa:16:3e:30:a6:90"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17117e60d0d9484d80c0bc8de393921c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap872b2a23-80", "ovs_interfaceid": "872b2a23-8054-4d26-b798-c0099d1c9a91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 21:37:29 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Converting VIF {"id": "872b2a23-8054-4d26-b798-c0099d1c9a91", "address": "fa:16:3e:30:a6:90", "network": {"id": "b6a24032-0229-4ebe-83a3-8804e494838c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1472404179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1472404179-network", "vif_mac": "fa:16:3e:30:a6:90"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17117e60d0d9484d80c0bc8de393921c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap872b2a23-80", "ovs_interfaceid": "872b2a23-8054-4d26-b798-c0099d1c9a91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:37:29 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:30:a6:90,bridge_name='br-int',has_traffic_filtering=True,id=872b2a23-8054-4d26-b798-c0099d1c9a91,network=Network(b6a24032-0229-4ebe-83a3-8804e494838c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap872b2a23-80') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:37:29 user nova-compute[74337]: DEBUG os_vif [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:a6:90,bridge_name='br-int',has_traffic_filtering=True,id=872b2a23-8054-4d26-b798-c0099d1c9a91,network=Network(b6a24032-0229-4ebe-83a3-8804e494838c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap872b2a23-80') {{(pid=74337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 21:37:29 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:29 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:29 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap872b2a23-80, bridge=br-int, if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:37:29 user nova-compute[74337]: INFO os_vif [None req-4d28a9c6-259a-4863-ab3d-16b6cacc9010 tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:6a:0e,bridge_name='br-int',has_traffic_filtering=True,id=530b7241-1498-47dc-8a6f-79e6c9cc850a,network=Network(44c67162-ce40-4b2b-bc3e-07b0203e2083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap530b7241-14')
Oct 23 21:37:29 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-4d28a9c6-259a-4863-ab3d-16b6cacc9010 tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] Deleting instance files /opt/stack/data/nova/instances/8acc1b10-a541-4c06-aeb7-1ecf7a2457be_del
Oct 23 21:37:29 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-4d28a9c6-259a-4863-ab3d-16b6cacc9010 tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] Deletion of /opt/stack/data/nova/instances/8acc1b10-a541-4c06-aeb7-1ecf7a2457be_del complete
Oct 23 21:37:29 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:37:29 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:29 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6a1c8f5b-b3ee-4f0c-8219-5a7ff59d72eb) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:37:29 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:29 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:37:29 user nova-compute[74337]: INFO os_vif [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:a6:90,bridge_name='br-int',has_traffic_filtering=True,id=872b2a23-8054-4d26-b798-c0099d1c9a91,network=Network(b6a24032-0229-4ebe-83a3-8804e494838c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap872b2a23-80')
Oct 23 21:37:29 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] calling os-brick to detach iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 21:37:29 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, {'target_iqn': 'iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cQHBUDwS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:37:29 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:37:29 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:37:29 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:37:29 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:29 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:29 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a2cf46-3c3b-43f4-97d3-e85c50760e52]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:29 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 21:37:29 user nova-compute[74337]: No targets found.
Oct 23 21:37:29 user nova-compute[74337]: iSNS:
Oct 23 21:37:29 user nova-compute[74337]: No targets found.
Oct 23 21:37:29 user nova-compute[74337]: STATIC:
Oct 23 21:37:29 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a
Oct 23 21:37:29 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:37:29 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:37:29 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661
Oct 23 21:37:29 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:37:29 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:37:29 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496
Oct 23 21:37:29 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:37:29 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:37:29 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f
Oct 23 21:37:29 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:37:29 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:37:29 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522
Oct 23 21:37:29 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:37:29 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:37:29 user nova-compute[74337]: FIRMWARE:
Oct 23 21:37:29 user nova-compute[74337]: No targets found.
Oct 23 21:37:29 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:37:29 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 21:37:29 user nova-compute[74337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 21:37:29 user nova-compute[74337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 21:37:29 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522', 0)] {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 21:37:29 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:29 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:29 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d24a13c7-f8b6-45d2-88df-823a76f6a70a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:29 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:29 user nova-compute[74337]: INFO nova.compute.manager [None req-4d28a9c6-259a-4863-ab3d-16b6cacc9010 tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] Took 1.38 seconds to destroy the instance on the hypervisor.
Oct 23 21:37:29 user nova-compute[74337]: DEBUG oslo.service.loopingcall [None req-4d28a9c6-259a-4863-ab3d-16b6cacc9010 tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74337) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 21:37:29 user nova-compute[74337]: DEBUG nova.compute.manager [-] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] Deallocating network for instance {{(pid=74337) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 21:37:29 user nova-compute[74337]: DEBUG nova.network.neutron [-] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] deallocate_for_instance() {{(pid=74337) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 21:37:29 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:29 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[21008a94-1a8e-4f05-81da-7fee119326b5]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:29 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496 (non-flash)
Oct 23 21:37:29 user nova-compute[74337]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f (non-flash)
Oct 23 21:37:29 user nova-compute[74337]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 (non-flash)
Oct 23 21:37:29 user nova-compute[74337]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a (non-flash)
Oct 23 21:37:29 user nova-compute[74337]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661 (non-flash)
Oct 23 21:37:29 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:37:29 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496 (non-flash)
Oct 23 21:37:29 user nova-compute[74337]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f (non-flash)
Oct 23 21:37:29 user nova-compute[74337]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 (non-flash)
Oct 23 21:37:29 user nova-compute[74337]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a (non-flash)
Oct 23 21:37:29 user nova-compute[74337]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661 (non-flash)
Oct 23 21:37:29 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:37:29 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5eec25cd30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522'): ({'sde'}, set())}) {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 21:37:29 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Removing single pathed devices sde {{(pid=74337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 21:37:29 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:29 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:29 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c0a7c83-1804-45b1-b24b-90ee2dceffbe]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:29 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:29 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.024s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:29 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b9f3c5-64c3-49fb-921c-6f3a3da58767]: (4, ('ok\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:29 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Flushing IO for device /dev/sde {{(pid=74337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 21:37:29 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:29 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:29 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe269895-5183-4371-96ab-b01b47f064f7]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:29 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 21:37:29 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:29 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.043s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:29 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ea6e16-aaba-48be-8924-78dcdf90d100]: (4, ('1', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:29 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 21:37:29 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] SCSI volumes sde have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 21:37:29 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522')] {{(pid=74337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 21:37:29 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:29 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:29 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:29 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[79757680-5c29-4504-8e7a-572e52a31ebd]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:29 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:37:29 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:29 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 -p 172.16.0.220:3260 --logout {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:29 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:29 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:29 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ce889f-85c9-40a8-aef6-7d938af165ed]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:29 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522, portal: 172.16.0.220,3260]
Oct 23 21:37:29 user nova-compute[74337]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522, portal: 172.16.0.220,3260] successful.
Oct 23 21:37:29 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:37:29 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 -p 172.16.0.220:3260 --op delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:29 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:29 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d31a5f-97f1-47e7-9cf1-c26959edea73]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:29 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:37:29 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.371s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:37:29 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] <== disconnect_volume: return (373ms) None {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:37:29 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Disconnected iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 21:37:29 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:29 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:29 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:30 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 21:37:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50_resize/disk /opt/stack/data/nova/instances/d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50/disk {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:30 user nova-compute[74337]: DEBUG nova.network.neutron [-] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] Updating instance_info_cache with network_info: [] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:37:30 user nova-compute[74337]: INFO nova.compute.manager [-] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] Took 1.16 seconds to deallocate network for instance.
Oct 23 21:37:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] CMD "cp -r /opt/stack/data/nova/instances/d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50_resize/disk /opt/stack/data/nova/instances/d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50/disk" returned: 0 in 0.425s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50_resize/disk.info /opt/stack/data/nova/instances/d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50/disk.info {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] CMD "cp -r /opt/stack/data/nova/instances/d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50_resize/disk.info /opt/stack/data/nova/instances/d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50/disk.info" returned: 0 in 0.041s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:30 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4d28a9c6-259a-4863-ab3d-16b6cacc9010 tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:37:30 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4d28a9c6-259a-4863-ab3d-16b6cacc9010 tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:37:30 user nova-compute[74337]: DEBUG nova.compute.manager [req-ab6c75a5-de35-4848-be80-5fa51a2d5186 req-e2866284-dd4d-484e-886e-03f8ccb99f56 service nova] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] Received event network-vif-plugged-530b7241-1498-47dc-8a6f-79e6c9cc850a {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:37:30 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ab6c75a5-de35-4848-be80-5fa51a2d5186 req-e2866284-dd4d-484e-886e-03f8ccb99f56 service nova] Acquiring lock "8acc1b10-a541-4c06-aeb7-1ecf7a2457be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:37:30 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ab6c75a5-de35-4848-be80-5fa51a2d5186 req-e2866284-dd4d-484e-886e-03f8ccb99f56 service nova] Lock "8acc1b10-a541-4c06-aeb7-1ecf7a2457be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:37:30 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ab6c75a5-de35-4848-be80-5fa51a2d5186 req-e2866284-dd4d-484e-886e-03f8ccb99f56 service nova] Lock "8acc1b10-a541-4c06-aeb7-1ecf7a2457be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:37:30 user nova-compute[74337]: DEBUG nova.compute.manager [req-ab6c75a5-de35-4848-be80-5fa51a2d5186 req-e2866284-dd4d-484e-886e-03f8ccb99f56 service nova] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] No waiting events found dispatching network-vif-plugged-530b7241-1498-47dc-8a6f-79e6c9cc850a {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:37:30 user nova-compute[74337]: WARNING nova.compute.manager [req-ab6c75a5-de35-4848-be80-5fa51a2d5186 req-e2866284-dd4d-484e-886e-03f8ccb99f56 service nova] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] Received unexpected event network-vif-plugged-530b7241-1498-47dc-8a6f-79e6c9cc850a for instance with vm_state deleted and task_state None.
Oct 23 21:37:30 user nova-compute[74337]: DEBUG nova.compute.manager [req-ab6c75a5-de35-4848-be80-5fa51a2d5186 req-e2866284-dd4d-484e-886e-03f8ccb99f56 service nova] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] Received event network-vif-plugged-530b7241-1498-47dc-8a6f-79e6c9cc850a {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:37:30 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ab6c75a5-de35-4848-be80-5fa51a2d5186 req-e2866284-dd4d-484e-886e-03f8ccb99f56 service nova] Acquiring lock "8acc1b10-a541-4c06-aeb7-1ecf7a2457be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:37:30 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ab6c75a5-de35-4848-be80-5fa51a2d5186 req-e2866284-dd4d-484e-886e-03f8ccb99f56 service nova] Lock "8acc1b10-a541-4c06-aeb7-1ecf7a2457be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:37:30 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ab6c75a5-de35-4848-be80-5fa51a2d5186 req-e2866284-dd4d-484e-886e-03f8ccb99f56 service nova] Lock "8acc1b10-a541-4c06-aeb7-1ecf7a2457be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:37:30 user nova-compute[74337]: DEBUG nova.compute.manager [req-ab6c75a5-de35-4848-be80-5fa51a2d5186 req-e2866284-dd4d-484e-886e-03f8ccb99f56 service nova] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] No waiting events found dispatching network-vif-plugged-530b7241-1498-47dc-8a6f-79e6c9cc850a {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:37:30 user nova-compute[74337]: WARNING nova.compute.manager [req-ab6c75a5-de35-4848-be80-5fa51a2d5186 req-e2866284-dd4d-484e-886e-03f8ccb99f56 service nova] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] Received unexpected event network-vif-plugged-530b7241-1498-47dc-8a6f-79e6c9cc850a for instance with vm_state deleted and task_state None.
Oct 23 21:37:30 user nova-compute[74337]: DEBUG nova.compute.manager [req-ab6c75a5-de35-4848-be80-5fa51a2d5186 req-e2866284-dd4d-484e-886e-03f8ccb99f56 service nova] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] Received event network-vif-unplugged-530b7241-1498-47dc-8a6f-79e6c9cc850a {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:37:30 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ab6c75a5-de35-4848-be80-5fa51a2d5186 req-e2866284-dd4d-484e-886e-03f8ccb99f56 service nova] Acquiring lock "8acc1b10-a541-4c06-aeb7-1ecf7a2457be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:37:30 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ab6c75a5-de35-4848-be80-5fa51a2d5186 req-e2866284-dd4d-484e-886e-03f8ccb99f56 service nova] Lock "8acc1b10-a541-4c06-aeb7-1ecf7a2457be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:37:30 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ab6c75a5-de35-4848-be80-5fa51a2d5186 req-e2866284-dd4d-484e-886e-03f8ccb99f56 service nova] Lock "8acc1b10-a541-4c06-aeb7-1ecf7a2457be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:37:30 user nova-compute[74337]: DEBUG nova.compute.manager [req-ab6c75a5-de35-4848-be80-5fa51a2d5186 req-e2866284-dd4d-484e-886e-03f8ccb99f56 service nova] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] No waiting events found dispatching network-vif-unplugged-530b7241-1498-47dc-8a6f-79e6c9cc850a {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:37:30 user nova-compute[74337]: WARNING nova.compute.manager [req-ab6c75a5-de35-4848-be80-5fa51a2d5186 req-e2866284-dd4d-484e-886e-03f8ccb99f56 service nova] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] Received unexpected event network-vif-unplugged-530b7241-1498-47dc-8a6f-79e6c9cc850a for instance with vm_state deleted and task_state None.
Oct 23 21:37:30 user nova-compute[74337]: DEBUG nova.compute.manager [req-ab6c75a5-de35-4848-be80-5fa51a2d5186 req-e2866284-dd4d-484e-886e-03f8ccb99f56 service nova] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] Received event network-vif-plugged-530b7241-1498-47dc-8a6f-79e6c9cc850a {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:37:30 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ab6c75a5-de35-4848-be80-5fa51a2d5186 req-e2866284-dd4d-484e-886e-03f8ccb99f56 service nova] Acquiring lock "8acc1b10-a541-4c06-aeb7-1ecf7a2457be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:37:30 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ab6c75a5-de35-4848-be80-5fa51a2d5186 req-e2866284-dd4d-484e-886e-03f8ccb99f56 service nova] Lock "8acc1b10-a541-4c06-aeb7-1ecf7a2457be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:37:30 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ab6c75a5-de35-4848-be80-5fa51a2d5186 req-e2866284-dd4d-484e-886e-03f8ccb99f56 service nova] Lock "8acc1b10-a541-4c06-aeb7-1ecf7a2457be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:37:30 user nova-compute[74337]: DEBUG nova.compute.manager [req-ab6c75a5-de35-4848-be80-5fa51a2d5186 req-e2866284-dd4d-484e-886e-03f8ccb99f56 service nova] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] No waiting events found dispatching network-vif-plugged-530b7241-1498-47dc-8a6f-79e6c9cc850a {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:37:30 user nova-compute[74337]: WARNING nova.compute.manager [req-ab6c75a5-de35-4848-be80-5fa51a2d5186 req-e2866284-dd4d-484e-886e-03f8ccb99f56 service nova] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] Received unexpected event network-vif-plugged-530b7241-1498-47dc-8a6f-79e6c9cc850a for instance with vm_state deleted and task_state None.
Oct 23 21:37:30 user nova-compute[74337]: DEBUG nova.compute.manager [req-ab6c75a5-de35-4848-be80-5fa51a2d5186 req-e2866284-dd4d-484e-886e-03f8ccb99f56 service nova] [instance: 8acc1b10-a541-4c06-aeb7-1ecf7a2457be] Received event network-vif-deleted-530b7241-1498-47dc-8a6f-79e6c9cc850a {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:37:31 user nova-compute[74337]: DEBUG nova.compute.manager [req-6a3e9526-62c4-4285-95b8-ac4da298ba10 req-b6e42a56-eb4b-4d91-b817-952a8f176fc3 service nova] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Received event network-vif-plugged-872b2a23-8054-4d26-b798-c0099d1c9a91 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:37:31 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-6a3e9526-62c4-4285-95b8-ac4da298ba10 req-b6e42a56-eb4b-4d91-b817-952a8f176fc3 service nova] Acquiring lock "d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:37:31 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-6a3e9526-62c4-4285-95b8-ac4da298ba10 req-b6e42a56-eb4b-4d91-b817-952a8f176fc3 service nova] Lock "d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:37:31 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-6a3e9526-62c4-4285-95b8-ac4da298ba10 req-b6e42a56-eb4b-4d91-b817-952a8f176fc3 service nova] Lock "d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:37:31 user nova-compute[74337]: DEBUG nova.compute.manager [req-6a3e9526-62c4-4285-95b8-ac4da298ba10 req-b6e42a56-eb4b-4d91-b817-952a8f176fc3 service nova] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] No waiting events found dispatching network-vif-plugged-872b2a23-8054-4d26-b798-c0099d1c9a91 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:37:31 user nova-compute[74337]: WARNING nova.compute.manager [req-6a3e9526-62c4-4285-95b8-ac4da298ba10 req-b6e42a56-eb4b-4d91-b817-952a8f176fc3 service nova] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Received unexpected event network-vif-plugged-872b2a23-8054-4d26-b798-c0099d1c9a91 for instance with vm_state active and task_state resize_migrating.
Oct 23 21:37:31 user nova-compute[74337]: DEBUG nova.compute.manager [req-6a3e9526-62c4-4285-95b8-ac4da298ba10 req-b6e42a56-eb4b-4d91-b817-952a8f176fc3 service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Received event network-vif-deleted-ddee6c78-417b-494f-a9e1-f662c549f425 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:37:31 user nova-compute[74337]: INFO nova.compute.manager [req-6a3e9526-62c4-4285-95b8-ac4da298ba10 req-b6e42a56-eb4b-4d91-b817-952a8f176fc3 service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Neutron deleted interface ddee6c78-417b-494f-a9e1-f662c549f425; detaching it from the instance and deleting it from the info cache
Oct 23 21:37:31 user nova-compute[74337]: DEBUG nova.network.neutron [req-6a3e9526-62c4-4285-95b8-ac4da298ba10 req-b6e42a56-eb4b-4d91-b817-952a8f176fc3 service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Updating instance_info_cache with network_info: [{"id": "58eb51e5-3d74-4162-93b8-66bdf176c1d5", "address": "fa:16:3e:53:ba:1b", "network": {"id": "54ea29fa-daa7-4818-8d2d-c90ee9a18a95", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1215215856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58eb51e5-3d", "ovs_interfaceid": "58eb51e5-3d74-4162-93b8-66bdf176c1d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dd8e8982-b86c-469a-aa55-72bb2ac9bb8b", "address": "fa:16:3e:67:90:76", "network": {"id": "8b22a426-2945-474d-b0e6-8c22bb5e57e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-57423842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd8e8982-b8", "ovs_interfaceid": "dd8e8982-b86c-469a-aa55-72bb2ac9bb8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e91aa55a-4a71-4090-bdde-88c4a648b60b", "address": "fa:16:3e:45:60:43", "network": {"id": "8b22a426-2945-474d-b0e6-8c22bb5e57e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-57423842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape91aa55a-4a", "ovs_interfaceid": "e91aa55a-4a71-4090-bdde-88c4a648b60b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b1664585-4013-46f9-9738-33fd7b9a3161", "address": "fa:16:3e:e8:30:72", "network": {"id": "8b22a426-2945-474d-b0e6-8c22bb5e57e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-57423842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1664585-40", "ovs_interfaceid": "b1664585-4013-46f9-9738-33fd7b9a3161", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ba01b035-453b-4378-92fc-1d81b84363ff", "address": "fa:16:3e:89:cb:12", "network": {"id": "cd8ce1ca-56b3-48fa-bb57-54d0616aa7ca", "bridge": "br-int", "label": "tempest-device-tagging-net2-611360182", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba01b035-45", "ovs_interfaceid": "ba01b035-453b-4378-92fc-1d81b84363ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "248131be-39a9-430f-b27a-377d176d7846", "address": "fa:16:3e:5d:ae:b7", "network": {"id": "cd8ce1ca-56b3-48fa-bb57-54d0616aa7ca", "bridge": "br-int", "label": "tempest-device-tagging-net2-611360182", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap248131be-39", "ovs_interfaceid": "248131be-39a9-430f-b27a-377d176d7846", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:37:31 user nova-compute[74337]: DEBUG nova.compute.manager [req-6a3e9526-62c4-4285-95b8-ac4da298ba10 req-b6e42a56-eb4b-4d91-b817-952a8f176fc3 service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Detach interface failed, port_id=ddee6c78-417b-494f-a9e1-f662c549f425, reason: Instance f1040399-0c5d-4a68-9ee0-4fbe45a42c55 could not be found. {{(pid=74337) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 23 21:37:31 user nova-compute[74337]: DEBUG nova.compute.manager [req-6a3e9526-62c4-4285-95b8-ac4da298ba10 req-b6e42a56-eb4b-4d91-b817-952a8f176fc3 service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Received event network-vif-deleted-248131be-39a9-430f-b27a-377d176d7846 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:37:31 user nova-compute[74337]: INFO nova.compute.manager [req-6a3e9526-62c4-4285-95b8-ac4da298ba10 req-b6e42a56-eb4b-4d91-b817-952a8f176fc3 service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Neutron deleted interface 248131be-39a9-430f-b27a-377d176d7846; detaching it from the instance and deleting it from the info cache
Oct 23 21:37:31 user nova-compute[74337]: DEBUG nova.network.neutron [req-6a3e9526-62c4-4285-95b8-ac4da298ba10 req-b6e42a56-eb4b-4d91-b817-952a8f176fc3 service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Updating instance_info_cache with network_info: [{"id": "58eb51e5-3d74-4162-93b8-66bdf176c1d5", "address": "fa:16:3e:53:ba:1b", "network": {"id": "54ea29fa-daa7-4818-8d2d-c90ee9a18a95", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1215215856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58eb51e5-3d", "ovs_interfaceid": "58eb51e5-3d74-4162-93b8-66bdf176c1d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dd8e8982-b86c-469a-aa55-72bb2ac9bb8b", "address": "fa:16:3e:67:90:76", "network": {"id": "8b22a426-2945-474d-b0e6-8c22bb5e57e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-57423842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd8e8982-b8", "ovs_interfaceid": "dd8e8982-b86c-469a-aa55-72bb2ac9bb8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e91aa55a-4a71-4090-bdde-88c4a648b60b", "address": "fa:16:3e:45:60:43", "network": {"id": "8b22a426-2945-474d-b0e6-8c22bb5e57e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-57423842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape91aa55a-4a", "ovs_interfaceid": "e91aa55a-4a71-4090-bdde-88c4a648b60b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b1664585-4013-46f9-9738-33fd7b9a3161", "address": "fa:16:3e:e8:30:72", "network": {"id": "8b22a426-2945-474d-b0e6-8c22bb5e57e5", "bridge": "br-int", "label": "tempest-device-tagging-net1-57423842", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1664585-40", "ovs_interfaceid": "b1664585-4013-46f9-9738-33fd7b9a3161", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ba01b035-453b-4378-92fc-1d81b84363ff", "address": "fa:16:3e:89:cb:12", "network": {"id": "cd8ce1ca-56b3-48fa-bb57-54d0616aa7ca", "bridge": "br-int", "label": "tempest-device-tagging-net2-611360182", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b1b3449d434445e7973d49183234beee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba01b035-45", "ovs_interfaceid": "ba01b035-453b-4378-92fc-1d81b84363ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:37:31 user nova-compute[74337]: DEBUG nova.compute.manager [req-6a3e9526-62c4-4285-95b8-ac4da298ba10 req-b6e42a56-eb4b-4d91-b817-952a8f176fc3 service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Detach interface failed, port_id=248131be-39a9-430f-b27a-377d176d7846, reason: Instance f1040399-0c5d-4a68-9ee0-4fbe45a42c55 could not be found. {{(pid=74337) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 23 21:37:31 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-4d28a9c6-259a-4863-ab3d-16b6cacc9010 tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:37:31 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-4d28a9c6-259a-4863-ab3d-16b6cacc9010 tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:37:31 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4d28a9c6-259a-4863-ab3d-16b6cacc9010 tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.486s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:37:31 user nova-compute[74337]: INFO nova.scheduler.client.report [None req-4d28a9c6-259a-4863-ab3d-16b6cacc9010 tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Deleted allocations for instance 8acc1b10-a541-4c06-aeb7-1ecf7a2457be
Oct 23 21:37:31 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4d28a9c6-259a-4863-ab3d-16b6cacc9010 tempest-TaggedAttachmentsTest-2141482979 tempest-TaggedAttachmentsTest-2141482979-project-member] Lock "8acc1b10-a541-4c06-aeb7-1ecf7a2457be" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.254s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:37:32 user nova-compute[74337]: DEBUG nova.network.neutron [-] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Updating instance_info_cache with network_info: [] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:37:32 user nova-compute[74337]: INFO nova.compute.manager [-] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Took 4.48 seconds to deallocate network for instance.
Oct 23 21:37:32 user nova-compute[74337]: DEBUG nova.network.neutron [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Port 872b2a23-8054-4d26-b798-c0099d1c9a91 binding to destination host user is already ACTIVE {{(pid=74337) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Oct 23 21:37:32 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Acquiring lock "d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:37:32 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Lock "d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:37:32 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Lock "d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:37:32 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Acquiring lock "refresh_cache-d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:37:32 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Acquired lock "refresh_cache-d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:37:32 user nova-compute[74337]: DEBUG nova.network.neutron [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Building network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 21:37:33 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:33 user nova-compute[74337]: DEBUG nova.compute.manager [req-127beb0c-9e05-43ae-bf66-7ee8f51b4e3d req-58e7f2e2-baf0-48ec-80ec-8f69e10519f4 service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Received event network-vif-deleted-b1664585-4013-46f9-9738-33fd7b9a3161 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:37:33 user nova-compute[74337]: DEBUG nova.compute.manager [req-127beb0c-9e05-43ae-bf66-7ee8f51b4e3d req-58e7f2e2-baf0-48ec-80ec-8f69e10519f4 service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Received event network-vif-deleted-ba01b035-453b-4378-92fc-1d81b84363ff {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:37:33 user nova-compute[74337]: DEBUG nova.compute.manager [req-127beb0c-9e05-43ae-bf66-7ee8f51b4e3d req-58e7f2e2-baf0-48ec-80ec-8f69e10519f4 service nova] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Received event network-vif-deleted-58eb51e5-3d74-4162-93b8-66bdf176c1d5 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:37:33 user nova-compute[74337]: DEBUG nova.network.neutron [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Updating instance_info_cache with network_info: [{"id": "872b2a23-8054-4d26-b798-c0099d1c9a91", "address": "fa:16:3e:30:a6:90", "network": {"id": "b6a24032-0229-4ebe-83a3-8804e494838c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1472404179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17117e60d0d9484d80c0bc8de393921c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap872b2a23-80", "ovs_interfaceid": "872b2a23-8054-4d26-b798-c0099d1c9a91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:37:33 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Releasing lock "refresh_cache-d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:37:33 user nova-compute[74337]: DEBUG os_brick.utils [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:37:33 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:33 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:33 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[1487a604-2538-4d92-a82b-00c2d5f7125b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f34011b66e40\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:33 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:33 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:33 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e06f53-0662-4b4c-bf56-d310d587a261]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:33 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:33 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:33 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf2546be-2355-4d81-88fe-2f94c7790953]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:33 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[47dce70b-ad7c-40d9-8568-0d8a4327895f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:33 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Running cmd (subprocess): nvme version {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:33 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] 'nvme version' failed. Not Retrying. {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 21:37:33 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] nvme not present on system {{(pid=74337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 21:37:33 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:33 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 21:37:33 user nova-compute[74337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 21:37:33 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[f40f50af-cc40-4e44-bf32-da8216a25772]: (4, '') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:33 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 21:37:33 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 21:37:33 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] LIGHTOS: no hostnqn found. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 21:37:33 user nova-compute[74337]: DEBUG os_brick.utils [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f34011b66e40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:37:34 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:35 user nova-compute[74337]: INFO nova.compute.manager [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] [instance: f1040399-0c5d-4a68-9ee0-4fbe45a42c55] Took 2.74 seconds to detach 3 volumes for instance.
Oct 23 21:37:35 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:37:35 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:37:35 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-8986f5b9-1a52-4929-a0e3-14b800ba6363 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5a181593-8086-4ece-9f5b-5ccba0bfe91e is timed out.
Oct 23 21:37:35 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-8986f5b9-1a52-4929-a0e3-14b800ba6363 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Successfully detached device vdb from instance 5a181593-8086-4ece-9f5b-5ccba0bfe91e from the live domain config.
Oct 23 21:37:35 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8986f5b9-1a52-4929-a0e3-14b800ba6363 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] [instance: 5a181593-8086-4ece-9f5b-5ccba0bfe91e] calling os-brick to detach iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 21:37:35 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8986f5b9-1a52-4929-a0e3-14b800ba6363 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, {'target_iqn': 'iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wfjRXToB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk', 'volume_id': '06d4748a-a032-4937-a18b-c323e56f507f'}, None), 'kwargs': False}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:37:35 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-8986f5b9-1a52-4929-a0e3-14b800ba6363 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:37:35 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-8986f5b9-1a52-4929-a0e3-14b800ba6363 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:37:35 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-8986f5b9-1a52-4929-a0e3-14b800ba6363 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:37:35 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:35 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:35 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[68535508-98ff-46b4-981e-91980dd37239]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:35 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8986f5b9-1a52-4929-a0e3-14b800ba6363 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 21:37:35 user nova-compute[74337]: No targets found.
Oct 23 21:37:35 user nova-compute[74337]: iSNS:
Oct 23 21:37:35 user nova-compute[74337]: No targets found.
Oct 23 21:37:35 user nova-compute[74337]: STATIC:
Oct 23 21:37:35 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a
Oct 23 21:37:35 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:37:35 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:37:35 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661
Oct 23 21:37:35 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:37:35 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:37:35 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496
Oct 23 21:37:35 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:37:35 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:37:35 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f
Oct 23 21:37:35 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:37:35 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:37:35 user nova-compute[74337]: FIRMWARE:
Oct 23 21:37:35 user nova-compute[74337]: No targets found.
Oct 23 21:37:35 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:37:35 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8986f5b9-1a52-4929-a0e3-14b800ba6363 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 21:37:35 user nova-compute[74337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 21:37:35 user nova-compute[74337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 21:37:35 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8986f5b9-1a52-4929-a0e3-14b800ba6363 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f', 0)] {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 21:37:35 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:35 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:35 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6ffccb4-25b5-4969-aced-6a953cf6142c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:35 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:35 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:35 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5dba498-50fe-45d8-9827-2f167ffaad50]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:35 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8986f5b9-1a52-4929-a0e3-14b800ba6363 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496 (non-flash)
Oct 23 21:37:35 user nova-compute[74337]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f (non-flash)
Oct 23 21:37:35 user nova-compute[74337]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a (non-flash)
Oct 23 21:37:35 user nova-compute[74337]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661 (non-flash)
Oct 23 21:37:35 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:37:35 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8986f5b9-1a52-4929-a0e3-14b800ba6363 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496 (non-flash)
Oct 23 21:37:35 user nova-compute[74337]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f (non-flash)
Oct 23 21:37:35 user nova-compute[74337]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a (non-flash)
Oct 23 21:37:35 user nova-compute[74337]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661 (non-flash)
Oct 23 21:37:35 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:37:35 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8986f5b9-1a52-4929-a0e3-14b800ba6363 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5ef4063760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f'): ({'sdk'}, set())}) {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 21:37:35 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-8986f5b9-1a52-4929-a0e3-14b800ba6363 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Removing single pathed devices sdk {{(pid=74337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 21:37:35 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:35 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:35 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c38324-4968-41cc-b1dc-bc9d1395d679]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:35 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:35 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.020s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:35 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a16f7f90-bef0-4dc3-b57c-fb54bcdd137c]: (4, ('ok\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:35 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-8986f5b9-1a52-4929-a0e3-14b800ba6363 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Flushing IO for device /dev/sdk {{(pid=74337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 21:37:35 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:35 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.016s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:35 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[226e3fbe-d76a-493d-95f0-1976909a395d]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:35 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-8986f5b9-1a52-4929-a0e3-14b800ba6363 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=74337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 21:37:35 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:35 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.060s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:35 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8601b44-1e88-40ef-a48b-e2a5bcf2d1e3]: (4, ('1', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:35 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-8986f5b9-1a52-4929-a0e3-14b800ba6363 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Checking to see if SCSI volumes sdk have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 21:37:35 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-8986f5b9-1a52-4929-a0e3-14b800ba6363 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] SCSI volumes sdk have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 21:37:35 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8986f5b9-1a52-4929-a0e3-14b800ba6363 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f')] {{(pid=74337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 21:37:35 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:35 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:35 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e13bbb51-3884-407a-a0b9-8a03381d51b9]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:35 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8986f5b9-1a52-4929-a0e3-14b800ba6363 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:37:35 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f -p 172.16.0.220:3260 --logout {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:35 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:35 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6caeeeaa-55d5-46d6-95df-2bd1930a09fd]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:35 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8986f5b9-1a52-4929-a0e3-14b800ba6363 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f, portal: 172.16.0.220,3260]
Oct 23 21:37:35 user nova-compute[74337]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f, portal: 172.16.0.220,3260] successful.
Oct 23 21:37:35 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:37:35 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f -p 172.16.0.220:3260 --op delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:35 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:37:35 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06d4748a-a032-4937-a18b-c323e56f507f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:35 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[63df2042-70ea-4f88-8c3e-c28f8729280f]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:35 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8986f5b9-1a52-4929-a0e3-14b800ba6363 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:37:35 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-8986f5b9-1a52-4929-a0e3-14b800ba6363 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.356s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:37:35 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8986f5b9-1a52-4929-a0e3-14b800ba6363 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] <== disconnect_volume: return (359ms) None {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:37:35 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8986f5b9-1a52-4929-a0e3-14b800ba6363 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] [instance: 5a181593-8086-4ece-9f5b-5ccba0bfe91e] Disconnected iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 21:37:35 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:37:35 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.436s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:37:35 user nova-compute[74337]: INFO nova.scheduler.client.report [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Deleted allocations for instance f1040399-0c5d-4a68-9ee0-4fbe45a42c55
Oct 23 21:37:35 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-efd4cba3-ab07-4d0b-9942-6f9875cbe792 tempest-TaggedBootDevicesTest-491179426 tempest-TaggedBootDevicesTest-491179426-project-member] Lock "f1040399-0c5d-4a68-9ee0-4fbe45a42c55" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.556s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:37:36 user nova-compute[74337]: DEBUG nova.objects.instance [None req-8986f5b9-1a52-4929-a0e3-14b800ba6363 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Lazy-loading 'flavor' on Instance uuid 5a181593-8086-4ece-9f5b-5ccba0bfe91e {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:37:36 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-8986f5b9-1a52-4929-a0e3-14b800ba6363 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Lock "5a181593-8086-4ece-9f5b-5ccba0bfe91e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.006s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:37:38 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:38 user nova-compute[74337]: DEBUG nova.compute.manager [req-c0f61703-e6b6-4122-af09-67dddf255d09 req-c055d04e-4689-4911-9146-21864fab9be7 service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Received event network-changed-2ea512c9-8ab6-49a3-9f77-14bcd380f8e8 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:37:38 user nova-compute[74337]: DEBUG nova.compute.manager [req-c0f61703-e6b6-4122-af09-67dddf255d09 req-c055d04e-4689-4911-9146-21864fab9be7 service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Refreshing instance network info cache due to event network-changed-2ea512c9-8ab6-49a3-9f77-14bcd380f8e8. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 21:37:38 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-c0f61703-e6b6-4122-af09-67dddf255d09 req-c055d04e-4689-4911-9146-21864fab9be7 service nova] Acquiring lock "refresh_cache-04c02325-7ce4-45c2-819b-c656e93c96ca" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:37:38 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-c0f61703-e6b6-4122-af09-67dddf255d09 req-c055d04e-4689-4911-9146-21864fab9be7 service nova] Acquired lock "refresh_cache-04c02325-7ce4-45c2-819b-c656e93c96ca" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:37:38 user nova-compute[74337]: DEBUG nova.network.neutron [req-c0f61703-e6b6-4122-af09-67dddf255d09 req-c055d04e-4689-4911-9146-21864fab9be7 service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Refreshing network info cache for port 2ea512c9-8ab6-49a3-9f77-14bcd380f8e8 {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 21:37:39 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:39 user nova-compute[74337]: DEBUG nova.network.neutron [req-c0f61703-e6b6-4122-af09-67dddf255d09 req-c055d04e-4689-4911-9146-21864fab9be7 service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Updated VIF entry in instance network info cache for port 2ea512c9-8ab6-49a3-9f77-14bcd380f8e8. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 21:37:39 user nova-compute[74337]: DEBUG nova.network.neutron [req-c0f61703-e6b6-4122-af09-67dddf255d09 req-c055d04e-4689-4911-9146-21864fab9be7 service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Updating instance_info_cache with network_info: [{"id": "2ea512c9-8ab6-49a3-9f77-14bcd380f8e8", "address": "fa:16:3e:75:d8:7f", "network": {"id": "e5fd79cb-72f1-4d32-a604-b9518e375fcd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-840255736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46b2b924f3a4461ba09eb54ee42f4649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ea512c9-8a", "ovs_interfaceid": "2ea512c9-8ab6-49a3-9f77-14bcd380f8e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2727b3bf-35e4-485a-b44b-66406b7d1597", "address": "fa:16:3e:e2:6e:58", "network": {"id": "8a3d7452-cadc-4728-a772-801d6a5c4770", "bridge": "br-int", "label": "tempest-device-tagging-net1-560176148", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46b2b924f3a4461ba09eb54ee42f4649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2727b3bf-35", "ovs_interfaceid": "2727b3bf-35e4-485a-b44b-66406b7d1597", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9141d0eb-5e49-4a83-993f-3eac6a526dfd", "address": "fa:16:3e:1f:61:c0", "network": {"id": "8a3d7452-cadc-4728-a772-801d6a5c4770", "bridge": "br-int", "label": "tempest-device-tagging-net1-560176148", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46b2b924f3a4461ba09eb54ee42f4649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9141d0eb-5e", "ovs_interfaceid": "9141d0eb-5e49-4a83-993f-3eac6a526dfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4da5a263-b3c7-49ba-b2e1-d54cbb5f0f0e", "address": "fa:16:3e:2d:65:73", "network": {"id": "8a3d7452-cadc-4728-a772-801d6a5c4770", "bridge": "br-int", "label": "tempest-device-tagging-net1-560176148", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46b2b924f3a4461ba09eb54ee42f4649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4da5a263-b3", "ovs_interfaceid": "4da5a263-b3c7-49ba-b2e1-d54cbb5f0f0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d35e88b3-1ad6-42dc-9b9f-281cb0e99dc8", "address": "fa:16:3e:51:c9:d7", "network": {"id": "8a3d7452-cadc-4728-a772-801d6a5c4770", "bridge": "br-int", "label": "tempest-device-tagging-net1-560176148", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46b2b924f3a4461ba09eb54ee42f4649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd35e88b3-1a", "ovs_interfaceid": "d35e88b3-1ad6-42dc-9b9f-281cb0e99dc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "78d439bc-58eb-4984-86f7-e9610cd8c17f", "address": "fa:16:3e:a3:26:2f", "network": {"id": "1f1cb866-1870-48d7-8866-ac73e71c8ef4", "bridge": "br-int", "label": "tempest-device-tagging-net2-663589537", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "46b2b924f3a4461ba09eb54ee42f4649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78d439bc-58", "ovs_interfaceid": "78d439bc-58eb-4984-86f7-e9610cd8c17f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "870087f8-5e43-4e98-a6ab-b65529f9fa6b", "address": "fa:16:3e:96:be:1f", "network": {"id": "1f1cb866-1870-48d7-8866-ac73e71c8ef4", "bridge": "br-int", "label": "tempest-device-tagging-net2-663589537", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "46b2b924f3a4461ba09eb54ee42f4649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap870087f8-5e", "ovs_interfaceid": "870087f8-5e43-4e98-a6ab-b65529f9fa6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:37:39 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-c0f61703-e6b6-4122-af09-67dddf255d09 req-c055d04e-4689-4911-9146-21864fab9be7 service nova] Releasing lock "refresh_cache-04c02325-7ce4-45c2-819b-c656e93c96ca" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:37:41 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Acquiring lock "04c02325-7ce4-45c2-819b-c656e93c96ca" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:37:41 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Lock "04c02325-7ce4-45c2-819b-c656e93c96ca" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:37:41 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Acquiring lock "04c02325-7ce4-45c2-819b-c656e93c96ca-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:37:41 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Lock "04c02325-7ce4-45c2-819b-c656e93c96ca-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:37:41 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Lock "04c02325-7ce4-45c2-819b-c656e93c96ca-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:37:41 user nova-compute[74337]: INFO nova.compute.manager [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Terminating instance
Oct 23 21:37:41 user nova-compute[74337]: DEBUG nova.compute.manager [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Start destroying the instance on the hypervisor. {{(pid=74337) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 21:37:41 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:41 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:41 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:42 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:42 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:42 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:42 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:42 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:42 user nova-compute[74337]: DEBUG nova.compute.manager [req-14cef29c-1665-4694-bb22-eb46d3554b09 req-93177d4c-e44a-4936-a2a1-af30375200f8 service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Received event network-vif-unplugged-2ea512c9-8ab6-49a3-9f77-14bcd380f8e8 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:37:42 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-14cef29c-1665-4694-bb22-eb46d3554b09 req-93177d4c-e44a-4936-a2a1-af30375200f8 service nova] Acquiring lock "04c02325-7ce4-45c2-819b-c656e93c96ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:37:42 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-14cef29c-1665-4694-bb22-eb46d3554b09 req-93177d4c-e44a-4936-a2a1-af30375200f8 service nova] Lock "04c02325-7ce4-45c2-819b-c656e93c96ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:37:42 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-14cef29c-1665-4694-bb22-eb46d3554b09 req-93177d4c-e44a-4936-a2a1-af30375200f8 service nova] Lock "04c02325-7ce4-45c2-819b-c656e93c96ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:37:42 user nova-compute[74337]: DEBUG nova.compute.manager [req-14cef29c-1665-4694-bb22-eb46d3554b09 req-93177d4c-e44a-4936-a2a1-af30375200f8 service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] No waiting events found dispatching network-vif-unplugged-2ea512c9-8ab6-49a3-9f77-14bcd380f8e8 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:37:42 user nova-compute[74337]: DEBUG nova.compute.manager [req-14cef29c-1665-4694-bb22-eb46d3554b09 req-93177d4c-e44a-4936-a2a1-af30375200f8 service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Received event network-vif-unplugged-2ea512c9-8ab6-49a3-9f77-14bcd380f8e8 for instance with task_state deleting. {{(pid=74337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 21:37:42 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:42 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:42 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:42 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:42 user nova-compute[74337]: DEBUG nova.compute.manager [req-ff5bb523-4ad5-494b-ba8b-d460f9cbf59e req-96081f7d-7be3-46bb-a12a-2506f1033fee service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Received event network-vif-unplugged-4da5a263-b3c7-49ba-b2e1-d54cbb5f0f0e {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:37:42 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ff5bb523-4ad5-494b-ba8b-d460f9cbf59e req-96081f7d-7be3-46bb-a12a-2506f1033fee service nova] Acquiring lock "04c02325-7ce4-45c2-819b-c656e93c96ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:37:42 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ff5bb523-4ad5-494b-ba8b-d460f9cbf59e req-96081f7d-7be3-46bb-a12a-2506f1033fee service nova] Lock "04c02325-7ce4-45c2-819b-c656e93c96ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:37:42 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ff5bb523-4ad5-494b-ba8b-d460f9cbf59e req-96081f7d-7be3-46bb-a12a-2506f1033fee service nova] Lock "04c02325-7ce4-45c2-819b-c656e93c96ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:37:42 user nova-compute[74337]: DEBUG nova.compute.manager [req-ff5bb523-4ad5-494b-ba8b-d460f9cbf59e req-96081f7d-7be3-46bb-a12a-2506f1033fee service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] No waiting events found dispatching network-vif-unplugged-4da5a263-b3c7-49ba-b2e1-d54cbb5f0f0e {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:37:42 user nova-compute[74337]: DEBUG nova.compute.manager [req-ff5bb523-4ad5-494b-ba8b-d460f9cbf59e req-96081f7d-7be3-46bb-a12a-2506f1033fee service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Received event network-vif-unplugged-4da5a263-b3c7-49ba-b2e1-d54cbb5f0f0e for instance with task_state deleting. {{(pid=74337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 21:37:42 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:42 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:42 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:42 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:42 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:42 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:42 user nova-compute[74337]: DEBUG nova.compute.manager [req-882bfb7e-51e2-40b6-a278-458b794e7e79 req-f4da05b5-aa1a-4214-90f3-bf84c4f5dc24 service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Received event network-vif-unplugged-d35e88b3-1ad6-42dc-9b9f-281cb0e99dc8 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:37:42 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-882bfb7e-51e2-40b6-a278-458b794e7e79 req-f4da05b5-aa1a-4214-90f3-bf84c4f5dc24 service nova] Acquiring lock "04c02325-7ce4-45c2-819b-c656e93c96ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:37:42 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-882bfb7e-51e2-40b6-a278-458b794e7e79 req-f4da05b5-aa1a-4214-90f3-bf84c4f5dc24 service nova] Lock "04c02325-7ce4-45c2-819b-c656e93c96ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:37:42 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-882bfb7e-51e2-40b6-a278-458b794e7e79 req-f4da05b5-aa1a-4214-90f3-bf84c4f5dc24 service nova] Lock "04c02325-7ce4-45c2-819b-c656e93c96ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:37:42 user nova-compute[74337]: DEBUG nova.compute.manager [req-882bfb7e-51e2-40b6-a278-458b794e7e79 req-f4da05b5-aa1a-4214-90f3-bf84c4f5dc24 service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] No waiting events found dispatching network-vif-unplugged-d35e88b3-1ad6-42dc-9b9f-281cb0e99dc8 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:37:42 user nova-compute[74337]: DEBUG nova.compute.manager [req-882bfb7e-51e2-40b6-a278-458b794e7e79 req-f4da05b5-aa1a-4214-90f3-bf84c4f5dc24 service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Received event network-vif-unplugged-d35e88b3-1ad6-42dc-9b9f-281cb0e99dc8 for instance with task_state deleting. {{(pid=74337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 21:37:42 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:42 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:43 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:43 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:43 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:43 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:43 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:43 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Instance destroyed successfully.
Oct 23 21:37:43 user nova-compute[74337]: DEBUG nova.objects.instance [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Lazy-loading 'resources' on Instance uuid 04c02325-7ce4-45c2-819b-c656e93c96ca {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:37:43 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T21:34:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-605341238',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-605341238',id=11,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKmnJ7mFnPC72zwxOhbZBqQQcw8wKcBQrJU/kXbtycxWGrYKWY4ryrk3P1/UrfZxJmArjpq8PnfjCzLxm5CSleEJWdCvoG6Fk25LMsRefGname4N0hV8zcfbkPovW5pJmA==',key_name='tempest-keypair-290861577',keypairs=<?>,launch_index=0,launched_at=2023-10-23T21:36:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='46b2b924f3a4461ba09eb54ee42f4649',ramdisk_id='',reservation_id='r-gnrgh800',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-66532269',owner_user_name='tempest-TaggedBootDevicesTest_v242-66532269-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T21:36:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fdc4cfd43887413eabd86770e724e2b8',uuid=04c02325-7ce4-45c2-819b-c656e93c96ca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2ea512c9-8ab6-49a3-9f77-14bcd380f8e8", "address": "fa:16:3e:75:d8:7f", "network": {"id": "e5fd79cb-72f1-4d32-a604-b9518e375fcd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-840255736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46b2b924f3a4461ba09eb54ee42f4649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ea512c9-8a", "ovs_interfaceid": "2ea512c9-8ab6-49a3-9f77-14bcd380f8e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 21:37:43 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Converting VIF {"id": "2ea512c9-8ab6-49a3-9f77-14bcd380f8e8", "address": "fa:16:3e:75:d8:7f", "network": {"id": "e5fd79cb-72f1-4d32-a604-b9518e375fcd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-840255736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46b2b924f3a4461ba09eb54ee42f4649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ea512c9-8a", "ovs_interfaceid": "2ea512c9-8ab6-49a3-9f77-14bcd380f8e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:37:43 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:75:d8:7f,bridge_name='br-int',has_traffic_filtering=True,id=2ea512c9-8ab6-49a3-9f77-14bcd380f8e8,network=Network(e5fd79cb-72f1-4d32-a604-b9518e375fcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ea512c9-8a') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:37:43 user nova-compute[74337]: DEBUG os_vif [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:d8:7f,bridge_name='br-int',has_traffic_filtering=True,id=2ea512c9-8ab6-49a3-9f77-14bcd380f8e8,network=Network(e5fd79cb-72f1-4d32-a604-b9518e375fcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ea512c9-8a') {{(pid=74337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 21:37:43 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:43 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2ea512c9-8a, bridge=br-int, if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:37:43 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:43 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:37:43 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:43 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:43 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d9710e9a-390d-48ec-8365-a6b5e79ff6a0) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:37:43 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:43 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:37:43 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:43 user nova-compute[74337]: INFO os_vif [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:d8:7f,bridge_name='br-int',has_traffic_filtering=True,id=2ea512c9-8ab6-49a3-9f77-14bcd380f8e8,network=Network(e5fd79cb-72f1-4d32-a604-b9518e375fcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ea512c9-8a')
Oct 23 21:37:43 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T21:34:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-605341238',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-605341238',id=11,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKmnJ7mFnPC72zwxOhbZBqQQcw8wKcBQrJU/kXbtycxWGrYKWY4ryrk3P1/UrfZxJmArjpq8PnfjCzLxm5CSleEJWdCvoG6Fk25LMsRefGname4N0hV8zcfbkPovW5pJmA==',key_name='tempest-keypair-290861577',keypairs=<?>,launch_index=0,launched_at=2023-10-23T21:36:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='46b2b924f3a4461ba09eb54ee42f4649',ramdisk_id='',reservation_id='r-gnrgh800',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-66532269',owner_user_name='tempest-TaggedBootDevicesTest_v242-66532269-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T21:36:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fdc4cfd43887413eabd86770e724e2b8',uuid=04c02325-7ce4-45c2-819b-c656e93c96ca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2727b3bf-35e4-485a-b44b-66406b7d1597", "address": "fa:16:3e:e2:6e:58", "network": {"id": "8a3d7452-cadc-4728-a772-801d6a5c4770", "bridge": "br-int", "label": "tempest-device-tagging-net1-560176148", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46b2b924f3a4461ba09eb54ee42f4649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2727b3bf-35", "ovs_interfaceid": "2727b3bf-35e4-485a-b44b-66406b7d1597", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 21:37:43 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Converting VIF {"id": "2727b3bf-35e4-485a-b44b-66406b7d1597", "address": "fa:16:3e:e2:6e:58", "network": {"id": "8a3d7452-cadc-4728-a772-801d6a5c4770", "bridge": "br-int", "label": "tempest-device-tagging-net1-560176148", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46b2b924f3a4461ba09eb54ee42f4649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2727b3bf-35", "ovs_interfaceid": "2727b3bf-35e4-485a-b44b-66406b7d1597", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:37:43 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:6e:58,bridge_name='br-int',has_traffic_filtering=True,id=2727b3bf-35e4-485a-b44b-66406b7d1597,network=Network(8a3d7452-cadc-4728-a772-801d6a5c4770),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2727b3bf-35') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:37:43 user nova-compute[74337]: DEBUG os_vif [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:6e:58,bridge_name='br-int',has_traffic_filtering=True,id=2727b3bf-35e4-485a-b44b-66406b7d1597,network=Network(8a3d7452-cadc-4728-a772-801d6a5c4770),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2727b3bf-35') {{(pid=74337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 21:37:43 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:43 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2727b3bf-35, bridge=br-int, if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:37:43 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:43 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:37:43 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:43 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:43 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ff385cdb-69c0-4af8-93b9-e9f39aa5037e) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:37:43 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:43 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:44 user nova-compute[74337]: INFO os_vif [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:6e:58,bridge_name='br-int',has_traffic_filtering=True,id=2727b3bf-35e4-485a-b44b-66406b7d1597,network=Network(8a3d7452-cadc-4728-a772-801d6a5c4770),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2727b3bf-35')
Oct 23 21:37:44 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T21:34:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-605341238',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-605341238',id=11,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKmnJ7mFnPC72zwxOhbZBqQQcw8wKcBQrJU/kXbtycxWGrYKWY4ryrk3P1/UrfZxJmArjpq8PnfjCzLxm5CSleEJWdCvoG6Fk25LMsRefGname4N0hV8zcfbkPovW5pJmA==',key_name='tempest-keypair-290861577',keypairs=<?>,launch_index=0,launched_at=2023-10-23T21:36:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='46b2b924f3a4461ba09eb54ee42f4649',ramdisk_id='',reservation_id='r-gnrgh800',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-66532269',owner_user_name='tempest-TaggedBootDevicesTest_v242-66532269-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T21:36:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fdc4cfd43887413eabd86770e724e2b8',uuid=04c02325-7ce4-45c2-819b-c656e93c96ca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9141d0eb-5e49-4a83-993f-3eac6a526dfd", "address": "fa:16:3e:1f:61:c0", "network": {"id": "8a3d7452-cadc-4728-a772-801d6a5c4770", "bridge": "br-int", "label": "tempest-device-tagging-net1-560176148", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46b2b924f3a4461ba09eb54ee42f4649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9141d0eb-5e", "ovs_interfaceid": "9141d0eb-5e49-4a83-993f-3eac6a526dfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Converting VIF {"id": "9141d0eb-5e49-4a83-993f-3eac6a526dfd", "address": "fa:16:3e:1f:61:c0", "network": {"id": "8a3d7452-cadc-4728-a772-801d6a5c4770", "bridge": "br-int", "label": "tempest-device-tagging-net1-560176148", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46b2b924f3a4461ba09eb54ee42f4649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9141d0eb-5e", "ovs_interfaceid": "9141d0eb-5e49-4a83-993f-3eac6a526dfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:61:c0,bridge_name='br-int',has_traffic_filtering=True,id=9141d0eb-5e49-4a83-993f-3eac6a526dfd,network=Network(8a3d7452-cadc-4728-a772-801d6a5c4770),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9141d0eb-5e') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG os_vif [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:61:c0,bridge_name='br-int',has_traffic_filtering=True,id=9141d0eb-5e49-4a83-993f-3eac6a526dfd,network=Network(8a3d7452-cadc-4728-a772-801d6a5c4770),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9141d0eb-5e') {{(pid=74337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9141d0eb-5e, bridge=br-int, if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=11a7b627-4b79-4871-bafd-d3062e92f3f8) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:44 user nova-compute[74337]: INFO os_vif [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:61:c0,bridge_name='br-int',has_traffic_filtering=True,id=9141d0eb-5e49-4a83-993f-3eac6a526dfd,network=Network(8a3d7452-cadc-4728-a772-801d6a5c4770),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9141d0eb-5e')
Oct 23 21:37:44 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T21:34:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-605341238',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-605341238',id=11,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKmnJ7mFnPC72zwxOhbZBqQQcw8wKcBQrJU/kXbtycxWGrYKWY4ryrk3P1/UrfZxJmArjpq8PnfjCzLxm5CSleEJWdCvoG6Fk25LMsRefGname4N0hV8zcfbkPovW5pJmA==',key_name='tempest-keypair-290861577',keypairs=<?>,launch_index=0,launched_at=2023-10-23T21:36:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='46b2b924f3a4461ba09eb54ee42f4649',ramdisk_id='',reservation_id='r-gnrgh800',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-66532269',owner_user_name='tempest-TaggedBootDevicesTest_v242-66532269-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T21:36:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fdc4cfd43887413eabd86770e724e2b8',uuid=04c02325-7ce4-45c2-819b-c656e93c96ca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4da5a263-b3c7-49ba-b2e1-d54cbb5f0f0e", "address": "fa:16:3e:2d:65:73", "network": {"id": "8a3d7452-cadc-4728-a772-801d6a5c4770", "bridge": "br-int", "label": "tempest-device-tagging-net1-560176148", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46b2b924f3a4461ba09eb54ee42f4649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4da5a263-b3", "ovs_interfaceid": "4da5a263-b3c7-49ba-b2e1-d54cbb5f0f0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Converting VIF {"id": "4da5a263-b3c7-49ba-b2e1-d54cbb5f0f0e", "address": "fa:16:3e:2d:65:73", "network": {"id": "8a3d7452-cadc-4728-a772-801d6a5c4770", "bridge": "br-int", "label": "tempest-device-tagging-net1-560176148", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46b2b924f3a4461ba09eb54ee42f4649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4da5a263-b3", "ovs_interfaceid": "4da5a263-b3c7-49ba-b2e1-d54cbb5f0f0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:65:73,bridge_name='br-int',has_traffic_filtering=True,id=4da5a263-b3c7-49ba-b2e1-d54cbb5f0f0e,network=Network(8a3d7452-cadc-4728-a772-801d6a5c4770),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4da5a263-b3') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG os_vif [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:65:73,bridge_name='br-int',has_traffic_filtering=True,id=4da5a263-b3c7-49ba-b2e1-d54cbb5f0f0e,network=Network(8a3d7452-cadc-4728-a772-801d6a5c4770),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4da5a263-b3') {{(pid=74337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4da5a263-b3, bridge=br-int, if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2c16d81e-7958-41c2-8ccb-8516bfcf6c71) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:44 user nova-compute[74337]: INFO os_vif [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:65:73,bridge_name='br-int',has_traffic_filtering=True,id=4da5a263-b3c7-49ba-b2e1-d54cbb5f0f0e,network=Network(8a3d7452-cadc-4728-a772-801d6a5c4770),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4da5a263-b3')
Oct 23 21:37:44 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T21:34:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-605341238',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-605341238',id=11,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKmnJ7mFnPC72zwxOhbZBqQQcw8wKcBQrJU/kXbtycxWGrYKWY4ryrk3P1/UrfZxJmArjpq8PnfjCzLxm5CSleEJWdCvoG6Fk25LMsRefGname4N0hV8zcfbkPovW5pJmA==',key_name='tempest-keypair-290861577',keypairs=<?>,launch_index=0,launched_at=2023-10-23T21:36:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='46b2b924f3a4461ba09eb54ee42f4649',ramdisk_id='',reservation_id='r-gnrgh800',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-66532269',owner_user_name='tempest-TaggedBootDevicesTest_v242-66532269-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T21:36:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fdc4cfd43887413eabd86770e724e2b8',uuid=04c02325-7ce4-45c2-819b-c656e93c96ca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d35e88b3-1ad6-42dc-9b9f-281cb0e99dc8", "address": "fa:16:3e:51:c9:d7", "network": {"id": "8a3d7452-cadc-4728-a772-801d6a5c4770", "bridge": "br-int", "label": "tempest-device-tagging-net1-560176148", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46b2b924f3a4461ba09eb54ee42f4649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd35e88b3-1a", "ovs_interfaceid": "d35e88b3-1ad6-42dc-9b9f-281cb0e99dc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Converting VIF {"id": "d35e88b3-1ad6-42dc-9b9f-281cb0e99dc8", "address": "fa:16:3e:51:c9:d7", "network": {"id": "8a3d7452-cadc-4728-a772-801d6a5c4770", "bridge": "br-int", "label": "tempest-device-tagging-net1-560176148", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46b2b924f3a4461ba09eb54ee42f4649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd35e88b3-1a", "ovs_interfaceid": "d35e88b3-1ad6-42dc-9b9f-281cb0e99dc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:c9:d7,bridge_name='br-int',has_traffic_filtering=True,id=d35e88b3-1ad6-42dc-9b9f-281cb0e99dc8,network=Network(8a3d7452-cadc-4728-a772-801d6a5c4770),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd35e88b3-1a') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG os_vif [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:c9:d7,bridge_name='br-int',has_traffic_filtering=True,id=d35e88b3-1ad6-42dc-9b9f-281cb0e99dc8,network=Network(8a3d7452-cadc-4728-a772-801d6a5c4770),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd35e88b3-1a') {{(pid=74337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd35e88b3-1a, bridge=br-int, if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=780f7271-391b-42f8-954f-5a45e32465cc) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:44 user nova-compute[74337]: INFO os_vif [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:c9:d7,bridge_name='br-int',has_traffic_filtering=True,id=d35e88b3-1ad6-42dc-9b9f-281cb0e99dc8,network=Network(8a3d7452-cadc-4728-a772-801d6a5c4770),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd35e88b3-1a')
Oct 23 21:37:44 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T21:34:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-605341238',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-605341238',id=11,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKmnJ7mFnPC72zwxOhbZBqQQcw8wKcBQrJU/kXbtycxWGrYKWY4ryrk3P1/UrfZxJmArjpq8PnfjCzLxm5CSleEJWdCvoG6Fk25LMsRefGname4N0hV8zcfbkPovW5pJmA==',key_name='tempest-keypair-290861577',keypairs=<?>,launch_index=0,launched_at=2023-10-23T21:36:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='46b2b924f3a4461ba09eb54ee42f4649',ramdisk_id='',reservation_id='r-gnrgh800',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-66532269',owner_user_name='tempest-TaggedBootDevicesTest_v242-66532269-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T21:36:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fdc4cfd43887413eabd86770e724e2b8',uuid=04c02325-7ce4-45c2-819b-c656e93c96ca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "78d439bc-58eb-4984-86f7-e9610cd8c17f", "address": "fa:16:3e:a3:26:2f", "network": {"id": "1f1cb866-1870-48d7-8866-ac73e71c8ef4", "bridge": "br-int", "label": "tempest-device-tagging-net2-663589537", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "46b2b924f3a4461ba09eb54ee42f4649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78d439bc-58", "ovs_interfaceid": "78d439bc-58eb-4984-86f7-e9610cd8c17f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Converting VIF {"id": "78d439bc-58eb-4984-86f7-e9610cd8c17f", "address": "fa:16:3e:a3:26:2f", "network": {"id": "1f1cb866-1870-48d7-8866-ac73e71c8ef4", "bridge": "br-int", "label": "tempest-device-tagging-net2-663589537", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "46b2b924f3a4461ba09eb54ee42f4649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78d439bc-58", "ovs_interfaceid": "78d439bc-58eb-4984-86f7-e9610cd8c17f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:26:2f,bridge_name='br-int',has_traffic_filtering=True,id=78d439bc-58eb-4984-86f7-e9610cd8c17f,network=Network(1f1cb866-1870-48d7-8866-ac73e71c8ef4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78d439bc-58') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG os_vif [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:26:2f,bridge_name='br-int',has_traffic_filtering=True,id=78d439bc-58eb-4984-86f7-e9610cd8c17f,network=Network(1f1cb866-1870-48d7-8866-ac73e71c8ef4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78d439bc-58') {{(pid=74337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap78d439bc-58, bridge=br-int, if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0eae635b-4789-4a14-bcb2-04e7ae0b678b) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG nova.compute.manager [req-9b2b3f49-ad74-4a34-a5ba-c0a2b9a46ac0 req-03d94350-7014-4b62-9317-915df3046ea4 service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Received event network-vif-plugged-2ea512c9-8ab6-49a3-9f77-14bcd380f8e8 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-9b2b3f49-ad74-4a34-a5ba-c0a2b9a46ac0 req-03d94350-7014-4b62-9317-915df3046ea4 service nova] Acquiring lock "04c02325-7ce4-45c2-819b-c656e93c96ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-9b2b3f49-ad74-4a34-a5ba-c0a2b9a46ac0 req-03d94350-7014-4b62-9317-915df3046ea4 service nova] Lock "04c02325-7ce4-45c2-819b-c656e93c96ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-9b2b3f49-ad74-4a34-a5ba-c0a2b9a46ac0 req-03d94350-7014-4b62-9317-915df3046ea4 service nova] Lock "04c02325-7ce4-45c2-819b-c656e93c96ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG nova.compute.manager [req-9b2b3f49-ad74-4a34-a5ba-c0a2b9a46ac0 req-03d94350-7014-4b62-9317-915df3046ea4 service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] No waiting events found dispatching network-vif-plugged-2ea512c9-8ab6-49a3-9f77-14bcd380f8e8 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:37:44 user nova-compute[74337]: WARNING nova.compute.manager [req-9b2b3f49-ad74-4a34-a5ba-c0a2b9a46ac0 req-03d94350-7014-4b62-9317-915df3046ea4 service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Received unexpected event network-vif-plugged-2ea512c9-8ab6-49a3-9f77-14bcd380f8e8 for instance with vm_state active and task_state deleting.
Oct 23 21:37:44 user nova-compute[74337]: DEBUG nova.compute.manager [req-9b2b3f49-ad74-4a34-a5ba-c0a2b9a46ac0 req-03d94350-7014-4b62-9317-915df3046ea4 service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Received event network-vif-unplugged-2727b3bf-35e4-485a-b44b-66406b7d1597 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-9b2b3f49-ad74-4a34-a5ba-c0a2b9a46ac0 req-03d94350-7014-4b62-9317-915df3046ea4 service nova] Acquiring lock "04c02325-7ce4-45c2-819b-c656e93c96ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-9b2b3f49-ad74-4a34-a5ba-c0a2b9a46ac0 req-03d94350-7014-4b62-9317-915df3046ea4 service nova] Lock "04c02325-7ce4-45c2-819b-c656e93c96ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-9b2b3f49-ad74-4a34-a5ba-c0a2b9a46ac0 req-03d94350-7014-4b62-9317-915df3046ea4 service nova] Lock "04c02325-7ce4-45c2-819b-c656e93c96ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG nova.compute.manager [req-9b2b3f49-ad74-4a34-a5ba-c0a2b9a46ac0 req-03d94350-7014-4b62-9317-915df3046ea4 service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] No waiting events found dispatching network-vif-unplugged-2727b3bf-35e4-485a-b44b-66406b7d1597 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG nova.compute.manager [req-9b2b3f49-ad74-4a34-a5ba-c0a2b9a46ac0 req-03d94350-7014-4b62-9317-915df3046ea4 service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Received event network-vif-unplugged-2727b3bf-35e4-485a-b44b-66406b7d1597 for instance with task_state deleting. {{(pid=74337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG nova.compute.manager [req-9b2b3f49-ad74-4a34-a5ba-c0a2b9a46ac0 req-03d94350-7014-4b62-9317-915df3046ea4 service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Received event network-vif-plugged-2727b3bf-35e4-485a-b44b-66406b7d1597 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-9b2b3f49-ad74-4a34-a5ba-c0a2b9a46ac0 req-03d94350-7014-4b62-9317-915df3046ea4 service nova] Acquiring lock "04c02325-7ce4-45c2-819b-c656e93c96ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-9b2b3f49-ad74-4a34-a5ba-c0a2b9a46ac0 req-03d94350-7014-4b62-9317-915df3046ea4 service nova] Lock "04c02325-7ce4-45c2-819b-c656e93c96ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-9b2b3f49-ad74-4a34-a5ba-c0a2b9a46ac0 req-03d94350-7014-4b62-9317-915df3046ea4 service nova] Lock "04c02325-7ce4-45c2-819b-c656e93c96ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG nova.compute.manager [req-9b2b3f49-ad74-4a34-a5ba-c0a2b9a46ac0 req-03d94350-7014-4b62-9317-915df3046ea4 service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] No waiting events found dispatching network-vif-plugged-2727b3bf-35e4-485a-b44b-66406b7d1597 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:37:44 user nova-compute[74337]: WARNING nova.compute.manager [req-9b2b3f49-ad74-4a34-a5ba-c0a2b9a46ac0 req-03d94350-7014-4b62-9317-915df3046ea4 service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Received unexpected event network-vif-plugged-2727b3bf-35e4-485a-b44b-66406b7d1597 for instance with vm_state active and task_state deleting.
Oct 23 21:37:44 user nova-compute[74337]: DEBUG nova.compute.manager [req-9b2b3f49-ad74-4a34-a5ba-c0a2b9a46ac0 req-03d94350-7014-4b62-9317-915df3046ea4 service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Received event network-vif-unplugged-9141d0eb-5e49-4a83-993f-3eac6a526dfd {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-9b2b3f49-ad74-4a34-a5ba-c0a2b9a46ac0 req-03d94350-7014-4b62-9317-915df3046ea4 service nova] Acquiring lock "04c02325-7ce4-45c2-819b-c656e93c96ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-9b2b3f49-ad74-4a34-a5ba-c0a2b9a46ac0 req-03d94350-7014-4b62-9317-915df3046ea4 service nova] Lock "04c02325-7ce4-45c2-819b-c656e93c96ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-9b2b3f49-ad74-4a34-a5ba-c0a2b9a46ac0 req-03d94350-7014-4b62-9317-915df3046ea4 service nova] Lock "04c02325-7ce4-45c2-819b-c656e93c96ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG nova.compute.manager [req-9b2b3f49-ad74-4a34-a5ba-c0a2b9a46ac0 req-03d94350-7014-4b62-9317-915df3046ea4 service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] No waiting events found dispatching network-vif-unplugged-9141d0eb-5e49-4a83-993f-3eac6a526dfd {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG nova.compute.manager [req-9b2b3f49-ad74-4a34-a5ba-c0a2b9a46ac0 req-03d94350-7014-4b62-9317-915df3046ea4 service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Received event network-vif-unplugged-9141d0eb-5e49-4a83-993f-3eac6a526dfd for instance with task_state deleting. {{(pid=74337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG nova.compute.manager [req-9b2b3f49-ad74-4a34-a5ba-c0a2b9a46ac0 req-03d94350-7014-4b62-9317-915df3046ea4 service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Received event network-vif-plugged-9141d0eb-5e49-4a83-993f-3eac6a526dfd {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-9b2b3f49-ad74-4a34-a5ba-c0a2b9a46ac0 req-03d94350-7014-4b62-9317-915df3046ea4 service nova] Acquiring lock "04c02325-7ce4-45c2-819b-c656e93c96ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-9b2b3f49-ad74-4a34-a5ba-c0a2b9a46ac0 req-03d94350-7014-4b62-9317-915df3046ea4 service nova] Lock "04c02325-7ce4-45c2-819b-c656e93c96ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-9b2b3f49-ad74-4a34-a5ba-c0a2b9a46ac0 req-03d94350-7014-4b62-9317-915df3046ea4 service nova] Lock "04c02325-7ce4-45c2-819b-c656e93c96ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG nova.compute.manager [req-9b2b3f49-ad74-4a34-a5ba-c0a2b9a46ac0 req-03d94350-7014-4b62-9317-915df3046ea4 service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] No waiting events found dispatching network-vif-plugged-9141d0eb-5e49-4a83-993f-3eac6a526dfd {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:37:44 user nova-compute[74337]: WARNING nova.compute.manager [req-9b2b3f49-ad74-4a34-a5ba-c0a2b9a46ac0 req-03d94350-7014-4b62-9317-915df3046ea4 service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Received unexpected event network-vif-plugged-9141d0eb-5e49-4a83-993f-3eac6a526dfd for instance with vm_state active and task_state deleting.
Oct 23 21:37:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:37:44 user nova-compute[74337]: INFO os_vif [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:26:2f,bridge_name='br-int',has_traffic_filtering=True,id=78d439bc-58eb-4984-86f7-e9610cd8c17f,network=Network(1f1cb866-1870-48d7-8866-ac73e71c8ef4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78d439bc-58')
Oct 23 21:37:44 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-23T21:34:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-605341238',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-605341238',id=11,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKmnJ7mFnPC72zwxOhbZBqQQcw8wKcBQrJU/kXbtycxWGrYKWY4ryrk3P1/UrfZxJmArjpq8PnfjCzLxm5CSleEJWdCvoG6Fk25LMsRefGname4N0hV8zcfbkPovW5pJmA==',key_name='tempest-keypair-290861577',keypairs=<?>,launch_index=0,launched_at=2023-10-23T21:36:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='46b2b924f3a4461ba09eb54ee42f4649',ramdisk_id='',reservation_id='r-gnrgh800',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-66532269',owner_user_name='tempest-TaggedBootDevicesTest_v242-66532269-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T21:36:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fdc4cfd43887413eabd86770e724e2b8',uuid=04c02325-7ce4-45c2-819b-c656e93c96ca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "870087f8-5e43-4e98-a6ab-b65529f9fa6b", "address": "fa:16:3e:96:be:1f", "network": {"id": "1f1cb866-1870-48d7-8866-ac73e71c8ef4", "bridge": "br-int", "label": "tempest-device-tagging-net2-663589537", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "46b2b924f3a4461ba09eb54ee42f4649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap870087f8-5e", "ovs_interfaceid": "870087f8-5e43-4e98-a6ab-b65529f9fa6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Converting VIF {"id": "870087f8-5e43-4e98-a6ab-b65529f9fa6b", "address": "fa:16:3e:96:be:1f", "network": {"id": "1f1cb866-1870-48d7-8866-ac73e71c8ef4", "bridge": "br-int", "label": "tempest-device-tagging-net2-663589537", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "46b2b924f3a4461ba09eb54ee42f4649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap870087f8-5e", "ovs_interfaceid": "870087f8-5e43-4e98-a6ab-b65529f9fa6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:be:1f,bridge_name='br-int',has_traffic_filtering=True,id=870087f8-5e43-4e98-a6ab-b65529f9fa6b,network=Network(1f1cb866-1870-48d7-8866-ac73e71c8ef4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap870087f8-5e') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG os_vif [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:be:1f,bridge_name='br-int',has_traffic_filtering=True,id=870087f8-5e43-4e98-a6ab-b65529f9fa6b,network=Network(1f1cb866-1870-48d7-8866-ac73e71c8ef4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap870087f8-5e') {{(pid=74337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap870087f8-5e, bridge=br-int, if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7ec1550b-bbb1-4f5b-bf0b-0fdd9c8c964f) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:44 user nova-compute[74337]: INFO os_vif [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:be:1f,bridge_name='br-int',has_traffic_filtering=True,id=870087f8-5e43-4e98-a6ab-b65529f9fa6b,network=Network(1f1cb866-1870-48d7-8866-ac73e71c8ef4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap870087f8-5e')
Oct 23 21:37:44 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] calling os-brick to detach iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, {'target_iqn': 'iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ohumOZdz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:37:44 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:37:44 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c25961d5-df9e-4939-a444-eb4ca2d2a233]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 21:37:44 user nova-compute[74337]: No targets found.
Oct 23 21:37:44 user nova-compute[74337]: iSNS:
Oct 23 21:37:44 user nova-compute[74337]: No targets found.
Oct 23 21:37:44 user nova-compute[74337]: STATIC:
Oct 23 21:37:44 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a
Oct 23 21:37:44 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:37:44 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:37:44 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661
Oct 23 21:37:44 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:37:44 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:37:44 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496
Oct 23 21:37:44 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:37:44 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:37:44 user nova-compute[74337]: FIRMWARE:
Oct 23 21:37:44 user nova-compute[74337]: No targets found.
Oct 23 21:37:44 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 21:37:44 user nova-compute[74337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 21:37:44 user nova-compute[74337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661', 0)] {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[df3886f5-d389-4c3e-9cc2-a8d41a0ecd0d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf6677b4-0b0e-4d7e-b7fd-576e1d48c597]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496 (non-flash)
Oct 23 21:37:44 user nova-compute[74337]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a (non-flash)
Oct 23 21:37:44 user nova-compute[74337]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661 (non-flash)
Oct 23 21:37:44 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496 (non-flash)
Oct 23 21:37:44 user nova-compute[74337]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a (non-flash)
Oct 23 21:37:44 user nova-compute[74337]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661 (non-flash)
Oct 23 21:37:44 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5eec2051b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661'): ({'sdh'}, set())}) {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Removing single pathed devices sdh {{(pid=74337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d54226-971f-4350-ab52-bd1fc2a86801]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.021s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e43a288f-a7a9-449f-ae8f-b750e93ab30a]: (4, ('ok\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Flushing IO for device /dev/sdh {{(pid=74337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d01a8762-5727-4350-9f35-0251cb6127ea]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.062s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c85041e-6dd6-4cc5-873d-ff69c203e0e4]: (4, ('1', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] SCSI volumes sdh have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661')] {{(pid=74337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f7e5af-a33b-4b1b-b31f-09d9420672c4]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661 -p 172.16.0.220:3260 --logout {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG nova.compute.manager [req-ba5a8c00-4fa6-4966-a48b-9af0244017d7 req-3dc6e0bf-3b4d-44ef-b505-67d1c2de0571 service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Received event network-vif-plugged-4da5a263-b3c7-49ba-b2e1-d54cbb5f0f0e {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ba5a8c00-4fa6-4966-a48b-9af0244017d7 req-3dc6e0bf-3b4d-44ef-b505-67d1c2de0571 service nova] Acquiring lock "04c02325-7ce4-45c2-819b-c656e93c96ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ba5a8c00-4fa6-4966-a48b-9af0244017d7 req-3dc6e0bf-3b4d-44ef-b505-67d1c2de0571 service nova] Lock "04c02325-7ce4-45c2-819b-c656e93c96ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ba5a8c00-4fa6-4966-a48b-9af0244017d7 req-3dc6e0bf-3b4d-44ef-b505-67d1c2de0571 service nova] Lock "04c02325-7ce4-45c2-819b-c656e93c96ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG nova.compute.manager [req-ba5a8c00-4fa6-4966-a48b-9af0244017d7 req-3dc6e0bf-3b4d-44ef-b505-67d1c2de0571 service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] No waiting events found dispatching network-vif-plugged-4da5a263-b3c7-49ba-b2e1-d54cbb5f0f0e {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:37:44 user nova-compute[74337]: WARNING nova.compute.manager [req-ba5a8c00-4fa6-4966-a48b-9af0244017d7 req-3dc6e0bf-3b4d-44ef-b505-67d1c2de0571 service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Received unexpected event network-vif-plugged-4da5a263-b3c7-49ba-b2e1-d54cbb5f0f0e for instance with vm_state active and task_state deleting.
Oct 23 21:37:44 user nova-compute[74337]: DEBUG nova.compute.manager [req-ba5a8c00-4fa6-4966-a48b-9af0244017d7 req-3dc6e0bf-3b4d-44ef-b505-67d1c2de0571 service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Received event network-vif-unplugged-78d439bc-58eb-4984-86f7-e9610cd8c17f {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ba5a8c00-4fa6-4966-a48b-9af0244017d7 req-3dc6e0bf-3b4d-44ef-b505-67d1c2de0571 service nova] Acquiring lock "04c02325-7ce4-45c2-819b-c656e93c96ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ba5a8c00-4fa6-4966-a48b-9af0244017d7 req-3dc6e0bf-3b4d-44ef-b505-67d1c2de0571 service nova] Lock "04c02325-7ce4-45c2-819b-c656e93c96ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ba5a8c00-4fa6-4966-a48b-9af0244017d7 req-3dc6e0bf-3b4d-44ef-b505-67d1c2de0571 service nova] Lock "04c02325-7ce4-45c2-819b-c656e93c96ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG nova.compute.manager [req-ba5a8c00-4fa6-4966-a48b-9af0244017d7 req-3dc6e0bf-3b4d-44ef-b505-67d1c2de0571 service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] No waiting events found dispatching network-vif-unplugged-78d439bc-58eb-4984-86f7-e9610cd8c17f {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG nova.compute.manager [req-ba5a8c00-4fa6-4966-a48b-9af0244017d7 req-3dc6e0bf-3b4d-44ef-b505-67d1c2de0571 service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Received event network-vif-unplugged-78d439bc-58eb-4984-86f7-e9610cd8c17f for instance with task_state deleting. {{(pid=74337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG nova.compute.manager [req-ba5a8c00-4fa6-4966-a48b-9af0244017d7 req-3dc6e0bf-3b4d-44ef-b505-67d1c2de0571 service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Received event network-vif-plugged-78d439bc-58eb-4984-86f7-e9610cd8c17f {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ba5a8c00-4fa6-4966-a48b-9af0244017d7 req-3dc6e0bf-3b4d-44ef-b505-67d1c2de0571 service nova] Acquiring lock "04c02325-7ce4-45c2-819b-c656e93c96ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ba5a8c00-4fa6-4966-a48b-9af0244017d7 req-3dc6e0bf-3b4d-44ef-b505-67d1c2de0571 service nova] Lock "04c02325-7ce4-45c2-819b-c656e93c96ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ba5a8c00-4fa6-4966-a48b-9af0244017d7 req-3dc6e0bf-3b4d-44ef-b505-67d1c2de0571 service nova] Lock "04c02325-7ce4-45c2-819b-c656e93c96ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG nova.compute.manager [req-ba5a8c00-4fa6-4966-a48b-9af0244017d7 req-3dc6e0bf-3b4d-44ef-b505-67d1c2de0571 service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] No waiting events found dispatching network-vif-plugged-78d439bc-58eb-4984-86f7-e9610cd8c17f {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:37:44 user nova-compute[74337]: WARNING nova.compute.manager [req-ba5a8c00-4fa6-4966-a48b-9af0244017d7 req-3dc6e0bf-3b4d-44ef-b505-67d1c2de0571 service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Received unexpected event network-vif-plugged-78d439bc-58eb-4984-86f7-e9610cd8c17f for instance with vm_state active and task_state deleting.
Oct 23 21:37:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2bb304e-68d9-464f-9b26-4f2bc01b6f33]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661, portal: 172.16.0.220,3260]
Oct 23 21:37:44 user nova-compute[74337]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661, portal: 172.16.0.220,3260] successful.
Oct 23 21:37:44 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661 -p 172.16.0.220:3260 --op delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0865a5a4-aa44-450e-8451-0d5e8b14f661 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd246fd-41d2-4b0e-a8ab-8f652f09d15b]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] <== disconnect_volume: return (337ms) None {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Disconnected iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] calling os-brick to detach iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, {'target_iqn': 'iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LxQKtqSs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:37:44 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:37:44 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e3031f-0c24-4d02-b17b-728db6cf10c2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 21:37:44 user nova-compute[74337]: No targets found.
Oct 23 21:37:44 user nova-compute[74337]: iSNS:
Oct 23 21:37:44 user nova-compute[74337]: No targets found.
Oct 23 21:37:44 user nova-compute[74337]: STATIC:
Oct 23 21:37:44 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a
Oct 23 21:37:44 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:37:44 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:37:44 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496
Oct 23 21:37:44 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:37:44 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:37:44 user nova-compute[74337]: FIRMWARE:
Oct 23 21:37:44 user nova-compute[74337]: No targets found.
Oct 23 21:37:44 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 21:37:44 user nova-compute[74337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 21:37:44 user nova-compute[74337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a', 0)] {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e771bf71-c2a0-48c3-9f8f-60262dd980f3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b285c5-b54e-4b00-8a94-7c2dec012bd1]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496 (non-flash)
Oct 23 21:37:44 user nova-compute[74337]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a (non-flash)
Oct 23 21:37:44 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496 (non-flash)
Oct 23 21:37:44 user nova-compute[74337]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a (non-flash)
Oct 23 21:37:44 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5eec206830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a'): ({'sdg'}, set())}) {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Removing single pathed devices sdg {{(pid=74337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[49087f0c-946d-4972-a7d0-060890fd9bd5]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c2cb42c-c302-4bc8-b54c-50dec83282c4]: (4, ('ok\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Flushing IO for device /dev/sdg {{(pid=74337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[178a9e70-91f1-47f6-b4ab-04a2c000259c]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.041s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d22bfa9c-5827-4e75-b7b0-fabf54536b89]: (4, ('1', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] SCSI volumes sdg have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a')] {{(pid=74337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG nova.compute.manager [req-bf173df8-882d-4adf-9906-206c7c226767 req-e4417fd8-caf5-4cd0-9c5e-e2dc1497a2a6 service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Received event network-vif-plugged-d35e88b3-1ad6-42dc-9b9f-281cb0e99dc8 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-bf173df8-882d-4adf-9906-206c7c226767 req-e4417fd8-caf5-4cd0-9c5e-e2dc1497a2a6 service nova] Acquiring lock "04c02325-7ce4-45c2-819b-c656e93c96ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-bf173df8-882d-4adf-9906-206c7c226767 req-e4417fd8-caf5-4cd0-9c5e-e2dc1497a2a6 service nova] Lock "04c02325-7ce4-45c2-819b-c656e93c96ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-bf173df8-882d-4adf-9906-206c7c226767 req-e4417fd8-caf5-4cd0-9c5e-e2dc1497a2a6 service nova] Lock "04c02325-7ce4-45c2-819b-c656e93c96ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG nova.compute.manager [req-bf173df8-882d-4adf-9906-206c7c226767 req-e4417fd8-caf5-4cd0-9c5e-e2dc1497a2a6 service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] No waiting events found dispatching network-vif-plugged-d35e88b3-1ad6-42dc-9b9f-281cb0e99dc8 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:37:44 user nova-compute[74337]: WARNING nova.compute.manager [req-bf173df8-882d-4adf-9906-206c7c226767 req-e4417fd8-caf5-4cd0-9c5e-e2dc1497a2a6 service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Received unexpected event network-vif-plugged-d35e88b3-1ad6-42dc-9b9f-281cb0e99dc8 for instance with vm_state active and task_state deleting.
Oct 23 21:37:44 user nova-compute[74337]: DEBUG nova.compute.manager [req-bf173df8-882d-4adf-9906-206c7c226767 req-e4417fd8-caf5-4cd0-9c5e-e2dc1497a2a6 service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Received event network-vif-unplugged-870087f8-5e43-4e98-a6ab-b65529f9fa6b {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-bf173df8-882d-4adf-9906-206c7c226767 req-e4417fd8-caf5-4cd0-9c5e-e2dc1497a2a6 service nova] Acquiring lock "04c02325-7ce4-45c2-819b-c656e93c96ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-bf173df8-882d-4adf-9906-206c7c226767 req-e4417fd8-caf5-4cd0-9c5e-e2dc1497a2a6 service nova] Lock "04c02325-7ce4-45c2-819b-c656e93c96ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-bf173df8-882d-4adf-9906-206c7c226767 req-e4417fd8-caf5-4cd0-9c5e-e2dc1497a2a6 service nova] Lock "04c02325-7ce4-45c2-819b-c656e93c96ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG nova.compute.manager [req-bf173df8-882d-4adf-9906-206c7c226767 req-e4417fd8-caf5-4cd0-9c5e-e2dc1497a2a6 service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] No waiting events found dispatching network-vif-unplugged-870087f8-5e43-4e98-a6ab-b65529f9fa6b {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG nova.compute.manager [req-bf173df8-882d-4adf-9906-206c7c226767 req-e4417fd8-caf5-4cd0-9c5e-e2dc1497a2a6 service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Received event network-vif-unplugged-870087f8-5e43-4e98-a6ab-b65529f9fa6b for instance with task_state deleting. {{(pid=74337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG nova.compute.manager [req-bf173df8-882d-4adf-9906-206c7c226767 req-e4417fd8-caf5-4cd0-9c5e-e2dc1497a2a6 service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Received event network-vif-plugged-870087f8-5e43-4e98-a6ab-b65529f9fa6b {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-bf173df8-882d-4adf-9906-206c7c226767 req-e4417fd8-caf5-4cd0-9c5e-e2dc1497a2a6 service nova] Acquiring lock "04c02325-7ce4-45c2-819b-c656e93c96ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-bf173df8-882d-4adf-9906-206c7c226767 req-e4417fd8-caf5-4cd0-9c5e-e2dc1497a2a6 service nova] Lock "04c02325-7ce4-45c2-819b-c656e93c96ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-bf173df8-882d-4adf-9906-206c7c226767 req-e4417fd8-caf5-4cd0-9c5e-e2dc1497a2a6 service nova] Lock "04c02325-7ce4-45c2-819b-c656e93c96ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG nova.compute.manager [req-bf173df8-882d-4adf-9906-206c7c226767 req-e4417fd8-caf5-4cd0-9c5e-e2dc1497a2a6 service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] No waiting events found dispatching network-vif-plugged-870087f8-5e43-4e98-a6ab-b65529f9fa6b {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:37:44 user nova-compute[74337]: WARNING nova.compute.manager [req-bf173df8-882d-4adf-9906-206c7c226767 req-e4417fd8-caf5-4cd0-9c5e-e2dc1497a2a6 service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Received unexpected event network-vif-plugged-870087f8-5e43-4e98-a6ab-b65529f9fa6b for instance with vm_state active and task_state deleting.
Oct 23 21:37:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[96fdfbc6-fbfe-4ba6-b0af-7c102c5311d1]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:37:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a -p 172.16.0.220:3260 --logout {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:45 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad6367b4-db16-43ca-bf07-df5f79156805]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a, portal: 172.16.0.220,3260]
Oct 23 21:37:45 user nova-compute[74337]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a, portal: 172.16.0.220,3260] successful.
Oct 23 21:37:45 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:37:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a -p 172.16.0.220:3260 --op delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64864579-6ad1-4796-a620-c2c1ee8a702a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:45 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0cf58d0-8cce-4ff0-8d50-3158e5832e56]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:37:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:37:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] <== disconnect_volume: return (324ms) None {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:37:45 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Disconnected iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 21:37:45 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] calling os-brick to detach iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 21:37:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, {'target_iqn': 'iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ROKFtlJc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': True}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:37:45 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:37:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:37:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:37:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:45 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e008ba6-8093-4c8f-909a-ffe9538f8880]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 21:37:45 user nova-compute[74337]: No targets found.
Oct 23 21:37:45 user nova-compute[74337]: iSNS:
Oct 23 21:37:45 user nova-compute[74337]: No targets found.
Oct 23 21:37:45 user nova-compute[74337]: STATIC:
Oct 23 21:37:45 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496
Oct 23 21:37:45 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:37:45 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:37:45 user nova-compute[74337]: FIRMWARE:
Oct 23 21:37:45 user nova-compute[74337]: No targets found.
Oct 23 21:37:45 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:37:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 21:37:45 user nova-compute[74337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 21:37:45 user nova-compute[74337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 21:37:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496', 0)] {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 21:37:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:45 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aebd6aa-99bf-4626-97f9-ac4849b477a9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:45 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c08f5cc4-0a3e-4d30-a1f2-d762cd4eeadf]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496 (non-flash)
Oct 23 21:37:45 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:37:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496 (non-flash)
Oct 23 21:37:45 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:37:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5eec206830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496'): ({'sdj'}, set())}) {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 21:37:45 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Removing single pathed devices sdj {{(pid=74337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 21:37:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:45 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d591273f-f4f9-4fd1-8400-10487776787f]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.022s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:45 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[187358eb-33d5-474d-ab42-a4959bdc4993]: (4, ('ok\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:45 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Flushing IO for device /dev/sdj {{(pid=74337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 21:37:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.013s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:45 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[3774e26f-6feb-4493-9fce-d46722f3c53b]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:45 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=74337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 21:37:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.037s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:45 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4dba332-ca51-473f-87b4-c98d7355f2f9]: (4, ('1', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:45 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 21:37:45 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] SCSI volumes sdj have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 21:37:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496')] {{(pid=74337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 21:37:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:45 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c96ab15f-e341-4a12-ace5-9fee5a5eea2d]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:37:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496 -p 172.16.0.220:3260 --logout {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:45 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[56882532-d0f1-439a-a644-e7ccfb1d84d8]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496, portal: 172.16.0.220,3260]
Oct 23 21:37:45 user nova-compute[74337]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496, portal: 172.16.0.220,3260] successful.
Oct 23 21:37:45 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:37:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496 -p 172.16.0.220:3260 --op delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:37:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8aea79a-53dd-4442-8470-dc68c6351496 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:37:45 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a8b36d9-b7ce-4a7d-8b03-f246bcfc0175]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:37:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:37:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:37:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] <== disconnect_volume: return (294ms) None {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:37:45 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Disconnected iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 21:37:45 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Deleting instance files /opt/stack/data/nova/instances/04c02325-7ce4-45c2-819b-c656e93c96ca_del
Oct 23 21:37:45 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Deletion of /opt/stack/data/nova/instances/04c02325-7ce4-45c2-819b-c656e93c96ca_del complete
Oct 23 21:37:45 user nova-compute[74337]: INFO nova.compute.manager [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Took 3.63 seconds to destroy the instance on the hypervisor.
Oct 23 21:37:45 user nova-compute[74337]: DEBUG oslo.service.loopingcall [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74337) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 21:37:45 user nova-compute[74337]: DEBUG nova.compute.manager [-] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Deallocating network for instance {{(pid=74337) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 21:37:45 user nova-compute[74337]: DEBUG nova.network.neutron [-] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] deallocate_for_instance() {{(pid=74337) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 21:37:47 user nova-compute[74337]: DEBUG nova.compute.manager [req-4ba9da36-c914-413c-9107-b6ba0a90bd1e req-23820c75-ac3d-46c5-9520-ee597850d64b service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Received event network-vif-deleted-4da5a263-b3c7-49ba-b2e1-d54cbb5f0f0e {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:37:47 user nova-compute[74337]: INFO nova.compute.manager [req-4ba9da36-c914-413c-9107-b6ba0a90bd1e req-23820c75-ac3d-46c5-9520-ee597850d64b service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Neutron deleted interface 4da5a263-b3c7-49ba-b2e1-d54cbb5f0f0e; detaching it from the instance and deleting it from the info cache
Oct 23 21:37:47 user nova-compute[74337]: DEBUG nova.network.neutron [req-4ba9da36-c914-413c-9107-b6ba0a90bd1e req-23820c75-ac3d-46c5-9520-ee597850d64b service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Updating instance_info_cache with network_info: [{"id": "2ea512c9-8ab6-49a3-9f77-14bcd380f8e8", "address": "fa:16:3e:75:d8:7f", "network": {"id": "e5fd79cb-72f1-4d32-a604-b9518e375fcd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-840255736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46b2b924f3a4461ba09eb54ee42f4649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ea512c9-8a", "ovs_interfaceid": "2ea512c9-8ab6-49a3-9f77-14bcd380f8e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2727b3bf-35e4-485a-b44b-66406b7d1597", "address": "fa:16:3e:e2:6e:58", "network": {"id": "8a3d7452-cadc-4728-a772-801d6a5c4770", "bridge": "br-int", "label": "tempest-device-tagging-net1-560176148", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46b2b924f3a4461ba09eb54ee42f4649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2727b3bf-35", "ovs_interfaceid": "2727b3bf-35e4-485a-b44b-66406b7d1597", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9141d0eb-5e49-4a83-993f-3eac6a526dfd", "address": "fa:16:3e:1f:61:c0", "network": {"id": "8a3d7452-cadc-4728-a772-801d6a5c4770", "bridge": "br-int", "label": "tempest-device-tagging-net1-560176148", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46b2b924f3a4461ba09eb54ee42f4649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9141d0eb-5e", "ovs_interfaceid": "9141d0eb-5e49-4a83-993f-3eac6a526dfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d35e88b3-1ad6-42dc-9b9f-281cb0e99dc8", "address": "fa:16:3e:51:c9:d7", "network": {"id": "8a3d7452-cadc-4728-a772-801d6a5c4770", "bridge": "br-int", "label": "tempest-device-tagging-net1-560176148", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46b2b924f3a4461ba09eb54ee42f4649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd35e88b3-1a", "ovs_interfaceid": "d35e88b3-1ad6-42dc-9b9f-281cb0e99dc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "78d439bc-58eb-4984-86f7-e9610cd8c17f", "address": "fa:16:3e:a3:26:2f", "network": {"id": "1f1cb866-1870-48d7-8866-ac73e71c8ef4", "bridge": "br-int", "label": "tempest-device-tagging-net2-663589537", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "46b2b924f3a4461ba09eb54ee42f4649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78d439bc-58", "ovs_interfaceid": "78d439bc-58eb-4984-86f7-e9610cd8c17f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "870087f8-5e43-4e98-a6ab-b65529f9fa6b", "address": "fa:16:3e:96:be:1f", "network": {"id": "1f1cb866-1870-48d7-8866-ac73e71c8ef4", "bridge": "br-int", "label": "tempest-device-tagging-net2-663589537", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "46b2b924f3a4461ba09eb54ee42f4649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap870087f8-5e", "ovs_interfaceid": "870087f8-5e43-4e98-a6ab-b65529f9fa6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:37:47 user nova-compute[74337]: DEBUG nova.compute.manager [req-4ba9da36-c914-413c-9107-b6ba0a90bd1e req-23820c75-ac3d-46c5-9520-ee597850d64b service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Detach interface failed, port_id=4da5a263-b3c7-49ba-b2e1-d54cbb5f0f0e, reason: Instance 04c02325-7ce4-45c2-819b-c656e93c96ca could not be found. {{(pid=74337) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 23 21:37:48 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:48 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-da6601b9-c306-4710-9ac6-f757c3e57099 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] Acquiring lock "a4bf4723-1e3c-42f1-a422-9d9263b67e3d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:37:48 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-da6601b9-c306-4710-9ac6-f757c3e57099 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] Lock "a4bf4723-1e3c-42f1-a422-9d9263b67e3d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:37:48 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-da6601b9-c306-4710-9ac6-f757c3e57099 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] Acquiring lock "a4bf4723-1e3c-42f1-a422-9d9263b67e3d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:37:48 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-da6601b9-c306-4710-9ac6-f757c3e57099 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] Lock "a4bf4723-1e3c-42f1-a422-9d9263b67e3d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:37:48 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-da6601b9-c306-4710-9ac6-f757c3e57099 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] Lock "a4bf4723-1e3c-42f1-a422-9d9263b67e3d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:37:48 user nova-compute[74337]: INFO nova.compute.manager [None req-da6601b9-c306-4710-9ac6-f757c3e57099 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d] Terminating instance
Oct 23 21:37:48 user nova-compute[74337]: DEBUG nova.compute.manager [None req-da6601b9-c306-4710-9ac6-f757c3e57099 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d] Start destroying the instance on the hypervisor. {{(pid=74337) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 21:37:48 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:48 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:49 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:49 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:49 user nova-compute[74337]: DEBUG nova.compute.manager [req-d252fa01-bbe3-449a-9c73-79e349ac5212 req-e02c1e8a-b21c-436f-b859-2961270a8242 service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Received event network-vif-deleted-78d439bc-58eb-4984-86f7-e9610cd8c17f {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:37:49 user nova-compute[74337]: INFO nova.compute.manager [req-d252fa01-bbe3-449a-9c73-79e349ac5212 req-e02c1e8a-b21c-436f-b859-2961270a8242 service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Neutron deleted interface 78d439bc-58eb-4984-86f7-e9610cd8c17f; detaching it from the instance and deleting it from the info cache
Oct 23 21:37:49 user nova-compute[74337]: DEBUG nova.network.neutron [req-d252fa01-bbe3-449a-9c73-79e349ac5212 req-e02c1e8a-b21c-436f-b859-2961270a8242 service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Updating instance_info_cache with network_info: [{"id": "2ea512c9-8ab6-49a3-9f77-14bcd380f8e8", "address": "fa:16:3e:75:d8:7f", "network": {"id": "e5fd79cb-72f1-4d32-a604-b9518e375fcd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-840255736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46b2b924f3a4461ba09eb54ee42f4649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ea512c9-8a", "ovs_interfaceid": "2ea512c9-8ab6-49a3-9f77-14bcd380f8e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2727b3bf-35e4-485a-b44b-66406b7d1597", "address": "fa:16:3e:e2:6e:58", "network": {"id": "8a3d7452-cadc-4728-a772-801d6a5c4770", "bridge": "br-int", "label": "tempest-device-tagging-net1-560176148", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46b2b924f3a4461ba09eb54ee42f4649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2727b3bf-35", "ovs_interfaceid": "2727b3bf-35e4-485a-b44b-66406b7d1597", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9141d0eb-5e49-4a83-993f-3eac6a526dfd", "address": "fa:16:3e:1f:61:c0", "network": {"id": "8a3d7452-cadc-4728-a772-801d6a5c4770", "bridge": "br-int", "label": "tempest-device-tagging-net1-560176148", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46b2b924f3a4461ba09eb54ee42f4649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9141d0eb-5e", "ovs_interfaceid": "9141d0eb-5e49-4a83-993f-3eac6a526dfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d35e88b3-1ad6-42dc-9b9f-281cb0e99dc8", "address": "fa:16:3e:51:c9:d7", "network": {"id": "8a3d7452-cadc-4728-a772-801d6a5c4770", "bridge": "br-int", "label": "tempest-device-tagging-net1-560176148", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46b2b924f3a4461ba09eb54ee42f4649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd35e88b3-1a", "ovs_interfaceid": "d35e88b3-1ad6-42dc-9b9f-281cb0e99dc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "870087f8-5e43-4e98-a6ab-b65529f9fa6b", "address": "fa:16:3e:96:be:1f", "network": {"id": "1f1cb866-1870-48d7-8866-ac73e71c8ef4", "bridge": "br-int", "label": "tempest-device-tagging-net2-663589537", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "46b2b924f3a4461ba09eb54ee42f4649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap870087f8-5e", "ovs_interfaceid": "870087f8-5e43-4e98-a6ab-b65529f9fa6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:37:49 user nova-compute[74337]: DEBUG nova.compute.manager [req-d252fa01-bbe3-449a-9c73-79e349ac5212 req-e02c1e8a-b21c-436f-b859-2961270a8242 service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Detach interface failed, port_id=78d439bc-58eb-4984-86f7-e9610cd8c17f, reason: Instance 04c02325-7ce4-45c2-819b-c656e93c96ca could not be found. {{(pid=74337) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 23 21:37:49 user nova-compute[74337]: DEBUG nova.compute.manager [req-d252fa01-bbe3-449a-9c73-79e349ac5212 req-e02c1e8a-b21c-436f-b859-2961270a8242 service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Received event network-vif-deleted-870087f8-5e43-4e98-a6ab-b65529f9fa6b {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:37:49 user nova-compute[74337]: INFO nova.compute.manager [req-d252fa01-bbe3-449a-9c73-79e349ac5212 req-e02c1e8a-b21c-436f-b859-2961270a8242 service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Neutron deleted interface 870087f8-5e43-4e98-a6ab-b65529f9fa6b; detaching it from the instance and deleting it from the info cache
Oct 23 21:37:49 user nova-compute[74337]: DEBUG nova.network.neutron [req-d252fa01-bbe3-449a-9c73-79e349ac5212 req-e02c1e8a-b21c-436f-b859-2961270a8242 service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Updating instance_info_cache with network_info: [{"id": "2ea512c9-8ab6-49a3-9f77-14bcd380f8e8", "address": "fa:16:3e:75:d8:7f", "network": {"id": "e5fd79cb-72f1-4d32-a604-b9518e375fcd", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-840255736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46b2b924f3a4461ba09eb54ee42f4649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ea512c9-8a", "ovs_interfaceid": "2ea512c9-8ab6-49a3-9f77-14bcd380f8e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2727b3bf-35e4-485a-b44b-66406b7d1597", "address": "fa:16:3e:e2:6e:58", "network": {"id": "8a3d7452-cadc-4728-a772-801d6a5c4770", "bridge": "br-int", "label": "tempest-device-tagging-net1-560176148", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46b2b924f3a4461ba09eb54ee42f4649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2727b3bf-35", "ovs_interfaceid": "2727b3bf-35e4-485a-b44b-66406b7d1597", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9141d0eb-5e49-4a83-993f-3eac6a526dfd", "address": "fa:16:3e:1f:61:c0", "network": {"id": "8a3d7452-cadc-4728-a772-801d6a5c4770", "bridge": "br-int", "label": "tempest-device-tagging-net1-560176148", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46b2b924f3a4461ba09eb54ee42f4649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9141d0eb-5e", "ovs_interfaceid": "9141d0eb-5e49-4a83-993f-3eac6a526dfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d35e88b3-1ad6-42dc-9b9f-281cb0e99dc8", "address": "fa:16:3e:51:c9:d7", "network": {"id": "8a3d7452-cadc-4728-a772-801d6a5c4770", "bridge": "br-int", "label": "tempest-device-tagging-net1-560176148", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46b2b924f3a4461ba09eb54ee42f4649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd35e88b3-1a", "ovs_interfaceid": "d35e88b3-1ad6-42dc-9b9f-281cb0e99dc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:37:49 user nova-compute[74337]: DEBUG nova.compute.manager [req-d252fa01-bbe3-449a-9c73-79e349ac5212 req-e02c1e8a-b21c-436f-b859-2961270a8242 service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Detach interface failed, port_id=870087f8-5e43-4e98-a6ab-b65529f9fa6b, reason: Instance 04c02325-7ce4-45c2-819b-c656e93c96ca could not be found. {{(pid=74337) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 23 21:37:49 user nova-compute[74337]: DEBUG nova.compute.manager [req-d252fa01-bbe3-449a-9c73-79e349ac5212 req-e02c1e8a-b21c-436f-b859-2961270a8242 service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Received event network-vif-deleted-2ea512c9-8ab6-49a3-9f77-14bcd380f8e8 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:37:49 user nova-compute[74337]: INFO nova.compute.manager [req-d252fa01-bbe3-449a-9c73-79e349ac5212 req-e02c1e8a-b21c-436f-b859-2961270a8242 service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Neutron deleted interface 2ea512c9-8ab6-49a3-9f77-14bcd380f8e8; detaching it from the instance and deleting it from the info cache
Oct 23 21:37:49 user nova-compute[74337]: DEBUG nova.network.neutron [req-d252fa01-bbe3-449a-9c73-79e349ac5212 req-e02c1e8a-b21c-436f-b859-2961270a8242 service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Updating instance_info_cache with network_info: [{"id": "2727b3bf-35e4-485a-b44b-66406b7d1597", "address": "fa:16:3e:e2:6e:58", "network": {"id": "8a3d7452-cadc-4728-a772-801d6a5c4770", "bridge": "br-int", "label": "tempest-device-tagging-net1-560176148", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46b2b924f3a4461ba09eb54ee42f4649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2727b3bf-35", "ovs_interfaceid": "2727b3bf-35e4-485a-b44b-66406b7d1597", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9141d0eb-5e49-4a83-993f-3eac6a526dfd", "address": "fa:16:3e:1f:61:c0", "network": {"id": "8a3d7452-cadc-4728-a772-801d6a5c4770", "bridge": "br-int", "label": "tempest-device-tagging-net1-560176148", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.42", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46b2b924f3a4461ba09eb54ee42f4649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9141d0eb-5e", "ovs_interfaceid": "9141d0eb-5e49-4a83-993f-3eac6a526dfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d35e88b3-1ad6-42dc-9b9f-281cb0e99dc8", "address": "fa:16:3e:51:c9:d7", "network": {"id": "8a3d7452-cadc-4728-a772-801d6a5c4770", "bridge": "br-int", "label": "tempest-device-tagging-net1-560176148", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "46b2b924f3a4461ba09eb54ee42f4649", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd35e88b3-1a", "ovs_interfaceid": "d35e88b3-1ad6-42dc-9b9f-281cb0e99dc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:37:49 user nova-compute[74337]: DEBUG nova.network.neutron [-] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Updating instance_info_cache with network_info: [] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:37:49 user nova-compute[74337]: DEBUG nova.compute.manager [req-d252fa01-bbe3-449a-9c73-79e349ac5212 req-e02c1e8a-b21c-436f-b859-2961270a8242 service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Detach interface failed, port_id=2ea512c9-8ab6-49a3-9f77-14bcd380f8e8, reason: Instance 04c02325-7ce4-45c2-819b-c656e93c96ca could not be found. {{(pid=74337) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 23 21:37:49 user nova-compute[74337]: INFO nova.compute.manager [-] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Took 3.77 seconds to deallocate network for instance.
Oct 23 21:37:49 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:49 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d] Instance destroyed successfully.
Oct 23 21:37:49 user nova-compute[74337]: DEBUG nova.objects.instance [None req-da6601b9-c306-4710-9ac6-f757c3e57099 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] Lazy-loading 'resources' on Instance uuid a4bf4723-1e3c-42f1-a422-9d9263b67e3d {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:37:49 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-da6601b9-c306-4710-9ac6-f757c3e57099 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:33:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-995477550',display_name='tempest-VolumesAssistedSnapshotsTest-server-995477550',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-995477550',id=8,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEgBDDuYXZW2aYihqShoj0FXXa/1O08PJI4TzEf9/aP4s5NHc//IUQnF9Y190W0c2EksTAQFuo+XTjlJen+Ckm046QwtwrYyecO5pMhjzxLm/NYwKKvFPbJ5lQYpFnzPIw==',key_name='tempest-keypair-498850097',keypairs=<?>,launch_index=0,launched_at=2023-10-23T21:33:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='85815ae529d347c48efe797a4722025d',ramdisk_id='',reservation_id='r-q9erkyb5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-750224046',owner_user_name='tempest-VolumesAssistedSnapshotsTest-750224046-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T21:33:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='800fabf8cbf54e2daf153736c1ff3614',uuid=a4bf4723-1e3c-42f1-a422-9d9263b67e3d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "36e0b911-4cb9-4b24-bcb2-e44022f7f3d4", "address": "fa:16:3e:9f:d4:56", "network": {"id": "0891479c-8d7d-4e74-be06-51d2ecbcdef8", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1955051047-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85815ae529d347c48efe797a4722025d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36e0b911-4c", "ovs_interfaceid": "36e0b911-4cb9-4b24-bcb2-e44022f7f3d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 21:37:49 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-da6601b9-c306-4710-9ac6-f757c3e57099 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] Converting VIF {"id": "36e0b911-4cb9-4b24-bcb2-e44022f7f3d4", "address": "fa:16:3e:9f:d4:56", "network": {"id": "0891479c-8d7d-4e74-be06-51d2ecbcdef8", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1955051047-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85815ae529d347c48efe797a4722025d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36e0b911-4c", "ovs_interfaceid": "36e0b911-4cb9-4b24-bcb2-e44022f7f3d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:37:49 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-da6601b9-c306-4710-9ac6-f757c3e57099 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9f:d4:56,bridge_name='br-int',has_traffic_filtering=True,id=36e0b911-4cb9-4b24-bcb2-e44022f7f3d4,network=Network(0891479c-8d7d-4e74-be06-51d2ecbcdef8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36e0b911-4c') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:37:49 user nova-compute[74337]: DEBUG os_vif [None req-da6601b9-c306-4710-9ac6-f757c3e57099 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9f:d4:56,bridge_name='br-int',has_traffic_filtering=True,id=36e0b911-4cb9-4b24-bcb2-e44022f7f3d4,network=Network(0891479c-8d7d-4e74-be06-51d2ecbcdef8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36e0b911-4c') {{(pid=74337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 21:37:49 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:49 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap36e0b911-4c, bridge=br-int, if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:37:49 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:49 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:37:49 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:49 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=78674944-df6d-4410-9743-c5347be2f872) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:37:49 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:49 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:37:49 user nova-compute[74337]: INFO os_vif [None req-da6601b9-c306-4710-9ac6-f757c3e57099 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9f:d4:56,bridge_name='br-int',has_traffic_filtering=True,id=36e0b911-4cb9-4b24-bcb2-e44022f7f3d4,network=Network(0891479c-8d7d-4e74-be06-51d2ecbcdef8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36e0b911-4c')
Oct 23 21:37:49 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-da6601b9-c306-4710-9ac6-f757c3e57099 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d] Deleting instance files /opt/stack/data/nova/instances/a4bf4723-1e3c-42f1-a422-9d9263b67e3d_del
Oct 23 21:37:49 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-da6601b9-c306-4710-9ac6-f757c3e57099 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d] Deletion of /opt/stack/data/nova/instances/a4bf4723-1e3c-42f1-a422-9d9263b67e3d_del complete
Oct 23 21:37:49 user nova-compute[74337]: INFO nova.compute.manager [None req-da6601b9-c306-4710-9ac6-f757c3e57099 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d] Took 0.87 seconds to destroy the instance on the hypervisor.
Oct 23 21:37:49 user nova-compute[74337]: DEBUG oslo.service.loopingcall [None req-da6601b9-c306-4710-9ac6-f757c3e57099 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74337) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 21:37:49 user nova-compute[74337]: DEBUG nova.compute.manager [-] [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d] Deallocating network for instance {{(pid=74337) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 21:37:49 user nova-compute[74337]: DEBUG nova.network.neutron [-] [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d] deallocate_for_instance() {{(pid=74337) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 21:37:50 user nova-compute[74337]: DEBUG nova.network.neutron [-] [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d] Updating instance_info_cache with network_info: [] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:37:50 user nova-compute[74337]: INFO nova.compute.manager [-] [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d] Took 0.74 seconds to deallocate network for instance.
Oct 23 21:37:50 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-da6601b9-c306-4710-9ac6-f757c3e57099 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:37:50 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-da6601b9-c306-4710-9ac6-f757c3e57099 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:37:50 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-da6601b9-c306-4710-9ac6-f757c3e57099 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:37:50 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-da6601b9-c306-4710-9ac6-f757c3e57099 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:37:50 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-da6601b9-c306-4710-9ac6-f757c3e57099 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.313s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:37:50 user nova-compute[74337]: INFO nova.scheduler.client.report [None req-da6601b9-c306-4710-9ac6-f757c3e57099 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] Deleted allocations for instance a4bf4723-1e3c-42f1-a422-9d9263b67e3d
Oct 23 21:37:50 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-da6601b9-c306-4710-9ac6-f757c3e57099 tempest-VolumesAssistedSnapshotsTest-750224046 tempest-VolumesAssistedSnapshotsTest-750224046-project-member] Lock "a4bf4723-1e3c-42f1-a422-9d9263b67e3d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.117s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:37:51 user nova-compute[74337]: DEBUG nova.compute.manager [req-56cc75f1-3262-4a20-bd2d-617f667eb628 req-a713e2ad-4d14-4bdd-8d60-3b26c4ee9f70 service nova] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Received event network-vif-deleted-d35e88b3-1ad6-42dc-9b9f-281cb0e99dc8 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:37:51 user nova-compute[74337]: DEBUG nova.compute.manager [req-56cc75f1-3262-4a20-bd2d-617f667eb628 req-a713e2ad-4d14-4bdd-8d60-3b26c4ee9f70 service nova] [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d] Received event network-vif-unplugged-36e0b911-4cb9-4b24-bcb2-e44022f7f3d4 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:37:51 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-56cc75f1-3262-4a20-bd2d-617f667eb628 req-a713e2ad-4d14-4bdd-8d60-3b26c4ee9f70 service nova] Acquiring lock "a4bf4723-1e3c-42f1-a422-9d9263b67e3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:37:51 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-56cc75f1-3262-4a20-bd2d-617f667eb628 req-a713e2ad-4d14-4bdd-8d60-3b26c4ee9f70 service nova] Lock "a4bf4723-1e3c-42f1-a422-9d9263b67e3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:37:51 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-56cc75f1-3262-4a20-bd2d-617f667eb628 req-a713e2ad-4d14-4bdd-8d60-3b26c4ee9f70 service nova] Lock "a4bf4723-1e3c-42f1-a422-9d9263b67e3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:37:51 user nova-compute[74337]: DEBUG nova.compute.manager [req-56cc75f1-3262-4a20-bd2d-617f667eb628 req-a713e2ad-4d14-4bdd-8d60-3b26c4ee9f70 service nova] [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d] No waiting events found dispatching network-vif-unplugged-36e0b911-4cb9-4b24-bcb2-e44022f7f3d4 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:37:51 user nova-compute[74337]: WARNING nova.compute.manager [req-56cc75f1-3262-4a20-bd2d-617f667eb628 req-a713e2ad-4d14-4bdd-8d60-3b26c4ee9f70 service nova] [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d] Received unexpected event network-vif-unplugged-36e0b911-4cb9-4b24-bcb2-e44022f7f3d4 for instance with vm_state deleted and task_state None.
Oct 23 21:37:51 user nova-compute[74337]: DEBUG nova.compute.manager [req-56cc75f1-3262-4a20-bd2d-617f667eb628 req-a713e2ad-4d14-4bdd-8d60-3b26c4ee9f70 service nova] [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d] Received event network-vif-plugged-36e0b911-4cb9-4b24-bcb2-e44022f7f3d4 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:37:51 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-56cc75f1-3262-4a20-bd2d-617f667eb628 req-a713e2ad-4d14-4bdd-8d60-3b26c4ee9f70 service nova] Acquiring lock "a4bf4723-1e3c-42f1-a422-9d9263b67e3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:37:51 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-56cc75f1-3262-4a20-bd2d-617f667eb628 req-a713e2ad-4d14-4bdd-8d60-3b26c4ee9f70 service nova] Lock "a4bf4723-1e3c-42f1-a422-9d9263b67e3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:37:51 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-56cc75f1-3262-4a20-bd2d-617f667eb628 req-a713e2ad-4d14-4bdd-8d60-3b26c4ee9f70 service nova] Lock "a4bf4723-1e3c-42f1-a422-9d9263b67e3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:37:51 user nova-compute[74337]: DEBUG nova.compute.manager [req-56cc75f1-3262-4a20-bd2d-617f667eb628 req-a713e2ad-4d14-4bdd-8d60-3b26c4ee9f70 service nova] [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d] No waiting events found dispatching network-vif-plugged-36e0b911-4cb9-4b24-bcb2-e44022f7f3d4 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:37:51 user nova-compute[74337]: WARNING nova.compute.manager [req-56cc75f1-3262-4a20-bd2d-617f667eb628 req-a713e2ad-4d14-4bdd-8d60-3b26c4ee9f70 service nova] [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d] Received unexpected event network-vif-plugged-36e0b911-4cb9-4b24-bcb2-e44022f7f3d4 for instance with vm_state deleted and task_state None.
Oct 23 21:37:51 user nova-compute[74337]: DEBUG nova.compute.manager [req-56cc75f1-3262-4a20-bd2d-617f667eb628 req-a713e2ad-4d14-4bdd-8d60-3b26c4ee9f70 service nova] [instance: a4bf4723-1e3c-42f1-a422-9d9263b67e3d] Received event network-vif-deleted-36e0b911-4cb9-4b24-bcb2-e44022f7f3d4 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:37:51 user nova-compute[74337]: INFO nova.compute.manager [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] [instance: 04c02325-7ce4-45c2-819b-c656e93c96ca] Took 2.72 seconds to detach 3 volumes for instance.
Oct 23 21:37:51 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:37:51 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:37:52 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:37:52 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:37:52 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.272s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:37:52 user nova-compute[74337]: INFO nova.scheduler.client.report [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Deleted allocations for instance 04c02325-7ce4-45c2-819b-c656e93c96ca
Oct 23 21:37:52 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-5ca7a871-1837-426b-8299-9a2fb3463531 tempest-TaggedBootDevicesTest_v242-66532269 tempest-TaggedBootDevicesTest_v242-66532269-project-member] Lock "04c02325-7ce4-45c2-819b-c656e93c96ca" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.579s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:37:54 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:37:55 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:37:58 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:37:59 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:37:59 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:37:59 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 21:37:59 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:38:00 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:38:00 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Starting heal instance info cache {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 21:38:00 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "refresh_cache-5a181593-8086-4ece-9f5b-5ccba0bfe91e" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:38:00 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquired lock "refresh_cache-5a181593-8086-4ece-9f5b-5ccba0bfe91e" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:38:00 user nova-compute[74337]: DEBUG nova.network.neutron [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 5a181593-8086-4ece-9f5b-5ccba0bfe91e] Forcefully refreshing network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 21:38:01 user nova-compute[74337]: DEBUG nova.network.neutron [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 5a181593-8086-4ece-9f5b-5ccba0bfe91e] Updating instance_info_cache with network_info: [{"id": "b1c5ce36-994a-4a4d-9027-6e3716b2d8f5", "address": "fa:16:3e:9a:56:5a", "network": {"id": "41a76d3f-a889-4294-bdc5-d9175a403158", "bridge": "br-int", "label": "tempest-TestVolumeSwap-237128553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "222c613ffcb647f183ef412107337c74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1c5ce36-99", "ovs_interfaceid": "b1c5ce36-994a-4a4d-9027-6e3716b2d8f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:38:01 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Releasing lock "refresh_cache-5a181593-8086-4ece-9f5b-5ccba0bfe91e" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:38:01 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 5a181593-8086-4ece-9f5b-5ccba0bfe91e] Updated the network info_cache for instance {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 21:38:01 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:38:01 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:38:01 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:38:01 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:38:01 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Auditing locally available compute resources for user (node: user) {{(pid=74337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 21:38:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a181593-8086-4ece-9f5b-5ccba0bfe91e/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:38:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a181593-8086-4ece-9f5b-5ccba0bfe91e/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:38:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a181593-8086-4ece-9f5b-5ccba0bfe91e/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:38:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a181593-8086-4ece-9f5b-5ccba0bfe91e/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:38:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d45e8ae8-371b-46ae-849d-d7f7d5bbd770/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:38:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d45e8ae8-371b-46ae-849d-d7f7d5bbd770/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:38:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d45e8ae8-371b-46ae-849d-d7f7d5bbd770/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:38:02 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d45e8ae8-371b-46ae-849d-d7f7d5bbd770/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:38:02 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:38:02 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:38:02 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:38:02 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Starting finish_migration {{(pid=74337) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Oct 23 21:38:02 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Instance directory exists: not creating {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 23 21:38:02 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Creating image(s)
Oct 23 21:38:02 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:38:02 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:38:02 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 21:38:02 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf6270ba-7a4e-40c4-b7fd-c62a44125c89/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:38:02 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.208s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:38:02 user nova-compute[74337]: DEBUG nova.virt.disk.api [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50/disk. size=21474836480 {{(pid=74337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 21:38:02 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:38:02 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf6270ba-7a4e-40c4-b7fd-c62a44125c89/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:38:02 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf6270ba-7a4e-40c4-b7fd-c62a44125c89/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:38:02 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:38:02 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50/disk 21474836480 {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:38:02 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50/disk 21474836480" returned: 0 in 0.045s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:38:02 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf6270ba-7a4e-40c4-b7fd-c62a44125c89/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:38:03 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Did not create local disks {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 23 21:38:03 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Ensure instance console log exists: /opt/stack/data/nova/instances/d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50/console.log {{(pid=74337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 21:38:03 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:38:03 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:38:03 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:38:03 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Start _get_guest_xml network_info=[{"id": "872b2a23-8054-4d26-b798-c0099d1c9a91", "address": "fa:16:3e:30:a6:90", "network": {"id": "b6a24032-0229-4ebe-83a3-8804e494838c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1472404179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1472404179-network", "vif_mac": "fa:16:3e:30:a6:90"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17117e60d0d9484d80c0bc8de393921c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap872b2a23-80", "ovs_interfaceid": "872b2a23-8054-4d26-b798-c0099d1c9a91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T21:29:21Z,direct_url=<?>,disk_format='qcow2',id=d859d89d-998d-4109-b26a-0d6e28152932,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ff43462300764979a6cf688444336a56',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T21:29:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'image_id': 'd859d89d-998d-4109-b26a-0d6e28152932'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '6d3e6720-4ade-4752-b67d-d653072fa2a4', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cQHBUDwS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'd1dbccc7-0a00-4b8b-813d-e3ca38ee0d50', 'attached_at': '2023-10-23T21:38:02.000000', 'detached_at': '', 'volume_id': '61659946-05f4-49d5-9e10-69b68340b522', 'serial': '61659946-05f4-49d5-9e10-69b68340b522'}, 'guest_format': None, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 21:38:03 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00f757cf-e5dd-476f-81c6-670ed2bf6938/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:38:03 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:38:03 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:38:03 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 21:38:03 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] CPU controller missing on host. {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 21:38:03 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 21:38:03 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] CPU controller found on host. {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 21:38:03 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 21:38:03 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T21:29:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T21:29:21Z,direct_url=<?>,disk_format='qcow2',id=d859d89d-998d-4109-b26a-0d6e28152932,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ff43462300764979a6cf688444336a56',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T21:29:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 21:38:03 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Flavor limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 21:38:03 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Image limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 21:38:03 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Flavor pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 21:38:03 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Image pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 21:38:03 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 21:38:03 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 21:38:03 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 21:38:03 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Got 1 possible topologies {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 21:38:03 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 21:38:03 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 21:38:03 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Calling os-brick to attach iSCSI Volume {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 21:38:03 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cQHBUDwS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:38:03 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:38:03 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:38:03 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:38:03 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:38:03 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:38:03 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:38:03 user nova-compute[74337]: INFO os_brick.initiator.connectors.iscsi [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 21:38:03 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 -p 172.16.0.220:3260 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:38:03 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:38:03 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4cdc9c9-9d8b-4a07-bfe7-84dfda567742]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:38:03 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 21:38:03 user nova-compute[74337]:  {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:38:03 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 -p 172.16.0.220:3260 --interface default --op new {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:38:03 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:38:03 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f61f012-2905-4c24-aaf0-f672f484b1dc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522] added\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:38:03 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522] added
Oct 23 21:38:03 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:38:03 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:38:03 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:38:03 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dd26d69-f20c-45ac-85ba-269284feb816]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:38:03 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:38:03 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:38:03 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00f757cf-e5dd-476f-81c6-670ed2bf6938/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:38:03 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00f757cf-e5dd-476f-81c6-670ed2bf6938/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:38:03 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:38:03 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f4e8d5-24a9-4b64-9b96-df9cd4d58ab5]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:38:03 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:38:03 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cQHBUDwS {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:38:03 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cQHBUDwS" returned: 0 in 0.020s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:38:03 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc02516-60e8-4e08-98b7-68d77c082dc6]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:38:03 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cQHBUDwS'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:38:03 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:38:03 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:38:03 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ba8660-de5e-4067-8e86-ea796938099c]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:38:03 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:38:03 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:38:03 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:38:03 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[511b3860-bbd4-4e54-b106-b0cf5bf07934]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:38:03 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 23 21:38:03 user nova-compute[74337]:  {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:38:03 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 23 21:38:03 user nova-compute[74337]:  {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:38:03 user nova-compute[74337]: WARNING os_brick.initiator.connectors.iscsi [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 23 21:38:03 user nova-compute[74337]: 
Oct 23 21:38:03 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 -p 172.16.0.220:3260 --login {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:38:03 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:38:03 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[438e23b1-476e-48fa-9514-90ee0939ee11]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:38:03 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522, portal: 172.16.0.220,3260]
Oct 23 21:38:03 user nova-compute[74337]: Login to [iface: default, target: iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522, portal: 172.16.0.220,3260] successful.
Oct 23 21:38:03 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:38:03 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:38:03 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:38:03 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[78bdde90-f4e8-4d74-b4e6-6713a00f8a18]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:38:03 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:38:03 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:38:03 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00f757cf-e5dd-476f-81c6-670ed2bf6938/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:38:03 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b193f267-2ca2-47c5-bd6c-397b1e041d4a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:38:03 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:38:03 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[39326841-fa9f-401d-82b7-93d89b2f7311]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:38:03 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 (non-flash)
Oct 23 21:38:03 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:38:03 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 (non-flash)
Oct 23 21:38:03 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:38:03 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.341s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:38:03 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Connected to 172.16.0.220:3260 {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 21:38:03 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] HCTL ('33', '-', '-', 0) found on session 17 with lun 0 {{(pid=74337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 21:38:03 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 21:38:03 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:38:03 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:38:03 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[0181191b-d2c6-4853-8996-af924e8c9d48]: (4, ('- - 0', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:38:03 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Searching for a device in session 17 and hctl ['33', '*', '*', 0] yield: None {{(pid=74337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 21:38:03 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b193f267-2ca2-47c5-bd6c-397b1e041d4a/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:38:03 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b193f267-2ca2-47c5-bd6c-397b1e041d4a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:38:03 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b193f267-2ca2-47c5-bd6c-397b1e041d4a/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:38:04 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:38:04 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:38:04 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Hypervisor/Node resource view: name=user free_ram=8023MB free_disk=25.544857025146484GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 21:38:04 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:38:04 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:38:04 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Applying migration context for instance d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50 as it has an incoming, in-progress migration 07b7bb7a-337b-4151-b2c9-4386a51c5bbf. Migration status is post-migrating {{(pid=74337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 23 21:38:04 user nova-compute[74337]: INFO nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Updating resource usage from migration 07b7bb7a-337b-4151-b2c9-4386a51c5bbf
Oct 23 21:38:04 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance cf6270ba-7a4e-40c4-b7fd-c62a44125c89 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:38:04 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance d45e8ae8-371b-46ae-849d-d7f7d5bbd770 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:38:04 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 5a181593-8086-4ece-9f5b-5ccba0bfe91e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:38:04 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 00f757cf-e5dd-476f-81c6-670ed2bf6938 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:38:04 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance b193f267-2ca2-47c5-bd6c-397b1e041d4a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:38:04 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Migration 07b7bb7a-337b-4151-b2c9-4386a51c5bbf is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 23 21:38:04 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:38:04 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 21:38:04 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=26GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 21:38:04 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Searching for a device in session 17 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 21:38:04 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cQHBUDwS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 21:38:04 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.381s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:38:04 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] <== connect_volume: return (1383ms) {'type': 'block', 'scsi_wwn': '23137393363343964', 'path': '/dev/sdb'} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:38:04 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23137393363343964', 'path': '/dev/sdb'} {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 21:38:04 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:33:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1887044710',display_name='tempest-ServerActionsTestOtherB-server-1887044710',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1887044710',id=3,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHU30kXpNK56Ek7qPPN2svMqEvJefmquCorzEt/taRsaipSAkpLIVwB8P5vsm9bHgo5LnJ4I5wS/V9f0J2TYkkYbtKjnjylT3HdP3iz0AGKDmStPt9PuAI+hC3gVCHen5Q==',key_name='tempest-keypair-1524952332',keypairs=<?>,launch_index=0,launched_at=2023-10-23T21:33:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='17117e60d0d9484d80c0bc8de393921c',ramdisk_id='',reservation_id='r-1ao5mr6t',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1301864789',owner_user_name='tempest-ServerActionsTestOtherB-1301864789-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:37:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='92570d8849c646d882017142cac1b674',uuid=d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "872b2a23-8054-4d26-b798-c0099d1c9a91", "address": "fa:16:3e:30:a6:90", "network": {"id": "b6a24032-0229-4ebe-83a3-8804e494838c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1472404179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1472404179-network", "vif_mac": "fa:16:3e:30:a6:90"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17117e60d0d9484d80c0bc8de393921c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap872b2a23-80", "ovs_interfaceid": "872b2a23-8054-4d26-b798-c0099d1c9a91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 21:38:04 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Converting VIF {"id": "872b2a23-8054-4d26-b798-c0099d1c9a91", "address": "fa:16:3e:30:a6:90", "network": {"id": "b6a24032-0229-4ebe-83a3-8804e494838c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1472404179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1472404179-network", "vif_mac": "fa:16:3e:30:a6:90"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17117e60d0d9484d80c0bc8de393921c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap872b2a23-80", "ovs_interfaceid": "872b2a23-8054-4d26-b798-c0099d1c9a91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:38:04 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:a6:90,bridge_name='br-int',has_traffic_filtering=True,id=872b2a23-8054-4d26-b798-c0099d1c9a91,network=Network(b6a24032-0229-4ebe-83a3-8804e494838c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap872b2a23-80') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:38:04 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] End _get_guest_xml xml=<domain type="kvm">
Oct 23 21:38:04 user nova-compute[74337]:   <uuid>d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50</uuid>
Oct 23 21:38:04 user nova-compute[74337]:   <name>instance-00000003</name>
Oct 23 21:38:04 user nova-compute[74337]:   <memory>2097152</memory>
Oct 23 21:38:04 user nova-compute[74337]:   <vcpu>1</vcpu>
Oct 23 21:38:04 user nova-compute[74337]:   <metadata>
Oct 23 21:38:04 user nova-compute[74337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 21:38:04 user nova-compute[74337]:       <nova:package version="0.0.0"/>
Oct 23 21:38:04 user nova-compute[74337]:       <nova:name>tempest-ServerActionsTestOtherB-server-1887044710</nova:name>
Oct 23 21:38:04 user nova-compute[74337]:       <nova:creationTime>2023-10-23 21:38:03</nova:creationTime>
Oct 23 21:38:04 user nova-compute[74337]:       <nova:flavor name="m1.small">
Oct 23 21:38:04 user nova-compute[74337]:         <nova:memory>2048</nova:memory>
Oct 23 21:38:04 user nova-compute[74337]:         <nova:disk>20</nova:disk>
Oct 23 21:38:04 user nova-compute[74337]:         <nova:swap>0</nova:swap>
Oct 23 21:38:04 user nova-compute[74337]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 21:38:04 user nova-compute[74337]:         <nova:vcpus>1</nova:vcpus>
Oct 23 21:38:04 user nova-compute[74337]:       </nova:flavor>
Oct 23 21:38:04 user nova-compute[74337]:       <nova:owner>
Oct 23 21:38:04 user nova-compute[74337]:         <nova:user uuid="92570d8849c646d882017142cac1b674">tempest-ServerActionsTestOtherB-1301864789-project-member</nova:user>
Oct 23 21:38:04 user nova-compute[74337]:         <nova:project uuid="17117e60d0d9484d80c0bc8de393921c">tempest-ServerActionsTestOtherB-1301864789</nova:project>
Oct 23 21:38:04 user nova-compute[74337]:       </nova:owner>
Oct 23 21:38:04 user nova-compute[74337]:       <nova:root type="image" uuid="d859d89d-998d-4109-b26a-0d6e28152932"/>
Oct 23 21:38:04 user nova-compute[74337]:       <nova:ports>
Oct 23 21:38:04 user nova-compute[74337]:         <nova:port uuid="872b2a23-8054-4d26-b798-c0099d1c9a91">
Oct 23 21:38:04 user nova-compute[74337]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 23 21:38:04 user nova-compute[74337]:         </nova:port>
Oct 23 21:38:04 user nova-compute[74337]:       </nova:ports>
Oct 23 21:38:04 user nova-compute[74337]:     </nova:instance>
Oct 23 21:38:04 user nova-compute[74337]:   </metadata>
Oct 23 21:38:04 user nova-compute[74337]:   <sysinfo type="smbios">
Oct 23 21:38:04 user nova-compute[74337]:     <system>
Oct 23 21:38:04 user nova-compute[74337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 21:38:04 user nova-compute[74337]:       <entry name="product">OpenStack Nova</entry>
Oct 23 21:38:04 user nova-compute[74337]:       <entry name="version">0.0.0</entry>
Oct 23 21:38:04 user nova-compute[74337]:       <entry name="serial">d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50</entry>
Oct 23 21:38:04 user nova-compute[74337]:       <entry name="uuid">d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50</entry>
Oct 23 21:38:04 user nova-compute[74337]:       <entry name="family">Virtual Machine</entry>
Oct 23 21:38:04 user nova-compute[74337]:     </system>
Oct 23 21:38:04 user nova-compute[74337]:   </sysinfo>
Oct 23 21:38:04 user nova-compute[74337]:   <os>
Oct 23 21:38:04 user nova-compute[74337]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 21:38:04 user nova-compute[74337]:     <boot dev="hd"/>
Oct 23 21:38:04 user nova-compute[74337]:     <smbios mode="sysinfo"/>
Oct 23 21:38:04 user nova-compute[74337]:   </os>
Oct 23 21:38:04 user nova-compute[74337]:   <features>
Oct 23 21:38:04 user nova-compute[74337]:     <acpi/>
Oct 23 21:38:04 user nova-compute[74337]:     <apic/>
Oct 23 21:38:04 user nova-compute[74337]:     <vmcoreinfo/>
Oct 23 21:38:04 user nova-compute[74337]:   </features>
Oct 23 21:38:04 user nova-compute[74337]:   <clock offset="utc">
Oct 23 21:38:04 user nova-compute[74337]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 21:38:04 user nova-compute[74337]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 21:38:04 user nova-compute[74337]:     <timer name="hpet" present="no"/>
Oct 23 21:38:04 user nova-compute[74337]:   </clock>
Oct 23 21:38:04 user nova-compute[74337]:   <cpu mode="custom" match="exact">
Oct 23 21:38:04 user nova-compute[74337]:     <model>Nehalem</model>
Oct 23 21:38:04 user nova-compute[74337]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 21:38:04 user nova-compute[74337]:   </cpu>
Oct 23 21:38:04 user nova-compute[74337]:   <devices>
Oct 23 21:38:04 user nova-compute[74337]:     <disk type="file" device="disk">
Oct 23 21:38:04 user nova-compute[74337]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 21:38:04 user nova-compute[74337]:       <source file="/opt/stack/data/nova/instances/d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50/disk"/>
Oct 23 21:38:04 user nova-compute[74337]:       <target dev="vda" bus="virtio"/>
Oct 23 21:38:04 user nova-compute[74337]:     </disk>
Oct 23 21:38:04 user nova-compute[74337]:     <disk type="block" device="disk">
Oct 23 21:38:04 user nova-compute[74337]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 21:38:04 user nova-compute[74337]:       <source dev="/dev/sdb"/>
Oct 23 21:38:04 user nova-compute[74337]:       <target dev="vdb" bus="virtio"/>
Oct 23 21:38:04 user nova-compute[74337]:       <serial>61659946-05f4-49d5-9e10-69b68340b522</serial>
Oct 23 21:38:04 user nova-compute[74337]:     </disk>
Oct 23 21:38:04 user nova-compute[74337]:     <interface type="ethernet">
Oct 23 21:38:04 user nova-compute[74337]:       <mac address="fa:16:3e:30:a6:90"/>
Oct 23 21:38:04 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:38:04 user nova-compute[74337]:       <mtu size="1442"/>
Oct 23 21:38:04 user nova-compute[74337]:       <target dev="tap872b2a23-80"/>
Oct 23 21:38:04 user nova-compute[74337]:     </interface>
Oct 23 21:38:04 user nova-compute[74337]:     <serial type="pty">
Oct 23 21:38:04 user nova-compute[74337]:       <log file="/opt/stack/data/nova/instances/d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50/console.log" append="off"/>
Oct 23 21:38:04 user nova-compute[74337]:     </serial>
Oct 23 21:38:04 user nova-compute[74337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 21:38:04 user nova-compute[74337]:     <video>
Oct 23 21:38:04 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:38:04 user nova-compute[74337]:     </video>
Oct 23 21:38:04 user nova-compute[74337]:     <rng model="virtio">
Oct 23 21:38:04 user nova-compute[74337]:       <backend model="random">/dev/urandom</backend>
Oct 23 21:38:04 user nova-compute[74337]:     </rng>
Oct 23 21:38:04 user nova-compute[74337]:     <controller type="usb" index="0" model="none"/>
Oct 23 21:38:04 user nova-compute[74337]:     <memballoon model="virtio">
Oct 23 21:38:04 user nova-compute[74337]:       <stats period="10"/>
Oct 23 21:38:04 user nova-compute[74337]:     </memballoon>
Oct 23 21:38:04 user nova-compute[74337]:   </devices>
Oct 23 21:38:04 user nova-compute[74337]: </domain>
Oct 23 21:38:04 user nova-compute[74337]:  {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 21:38:04 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:33:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1887044710',display_name='tempest-ServerActionsTestOtherB-server-1887044710',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1887044710',id=3,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHU30kXpNK56Ek7qPPN2svMqEvJefmquCorzEt/taRsaipSAkpLIVwB8P5vsm9bHgo5LnJ4I5wS/V9f0J2TYkkYbtKjnjylT3HdP3iz0AGKDmStPt9PuAI+hC3gVCHen5Q==',key_name='tempest-keypair-1524952332',keypairs=<?>,launch_index=0,launched_at=2023-10-23T21:33:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='17117e60d0d9484d80c0bc8de393921c',ramdisk_id='',reservation_id='r-1ao5mr6t',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1301864789',owner_user_name='tempest-ServerActionsTestOtherB-1301864789-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:37:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='92570d8849c646d882017142cac1b674',uuid=d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "872b2a23-8054-4d26-b798-c0099d1c9a91", "address": "fa:16:3e:30:a6:90", "network": {"id": "b6a24032-0229-4ebe-83a3-8804e494838c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1472404179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1472404179-network", "vif_mac": "fa:16:3e:30:a6:90"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17117e60d0d9484d80c0bc8de393921c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap872b2a23-80", "ovs_interfaceid": "872b2a23-8054-4d26-b798-c0099d1c9a91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 21:38:04 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Converting VIF {"id": "872b2a23-8054-4d26-b798-c0099d1c9a91", "address": "fa:16:3e:30:a6:90", "network": {"id": "b6a24032-0229-4ebe-83a3-8804e494838c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1472404179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1472404179-network", "vif_mac": "fa:16:3e:30:a6:90"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17117e60d0d9484d80c0bc8de393921c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap872b2a23-80", "ovs_interfaceid": "872b2a23-8054-4d26-b798-c0099d1c9a91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:38:04 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:a6:90,bridge_name='br-int',has_traffic_filtering=True,id=872b2a23-8054-4d26-b798-c0099d1c9a91,network=Network(b6a24032-0229-4ebe-83a3-8804e494838c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap872b2a23-80') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:38:04 user nova-compute[74337]: DEBUG os_vif [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:a6:90,bridge_name='br-int',has_traffic_filtering=True,id=872b2a23-8054-4d26-b798-c0099d1c9a91,network=Network(b6a24032-0229-4ebe-83a3-8804e494838c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap872b2a23-80') {{(pid=74337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 21:38:04 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:38:04 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:38:04 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 21:38:04 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:38:04 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a05b1896-5c56-5ff6-93a0-848735048ff7', '_type': 'linux-noop'}}, row=False) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:38:04 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:38:04 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:38:04 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:38:04 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap872b2a23-80, may_exist=True, interface_attrs={}) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:38:04 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap872b2a23-80, col_values=(('qos', UUID('24cc337b-4fb3-4d25-a331-a6aa6d5db75b')),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:38:04 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap872b2a23-80, col_values=(('external_ids', {'iface-id': '872b2a23-8054-4d26-b798-c0099d1c9a91', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:30:a6:90', 'vm-uuid': 'd1dbccc7-0a00-4b8b-813d-e3ca38ee0d50'}),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:38:04 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:38:04 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:38:04 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:38:04 user nova-compute[74337]: INFO os_vif [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:a6:90,bridge_name='br-int',has_traffic_filtering=True,id=872b2a23-8054-4d26-b798-c0099d1c9a91,network=Network(b6a24032-0229-4ebe-83a3-8804e494838c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap872b2a23-80')
Oct 23 21:38:04 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:38:04 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] No BDM found with device name vda, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 21:38:04 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 21:38:04 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] No VIF found with MAC fa:16:3e:30:a6:90, not building metadata {{(pid=74337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 21:38:04 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:38:04 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Compute_service record updated for user:user {{(pid=74337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 21:38:04 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.475s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:38:05 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-9ac86cde-1e83-4545-a0c2-c22a2119be17 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Acquiring lock "5a181593-8086-4ece-9f5b-5ccba0bfe91e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:38:05 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-9ac86cde-1e83-4545-a0c2-c22a2119be17 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Lock "5a181593-8086-4ece-9f5b-5ccba0bfe91e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:38:05 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-9ac86cde-1e83-4545-a0c2-c22a2119be17 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Acquiring lock "5a181593-8086-4ece-9f5b-5ccba0bfe91e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:38:05 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-9ac86cde-1e83-4545-a0c2-c22a2119be17 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Lock "5a181593-8086-4ece-9f5b-5ccba0bfe91e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:38:05 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-9ac86cde-1e83-4545-a0c2-c22a2119be17 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Lock "5a181593-8086-4ece-9f5b-5ccba0bfe91e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:38:05 user nova-compute[74337]: INFO nova.compute.manager [None req-9ac86cde-1e83-4545-a0c2-c22a2119be17 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] [instance: 5a181593-8086-4ece-9f5b-5ccba0bfe91e] Terminating instance
Oct 23 21:38:05 user nova-compute[74337]: DEBUG nova.compute.manager [None req-9ac86cde-1e83-4545-a0c2-c22a2119be17 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] [instance: 5a181593-8086-4ece-9f5b-5ccba0bfe91e] Start destroying the instance on the hypervisor. {{(pid=74337) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 21:38:05 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:38:05 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:38:05 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:38:05 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:38:05 user nova-compute[74337]: DEBUG nova.compute.manager [req-af97b555-9694-417e-8763-2db3b949f8a6 req-3842f8cd-a47c-4f98-a57f-6a160237f74d service nova] [instance: 5a181593-8086-4ece-9f5b-5ccba0bfe91e] Received event network-vif-unplugged-b1c5ce36-994a-4a4d-9027-6e3716b2d8f5 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:38:05 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-af97b555-9694-417e-8763-2db3b949f8a6 req-3842f8cd-a47c-4f98-a57f-6a160237f74d service nova] Acquiring lock "5a181593-8086-4ece-9f5b-5ccba0bfe91e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:38:05 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-af97b555-9694-417e-8763-2db3b949f8a6 req-3842f8cd-a47c-4f98-a57f-6a160237f74d service nova] Lock "5a181593-8086-4ece-9f5b-5ccba0bfe91e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:38:05 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-af97b555-9694-417e-8763-2db3b949f8a6 req-3842f8cd-a47c-4f98-a57f-6a160237f74d service nova] Lock "5a181593-8086-4ece-9f5b-5ccba0bfe91e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:38:05 user nova-compute[74337]: DEBUG nova.compute.manager [req-af97b555-9694-417e-8763-2db3b949f8a6 req-3842f8cd-a47c-4f98-a57f-6a160237f74d service nova] [instance: 5a181593-8086-4ece-9f5b-5ccba0bfe91e] No waiting events found dispatching network-vif-unplugged-b1c5ce36-994a-4a4d-9027-6e3716b2d8f5 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:38:05 user nova-compute[74337]: DEBUG nova.compute.manager [req-af97b555-9694-417e-8763-2db3b949f8a6 req-3842f8cd-a47c-4f98-a57f-6a160237f74d service nova] [instance: 5a181593-8086-4ece-9f5b-5ccba0bfe91e] Received event network-vif-unplugged-b1c5ce36-994a-4a4d-9027-6e3716b2d8f5 for instance with task_state deleting. {{(pid=74337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 21:38:05 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:38:05 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:38:05 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:38:06 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: 5a181593-8086-4ece-9f5b-5ccba0bfe91e] Instance destroyed successfully.
Oct 23 21:38:06 user nova-compute[74337]: DEBUG nova.objects.instance [None req-9ac86cde-1e83-4545-a0c2-c22a2119be17 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Lazy-loading 'resources' on Instance uuid 5a181593-8086-4ece-9f5b-5ccba0bfe91e {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:38:06 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:38:06 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:38:06 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-9ac86cde-1e83-4545-a0c2-c22a2119be17 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:33:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-488665569',display_name='tempest-TestVolumeSwap-server-488665569',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-488665569',id=7,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBREbt4B1CUPwdNxcRJpmycGObsc6eTclaKlhBHbFnJAHw2nV0mdvTN6etl0nHBuvYUj7a84WrQL+G/mBv++WAGQ//stCz/cJWxqfyF9uZzadmruucmbrScsEoE5r1Xxgw==',key_name='tempest-keypair-229409021',keypairs=<?>,launch_index=0,launched_at=2023-10-23T21:33:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='222c613ffcb647f183ef412107337c74',ramdisk_id='',reservation_id='r-p94f8ybe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-2123571584',owner_user_name='tempest-TestVolumeSwap-2123571584-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T21:33:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3fbcff9492364ae9b4771d5f890016dd',uuid=5a181593-8086-4ece-9f5b-5ccba0bfe91e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b1c5ce36-994a-4a4d-9027-6e3716b2d8f5", "address": "fa:16:3e:9a:56:5a", "network": {"id": "41a76d3f-a889-4294-bdc5-d9175a403158", "bridge": "br-int", "label": "tempest-TestVolumeSwap-237128553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "222c613ffcb647f183ef412107337c74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1c5ce36-99", "ovs_interfaceid": "b1c5ce36-994a-4a4d-9027-6e3716b2d8f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 21:38:06 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-9ac86cde-1e83-4545-a0c2-c22a2119be17 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Converting VIF {"id": "b1c5ce36-994a-4a4d-9027-6e3716b2d8f5", "address": "fa:16:3e:9a:56:5a", "network": {"id": "41a76d3f-a889-4294-bdc5-d9175a403158", "bridge": "br-int", "label": "tempest-TestVolumeSwap-237128553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "222c613ffcb647f183ef412107337c74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1c5ce36-99", "ovs_interfaceid": "b1c5ce36-994a-4a4d-9027-6e3716b2d8f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:38:06 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-9ac86cde-1e83-4545-a0c2-c22a2119be17 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9a:56:5a,bridge_name='br-int',has_traffic_filtering=True,id=b1c5ce36-994a-4a4d-9027-6e3716b2d8f5,network=Network(41a76d3f-a889-4294-bdc5-d9175a403158),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1c5ce36-99') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:38:06 user nova-compute[74337]: DEBUG os_vif [None req-9ac86cde-1e83-4545-a0c2-c22a2119be17 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:56:5a,bridge_name='br-int',has_traffic_filtering=True,id=b1c5ce36-994a-4a4d-9027-6e3716b2d8f5,network=Network(41a76d3f-a889-4294-bdc5-d9175a403158),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1c5ce36-99') {{(pid=74337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 21:38:06 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:38:06 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb1c5ce36-99, bridge=br-int, if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:38:06 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:38:06 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:38:06 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:38:06 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:38:06 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e18551eb-b7b1-4018-adec-1db51a64cbbe) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:38:06 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:38:06 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:38:06 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:38:06 user nova-compute[74337]: INFO os_vif [None req-9ac86cde-1e83-4545-a0c2-c22a2119be17 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:56:5a,bridge_name='br-int',has_traffic_filtering=True,id=b1c5ce36-994a-4a4d-9027-6e3716b2d8f5,network=Network(41a76d3f-a889-4294-bdc5-d9175a403158),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1c5ce36-99')
Oct 23 21:38:06 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-9ac86cde-1e83-4545-a0c2-c22a2119be17 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] [instance: 5a181593-8086-4ece-9f5b-5ccba0bfe91e] Deleting instance files /opt/stack/data/nova/instances/5a181593-8086-4ece-9f5b-5ccba0bfe91e_del
Oct 23 21:38:06 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-9ac86cde-1e83-4545-a0c2-c22a2119be17 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] [instance: 5a181593-8086-4ece-9f5b-5ccba0bfe91e] Deletion of /opt/stack/data/nova/instances/5a181593-8086-4ece-9f5b-5ccba0bfe91e_del complete
Oct 23 21:38:06 user nova-compute[74337]: INFO nova.compute.manager [None req-9ac86cde-1e83-4545-a0c2-c22a2119be17 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] [instance: 5a181593-8086-4ece-9f5b-5ccba0bfe91e] Took 1.44 seconds to destroy the instance on the hypervisor.
Oct 23 21:38:06 user nova-compute[74337]: DEBUG oslo.service.loopingcall [None req-9ac86cde-1e83-4545-a0c2-c22a2119be17 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74337) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 21:38:06 user nova-compute[74337]: DEBUG nova.compute.manager [-] [instance: 5a181593-8086-4ece-9f5b-5ccba0bfe91e] Deallocating network for instance {{(pid=74337) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 21:38:06 user nova-compute[74337]: DEBUG nova.network.neutron [-] [instance: 5a181593-8086-4ece-9f5b-5ccba0bfe91e] deallocate_for_instance() {{(pid=74337) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 21:38:07 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:38:07 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:38:07 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:38:07 user nova-compute[74337]: DEBUG nova.compute.manager [req-1ec557cd-7807-4158-81bf-6530a210c810 req-2ed52535-91f6-47da-96b0-7ebda21102d1 service nova] [instance: 5a181593-8086-4ece-9f5b-5ccba0bfe91e] Received event network-vif-plugged-b1c5ce36-994a-4a4d-9027-6e3716b2d8f5 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:38:07 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-1ec557cd-7807-4158-81bf-6530a210c810 req-2ed52535-91f6-47da-96b0-7ebda21102d1 service nova] Acquiring lock "5a181593-8086-4ece-9f5b-5ccba0bfe91e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:38:07 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-1ec557cd-7807-4158-81bf-6530a210c810 req-2ed52535-91f6-47da-96b0-7ebda21102d1 service nova] Lock "5a181593-8086-4ece-9f5b-5ccba0bfe91e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:38:07 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-1ec557cd-7807-4158-81bf-6530a210c810 req-2ed52535-91f6-47da-96b0-7ebda21102d1 service nova] Lock "5a181593-8086-4ece-9f5b-5ccba0bfe91e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:38:07 user nova-compute[74337]: DEBUG nova.compute.manager [req-1ec557cd-7807-4158-81bf-6530a210c810 req-2ed52535-91f6-47da-96b0-7ebda21102d1 service nova] [instance: 5a181593-8086-4ece-9f5b-5ccba0bfe91e] No waiting events found dispatching network-vif-plugged-b1c5ce36-994a-4a4d-9027-6e3716b2d8f5 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:38:07 user nova-compute[74337]: WARNING nova.compute.manager [req-1ec557cd-7807-4158-81bf-6530a210c810 req-2ed52535-91f6-47da-96b0-7ebda21102d1 service nova] [instance: 5a181593-8086-4ece-9f5b-5ccba0bfe91e] Received unexpected event network-vif-plugged-b1c5ce36-994a-4a4d-9027-6e3716b2d8f5 for instance with vm_state active and task_state deleting.
Oct 23 21:38:07 user nova-compute[74337]: DEBUG nova.compute.manager [req-1ec557cd-7807-4158-81bf-6530a210c810 req-2ed52535-91f6-47da-96b0-7ebda21102d1 service nova] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Received event network-vif-plugged-872b2a23-8054-4d26-b798-c0099d1c9a91 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:38:07 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-1ec557cd-7807-4158-81bf-6530a210c810 req-2ed52535-91f6-47da-96b0-7ebda21102d1 service nova] Acquiring lock "d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:38:07 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-1ec557cd-7807-4158-81bf-6530a210c810 req-2ed52535-91f6-47da-96b0-7ebda21102d1 service nova] Lock "d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:38:07 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-1ec557cd-7807-4158-81bf-6530a210c810 req-2ed52535-91f6-47da-96b0-7ebda21102d1 service nova] Lock "d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:38:07 user nova-compute[74337]: DEBUG nova.compute.manager [req-1ec557cd-7807-4158-81bf-6530a210c810 req-2ed52535-91f6-47da-96b0-7ebda21102d1 service nova] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] No waiting events found dispatching network-vif-plugged-872b2a23-8054-4d26-b798-c0099d1c9a91 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:38:07 user nova-compute[74337]: WARNING nova.compute.manager [req-1ec557cd-7807-4158-81bf-6530a210c810 req-2ed52535-91f6-47da-96b0-7ebda21102d1 service nova] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Received unexpected event network-vif-plugged-872b2a23-8054-4d26-b798-c0099d1c9a91 for instance with vm_state active and task_state resize_finish.
Oct 23 21:38:07 user nova-compute[74337]: DEBUG nova.compute.manager [req-1ec557cd-7807-4158-81bf-6530a210c810 req-2ed52535-91f6-47da-96b0-7ebda21102d1 service nova] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Received event network-vif-plugged-872b2a23-8054-4d26-b798-c0099d1c9a91 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:38:07 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-1ec557cd-7807-4158-81bf-6530a210c810 req-2ed52535-91f6-47da-96b0-7ebda21102d1 service nova] Acquiring lock "d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:38:07 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-1ec557cd-7807-4158-81bf-6530a210c810 req-2ed52535-91f6-47da-96b0-7ebda21102d1 service nova] Lock "d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:38:07 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-1ec557cd-7807-4158-81bf-6530a210c810 req-2ed52535-91f6-47da-96b0-7ebda21102d1 service nova] Lock "d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:38:07 user nova-compute[74337]: DEBUG nova.compute.manager [req-1ec557cd-7807-4158-81bf-6530a210c810 req-2ed52535-91f6-47da-96b0-7ebda21102d1 service nova] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] No waiting events found dispatching network-vif-plugged-872b2a23-8054-4d26-b798-c0099d1c9a91 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:38:07 user nova-compute[74337]: WARNING nova.compute.manager [req-1ec557cd-7807-4158-81bf-6530a210c810 req-2ed52535-91f6-47da-96b0-7ebda21102d1 service nova] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Received unexpected event network-vif-plugged-872b2a23-8054-4d26-b798-c0099d1c9a91 for instance with vm_state active and task_state resize_finish.
Oct 23 21:38:07 user nova-compute[74337]: DEBUG nova.network.neutron [-] [instance: 5a181593-8086-4ece-9f5b-5ccba0bfe91e] Updating instance_info_cache with network_info: [] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:38:07 user nova-compute[74337]: INFO nova.compute.manager [-] [instance: 5a181593-8086-4ece-9f5b-5ccba0bfe91e] Took 1.09 seconds to deallocate network for instance.
Oct 23 21:38:07 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-9ac86cde-1e83-4545-a0c2-c22a2119be17 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:38:07 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-9ac86cde-1e83-4545-a0c2-c22a2119be17 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:38:07 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-9ac86cde-1e83-4545-a0c2-c22a2119be17 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:38:07 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-9ac86cde-1e83-4545-a0c2-c22a2119be17 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:38:08 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-9ac86cde-1e83-4545-a0c2-c22a2119be17 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.296s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:38:08 user nova-compute[74337]: INFO nova.scheduler.client.report [None req-9ac86cde-1e83-4545-a0c2-c22a2119be17 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Deleted allocations for instance 5a181593-8086-4ece-9f5b-5ccba0bfe91e
Oct 23 21:38:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:38:08 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-9ac86cde-1e83-4545-a0c2-c22a2119be17 tempest-TestVolumeSwap-2123571584 tempest-TestVolumeSwap-2123571584-project-member] Lock "5a181593-8086-4ece-9f5b-5ccba0bfe91e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.067s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:38:08 user nova-compute[74337]: DEBUG nova.compute.manager [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Instance event wait completed in 0 seconds for  {{(pid=74337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 21:38:08 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Instance running successfully.
Oct 23 21:38:08 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Failed to set time: agent not configured {{(pid=74337) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Oct 23 21:38:08 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-419586fb-00ba-42ed-94cf-953bab455b56 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] finish_migration finished successfully. {{(pid=74337) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Oct 23 21:38:09 user nova-compute[74337]: DEBUG nova.compute.manager [req-4b4b0114-a8f7-4273-a11b-6bda2554a01a req-89efc0cb-737a-4d52-a598-0b96dcb0fae8 service nova] [instance: 5a181593-8086-4ece-9f5b-5ccba0bfe91e] Received event network-vif-deleted-b1c5ce36-994a-4a4d-9027-6e3716b2d8f5 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:38:11 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:38:13 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:38:16 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:38:17 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:38:21 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:38:21 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:38:23 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:38:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:38:27 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:38:28 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:38:29 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:38:31 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:38:33 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:38:33 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:38:36 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:38:37 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:38:38 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:38:39 user nova-compute[74337]: DEBUG nova.compute.manager [req-595db91f-e0af-447d-ac73-ef595c3d409b req-3be9d461-c76e-4862-a9b2-d5edf0afaf9f service nova] [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938] Received event network-changed-9034e8d2-9a0e-42b6-9a38-49877881f0d3 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:38:39 user nova-compute[74337]: DEBUG nova.compute.manager [req-595db91f-e0af-447d-ac73-ef595c3d409b req-3be9d461-c76e-4862-a9b2-d5edf0afaf9f service nova] [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938] Refreshing instance network info cache due to event network-changed-9034e8d2-9a0e-42b6-9a38-49877881f0d3. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 21:38:39 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-595db91f-e0af-447d-ac73-ef595c3d409b req-3be9d461-c76e-4862-a9b2-d5edf0afaf9f service nova] Acquiring lock "refresh_cache-00f757cf-e5dd-476f-81c6-670ed2bf6938" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:38:39 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-595db91f-e0af-447d-ac73-ef595c3d409b req-3be9d461-c76e-4862-a9b2-d5edf0afaf9f service nova] Acquired lock "refresh_cache-00f757cf-e5dd-476f-81c6-670ed2bf6938" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:38:39 user nova-compute[74337]: DEBUG nova.network.neutron [req-595db91f-e0af-447d-ac73-ef595c3d409b req-3be9d461-c76e-4862-a9b2-d5edf0afaf9f service nova] [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938] Refreshing network info cache for port 9034e8d2-9a0e-42b6-9a38-49877881f0d3 {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 21:38:40 user nova-compute[74337]: DEBUG nova.network.neutron [req-595db91f-e0af-447d-ac73-ef595c3d409b req-3be9d461-c76e-4862-a9b2-d5edf0afaf9f service nova] [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938] Updated VIF entry in instance network info cache for port 9034e8d2-9a0e-42b6-9a38-49877881f0d3. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 21:38:40 user nova-compute[74337]: DEBUG nova.network.neutron [req-595db91f-e0af-447d-ac73-ef595c3d409b req-3be9d461-c76e-4862-a9b2-d5edf0afaf9f service nova] [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938] Updating instance_info_cache with network_info: [{"id": "9034e8d2-9a0e-42b6-9a38-49877881f0d3", "address": "fa:16:3e:43:34:d0", "network": {"id": "0feb8c56-c17f-47d0-9796-91d4bd20e81d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1399506675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd8afde978624cf8a2356e8ce8b4d3f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9034e8d2-9a", "ovs_interfaceid": "9034e8d2-9a0e-42b6-9a38-49877881f0d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:38:40 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-595db91f-e0af-447d-ac73-ef595c3d409b req-3be9d461-c76e-4862-a9b2-d5edf0afaf9f service nova] Releasing lock "refresh_cache-00f757cf-e5dd-476f-81c6-670ed2bf6938" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:38:41 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:38:43 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:38:43 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:38:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:38:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:38:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:38:46 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-13b10d14-cfd0-42e9-a392-382fe98cdee4 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Acquiring lock "00f757cf-e5dd-476f-81c6-670ed2bf6938" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:38:46 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-13b10d14-cfd0-42e9-a392-382fe98cdee4 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Lock "00f757cf-e5dd-476f-81c6-670ed2bf6938" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:38:46 user nova-compute[74337]: INFO nova.compute.manager [None req-13b10d14-cfd0-42e9-a392-382fe98cdee4 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938] Shelving
Oct 23 21:38:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:38:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:38:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:38:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:38:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:38:47 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938] Instance destroyed successfully.
Oct 23 21:38:47 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-13b10d14-cfd0-42e9-a392-382fe98cdee4 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938] Beginning cold snapshot process
Oct 23 21:38:48 user nova-compute[74337]: DEBUG nova.privsep.utils [None req-13b10d14-cfd0-42e9-a392-382fe98cdee4 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74337) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 23 21:38:48 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-13b10d14-cfd0-42e9-a392-382fe98cdee4 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/00f757cf-e5dd-476f-81c6-670ed2bf6938/disk /opt/stack/data/nova/instances/snapshots/tmpgh6muvjf/bf20e1394ada40699480f5d0aa35a878 {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:38:48 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:38:48 user nova-compute[74337]: DEBUG nova.compute.manager [req-f8c01481-3724-4329-a205-63cbc7f8db93 req-2c038b9d-7817-4923-98b2-0fdd9089f535 service nova] [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938] Received event network-vif-unplugged-9034e8d2-9a0e-42b6-9a38-49877881f0d3 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:38:48 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-f8c01481-3724-4329-a205-63cbc7f8db93 req-2c038b9d-7817-4923-98b2-0fdd9089f535 service nova] Acquiring lock "00f757cf-e5dd-476f-81c6-670ed2bf6938-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:38:48 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-f8c01481-3724-4329-a205-63cbc7f8db93 req-2c038b9d-7817-4923-98b2-0fdd9089f535 service nova] Lock "00f757cf-e5dd-476f-81c6-670ed2bf6938-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:38:48 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-f8c01481-3724-4329-a205-63cbc7f8db93 req-2c038b9d-7817-4923-98b2-0fdd9089f535 service nova] Lock "00f757cf-e5dd-476f-81c6-670ed2bf6938-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:38:48 user nova-compute[74337]: DEBUG nova.compute.manager [req-f8c01481-3724-4329-a205-63cbc7f8db93 req-2c038b9d-7817-4923-98b2-0fdd9089f535 service nova] [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938] No waiting events found dispatching network-vif-unplugged-9034e8d2-9a0e-42b6-9a38-49877881f0d3 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:38:48 user nova-compute[74337]: WARNING nova.compute.manager [req-f8c01481-3724-4329-a205-63cbc7f8db93 req-2c038b9d-7817-4923-98b2-0fdd9089f535 service nova] [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938] Received unexpected event network-vif-unplugged-9034e8d2-9a0e-42b6-9a38-49877881f0d3 for instance with vm_state active and task_state shelving_image_pending_upload.
Oct 23 21:38:49 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-13b10d14-cfd0-42e9-a392-382fe98cdee4 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/00f757cf-e5dd-476f-81c6-670ed2bf6938/disk /opt/stack/data/nova/instances/snapshots/tmpgh6muvjf/bf20e1394ada40699480f5d0aa35a878" returned: 0 in 1.015s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:38:49 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-13b10d14-cfd0-42e9-a392-382fe98cdee4 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938] Snapshot extracted, beginning image upload
Oct 23 21:38:49 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Acquiring lock "2cae5b4d-96a0-41ae-9643-b7bf09581988" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:38:49 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Lock "2cae5b4d-96a0-41ae-9643-b7bf09581988" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:38:49 user nova-compute[74337]: DEBUG nova.compute.manager [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Starting instance... {{(pid=74337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 21:38:49 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:38:49 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:38:49 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 21:38:49 user nova-compute[74337]: INFO nova.compute.claims [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Claim successful on node user
Oct 23 21:38:50 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-28368881-624d-42e3-9cff-9890e138da56 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Acquiring lock "1189976f-8d02-468d-8fa7-bd5594c5f85a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:38:50 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-28368881-624d-42e3-9cff-9890e138da56 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lock "1189976f-8d02-468d-8fa7-bd5594c5f85a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:38:50 user nova-compute[74337]: DEBUG nova.compute.manager [None req-28368881-624d-42e3-9cff-9890e138da56 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: 1189976f-8d02-468d-8fa7-bd5594c5f85a] Starting instance... {{(pid=74337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 21:38:50 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-28368881-624d-42e3-9cff-9890e138da56 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:38:50 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:38:50 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:38:50 user nova-compute[74337]: DEBUG nova.compute.manager [req-fbd64cd1-20fe-4862-ab4b-d3a778f3db59 req-186852da-56d2-4a56-9601-c965d25e6593 service nova] [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938] Received event network-vif-plugged-9034e8d2-9a0e-42b6-9a38-49877881f0d3 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:38:50 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-fbd64cd1-20fe-4862-ab4b-d3a778f3db59 req-186852da-56d2-4a56-9601-c965d25e6593 service nova] Acquiring lock "00f757cf-e5dd-476f-81c6-670ed2bf6938-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:38:50 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-fbd64cd1-20fe-4862-ab4b-d3a778f3db59 req-186852da-56d2-4a56-9601-c965d25e6593 service nova] Lock "00f757cf-e5dd-476f-81c6-670ed2bf6938-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:38:50 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-fbd64cd1-20fe-4862-ab4b-d3a778f3db59 req-186852da-56d2-4a56-9601-c965d25e6593 service nova] Lock "00f757cf-e5dd-476f-81c6-670ed2bf6938-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:38:50 user nova-compute[74337]: DEBUG nova.compute.manager [req-fbd64cd1-20fe-4862-ab4b-d3a778f3db59 req-186852da-56d2-4a56-9601-c965d25e6593 service nova] [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938] No waiting events found dispatching network-vif-plugged-9034e8d2-9a0e-42b6-9a38-49877881f0d3 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:38:50 user nova-compute[74337]: WARNING nova.compute.manager [req-fbd64cd1-20fe-4862-ab4b-d3a778f3db59 req-186852da-56d2-4a56-9601-c965d25e6593 service nova] [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938] Received unexpected event network-vif-plugged-9034e8d2-9a0e-42b6-9a38-49877881f0d3 for instance with vm_state active and task_state shelving_image_uploading.
Oct 23 21:38:50 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.522s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:38:50 user nova-compute[74337]: DEBUG nova.compute.manager [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Start building networks asynchronously for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 21:38:50 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-28368881-624d-42e3-9cff-9890e138da56 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.323s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:38:50 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-28368881-624d-42e3-9cff-9890e138da56 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 21:38:50 user nova-compute[74337]: INFO nova.compute.claims [None req-28368881-624d-42e3-9cff-9890e138da56 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: 1189976f-8d02-468d-8fa7-bd5594c5f85a] Claim successful on node user
Oct 23 21:38:50 user nova-compute[74337]: DEBUG nova.compute.manager [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Allocating IP information in the background. {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 21:38:50 user nova-compute[74337]: DEBUG nova.network.neutron [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] allocate_for_instance() {{(pid=74337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 21:38:50 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 21:38:50 user nova-compute[74337]: DEBUG nova.compute.manager [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Start building block device mappings for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 21:38:50 user nova-compute[74337]: DEBUG nova.policy [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1c6d296964f545e78d8bc461d6f28dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3abafb229d604b65a3fb50f0eebc70ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74337) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 21:38:50 user nova-compute[74337]: INFO nova.virt.block_device [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Booting with volume f45407b0-0f4c-4120-8ef2-812f51f88f01 at /dev/vda
Oct 23 21:38:50 user nova-compute[74337]: DEBUG os_brick.utils [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:38:50 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:38:50 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:38:50 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[996ccf77-95a3-407d-9e49-f5215df7c96b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f34011b66e40\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:38:50 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:38:50 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:38:50 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6183ec92-d627-4d90-aec2-072f0f36e3ee]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:38:50 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:38:50 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:38:50 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[611909b1-53eb-4011-ac50-9f0adfb29924]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:38:50 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b90c3f25-e6e8-4423-a2be-dbc6e88d20d4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:38:50 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Running cmd (subprocess): nvme version {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:38:50 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] 'nvme version' failed. Not Retrying. {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 21:38:50 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] nvme not present on system {{(pid=74337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 21:38:50 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:38:50 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 21:38:50 user nova-compute[74337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 21:38:50 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[72478022-3daf-41c3-8375-5f586c5069f4]: (4, '') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:38:50 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 21:38:50 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 21:38:50 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] LIGHTOS: no hostnqn found. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 21:38:50 user nova-compute[74337]: DEBUG os_brick.utils [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] <== get_connector_properties: return (171ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f34011b66e40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:38:50 user nova-compute[74337]: DEBUG nova.virt.block_device [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Updating existing volume attachment record: f2bf9331-83f3-4e96-aa53-070ac62c5bd1 {{(pid=74337) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 21:38:51 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-28368881-624d-42e3-9cff-9890e138da56 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:38:51 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-28368881-624d-42e3-9cff-9890e138da56 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:38:51 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-28368881-624d-42e3-9cff-9890e138da56 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.615s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:38:51 user nova-compute[74337]: DEBUG nova.compute.manager [None req-28368881-624d-42e3-9cff-9890e138da56 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: 1189976f-8d02-468d-8fa7-bd5594c5f85a] Start building networks asynchronously for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 21:38:51 user nova-compute[74337]: DEBUG nova.compute.manager [None req-28368881-624d-42e3-9cff-9890e138da56 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: 1189976f-8d02-468d-8fa7-bd5594c5f85a] Allocating IP information in the background. {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 21:38:51 user nova-compute[74337]: DEBUG nova.network.neutron [None req-28368881-624d-42e3-9cff-9890e138da56 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: 1189976f-8d02-468d-8fa7-bd5594c5f85a] allocate_for_instance() {{(pid=74337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 21:38:51 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-28368881-624d-42e3-9cff-9890e138da56 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: 1189976f-8d02-468d-8fa7-bd5594c5f85a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 21:38:51 user nova-compute[74337]: DEBUG nova.compute.manager [None req-28368881-624d-42e3-9cff-9890e138da56 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: 1189976f-8d02-468d-8fa7-bd5594c5f85a] Start building block device mappings for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 21:38:51 user nova-compute[74337]: DEBUG nova.policy [None req-28368881-624d-42e3-9cff-9890e138da56 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a2e424dd3c684c808de14c2a9c3c1ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b85c4f783a4ee7ab67422b49da85ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74337) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 21:38:51 user nova-compute[74337]: DEBUG nova.compute.manager [None req-28368881-624d-42e3-9cff-9890e138da56 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: 1189976f-8d02-468d-8fa7-bd5594c5f85a] Start spawning the instance on the hypervisor. {{(pid=74337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 21:38:51 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-28368881-624d-42e3-9cff-9890e138da56 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: 1189976f-8d02-468d-8fa7-bd5594c5f85a] Creating instance directory {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 21:38:51 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-28368881-624d-42e3-9cff-9890e138da56 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: 1189976f-8d02-468d-8fa7-bd5594c5f85a] Creating image(s)
Oct 23 21:38:51 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-28368881-624d-42e3-9cff-9890e138da56 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Acquiring lock "/opt/stack/data/nova/instances/1189976f-8d02-468d-8fa7-bd5594c5f85a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:38:51 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-28368881-624d-42e3-9cff-9890e138da56 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lock "/opt/stack/data/nova/instances/1189976f-8d02-468d-8fa7-bd5594c5f85a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:38:51 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-28368881-624d-42e3-9cff-9890e138da56 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lock "/opt/stack/data/nova/instances/1189976f-8d02-468d-8fa7-bd5594c5f85a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:38:51 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-28368881-624d-42e3-9cff-9890e138da56 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:38:51 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:38:51 user nova-compute[74337]: DEBUG nova.network.neutron [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Successfully created port: fc418a9a-364a-4e52-a073-58a567680beb {{(pid=74337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 21:38:51 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-28368881-624d-42e3-9cff-9890e138da56 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.212s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:38:51 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-28368881-624d-42e3-9cff-9890e138da56 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Acquiring lock "fc7b140751b8c385de81623e40fb09ce09374ab7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:38:51 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-28368881-624d-42e3-9cff-9890e138da56 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lock "fc7b140751b8c385de81623e40fb09ce09374ab7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:38:51 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-28368881-624d-42e3-9cff-9890e138da56 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:38:51 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:38:51 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-28368881-624d-42e3-9cff-9890e138da56 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.263s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:38:51 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-28368881-624d-42e3-9cff-9890e138da56 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7,backing_fmt=raw /opt/stack/data/nova/instances/1189976f-8d02-468d-8fa7-bd5594c5f85a/disk 1073741824 {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:38:51 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-28368881-624d-42e3-9cff-9890e138da56 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7,backing_fmt=raw /opt/stack/data/nova/instances/1189976f-8d02-468d-8fa7-bd5594c5f85a/disk 1073741824" returned: 0 in 0.075s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:38:51 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-28368881-624d-42e3-9cff-9890e138da56 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lock "fc7b140751b8c385de81623e40fb09ce09374ab7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.348s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:38:51 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-28368881-624d-42e3-9cff-9890e138da56 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:38:52 user nova-compute[74337]: DEBUG nova.network.neutron [None req-28368881-624d-42e3-9cff-9890e138da56 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: 1189976f-8d02-468d-8fa7-bd5594c5f85a] Successfully created port: 9c888931-1180-4efd-8ca1-a57252bf8dc5 {{(pid=74337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 21:38:52 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-28368881-624d-42e3-9cff-9890e138da56 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.229s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:38:52 user nova-compute[74337]: DEBUG nova.virt.disk.api [None req-28368881-624d-42e3-9cff-9890e138da56 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1189976f-8d02-468d-8fa7-bd5594c5f85a/disk. size=1073741824 {{(pid=74337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 21:38:52 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-28368881-624d-42e3-9cff-9890e138da56 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1189976f-8d02-468d-8fa7-bd5594c5f85a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:38:52 user nova-compute[74337]: DEBUG nova.network.neutron [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Successfully updated port: fc418a9a-364a-4e52-a073-58a567680beb {{(pid=74337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 21:38:52 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Acquiring lock "refresh_cache-2cae5b4d-96a0-41ae-9643-b7bf09581988" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:38:52 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Acquired lock "refresh_cache-2cae5b4d-96a0-41ae-9643-b7bf09581988" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:38:52 user nova-compute[74337]: DEBUG nova.network.neutron [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Building network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 21:38:52 user nova-compute[74337]: DEBUG nova.compute.manager [req-e9baab2d-0240-4cf0-aa5a-ca48f8855819 req-02b0355c-1a15-48b7-ad9d-c226d130ffe9 service nova] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Received event network-changed-fc418a9a-364a-4e52-a073-58a567680beb {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:38:52 user nova-compute[74337]: DEBUG nova.compute.manager [req-e9baab2d-0240-4cf0-aa5a-ca48f8855819 req-02b0355c-1a15-48b7-ad9d-c226d130ffe9 service nova] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Refreshing instance network info cache due to event network-changed-fc418a9a-364a-4e52-a073-58a567680beb. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 21:38:52 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-e9baab2d-0240-4cf0-aa5a-ca48f8855819 req-02b0355c-1a15-48b7-ad9d-c226d130ffe9 service nova] Acquiring lock "refresh_cache-2cae5b4d-96a0-41ae-9643-b7bf09581988" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:38:52 user nova-compute[74337]: DEBUG nova.network.neutron [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Instance cache missing network info. {{(pid=74337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 21:38:52 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-28368881-624d-42e3-9cff-9890e138da56 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1189976f-8d02-468d-8fa7-bd5594c5f85a/disk --force-share --output=json" returned: 0 in 0.310s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:38:52 user nova-compute[74337]: DEBUG nova.virt.disk.api [None req-28368881-624d-42e3-9cff-9890e138da56 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Cannot resize image /opt/stack/data/nova/instances/1189976f-8d02-468d-8fa7-bd5594c5f85a/disk to a smaller size. {{(pid=74337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 21:38:52 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-28368881-624d-42e3-9cff-9890e138da56 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: 1189976f-8d02-468d-8fa7-bd5594c5f85a] Created local disks {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 21:38:52 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-28368881-624d-42e3-9cff-9890e138da56 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: 1189976f-8d02-468d-8fa7-bd5594c5f85a] Ensure instance console log exists: /opt/stack/data/nova/instances/1189976f-8d02-468d-8fa7-bd5594c5f85a/console.log {{(pid=74337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 21:38:52 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-28368881-624d-42e3-9cff-9890e138da56 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:38:52 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-28368881-624d-42e3-9cff-9890e138da56 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:38:52 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-28368881-624d-42e3-9cff-9890e138da56 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:38:52 user nova-compute[74337]: DEBUG nova.network.neutron [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Updating instance_info_cache with network_info: [{"id": "fc418a9a-364a-4e52-a073-58a567680beb", "address": "fa:16:3e:5b:b9:06", "network": {"id": "e3ef8fef-f49d-46a8-b357-1ee41c4a17e4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-952280610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3abafb229d604b65a3fb50f0eebc70ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc418a9a-36", "ovs_interfaceid": "fc418a9a-364a-4e52-a073-58a567680beb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:38:52 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Releasing lock "refresh_cache-2cae5b4d-96a0-41ae-9643-b7bf09581988" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:38:52 user nova-compute[74337]: DEBUG nova.compute.manager [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Instance network_info: |[{"id": "fc418a9a-364a-4e52-a073-58a567680beb", "address": "fa:16:3e:5b:b9:06", "network": {"id": "e3ef8fef-f49d-46a8-b357-1ee41c4a17e4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-952280610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3abafb229d604b65a3fb50f0eebc70ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc418a9a-36", "ovs_interfaceid": "fc418a9a-364a-4e52-a073-58a567680beb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 21:38:52 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-e9baab2d-0240-4cf0-aa5a-ca48f8855819 req-02b0355c-1a15-48b7-ad9d-c226d130ffe9 service nova] Acquired lock "refresh_cache-2cae5b4d-96a0-41ae-9643-b7bf09581988" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:38:52 user nova-compute[74337]: DEBUG nova.network.neutron [req-e9baab2d-0240-4cf0-aa5a-ca48f8855819 req-02b0355c-1a15-48b7-ad9d-c226d130ffe9 service nova] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Refreshing network info cache for port fc418a9a-364a-4e52-a073-58a567680beb {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 21:38:52 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-13b10d14-cfd0-42e9-a392-382fe98cdee4 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938] Snapshot image upload complete
Oct 23 21:38:52 user nova-compute[74337]: DEBUG nova.compute.manager [None req-13b10d14-cfd0-42e9-a392-382fe98cdee4 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938] Checking state {{(pid=74337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 21:38:53 user nova-compute[74337]: INFO nova.compute.manager [None req-13b10d14-cfd0-42e9-a392-382fe98cdee4 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938] Shelve offloading
Oct 23 21:38:53 user nova-compute[74337]: DEBUG nova.network.neutron [None req-28368881-624d-42e3-9cff-9890e138da56 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: 1189976f-8d02-468d-8fa7-bd5594c5f85a] Successfully updated port: 9c888931-1180-4efd-8ca1-a57252bf8dc5 {{(pid=74337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 21:38:53 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-28368881-624d-42e3-9cff-9890e138da56 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Acquiring lock "refresh_cache-1189976f-8d02-468d-8fa7-bd5594c5f85a" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:38:53 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-28368881-624d-42e3-9cff-9890e138da56 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Acquired lock "refresh_cache-1189976f-8d02-468d-8fa7-bd5594c5f85a" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:38:53 user nova-compute[74337]: DEBUG nova.network.neutron [None req-28368881-624d-42e3-9cff-9890e138da56 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: 1189976f-8d02-468d-8fa7-bd5594c5f85a] Building network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 21:38:53 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938] Instance destroyed successfully.
Oct 23 21:38:53 user nova-compute[74337]: DEBUG nova.compute.manager [None req-13b10d14-cfd0-42e9-a392-382fe98cdee4 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938] Checking state {{(pid=74337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 21:38:53 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-13b10d14-cfd0-42e9-a392-382fe98cdee4 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Acquiring lock "refresh_cache-00f757cf-e5dd-476f-81c6-670ed2bf6938" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:38:53 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-13b10d14-cfd0-42e9-a392-382fe98cdee4 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Acquired lock "refresh_cache-00f757cf-e5dd-476f-81c6-670ed2bf6938" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:38:53 user nova-compute[74337]: DEBUG nova.network.neutron [None req-13b10d14-cfd0-42e9-a392-382fe98cdee4 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938] Building network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 21:38:53 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:38:53 user nova-compute[74337]: DEBUG nova.network.neutron [None req-28368881-624d-42e3-9cff-9890e138da56 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: 1189976f-8d02-468d-8fa7-bd5594c5f85a] Instance cache missing network info. {{(pid=74337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 21:38:53 user nova-compute[74337]: DEBUG nova.compute.manager [req-70fdb880-38bb-4ce8-9fd2-f4576107ec41 req-d3ff1887-e190-4693-8f19-2df67fc69369 service nova] [instance: 1189976f-8d02-468d-8fa7-bd5594c5f85a] Received event network-changed-9c888931-1180-4efd-8ca1-a57252bf8dc5 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:38:53 user nova-compute[74337]: DEBUG nova.compute.manager [req-70fdb880-38bb-4ce8-9fd2-f4576107ec41 req-d3ff1887-e190-4693-8f19-2df67fc69369 service nova] [instance: 1189976f-8d02-468d-8fa7-bd5594c5f85a] Refreshing instance network info cache due to event network-changed-9c888931-1180-4efd-8ca1-a57252bf8dc5. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 21:38:53 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-70fdb880-38bb-4ce8-9fd2-f4576107ec41 req-d3ff1887-e190-4693-8f19-2df67fc69369 service nova] Acquiring lock "refresh_cache-1189976f-8d02-468d-8fa7-bd5594c5f85a" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:38:53 user nova-compute[74337]: DEBUG nova.network.neutron [req-e9baab2d-0240-4cf0-aa5a-ca48f8855819 req-02b0355c-1a15-48b7-ad9d-c226d130ffe9 service nova] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Updated VIF entry in instance network info cache for port fc418a9a-364a-4e52-a073-58a567680beb. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 21:38:53 user nova-compute[74337]: DEBUG nova.network.neutron [req-e9baab2d-0240-4cf0-aa5a-ca48f8855819 req-02b0355c-1a15-48b7-ad9d-c226d130ffe9 service nova] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Updating instance_info_cache with network_info: [{"id": "fc418a9a-364a-4e52-a073-58a567680beb", "address": "fa:16:3e:5b:b9:06", "network": {"id": "e3ef8fef-f49d-46a8-b357-1ee41c4a17e4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-952280610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3abafb229d604b65a3fb50f0eebc70ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc418a9a-36", "ovs_interfaceid": "fc418a9a-364a-4e52-a073-58a567680beb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:38:53 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-e9baab2d-0240-4cf0-aa5a-ca48f8855819 req-02b0355c-1a15-48b7-ad9d-c226d130ffe9 service nova] Releasing lock "refresh_cache-2cae5b4d-96a0-41ae-9643-b7bf09581988" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:38:53 user nova-compute[74337]: DEBUG nova.network.neutron [None req-28368881-624d-42e3-9cff-9890e138da56 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: 1189976f-8d02-468d-8fa7-bd5594c5f85a] Updating instance_info_cache with network_info: [{"id": "9c888931-1180-4efd-8ca1-a57252bf8dc5", "address": "fa:16:3e:f9:a2:b8", "network": {"id": "5f62b1d8-d5d0-4ff9-922b-fc6e72fb640d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-655282105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b85c4f783a4ee7ab67422b49da85ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c888931-11", "ovs_interfaceid": "9c888931-1180-4efd-8ca1-a57252bf8dc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:38:53 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-28368881-624d-42e3-9cff-9890e138da56 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Releasing lock "refresh_cache-1189976f-8d02-468d-8fa7-bd5594c5f85a" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:38:53 user nova-compute[74337]: DEBUG nova.compute.manager [None req-28368881-624d-42e3-9cff-9890e138da56 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: 1189976f-8d02-468d-8fa7-bd5594c5f85a] Instance network_info: |[{"id": "9c888931-1180-4efd-8ca1-a57252bf8dc5", "address": "fa:16:3e:f9:a2:b8", "network": {"id": "5f62b1d8-d5d0-4ff9-922b-fc6e72fb640d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-655282105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b85c4f783a4ee7ab67422b49da85ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c888931-11", "ovs_interfaceid": "9c888931-1180-4efd-8ca1-a57252bf8dc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 21:38:53 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-70fdb880-38bb-4ce8-9fd2-f4576107ec41 req-d3ff1887-e190-4693-8f19-2df67fc69369 service nova] Acquired lock "refresh_cache-1189976f-8d02-468d-8fa7-bd5594c5f85a" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:38:53 user nova-compute[74337]: DEBUG nova.network.neutron [req-70fdb880-38bb-4ce8-9fd2-f4576107ec41 req-d3ff1887-e190-4693-8f19-2df67fc69369 service nova] [instance: 1189976f-8d02-468d-8fa7-bd5594c5f85a] Refreshing network info cache for port 9c888931-1180-4efd-8ca1-a57252bf8dc5 {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 21:38:53 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-28368881-624d-42e3-9cff-9890e138da56 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: 1189976f-8d02-468d-8fa7-bd5594c5f85a] Start _get_guest_xml network_info=[{"id": "9c888931-1180-4efd-8ca1-a57252bf8dc5", "address": "fa:16:3e:f9:a2:b8", "network": {"id": "5f62b1d8-d5d0-4ff9-922b-fc6e72fb640d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-655282105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b85c4f783a4ee7ab67422b49da85ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c888931-11", "ovs_interfaceid": "9c888931-1180-4efd-8ca1-a57252bf8dc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T21:29:21Z,direct_url=<?>,disk_format='qcow2',id=d859d89d-998d-4109-b26a-0d6e28152932,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ff43462300764979a6cf688444336a56',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T21:29:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'image_id': 'd859d89d-998d-4109-b26a-0d6e28152932'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 21:38:53 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-28368881-624d-42e3-9cff-9890e138da56 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:38:53 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-28368881-624d-42e3-9cff-9890e138da56 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:38:53 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-28368881-624d-42e3-9cff-9890e138da56 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 21:38:53 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-28368881-624d-42e3-9cff-9890e138da56 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] CPU controller missing on host. {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 21:38:53 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-28368881-624d-42e3-9cff-9890e138da56 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 21:38:53 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-28368881-624d-42e3-9cff-9890e138da56 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] CPU controller found on host. {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 21:38:54 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-28368881-624d-42e3-9cff-9890e138da56 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 21:38:54 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-28368881-624d-42e3-9cff-9890e138da56 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T21:29:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T21:29:21Z,direct_url=<?>,disk_format='qcow2',id=d859d89d-998d-4109-b26a-0d6e28152932,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ff43462300764979a6cf688444336a56',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T21:29:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 21:38:54 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-28368881-624d-42e3-9cff-9890e138da56 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Flavor limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 21:38:54 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-28368881-624d-42e3-9cff-9890e138da56 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Image limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 21:38:54 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-28368881-624d-42e3-9cff-9890e138da56 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Flavor pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 21:38:54 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-28368881-624d-42e3-9cff-9890e138da56 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Image pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 21:38:54 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-28368881-624d-42e3-9cff-9890e138da56 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 21:38:54 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-28368881-624d-42e3-9cff-9890e138da56 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 21:38:54 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-28368881-624d-42e3-9cff-9890e138da56 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 21:38:54 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-28368881-624d-42e3-9cff-9890e138da56 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Got 1 possible topologies {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 21:38:54 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-28368881-624d-42e3-9cff-9890e138da56 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 21:38:54 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-28368881-624d-42e3-9cff-9890e138da56 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 21:38:54 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-28368881-624d-42e3-9cff-9890e138da56 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:38:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-202634150',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-202634150',id=15,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83b85c4f783a4ee7ab67422b49da85ca',ramdisk_id='',reservation_id='r-fxhna0bf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1944032280',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:38:51Z,user_data=None,user_id='a2e424dd3c684c808de14c2a9c3c1ed6',uuid=1189976f-8d02-468d-8fa7-bd5594c5f85a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c888931-1180-4efd-8ca1-a57252bf8dc5", "address": "fa:16:3e:f9:a2:b8", "network": {"id": "5f62b1d8-d5d0-4ff9-922b-fc6e72fb640d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-655282105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b85c4f783a4ee7ab67422b49da85ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c888931-11", "ovs_interfaceid": "9c888931-1180-4efd-8ca1-a57252bf8dc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 21:38:54 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-28368881-624d-42e3-9cff-9890e138da56 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Converting VIF {"id": "9c888931-1180-4efd-8ca1-a57252bf8dc5", "address": "fa:16:3e:f9:a2:b8", "network": {"id": "5f62b1d8-d5d0-4ff9-922b-fc6e72fb640d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-655282105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b85c4f783a4ee7ab67422b49da85ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c888931-11", "ovs_interfaceid": "9c888931-1180-4efd-8ca1-a57252bf8dc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:38:54 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-28368881-624d-42e3-9cff-9890e138da56 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:a2:b8,bridge_name='br-int',has_traffic_filtering=True,id=9c888931-1180-4efd-8ca1-a57252bf8dc5,network=Network(5f62b1d8-d5d0-4ff9-922b-fc6e72fb640d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c888931-11') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:38:54 user nova-compute[74337]: DEBUG nova.objects.instance [None req-28368881-624d-42e3-9cff-9890e138da56 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lazy-loading 'pci_devices' on Instance uuid 1189976f-8d02-468d-8fa7-bd5594c5f85a {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:38:54 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-28368881-624d-42e3-9cff-9890e138da56 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: 1189976f-8d02-468d-8fa7-bd5594c5f85a] End _get_guest_xml xml=<domain type="kvm">
Oct 23 21:38:54 user nova-compute[74337]:   <uuid>1189976f-8d02-468d-8fa7-bd5594c5f85a</uuid>
Oct 23 21:38:54 user nova-compute[74337]:   <name>instance-0000000f</name>
Oct 23 21:38:54 user nova-compute[74337]:   <memory>524288</memory>
Oct 23 21:38:54 user nova-compute[74337]:   <vcpu>1</vcpu>
Oct 23 21:38:54 user nova-compute[74337]:   <metadata>
Oct 23 21:38:54 user nova-compute[74337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 21:38:54 user nova-compute[74337]:       <nova:package version="0.0.0"/>
Oct 23 21:38:54 user nova-compute[74337]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-202634150</nova:name>
Oct 23 21:38:54 user nova-compute[74337]:       <nova:creationTime>2023-10-23 21:38:53</nova:creationTime>
Oct 23 21:38:54 user nova-compute[74337]:       <nova:flavor name="m1.tiny">
Oct 23 21:38:54 user nova-compute[74337]:         <nova:memory>512</nova:memory>
Oct 23 21:38:54 user nova-compute[74337]:         <nova:disk>1</nova:disk>
Oct 23 21:38:54 user nova-compute[74337]:         <nova:swap>0</nova:swap>
Oct 23 21:38:54 user nova-compute[74337]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 21:38:54 user nova-compute[74337]:         <nova:vcpus>1</nova:vcpus>
Oct 23 21:38:54 user nova-compute[74337]:       </nova:flavor>
Oct 23 21:38:54 user nova-compute[74337]:       <nova:owner>
Oct 23 21:38:54 user nova-compute[74337]:         <nova:user uuid="a2e424dd3c684c808de14c2a9c3c1ed6">tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member</nova:user>
Oct 23 21:38:54 user nova-compute[74337]:         <nova:project uuid="83b85c4f783a4ee7ab67422b49da85ca">tempest-ServerBootFromVolumeStableRescueTest-1944032280</nova:project>
Oct 23 21:38:54 user nova-compute[74337]:       </nova:owner>
Oct 23 21:38:54 user nova-compute[74337]:       <nova:root type="image" uuid="d859d89d-998d-4109-b26a-0d6e28152932"/>
Oct 23 21:38:54 user nova-compute[74337]:       <nova:ports>
Oct 23 21:38:54 user nova-compute[74337]:         <nova:port uuid="9c888931-1180-4efd-8ca1-a57252bf8dc5">
Oct 23 21:38:54 user nova-compute[74337]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 23 21:38:54 user nova-compute[74337]:         </nova:port>
Oct 23 21:38:54 user nova-compute[74337]:       </nova:ports>
Oct 23 21:38:54 user nova-compute[74337]:     </nova:instance>
Oct 23 21:38:54 user nova-compute[74337]:   </metadata>
Oct 23 21:38:54 user nova-compute[74337]:   <sysinfo type="smbios">
Oct 23 21:38:54 user nova-compute[74337]:     <system>
Oct 23 21:38:54 user nova-compute[74337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 21:38:54 user nova-compute[74337]:       <entry name="product">OpenStack Nova</entry>
Oct 23 21:38:54 user nova-compute[74337]:       <entry name="version">0.0.0</entry>
Oct 23 21:38:54 user nova-compute[74337]:       <entry name="serial">1189976f-8d02-468d-8fa7-bd5594c5f85a</entry>
Oct 23 21:38:54 user nova-compute[74337]:       <entry name="uuid">1189976f-8d02-468d-8fa7-bd5594c5f85a</entry>
Oct 23 21:38:54 user nova-compute[74337]:       <entry name="family">Virtual Machine</entry>
Oct 23 21:38:54 user nova-compute[74337]:     </system>
Oct 23 21:38:54 user nova-compute[74337]:   </sysinfo>
Oct 23 21:38:54 user nova-compute[74337]:   <os>
Oct 23 21:38:54 user nova-compute[74337]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 21:38:54 user nova-compute[74337]:     <boot dev="hd"/>
Oct 23 21:38:54 user nova-compute[74337]:     <smbios mode="sysinfo"/>
Oct 23 21:38:54 user nova-compute[74337]:   </os>
Oct 23 21:38:54 user nova-compute[74337]:   <features>
Oct 23 21:38:54 user nova-compute[74337]:     <acpi/>
Oct 23 21:38:54 user nova-compute[74337]:     <apic/>
Oct 23 21:38:54 user nova-compute[74337]:     <vmcoreinfo/>
Oct 23 21:38:54 user nova-compute[74337]:   </features>
Oct 23 21:38:54 user nova-compute[74337]:   <clock offset="utc">
Oct 23 21:38:54 user nova-compute[74337]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 21:38:54 user nova-compute[74337]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 21:38:54 user nova-compute[74337]:     <timer name="hpet" present="no"/>
Oct 23 21:38:54 user nova-compute[74337]:   </clock>
Oct 23 21:38:54 user nova-compute[74337]:   <cpu mode="custom" match="exact">
Oct 23 21:38:54 user nova-compute[74337]:     <model>Nehalem</model>
Oct 23 21:38:54 user nova-compute[74337]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 21:38:54 user nova-compute[74337]:   </cpu>
Oct 23 21:38:54 user nova-compute[74337]:   <devices>
Oct 23 21:38:54 user nova-compute[74337]:     <disk type="file" device="disk">
Oct 23 21:38:54 user nova-compute[74337]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 21:38:54 user nova-compute[74337]:       <source file="/opt/stack/data/nova/instances/1189976f-8d02-468d-8fa7-bd5594c5f85a/disk"/>
Oct 23 21:38:54 user nova-compute[74337]:       <target dev="vda" bus="virtio"/>
Oct 23 21:38:54 user nova-compute[74337]:     </disk>
Oct 23 21:38:54 user nova-compute[74337]:     <interface type="ethernet">
Oct 23 21:38:54 user nova-compute[74337]:       <mac address="fa:16:3e:f9:a2:b8"/>
Oct 23 21:38:54 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:38:54 user nova-compute[74337]:       <mtu size="1442"/>
Oct 23 21:38:54 user nova-compute[74337]:       <target dev="tap9c888931-11"/>
Oct 23 21:38:54 user nova-compute[74337]:     </interface>
Oct 23 21:38:54 user nova-compute[74337]:     <serial type="pty">
Oct 23 21:38:54 user nova-compute[74337]:       <log file="/opt/stack/data/nova/instances/1189976f-8d02-468d-8fa7-bd5594c5f85a/console.log" append="off"/>
Oct 23 21:38:54 user nova-compute[74337]:     </serial>
Oct 23 21:38:54 user nova-compute[74337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 21:38:54 user nova-compute[74337]:     <video>
Oct 23 21:38:54 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:38:54 user nova-compute[74337]:     </video>
Oct 23 21:38:54 user nova-compute[74337]:     <rng model="virtio">
Oct 23 21:38:54 user nova-compute[74337]:       <backend model="random">/dev/urandom</backend>
Oct 23 21:38:54 user nova-compute[74337]:     </rng>
Oct 23 21:38:54 user nova-compute[74337]:     <controller type="usb" index="0" model="none"/>
Oct 23 21:38:54 user nova-compute[74337]:     <memballoon model="virtio">
Oct 23 21:38:54 user nova-compute[74337]:       <stats period="10"/>
Oct 23 21:38:54 user nova-compute[74337]:     </memballoon>
Oct 23 21:38:54 user nova-compute[74337]:   </devices>
Oct 23 21:38:54 user nova-compute[74337]: </domain>
Oct 23 21:38:54 user nova-compute[74337]:  {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 21:38:54 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-28368881-624d-42e3-9cff-9890e138da56 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:38:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-202634150',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-202634150',id=15,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83b85c4f783a4ee7ab67422b49da85ca',ramdisk_id='',reservation_id='r-fxhna0bf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1944032280',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:38:51Z,user_data=None,user_id='a2e424dd3c684c808de14c2a9c3c1ed6',uuid=1189976f-8d02-468d-8fa7-bd5594c5f85a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c888931-1180-4efd-8ca1-a57252bf8dc5", "address": "fa:16:3e:f9:a2:b8", "network": {"id": "5f62b1d8-d5d0-4ff9-922b-fc6e72fb640d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-655282105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b85c4f783a4ee7ab67422b49da85ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c888931-11", "ovs_interfaceid": "9c888931-1180-4efd-8ca1-a57252bf8dc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 21:38:54 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-28368881-624d-42e3-9cff-9890e138da56 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Converting VIF {"id": "9c888931-1180-4efd-8ca1-a57252bf8dc5", "address": "fa:16:3e:f9:a2:b8", "network": {"id": "5f62b1d8-d5d0-4ff9-922b-fc6e72fb640d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-655282105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b85c4f783a4ee7ab67422b49da85ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c888931-11", "ovs_interfaceid": "9c888931-1180-4efd-8ca1-a57252bf8dc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:38:54 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-28368881-624d-42e3-9cff-9890e138da56 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:a2:b8,bridge_name='br-int',has_traffic_filtering=True,id=9c888931-1180-4efd-8ca1-a57252bf8dc5,network=Network(5f62b1d8-d5d0-4ff9-922b-fc6e72fb640d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c888931-11') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:38:54 user nova-compute[74337]: DEBUG os_vif [None req-28368881-624d-42e3-9cff-9890e138da56 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:a2:b8,bridge_name='br-int',has_traffic_filtering=True,id=9c888931-1180-4efd-8ca1-a57252bf8dc5,network=Network(5f62b1d8-d5d0-4ff9-922b-fc6e72fb640d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c888931-11') {{(pid=74337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 21:38:54 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:38:54 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:38:54 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 21:38:54 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:38:54 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a7e89fcf-89c9-5959-ace6-2a49374b4528', '_type': 'linux-noop'}}, row=False) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:38:54 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:38:54 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:38:54 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:38:54 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:38:54 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9c888931-11, may_exist=True, interface_attrs={}) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:38:54 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9c888931-11, col_values=(('qos', UUID('3e8a610d-f878-4de6-b660-16f45796e31f')),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:38:54 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9c888931-11, col_values=(('external_ids', {'iface-id': '9c888931-1180-4efd-8ca1-a57252bf8dc5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f9:a2:b8', 'vm-uuid': '1189976f-8d02-468d-8fa7-bd5594c5f85a'}),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:38:54 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:38:54 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:38:54 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:38:54 user nova-compute[74337]: INFO os_vif [None req-28368881-624d-42e3-9cff-9890e138da56 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:a2:b8,bridge_name='br-int',has_traffic_filtering=True,id=9c888931-1180-4efd-8ca1-a57252bf8dc5,network=Network(5f62b1d8-d5d0-4ff9-922b-fc6e72fb640d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c888931-11')
Oct 23 21:38:54 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-28368881-624d-42e3-9cff-9890e138da56 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] No BDM found with device name vda, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 21:38:54 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-28368881-624d-42e3-9cff-9890e138da56 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] No VIF found with MAC fa:16:3e:f9:a2:b8, not building metadata {{(pid=74337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 21:38:54 user nova-compute[74337]: DEBUG nova.network.neutron [None req-13b10d14-cfd0-42e9-a392-382fe98cdee4 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938] Updating instance_info_cache with network_info: [{"id": "9034e8d2-9a0e-42b6-9a38-49877881f0d3", "address": "fa:16:3e:43:34:d0", "network": {"id": "0feb8c56-c17f-47d0-9796-91d4bd20e81d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1399506675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd8afde978624cf8a2356e8ce8b4d3f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9034e8d2-9a", "ovs_interfaceid": "9034e8d2-9a0e-42b6-9a38-49877881f0d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:38:54 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-13b10d14-cfd0-42e9-a392-382fe98cdee4 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Releasing lock "refresh_cache-00f757cf-e5dd-476f-81c6-670ed2bf6938" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:38:54 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:38:54 user nova-compute[74337]: DEBUG nova.network.neutron [req-70fdb880-38bb-4ce8-9fd2-f4576107ec41 req-d3ff1887-e190-4693-8f19-2df67fc69369 service nova] [instance: 1189976f-8d02-468d-8fa7-bd5594c5f85a] Updated VIF entry in instance network info cache for port 9c888931-1180-4efd-8ca1-a57252bf8dc5. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 21:38:54 user nova-compute[74337]: DEBUG nova.network.neutron [req-70fdb880-38bb-4ce8-9fd2-f4576107ec41 req-d3ff1887-e190-4693-8f19-2df67fc69369 service nova] [instance: 1189976f-8d02-468d-8fa7-bd5594c5f85a] Updating instance_info_cache with network_info: [{"id": "9c888931-1180-4efd-8ca1-a57252bf8dc5", "address": "fa:16:3e:f9:a2:b8", "network": {"id": "5f62b1d8-d5d0-4ff9-922b-fc6e72fb640d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-655282105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b85c4f783a4ee7ab67422b49da85ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c888931-11", "ovs_interfaceid": "9c888931-1180-4efd-8ca1-a57252bf8dc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:38:54 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-70fdb880-38bb-4ce8-9fd2-f4576107ec41 req-d3ff1887-e190-4693-8f19-2df67fc69369 service nova] Releasing lock "refresh_cache-1189976f-8d02-468d-8fa7-bd5594c5f85a" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:38:55 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938] Instance destroyed successfully.
Oct 23 21:38:55 user nova-compute[74337]: DEBUG nova.objects.instance [None req-13b10d14-cfd0-42e9-a392-382fe98cdee4 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Lazy-loading 'resources' on Instance uuid 00f757cf-e5dd-476f-81c6-670ed2bf6938 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:38:55 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-13b10d14-cfd0-42e9-a392-382fe98cdee4 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:36:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-333947415',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-333947415',id=12,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMRrEl7LEoNd8U+hfyJLPPNLjY7QCrquZZ9/0Pwg7nr+hXI91t4451IRFet8aERqxR96rboEIpSmotN9ndjRC9k4yeRPFf2e3MGh0dPoW6GW/TMDKJ4wkCSx2cWsJY9rWA==',key_name='tempest-keypair-1196853898',keypairs=<?>,launch_index=0,launched_at=2023-10-23T21:36:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='dd8afde978624cf8a2356e8ce8b4d3f2',ramdisk_id='',reservation_id='r-cg9v0l0q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-338191707',owner_user_name='tempest-AttachVolumeShelveTestJSON-338191707-project-member',shelved_at='2023-10-23T21:38:52.938817',shelved_host='user',shelved_image_id='1b3c196c-07ba-4f1a-acac-6cf43ef55d4b'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T21:38:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ddd5c407fbe440e85111213c4c2dd46',uuid=00f757cf-e5dd-476f-81c6-670ed2bf6938,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "9034e8d2-9a0e-42b6-9a38-49877881f0d3", "address": "fa:16:3e:43:34:d0", "network": {"id": "0feb8c56-c17f-47d0-9796-91d4bd20e81d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1399506675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd8afde978624cf8a2356e8ce8b4d3f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9034e8d2-9a", "ovs_interfaceid": "9034e8d2-9a0e-42b6-9a38-49877881f0d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 21:38:55 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-13b10d14-cfd0-42e9-a392-382fe98cdee4 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Converting VIF {"id": "9034e8d2-9a0e-42b6-9a38-49877881f0d3", "address": "fa:16:3e:43:34:d0", "network": {"id": "0feb8c56-c17f-47d0-9796-91d4bd20e81d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1399506675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd8afde978624cf8a2356e8ce8b4d3f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9034e8d2-9a", "ovs_interfaceid": "9034e8d2-9a0e-42b6-9a38-49877881f0d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:38:55 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-13b10d14-cfd0-42e9-a392-382fe98cdee4 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:34:d0,bridge_name='br-int',has_traffic_filtering=True,id=9034e8d2-9a0e-42b6-9a38-49877881f0d3,network=Network(0feb8c56-c17f-47d0-9796-91d4bd20e81d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9034e8d2-9a') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:38:55 user nova-compute[74337]: DEBUG os_vif [None req-13b10d14-cfd0-42e9-a392-382fe98cdee4 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:34:d0,bridge_name='br-int',has_traffic_filtering=True,id=9034e8d2-9a0e-42b6-9a38-49877881f0d3,network=Network(0feb8c56-c17f-47d0-9796-91d4bd20e81d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9034e8d2-9a') {{(pid=74337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 21:38:55 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:38:55 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9034e8d2-9a, bridge=br-int, if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:38:55 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:38:55 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:38:55 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:38:55 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:38:55 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8d1b8db3-70de-4cb2-b32c-bbe2796d31ad) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:38:55 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:38:55 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:38:55 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:38:55 user nova-compute[74337]: INFO os_vif [None req-13b10d14-cfd0-42e9-a392-382fe98cdee4 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:34:d0,bridge_name='br-int',has_traffic_filtering=True,id=9034e8d2-9a0e-42b6-9a38-49877881f0d3,network=Network(0feb8c56-c17f-47d0-9796-91d4bd20e81d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9034e8d2-9a')
Oct 23 21:38:55 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-13b10d14-cfd0-42e9-a392-382fe98cdee4 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938] Deleting instance files /opt/stack/data/nova/instances/00f757cf-e5dd-476f-81c6-670ed2bf6938_del
Oct 23 21:38:55 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-13b10d14-cfd0-42e9-a392-382fe98cdee4 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938] Deletion of /opt/stack/data/nova/instances/00f757cf-e5dd-476f-81c6-670ed2bf6938_del complete
Oct 23 21:38:55 user nova-compute[74337]: INFO nova.scheduler.client.report [None req-13b10d14-cfd0-42e9-a392-382fe98cdee4 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Deleted allocations for instance 00f757cf-e5dd-476f-81c6-670ed2bf6938
Oct 23 21:38:55 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-13b10d14-cfd0-42e9-a392-382fe98cdee4 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:38:55 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-13b10d14-cfd0-42e9-a392-382fe98cdee4 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:38:55 user nova-compute[74337]: DEBUG nova.objects.instance [None req-13b10d14-cfd0-42e9-a392-382fe98cdee4 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Lazy-loading 'numa_topology' on Instance uuid 00f757cf-e5dd-476f-81c6-670ed2bf6938 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:38:55 user nova-compute[74337]: DEBUG nova.objects.base [None req-13b10d14-cfd0-42e9-a392-382fe98cdee4 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Object Instance<00f757cf-e5dd-476f-81c6-670ed2bf6938> lazy-loaded attributes: resources,numa_topology {{(pid=74337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 21:38:56 user nova-compute[74337]: DEBUG nova.compute.manager [req-eae772ad-3b90-4b0e-8688-e993dde9c222 req-faf33c4c-7818-46a4-8da4-56c92482b9bd service nova] [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938] Received event network-changed-9034e8d2-9a0e-42b6-9a38-49877881f0d3 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:38:56 user nova-compute[74337]: DEBUG nova.compute.manager [req-eae772ad-3b90-4b0e-8688-e993dde9c222 req-faf33c4c-7818-46a4-8da4-56c92482b9bd service nova] [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938] Refreshing instance network info cache due to event network-changed-9034e8d2-9a0e-42b6-9a38-49877881f0d3. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 21:38:56 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-eae772ad-3b90-4b0e-8688-e993dde9c222 req-faf33c4c-7818-46a4-8da4-56c92482b9bd service nova] Acquiring lock "refresh_cache-00f757cf-e5dd-476f-81c6-670ed2bf6938" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:38:56 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-eae772ad-3b90-4b0e-8688-e993dde9c222 req-faf33c4c-7818-46a4-8da4-56c92482b9bd service nova] Acquired lock "refresh_cache-00f757cf-e5dd-476f-81c6-670ed2bf6938" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:38:56 user nova-compute[74337]: DEBUG nova.network.neutron [req-eae772ad-3b90-4b0e-8688-e993dde9c222 req-faf33c4c-7818-46a4-8da4-56c92482b9bd service nova] [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938] Refreshing network info cache for port 9034e8d2-9a0e-42b6-9a38-49877881f0d3 {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 21:38:56 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:38:56 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:38:56 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:38:56 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-13b10d14-cfd0-42e9-a392-382fe98cdee4 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:38:56 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-13b10d14-cfd0-42e9-a392-382fe98cdee4 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:38:56 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-13b10d14-cfd0-42e9-a392-382fe98cdee4 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.074s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:38:56 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:38:56 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-13b10d14-cfd0-42e9-a392-382fe98cdee4 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Lock "00f757cf-e5dd-476f-81c6-670ed2bf6938" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 9.556s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:38:56 user nova-compute[74337]: DEBUG nova.network.neutron [req-eae772ad-3b90-4b0e-8688-e993dde9c222 req-faf33c4c-7818-46a4-8da4-56c92482b9bd service nova] [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938] Updated VIF entry in instance network info cache for port 9034e8d2-9a0e-42b6-9a38-49877881f0d3. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 21:38:56 user nova-compute[74337]: DEBUG nova.network.neutron [req-eae772ad-3b90-4b0e-8688-e993dde9c222 req-faf33c4c-7818-46a4-8da4-56c92482b9bd service nova] [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938] Updating instance_info_cache with network_info: [{"id": "9034e8d2-9a0e-42b6-9a38-49877881f0d3", "address": "fa:16:3e:43:34:d0", "network": {"id": "0feb8c56-c17f-47d0-9796-91d4bd20e81d", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1399506675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd8afde978624cf8a2356e8ce8b4d3f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap9034e8d2-9a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:38:56 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-eae772ad-3b90-4b0e-8688-e993dde9c222 req-faf33c4c-7818-46a4-8da4-56c92482b9bd service nova] Releasing lock "refresh_cache-00f757cf-e5dd-476f-81c6-670ed2bf6938" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:38:56 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:38:56 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:38:56 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:38:56 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:38:57 user nova-compute[74337]: DEBUG nova.compute.manager [req-f5612a3f-33a8-440a-bad1-92b2ee97bbc4 req-8c92aa7f-54f7-4e10-98b5-27dee7fc0028 service nova] [instance: 1189976f-8d02-468d-8fa7-bd5594c5f85a] Received event network-vif-plugged-9c888931-1180-4efd-8ca1-a57252bf8dc5 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:38:57 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-f5612a3f-33a8-440a-bad1-92b2ee97bbc4 req-8c92aa7f-54f7-4e10-98b5-27dee7fc0028 service nova] Acquiring lock "1189976f-8d02-468d-8fa7-bd5594c5f85a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:38:57 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-f5612a3f-33a8-440a-bad1-92b2ee97bbc4 req-8c92aa7f-54f7-4e10-98b5-27dee7fc0028 service nova] Lock "1189976f-8d02-468d-8fa7-bd5594c5f85a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:38:57 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-f5612a3f-33a8-440a-bad1-92b2ee97bbc4 req-8c92aa7f-54f7-4e10-98b5-27dee7fc0028 service nova] Lock "1189976f-8d02-468d-8fa7-bd5594c5f85a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:38:57 user nova-compute[74337]: DEBUG nova.compute.manager [req-f5612a3f-33a8-440a-bad1-92b2ee97bbc4 req-8c92aa7f-54f7-4e10-98b5-27dee7fc0028 service nova] [instance: 1189976f-8d02-468d-8fa7-bd5594c5f85a] No waiting events found dispatching network-vif-plugged-9c888931-1180-4efd-8ca1-a57252bf8dc5 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:38:57 user nova-compute[74337]: WARNING nova.compute.manager [req-f5612a3f-33a8-440a-bad1-92b2ee97bbc4 req-8c92aa7f-54f7-4e10-98b5-27dee7fc0028 service nova] [instance: 1189976f-8d02-468d-8fa7-bd5594c5f85a] Received unexpected event network-vif-plugged-9c888931-1180-4efd-8ca1-a57252bf8dc5 for instance with vm_state building and task_state spawning.
Oct 23 21:38:57 user nova-compute[74337]: DEBUG nova.compute.manager [req-f5612a3f-33a8-440a-bad1-92b2ee97bbc4 req-8c92aa7f-54f7-4e10-98b5-27dee7fc0028 service nova] [instance: 1189976f-8d02-468d-8fa7-bd5594c5f85a] Received event network-vif-plugged-9c888931-1180-4efd-8ca1-a57252bf8dc5 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:38:57 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-f5612a3f-33a8-440a-bad1-92b2ee97bbc4 req-8c92aa7f-54f7-4e10-98b5-27dee7fc0028 service nova] Acquiring lock "1189976f-8d02-468d-8fa7-bd5594c5f85a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:38:57 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-f5612a3f-33a8-440a-bad1-92b2ee97bbc4 req-8c92aa7f-54f7-4e10-98b5-27dee7fc0028 service nova] Lock "1189976f-8d02-468d-8fa7-bd5594c5f85a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:38:57 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-f5612a3f-33a8-440a-bad1-92b2ee97bbc4 req-8c92aa7f-54f7-4e10-98b5-27dee7fc0028 service nova] Lock "1189976f-8d02-468d-8fa7-bd5594c5f85a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:38:57 user nova-compute[74337]: DEBUG nova.compute.manager [req-f5612a3f-33a8-440a-bad1-92b2ee97bbc4 req-8c92aa7f-54f7-4e10-98b5-27dee7fc0028 service nova] [instance: 1189976f-8d02-468d-8fa7-bd5594c5f85a] No waiting events found dispatching network-vif-plugged-9c888931-1180-4efd-8ca1-a57252bf8dc5 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:38:57 user nova-compute[74337]: WARNING nova.compute.manager [req-f5612a3f-33a8-440a-bad1-92b2ee97bbc4 req-8c92aa7f-54f7-4e10-98b5-27dee7fc0028 service nova] [instance: 1189976f-8d02-468d-8fa7-bd5594c5f85a] Received unexpected event network-vif-plugged-9c888931-1180-4efd-8ca1-a57252bf8dc5 for instance with vm_state building and task_state spawning.
Oct 23 21:38:58 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:38:58 user nova-compute[74337]: DEBUG nova.compute.manager [None req-28368881-624d-42e3-9cff-9890e138da56 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: 1189976f-8d02-468d-8fa7-bd5594c5f85a] Instance event wait completed in 0 seconds for  {{(pid=74337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 21:38:58 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-28368881-624d-42e3-9cff-9890e138da56 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: 1189976f-8d02-468d-8fa7-bd5594c5f85a] Guest created on hypervisor {{(pid=74337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 21:38:58 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: 1189976f-8d02-468d-8fa7-bd5594c5f85a] Instance spawned successfully.
Oct 23 21:38:58 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-28368881-624d-42e3-9cff-9890e138da56 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: 1189976f-8d02-468d-8fa7-bd5594c5f85a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 21:38:58 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-28368881-624d-42e3-9cff-9890e138da56 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: 1189976f-8d02-468d-8fa7-bd5594c5f85a] Found default for hw_cdrom_bus of ide {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:38:58 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-28368881-624d-42e3-9cff-9890e138da56 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: 1189976f-8d02-468d-8fa7-bd5594c5f85a] Found default for hw_disk_bus of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:38:58 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-28368881-624d-42e3-9cff-9890e138da56 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: 1189976f-8d02-468d-8fa7-bd5594c5f85a] Found default for hw_input_bus of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:38:58 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-28368881-624d-42e3-9cff-9890e138da56 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: 1189976f-8d02-468d-8fa7-bd5594c5f85a] Found default for hw_pointer_model of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:38:58 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-28368881-624d-42e3-9cff-9890e138da56 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: 1189976f-8d02-468d-8fa7-bd5594c5f85a] Found default for hw_video_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:38:58 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-28368881-624d-42e3-9cff-9890e138da56 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: 1189976f-8d02-468d-8fa7-bd5594c5f85a] Found default for hw_vif_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:38:58 user nova-compute[74337]: INFO nova.compute.manager [None req-28368881-624d-42e3-9cff-9890e138da56 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: 1189976f-8d02-468d-8fa7-bd5594c5f85a] Took 7.63 seconds to spawn the instance on the hypervisor.
Oct 23 21:38:58 user nova-compute[74337]: DEBUG nova.compute.manager [None req-28368881-624d-42e3-9cff-9890e138da56 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: 1189976f-8d02-468d-8fa7-bd5594c5f85a] Checking state {{(pid=74337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 21:38:59 user nova-compute[74337]: INFO nova.compute.manager [None req-28368881-624d-42e3-9cff-9890e138da56 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: 1189976f-8d02-468d-8fa7-bd5594c5f85a] Took 8.98 seconds to build instance.
Oct 23 21:38:59 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-28368881-624d-42e3-9cff-9890e138da56 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lock "1189976f-8d02-468d-8fa7-bd5594c5f85a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.086s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:38:59 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:38:59 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:39:00 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:39:00 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:39:00 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:39:00 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 21:39:01 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:39:01 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Starting heal instance info cache {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 21:39:01 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Didn't find any instances for network info cache update. {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 23 21:39:02 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:39:02 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:39:02 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:39:02 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:39:02 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Auditing locally available compute resources for user (node: user) {{(pid=74337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 21:39:02 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d45e8ae8-371b-46ae-849d-d7f7d5bbd770/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:39:02 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d45e8ae8-371b-46ae-849d-d7f7d5bbd770/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:39:02 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d45e8ae8-371b-46ae-849d-d7f7d5bbd770/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:39:03 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d45e8ae8-371b-46ae-849d-d7f7d5bbd770/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:39:03 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:39:03 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:39:03 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:39:03 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:39:03 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:39:03 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 21:39:03 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf6270ba-7a4e-40c4-b7fd-c62a44125c89/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:39:03 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf6270ba-7a4e-40c4-b7fd-c62a44125c89/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:39:03 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf6270ba-7a4e-40c4-b7fd-c62a44125c89/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:39:04 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf6270ba-7a4e-40c4-b7fd-c62a44125c89/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:39:04 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1189976f-8d02-468d-8fa7-bd5594c5f85a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:39:04 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1189976f-8d02-468d-8fa7-bd5594c5f85a/disk --force-share --output=json" returned: 0 in 0.292s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:39:04 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1189976f-8d02-468d-8fa7-bd5594c5f85a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:39:04 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1189976f-8d02-468d-8fa7-bd5594c5f85a/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:39:04 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b193f267-2ca2-47c5-bd6c-397b1e041d4a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:39:04 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b193f267-2ca2-47c5-bd6c-397b1e041d4a/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:39:04 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b193f267-2ca2-47c5-bd6c-397b1e041d4a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:39:05 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:39:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b193f267-2ca2-47c5-bd6c-397b1e041d4a/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:39:05 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:39:05 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:39:05 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Hypervisor/Node resource view: name=user free_ram=8126MB free_disk=25.56625747680664GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 21:39:05 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:39:05 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:39:05 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Applying migration context for instance d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50 as it has an incoming, in-progress migration 07b7bb7a-337b-4151-b2c9-4386a51c5bbf. Migration status is finished {{(pid=74337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 23 21:39:05 user nova-compute[74337]: INFO nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Updating resource usage from migration 07b7bb7a-337b-4151-b2c9-4386a51c5bbf
Oct 23 21:39:06 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance cf6270ba-7a4e-40c4-b7fd-c62a44125c89 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:39:06 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance d45e8ae8-371b-46ae-849d-d7f7d5bbd770 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:39:06 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance b193f267-2ca2-47c5-bd6c-397b1e041d4a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:39:06 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Migration 07b7bb7a-337b-4151-b2c9-4386a51c5bbf is active on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 23 21:39:06 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:39:06 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 2cae5b4d-96a0-41ae-9643-b7bf09581988 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:39:06 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 1189976f-8d02-468d-8fa7-bd5594c5f85a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:39:06 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 21:39:06 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=25GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 21:39:06 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Refreshing inventories for resource provider dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 23 21:39:06 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Updating ProviderTree inventory for provider dfcf3942-a432-4293-945b-14b86f57d794 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 23 21:39:06 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Updating inventory in ProviderTree for provider dfcf3942-a432-4293-945b-14b86f57d794 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 23 21:39:06 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Refreshing aggregate associations for resource provider dfcf3942-a432-4293-945b-14b86f57d794, aggregates: None {{(pid=74337) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 23 21:39:06 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Refreshing trait associations for resource provider dfcf3942-a432-4293-945b-14b86f57d794, traits: COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE2,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE42,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_EXTEND,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_TRUSTED_CERTS {{(pid=74337) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 23 21:39:06 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:39:06 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:39:06 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Compute_service record updated for user:user {{(pid=74337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 21:39:06 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.044s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:39:06 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:39:06 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Cleaning up deleted instances {{(pid=74337) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 23 21:39:06 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] There are 0 instances to clean {{(pid=74337) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 23 21:39:06 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:39:06 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74337) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 23 21:39:07 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:39:07 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:39:07 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:39:10 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:39:13 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:39:15 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:39:16 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:39:17 user nova-compute[74337]: DEBUG nova.network.neutron [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Port 872b2a23-8054-4d26-b798-c0099d1c9a91 binding to destination host user is already ACTIVE {{(pid=74337) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Oct 23 21:39:17 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Acquiring lock "refresh_cache-d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:39:17 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Acquired lock "refresh_cache-d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:39:17 user nova-compute[74337]: DEBUG nova.network.neutron [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Building network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 21:39:18 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:39:18 user nova-compute[74337]: DEBUG nova.network.neutron [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Updating instance_info_cache with network_info: [{"id": "872b2a23-8054-4d26-b798-c0099d1c9a91", "address": "fa:16:3e:30:a6:90", "network": {"id": "b6a24032-0229-4ebe-83a3-8804e494838c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1472404179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17117e60d0d9484d80c0bc8de393921c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap872b2a23-80", "ovs_interfaceid": "872b2a23-8054-4d26-b798-c0099d1c9a91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:39:18 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Releasing lock "refresh_cache-d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:39:18 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Creating tmpfile /opt/stack/data/nova/instances/d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50/tmpl6y7sjrw to verify with other compute node that the instance is on the same shared storage. {{(pid=74337) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Oct 23 21:39:18 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:39:18 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:39:18 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:39:18 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:39:18 user nova-compute[74337]: DEBUG nova.compute.manager [req-b51584a4-bd2f-4ecc-8455-e44f84367a9b req-48b49609-bf96-4b01-abef-9fd6ca21a828 service nova] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Received event network-vif-unplugged-872b2a23-8054-4d26-b798-c0099d1c9a91 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:39:18 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-b51584a4-bd2f-4ecc-8455-e44f84367a9b req-48b49609-bf96-4b01-abef-9fd6ca21a828 service nova] Acquiring lock "d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:39:18 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-b51584a4-bd2f-4ecc-8455-e44f84367a9b req-48b49609-bf96-4b01-abef-9fd6ca21a828 service nova] Lock "d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:39:18 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-b51584a4-bd2f-4ecc-8455-e44f84367a9b req-48b49609-bf96-4b01-abef-9fd6ca21a828 service nova] Lock "d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:39:18 user nova-compute[74337]: DEBUG nova.compute.manager [req-b51584a4-bd2f-4ecc-8455-e44f84367a9b req-48b49609-bf96-4b01-abef-9fd6ca21a828 service nova] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] No waiting events found dispatching network-vif-unplugged-872b2a23-8054-4d26-b798-c0099d1c9a91 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:39:18 user nova-compute[74337]: WARNING nova.compute.manager [req-b51584a4-bd2f-4ecc-8455-e44f84367a9b req-48b49609-bf96-4b01-abef-9fd6ca21a828 service nova] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Received unexpected event network-vif-unplugged-872b2a23-8054-4d26-b798-c0099d1c9a91 for instance with vm_state resized and task_state resize_reverting.
Oct 23 21:39:19 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Instance destroyed successfully.
Oct 23 21:39:19 user nova-compute[74337]: DEBUG nova.objects.instance [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Lazy-loading 'resources' on Instance uuid d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:39:19 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:33:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1887044710',display_name='tempest-ServerActionsTestOtherB-server-1887044710',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1887044710',id=3,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHU30kXpNK56Ek7qPPN2svMqEvJefmquCorzEt/taRsaipSAkpLIVwB8P5vsm9bHgo5LnJ4I5wS/V9f0J2TYkkYbtKjnjylT3HdP3iz0AGKDmStPt9PuAI+hC3gVCHen5Q==',key_name='tempest-keypair-1524952332',keypairs=<?>,launch_index=0,launched_at=2023-10-23T21:38:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='17117e60d0d9484d80c0bc8de393921c',ramdisk_id='',reservation_id='r-1ao5mr6t',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1301864789',owner_user_name='tempest-ServerActionsTestOtherB-1301864789-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T21:38:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='92570d8849c646d882017142cac1b674',uuid=d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "872b2a23-8054-4d26-b798-c0099d1c9a91", "address": "fa:16:3e:30:a6:90", "network": {"id": "b6a24032-0229-4ebe-83a3-8804e494838c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1472404179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17117e60d0d9484d80c0bc8de393921c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap872b2a23-80", "ovs_interfaceid": "872b2a23-8054-4d26-b798-c0099d1c9a91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 21:39:19 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Converting VIF {"id": "872b2a23-8054-4d26-b798-c0099d1c9a91", "address": "fa:16:3e:30:a6:90", "network": {"id": "b6a24032-0229-4ebe-83a3-8804e494838c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1472404179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17117e60d0d9484d80c0bc8de393921c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap872b2a23-80", "ovs_interfaceid": "872b2a23-8054-4d26-b798-c0099d1c9a91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:39:19 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:30:a6:90,bridge_name='br-int',has_traffic_filtering=True,id=872b2a23-8054-4d26-b798-c0099d1c9a91,network=Network(b6a24032-0229-4ebe-83a3-8804e494838c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap872b2a23-80') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:39:19 user nova-compute[74337]: DEBUG os_vif [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:a6:90,bridge_name='br-int',has_traffic_filtering=True,id=872b2a23-8054-4d26-b798-c0099d1c9a91,network=Network(b6a24032-0229-4ebe-83a3-8804e494838c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap872b2a23-80') {{(pid=74337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 21:39:19 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:39:19 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap872b2a23-80, bridge=br-int, if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:39:19 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:39:19 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:39:19 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:39:19 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=24cc337b-4fb3-4d25-a331-a6aa6d5db75b) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:39:19 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:39:19 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:39:19 user nova-compute[74337]: INFO os_vif [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:a6:90,bridge_name='br-int',has_traffic_filtering=True,id=872b2a23-8054-4d26-b798-c0099d1c9a91,network=Network(b6a24032-0229-4ebe-83a3-8804e494838c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap872b2a23-80')
Oct 23 21:39:19 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] calling os-brick to detach iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 21:39:19 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, {'target_iqn': 'iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cQHBUDwS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:39:19 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:39:19 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:39:19 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:39:19 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:39:19 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:39:19 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[48acdf79-689c-4b5d-9537-093d68084d5d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:39:19 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 21:39:19 user nova-compute[74337]: No targets found.
Oct 23 21:39:19 user nova-compute[74337]: iSNS:
Oct 23 21:39:19 user nova-compute[74337]: No targets found.
Oct 23 21:39:19 user nova-compute[74337]: STATIC:
Oct 23 21:39:19 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522
Oct 23 21:39:19 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:39:19 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:39:19 user nova-compute[74337]: FIRMWARE:
Oct 23 21:39:19 user nova-compute[74337]: No targets found.
Oct 23 21:39:19 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:39:19 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 21:39:19 user nova-compute[74337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 21:39:19 user nova-compute[74337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 21:39:19 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522', 0)] {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 21:39:19 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:39:19 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:39:19 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9489ef6-6545-4337-9c3c-a37f6d080b7a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:39:19 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:39:19 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:39:19 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a68ed3df-2394-41e6-8a5e-e3d8f4beb82e]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:39:19 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 (non-flash)
Oct 23 21:39:19 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:39:19 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 (non-flash)
Oct 23 21:39:19 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:39:19 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5eec3b8f70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522'): ({'sdb'}, set())}) {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 21:39:19 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Removing single pathed devices sdb {{(pid=74337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 21:39:19 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:39:19 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:39:19 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6ad4d6b-73cd-4bd5-be8f-80a624c76b3c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:39:19 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:39:19 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:39:19 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d4efc95-ce80-4ba5-9063-900c3433e4a9]: (4, ('ok\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:39:19 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Flushing IO for device /dev/sdb {{(pid=74337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 21:39:19 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:39:19 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:39:19 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e70cc78-8732-496a-9c5c-a4b8f01f93be]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:39:19 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 21:39:19 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:39:19 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.055s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:39:19 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[25183c1b-88a0-439b-a1fc-a0b700e2ce7e]: (4, ('1', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:39:19 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 21:39:19 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] SCSI volumes sdb have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 21:39:19 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522')] {{(pid=74337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 21:39:19 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:39:19 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:39:19 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[9974853c-81a1-4d50-8bd7-5b36feca0865]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:39:19 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:39:19 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 -p 172.16.0.220:3260 --logout {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:39:19 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:39:19 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d762352f-96e7-4372-9f7d-8bd4de3043af]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:39:19 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522, portal: 172.16.0.220,3260]
Oct 23 21:39:19 user nova-compute[74337]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522, portal: 172.16.0.220,3260] successful.
Oct 23 21:39:19 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:39:19 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 -p 172.16.0.220:3260 --op delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:39:19 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:39:19 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab46976f-a27b-4521-ab61-093997a92561]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:39:19 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:39:19 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:39:19 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] <== disconnect_volume: return (342ms) None {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:39:19 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Disconnected iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 21:39:20 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:39:20 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:39:20 user nova-compute[74337]: DEBUG nova.objects.instance [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Lazy-loading 'migration_context' on Instance uuid d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:39:20 user nova-compute[74337]: DEBUG nova.objects.base [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Object Instance<d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50> lazy-loaded attributes: resources,migration_context {{(pid=74337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 21:39:20 user nova-compute[74337]: DEBUG nova.compute.manager [req-65493d3e-ba42-4c36-9d4f-2983bdc6a50a req-cee1a7fd-2e5d-4136-881d-4ae8f0c7c7b6 service nova] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Received event network-vif-plugged-872b2a23-8054-4d26-b798-c0099d1c9a91 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:39:20 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-65493d3e-ba42-4c36-9d4f-2983bdc6a50a req-cee1a7fd-2e5d-4136-881d-4ae8f0c7c7b6 service nova] Acquiring lock "d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:39:20 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-65493d3e-ba42-4c36-9d4f-2983bdc6a50a req-cee1a7fd-2e5d-4136-881d-4ae8f0c7c7b6 service nova] Lock "d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:39:20 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-65493d3e-ba42-4c36-9d4f-2983bdc6a50a req-cee1a7fd-2e5d-4136-881d-4ae8f0c7c7b6 service nova] Lock "d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:39:20 user nova-compute[74337]: DEBUG nova.compute.manager [req-65493d3e-ba42-4c36-9d4f-2983bdc6a50a req-cee1a7fd-2e5d-4136-881d-4ae8f0c7c7b6 service nova] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] No waiting events found dispatching network-vif-plugged-872b2a23-8054-4d26-b798-c0099d1c9a91 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:39:20 user nova-compute[74337]: WARNING nova.compute.manager [req-65493d3e-ba42-4c36-9d4f-2983bdc6a50a req-cee1a7fd-2e5d-4136-881d-4ae8f0c7c7b6 service nova] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Received unexpected event network-vif-plugged-872b2a23-8054-4d26-b798-c0099d1c9a91 for instance with vm_state resized and task_state resize_reverting.
Oct 23 21:39:20 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:39:21 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:39:21 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.440s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:39:21 user nova-compute[74337]: INFO nova.compute.manager [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Swapping old allocation on dict_keys(['dfcf3942-a432-4293-945b-14b86f57d794']) held by migration 07b7bb7a-337b-4151-b2c9-4386a51c5bbf for instance
Oct 23 21:39:21 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Overwriting current allocation {'allocations': {'dfcf3942-a432-4293-945b-14b86f57d794': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 19}}, 'project_id': '17117e60d0d9484d80c0bc8de393921c', 'user_id': '92570d8849c646d882017142cac1b674', 'consumer_generation': 1} on consumer d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50 {{(pid=74337) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Oct 23 21:39:21 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:39:21 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Acquiring lock "refresh_cache-d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:39:21 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Acquired lock "refresh_cache-d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:39:21 user nova-compute[74337]: DEBUG nova.network.neutron [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Building network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 21:39:22 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:39:22 user nova-compute[74337]: DEBUG nova.network.neutron [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Updating instance_info_cache with network_info: [{"id": "872b2a23-8054-4d26-b798-c0099d1c9a91", "address": "fa:16:3e:30:a6:90", "network": {"id": "b6a24032-0229-4ebe-83a3-8804e494838c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1472404179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17117e60d0d9484d80c0bc8de393921c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap872b2a23-80", "ovs_interfaceid": "872b2a23-8054-4d26-b798-c0099d1c9a91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:39:22 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Releasing lock "refresh_cache-d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:39:22 user nova-compute[74337]: DEBUG os_brick.utils [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:39:22 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:39:22 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:39:22 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[7466a7e8-3eb7-4e9c-b51e-dab5fe18a2ee]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f34011b66e40\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:39:22 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:39:22 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:39:22 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aeddf44-5ec9-496d-9deb-b8f0b43cf838]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:39:22 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:39:22 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:39:22 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9c85fee-0e25-4b72-9bd5-d17d18473d84]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:39:22 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea4d1553-88b0-4271-9ad1-c6e954f4ef74]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:39:22 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Running cmd (subprocess): nvme version {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:39:22 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] 'nvme version' failed. Not Retrying. {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 21:39:22 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] nvme not present on system {{(pid=74337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 21:39:22 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:39:22 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 21:39:22 user nova-compute[74337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 21:39:22 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[110bc8f4-87ad-491f-99dc-6ba1c17b9c0a]: (4, '') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:39:22 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 21:39:22 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 21:39:22 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] LIGHTOS: no hostnqn found. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 21:39:22 user nova-compute[74337]: DEBUG os_brick.utils [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f34011b66e40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:39:22 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:39:23 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:39:24 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:39:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:39:27 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:39:28 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:39:29 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:39:30 user nova-compute[74337]: DEBUG nova.compute.manager [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Start spawning the instance on the hypervisor. {{(pid=74337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 21:39:30 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Creating instance directory {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 21:39:30 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Creating image(s)
Oct 23 21:39:30 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Did not create local disks {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 23 21:39:30 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Ensure instance console log exists: /opt/stack/data/nova/instances/2cae5b4d-96a0-41ae-9643-b7bf09581988/console.log {{(pid=74337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 21:39:30 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:39:30 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:39:30 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:39:30 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Start _get_guest_xml network_info=[{"id": "fc418a9a-364a-4e52-a073-58a567680beb", "address": "fa:16:3e:5b:b9:06", "network": {"id": "e3ef8fef-f49d-46a8-b357-1ee41c4a17e4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-952280610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3abafb229d604b65a3fb50f0eebc70ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc418a9a-36", "ovs_interfaceid": "fc418a9a-364a-4e52-a073-58a567680beb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'f2bf9331-83f3-4e96-aa53-070ac62c5bd1', 'delete_on_termination': True, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aMCXtGKR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2cae5b4d-96a0-41ae-9643-b7bf09581988', 'attached_at': '', 'detached_at': '', 'volume_id': 'f45407b0-0f4c-4120-8ef2-812f51f88f01', 'serial': 'f45407b0-0f4c-4120-8ef2-812f51f88f01'}, 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 21:39:30 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:39:30 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:39:30 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 21:39:30 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] CPU controller missing on host. {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 21:39:30 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 21:39:30 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] CPU controller found on host. {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 21:39:30 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 21:39:30 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T21:29:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 21:39:30 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Flavor limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 21:39:30 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Image limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 21:39:30 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Flavor pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 21:39:30 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Image pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 21:39:30 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 21:39:30 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 21:39:30 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 21:39:30 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Got 1 possible topologies {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 21:39:30 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 21:39:30 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 21:39:30 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Calling os-brick to attach iSCSI Volume {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 21:39:30 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aMCXtGKR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:39:30 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:39:30 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:39:30 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:39:30 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:39:30 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:39:30 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:39:30 user nova-compute[74337]: INFO os_brick.initiator.connectors.iscsi [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 21:39:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01 -p 172.16.0.220:3260 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:39:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:39:30 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[041da840-7c81-4be8-b9cf-e367a4f78680]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:39:30 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 21:39:30 user nova-compute[74337]:  {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:39:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01 -p 172.16.0.220:3260 --interface default --op new {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:39:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:39:30 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ab2421f-929d-4650-aa82-c38c1e572e2a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01] added\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:39:30 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01] added
Oct 23 21:39:30 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:39:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:39:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.035s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:39:30 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c664d284-6839-4a56-a9c7-90c569e1c754]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:39:30 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:39:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:39:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:39:30 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[257ea2ea-f96c-4475-90c3-7df0641f1188]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:39:30 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:39:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aMCXtGKR {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:39:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aMCXtGKR" returned: 0 in 0.021s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:39:30 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd4bed3c-49dc-41dd-b71a-7e2530597b5b]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:39:30 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aMCXtGKR'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:39:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:39:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:39:30 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[72bf3bfd-d259-49c1-a332-78fc4c8927f6]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:39:30 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:39:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:39:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.021s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:39:30 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b45869-c837-4263-b1f7-990bcc437ace]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:39:30 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 23 21:39:30 user nova-compute[74337]:  {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:39:30 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 23 21:39:30 user nova-compute[74337]:  {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:39:30 user nova-compute[74337]: WARNING os_brick.initiator.connectors.iscsi [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 23 21:39:30 user nova-compute[74337]: 
Oct 23 21:39:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01 -p 172.16.0.220:3260 --login {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:39:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:39:30 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe88d1d-0b70-4f1d-9260-4d64c0d37921]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:39:30 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01, portal: 172.16.0.220,3260]
Oct 23 21:39:30 user nova-compute[74337]: Login to [iface: default, target: iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01, portal: 172.16.0.220,3260] successful.
Oct 23 21:39:30 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:39:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:39:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:39:30 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d1a8ba5-76db-4d1b-b9b6-4ea2fd27b135]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:39:30 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:39:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:39:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:39:30 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b68d24-2b33-4296-8a02-15a3a053469d]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:39:30 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01 (non-flash)
Oct 23 21:39:30 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:39:30 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01 (non-flash)
Oct 23 21:39:30 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:39:30 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:39:30 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Connected to 172.16.0.220:3260 {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 21:39:30 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] HCTL ('33', '-', '-', 0) found on session 18 with lun 0 {{(pid=74337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 21:39:30 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 21:39:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:39:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:39:30 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fc8279e-fbb2-4268-9001-9ecc26eb5cc6]: (4, ('- - 0', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:39:30 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Searching for a device in session 18 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 21:39:30 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aMCXtGKR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 21:39:30 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-cd0b1d0c-3f82-43d8-85bf-9282ced3c9da tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Acquiring lock "b193f267-2ca2-47c5-bd6c-397b1e041d4a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:39:30 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-cd0b1d0c-3f82-43d8-85bf-9282ced3c9da tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Lock "b193f267-2ca2-47c5-bd6c-397b1e041d4a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:39:30 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-cd0b1d0c-3f82-43d8-85bf-9282ced3c9da tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Acquiring lock "b193f267-2ca2-47c5-bd6c-397b1e041d4a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:39:30 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-cd0b1d0c-3f82-43d8-85bf-9282ced3c9da tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Lock "b193f267-2ca2-47c5-bd6c-397b1e041d4a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.007s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:39:30 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-cd0b1d0c-3f82-43d8-85bf-9282ced3c9da tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Lock "b193f267-2ca2-47c5-bd6c-397b1e041d4a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:39:30 user nova-compute[74337]: INFO nova.compute.manager [None req-cd0b1d0c-3f82-43d8-85bf-9282ced3c9da tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] [instance: b193f267-2ca2-47c5-bd6c-397b1e041d4a] Terminating instance
Oct 23 21:39:30 user nova-compute[74337]: DEBUG nova.compute.manager [None req-cd0b1d0c-3f82-43d8-85bf-9282ced3c9da tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] [instance: b193f267-2ca2-47c5-bd6c-397b1e041d4a] Start destroying the instance on the hypervisor. {{(pid=74337) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 21:39:30 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:39:30 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:39:31 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:39:31 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:39:31 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:39:31 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:39:31 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: b193f267-2ca2-47c5-bd6c-397b1e041d4a] Instance destroyed successfully.
Oct 23 21:39:31 user nova-compute[74337]: DEBUG nova.objects.instance [None req-cd0b1d0c-3f82-43d8-85bf-9282ced3c9da tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Lazy-loading 'resources' on Instance uuid b193f267-2ca2-47c5-bd6c-397b1e041d4a {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:39:31 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-cd0b1d0c-3f82-43d8-85bf-9282ced3c9da tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:36:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-670537481',display_name='tempest-VolumesAdminNegativeTest-server-670537481',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-670537481',id=13,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-23T21:37:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='997b9ab7d2794438be79f11bb972be47',ramdisk_id='',reservation_id='r-5eipq1eo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-547225907',owner_user_name='tempest-VolumesAdminNegativeTest-547225907-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T21:37:06Z,user_data=None,user_id='1106b04eeefe488c9ead914063b88d33',uuid=b193f267-2ca2-47c5-bd6c-397b1e041d4a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f2fe3e4e-05fe-4b23-8ce5-08dbc1e350f5", "address": "fa:16:3e:8a:70:da", "network": {"id": "9fa29b5e-b3c7-4890-9d82-d9524e4cb78a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-89037375-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "997b9ab7d2794438be79f11bb972be47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2fe3e4e-05", "ovs_interfaceid": "f2fe3e4e-05fe-4b23-8ce5-08dbc1e350f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 21:39:31 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-cd0b1d0c-3f82-43d8-85bf-9282ced3c9da tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Converting VIF {"id": "f2fe3e4e-05fe-4b23-8ce5-08dbc1e350f5", "address": "fa:16:3e:8a:70:da", "network": {"id": "9fa29b5e-b3c7-4890-9d82-d9524e4cb78a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-89037375-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "997b9ab7d2794438be79f11bb972be47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2fe3e4e-05", "ovs_interfaceid": "f2fe3e4e-05fe-4b23-8ce5-08dbc1e350f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:39:31 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-cd0b1d0c-3f82-43d8-85bf-9282ced3c9da tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:70:da,bridge_name='br-int',has_traffic_filtering=True,id=f2fe3e4e-05fe-4b23-8ce5-08dbc1e350f5,network=Network(9fa29b5e-b3c7-4890-9d82-d9524e4cb78a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2fe3e4e-05') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:39:31 user nova-compute[74337]: DEBUG os_vif [None req-cd0b1d0c-3f82-43d8-85bf-9282ced3c9da tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:70:da,bridge_name='br-int',has_traffic_filtering=True,id=f2fe3e4e-05fe-4b23-8ce5-08dbc1e350f5,network=Network(9fa29b5e-b3c7-4890-9d82-d9524e4cb78a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2fe3e4e-05') {{(pid=74337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 21:39:31 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:39:31 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf2fe3e4e-05, bridge=br-int, if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:39:31 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:39:31 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:39:31 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:39:31 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c26e6413-b9a7-4cc4-bf70-0379d960ed37) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:39:31 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:39:31 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:39:31 user nova-compute[74337]: DEBUG nova.compute.manager [req-2396b2fb-c68e-4067-ac73-a39dc9cd3150 req-1ce4d3fb-7641-4932-a324-e26fc8850178 service nova] [instance: b193f267-2ca2-47c5-bd6c-397b1e041d4a] Received event network-vif-unplugged-f2fe3e4e-05fe-4b23-8ce5-08dbc1e350f5 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:39:31 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-2396b2fb-c68e-4067-ac73-a39dc9cd3150 req-1ce4d3fb-7641-4932-a324-e26fc8850178 service nova] Acquiring lock "b193f267-2ca2-47c5-bd6c-397b1e041d4a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:39:31 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-2396b2fb-c68e-4067-ac73-a39dc9cd3150 req-1ce4d3fb-7641-4932-a324-e26fc8850178 service nova] Lock "b193f267-2ca2-47c5-bd6c-397b1e041d4a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:39:31 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-2396b2fb-c68e-4067-ac73-a39dc9cd3150 req-1ce4d3fb-7641-4932-a324-e26fc8850178 service nova] Lock "b193f267-2ca2-47c5-bd6c-397b1e041d4a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:39:31 user nova-compute[74337]: DEBUG nova.compute.manager [req-2396b2fb-c68e-4067-ac73-a39dc9cd3150 req-1ce4d3fb-7641-4932-a324-e26fc8850178 service nova] [instance: b193f267-2ca2-47c5-bd6c-397b1e041d4a] No waiting events found dispatching network-vif-unplugged-f2fe3e4e-05fe-4b23-8ce5-08dbc1e350f5 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:39:31 user nova-compute[74337]: DEBUG nova.compute.manager [req-2396b2fb-c68e-4067-ac73-a39dc9cd3150 req-1ce4d3fb-7641-4932-a324-e26fc8850178 service nova] [instance: b193f267-2ca2-47c5-bd6c-397b1e041d4a] Received event network-vif-unplugged-f2fe3e4e-05fe-4b23-8ce5-08dbc1e350f5 for instance with task_state deleting. {{(pid=74337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 21:39:31 user nova-compute[74337]: INFO os_vif [None req-cd0b1d0c-3f82-43d8-85bf-9282ced3c9da tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:70:da,bridge_name='br-int',has_traffic_filtering=True,id=f2fe3e4e-05fe-4b23-8ce5-08dbc1e350f5,network=Network(9fa29b5e-b3c7-4890-9d82-d9524e4cb78a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2fe3e4e-05')
Oct 23 21:39:31 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-cd0b1d0c-3f82-43d8-85bf-9282ced3c9da tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] [instance: b193f267-2ca2-47c5-bd6c-397b1e041d4a] Deleting instance files /opt/stack/data/nova/instances/b193f267-2ca2-47c5-bd6c-397b1e041d4a_del
Oct 23 21:39:31 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-cd0b1d0c-3f82-43d8-85bf-9282ced3c9da tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] [instance: b193f267-2ca2-47c5-bd6c-397b1e041d4a] Deletion of /opt/stack/data/nova/instances/b193f267-2ca2-47c5-bd6c-397b1e041d4a_del complete
Oct 23 21:39:31 user nova-compute[74337]: INFO nova.compute.manager [None req-cd0b1d0c-3f82-43d8-85bf-9282ced3c9da tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] [instance: b193f267-2ca2-47c5-bd6c-397b1e041d4a] Took 0.74 seconds to destroy the instance on the hypervisor.
Oct 23 21:39:31 user nova-compute[74337]: DEBUG oslo.service.loopingcall [None req-cd0b1d0c-3f82-43d8-85bf-9282ced3c9da tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74337) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 21:39:31 user nova-compute[74337]: DEBUG nova.compute.manager [-] [instance: b193f267-2ca2-47c5-bd6c-397b1e041d4a] Deallocating network for instance {{(pid=74337) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 21:39:31 user nova-compute[74337]: DEBUG nova.network.neutron [-] [instance: b193f267-2ca2-47c5-bd6c-397b1e041d4a] deallocate_for_instance() {{(pid=74337) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 21:39:31 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:39:31 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] <== connect_volume: return (1337ms) {'type': 'block', 'scsi_wwn': '23263393864326637', 'path': '/dev/sdb'} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:39:31 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23263393864326637', 'path': '/dev/sdb'} {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 21:39:31 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:38:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1403410720',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1403410720',id=14,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNAij/gN9c1LogESmDyDRUK8aX9TNeBklW1117x1fKgPvWOfbQTMsxbBaU+oDUoFHSZouzNEg8DViCjOAm3WRLHflowTaqyVE9dl6GjV16zXbkR3EGgDaXXdXhXT1FiXhw==',key_name='tempest-keypair-1763181828',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3abafb229d604b65a3fb50f0eebc70ae',ramdisk_id='',reservation_id='r-0v9ax80p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1326198598',owner_user_name='tempest-ServerActionsV293TestJSON-1326198598-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:38:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c6d296964f545e78d8bc461d6f28dba',uuid=2cae5b4d-96a0-41ae-9643-b7bf09581988,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fc418a9a-364a-4e52-a073-58a567680beb", "address": "fa:16:3e:5b:b9:06", "network": {"id": "e3ef8fef-f49d-46a8-b357-1ee41c4a17e4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-952280610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3abafb229d604b65a3fb50f0eebc70ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc418a9a-36", "ovs_interfaceid": "fc418a9a-364a-4e52-a073-58a567680beb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 21:39:31 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Converting VIF {"id": "fc418a9a-364a-4e52-a073-58a567680beb", "address": "fa:16:3e:5b:b9:06", "network": {"id": "e3ef8fef-f49d-46a8-b357-1ee41c4a17e4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-952280610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3abafb229d604b65a3fb50f0eebc70ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc418a9a-36", "ovs_interfaceid": "fc418a9a-364a-4e52-a073-58a567680beb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:39:31 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:b9:06,bridge_name='br-int',has_traffic_filtering=True,id=fc418a9a-364a-4e52-a073-58a567680beb,network=Network(e3ef8fef-f49d-46a8-b357-1ee41c4a17e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc418a9a-36') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:39:31 user nova-compute[74337]: DEBUG nova.objects.instance [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Lazy-loading 'pci_devices' on Instance uuid 2cae5b4d-96a0-41ae-9643-b7bf09581988 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:39:31 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] End _get_guest_xml xml=<domain type="kvm">
Oct 23 21:39:31 user nova-compute[74337]:   <uuid>2cae5b4d-96a0-41ae-9643-b7bf09581988</uuid>
Oct 23 21:39:31 user nova-compute[74337]:   <name>instance-0000000e</name>
Oct 23 21:39:31 user nova-compute[74337]:   <memory>524288</memory>
Oct 23 21:39:31 user nova-compute[74337]:   <vcpu>1</vcpu>
Oct 23 21:39:31 user nova-compute[74337]:   <metadata>
Oct 23 21:39:31 user nova-compute[74337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 21:39:31 user nova-compute[74337]:       <nova:package version="0.0.0"/>
Oct 23 21:39:31 user nova-compute[74337]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1403410720</nova:name>
Oct 23 21:39:31 user nova-compute[74337]:       <nova:creationTime>2023-10-23 21:39:30</nova:creationTime>
Oct 23 21:39:31 user nova-compute[74337]:       <nova:flavor name="m1.tiny">
Oct 23 21:39:31 user nova-compute[74337]:         <nova:memory>512</nova:memory>
Oct 23 21:39:31 user nova-compute[74337]:         <nova:disk>1</nova:disk>
Oct 23 21:39:31 user nova-compute[74337]:         <nova:swap>0</nova:swap>
Oct 23 21:39:31 user nova-compute[74337]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 21:39:31 user nova-compute[74337]:         <nova:vcpus>1</nova:vcpus>
Oct 23 21:39:31 user nova-compute[74337]:       </nova:flavor>
Oct 23 21:39:31 user nova-compute[74337]:       <nova:owner>
Oct 23 21:39:31 user nova-compute[74337]:         <nova:user uuid="1c6d296964f545e78d8bc461d6f28dba">tempest-ServerActionsV293TestJSON-1326198598-project-member</nova:user>
Oct 23 21:39:31 user nova-compute[74337]:         <nova:project uuid="3abafb229d604b65a3fb50f0eebc70ae">tempest-ServerActionsV293TestJSON-1326198598</nova:project>
Oct 23 21:39:31 user nova-compute[74337]:       </nova:owner>
Oct 23 21:39:31 user nova-compute[74337]:       <nova:ports>
Oct 23 21:39:31 user nova-compute[74337]:         <nova:port uuid="fc418a9a-364a-4e52-a073-58a567680beb">
Oct 23 21:39:31 user nova-compute[74337]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 23 21:39:31 user nova-compute[74337]:         </nova:port>
Oct 23 21:39:31 user nova-compute[74337]:       </nova:ports>
Oct 23 21:39:31 user nova-compute[74337]:     </nova:instance>
Oct 23 21:39:31 user nova-compute[74337]:   </metadata>
Oct 23 21:39:31 user nova-compute[74337]:   <sysinfo type="smbios">
Oct 23 21:39:31 user nova-compute[74337]:     <system>
Oct 23 21:39:31 user nova-compute[74337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 21:39:31 user nova-compute[74337]:       <entry name="product">OpenStack Nova</entry>
Oct 23 21:39:31 user nova-compute[74337]:       <entry name="version">0.0.0</entry>
Oct 23 21:39:31 user nova-compute[74337]:       <entry name="serial">2cae5b4d-96a0-41ae-9643-b7bf09581988</entry>
Oct 23 21:39:31 user nova-compute[74337]:       <entry name="uuid">2cae5b4d-96a0-41ae-9643-b7bf09581988</entry>
Oct 23 21:39:31 user nova-compute[74337]:       <entry name="family">Virtual Machine</entry>
Oct 23 21:39:31 user nova-compute[74337]:     </system>
Oct 23 21:39:31 user nova-compute[74337]:   </sysinfo>
Oct 23 21:39:31 user nova-compute[74337]:   <os>
Oct 23 21:39:31 user nova-compute[74337]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 21:39:31 user nova-compute[74337]:     <boot dev="hd"/>
Oct 23 21:39:31 user nova-compute[74337]:     <smbios mode="sysinfo"/>
Oct 23 21:39:31 user nova-compute[74337]:   </os>
Oct 23 21:39:31 user nova-compute[74337]:   <features>
Oct 23 21:39:31 user nova-compute[74337]:     <acpi/>
Oct 23 21:39:31 user nova-compute[74337]:     <apic/>
Oct 23 21:39:31 user nova-compute[74337]:     <vmcoreinfo/>
Oct 23 21:39:31 user nova-compute[74337]:   </features>
Oct 23 21:39:31 user nova-compute[74337]:   <clock offset="utc">
Oct 23 21:39:31 user nova-compute[74337]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 21:39:31 user nova-compute[74337]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 21:39:31 user nova-compute[74337]:     <timer name="hpet" present="no"/>
Oct 23 21:39:31 user nova-compute[74337]:   </clock>
Oct 23 21:39:31 user nova-compute[74337]:   <cpu mode="custom" match="exact">
Oct 23 21:39:31 user nova-compute[74337]:     <model>Nehalem</model>
Oct 23 21:39:31 user nova-compute[74337]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 21:39:31 user nova-compute[74337]:   </cpu>
Oct 23 21:39:31 user nova-compute[74337]:   <devices>
Oct 23 21:39:31 user nova-compute[74337]:     <disk type="block" device="disk">
Oct 23 21:39:31 user nova-compute[74337]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 21:39:31 user nova-compute[74337]:       <source dev="/dev/sdb"/>
Oct 23 21:39:31 user nova-compute[74337]:       <target dev="vda" bus="virtio"/>
Oct 23 21:39:31 user nova-compute[74337]:       <serial>f45407b0-0f4c-4120-8ef2-812f51f88f01</serial>
Oct 23 21:39:31 user nova-compute[74337]:     </disk>
Oct 23 21:39:31 user nova-compute[74337]:     <interface type="ethernet">
Oct 23 21:39:31 user nova-compute[74337]:       <mac address="fa:16:3e:5b:b9:06"/>
Oct 23 21:39:31 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:39:31 user nova-compute[74337]:       <mtu size="1442"/>
Oct 23 21:39:31 user nova-compute[74337]:       <target dev="tapfc418a9a-36"/>
Oct 23 21:39:31 user nova-compute[74337]:     </interface>
Oct 23 21:39:31 user nova-compute[74337]:     <serial type="pty">
Oct 23 21:39:31 user nova-compute[74337]:       <log file="/opt/stack/data/nova/instances/2cae5b4d-96a0-41ae-9643-b7bf09581988/console.log" append="off"/>
Oct 23 21:39:31 user nova-compute[74337]:     </serial>
Oct 23 21:39:31 user nova-compute[74337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 21:39:31 user nova-compute[74337]:     <video>
Oct 23 21:39:31 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:39:31 user nova-compute[74337]:     </video>
Oct 23 21:39:31 user nova-compute[74337]:     <rng model="virtio">
Oct 23 21:39:31 user nova-compute[74337]:       <backend model="random">/dev/urandom</backend>
Oct 23 21:39:31 user nova-compute[74337]:     </rng>
Oct 23 21:39:31 user nova-compute[74337]:     <controller type="usb" index="0" model="none"/>
Oct 23 21:39:31 user nova-compute[74337]:     <memballoon model="virtio">
Oct 23 21:39:31 user nova-compute[74337]:       <stats period="10"/>
Oct 23 21:39:31 user nova-compute[74337]:     </memballoon>
Oct 23 21:39:31 user nova-compute[74337]:   </devices>
Oct 23 21:39:31 user nova-compute[74337]: </domain>
Oct 23 21:39:31 user nova-compute[74337]:  {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 21:39:31 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:38:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1403410720',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1403410720',id=14,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNAij/gN9c1LogESmDyDRUK8aX9TNeBklW1117x1fKgPvWOfbQTMsxbBaU+oDUoFHSZouzNEg8DViCjOAm3WRLHflowTaqyVE9dl6GjV16zXbkR3EGgDaXXdXhXT1FiXhw==',key_name='tempest-keypair-1763181828',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3abafb229d604b65a3fb50f0eebc70ae',ramdisk_id='',reservation_id='r-0v9ax80p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1326198598',owner_user_name='tempest-ServerActionsV293TestJSON-1326198598-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:38:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c6d296964f545e78d8bc461d6f28dba',uuid=2cae5b4d-96a0-41ae-9643-b7bf09581988,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fc418a9a-364a-4e52-a073-58a567680beb", "address": "fa:16:3e:5b:b9:06", "network": {"id": "e3ef8fef-f49d-46a8-b357-1ee41c4a17e4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-952280610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3abafb229d604b65a3fb50f0eebc70ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc418a9a-36", "ovs_interfaceid": "fc418a9a-364a-4e52-a073-58a567680beb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 21:39:31 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Converting VIF {"id": "fc418a9a-364a-4e52-a073-58a567680beb", "address": "fa:16:3e:5b:b9:06", "network": {"id": "e3ef8fef-f49d-46a8-b357-1ee41c4a17e4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-952280610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3abafb229d604b65a3fb50f0eebc70ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc418a9a-36", "ovs_interfaceid": "fc418a9a-364a-4e52-a073-58a567680beb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:39:31 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:b9:06,bridge_name='br-int',has_traffic_filtering=True,id=fc418a9a-364a-4e52-a073-58a567680beb,network=Network(e3ef8fef-f49d-46a8-b357-1ee41c4a17e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc418a9a-36') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:39:31 user nova-compute[74337]: DEBUG os_vif [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:b9:06,bridge_name='br-int',has_traffic_filtering=True,id=fc418a9a-364a-4e52-a073-58a567680beb,network=Network(e3ef8fef-f49d-46a8-b357-1ee41c4a17e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc418a9a-36') {{(pid=74337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 21:39:31 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:39:31 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:39:31 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 21:39:31 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:39:31 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '59335597-4f6b-54bc-957c-322c82ee5f40', '_type': 'linux-noop'}}, row=False) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:39:31 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:39:31 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:39:31 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:39:31 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfc418a9a-36, may_exist=True, interface_attrs={}) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:39:31 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfc418a9a-36, col_values=(('qos', UUID('832fcfaf-6e20-4747-884f-55aed4a70cbe')),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:39:31 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfc418a9a-36, col_values=(('external_ids', {'iface-id': 'fc418a9a-364a-4e52-a073-58a567680beb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:b9:06', 'vm-uuid': '2cae5b4d-96a0-41ae-9643-b7bf09581988'}),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:39:31 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:39:31 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:39:31 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:39:31 user nova-compute[74337]: INFO os_vif [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:b9:06,bridge_name='br-int',has_traffic_filtering=True,id=fc418a9a-364a-4e52-a073-58a567680beb,network=Network(e3ef8fef-f49d-46a8-b357-1ee41c4a17e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc418a9a-36')
Oct 23 21:39:31 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] No BDM found with device name vda, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 21:39:31 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] No VIF found with MAC fa:16:3e:5b:b9:06, not building metadata {{(pid=74337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 21:39:32 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:39:32 user nova-compute[74337]: DEBUG nova.network.neutron [-] [instance: b193f267-2ca2-47c5-bd6c-397b1e041d4a] Updating instance_info_cache with network_info: [] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:39:32 user nova-compute[74337]: INFO nova.compute.manager [-] [instance: b193f267-2ca2-47c5-bd6c-397b1e041d4a] Took 1.06 seconds to deallocate network for instance.
Oct 23 21:39:32 user nova-compute[74337]: DEBUG nova.compute.manager [req-dbb6388e-b960-4300-8167-053366eb5d31 req-3f46ac3f-e796-4fd9-be40-81530c9c9f5d service nova] [instance: b193f267-2ca2-47c5-bd6c-397b1e041d4a] Received event network-vif-deleted-f2fe3e4e-05fe-4b23-8ce5-08dbc1e350f5 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:39:32 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-cd0b1d0c-3f82-43d8-85bf-9282ced3c9da tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:39:32 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-cd0b1d0c-3f82-43d8-85bf-9282ced3c9da tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:39:32 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-cd0b1d0c-3f82-43d8-85bf-9282ced3c9da tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:39:32 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-cd0b1d0c-3f82-43d8-85bf-9282ced3c9da tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:39:32 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-cd0b1d0c-3f82-43d8-85bf-9282ced3c9da tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.297s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:39:32 user nova-compute[74337]: INFO nova.scheduler.client.report [None req-cd0b1d0c-3f82-43d8-85bf-9282ced3c9da tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Deleted allocations for instance b193f267-2ca2-47c5-bd6c-397b1e041d4a
Oct 23 21:39:33 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:39:33 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-cd0b1d0c-3f82-43d8-85bf-9282ced3c9da tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Lock "b193f267-2ca2-47c5-bd6c-397b1e041d4a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.464s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:39:33 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:39:33 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:39:33 user nova-compute[74337]: DEBUG nova.compute.manager [req-7e818c82-3122-4a70-9815-65bdf10c6cf9 req-2d00720c-56c1-45ad-9b84-327f12726916 service nova] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Received event network-vif-plugged-fc418a9a-364a-4e52-a073-58a567680beb {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:39:33 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-7e818c82-3122-4a70-9815-65bdf10c6cf9 req-2d00720c-56c1-45ad-9b84-327f12726916 service nova] Acquiring lock "2cae5b4d-96a0-41ae-9643-b7bf09581988-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:39:33 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-7e818c82-3122-4a70-9815-65bdf10c6cf9 req-2d00720c-56c1-45ad-9b84-327f12726916 service nova] Lock "2cae5b4d-96a0-41ae-9643-b7bf09581988-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:39:33 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-7e818c82-3122-4a70-9815-65bdf10c6cf9 req-2d00720c-56c1-45ad-9b84-327f12726916 service nova] Lock "2cae5b4d-96a0-41ae-9643-b7bf09581988-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:39:33 user nova-compute[74337]: DEBUG nova.compute.manager [req-7e818c82-3122-4a70-9815-65bdf10c6cf9 req-2d00720c-56c1-45ad-9b84-327f12726916 service nova] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] No waiting events found dispatching network-vif-plugged-fc418a9a-364a-4e52-a073-58a567680beb {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:39:33 user nova-compute[74337]: WARNING nova.compute.manager [req-7e818c82-3122-4a70-9815-65bdf10c6cf9 req-2d00720c-56c1-45ad-9b84-327f12726916 service nova] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Received unexpected event network-vif-plugged-fc418a9a-364a-4e52-a073-58a567680beb for instance with vm_state building and task_state spawning.
Oct 23 21:39:33 user nova-compute[74337]: DEBUG nova.compute.manager [req-9ceda603-a9bd-4df3-81b4-21408c7f33e1 req-280a6ffb-6ac8-453b-9d70-fd22198d2e32 service nova] [instance: b193f267-2ca2-47c5-bd6c-397b1e041d4a] Received event network-vif-plugged-f2fe3e4e-05fe-4b23-8ce5-08dbc1e350f5 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:39:33 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-9ceda603-a9bd-4df3-81b4-21408c7f33e1 req-280a6ffb-6ac8-453b-9d70-fd22198d2e32 service nova] Acquiring lock "b193f267-2ca2-47c5-bd6c-397b1e041d4a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:39:33 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-9ceda603-a9bd-4df3-81b4-21408c7f33e1 req-280a6ffb-6ac8-453b-9d70-fd22198d2e32 service nova] Lock "b193f267-2ca2-47c5-bd6c-397b1e041d4a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:39:33 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-9ceda603-a9bd-4df3-81b4-21408c7f33e1 req-280a6ffb-6ac8-453b-9d70-fd22198d2e32 service nova] Lock "b193f267-2ca2-47c5-bd6c-397b1e041d4a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:39:33 user nova-compute[74337]: DEBUG nova.compute.manager [req-9ceda603-a9bd-4df3-81b4-21408c7f33e1 req-280a6ffb-6ac8-453b-9d70-fd22198d2e32 service nova] [instance: b193f267-2ca2-47c5-bd6c-397b1e041d4a] No waiting events found dispatching network-vif-plugged-f2fe3e4e-05fe-4b23-8ce5-08dbc1e350f5 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:39:33 user nova-compute[74337]: WARNING nova.compute.manager [req-9ceda603-a9bd-4df3-81b4-21408c7f33e1 req-280a6ffb-6ac8-453b-9d70-fd22198d2e32 service nova] [instance: b193f267-2ca2-47c5-bd6c-397b1e041d4a] Received unexpected event network-vif-plugged-f2fe3e4e-05fe-4b23-8ce5-08dbc1e350f5 for instance with vm_state deleted and task_state None.
Oct 23 21:39:33 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:39:33 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:39:35 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:39:35 user nova-compute[74337]: DEBUG nova.compute.manager [req-b43ff54f-baba-44ae-abb2-f14553ca5039 req-46921090-7b3f-4d1a-82dc-14737c7c6ff6 service nova] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Received event network-vif-plugged-fc418a9a-364a-4e52-a073-58a567680beb {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:39:35 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-b43ff54f-baba-44ae-abb2-f14553ca5039 req-46921090-7b3f-4d1a-82dc-14737c7c6ff6 service nova] Acquiring lock "2cae5b4d-96a0-41ae-9643-b7bf09581988-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:39:35 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-b43ff54f-baba-44ae-abb2-f14553ca5039 req-46921090-7b3f-4d1a-82dc-14737c7c6ff6 service nova] Lock "2cae5b4d-96a0-41ae-9643-b7bf09581988-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:39:35 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-b43ff54f-baba-44ae-abb2-f14553ca5039 req-46921090-7b3f-4d1a-82dc-14737c7c6ff6 service nova] Lock "2cae5b4d-96a0-41ae-9643-b7bf09581988-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:39:35 user nova-compute[74337]: DEBUG nova.compute.manager [req-b43ff54f-baba-44ae-abb2-f14553ca5039 req-46921090-7b3f-4d1a-82dc-14737c7c6ff6 service nova] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] No waiting events found dispatching network-vif-plugged-fc418a9a-364a-4e52-a073-58a567680beb {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:39:35 user nova-compute[74337]: WARNING nova.compute.manager [req-b43ff54f-baba-44ae-abb2-f14553ca5039 req-46921090-7b3f-4d1a-82dc-14737c7c6ff6 service nova] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Received unexpected event network-vif-plugged-fc418a9a-364a-4e52-a073-58a567680beb for instance with vm_state building and task_state spawning.
Oct 23 21:39:35 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:39:35 user nova-compute[74337]: DEBUG nova.compute.manager [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Instance event wait completed in 0 seconds for  {{(pid=74337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 21:39:35 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Guest created on hypervisor {{(pid=74337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 21:39:35 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Instance spawned successfully.
Oct 23 21:39:35 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 21:39:35 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Found default for hw_cdrom_bus of ide {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:39:35 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Found default for hw_disk_bus of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:39:35 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Found default for hw_input_bus of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:39:35 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Found default for hw_pointer_model of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:39:35 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Found default for hw_video_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:39:35 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Found default for hw_vif_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:39:35 user nova-compute[74337]: INFO nova.compute.manager [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Took 5.90 seconds to spawn the instance on the hypervisor.
Oct 23 21:39:35 user nova-compute[74337]: DEBUG nova.compute.manager [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Checking state {{(pid=74337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 21:39:36 user nova-compute[74337]: INFO nova.compute.manager [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Took 46.18 seconds to build instance.
Oct 23 21:39:36 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-f7d66fe1-b177-40df-bca9-52500c7d5ec6 tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Lock "2cae5b4d-96a0-41ae-9643-b7bf09581988" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 46.323s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:39:36 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:39:37 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:39:38 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:39:38 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:39:41 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-6d1b5662-6d34-4c45-9b59-f3579c169ae8 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Acquiring lock "0ba8d1d0-5fac-4213-9a50-a4e273710b1b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:39:41 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-6d1b5662-6d34-4c45-9b59-f3579c169ae8 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Lock "0ba8d1d0-5fac-4213-9a50-a4e273710b1b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:39:41 user nova-compute[74337]: DEBUG nova.compute.manager [None req-6d1b5662-6d34-4c45-9b59-f3579c169ae8 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] [instance: 0ba8d1d0-5fac-4213-9a50-a4e273710b1b] Starting instance... {{(pid=74337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 21:39:41 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-6d1b5662-6d34-4c45-9b59-f3579c169ae8 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:39:41 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-6d1b5662-6d34-4c45-9b59-f3579c169ae8 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:39:41 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-6d1b5662-6d34-4c45-9b59-f3579c169ae8 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 21:39:41 user nova-compute[74337]: INFO nova.compute.claims [None req-6d1b5662-6d34-4c45-9b59-f3579c169ae8 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] [instance: 0ba8d1d0-5fac-4213-9a50-a4e273710b1b] Claim successful on node user
Oct 23 21:39:41 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:39:41 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-6d1b5662-6d34-4c45-9b59-f3579c169ae8 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:39:41 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-6d1b5662-6d34-4c45-9b59-f3579c169ae8 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:39:41 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-6d1b5662-6d34-4c45-9b59-f3579c169ae8 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.641s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:39:41 user nova-compute[74337]: DEBUG nova.compute.manager [None req-6d1b5662-6d34-4c45-9b59-f3579c169ae8 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] [instance: 0ba8d1d0-5fac-4213-9a50-a4e273710b1b] Start building networks asynchronously for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 21:39:42 user nova-compute[74337]: DEBUG nova.compute.manager [None req-6d1b5662-6d34-4c45-9b59-f3579c169ae8 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] [instance: 0ba8d1d0-5fac-4213-9a50-a4e273710b1b] Allocating IP information in the background. {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 21:39:42 user nova-compute[74337]: DEBUG nova.network.neutron [None req-6d1b5662-6d34-4c45-9b59-f3579c169ae8 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] [instance: 0ba8d1d0-5fac-4213-9a50-a4e273710b1b] allocate_for_instance() {{(pid=74337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 21:39:42 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-6d1b5662-6d34-4c45-9b59-f3579c169ae8 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] [instance: 0ba8d1d0-5fac-4213-9a50-a4e273710b1b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 21:39:42 user nova-compute[74337]: DEBUG nova.compute.manager [None req-6d1b5662-6d34-4c45-9b59-f3579c169ae8 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] [instance: 0ba8d1d0-5fac-4213-9a50-a4e273710b1b] Start building block device mappings for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 21:39:42 user nova-compute[74337]: DEBUG nova.policy [None req-6d1b5662-6d34-4c45-9b59-f3579c169ae8 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c11f9fb1ab7c411fa9069976c4419bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83700495146c4b0e8d76491380b5f895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74337) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 21:39:42 user nova-compute[74337]: DEBUG nova.compute.manager [None req-6d1b5662-6d34-4c45-9b59-f3579c169ae8 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] [instance: 0ba8d1d0-5fac-4213-9a50-a4e273710b1b] Start spawning the instance on the hypervisor. {{(pid=74337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 21:39:42 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-6d1b5662-6d34-4c45-9b59-f3579c169ae8 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] [instance: 0ba8d1d0-5fac-4213-9a50-a4e273710b1b] Creating instance directory {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 21:39:42 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-6d1b5662-6d34-4c45-9b59-f3579c169ae8 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] [instance: 0ba8d1d0-5fac-4213-9a50-a4e273710b1b] Creating image(s)
Oct 23 21:39:42 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-6d1b5662-6d34-4c45-9b59-f3579c169ae8 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Acquiring lock "/opt/stack/data/nova/instances/0ba8d1d0-5fac-4213-9a50-a4e273710b1b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:39:42 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-6d1b5662-6d34-4c45-9b59-f3579c169ae8 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Lock "/opt/stack/data/nova/instances/0ba8d1d0-5fac-4213-9a50-a4e273710b1b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:39:42 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-6d1b5662-6d34-4c45-9b59-f3579c169ae8 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Lock "/opt/stack/data/nova/instances/0ba8d1d0-5fac-4213-9a50-a4e273710b1b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:39:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-6d1b5662-6d34-4c45-9b59-f3579c169ae8 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:39:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-6d1b5662-6d34-4c45-9b59-f3579c169ae8 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.242s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:39:42 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-6d1b5662-6d34-4c45-9b59-f3579c169ae8 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Acquiring lock "fc7b140751b8c385de81623e40fb09ce09374ab7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:39:42 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-6d1b5662-6d34-4c45-9b59-f3579c169ae8 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Lock "fc7b140751b8c385de81623e40fb09ce09374ab7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:39:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-6d1b5662-6d34-4c45-9b59-f3579c169ae8 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:39:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-6d1b5662-6d34-4c45-9b59-f3579c169ae8 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.208s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:39:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-6d1b5662-6d34-4c45-9b59-f3579c169ae8 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7,backing_fmt=raw /opt/stack/data/nova/instances/0ba8d1d0-5fac-4213-9a50-a4e273710b1b/disk 1073741824 {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:39:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-6d1b5662-6d34-4c45-9b59-f3579c169ae8 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7,backing_fmt=raw /opt/stack/data/nova/instances/0ba8d1d0-5fac-4213-9a50-a4e273710b1b/disk 1073741824" returned: 0 in 0.057s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:39:42 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-6d1b5662-6d34-4c45-9b59-f3579c169ae8 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Lock "fc7b140751b8c385de81623e40fb09ce09374ab7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.273s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:39:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-6d1b5662-6d34-4c45-9b59-f3579c169ae8 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:39:42 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-89703f46-10b3-4dbe-b8ae-50ac456b578f tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Acquiring lock "547c4d4c-e0dd-495a-b83f-98426d0a4a99" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:39:42 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-89703f46-10b3-4dbe-b8ae-50ac456b578f tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lock "547c4d4c-e0dd-495a-b83f-98426d0a4a99" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:39:42 user nova-compute[74337]: DEBUG nova.compute.manager [None req-89703f46-10b3-4dbe-b8ae-50ac456b578f tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 547c4d4c-e0dd-495a-b83f-98426d0a4a99] Starting instance... {{(pid=74337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 21:39:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-6d1b5662-6d34-4c45-9b59-f3579c169ae8 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.218s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:39:42 user nova-compute[74337]: DEBUG nova.virt.disk.api [None req-6d1b5662-6d34-4c45-9b59-f3579c169ae8 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0ba8d1d0-5fac-4213-9a50-a4e273710b1b/disk. size=1073741824 {{(pid=74337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 21:39:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-6d1b5662-6d34-4c45-9b59-f3579c169ae8 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba8d1d0-5fac-4213-9a50-a4e273710b1b/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:39:43 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-89703f46-10b3-4dbe-b8ae-50ac456b578f tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:39:43 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-89703f46-10b3-4dbe-b8ae-50ac456b578f tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.004s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:39:43 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-89703f46-10b3-4dbe-b8ae-50ac456b578f tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 21:39:43 user nova-compute[74337]: INFO nova.compute.claims [None req-89703f46-10b3-4dbe-b8ae-50ac456b578f tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 547c4d4c-e0dd-495a-b83f-98426d0a4a99] Claim successful on node user
Oct 23 21:39:43 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-6d1b5662-6d34-4c45-9b59-f3579c169ae8 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba8d1d0-5fac-4213-9a50-a4e273710b1b/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:39:43 user nova-compute[74337]: DEBUG nova.virt.disk.api [None req-6d1b5662-6d34-4c45-9b59-f3579c169ae8 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Cannot resize image /opt/stack/data/nova/instances/0ba8d1d0-5fac-4213-9a50-a4e273710b1b/disk to a smaller size. {{(pid=74337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 21:39:43 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-6d1b5662-6d34-4c45-9b59-f3579c169ae8 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] [instance: 0ba8d1d0-5fac-4213-9a50-a4e273710b1b] Created local disks {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 21:39:43 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-6d1b5662-6d34-4c45-9b59-f3579c169ae8 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] [instance: 0ba8d1d0-5fac-4213-9a50-a4e273710b1b] Ensure instance console log exists: /opt/stack/data/nova/instances/0ba8d1d0-5fac-4213-9a50-a4e273710b1b/console.log {{(pid=74337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 21:39:43 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-6d1b5662-6d34-4c45-9b59-f3579c169ae8 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:39:43 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-6d1b5662-6d34-4c45-9b59-f3579c169ae8 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:39:43 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-6d1b5662-6d34-4c45-9b59-f3579c169ae8 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:39:43 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:39:43 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-89703f46-10b3-4dbe-b8ae-50ac456b578f tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:39:43 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-89703f46-10b3-4dbe-b8ae-50ac456b578f tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:39:43 user nova-compute[74337]: DEBUG nova.network.neutron [None req-6d1b5662-6d34-4c45-9b59-f3579c169ae8 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] [instance: 0ba8d1d0-5fac-4213-9a50-a4e273710b1b] Successfully created port: c7a03b6c-5d0f-4a54-b615-16c7546eb5f7 {{(pid=74337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 21:39:43 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-89703f46-10b3-4dbe-b8ae-50ac456b578f tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.497s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:39:43 user nova-compute[74337]: DEBUG nova.compute.manager [None req-89703f46-10b3-4dbe-b8ae-50ac456b578f tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 547c4d4c-e0dd-495a-b83f-98426d0a4a99] Start building networks asynchronously for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 21:39:43 user nova-compute[74337]: DEBUG nova.compute.manager [None req-89703f46-10b3-4dbe-b8ae-50ac456b578f tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 547c4d4c-e0dd-495a-b83f-98426d0a4a99] Allocating IP information in the background. {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 21:39:43 user nova-compute[74337]: DEBUG nova.network.neutron [None req-89703f46-10b3-4dbe-b8ae-50ac456b578f tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 547c4d4c-e0dd-495a-b83f-98426d0a4a99] allocate_for_instance() {{(pid=74337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 21:39:43 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-89703f46-10b3-4dbe-b8ae-50ac456b578f tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 547c4d4c-e0dd-495a-b83f-98426d0a4a99] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 21:39:43 user nova-compute[74337]: DEBUG nova.compute.manager [None req-89703f46-10b3-4dbe-b8ae-50ac456b578f tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 547c4d4c-e0dd-495a-b83f-98426d0a4a99] Start building block device mappings for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 21:39:43 user nova-compute[74337]: DEBUG nova.policy [None req-89703f46-10b3-4dbe-b8ae-50ac456b578f tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '891ee2e3acc54ed0bc4571f63ff491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f57e58a9ec4c6384dc0d3ca58eb610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74337) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 21:39:43 user nova-compute[74337]: DEBUG nova.compute.manager [None req-89703f46-10b3-4dbe-b8ae-50ac456b578f tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 547c4d4c-e0dd-495a-b83f-98426d0a4a99] Start spawning the instance on the hypervisor. {{(pid=74337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 21:39:43 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-89703f46-10b3-4dbe-b8ae-50ac456b578f tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 547c4d4c-e0dd-495a-b83f-98426d0a4a99] Creating instance directory {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 21:39:43 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-89703f46-10b3-4dbe-b8ae-50ac456b578f tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 547c4d4c-e0dd-495a-b83f-98426d0a4a99] Creating image(s)
Oct 23 21:39:43 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-89703f46-10b3-4dbe-b8ae-50ac456b578f tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Acquiring lock "/opt/stack/data/nova/instances/547c4d4c-e0dd-495a-b83f-98426d0a4a99/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:39:43 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-89703f46-10b3-4dbe-b8ae-50ac456b578f tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lock "/opt/stack/data/nova/instances/547c4d4c-e0dd-495a-b83f-98426d0a4a99/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:39:43 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-89703f46-10b3-4dbe-b8ae-50ac456b578f tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lock "/opt/stack/data/nova/instances/547c4d4c-e0dd-495a-b83f-98426d0a4a99/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:39:43 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-89703f46-10b3-4dbe-b8ae-50ac456b578f tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:39:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-89703f46-10b3-4dbe-b8ae-50ac456b578f tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.184s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:39:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-89703f46-10b3-4dbe-b8ae-50ac456b578f tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Acquiring lock "fc7b140751b8c385de81623e40fb09ce09374ab7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:39:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-89703f46-10b3-4dbe-b8ae-50ac456b578f tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lock "fc7b140751b8c385de81623e40fb09ce09374ab7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:39:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-89703f46-10b3-4dbe-b8ae-50ac456b578f tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:39:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-89703f46-10b3-4dbe-b8ae-50ac456b578f tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.201s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:39:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-89703f46-10b3-4dbe-b8ae-50ac456b578f tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7,backing_fmt=raw /opt/stack/data/nova/instances/547c4d4c-e0dd-495a-b83f-98426d0a4a99/disk 1073741824 {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:39:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-89703f46-10b3-4dbe-b8ae-50ac456b578f tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7,backing_fmt=raw /opt/stack/data/nova/instances/547c4d4c-e0dd-495a-b83f-98426d0a4a99/disk 1073741824" returned: 0 in 0.050s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:39:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-89703f46-10b3-4dbe-b8ae-50ac456b578f tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lock "fc7b140751b8c385de81623e40fb09ce09374ab7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:39:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-89703f46-10b3-4dbe-b8ae-50ac456b578f tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:39:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-89703f46-10b3-4dbe-b8ae-50ac456b578f tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.224s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:39:44 user nova-compute[74337]: DEBUG nova.virt.disk.api [None req-89703f46-10b3-4dbe-b8ae-50ac456b578f tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Checking if we can resize image /opt/stack/data/nova/instances/547c4d4c-e0dd-495a-b83f-98426d0a4a99/disk. size=1073741824 {{(pid=74337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 21:39:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-89703f46-10b3-4dbe-b8ae-50ac456b578f tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/547c4d4c-e0dd-495a-b83f-98426d0a4a99/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:39:44 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:39:44 user nova-compute[74337]: WARNING nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] While synchronizing instance power states, found 7 instances in the database and 4 instances on the hypervisor.
Oct 23 21:39:44 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Triggering sync for uuid cf6270ba-7a4e-40c4-b7fd-c62a44125c89 {{(pid=74337) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 23 21:39:44 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Triggering sync for uuid d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50 {{(pid=74337) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 23 21:39:44 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Triggering sync for uuid d45e8ae8-371b-46ae-849d-d7f7d5bbd770 {{(pid=74337) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 23 21:39:44 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Triggering sync for uuid 2cae5b4d-96a0-41ae-9643-b7bf09581988 {{(pid=74337) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 23 21:39:44 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Triggering sync for uuid 1189976f-8d02-468d-8fa7-bd5594c5f85a {{(pid=74337) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 23 21:39:44 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Triggering sync for uuid 0ba8d1d0-5fac-4213-9a50-a4e273710b1b {{(pid=74337) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 23 21:39:44 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Triggering sync for uuid 547c4d4c-e0dd-495a-b83f-98426d0a4a99 {{(pid=74337) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 23 21:39:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "cf6270ba-7a4e-40c4-b7fd-c62a44125c89" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:39:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "cf6270ba-7a4e-40c4-b7fd-c62a44125c89" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:39:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:39:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:39:44 user nova-compute[74337]: INFO nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Oct 23 21:39:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:39:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "d45e8ae8-371b-46ae-849d-d7f7d5bbd770" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:39:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "d45e8ae8-371b-46ae-849d-d7f7d5bbd770" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:39:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "2cae5b4d-96a0-41ae-9643-b7bf09581988" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:39:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "2cae5b4d-96a0-41ae-9643-b7bf09581988" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:39:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "1189976f-8d02-468d-8fa7-bd5594c5f85a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:39:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "1189976f-8d02-468d-8fa7-bd5594c5f85a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:39:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "0ba8d1d0-5fac-4213-9a50-a4e273710b1b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:39:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "547c4d4c-e0dd-495a-b83f-98426d0a4a99" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:39:44 user nova-compute[74337]: DEBUG nova.network.neutron [None req-6d1b5662-6d34-4c45-9b59-f3579c169ae8 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] [instance: 0ba8d1d0-5fac-4213-9a50-a4e273710b1b] Successfully updated port: c7a03b6c-5d0f-4a54-b615-16c7546eb5f7 {{(pid=74337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 21:39:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "cf6270ba-7a4e-40c4-b7fd-c62a44125c89" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.074s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:39:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "1189976f-8d02-468d-8fa7-bd5594c5f85a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.076s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:39:44 user nova-compute[74337]: DEBUG nova.compute.manager [req-2816571f-217e-4f69-b775-69033c612591 req-ad6ecae7-7777-4a6c-bc1e-196667a40069 service nova] [instance: 0ba8d1d0-5fac-4213-9a50-a4e273710b1b] Received event network-changed-c7a03b6c-5d0f-4a54-b615-16c7546eb5f7 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:39:44 user nova-compute[74337]: DEBUG nova.compute.manager [req-2816571f-217e-4f69-b775-69033c612591 req-ad6ecae7-7777-4a6c-bc1e-196667a40069 service nova] [instance: 0ba8d1d0-5fac-4213-9a50-a4e273710b1b] Refreshing instance network info cache due to event network-changed-c7a03b6c-5d0f-4a54-b615-16c7546eb5f7. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 21:39:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-2816571f-217e-4f69-b775-69033c612591 req-ad6ecae7-7777-4a6c-bc1e-196667a40069 service nova] Acquiring lock "refresh_cache-0ba8d1d0-5fac-4213-9a50-a4e273710b1b" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:39:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-2816571f-217e-4f69-b775-69033c612591 req-ad6ecae7-7777-4a6c-bc1e-196667a40069 service nova] Acquired lock "refresh_cache-0ba8d1d0-5fac-4213-9a50-a4e273710b1b" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:39:44 user nova-compute[74337]: DEBUG nova.network.neutron [req-2816571f-217e-4f69-b775-69033c612591 req-ad6ecae7-7777-4a6c-bc1e-196667a40069 service nova] [instance: 0ba8d1d0-5fac-4213-9a50-a4e273710b1b] Refreshing network info cache for port c7a03b6c-5d0f-4a54-b615-16c7546eb5f7 {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 21:39:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-89703f46-10b3-4dbe-b8ae-50ac456b578f tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/547c4d4c-e0dd-495a-b83f-98426d0a4a99/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:39:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "d45e8ae8-371b-46ae-849d-d7f7d5bbd770" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.097s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:39:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-6d1b5662-6d34-4c45-9b59-f3579c169ae8 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Acquiring lock "refresh_cache-0ba8d1d0-5fac-4213-9a50-a4e273710b1b" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:39:44 user nova-compute[74337]: DEBUG nova.virt.disk.api [None req-89703f46-10b3-4dbe-b8ae-50ac456b578f tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Cannot resize image /opt/stack/data/nova/instances/547c4d4c-e0dd-495a-b83f-98426d0a4a99/disk to a smaller size. {{(pid=74337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 21:39:44 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-89703f46-10b3-4dbe-b8ae-50ac456b578f tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 547c4d4c-e0dd-495a-b83f-98426d0a4a99] Created local disks {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 21:39:44 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-89703f46-10b3-4dbe-b8ae-50ac456b578f tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 547c4d4c-e0dd-495a-b83f-98426d0a4a99] Ensure instance console log exists: /opt/stack/data/nova/instances/547c4d4c-e0dd-495a-b83f-98426d0a4a99/console.log {{(pid=74337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 21:39:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-89703f46-10b3-4dbe-b8ae-50ac456b578f tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:39:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-89703f46-10b3-4dbe-b8ae-50ac456b578f tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:39:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-89703f46-10b3-4dbe-b8ae-50ac456b578f tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:39:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "2cae5b4d-96a0-41ae-9643-b7bf09581988" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.120s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:39:44 user nova-compute[74337]: DEBUG nova.network.neutron [req-2816571f-217e-4f69-b775-69033c612591 req-ad6ecae7-7777-4a6c-bc1e-196667a40069 service nova] [instance: 0ba8d1d0-5fac-4213-9a50-a4e273710b1b] Instance cache missing network info. {{(pid=74337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 21:39:44 user nova-compute[74337]: DEBUG nova.network.neutron [None req-89703f46-10b3-4dbe-b8ae-50ac456b578f tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 547c4d4c-e0dd-495a-b83f-98426d0a4a99] Successfully created port: 2dd20d7f-9490-476a-90ed-e6a1c9085e4d {{(pid=74337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG nova.network.neutron [req-2816571f-217e-4f69-b775-69033c612591 req-ad6ecae7-7777-4a6c-bc1e-196667a40069 service nova] [instance: 0ba8d1d0-5fac-4213-9a50-a4e273710b1b] Updating instance_info_cache with network_info: [] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-2816571f-217e-4f69-b775-69033c612591 req-ad6ecae7-7777-4a6c-bc1e-196667a40069 service nova] Releasing lock "refresh_cache-0ba8d1d0-5fac-4213-9a50-a4e273710b1b" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-6d1b5662-6d34-4c45-9b59-f3579c169ae8 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Acquired lock "refresh_cache-0ba8d1d0-5fac-4213-9a50-a4e273710b1b" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG nova.network.neutron [None req-6d1b5662-6d34-4c45-9b59-f3579c169ae8 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] [instance: 0ba8d1d0-5fac-4213-9a50-a4e273710b1b] Building network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Starting finish_revert_migration {{(pid=74337) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Start _get_guest_xml network_info=[{"id": "872b2a23-8054-4d26-b798-c0099d1c9a91", "address": "fa:16:3e:30:a6:90", "network": {"id": "b6a24032-0229-4ebe-83a3-8804e494838c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1472404179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17117e60d0d9484d80c0bc8de393921c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap872b2a23-80", "ovs_interfaceid": "872b2a23-8054-4d26-b798-c0099d1c9a91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=d859d89d-998d-4109-b26a-0d6e28152932,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'image_id': 'd859d89d-998d-4109-b26a-0d6e28152932'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'eda3c8a6-2b54-4e9b-8b1d-f3e85dfa32c3', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cQHBUDwS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'd1dbccc7-0a00-4b8b-813d-e3ca38ee0d50', 'attached_at': '2023-10-23T21:39:45.000000', 'detached_at': '', 'volume_id': '61659946-05f4-49d5-9e10-69b68340b522', 'serial': '61659946-05f4-49d5-9e10-69b68340b522'}, 'guest_format': None, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 21:39:45 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:39:45 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:39:45 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] CPU controller missing on host. {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] CPU controller found on host. {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T21:29:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=d859d89d-998d-4109-b26a-0d6e28152932,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Flavor limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Image limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Flavor pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Image pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Got 1 possible topologies {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG nova.objects.instance [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Lazy-loading 'vcpu_model' on Instance uuid d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG nova.network.neutron [None req-6d1b5662-6d34-4c45-9b59-f3579c169ae8 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] [instance: 0ba8d1d0-5fac-4213-9a50-a4e273710b1b] Instance cache missing network info. {{(pid=74337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Calling os-brick to attach iSCSI Volume {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cQHBUDwS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:39:45 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:39:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:39:45 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:39:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:39:45 user nova-compute[74337]: INFO os_brick.initiator.connectors.iscsi [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 21:39:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 -p 172.16.0.220:3260 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 -p 172.16.0.220:3260" returned: 21 in 0.043s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e29ddf-f072-4117-92e4-d0e086de4afc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 21:39:45 user nova-compute[74337]:  {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 -p 172.16.0.220:3260 --interface default --op new {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6360840e-ddf4-41df-b327-b3d2ee9072ae]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522] added\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522] added
Oct 23 21:39:45 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[10907069-4117-437a-afbd-478577f779fe]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c101563e-3e89-43a3-9322-1a857f27719e]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cQHBUDwS {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cQHBUDwS" returned: 0 in 0.020s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b811d5cc-5e03-4f70-9332-86ed4db5a75e]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cQHBUDwS'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[18dca05f-d3a4-4043-a47e-90dc279762ab]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6365318-b7b5-42cc-9bc8-a57c20d5742f]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01 (non-flash)
Oct 23 21:39:45 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01 (non-flash)
Oct 23 21:39:45 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 -p 172.16.0.220:3260 --login {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4417547-d553-4008-a819-6f8d7df5986b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522, portal: 172.16.0.220,3260]
Oct 23 21:39:45 user nova-compute[74337]: Login to [iface: default, target: iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522, portal: 172.16.0.220,3260] successful.
Oct 23 21:39:45 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da1a63d-64f5-426e-93b4-ec650f958b0a]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a50572-8463-4459-a5a8-c6a5d44ade05]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01 (non-flash)
Oct 23 21:39:45 user nova-compute[74337]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 (non-flash)
Oct 23 21:39:45 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01 (non-flash)
Oct 23 21:39:45 user nova-compute[74337]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 (non-flash)
Oct 23 21:39:45 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.340s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Connected to 172.16.0.220:3260 {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] HCTL ('34', '-', '-', 0) found on session 19 with lun 0 {{(pid=74337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b60395ca-6545-4edb-b40d-aa84e45ada6d]: (4, ('- - 0', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Searching for a device in session 19 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cQHBUDwS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG nova.network.neutron [None req-6d1b5662-6d34-4c45-9b59-f3579c169ae8 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] [instance: 0ba8d1d0-5fac-4213-9a50-a4e273710b1b] Updating instance_info_cache with network_info: [{"id": "c7a03b6c-5d0f-4a54-b615-16c7546eb5f7", "address": "fa:16:3e:b6:7b:d0", "network": {"id": "3d6e3d17-6da2-4ac1-ab9f-b7ed54db79bc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1078020443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83700495146c4b0e8d76491380b5f895", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7a03b6c-5d", "ovs_interfaceid": "c7a03b6c-5d0f-4a54-b615-16c7546eb5f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-6d1b5662-6d34-4c45-9b59-f3579c169ae8 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Releasing lock "refresh_cache-0ba8d1d0-5fac-4213-9a50-a4e273710b1b" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG nova.compute.manager [None req-6d1b5662-6d34-4c45-9b59-f3579c169ae8 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] [instance: 0ba8d1d0-5fac-4213-9a50-a4e273710b1b] Instance network_info: |[{"id": "c7a03b6c-5d0f-4a54-b615-16c7546eb5f7", "address": "fa:16:3e:b6:7b:d0", "network": {"id": "3d6e3d17-6da2-4ac1-ab9f-b7ed54db79bc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1078020443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83700495146c4b0e8d76491380b5f895", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7a03b6c-5d", "ovs_interfaceid": "c7a03b6c-5d0f-4a54-b615-16c7546eb5f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-6d1b5662-6d34-4c45-9b59-f3579c169ae8 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] [instance: 0ba8d1d0-5fac-4213-9a50-a4e273710b1b] Start _get_guest_xml network_info=[{"id": "c7a03b6c-5d0f-4a54-b615-16c7546eb5f7", "address": "fa:16:3e:b6:7b:d0", "network": {"id": "3d6e3d17-6da2-4ac1-ab9f-b7ed54db79bc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1078020443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83700495146c4b0e8d76491380b5f895", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7a03b6c-5d", "ovs_interfaceid": "c7a03b6c-5d0f-4a54-b615-16c7546eb5f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T21:29:21Z,direct_url=<?>,disk_format='qcow2',id=d859d89d-998d-4109-b26a-0d6e28152932,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ff43462300764979a6cf688444336a56',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T21:29:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'image_id': 'd859d89d-998d-4109-b26a-0d6e28152932'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 21:39:45 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-6d1b5662-6d34-4c45-9b59-f3579c169ae8 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:39:45 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-6d1b5662-6d34-4c45-9b59-f3579c169ae8 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:39:45 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-6d1b5662-6d34-4c45-9b59-f3579c169ae8 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-6d1b5662-6d34-4c45-9b59-f3579c169ae8 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] CPU controller missing on host. {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-6d1b5662-6d34-4c45-9b59-f3579c169ae8 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-6d1b5662-6d34-4c45-9b59-f3579c169ae8 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] CPU controller found on host. {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-6d1b5662-6d34-4c45-9b59-f3579c169ae8 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-6d1b5662-6d34-4c45-9b59-f3579c169ae8 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T21:29:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T21:29:21Z,direct_url=<?>,disk_format='qcow2',id=d859d89d-998d-4109-b26a-0d6e28152932,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ff43462300764979a6cf688444336a56',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T21:29:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-6d1b5662-6d34-4c45-9b59-f3579c169ae8 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Flavor limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-6d1b5662-6d34-4c45-9b59-f3579c169ae8 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Image limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-6d1b5662-6d34-4c45-9b59-f3579c169ae8 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Flavor pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-6d1b5662-6d34-4c45-9b59-f3579c169ae8 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Image pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-6d1b5662-6d34-4c45-9b59-f3579c169ae8 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-6d1b5662-6d34-4c45-9b59-f3579c169ae8 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-6d1b5662-6d34-4c45-9b59-f3579c169ae8 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-6d1b5662-6d34-4c45-9b59-f3579c169ae8 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Got 1 possible topologies {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-6d1b5662-6d34-4c45-9b59-f3579c169ae8 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-6d1b5662-6d34-4c45-9b59-f3579c169ae8 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-6d1b5662-6d34-4c45-9b59-f3579c169ae8 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:39:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1579661659',display_name='tempest-ServersNegativeTestJSON-server-1579661659',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1579661659',id=16,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83700495146c4b0e8d76491380b5f895',ramdisk_id='',reservation_id='r-irbp4xpm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-2018044743',owner_user_name='tempest-ServersNegativeTestJSON-2018044743-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:39:42Z,user_data=None,user_id='c11f9fb1ab7c411fa9069976c4419bbf',uuid=0ba8d1d0-5fac-4213-9a50-a4e273710b1b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c7a03b6c-5d0f-4a54-b615-16c7546eb5f7", "address": "fa:16:3e:b6:7b:d0", "network": {"id": "3d6e3d17-6da2-4ac1-ab9f-b7ed54db79bc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1078020443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83700495146c4b0e8d76491380b5f895", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7a03b6c-5d", "ovs_interfaceid": "c7a03b6c-5d0f-4a54-b615-16c7546eb5f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-6d1b5662-6d34-4c45-9b59-f3579c169ae8 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Converting VIF {"id": "c7a03b6c-5d0f-4a54-b615-16c7546eb5f7", "address": "fa:16:3e:b6:7b:d0", "network": {"id": "3d6e3d17-6da2-4ac1-ab9f-b7ed54db79bc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1078020443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83700495146c4b0e8d76491380b5f895", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7a03b6c-5d", "ovs_interfaceid": "c7a03b6c-5d0f-4a54-b615-16c7546eb5f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-6d1b5662-6d34-4c45-9b59-f3579c169ae8 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:7b:d0,bridge_name='br-int',has_traffic_filtering=True,id=c7a03b6c-5d0f-4a54-b615-16c7546eb5f7,network=Network(3d6e3d17-6da2-4ac1-ab9f-b7ed54db79bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7a03b6c-5d') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG nova.objects.instance [None req-6d1b5662-6d34-4c45-9b59-f3579c169ae8 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Lazy-loading 'pci_devices' on Instance uuid 0ba8d1d0-5fac-4213-9a50-a4e273710b1b {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-6d1b5662-6d34-4c45-9b59-f3579c169ae8 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] [instance: 0ba8d1d0-5fac-4213-9a50-a4e273710b1b] End _get_guest_xml xml=<domain type="kvm">
Oct 23 21:39:45 user nova-compute[74337]:   <uuid>0ba8d1d0-5fac-4213-9a50-a4e273710b1b</uuid>
Oct 23 21:39:45 user nova-compute[74337]:   <name>instance-00000010</name>
Oct 23 21:39:45 user nova-compute[74337]:   <memory>524288</memory>
Oct 23 21:39:45 user nova-compute[74337]:   <vcpu>1</vcpu>
Oct 23 21:39:45 user nova-compute[74337]:   <metadata>
Oct 23 21:39:45 user nova-compute[74337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 21:39:45 user nova-compute[74337]:       <nova:package version="0.0.0"/>
Oct 23 21:39:45 user nova-compute[74337]:       <nova:name>tempest-ServersNegativeTestJSON-server-1579661659</nova:name>
Oct 23 21:39:45 user nova-compute[74337]:       <nova:creationTime>2023-10-23 21:39:45</nova:creationTime>
Oct 23 21:39:45 user nova-compute[74337]:       <nova:flavor name="m1.tiny">
Oct 23 21:39:45 user nova-compute[74337]:         <nova:memory>512</nova:memory>
Oct 23 21:39:45 user nova-compute[74337]:         <nova:disk>1</nova:disk>
Oct 23 21:39:45 user nova-compute[74337]:         <nova:swap>0</nova:swap>
Oct 23 21:39:45 user nova-compute[74337]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 21:39:45 user nova-compute[74337]:         <nova:vcpus>1</nova:vcpus>
Oct 23 21:39:45 user nova-compute[74337]:       </nova:flavor>
Oct 23 21:39:45 user nova-compute[74337]:       <nova:owner>
Oct 23 21:39:45 user nova-compute[74337]:         <nova:user uuid="c11f9fb1ab7c411fa9069976c4419bbf">tempest-ServersNegativeTestJSON-2018044743-project-member</nova:user>
Oct 23 21:39:45 user nova-compute[74337]:         <nova:project uuid="83700495146c4b0e8d76491380b5f895">tempest-ServersNegativeTestJSON-2018044743</nova:project>
Oct 23 21:39:45 user nova-compute[74337]:       </nova:owner>
Oct 23 21:39:45 user nova-compute[74337]:       <nova:root type="image" uuid="d859d89d-998d-4109-b26a-0d6e28152932"/>
Oct 23 21:39:45 user nova-compute[74337]:       <nova:ports>
Oct 23 21:39:45 user nova-compute[74337]:         <nova:port uuid="c7a03b6c-5d0f-4a54-b615-16c7546eb5f7">
Oct 23 21:39:45 user nova-compute[74337]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 23 21:39:45 user nova-compute[74337]:         </nova:port>
Oct 23 21:39:45 user nova-compute[74337]:       </nova:ports>
Oct 23 21:39:45 user nova-compute[74337]:     </nova:instance>
Oct 23 21:39:45 user nova-compute[74337]:   </metadata>
Oct 23 21:39:45 user nova-compute[74337]:   <sysinfo type="smbios">
Oct 23 21:39:45 user nova-compute[74337]:     <system>
Oct 23 21:39:45 user nova-compute[74337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 21:39:45 user nova-compute[74337]:       <entry name="product">OpenStack Nova</entry>
Oct 23 21:39:45 user nova-compute[74337]:       <entry name="version">0.0.0</entry>
Oct 23 21:39:45 user nova-compute[74337]:       <entry name="serial">0ba8d1d0-5fac-4213-9a50-a4e273710b1b</entry>
Oct 23 21:39:45 user nova-compute[74337]:       <entry name="uuid">0ba8d1d0-5fac-4213-9a50-a4e273710b1b</entry>
Oct 23 21:39:45 user nova-compute[74337]:       <entry name="family">Virtual Machine</entry>
Oct 23 21:39:45 user nova-compute[74337]:     </system>
Oct 23 21:39:45 user nova-compute[74337]:   </sysinfo>
Oct 23 21:39:45 user nova-compute[74337]:   <os>
Oct 23 21:39:45 user nova-compute[74337]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 21:39:45 user nova-compute[74337]:     <boot dev="hd"/>
Oct 23 21:39:45 user nova-compute[74337]:     <smbios mode="sysinfo"/>
Oct 23 21:39:45 user nova-compute[74337]:   </os>
Oct 23 21:39:45 user nova-compute[74337]:   <features>
Oct 23 21:39:45 user nova-compute[74337]:     <acpi/>
Oct 23 21:39:45 user nova-compute[74337]:     <apic/>
Oct 23 21:39:45 user nova-compute[74337]:     <vmcoreinfo/>
Oct 23 21:39:45 user nova-compute[74337]:   </features>
Oct 23 21:39:45 user nova-compute[74337]:   <clock offset="utc">
Oct 23 21:39:45 user nova-compute[74337]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 21:39:45 user nova-compute[74337]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 21:39:45 user nova-compute[74337]:     <timer name="hpet" present="no"/>
Oct 23 21:39:45 user nova-compute[74337]:   </clock>
Oct 23 21:39:45 user nova-compute[74337]:   <cpu mode="custom" match="exact">
Oct 23 21:39:45 user nova-compute[74337]:     <model>Nehalem</model>
Oct 23 21:39:45 user nova-compute[74337]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 21:39:45 user nova-compute[74337]:   </cpu>
Oct 23 21:39:45 user nova-compute[74337]:   <devices>
Oct 23 21:39:45 user nova-compute[74337]:     <disk type="file" device="disk">
Oct 23 21:39:45 user nova-compute[74337]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 21:39:45 user nova-compute[74337]:       <source file="/opt/stack/data/nova/instances/0ba8d1d0-5fac-4213-9a50-a4e273710b1b/disk"/>
Oct 23 21:39:45 user nova-compute[74337]:       <target dev="vda" bus="virtio"/>
Oct 23 21:39:45 user nova-compute[74337]:     </disk>
Oct 23 21:39:45 user nova-compute[74337]:     <interface type="ethernet">
Oct 23 21:39:45 user nova-compute[74337]:       <mac address="fa:16:3e:b6:7b:d0"/>
Oct 23 21:39:45 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:39:45 user nova-compute[74337]:       <mtu size="1442"/>
Oct 23 21:39:45 user nova-compute[74337]:       <target dev="tapc7a03b6c-5d"/>
Oct 23 21:39:45 user nova-compute[74337]:     </interface>
Oct 23 21:39:45 user nova-compute[74337]:     <serial type="pty">
Oct 23 21:39:45 user nova-compute[74337]:       <log file="/opt/stack/data/nova/instances/0ba8d1d0-5fac-4213-9a50-a4e273710b1b/console.log" append="off"/>
Oct 23 21:39:45 user nova-compute[74337]:     </serial>
Oct 23 21:39:45 user nova-compute[74337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 21:39:45 user nova-compute[74337]:     <video>
Oct 23 21:39:45 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:39:45 user nova-compute[74337]:     </video>
Oct 23 21:39:45 user nova-compute[74337]:     <rng model="virtio">
Oct 23 21:39:45 user nova-compute[74337]:       <backend model="random">/dev/urandom</backend>
Oct 23 21:39:45 user nova-compute[74337]:     </rng>
Oct 23 21:39:45 user nova-compute[74337]:     <controller type="usb" index="0" model="none"/>
Oct 23 21:39:45 user nova-compute[74337]:     <memballoon model="virtio">
Oct 23 21:39:45 user nova-compute[74337]:       <stats period="10"/>
Oct 23 21:39:45 user nova-compute[74337]:     </memballoon>
Oct 23 21:39:45 user nova-compute[74337]:   </devices>
Oct 23 21:39:45 user nova-compute[74337]: </domain>
Oct 23 21:39:45 user nova-compute[74337]:  {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-6d1b5662-6d34-4c45-9b59-f3579c169ae8 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:39:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1579661659',display_name='tempest-ServersNegativeTestJSON-server-1579661659',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1579661659',id=16,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83700495146c4b0e8d76491380b5f895',ramdisk_id='',reservation_id='r-irbp4xpm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-2018044743',owner_user_name='tempest-ServersNegativeTestJSON-2018044743-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:39:42Z,user_data=None,user_id='c11f9fb1ab7c411fa9069976c4419bbf',uuid=0ba8d1d0-5fac-4213-9a50-a4e273710b1b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c7a03b6c-5d0f-4a54-b615-16c7546eb5f7", "address": "fa:16:3e:b6:7b:d0", "network": {"id": "3d6e3d17-6da2-4ac1-ab9f-b7ed54db79bc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1078020443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83700495146c4b0e8d76491380b5f895", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7a03b6c-5d", "ovs_interfaceid": "c7a03b6c-5d0f-4a54-b615-16c7546eb5f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-6d1b5662-6d34-4c45-9b59-f3579c169ae8 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Converting VIF {"id": "c7a03b6c-5d0f-4a54-b615-16c7546eb5f7", "address": "fa:16:3e:b6:7b:d0", "network": {"id": "3d6e3d17-6da2-4ac1-ab9f-b7ed54db79bc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1078020443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83700495146c4b0e8d76491380b5f895", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7a03b6c-5d", "ovs_interfaceid": "c7a03b6c-5d0f-4a54-b615-16c7546eb5f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-6d1b5662-6d34-4c45-9b59-f3579c169ae8 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:7b:d0,bridge_name='br-int',has_traffic_filtering=True,id=c7a03b6c-5d0f-4a54-b615-16c7546eb5f7,network=Network(3d6e3d17-6da2-4ac1-ab9f-b7ed54db79bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7a03b6c-5d') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG os_vif [None req-6d1b5662-6d34-4c45-9b59-f3579c169ae8 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:7b:d0,bridge_name='br-int',has_traffic_filtering=True,id=c7a03b6c-5d0f-4a54-b615-16c7546eb5f7,network=Network(3d6e3d17-6da2-4ac1-ab9f-b7ed54db79bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7a03b6c-5d') {{(pid=74337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8b2d0018-b78a-52f2-8069-21559210048a', '_type': 'linux-noop'}}, row=False) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc7a03b6c-5d, may_exist=True, interface_attrs={}) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc7a03b6c-5d, col_values=(('qos', UUID('a8f1eddb-992d-4df8-8202-02b212933855')),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc7a03b6c-5d, col_values=(('external_ids', {'iface-id': 'c7a03b6c-5d0f-4a54-b615-16c7546eb5f7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b6:7b:d0', 'vm-uuid': '0ba8d1d0-5fac-4213-9a50-a4e273710b1b'}),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:39:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:39:45 user nova-compute[74337]: INFO os_vif [None req-6d1b5662-6d34-4c45-9b59-f3579c169ae8 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:7b:d0,bridge_name='br-int',has_traffic_filtering=True,id=c7a03b6c-5d0f-4a54-b615-16c7546eb5f7,network=Network(3d6e3d17-6da2-4ac1-ab9f-b7ed54db79bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7a03b6c-5d')
Oct 23 21:39:46 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-6d1b5662-6d34-4c45-9b59-f3579c169ae8 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] No BDM found with device name vda, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 21:39:46 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-6d1b5662-6d34-4c45-9b59-f3579c169ae8 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] No VIF found with MAC fa:16:3e:b6:7b:d0, not building metadata {{(pid=74337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 21:39:46 user nova-compute[74337]: DEBUG nova.network.neutron [None req-89703f46-10b3-4dbe-b8ae-50ac456b578f tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 547c4d4c-e0dd-495a-b83f-98426d0a4a99] Successfully updated port: 2dd20d7f-9490-476a-90ed-e6a1c9085e4d {{(pid=74337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 21:39:46 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-89703f46-10b3-4dbe-b8ae-50ac456b578f tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Acquiring lock "refresh_cache-547c4d4c-e0dd-495a-b83f-98426d0a4a99" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:39:46 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-89703f46-10b3-4dbe-b8ae-50ac456b578f tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Acquired lock "refresh_cache-547c4d4c-e0dd-495a-b83f-98426d0a4a99" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:39:46 user nova-compute[74337]: DEBUG nova.network.neutron [None req-89703f46-10b3-4dbe-b8ae-50ac456b578f tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 547c4d4c-e0dd-495a-b83f-98426d0a4a99] Building network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 21:39:46 user nova-compute[74337]: DEBUG nova.network.neutron [None req-89703f46-10b3-4dbe-b8ae-50ac456b578f tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 547c4d4c-e0dd-495a-b83f-98426d0a4a99] Instance cache missing network info. {{(pid=74337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 21:39:46 user nova-compute[74337]: DEBUG nova.network.neutron [None req-89703f46-10b3-4dbe-b8ae-50ac456b578f tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 547c4d4c-e0dd-495a-b83f-98426d0a4a99] Updating instance_info_cache with network_info: [{"id": "2dd20d7f-9490-476a-90ed-e6a1c9085e4d", "address": "fa:16:3e:5f:e1:f7", "network": {"id": "aff1f95f-fda8-4f0f-8d10-7e3d587e4fda", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2048135647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1f57e58a9ec4c6384dc0d3ca58eb610", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd20d7f-94", "ovs_interfaceid": "2dd20d7f-9490-476a-90ed-e6a1c9085e4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:39:46 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-89703f46-10b3-4dbe-b8ae-50ac456b578f tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Releasing lock "refresh_cache-547c4d4c-e0dd-495a-b83f-98426d0a4a99" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:39:46 user nova-compute[74337]: DEBUG nova.compute.manager [None req-89703f46-10b3-4dbe-b8ae-50ac456b578f tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 547c4d4c-e0dd-495a-b83f-98426d0a4a99] Instance network_info: |[{"id": "2dd20d7f-9490-476a-90ed-e6a1c9085e4d", "address": "fa:16:3e:5f:e1:f7", "network": {"id": "aff1f95f-fda8-4f0f-8d10-7e3d587e4fda", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2048135647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1f57e58a9ec4c6384dc0d3ca58eb610", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd20d7f-94", "ovs_interfaceid": "2dd20d7f-9490-476a-90ed-e6a1c9085e4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 21:39:46 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-89703f46-10b3-4dbe-b8ae-50ac456b578f tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 547c4d4c-e0dd-495a-b83f-98426d0a4a99] Start _get_guest_xml network_info=[{"id": "2dd20d7f-9490-476a-90ed-e6a1c9085e4d", "address": "fa:16:3e:5f:e1:f7", "network": {"id": "aff1f95f-fda8-4f0f-8d10-7e3d587e4fda", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2048135647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1f57e58a9ec4c6384dc0d3ca58eb610", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd20d7f-94", "ovs_interfaceid": "2dd20d7f-9490-476a-90ed-e6a1c9085e4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T21:29:21Z,direct_url=<?>,disk_format='qcow2',id=d859d89d-998d-4109-b26a-0d6e28152932,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ff43462300764979a6cf688444336a56',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T21:29:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'image_id': 'd859d89d-998d-4109-b26a-0d6e28152932'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 21:39:46 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-89703f46-10b3-4dbe-b8ae-50ac456b578f tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:39:46 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-89703f46-10b3-4dbe-b8ae-50ac456b578f tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:39:46 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-89703f46-10b3-4dbe-b8ae-50ac456b578f tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 21:39:46 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-89703f46-10b3-4dbe-b8ae-50ac456b578f tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] CPU controller missing on host. {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 21:39:46 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-89703f46-10b3-4dbe-b8ae-50ac456b578f tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 21:39:46 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-89703f46-10b3-4dbe-b8ae-50ac456b578f tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] CPU controller found on host. {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 21:39:46 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-89703f46-10b3-4dbe-b8ae-50ac456b578f tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 21:39:46 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-89703f46-10b3-4dbe-b8ae-50ac456b578f tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T21:29:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T21:29:21Z,direct_url=<?>,disk_format='qcow2',id=d859d89d-998d-4109-b26a-0d6e28152932,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ff43462300764979a6cf688444336a56',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T21:29:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 21:39:46 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-89703f46-10b3-4dbe-b8ae-50ac456b578f tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Flavor limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 21:39:46 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-89703f46-10b3-4dbe-b8ae-50ac456b578f tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Image limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 21:39:46 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-89703f46-10b3-4dbe-b8ae-50ac456b578f tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Flavor pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 21:39:46 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-89703f46-10b3-4dbe-b8ae-50ac456b578f tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Image pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 21:39:46 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-89703f46-10b3-4dbe-b8ae-50ac456b578f tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 21:39:46 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-89703f46-10b3-4dbe-b8ae-50ac456b578f tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 21:39:46 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-89703f46-10b3-4dbe-b8ae-50ac456b578f tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 21:39:46 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-89703f46-10b3-4dbe-b8ae-50ac456b578f tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Got 1 possible topologies {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 21:39:46 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-89703f46-10b3-4dbe-b8ae-50ac456b578f tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 21:39:46 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-89703f46-10b3-4dbe-b8ae-50ac456b578f tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 21:39:46 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-89703f46-10b3-4dbe-b8ae-50ac456b578f tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:39:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1158479955',display_name='tempest-ServerActionsTestOtherA-server-1158479955',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1158479955',id=17,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAUefvW5MXCf+ATdQvlG858gIBXPDNbf7wcgIdNA8u/7ry6R/jyuWYoMofLLf6tWmqavGvJQy7SZOewcrGrMe1Wf24ACMK0qGJkM0S6nAXe5EBQ2zvJtr8dUyXZnBDdU6w==',key_name='tempest-keypair-1448030867',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e1f57e58a9ec4c6384dc0d3ca58eb610',ramdisk_id='',reservation_id='r-n7s1gje7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-100075475',owner_user_name='tempest-ServerActionsTestOtherA-100075475-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:39:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='891ee2e3acc54ed0bc4571f63ff491a0',uuid=547c4d4c-e0dd-495a-b83f-98426d0a4a99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2dd20d7f-9490-476a-90ed-e6a1c9085e4d", "address": "fa:16:3e:5f:e1:f7", "network": {"id": "aff1f95f-fda8-4f0f-8d10-7e3d587e4fda", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2048135647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1f57e58a9ec4c6384dc0d3ca58eb610", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd20d7f-94", "ovs_interfaceid": "2dd20d7f-9490-476a-90ed-e6a1c9085e4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 21:39:46 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-89703f46-10b3-4dbe-b8ae-50ac456b578f tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Converting VIF {"id": "2dd20d7f-9490-476a-90ed-e6a1c9085e4d", "address": "fa:16:3e:5f:e1:f7", "network": {"id": "aff1f95f-fda8-4f0f-8d10-7e3d587e4fda", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2048135647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1f57e58a9ec4c6384dc0d3ca58eb610", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd20d7f-94", "ovs_interfaceid": "2dd20d7f-9490-476a-90ed-e6a1c9085e4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:39:46 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-89703f46-10b3-4dbe-b8ae-50ac456b578f tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:e1:f7,bridge_name='br-int',has_traffic_filtering=True,id=2dd20d7f-9490-476a-90ed-e6a1c9085e4d,network=Network(aff1f95f-fda8-4f0f-8d10-7e3d587e4fda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dd20d7f-94') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:39:46 user nova-compute[74337]: DEBUG nova.objects.instance [None req-89703f46-10b3-4dbe-b8ae-50ac456b578f tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lazy-loading 'pci_devices' on Instance uuid 547c4d4c-e0dd-495a-b83f-98426d0a4a99 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:39:46 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-89703f46-10b3-4dbe-b8ae-50ac456b578f tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 547c4d4c-e0dd-495a-b83f-98426d0a4a99] End _get_guest_xml xml=<domain type="kvm">
Oct 23 21:39:46 user nova-compute[74337]:   <uuid>547c4d4c-e0dd-495a-b83f-98426d0a4a99</uuid>
Oct 23 21:39:46 user nova-compute[74337]:   <name>instance-00000011</name>
Oct 23 21:39:46 user nova-compute[74337]:   <memory>524288</memory>
Oct 23 21:39:46 user nova-compute[74337]:   <vcpu>1</vcpu>
Oct 23 21:39:46 user nova-compute[74337]:   <metadata>
Oct 23 21:39:46 user nova-compute[74337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 21:39:46 user nova-compute[74337]:       <nova:package version="0.0.0"/>
Oct 23 21:39:46 user nova-compute[74337]:       <nova:name>tempest-ServerActionsTestOtherA-server-1158479955</nova:name>
Oct 23 21:39:46 user nova-compute[74337]:       <nova:creationTime>2023-10-23 21:39:46</nova:creationTime>
Oct 23 21:39:46 user nova-compute[74337]:       <nova:flavor name="m1.tiny">
Oct 23 21:39:46 user nova-compute[74337]:         <nova:memory>512</nova:memory>
Oct 23 21:39:46 user nova-compute[74337]:         <nova:disk>1</nova:disk>
Oct 23 21:39:46 user nova-compute[74337]:         <nova:swap>0</nova:swap>
Oct 23 21:39:46 user nova-compute[74337]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 21:39:46 user nova-compute[74337]:         <nova:vcpus>1</nova:vcpus>
Oct 23 21:39:46 user nova-compute[74337]:       </nova:flavor>
Oct 23 21:39:46 user nova-compute[74337]:       <nova:owner>
Oct 23 21:39:46 user nova-compute[74337]:         <nova:user uuid="891ee2e3acc54ed0bc4571f63ff491a0">tempest-ServerActionsTestOtherA-100075475-project-member</nova:user>
Oct 23 21:39:46 user nova-compute[74337]:         <nova:project uuid="e1f57e58a9ec4c6384dc0d3ca58eb610">tempest-ServerActionsTestOtherA-100075475</nova:project>
Oct 23 21:39:46 user nova-compute[74337]:       </nova:owner>
Oct 23 21:39:46 user nova-compute[74337]:       <nova:root type="image" uuid="d859d89d-998d-4109-b26a-0d6e28152932"/>
Oct 23 21:39:46 user nova-compute[74337]:       <nova:ports>
Oct 23 21:39:46 user nova-compute[74337]:         <nova:port uuid="2dd20d7f-9490-476a-90ed-e6a1c9085e4d">
Oct 23 21:39:46 user nova-compute[74337]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 23 21:39:46 user nova-compute[74337]:         </nova:port>
Oct 23 21:39:46 user nova-compute[74337]:       </nova:ports>
Oct 23 21:39:46 user nova-compute[74337]:     </nova:instance>
Oct 23 21:39:46 user nova-compute[74337]:   </metadata>
Oct 23 21:39:46 user nova-compute[74337]:   <sysinfo type="smbios">
Oct 23 21:39:46 user nova-compute[74337]:     <system>
Oct 23 21:39:46 user nova-compute[74337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 21:39:46 user nova-compute[74337]:       <entry name="product">OpenStack Nova</entry>
Oct 23 21:39:46 user nova-compute[74337]:       <entry name="version">0.0.0</entry>
Oct 23 21:39:46 user nova-compute[74337]:       <entry name="serial">547c4d4c-e0dd-495a-b83f-98426d0a4a99</entry>
Oct 23 21:39:46 user nova-compute[74337]:       <entry name="uuid">547c4d4c-e0dd-495a-b83f-98426d0a4a99</entry>
Oct 23 21:39:46 user nova-compute[74337]:       <entry name="family">Virtual Machine</entry>
Oct 23 21:39:46 user nova-compute[74337]:     </system>
Oct 23 21:39:46 user nova-compute[74337]:   </sysinfo>
Oct 23 21:39:46 user nova-compute[74337]:   <os>
Oct 23 21:39:46 user nova-compute[74337]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 21:39:46 user nova-compute[74337]:     <boot dev="hd"/>
Oct 23 21:39:46 user nova-compute[74337]:     <smbios mode="sysinfo"/>
Oct 23 21:39:46 user nova-compute[74337]:   </os>
Oct 23 21:39:46 user nova-compute[74337]:   <features>
Oct 23 21:39:46 user nova-compute[74337]:     <acpi/>
Oct 23 21:39:46 user nova-compute[74337]:     <apic/>
Oct 23 21:39:46 user nova-compute[74337]:     <vmcoreinfo/>
Oct 23 21:39:46 user nova-compute[74337]:   </features>
Oct 23 21:39:46 user nova-compute[74337]:   <clock offset="utc">
Oct 23 21:39:46 user nova-compute[74337]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 21:39:46 user nova-compute[74337]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 21:39:46 user nova-compute[74337]:     <timer name="hpet" present="no"/>
Oct 23 21:39:46 user nova-compute[74337]:   </clock>
Oct 23 21:39:46 user nova-compute[74337]:   <cpu mode="custom" match="exact">
Oct 23 21:39:46 user nova-compute[74337]:     <model>Nehalem</model>
Oct 23 21:39:46 user nova-compute[74337]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 21:39:46 user nova-compute[74337]:   </cpu>
Oct 23 21:39:46 user nova-compute[74337]:   <devices>
Oct 23 21:39:46 user nova-compute[74337]:     <disk type="file" device="disk">
Oct 23 21:39:46 user nova-compute[74337]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 21:39:46 user nova-compute[74337]:       <source file="/opt/stack/data/nova/instances/547c4d4c-e0dd-495a-b83f-98426d0a4a99/disk"/>
Oct 23 21:39:46 user nova-compute[74337]:       <target dev="vda" bus="virtio"/>
Oct 23 21:39:46 user nova-compute[74337]:     </disk>
Oct 23 21:39:46 user nova-compute[74337]:     <interface type="ethernet">
Oct 23 21:39:46 user nova-compute[74337]:       <mac address="fa:16:3e:5f:e1:f7"/>
Oct 23 21:39:46 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:39:46 user nova-compute[74337]:       <mtu size="1442"/>
Oct 23 21:39:46 user nova-compute[74337]:       <target dev="tap2dd20d7f-94"/>
Oct 23 21:39:46 user nova-compute[74337]:     </interface>
Oct 23 21:39:46 user nova-compute[74337]:     <serial type="pty">
Oct 23 21:39:46 user nova-compute[74337]:       <log file="/opt/stack/data/nova/instances/547c4d4c-e0dd-495a-b83f-98426d0a4a99/console.log" append="off"/>
Oct 23 21:39:46 user nova-compute[74337]:     </serial>
Oct 23 21:39:46 user nova-compute[74337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 21:39:46 user nova-compute[74337]:     <video>
Oct 23 21:39:46 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:39:46 user nova-compute[74337]:     </video>
Oct 23 21:39:46 user nova-compute[74337]:     <rng model="virtio">
Oct 23 21:39:46 user nova-compute[74337]:       <backend model="random">/dev/urandom</backend>
Oct 23 21:39:46 user nova-compute[74337]:     </rng>
Oct 23 21:39:46 user nova-compute[74337]:     <controller type="usb" index="0" model="none"/>
Oct 23 21:39:46 user nova-compute[74337]:     <memballoon model="virtio">
Oct 23 21:39:46 user nova-compute[74337]:       <stats period="10"/>
Oct 23 21:39:46 user nova-compute[74337]:     </memballoon>
Oct 23 21:39:46 user nova-compute[74337]:   </devices>
Oct 23 21:39:46 user nova-compute[74337]: </domain>
Oct 23 21:39:46 user nova-compute[74337]:  {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 21:39:46 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-89703f46-10b3-4dbe-b8ae-50ac456b578f tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:39:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1158479955',display_name='tempest-ServerActionsTestOtherA-server-1158479955',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1158479955',id=17,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAUefvW5MXCf+ATdQvlG858gIBXPDNbf7wcgIdNA8u/7ry6R/jyuWYoMofLLf6tWmqavGvJQy7SZOewcrGrMe1Wf24ACMK0qGJkM0S6nAXe5EBQ2zvJtr8dUyXZnBDdU6w==',key_name='tempest-keypair-1448030867',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e1f57e58a9ec4c6384dc0d3ca58eb610',ramdisk_id='',reservation_id='r-n7s1gje7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-100075475',owner_user_name='tempest-ServerActionsTestOtherA-100075475-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:39:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='891ee2e3acc54ed0bc4571f63ff491a0',uuid=547c4d4c-e0dd-495a-b83f-98426d0a4a99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2dd20d7f-9490-476a-90ed-e6a1c9085e4d", "address": "fa:16:3e:5f:e1:f7", "network": {"id": "aff1f95f-fda8-4f0f-8d10-7e3d587e4fda", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2048135647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1f57e58a9ec4c6384dc0d3ca58eb610", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd20d7f-94", "ovs_interfaceid": "2dd20d7f-9490-476a-90ed-e6a1c9085e4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 21:39:46 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-89703f46-10b3-4dbe-b8ae-50ac456b578f tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Converting VIF {"id": "2dd20d7f-9490-476a-90ed-e6a1c9085e4d", "address": "fa:16:3e:5f:e1:f7", "network": {"id": "aff1f95f-fda8-4f0f-8d10-7e3d587e4fda", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2048135647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1f57e58a9ec4c6384dc0d3ca58eb610", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd20d7f-94", "ovs_interfaceid": "2dd20d7f-9490-476a-90ed-e6a1c9085e4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:39:46 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-89703f46-10b3-4dbe-b8ae-50ac456b578f tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:e1:f7,bridge_name='br-int',has_traffic_filtering=True,id=2dd20d7f-9490-476a-90ed-e6a1c9085e4d,network=Network(aff1f95f-fda8-4f0f-8d10-7e3d587e4fda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dd20d7f-94') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:39:46 user nova-compute[74337]: DEBUG os_vif [None req-89703f46-10b3-4dbe-b8ae-50ac456b578f tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:e1:f7,bridge_name='br-int',has_traffic_filtering=True,id=2dd20d7f-9490-476a-90ed-e6a1c9085e4d,network=Network(aff1f95f-fda8-4f0f-8d10-7e3d587e4fda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dd20d7f-94') {{(pid=74337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 21:39:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:39:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:39:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 21:39:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:39:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c0fa293d-4346-5e28-90e0-ea8539922988', '_type': 'linux-noop'}}, row=False) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:39:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:39:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:39:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:39:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:39:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2dd20d7f-94, may_exist=True, interface_attrs={}) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:39:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2dd20d7f-94, col_values=(('qos', UUID('ab729482-dae2-41e9-a0a3-6071dd3850b0')),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:39:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2dd20d7f-94, col_values=(('external_ids', {'iface-id': '2dd20d7f-9490-476a-90ed-e6a1c9085e4d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5f:e1:f7', 'vm-uuid': '547c4d4c-e0dd-495a-b83f-98426d0a4a99'}),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:39:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:39:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:39:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:39:46 user nova-compute[74337]: INFO os_vif [None req-89703f46-10b3-4dbe-b8ae-50ac456b578f tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:e1:f7,bridge_name='br-int',has_traffic_filtering=True,id=2dd20d7f-9490-476a-90ed-e6a1c9085e4d,network=Network(aff1f95f-fda8-4f0f-8d10-7e3d587e4fda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dd20d7f-94')
Oct 23 21:39:46 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.386s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:39:46 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] <== connect_volume: return (1388ms) {'type': 'block', 'scsi_wwn': '23137393363343964', 'path': '/dev/sdc'} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:39:46 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23137393363343964', 'path': '/dev/sdc'} {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 21:39:46 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-89703f46-10b3-4dbe-b8ae-50ac456b578f tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] No BDM found with device name vda, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 21:39:46 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-89703f46-10b3-4dbe-b8ae-50ac456b578f tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] No VIF found with MAC fa:16:3e:5f:e1:f7, not building metadata {{(pid=74337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 21:39:46 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:33:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1887044710',display_name='tempest-ServerActionsTestOtherB-server-1887044710',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1887044710',id=3,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHU30kXpNK56Ek7qPPN2svMqEvJefmquCorzEt/taRsaipSAkpLIVwB8P5vsm9bHgo5LnJ4I5wS/V9f0J2TYkkYbtKjnjylT3HdP3iz0AGKDmStPt9PuAI+hC3gVCHen5Q==',key_name='tempest-keypair-1524952332',keypairs=<?>,launch_index=0,launched_at=2023-10-23T21:38:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='17117e60d0d9484d80c0bc8de393921c',ramdisk_id='',reservation_id='r-1ao5mr6t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1301864789',owner_user_name='tempest-ServerActionsTestOtherB-1301864789-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T21:39:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='92570d8849c646d882017142cac1b674',uuid=d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "872b2a23-8054-4d26-b798-c0099d1c9a91", "address": "fa:16:3e:30:a6:90", "network": {"id": "b6a24032-0229-4ebe-83a3-8804e494838c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1472404179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17117e60d0d9484d80c0bc8de393921c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap872b2a23-80", "ovs_interfaceid": "872b2a23-8054-4d26-b798-c0099d1c9a91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 21:39:46 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Converting VIF {"id": "872b2a23-8054-4d26-b798-c0099d1c9a91", "address": "fa:16:3e:30:a6:90", "network": {"id": "b6a24032-0229-4ebe-83a3-8804e494838c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1472404179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17117e60d0d9484d80c0bc8de393921c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap872b2a23-80", "ovs_interfaceid": "872b2a23-8054-4d26-b798-c0099d1c9a91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:39:46 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:a6:90,bridge_name='br-int',has_traffic_filtering=True,id=872b2a23-8054-4d26-b798-c0099d1c9a91,network=Network(b6a24032-0229-4ebe-83a3-8804e494838c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap872b2a23-80') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:39:46 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] End _get_guest_xml xml=<domain type="kvm">
Oct 23 21:39:46 user nova-compute[74337]:   <uuid>d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50</uuid>
Oct 23 21:39:46 user nova-compute[74337]:   <name>instance-00000003</name>
Oct 23 21:39:46 user nova-compute[74337]:   <memory>524288</memory>
Oct 23 21:39:46 user nova-compute[74337]:   <vcpu>1</vcpu>
Oct 23 21:39:46 user nova-compute[74337]:   <metadata>
Oct 23 21:39:46 user nova-compute[74337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 21:39:46 user nova-compute[74337]:       <nova:package version="0.0.0"/>
Oct 23 21:39:46 user nova-compute[74337]:       <nova:name>tempest-ServerActionsTestOtherB-server-1887044710</nova:name>
Oct 23 21:39:46 user nova-compute[74337]:       <nova:creationTime>2023-10-23 21:39:45</nova:creationTime>
Oct 23 21:39:46 user nova-compute[74337]:       <nova:flavor name="m1.tiny">
Oct 23 21:39:46 user nova-compute[74337]:         <nova:memory>512</nova:memory>
Oct 23 21:39:46 user nova-compute[74337]:         <nova:disk>1</nova:disk>
Oct 23 21:39:46 user nova-compute[74337]:         <nova:swap>0</nova:swap>
Oct 23 21:39:46 user nova-compute[74337]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 21:39:46 user nova-compute[74337]:         <nova:vcpus>1</nova:vcpus>
Oct 23 21:39:46 user nova-compute[74337]:       </nova:flavor>
Oct 23 21:39:46 user nova-compute[74337]:       <nova:owner>
Oct 23 21:39:46 user nova-compute[74337]:         <nova:user uuid="92570d8849c646d882017142cac1b674">tempest-ServerActionsTestOtherB-1301864789-project-member</nova:user>
Oct 23 21:39:46 user nova-compute[74337]:         <nova:project uuid="17117e60d0d9484d80c0bc8de393921c">tempest-ServerActionsTestOtherB-1301864789</nova:project>
Oct 23 21:39:46 user nova-compute[74337]:       </nova:owner>
Oct 23 21:39:46 user nova-compute[74337]:       <nova:root type="image" uuid="d859d89d-998d-4109-b26a-0d6e28152932"/>
Oct 23 21:39:46 user nova-compute[74337]:       <nova:ports>
Oct 23 21:39:46 user nova-compute[74337]:         <nova:port uuid="872b2a23-8054-4d26-b798-c0099d1c9a91">
Oct 23 21:39:46 user nova-compute[74337]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 23 21:39:46 user nova-compute[74337]:         </nova:port>
Oct 23 21:39:46 user nova-compute[74337]:       </nova:ports>
Oct 23 21:39:46 user nova-compute[74337]:     </nova:instance>
Oct 23 21:39:46 user nova-compute[74337]:   </metadata>
Oct 23 21:39:46 user nova-compute[74337]:   <sysinfo type="smbios">
Oct 23 21:39:46 user nova-compute[74337]:     <system>
Oct 23 21:39:46 user nova-compute[74337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 21:39:46 user nova-compute[74337]:       <entry name="product">OpenStack Nova</entry>
Oct 23 21:39:46 user nova-compute[74337]:       <entry name="version">0.0.0</entry>
Oct 23 21:39:46 user nova-compute[74337]:       <entry name="serial">d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50</entry>
Oct 23 21:39:46 user nova-compute[74337]:       <entry name="uuid">d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50</entry>
Oct 23 21:39:46 user nova-compute[74337]:       <entry name="family">Virtual Machine</entry>
Oct 23 21:39:46 user nova-compute[74337]:     </system>
Oct 23 21:39:46 user nova-compute[74337]:   </sysinfo>
Oct 23 21:39:46 user nova-compute[74337]:   <os>
Oct 23 21:39:46 user nova-compute[74337]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 21:39:46 user nova-compute[74337]:     <boot dev="hd"/>
Oct 23 21:39:46 user nova-compute[74337]:     <smbios mode="sysinfo"/>
Oct 23 21:39:46 user nova-compute[74337]:   </os>
Oct 23 21:39:46 user nova-compute[74337]:   <features>
Oct 23 21:39:46 user nova-compute[74337]:     <acpi/>
Oct 23 21:39:46 user nova-compute[74337]:     <apic/>
Oct 23 21:39:46 user nova-compute[74337]:     <vmcoreinfo/>
Oct 23 21:39:46 user nova-compute[74337]:   </features>
Oct 23 21:39:46 user nova-compute[74337]:   <clock offset="utc">
Oct 23 21:39:46 user nova-compute[74337]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 21:39:46 user nova-compute[74337]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 21:39:46 user nova-compute[74337]:     <timer name="hpet" present="no"/>
Oct 23 21:39:46 user nova-compute[74337]:   </clock>
Oct 23 21:39:46 user nova-compute[74337]:   <cpu mode="custom" match="exact">
Oct 23 21:39:46 user nova-compute[74337]:     <model>Nehalem</model>
Oct 23 21:39:46 user nova-compute[74337]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 21:39:46 user nova-compute[74337]:   </cpu>
Oct 23 21:39:46 user nova-compute[74337]:   <devices>
Oct 23 21:39:46 user nova-compute[74337]:     <disk type="file" device="disk">
Oct 23 21:39:46 user nova-compute[74337]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 21:39:46 user nova-compute[74337]:       <source file="/opt/stack/data/nova/instances/d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50/disk"/>
Oct 23 21:39:46 user nova-compute[74337]:       <target dev="vda" bus="virtio"/>
Oct 23 21:39:46 user nova-compute[74337]:     </disk>
Oct 23 21:39:46 user nova-compute[74337]:     <disk type="block" device="disk">
Oct 23 21:39:46 user nova-compute[74337]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 21:39:46 user nova-compute[74337]:       <source dev="/dev/sdc"/>
Oct 23 21:39:46 user nova-compute[74337]:       <target dev="vdb" bus="virtio"/>
Oct 23 21:39:46 user nova-compute[74337]:       <serial>61659946-05f4-49d5-9e10-69b68340b522</serial>
Oct 23 21:39:46 user nova-compute[74337]:     </disk>
Oct 23 21:39:46 user nova-compute[74337]:     <interface type="ethernet">
Oct 23 21:39:46 user nova-compute[74337]:       <mac address="fa:16:3e:30:a6:90"/>
Oct 23 21:39:46 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:39:46 user nova-compute[74337]:       <mtu size="1442"/>
Oct 23 21:39:46 user nova-compute[74337]:       <target dev="tap872b2a23-80"/>
Oct 23 21:39:46 user nova-compute[74337]:     </interface>
Oct 23 21:39:46 user nova-compute[74337]:     <serial type="pty">
Oct 23 21:39:46 user nova-compute[74337]:       <log file="/opt/stack/data/nova/instances/d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50/console.log" append="off"/>
Oct 23 21:39:46 user nova-compute[74337]:     </serial>
Oct 23 21:39:46 user nova-compute[74337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 21:39:46 user nova-compute[74337]:     <video>
Oct 23 21:39:46 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:39:46 user nova-compute[74337]:     </video>
Oct 23 21:39:46 user nova-compute[74337]:     <rng model="virtio">
Oct 23 21:39:46 user nova-compute[74337]:       <backend model="random">/dev/urandom</backend>
Oct 23 21:39:46 user nova-compute[74337]:     </rng>
Oct 23 21:39:46 user nova-compute[74337]:     <controller type="usb" index="0" model="none"/>
Oct 23 21:39:46 user nova-compute[74337]:     <memballoon model="virtio">
Oct 23 21:39:46 user nova-compute[74337]:       <stats period="10"/>
Oct 23 21:39:46 user nova-compute[74337]:     </memballoon>
Oct 23 21:39:46 user nova-compute[74337]:   </devices>
Oct 23 21:39:46 user nova-compute[74337]: </domain>
Oct 23 21:39:46 user nova-compute[74337]:  {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 21:39:46 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:33:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1887044710',display_name='tempest-ServerActionsTestOtherB-server-1887044710',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1887044710',id=3,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHU30kXpNK56Ek7qPPN2svMqEvJefmquCorzEt/taRsaipSAkpLIVwB8P5vsm9bHgo5LnJ4I5wS/V9f0J2TYkkYbtKjnjylT3HdP3iz0AGKDmStPt9PuAI+hC3gVCHen5Q==',key_name='tempest-keypair-1524952332',keypairs=<?>,launch_index=0,launched_at=2023-10-23T21:38:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='17117e60d0d9484d80c0bc8de393921c',ramdisk_id='',reservation_id='r-1ao5mr6t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1301864789',owner_user_name='tempest-ServerActionsTestOtherB-1301864789-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T21:39:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='92570d8849c646d882017142cac1b674',uuid=d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "872b2a23-8054-4d26-b798-c0099d1c9a91", "address": "fa:16:3e:30:a6:90", "network": {"id": "b6a24032-0229-4ebe-83a3-8804e494838c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1472404179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17117e60d0d9484d80c0bc8de393921c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap872b2a23-80", "ovs_interfaceid": "872b2a23-8054-4d26-b798-c0099d1c9a91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 21:39:46 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Converting VIF {"id": "872b2a23-8054-4d26-b798-c0099d1c9a91", "address": "fa:16:3e:30:a6:90", "network": {"id": "b6a24032-0229-4ebe-83a3-8804e494838c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1472404179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17117e60d0d9484d80c0bc8de393921c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap872b2a23-80", "ovs_interfaceid": "872b2a23-8054-4d26-b798-c0099d1c9a91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:39:46 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:a6:90,bridge_name='br-int',has_traffic_filtering=True,id=872b2a23-8054-4d26-b798-c0099d1c9a91,network=Network(b6a24032-0229-4ebe-83a3-8804e494838c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap872b2a23-80') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:39:46 user nova-compute[74337]: DEBUG os_vif [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:a6:90,bridge_name='br-int',has_traffic_filtering=True,id=872b2a23-8054-4d26-b798-c0099d1c9a91,network=Network(b6a24032-0229-4ebe-83a3-8804e494838c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap872b2a23-80') {{(pid=74337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 21:39:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:39:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:39:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 21:39:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:39:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a05b1896-5c56-5ff6-93a0-848735048ff7', '_type': 'linux-noop'}}, row=False) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:39:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:39:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:39:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:39:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:39:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap872b2a23-80, may_exist=True, interface_attrs={}) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:39:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap872b2a23-80, col_values=(('qos', UUID('59010208-fdf6-4e0a-a727-a5c5e030522a')),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:39:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap872b2a23-80, col_values=(('external_ids', {'iface-id': '872b2a23-8054-4d26-b798-c0099d1c9a91', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:30:a6:90', 'vm-uuid': 'd1dbccc7-0a00-4b8b-813d-e3ca38ee0d50'}),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:39:46 user nova-compute[74337]: DEBUG nova.compute.manager [req-e7788fc0-9919-4bbb-bb2d-9cd7ca5b3401 req-9c965f39-dbdd-47e3-8f69-954d502ee77e service nova] [instance: 547c4d4c-e0dd-495a-b83f-98426d0a4a99] Received event network-changed-2dd20d7f-9490-476a-90ed-e6a1c9085e4d {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:39:46 user nova-compute[74337]: DEBUG nova.compute.manager [req-e7788fc0-9919-4bbb-bb2d-9cd7ca5b3401 req-9c965f39-dbdd-47e3-8f69-954d502ee77e service nova] [instance: 547c4d4c-e0dd-495a-b83f-98426d0a4a99] Refreshing instance network info cache due to event network-changed-2dd20d7f-9490-476a-90ed-e6a1c9085e4d. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 21:39:46 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-e7788fc0-9919-4bbb-bb2d-9cd7ca5b3401 req-9c965f39-dbdd-47e3-8f69-954d502ee77e service nova] Acquiring lock "refresh_cache-547c4d4c-e0dd-495a-b83f-98426d0a4a99" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:39:46 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-e7788fc0-9919-4bbb-bb2d-9cd7ca5b3401 req-9c965f39-dbdd-47e3-8f69-954d502ee77e service nova] Acquired lock "refresh_cache-547c4d4c-e0dd-495a-b83f-98426d0a4a99" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:39:46 user nova-compute[74337]: DEBUG nova.network.neutron [req-e7788fc0-9919-4bbb-bb2d-9cd7ca5b3401 req-9c965f39-dbdd-47e3-8f69-954d502ee77e service nova] [instance: 547c4d4c-e0dd-495a-b83f-98426d0a4a99] Refreshing network info cache for port 2dd20d7f-9490-476a-90ed-e6a1c9085e4d {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 21:39:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:39:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:39:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:39:46 user nova-compute[74337]: INFO os_vif [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:a6:90,bridge_name='br-int',has_traffic_filtering=True,id=872b2a23-8054-4d26-b798-c0099d1c9a91,network=Network(b6a24032-0229-4ebe-83a3-8804e494838c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap872b2a23-80')
Oct 23 21:39:47 user nova-compute[74337]: DEBUG nova.network.neutron [req-e7788fc0-9919-4bbb-bb2d-9cd7ca5b3401 req-9c965f39-dbdd-47e3-8f69-954d502ee77e service nova] [instance: 547c4d4c-e0dd-495a-b83f-98426d0a4a99] Updated VIF entry in instance network info cache for port 2dd20d7f-9490-476a-90ed-e6a1c9085e4d. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 21:39:47 user nova-compute[74337]: DEBUG nova.network.neutron [req-e7788fc0-9919-4bbb-bb2d-9cd7ca5b3401 req-9c965f39-dbdd-47e3-8f69-954d502ee77e service nova] [instance: 547c4d4c-e0dd-495a-b83f-98426d0a4a99] Updating instance_info_cache with network_info: [{"id": "2dd20d7f-9490-476a-90ed-e6a1c9085e4d", "address": "fa:16:3e:5f:e1:f7", "network": {"id": "aff1f95f-fda8-4f0f-8d10-7e3d587e4fda", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2048135647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1f57e58a9ec4c6384dc0d3ca58eb610", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd20d7f-94", "ovs_interfaceid": "2dd20d7f-9490-476a-90ed-e6a1c9085e4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:39:47 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-e7788fc0-9919-4bbb-bb2d-9cd7ca5b3401 req-9c965f39-dbdd-47e3-8f69-954d502ee77e service nova] Releasing lock "refresh_cache-547c4d4c-e0dd-495a-b83f-98426d0a4a99" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:39:49 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:39:49 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:39:49 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:39:49 user nova-compute[74337]: DEBUG nova.compute.manager [req-72f7c77b-3e07-47b1-9635-2a5cbe190f18 req-3497885e-e2ca-4a54-bc70-993d865377bb service nova] [instance: 0ba8d1d0-5fac-4213-9a50-a4e273710b1b] Received event network-vif-plugged-c7a03b6c-5d0f-4a54-b615-16c7546eb5f7 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:39:49 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-72f7c77b-3e07-47b1-9635-2a5cbe190f18 req-3497885e-e2ca-4a54-bc70-993d865377bb service nova] Acquiring lock "0ba8d1d0-5fac-4213-9a50-a4e273710b1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:39:49 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-72f7c77b-3e07-47b1-9635-2a5cbe190f18 req-3497885e-e2ca-4a54-bc70-993d865377bb service nova] Lock "0ba8d1d0-5fac-4213-9a50-a4e273710b1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:39:49 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-72f7c77b-3e07-47b1-9635-2a5cbe190f18 req-3497885e-e2ca-4a54-bc70-993d865377bb service nova] Lock "0ba8d1d0-5fac-4213-9a50-a4e273710b1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:39:49 user nova-compute[74337]: DEBUG nova.compute.manager [req-72f7c77b-3e07-47b1-9635-2a5cbe190f18 req-3497885e-e2ca-4a54-bc70-993d865377bb service nova] [instance: 0ba8d1d0-5fac-4213-9a50-a4e273710b1b] No waiting events found dispatching network-vif-plugged-c7a03b6c-5d0f-4a54-b615-16c7546eb5f7 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:39:49 user nova-compute[74337]: WARNING nova.compute.manager [req-72f7c77b-3e07-47b1-9635-2a5cbe190f18 req-3497885e-e2ca-4a54-bc70-993d865377bb service nova] [instance: 0ba8d1d0-5fac-4213-9a50-a4e273710b1b] Received unexpected event network-vif-plugged-c7a03b6c-5d0f-4a54-b615-16c7546eb5f7 for instance with vm_state building and task_state spawning.
Oct 23 21:39:49 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:39:49 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:39:49 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:39:49 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:39:50 user nova-compute[74337]: DEBUG nova.compute.manager [req-1aa1038e-d2a4-4590-b242-17dc4ead8107 req-df739b31-b862-45dd-84b9-57c8996f2a9d service nova] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Received event network-vif-plugged-872b2a23-8054-4d26-b798-c0099d1c9a91 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:39:50 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-1aa1038e-d2a4-4590-b242-17dc4ead8107 req-df739b31-b862-45dd-84b9-57c8996f2a9d service nova] Acquiring lock "d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:39:50 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-1aa1038e-d2a4-4590-b242-17dc4ead8107 req-df739b31-b862-45dd-84b9-57c8996f2a9d service nova] Lock "d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:39:50 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-1aa1038e-d2a4-4590-b242-17dc4ead8107 req-df739b31-b862-45dd-84b9-57c8996f2a9d service nova] Lock "d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:39:50 user nova-compute[74337]: DEBUG nova.compute.manager [req-1aa1038e-d2a4-4590-b242-17dc4ead8107 req-df739b31-b862-45dd-84b9-57c8996f2a9d service nova] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] No waiting events found dispatching network-vif-plugged-872b2a23-8054-4d26-b798-c0099d1c9a91 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:39:50 user nova-compute[74337]: WARNING nova.compute.manager [req-1aa1038e-d2a4-4590-b242-17dc4ead8107 req-df739b31-b862-45dd-84b9-57c8996f2a9d service nova] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Received unexpected event network-vif-plugged-872b2a23-8054-4d26-b798-c0099d1c9a91 for instance with vm_state resized and task_state resize_reverting.
Oct 23 21:39:50 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:39:50 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:39:50 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:39:50 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:39:50 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:39:50 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:39:50 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:39:51 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:39:51 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:39:51 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:39:51 user nova-compute[74337]: DEBUG nova.compute.manager [req-fc54a142-1e56-4dfd-b6d8-8a1b62d10a0f req-8a4c7861-d37d-49d7-b2d8-26fc25f068f1 service nova] [instance: 0ba8d1d0-5fac-4213-9a50-a4e273710b1b] Received event network-vif-plugged-c7a03b6c-5d0f-4a54-b615-16c7546eb5f7 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:39:51 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-fc54a142-1e56-4dfd-b6d8-8a1b62d10a0f req-8a4c7861-d37d-49d7-b2d8-26fc25f068f1 service nova] Acquiring lock "0ba8d1d0-5fac-4213-9a50-a4e273710b1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:39:51 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-fc54a142-1e56-4dfd-b6d8-8a1b62d10a0f req-8a4c7861-d37d-49d7-b2d8-26fc25f068f1 service nova] Lock "0ba8d1d0-5fac-4213-9a50-a4e273710b1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:39:51 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-fc54a142-1e56-4dfd-b6d8-8a1b62d10a0f req-8a4c7861-d37d-49d7-b2d8-26fc25f068f1 service nova] Lock "0ba8d1d0-5fac-4213-9a50-a4e273710b1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:39:51 user nova-compute[74337]: DEBUG nova.compute.manager [req-fc54a142-1e56-4dfd-b6d8-8a1b62d10a0f req-8a4c7861-d37d-49d7-b2d8-26fc25f068f1 service nova] [instance: 0ba8d1d0-5fac-4213-9a50-a4e273710b1b] No waiting events found dispatching network-vif-plugged-c7a03b6c-5d0f-4a54-b615-16c7546eb5f7 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:39:51 user nova-compute[74337]: WARNING nova.compute.manager [req-fc54a142-1e56-4dfd-b6d8-8a1b62d10a0f req-8a4c7861-d37d-49d7-b2d8-26fc25f068f1 service nova] [instance: 0ba8d1d0-5fac-4213-9a50-a4e273710b1b] Received unexpected event network-vif-plugged-c7a03b6c-5d0f-4a54-b615-16c7546eb5f7 for instance with vm_state building and task_state spawning.
Oct 23 21:39:51 user nova-compute[74337]: DEBUG nova.compute.manager [req-fc54a142-1e56-4dfd-b6d8-8a1b62d10a0f req-8a4c7861-d37d-49d7-b2d8-26fc25f068f1 service nova] [instance: 547c4d4c-e0dd-495a-b83f-98426d0a4a99] Received event network-vif-plugged-2dd20d7f-9490-476a-90ed-e6a1c9085e4d {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:39:51 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-fc54a142-1e56-4dfd-b6d8-8a1b62d10a0f req-8a4c7861-d37d-49d7-b2d8-26fc25f068f1 service nova] Acquiring lock "547c4d4c-e0dd-495a-b83f-98426d0a4a99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:39:51 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-fc54a142-1e56-4dfd-b6d8-8a1b62d10a0f req-8a4c7861-d37d-49d7-b2d8-26fc25f068f1 service nova] Lock "547c4d4c-e0dd-495a-b83f-98426d0a4a99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:39:51 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-fc54a142-1e56-4dfd-b6d8-8a1b62d10a0f req-8a4c7861-d37d-49d7-b2d8-26fc25f068f1 service nova] Lock "547c4d4c-e0dd-495a-b83f-98426d0a4a99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:39:51 user nova-compute[74337]: DEBUG nova.compute.manager [req-fc54a142-1e56-4dfd-b6d8-8a1b62d10a0f req-8a4c7861-d37d-49d7-b2d8-26fc25f068f1 service nova] [instance: 547c4d4c-e0dd-495a-b83f-98426d0a4a99] No waiting events found dispatching network-vif-plugged-2dd20d7f-9490-476a-90ed-e6a1c9085e4d {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:39:51 user nova-compute[74337]: WARNING nova.compute.manager [req-fc54a142-1e56-4dfd-b6d8-8a1b62d10a0f req-8a4c7861-d37d-49d7-b2d8-26fc25f068f1 service nova] [instance: 547c4d4c-e0dd-495a-b83f-98426d0a4a99] Received unexpected event network-vif-plugged-2dd20d7f-9490-476a-90ed-e6a1c9085e4d for instance with vm_state building and task_state spawning.
Oct 23 21:39:51 user nova-compute[74337]: DEBUG nova.compute.manager [req-fc54a142-1e56-4dfd-b6d8-8a1b62d10a0f req-8a4c7861-d37d-49d7-b2d8-26fc25f068f1 service nova] [instance: 547c4d4c-e0dd-495a-b83f-98426d0a4a99] Received event network-vif-plugged-2dd20d7f-9490-476a-90ed-e6a1c9085e4d {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:39:51 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-fc54a142-1e56-4dfd-b6d8-8a1b62d10a0f req-8a4c7861-d37d-49d7-b2d8-26fc25f068f1 service nova] Acquiring lock "547c4d4c-e0dd-495a-b83f-98426d0a4a99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:39:51 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-fc54a142-1e56-4dfd-b6d8-8a1b62d10a0f req-8a4c7861-d37d-49d7-b2d8-26fc25f068f1 service nova] Lock "547c4d4c-e0dd-495a-b83f-98426d0a4a99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:39:51 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-fc54a142-1e56-4dfd-b6d8-8a1b62d10a0f req-8a4c7861-d37d-49d7-b2d8-26fc25f068f1 service nova] Lock "547c4d4c-e0dd-495a-b83f-98426d0a4a99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:39:51 user nova-compute[74337]: DEBUG nova.compute.manager [req-fc54a142-1e56-4dfd-b6d8-8a1b62d10a0f req-8a4c7861-d37d-49d7-b2d8-26fc25f068f1 service nova] [instance: 547c4d4c-e0dd-495a-b83f-98426d0a4a99] No waiting events found dispatching network-vif-plugged-2dd20d7f-9490-476a-90ed-e6a1c9085e4d {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:39:51 user nova-compute[74337]: WARNING nova.compute.manager [req-fc54a142-1e56-4dfd-b6d8-8a1b62d10a0f req-8a4c7861-d37d-49d7-b2d8-26fc25f068f1 service nova] [instance: 547c4d4c-e0dd-495a-b83f-98426d0a4a99] Received unexpected event network-vif-plugged-2dd20d7f-9490-476a-90ed-e6a1c9085e4d for instance with vm_state building and task_state spawning.
Oct 23 21:39:51 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:39:51 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:39:51 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:39:52 user nova-compute[74337]: DEBUG nova.compute.manager [req-6007af89-9b5b-4cae-a0d0-225b63cd2bdd req-a5216788-bbd5-4c47-a40e-b2f0fd9d588a service nova] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Received event network-vif-plugged-872b2a23-8054-4d26-b798-c0099d1c9a91 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:39:52 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-6007af89-9b5b-4cae-a0d0-225b63cd2bdd req-a5216788-bbd5-4c47-a40e-b2f0fd9d588a service nova] Acquiring lock "d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:39:52 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-6007af89-9b5b-4cae-a0d0-225b63cd2bdd req-a5216788-bbd5-4c47-a40e-b2f0fd9d588a service nova] Lock "d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:39:52 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-6007af89-9b5b-4cae-a0d0-225b63cd2bdd req-a5216788-bbd5-4c47-a40e-b2f0fd9d588a service nova] Lock "d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:39:52 user nova-compute[74337]: DEBUG nova.compute.manager [req-6007af89-9b5b-4cae-a0d0-225b63cd2bdd req-a5216788-bbd5-4c47-a40e-b2f0fd9d588a service nova] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] No waiting events found dispatching network-vif-plugged-872b2a23-8054-4d26-b798-c0099d1c9a91 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:39:52 user nova-compute[74337]: WARNING nova.compute.manager [req-6007af89-9b5b-4cae-a0d0-225b63cd2bdd req-a5216788-bbd5-4c47-a40e-b2f0fd9d588a service nova] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Received unexpected event network-vif-plugged-872b2a23-8054-4d26-b798-c0099d1c9a91 for instance with vm_state resized and task_state resize_reverting.
Oct 23 21:39:53 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:39:53 user nova-compute[74337]: DEBUG nova.compute.manager [None req-6d1b5662-6d34-4c45-9b59-f3579c169ae8 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] [instance: 0ba8d1d0-5fac-4213-9a50-a4e273710b1b] Instance event wait completed in 0 seconds for  {{(pid=74337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 21:39:53 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-6d1b5662-6d34-4c45-9b59-f3579c169ae8 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] [instance: 0ba8d1d0-5fac-4213-9a50-a4e273710b1b] Guest created on hypervisor {{(pid=74337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 21:39:53 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: 0ba8d1d0-5fac-4213-9a50-a4e273710b1b] Instance spawned successfully.
Oct 23 21:39:53 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-6d1b5662-6d34-4c45-9b59-f3579c169ae8 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] [instance: 0ba8d1d0-5fac-4213-9a50-a4e273710b1b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 21:39:53 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-6d1b5662-6d34-4c45-9b59-f3579c169ae8 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] [instance: 0ba8d1d0-5fac-4213-9a50-a4e273710b1b] Found default for hw_cdrom_bus of ide {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:39:53 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-6d1b5662-6d34-4c45-9b59-f3579c169ae8 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] [instance: 0ba8d1d0-5fac-4213-9a50-a4e273710b1b] Found default for hw_disk_bus of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:39:53 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-6d1b5662-6d34-4c45-9b59-f3579c169ae8 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] [instance: 0ba8d1d0-5fac-4213-9a50-a4e273710b1b] Found default for hw_input_bus of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:39:53 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-6d1b5662-6d34-4c45-9b59-f3579c169ae8 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] [instance: 0ba8d1d0-5fac-4213-9a50-a4e273710b1b] Found default for hw_pointer_model of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:39:53 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-6d1b5662-6d34-4c45-9b59-f3579c169ae8 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] [instance: 0ba8d1d0-5fac-4213-9a50-a4e273710b1b] Found default for hw_video_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:39:53 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-6d1b5662-6d34-4c45-9b59-f3579c169ae8 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] [instance: 0ba8d1d0-5fac-4213-9a50-a4e273710b1b] Found default for hw_vif_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:39:53 user nova-compute[74337]: INFO nova.compute.manager [None req-6d1b5662-6d34-4c45-9b59-f3579c169ae8 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] [instance: 0ba8d1d0-5fac-4213-9a50-a4e273710b1b] Took 11.75 seconds to spawn the instance on the hypervisor.
Oct 23 21:39:53 user nova-compute[74337]: DEBUG nova.compute.manager [None req-6d1b5662-6d34-4c45-9b59-f3579c169ae8 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] [instance: 0ba8d1d0-5fac-4213-9a50-a4e273710b1b] Checking state {{(pid=74337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 21:39:53 user nova-compute[74337]: DEBUG nova.compute.manager [None req-89703f46-10b3-4dbe-b8ae-50ac456b578f tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 547c4d4c-e0dd-495a-b83f-98426d0a4a99] Instance event wait completed in 0 seconds for  {{(pid=74337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 21:39:53 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-89703f46-10b3-4dbe-b8ae-50ac456b578f tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 547c4d4c-e0dd-495a-b83f-98426d0a4a99] Guest created on hypervisor {{(pid=74337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 21:39:53 user nova-compute[74337]: DEBUG nova.compute.manager [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Instance event wait completed in 0 seconds for  {{(pid=74337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 21:39:53 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: 547c4d4c-e0dd-495a-b83f-98426d0a4a99] Instance spawned successfully.
Oct 23 21:39:53 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-89703f46-10b3-4dbe-b8ae-50ac456b578f tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 547c4d4c-e0dd-495a-b83f-98426d0a4a99] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 21:39:53 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Instance running successfully.
Oct 23 21:39:53 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] finish_revert_migration finished successfully. {{(pid=74337) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Oct 23 21:39:54 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-89703f46-10b3-4dbe-b8ae-50ac456b578f tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 547c4d4c-e0dd-495a-b83f-98426d0a4a99] Found default for hw_cdrom_bus of ide {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:39:54 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-89703f46-10b3-4dbe-b8ae-50ac456b578f tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 547c4d4c-e0dd-495a-b83f-98426d0a4a99] Found default for hw_disk_bus of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:39:54 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-89703f46-10b3-4dbe-b8ae-50ac456b578f tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 547c4d4c-e0dd-495a-b83f-98426d0a4a99] Found default for hw_input_bus of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:39:54 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-89703f46-10b3-4dbe-b8ae-50ac456b578f tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 547c4d4c-e0dd-495a-b83f-98426d0a4a99] Found default for hw_pointer_model of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:39:54 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-89703f46-10b3-4dbe-b8ae-50ac456b578f tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 547c4d4c-e0dd-495a-b83f-98426d0a4a99] Found default for hw_video_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:39:54 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-89703f46-10b3-4dbe-b8ae-50ac456b578f tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 547c4d4c-e0dd-495a-b83f-98426d0a4a99] Found default for hw_vif_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:39:54 user nova-compute[74337]: INFO nova.compute.manager [None req-6d1b5662-6d34-4c45-9b59-f3579c169ae8 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] [instance: 0ba8d1d0-5fac-4213-9a50-a4e273710b1b] Took 12.91 seconds to build instance.
Oct 23 21:39:54 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-6d1b5662-6d34-4c45-9b59-f3579c169ae8 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Lock "0ba8d1d0-5fac-4213-9a50-a4e273710b1b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.073s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:39:54 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "0ba8d1d0-5fac-4213-9a50-a4e273710b1b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 9.474s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:39:54 user nova-compute[74337]: INFO nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 0ba8d1d0-5fac-4213-9a50-a4e273710b1b] During sync_power_state the instance has a pending task (spawning). Skip.
Oct 23 21:39:54 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "0ba8d1d0-5fac-4213-9a50-a4e273710b1b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:39:54 user nova-compute[74337]: INFO nova.compute.manager [None req-89703f46-10b3-4dbe-b8ae-50ac456b578f tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 547c4d4c-e0dd-495a-b83f-98426d0a4a99] Took 10.30 seconds to spawn the instance on the hypervisor.
Oct 23 21:39:54 user nova-compute[74337]: DEBUG nova.compute.manager [None req-89703f46-10b3-4dbe-b8ae-50ac456b578f tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 547c4d4c-e0dd-495a-b83f-98426d0a4a99] Checking state {{(pid=74337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 21:39:54 user nova-compute[74337]: INFO nova.compute.manager [None req-5b777cf2-daa9-4b12-bfe5-830851c86e85 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Updating instance to original state: 'active'
Oct 23 21:39:54 user nova-compute[74337]: INFO nova.compute.manager [None req-89703f46-10b3-4dbe-b8ae-50ac456b578f tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 547c4d4c-e0dd-495a-b83f-98426d0a4a99] Took 11.27 seconds to build instance.
Oct 23 21:39:54 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-89703f46-10b3-4dbe-b8ae-50ac456b578f tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lock "547c4d4c-e0dd-495a-b83f-98426d0a4a99" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.427s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:39:54 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "547c4d4c-e0dd-495a-b83f-98426d0a4a99" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 9.611s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:39:54 user nova-compute[74337]: INFO nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 547c4d4c-e0dd-495a-b83f-98426d0a4a99] During sync_power_state the instance has a pending task (spawning). Skip.
Oct 23 21:39:54 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "547c4d4c-e0dd-495a-b83f-98426d0a4a99" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:39:56 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:39:57 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:39:58 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:40:00 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:40:00 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:40:00 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 21:40:01 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:40:01 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Starting heal instance info cache {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 21:40:01 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Rebuilding the list of instances to heal {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 21:40:01 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "refresh_cache-cf6270ba-7a4e-40c4-b7fd-c62a44125c89" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:40:01 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquired lock "refresh_cache-cf6270ba-7a4e-40c4-b7fd-c62a44125c89" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:40:01 user nova-compute[74337]: DEBUG nova.network.neutron [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89] Forcefully refreshing network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 21:40:01 user nova-compute[74337]: DEBUG nova.objects.instance [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lazy-loading 'info_cache' on Instance uuid cf6270ba-7a4e-40c4-b7fd-c62a44125c89 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:40:01 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:40:02 user nova-compute[74337]: DEBUG nova.network.neutron [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89] Updating instance_info_cache with network_info: [{"id": "d6e114a4-cf61-4a19-bb3d-e0bcbfc5f5e5", "address": "fa:16:3e:8b:08:80", "network": {"id": "94117ecb-54bb-40a0-b3dc-d21eac6c8f7b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1530803655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2877cbc901948b68f6f8c588f29d89c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6e114a4-cf", "ovs_interfaceid": "d6e114a4-cf61-4a19-bb3d-e0bcbfc5f5e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:40:02 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Releasing lock "refresh_cache-cf6270ba-7a4e-40c4-b7fd-c62a44125c89" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:40:02 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89] Updated the network info_cache for instance {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 21:40:02 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:40:03 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:40:03 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:40:04 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:40:04 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:40:04 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:40:04 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:40:04 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Auditing locally available compute resources for user (node: user) {{(pid=74337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 21:40:04 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/547c4d4c-e0dd-495a-b83f-98426d0a4a99/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:40:04 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/547c4d4c-e0dd-495a-b83f-98426d0a4a99/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:40:04 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/547c4d4c-e0dd-495a-b83f-98426d0a4a99/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:40:04 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/547c4d4c-e0dd-495a-b83f-98426d0a4a99/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:40:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1189976f-8d02-468d-8fa7-bd5594c5f85a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:40:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1189976f-8d02-468d-8fa7-bd5594c5f85a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:40:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1189976f-8d02-468d-8fa7-bd5594c5f85a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:40:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1189976f-8d02-468d-8fa7-bd5594c5f85a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:40:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba8d1d0-5fac-4213-9a50-a4e273710b1b/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:40:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba8d1d0-5fac-4213-9a50-a4e273710b1b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:40:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba8d1d0-5fac-4213-9a50-a4e273710b1b/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:40:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba8d1d0-5fac-4213-9a50-a4e273710b1b/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:40:05 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 21:40:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:40:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:40:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:40:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:40:06 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 21:40:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d45e8ae8-371b-46ae-849d-d7f7d5bbd770/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:40:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d45e8ae8-371b-46ae-849d-d7f7d5bbd770/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:40:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d45e8ae8-371b-46ae-849d-d7f7d5bbd770/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:40:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d45e8ae8-371b-46ae-849d-d7f7d5bbd770/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:40:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf6270ba-7a4e-40c4-b7fd-c62a44125c89/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:40:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf6270ba-7a4e-40c4-b7fd-c62a44125c89/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:40:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf6270ba-7a4e-40c4-b7fd-c62a44125c89/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:40:06 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:40:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf6270ba-7a4e-40c4-b7fd-c62a44125c89/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:40:07 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:40:07 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:40:07 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Hypervisor/Node resource view: name=user free_ram=7855MB free_disk=25.568401336669922GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 21:40:07 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:40:07 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:40:07 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance cf6270ba-7a4e-40c4-b7fd-c62a44125c89 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:40:07 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance d45e8ae8-371b-46ae-849d-d7f7d5bbd770 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:40:07 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:40:07 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 2cae5b4d-96a0-41ae-9643-b7bf09581988 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:40:07 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 1189976f-8d02-468d-8fa7-bd5594c5f85a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:40:07 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 0ba8d1d0-5fac-4213-9a50-a4e273710b1b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:40:07 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 547c4d4c-e0dd-495a-b83f-98426d0a4a99 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:40:07 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 21:40:07 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 21:40:07 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:40:07 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:40:07 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Compute_service record updated for user:user {{(pid=74337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 21:40:07 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.545s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:40:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:40:08 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-98bcfd48-e2b8-4567-b474-861cbcf10052 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] Acquiring lock "cf6270ba-7a4e-40c4-b7fd-c62a44125c89" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:40:08 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-98bcfd48-e2b8-4567-b474-861cbcf10052 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] Lock "cf6270ba-7a4e-40c4-b7fd-c62a44125c89" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:40:08 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-98bcfd48-e2b8-4567-b474-861cbcf10052 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] Acquiring lock "cf6270ba-7a4e-40c4-b7fd-c62a44125c89-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:40:08 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-98bcfd48-e2b8-4567-b474-861cbcf10052 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] Lock "cf6270ba-7a4e-40c4-b7fd-c62a44125c89-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:40:08 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-98bcfd48-e2b8-4567-b474-861cbcf10052 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] Lock "cf6270ba-7a4e-40c4-b7fd-c62a44125c89-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:40:08 user nova-compute[74337]: INFO nova.compute.manager [None req-98bcfd48-e2b8-4567-b474-861cbcf10052 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89] Terminating instance
Oct 23 21:40:08 user nova-compute[74337]: DEBUG nova.compute.manager [None req-98bcfd48-e2b8-4567-b474-861cbcf10052 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89] Start destroying the instance on the hypervisor. {{(pid=74337) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 21:40:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:40:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:40:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:40:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:40:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:40:08 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:40:08 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:40:09 user nova-compute[74337]: DEBUG nova.compute.manager [req-0c0009f0-30b8-4799-90e9-e8effe99ecf8 req-2ad54373-9509-4b73-bd33-dc1bcc6af322 service nova] [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89] Received event network-vif-unplugged-d6e114a4-cf61-4a19-bb3d-e0bcbfc5f5e5 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:40:09 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-0c0009f0-30b8-4799-90e9-e8effe99ecf8 req-2ad54373-9509-4b73-bd33-dc1bcc6af322 service nova] Acquiring lock "cf6270ba-7a4e-40c4-b7fd-c62a44125c89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:40:09 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-0c0009f0-30b8-4799-90e9-e8effe99ecf8 req-2ad54373-9509-4b73-bd33-dc1bcc6af322 service nova] Lock "cf6270ba-7a4e-40c4-b7fd-c62a44125c89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:40:09 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-0c0009f0-30b8-4799-90e9-e8effe99ecf8 req-2ad54373-9509-4b73-bd33-dc1bcc6af322 service nova] Lock "cf6270ba-7a4e-40c4-b7fd-c62a44125c89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:40:09 user nova-compute[74337]: DEBUG nova.compute.manager [req-0c0009f0-30b8-4799-90e9-e8effe99ecf8 req-2ad54373-9509-4b73-bd33-dc1bcc6af322 service nova] [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89] No waiting events found dispatching network-vif-unplugged-d6e114a4-cf61-4a19-bb3d-e0bcbfc5f5e5 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:40:09 user nova-compute[74337]: DEBUG nova.compute.manager [req-0c0009f0-30b8-4799-90e9-e8effe99ecf8 req-2ad54373-9509-4b73-bd33-dc1bcc6af322 service nova] [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89] Received event network-vif-unplugged-d6e114a4-cf61-4a19-bb3d-e0bcbfc5f5e5 for instance with task_state deleting. {{(pid=74337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 21:40:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:40:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:40:09 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89] Instance destroyed successfully.
Oct 23 21:40:09 user nova-compute[74337]: DEBUG nova.objects.instance [None req-98bcfd48-e2b8-4567-b474-861cbcf10052 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] Lazy-loading 'resources' on Instance uuid cf6270ba-7a4e-40c4-b7fd-c62a44125c89 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:40:09 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-98bcfd48-e2b8-4567-b474-861cbcf10052 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:33:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1807506748',display_name='tempest-ServerStableDeviceRescueTest-server-1807506748',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1807506748',id=2,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCKAfhfYSJmBpzGrgTijINyu4Q3mJB71opW9wdqNlUAgJOt7WcELNE8A6fbXkzg5OBi07FIQ/ou8CKPcqlXP8qct1wC9f8LTz62fKL1SPRtByRFrnFXg/qMzjyoqfMRydg==',key_name='tempest-keypair-907434616',keypairs=<?>,launch_index=0,launched_at=2023-10-23T21:33:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c2877cbc901948b68f6f8c588f29d89c',ramdisk_id='',reservation_id='r-soafzqn4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-325029318',owner_user_name='tempest-ServerStableDeviceRescueTest-325029318-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T21:35:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a09f292f96924276a76d524aee8dc667',uuid=cf6270ba-7a4e-40c4-b7fd-c62a44125c89,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d6e114a4-cf61-4a19-bb3d-e0bcbfc5f5e5", "address": "fa:16:3e:8b:08:80", "network": {"id": "94117ecb-54bb-40a0-b3dc-d21eac6c8f7b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1530803655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2877cbc901948b68f6f8c588f29d89c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6e114a4-cf", "ovs_interfaceid": "d6e114a4-cf61-4a19-bb3d-e0bcbfc5f5e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 21:40:09 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-98bcfd48-e2b8-4567-b474-861cbcf10052 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] Converting VIF {"id": "d6e114a4-cf61-4a19-bb3d-e0bcbfc5f5e5", "address": "fa:16:3e:8b:08:80", "network": {"id": "94117ecb-54bb-40a0-b3dc-d21eac6c8f7b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1530803655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2877cbc901948b68f6f8c588f29d89c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6e114a4-cf", "ovs_interfaceid": "d6e114a4-cf61-4a19-bb3d-e0bcbfc5f5e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:40:09 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-98bcfd48-e2b8-4567-b474-861cbcf10052 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8b:08:80,bridge_name='br-int',has_traffic_filtering=True,id=d6e114a4-cf61-4a19-bb3d-e0bcbfc5f5e5,network=Network(94117ecb-54bb-40a0-b3dc-d21eac6c8f7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6e114a4-cf') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:40:09 user nova-compute[74337]: DEBUG os_vif [None req-98bcfd48-e2b8-4567-b474-861cbcf10052 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:08:80,bridge_name='br-int',has_traffic_filtering=True,id=d6e114a4-cf61-4a19-bb3d-e0bcbfc5f5e5,network=Network(94117ecb-54bb-40a0-b3dc-d21eac6c8f7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6e114a4-cf') {{(pid=74337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 21:40:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:40:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd6e114a4-cf, bridge=br-int, if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:40:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:40:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:40:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:40:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=31c92899-8dfa-4cdf-8357-fe60b2294e4a) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:40:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:40:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:40:09 user nova-compute[74337]: INFO os_vif [None req-98bcfd48-e2b8-4567-b474-861cbcf10052 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:08:80,bridge_name='br-int',has_traffic_filtering=True,id=d6e114a4-cf61-4a19-bb3d-e0bcbfc5f5e5,network=Network(94117ecb-54bb-40a0-b3dc-d21eac6c8f7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6e114a4-cf')
Oct 23 21:40:09 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-98bcfd48-e2b8-4567-b474-861cbcf10052 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89] Deleting instance files /opt/stack/data/nova/instances/cf6270ba-7a4e-40c4-b7fd-c62a44125c89_del
Oct 23 21:40:09 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-98bcfd48-e2b8-4567-b474-861cbcf10052 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89] Deletion of /opt/stack/data/nova/instances/cf6270ba-7a4e-40c4-b7fd-c62a44125c89_del complete
Oct 23 21:40:09 user nova-compute[74337]: INFO nova.compute.manager [None req-98bcfd48-e2b8-4567-b474-861cbcf10052 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89] Took 0.89 seconds to destroy the instance on the hypervisor.
Oct 23 21:40:09 user nova-compute[74337]: DEBUG oslo.service.loopingcall [None req-98bcfd48-e2b8-4567-b474-861cbcf10052 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74337) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 21:40:09 user nova-compute[74337]: DEBUG nova.compute.manager [-] [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89] Deallocating network for instance {{(pid=74337) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 21:40:09 user nova-compute[74337]: DEBUG nova.network.neutron [-] [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89] deallocate_for_instance() {{(pid=74337) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 21:40:10 user nova-compute[74337]: DEBUG nova.network.neutron [-] [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89] Updating instance_info_cache with network_info: [] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:40:10 user nova-compute[74337]: INFO nova.compute.manager [-] [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89] Took 0.92 seconds to deallocate network for instance.
Oct 23 21:40:10 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-98bcfd48-e2b8-4567-b474-861cbcf10052 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:40:10 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-98bcfd48-e2b8-4567-b474-861cbcf10052 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:40:10 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-98bcfd48-e2b8-4567-b474-861cbcf10052 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:40:10 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-98bcfd48-e2b8-4567-b474-861cbcf10052 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:40:10 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-98bcfd48-e2b8-4567-b474-861cbcf10052 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.258s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:40:10 user nova-compute[74337]: INFO nova.scheduler.client.report [None req-98bcfd48-e2b8-4567-b474-861cbcf10052 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] Deleted allocations for instance cf6270ba-7a4e-40c4-b7fd-c62a44125c89
Oct 23 21:40:10 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-98bcfd48-e2b8-4567-b474-861cbcf10052 tempest-ServerStableDeviceRescueTest-325029318 tempest-ServerStableDeviceRescueTest-325029318-project-member] Lock "cf6270ba-7a4e-40c4-b7fd-c62a44125c89" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.271s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:40:11 user nova-compute[74337]: DEBUG nova.compute.manager [req-1db7a4ee-585e-4a11-9e22-fb4a41e412d7 req-f06a1cee-1ffb-4c9c-ac23-dec99fcfc042 service nova] [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89] Received event network-vif-plugged-d6e114a4-cf61-4a19-bb3d-e0bcbfc5f5e5 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:40:11 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-1db7a4ee-585e-4a11-9e22-fb4a41e412d7 req-f06a1cee-1ffb-4c9c-ac23-dec99fcfc042 service nova] Acquiring lock "cf6270ba-7a4e-40c4-b7fd-c62a44125c89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:40:11 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-1db7a4ee-585e-4a11-9e22-fb4a41e412d7 req-f06a1cee-1ffb-4c9c-ac23-dec99fcfc042 service nova] Lock "cf6270ba-7a4e-40c4-b7fd-c62a44125c89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:40:11 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-1db7a4ee-585e-4a11-9e22-fb4a41e412d7 req-f06a1cee-1ffb-4c9c-ac23-dec99fcfc042 service nova] Lock "cf6270ba-7a4e-40c4-b7fd-c62a44125c89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:40:11 user nova-compute[74337]: DEBUG nova.compute.manager [req-1db7a4ee-585e-4a11-9e22-fb4a41e412d7 req-f06a1cee-1ffb-4c9c-ac23-dec99fcfc042 service nova] [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89] No waiting events found dispatching network-vif-plugged-d6e114a4-cf61-4a19-bb3d-e0bcbfc5f5e5 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:40:11 user nova-compute[74337]: WARNING nova.compute.manager [req-1db7a4ee-585e-4a11-9e22-fb4a41e412d7 req-f06a1cee-1ffb-4c9c-ac23-dec99fcfc042 service nova] [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89] Received unexpected event network-vif-plugged-d6e114a4-cf61-4a19-bb3d-e0bcbfc5f5e5 for instance with vm_state deleted and task_state None.
Oct 23 21:40:11 user nova-compute[74337]: DEBUG nova.compute.manager [req-1db7a4ee-585e-4a11-9e22-fb4a41e412d7 req-f06a1cee-1ffb-4c9c-ac23-dec99fcfc042 service nova] [instance: cf6270ba-7a4e-40c4-b7fd-c62a44125c89] Received event network-vif-deleted-d6e114a4-cf61-4a19-bb3d-e0bcbfc5f5e5 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:40:13 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:40:14 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:40:18 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:40:19 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:40:23 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:40:24 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:40:28 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:40:29 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:40:34 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:40:35 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-5ae15b2d-9dc2-4b05-bb9a-2fc5b03c6eca tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Acquiring lock "d45e8ae8-371b-46ae-849d-d7f7d5bbd770" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:40:35 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-5ae15b2d-9dc2-4b05-bb9a-2fc5b03c6eca tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Lock "d45e8ae8-371b-46ae-849d-d7f7d5bbd770" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:40:35 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-5ae15b2d-9dc2-4b05-bb9a-2fc5b03c6eca tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Acquiring lock "d45e8ae8-371b-46ae-849d-d7f7d5bbd770-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:40:35 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-5ae15b2d-9dc2-4b05-bb9a-2fc5b03c6eca tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Lock "d45e8ae8-371b-46ae-849d-d7f7d5bbd770-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:40:35 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-5ae15b2d-9dc2-4b05-bb9a-2fc5b03c6eca tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Lock "d45e8ae8-371b-46ae-849d-d7f7d5bbd770-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:40:35 user nova-compute[74337]: INFO nova.compute.manager [None req-5ae15b2d-9dc2-4b05-bb9a-2fc5b03c6eca tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] [instance: d45e8ae8-371b-46ae-849d-d7f7d5bbd770] Terminating instance
Oct 23 21:40:35 user nova-compute[74337]: DEBUG nova.compute.manager [None req-5ae15b2d-9dc2-4b05-bb9a-2fc5b03c6eca tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] [instance: d45e8ae8-371b-46ae-849d-d7f7d5bbd770] Start destroying the instance on the hypervisor. {{(pid=74337) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 21:40:35 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:40:35 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:40:35 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:40:35 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:40:35 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:40:36 user nova-compute[74337]: DEBUG nova.compute.manager [req-69095fb2-a701-43d6-bdec-b0b27220dbfc req-a19a1843-d7d3-4188-86e4-b2bd40dbe984 service nova] [instance: d45e8ae8-371b-46ae-849d-d7f7d5bbd770] Received event network-vif-unplugged-7ac73679-68b0-430f-8d77-68438fbb52f0 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:40:36 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-69095fb2-a701-43d6-bdec-b0b27220dbfc req-a19a1843-d7d3-4188-86e4-b2bd40dbe984 service nova] Acquiring lock "d45e8ae8-371b-46ae-849d-d7f7d5bbd770-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:40:36 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-69095fb2-a701-43d6-bdec-b0b27220dbfc req-a19a1843-d7d3-4188-86e4-b2bd40dbe984 service nova] Lock "d45e8ae8-371b-46ae-849d-d7f7d5bbd770-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:40:36 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-69095fb2-a701-43d6-bdec-b0b27220dbfc req-a19a1843-d7d3-4188-86e4-b2bd40dbe984 service nova] Lock "d45e8ae8-371b-46ae-849d-d7f7d5bbd770-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:40:36 user nova-compute[74337]: DEBUG nova.compute.manager [req-69095fb2-a701-43d6-bdec-b0b27220dbfc req-a19a1843-d7d3-4188-86e4-b2bd40dbe984 service nova] [instance: d45e8ae8-371b-46ae-849d-d7f7d5bbd770] No waiting events found dispatching network-vif-unplugged-7ac73679-68b0-430f-8d77-68438fbb52f0 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:40:36 user nova-compute[74337]: DEBUG nova.compute.manager [req-69095fb2-a701-43d6-bdec-b0b27220dbfc req-a19a1843-d7d3-4188-86e4-b2bd40dbe984 service nova] [instance: d45e8ae8-371b-46ae-849d-d7f7d5bbd770] Received event network-vif-unplugged-7ac73679-68b0-430f-8d77-68438fbb52f0 for instance with task_state deleting. {{(pid=74337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 21:40:36 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:40:36 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:40:36 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: d45e8ae8-371b-46ae-849d-d7f7d5bbd770] Instance destroyed successfully.
Oct 23 21:40:36 user nova-compute[74337]: DEBUG nova.objects.instance [None req-5ae15b2d-9dc2-4b05-bb9a-2fc5b03c6eca tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Lazy-loading 'resources' on Instance uuid d45e8ae8-371b-46ae-849d-d7f7d5bbd770 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:40:36 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-5ae15b2d-9dc2-4b05-bb9a-2fc5b03c6eca tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:33:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-992409238',display_name='tempest-VolumesAdminNegativeTest-server-992409238',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-992409238',id=4,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFZ52OJ5twsVrFvABjW3otbjRNWAc2GIXi/skppyx2gna8NdORx461dsWawhVGIhn5WFtYir1ab9f9lbDUw8nx+zGdcFSfvQmIZtHX0UArDfEHl6zO2Ol/2UdUY22NJKlA==',key_name='tempest-keypair-134951423',keypairs=<?>,launch_index=0,launched_at=2023-10-23T21:33:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='997b9ab7d2794438be79f11bb972be47',ramdisk_id='',reservation_id='r-f7onx0p9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-547225907',owner_user_name='tempest-VolumesAdminNegativeTest-547225907-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T21:33:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1106b04eeefe488c9ead914063b88d33',uuid=d45e8ae8-371b-46ae-849d-d7f7d5bbd770,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7ac73679-68b0-430f-8d77-68438fbb52f0", "address": "fa:16:3e:9b:5f:a0", "network": {"id": "9fa29b5e-b3c7-4890-9d82-d9524e4cb78a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-89037375-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "997b9ab7d2794438be79f11bb972be47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ac73679-68", "ovs_interfaceid": "7ac73679-68b0-430f-8d77-68438fbb52f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 21:40:36 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-5ae15b2d-9dc2-4b05-bb9a-2fc5b03c6eca tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Converting VIF {"id": "7ac73679-68b0-430f-8d77-68438fbb52f0", "address": "fa:16:3e:9b:5f:a0", "network": {"id": "9fa29b5e-b3c7-4890-9d82-d9524e4cb78a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-89037375-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "997b9ab7d2794438be79f11bb972be47", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ac73679-68", "ovs_interfaceid": "7ac73679-68b0-430f-8d77-68438fbb52f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:40:36 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-5ae15b2d-9dc2-4b05-bb9a-2fc5b03c6eca tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9b:5f:a0,bridge_name='br-int',has_traffic_filtering=True,id=7ac73679-68b0-430f-8d77-68438fbb52f0,network=Network(9fa29b5e-b3c7-4890-9d82-d9524e4cb78a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ac73679-68') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:40:36 user nova-compute[74337]: DEBUG os_vif [None req-5ae15b2d-9dc2-4b05-bb9a-2fc5b03c6eca tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:5f:a0,bridge_name='br-int',has_traffic_filtering=True,id=7ac73679-68b0-430f-8d77-68438fbb52f0,network=Network(9fa29b5e-b3c7-4890-9d82-d9524e4cb78a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ac73679-68') {{(pid=74337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 21:40:36 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:40:36 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7ac73679-68, bridge=br-int, if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:40:36 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:40:36 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:40:36 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:40:36 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=68e64ec9-1a34-4af3-bda1-f836a73acf3e) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:40:36 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:40:36 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:40:36 user nova-compute[74337]: INFO os_vif [None req-5ae15b2d-9dc2-4b05-bb9a-2fc5b03c6eca tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:5f:a0,bridge_name='br-int',has_traffic_filtering=True,id=7ac73679-68b0-430f-8d77-68438fbb52f0,network=Network(9fa29b5e-b3c7-4890-9d82-d9524e4cb78a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ac73679-68')
Oct 23 21:40:36 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-5ae15b2d-9dc2-4b05-bb9a-2fc5b03c6eca tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] [instance: d45e8ae8-371b-46ae-849d-d7f7d5bbd770] Deleting instance files /opt/stack/data/nova/instances/d45e8ae8-371b-46ae-849d-d7f7d5bbd770_del
Oct 23 21:40:36 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-5ae15b2d-9dc2-4b05-bb9a-2fc5b03c6eca tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] [instance: d45e8ae8-371b-46ae-849d-d7f7d5bbd770] Deletion of /opt/stack/data/nova/instances/d45e8ae8-371b-46ae-849d-d7f7d5bbd770_del complete
Oct 23 21:40:36 user nova-compute[74337]: INFO nova.compute.manager [None req-5ae15b2d-9dc2-4b05-bb9a-2fc5b03c6eca tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] [instance: d45e8ae8-371b-46ae-849d-d7f7d5bbd770] Took 1.21 seconds to destroy the instance on the hypervisor.
Oct 23 21:40:36 user nova-compute[74337]: DEBUG oslo.service.loopingcall [None req-5ae15b2d-9dc2-4b05-bb9a-2fc5b03c6eca tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74337) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 21:40:36 user nova-compute[74337]: DEBUG nova.compute.manager [-] [instance: d45e8ae8-371b-46ae-849d-d7f7d5bbd770] Deallocating network for instance {{(pid=74337) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 21:40:36 user nova-compute[74337]: DEBUG nova.network.neutron [-] [instance: d45e8ae8-371b-46ae-849d-d7f7d5bbd770] deallocate_for_instance() {{(pid=74337) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 21:40:37 user nova-compute[74337]: DEBUG nova.network.neutron [-] [instance: d45e8ae8-371b-46ae-849d-d7f7d5bbd770] Updating instance_info_cache with network_info: [] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:40:37 user nova-compute[74337]: INFO nova.compute.manager [-] [instance: d45e8ae8-371b-46ae-849d-d7f7d5bbd770] Took 1.22 seconds to deallocate network for instance.
Oct 23 21:40:37 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-5ae15b2d-9dc2-4b05-bb9a-2fc5b03c6eca tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:40:37 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-5ae15b2d-9dc2-4b05-bb9a-2fc5b03c6eca tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:40:38 user nova-compute[74337]: DEBUG nova.compute.manager [req-1bc89757-1fae-4751-a150-cd37f966a348 req-40209f14-4d1b-4995-accb-d8f362e6f5ba service nova] [instance: d45e8ae8-371b-46ae-849d-d7f7d5bbd770] Received event network-vif-plugged-7ac73679-68b0-430f-8d77-68438fbb52f0 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:40:38 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-1bc89757-1fae-4751-a150-cd37f966a348 req-40209f14-4d1b-4995-accb-d8f362e6f5ba service nova] Acquiring lock "d45e8ae8-371b-46ae-849d-d7f7d5bbd770-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:40:38 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-1bc89757-1fae-4751-a150-cd37f966a348 req-40209f14-4d1b-4995-accb-d8f362e6f5ba service nova] Lock "d45e8ae8-371b-46ae-849d-d7f7d5bbd770-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:40:38 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-1bc89757-1fae-4751-a150-cd37f966a348 req-40209f14-4d1b-4995-accb-d8f362e6f5ba service nova] Lock "d45e8ae8-371b-46ae-849d-d7f7d5bbd770-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:40:38 user nova-compute[74337]: DEBUG nova.compute.manager [req-1bc89757-1fae-4751-a150-cd37f966a348 req-40209f14-4d1b-4995-accb-d8f362e6f5ba service nova] [instance: d45e8ae8-371b-46ae-849d-d7f7d5bbd770] No waiting events found dispatching network-vif-plugged-7ac73679-68b0-430f-8d77-68438fbb52f0 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:40:38 user nova-compute[74337]: WARNING nova.compute.manager [req-1bc89757-1fae-4751-a150-cd37f966a348 req-40209f14-4d1b-4995-accb-d8f362e6f5ba service nova] [instance: d45e8ae8-371b-46ae-849d-d7f7d5bbd770] Received unexpected event network-vif-plugged-7ac73679-68b0-430f-8d77-68438fbb52f0 for instance with vm_state deleted and task_state None.
Oct 23 21:40:38 user nova-compute[74337]: DEBUG nova.compute.manager [req-1bc89757-1fae-4751-a150-cd37f966a348 req-40209f14-4d1b-4995-accb-d8f362e6f5ba service nova] [instance: d45e8ae8-371b-46ae-849d-d7f7d5bbd770] Received event network-vif-deleted-7ac73679-68b0-430f-8d77-68438fbb52f0 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:40:38 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-5ae15b2d-9dc2-4b05-bb9a-2fc5b03c6eca tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:40:38 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-5ae15b2d-9dc2-4b05-bb9a-2fc5b03c6eca tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:40:38 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-5ae15b2d-9dc2-4b05-bb9a-2fc5b03c6eca tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.361s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:40:38 user nova-compute[74337]: INFO nova.scheduler.client.report [None req-5ae15b2d-9dc2-4b05-bb9a-2fc5b03c6eca tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Deleted allocations for instance d45e8ae8-371b-46ae-849d-d7f7d5bbd770
Oct 23 21:40:38 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-5ae15b2d-9dc2-4b05-bb9a-2fc5b03c6eca tempest-VolumesAdminNegativeTest-547225907 tempest-VolumesAdminNegativeTest-547225907-project-member] Lock "d45e8ae8-371b-46ae-849d-d7f7d5bbd770" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.053s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:40:41 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-19af79b0-543f-40ee-8f11-bd84fd11ae64 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Acquiring lock "00f757cf-e5dd-476f-81c6-670ed2bf6938" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:40:41 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-19af79b0-543f-40ee-8f11-bd84fd11ae64 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Lock "00f757cf-e5dd-476f-81c6-670ed2bf6938" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:40:41 user nova-compute[74337]: INFO nova.compute.manager [None req-19af79b0-543f-40ee-8f11-bd84fd11ae64 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938] Unshelving
Oct 23 21:40:41 user nova-compute[74337]: INFO nova.virt.block_device [None req-19af79b0-543f-40ee-8f11-bd84fd11ae64 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938] Booting with volume 4e4fe425-3c14-4ab0-8c26-a7aa02c1e74e at /dev/vdc
Oct 23 21:40:41 user nova-compute[74337]: DEBUG nova.compute.manager [req-57281565-896b-441a-950c-cfd6fa637467 req-a5996ce5-5aaa-4267-adde-4957baaf6952 service nova] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Received event network-changed-fc418a9a-364a-4e52-a073-58a567680beb {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:40:41 user nova-compute[74337]: DEBUG nova.compute.manager [req-57281565-896b-441a-950c-cfd6fa637467 req-a5996ce5-5aaa-4267-adde-4957baaf6952 service nova] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Refreshing instance network info cache due to event network-changed-fc418a9a-364a-4e52-a073-58a567680beb. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 21:40:41 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-57281565-896b-441a-950c-cfd6fa637467 req-a5996ce5-5aaa-4267-adde-4957baaf6952 service nova] Acquiring lock "refresh_cache-2cae5b4d-96a0-41ae-9643-b7bf09581988" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:40:41 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-57281565-896b-441a-950c-cfd6fa637467 req-a5996ce5-5aaa-4267-adde-4957baaf6952 service nova] Acquired lock "refresh_cache-2cae5b4d-96a0-41ae-9643-b7bf09581988" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:40:41 user nova-compute[74337]: DEBUG nova.network.neutron [req-57281565-896b-441a-950c-cfd6fa637467 req-a5996ce5-5aaa-4267-adde-4957baaf6952 service nova] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Refreshing network info cache for port fc418a9a-364a-4e52-a073-58a567680beb {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 21:40:41 user nova-compute[74337]: DEBUG os_brick.utils [None req-19af79b0-543f-40ee-8f11-bd84fd11ae64 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:40:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:40:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:40:41 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c209128-974a-42d6-a0aa-75d9f7f76344]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f34011b66e40\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:40:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:40:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:40:41 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[33443c74-d7c2-4156-8985-8a82b6cfa222]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:40:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:40:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:40:41 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[528b31f1-0a3c-4575-a774-9693b0974b16]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:40:41 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[63dcebf1-cf66-4b00-a37f-fd8e62b840a1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:40:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-19af79b0-543f-40ee-8f11-bd84fd11ae64 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Running cmd (subprocess): nvme version {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:40:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-19af79b0-543f-40ee-8f11-bd84fd11ae64 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] 'nvme version' failed. Not Retrying. {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 21:40:41 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-19af79b0-543f-40ee-8f11-bd84fd11ae64 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] nvme not present on system {{(pid=74337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 21:40:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:40:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 21:40:41 user nova-compute[74337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 21:40:41 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e56b76-7110-42d4-ba1d-1f68fe2feadd]: (4, '') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:40:41 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-19af79b0-543f-40ee-8f11-bd84fd11ae64 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 21:40:41 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-19af79b0-543f-40ee-8f11-bd84fd11ae64 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 21:40:41 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-19af79b0-543f-40ee-8f11-bd84fd11ae64 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] LIGHTOS: no hostnqn found. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 21:40:41 user nova-compute[74337]: DEBUG os_brick.utils [None req-19af79b0-543f-40ee-8f11-bd84fd11ae64 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f34011b66e40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:40:41 user nova-compute[74337]: DEBUG nova.virt.block_device [None req-19af79b0-543f-40ee-8f11-bd84fd11ae64 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938] Updating existing volume attachment record: 33645ff8-bc2a-458a-a7be-9962a078735b {{(pid=74337) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 21:40:41 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:40:41 user nova-compute[74337]: DEBUG nova.compute.manager [None req-ad3a80a4-2c42-47b2-a4ed-ea14d0fe4a48 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: 1189976f-8d02-468d-8fa7-bd5594c5f85a] Checking state {{(pid=74337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 21:40:41 user nova-compute[74337]: INFO nova.compute.manager [None req-ad3a80a4-2c42-47b2-a4ed-ea14d0fe4a48 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: 1189976f-8d02-468d-8fa7-bd5594c5f85a] instance snapshotting
Oct 23 21:40:41 user nova-compute[74337]: DEBUG nova.network.neutron [req-57281565-896b-441a-950c-cfd6fa637467 req-a5996ce5-5aaa-4267-adde-4957baaf6952 service nova] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Updated VIF entry in instance network info cache for port fc418a9a-364a-4e52-a073-58a567680beb. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 21:40:41 user nova-compute[74337]: DEBUG nova.network.neutron [req-57281565-896b-441a-950c-cfd6fa637467 req-a5996ce5-5aaa-4267-adde-4957baaf6952 service nova] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Updating instance_info_cache with network_info: [{"id": "fc418a9a-364a-4e52-a073-58a567680beb", "address": "fa:16:3e:5b:b9:06", "network": {"id": "e3ef8fef-f49d-46a8-b357-1ee41c4a17e4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-952280610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3abafb229d604b65a3fb50f0eebc70ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc418a9a-36", "ovs_interfaceid": "fc418a9a-364a-4e52-a073-58a567680beb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:40:41 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-ad3a80a4-2c42-47b2-a4ed-ea14d0fe4a48 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: 1189976f-8d02-468d-8fa7-bd5594c5f85a] Beginning live snapshot process
Oct 23 21:40:41 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-57281565-896b-441a-950c-cfd6fa637467 req-a5996ce5-5aaa-4267-adde-4957baaf6952 service nova] Releasing lock "refresh_cache-2cae5b4d-96a0-41ae-9643-b7bf09581988" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:40:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-ad3a80a4-2c42-47b2-a4ed-ea14d0fe4a48 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1189976f-8d02-468d-8fa7-bd5594c5f85a/disk --force-share --output=json -f qcow2 {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:40:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-ad3a80a4-2c42-47b2-a4ed-ea14d0fe4a48 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1189976f-8d02-468d-8fa7-bd5594c5f85a/disk --force-share --output=json -f qcow2" returned: 0 in 0.201s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:40:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-ad3a80a4-2c42-47b2-a4ed-ea14d0fe4a48 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1189976f-8d02-468d-8fa7-bd5594c5f85a/disk --force-share --output=json -f qcow2 {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:40:42 user nova-compute[74337]: INFO nova.compute.manager [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Rebuilding instance
Oct 23 21:40:42 user nova-compute[74337]: DEBUG nova.compute.manager [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Checking state {{(pid=74337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 21:40:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-ad3a80a4-2c42-47b2-a4ed-ea14d0fe4a48 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1189976f-8d02-468d-8fa7-bd5594c5f85a/disk --force-share --output=json -f qcow2" returned: 0 in 0.195s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:40:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-ad3a80a4-2c42-47b2-a4ed-ea14d0fe4a48 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:40:42 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:40:42 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:40:42 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:40:42 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:40:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-ad3a80a4-2c42-47b2-a4ed-ea14d0fe4a48 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.211s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:40:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-ad3a80a4-2c42-47b2-a4ed-ea14d0fe4a48 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpshf5_hug/e4b68d7f5f284562afc81dee38b1cb21.delta 1073741824 {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:40:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-ad3a80a4-2c42-47b2-a4ed-ea14d0fe4a48 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpshf5_hug/e4b68d7f5f284562afc81dee38b1cb21.delta 1073741824" returned: 0 in 0.058s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:40:42 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-ad3a80a4-2c42-47b2-a4ed-ea14d0fe4a48 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: 1189976f-8d02-468d-8fa7-bd5594c5f85a] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 23 21:40:43 user nova-compute[74337]: DEBUG nova.compute.manager [req-5e6eb42b-1584-4b9c-b703-e50cccf25862 req-9e8f4c94-bbf7-4a75-a3f8-21d3050db737 service nova] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Received event network-vif-unplugged-fc418a9a-364a-4e52-a073-58a567680beb {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:40:43 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-5e6eb42b-1584-4b9c-b703-e50cccf25862 req-9e8f4c94-bbf7-4a75-a3f8-21d3050db737 service nova] Acquiring lock "2cae5b4d-96a0-41ae-9643-b7bf09581988-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:40:43 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-5e6eb42b-1584-4b9c-b703-e50cccf25862 req-9e8f4c94-bbf7-4a75-a3f8-21d3050db737 service nova] Lock "2cae5b4d-96a0-41ae-9643-b7bf09581988-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:40:43 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-5e6eb42b-1584-4b9c-b703-e50cccf25862 req-9e8f4c94-bbf7-4a75-a3f8-21d3050db737 service nova] Lock "2cae5b4d-96a0-41ae-9643-b7bf09581988-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:40:43 user nova-compute[74337]: DEBUG nova.compute.manager [req-5e6eb42b-1584-4b9c-b703-e50cccf25862 req-9e8f4c94-bbf7-4a75-a3f8-21d3050db737 service nova] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] No waiting events found dispatching network-vif-unplugged-fc418a9a-364a-4e52-a073-58a567680beb {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:40:43 user nova-compute[74337]: WARNING nova.compute.manager [req-5e6eb42b-1584-4b9c-b703-e50cccf25862 req-9e8f4c94-bbf7-4a75-a3f8-21d3050db737 service nova] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Received unexpected event network-vif-unplugged-fc418a9a-364a-4e52-a073-58a567680beb for instance with vm_state active and task_state rebuilding.
Oct 23 21:40:43 user nova-compute[74337]: DEBUG nova.compute.manager [req-5e6eb42b-1584-4b9c-b703-e50cccf25862 req-9e8f4c94-bbf7-4a75-a3f8-21d3050db737 service nova] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Received event network-vif-plugged-fc418a9a-364a-4e52-a073-58a567680beb {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:40:43 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-5e6eb42b-1584-4b9c-b703-e50cccf25862 req-9e8f4c94-bbf7-4a75-a3f8-21d3050db737 service nova] Acquiring lock "2cae5b4d-96a0-41ae-9643-b7bf09581988-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:40:43 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-5e6eb42b-1584-4b9c-b703-e50cccf25862 req-9e8f4c94-bbf7-4a75-a3f8-21d3050db737 service nova] Lock "2cae5b4d-96a0-41ae-9643-b7bf09581988-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:40:43 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-5e6eb42b-1584-4b9c-b703-e50cccf25862 req-9e8f4c94-bbf7-4a75-a3f8-21d3050db737 service nova] Lock "2cae5b4d-96a0-41ae-9643-b7bf09581988-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:40:43 user nova-compute[74337]: DEBUG nova.compute.manager [req-5e6eb42b-1584-4b9c-b703-e50cccf25862 req-9e8f4c94-bbf7-4a75-a3f8-21d3050db737 service nova] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] No waiting events found dispatching network-vif-plugged-fc418a9a-364a-4e52-a073-58a567680beb {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:40:43 user nova-compute[74337]: WARNING nova.compute.manager [req-5e6eb42b-1584-4b9c-b703-e50cccf25862 req-9e8f4c94-bbf7-4a75-a3f8-21d3050db737 service nova] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Received unexpected event network-vif-plugged-fc418a9a-364a-4e52-a073-58a567680beb for instance with vm_state active and task_state rebuilding.
Oct 23 21:40:43 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:40:43 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-ad3a80a4-2c42-47b2-a4ed-ea14d0fe4a48 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74337) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 21:40:43 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Instance destroyed successfully.
Oct 23 21:40:43 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-ad3a80a4-2c42-47b2-a4ed-ea14d0fe4a48 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] COPY block job progress, current cursor: 75300864 final cursor: 75497472 {{(pid=74337) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 21:40:43 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Instance destroyed successfully.
Oct 23 21:40:43 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:38:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1974624614',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1403410720',id=14,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNAij/gN9c1LogESmDyDRUK8aX9TNeBklW1117x1fKgPvWOfbQTMsxbBaU+oDUoFHSZouzNEg8DViCjOAm3WRLHflowTaqyVE9dl6GjV16zXbkR3EGgDaXXdXhXT1FiXhw==',key_name='tempest-keypair-1763181828',keypairs=<?>,launch_index=0,launched_at=2023-10-23T21:39:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3abafb229d604b65a3fb50f0eebc70ae',ramdisk_id='',reservation_id='r-0v9ax80p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1326198598',owner_user_name='tempest-ServerActionsV293TestJSON-1326198598-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:40:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c6d296964f545e78d8bc461d6f28dba',uuid=2cae5b4d-96a0-41ae-9643-b7bf09581988,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fc418a9a-364a-4e52-a073-58a567680beb", "address": "fa:16:3e:5b:b9:06", "network": {"id": "e3ef8fef-f49d-46a8-b357-1ee41c4a17e4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-952280610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3abafb229d604b65a3fb50f0eebc70ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc418a9a-36", "ovs_interfaceid": "fc418a9a-364a-4e52-a073-58a567680beb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 21:40:43 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Converting VIF {"id": "fc418a9a-364a-4e52-a073-58a567680beb", "address": "fa:16:3e:5b:b9:06", "network": {"id": "e3ef8fef-f49d-46a8-b357-1ee41c4a17e4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-952280610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3abafb229d604b65a3fb50f0eebc70ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc418a9a-36", "ovs_interfaceid": "fc418a9a-364a-4e52-a073-58a567680beb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:40:43 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5b:b9:06,bridge_name='br-int',has_traffic_filtering=True,id=fc418a9a-364a-4e52-a073-58a567680beb,network=Network(e3ef8fef-f49d-46a8-b357-1ee41c4a17e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc418a9a-36') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:40:43 user nova-compute[74337]: DEBUG os_vif [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:b9:06,bridge_name='br-int',has_traffic_filtering=True,id=fc418a9a-364a-4e52-a073-58a567680beb,network=Network(e3ef8fef-f49d-46a8-b357-1ee41c4a17e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc418a9a-36') {{(pid=74337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 21:40:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:40:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfc418a9a-36, bridge=br-int, if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:40:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:40:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:40:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:40:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=832fcfaf-6e20-4747-884f-55aed4a70cbe) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:40:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:40:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:40:44 user nova-compute[74337]: INFO os_vif [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:b9:06,bridge_name='br-int',has_traffic_filtering=True,id=fc418a9a-364a-4e52-a073-58a567680beb,network=Network(e3ef8fef-f49d-46a8-b357-1ee41c4a17e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc418a9a-36')
Oct 23 21:40:44 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] calling os-brick to detach iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 21:40:44 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, {'target_iqn': 'iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aMCXtGKR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:40:44 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 23 21:40:44 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:40:44 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:40:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:40:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:40:44 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0768f3c-0b3d-4669-9267-ca3e1b378cf9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:40:44 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 21:40:44 user nova-compute[74337]: No targets found.
Oct 23 21:40:44 user nova-compute[74337]: iSNS:
Oct 23 21:40:44 user nova-compute[74337]: No targets found.
Oct 23 21:40:44 user nova-compute[74337]: STATIC:
Oct 23 21:40:44 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01
Oct 23 21:40:44 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:40:44 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:40:44 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522
Oct 23 21:40:44 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:40:44 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:40:44 user nova-compute[74337]: FIRMWARE:
Oct 23 21:40:44 user nova-compute[74337]: No targets found.
Oct 23 21:40:44 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:40:44 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 21:40:44 user nova-compute[74337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 21:40:44 user nova-compute[74337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 21:40:44 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01', 0)] {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 21:40:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:40:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:40:44 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[225659cf-fd00-4f68-bf50-d95d01dd6f21]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:40:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:40:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:40:44 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[909ceca5-bc59-4ea2-926d-5304a332e6ee]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:40:44 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01 (non-flash)
Oct 23 21:40:44 user nova-compute[74337]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 (non-flash)
Oct 23 21:40:44 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:40:44 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01 (non-flash)
Oct 23 21:40:44 user nova-compute[74337]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 (non-flash)
Oct 23 21:40:44 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:40:44 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5eec3cee60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01'): ({'sdb'}, set())}) {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 21:40:44 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Removing single pathed devices sdb {{(pid=74337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 21:40:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:40:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:40:44 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d571ffc-1f46-4a7a-a74b-789a314f0007]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:40:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:40:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:40:44 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[65a34e72-c9b9-43ce-85e4-c079fc6d0c3b]: (4, ('ok\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:40:44 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Flushing IO for device /dev/sdb {{(pid=74337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 21:40:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:40:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:40:44 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[3149acd6-9e31-4daa-b0c5-53594c3e915b]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:40:44 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 21:40:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:40:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:40:44 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e84044-f569-4a9a-9514-f8a2c238db83]: (4, ('1', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:40:44 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 21:40:44 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] SCSI volumes sdb have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 21:40:44 user nova-compute[74337]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23263393864326637', '/dev/disk/by-id/scsi-1SCST_BIOd68cecde-2c98d2f7a4866f91', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_d68cecde') {{(pid=85566) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 23 21:40:44 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[af83ab36-ee20-4626-90bd-d2c20673add2]: (4, None) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:40:44 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01')] {{(pid=74337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 21:40:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:40:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:40:44 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd24e0d-ae70-489a-9629-f39f1a0bb142]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:40:44 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:40:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01 -p 172.16.0.220:3260 --logout {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:40:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:40:44 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[621accc6-edb3-47f9-a9d3-63781ec7e42f]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:40:44 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01, portal: 172.16.0.220,3260]
Oct 23 21:40:44 user nova-compute[74337]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01, portal: 172.16.0.220,3260] successful.
Oct 23 21:40:44 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:40:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01 -p 172.16.0.220:3260 --op delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:40:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:40:44 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe2c4e4-f51f-40ab-acda-9e8c7f3a299a]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:40:44 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:40:44 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:40:44 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] <== disconnect_volume: return (345ms) None {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:40:44 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Disconnected iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 21:40:44 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Deleting instance files /opt/stack/data/nova/instances/2cae5b4d-96a0-41ae-9643-b7bf09581988_del
Oct 23 21:40:44 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Deletion of /opt/stack/data/nova/instances/2cae5b4d-96a0-41ae-9643-b7bf09581988_del complete
Oct 23 21:40:44 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-ad3a80a4-2c42-47b2-a4ed-ea14d0fe4a48 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74337) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 21:40:44 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-ad3a80a4-2c42-47b2-a4ed-ea14d0fe4a48 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: 1189976f-8d02-468d-8fa7-bd5594c5f85a] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 23 21:40:44 user nova-compute[74337]: DEBUG nova.privsep.utils [None req-ad3a80a4-2c42-47b2-a4ed-ea14d0fe4a48 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74337) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 23 21:40:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-ad3a80a4-2c42-47b2-a4ed-ea14d0fe4a48 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpshf5_hug/e4b68d7f5f284562afc81dee38b1cb21.delta /opt/stack/data/nova/instances/snapshots/tmpshf5_hug/e4b68d7f5f284562afc81dee38b1cb21 {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:40:44 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 2cae5b4d-96a0-41ae-9643-b7bf09581988 could not be found.
Oct 23 21:40:44 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] calling os-brick to detach iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 21:40:44 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, {'target_iqn': 'iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aMCXtGKR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:40:44 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 23 21:40:44 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:40:44 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:40:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:40:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:40:44 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[21df65e0-ace3-4e9a-8019-690f6d7c3980]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:40:44 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 21:40:44 user nova-compute[74337]: No targets found.
Oct 23 21:40:44 user nova-compute[74337]: iSNS:
Oct 23 21:40:44 user nova-compute[74337]: No targets found.
Oct 23 21:40:44 user nova-compute[74337]: STATIC:
Oct 23 21:40:44 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522
Oct 23 21:40:44 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:40:44 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:40:44 user nova-compute[74337]: FIRMWARE:
Oct 23 21:40:44 user nova-compute[74337]: No targets found.
Oct 23 21:40:44 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:40:44 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 21:40:44 user nova-compute[74337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 21:40:44 user nova-compute[74337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 21:40:44 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01', 0)] {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 21:40:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:40:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:40:44 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[4784a2df-d57a-48c8-9e26-963b684231ce]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:40:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:40:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:40:44 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ab7885-09d4-45f3-b4ed-a3a03a5e11fe]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:40:44 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 (non-flash)
Oct 23 21:40:44 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:40:44 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 (non-flash)
Oct 23 21:40:44 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:40:44 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5ef443b760>, {}) {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 21:40:44 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Disconnecting from: [] {{(pid=74337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 21:40:44 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.086s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:40:44 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] <== disconnect_volume: return (89ms) None {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:40:44 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Disconnected iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 21:40:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-ad3a80a4-2c42-47b2-a4ed-ea14d0fe4a48 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpshf5_hug/e4b68d7f5f284562afc81dee38b1cb21.delta /opt/stack/data/nova/instances/snapshots/tmpshf5_hug/e4b68d7f5f284562afc81dee38b1cb21" returned: 0 in 0.525s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:40:45 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-ad3a80a4-2c42-47b2-a4ed-ea14d0fe4a48 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: 1189976f-8d02-468d-8fa7-bd5594c5f85a] Snapshot extracted, beginning image upload
Oct 23 21:40:47 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-ad3a80a4-2c42-47b2-a4ed-ea14d0fe4a48 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: 1189976f-8d02-468d-8fa7-bd5594c5f85a] Snapshot image upload complete
Oct 23 21:40:47 user nova-compute[74337]: INFO nova.compute.manager [None req-ad3a80a4-2c42-47b2-a4ed-ea14d0fe4a48 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: 1189976f-8d02-468d-8fa7-bd5594c5f85a] Took 6.07 seconds to snapshot the instance on the hypervisor.
Oct 23 21:40:48 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:40:49 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:40:53 user nova-compute[74337]: DEBUG nova.compute.manager [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Preparing to wait for external event volume-reimaged-f45407b0-0f4c-4120-8ef2-812f51f88f01 {{(pid=74337) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Oct 23 21:40:53 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Acquiring lock "2cae5b4d-96a0-41ae-9643-b7bf09581988-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:40:53 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Lock "2cae5b4d-96a0-41ae-9643-b7bf09581988-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:40:53 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Lock "2cae5b4d-96a0-41ae-9643-b7bf09581988-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:40:53 user nova-compute[74337]: ERROR nova.volume.cinder [None req-19af79b0-543f-40ee-8f11-bd84fd11ae64 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Update attachment failed for attachment 33645ff8-bc2a-458a-a7be-9962a078735b. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-d7a744e3-1168-454c-a618-08a3e150e9da) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-d7a744e3-1168-454c-a618-08a3e150e9da)
Oct 23 21:40:53 user nova-compute[74337]: ERROR nova.compute.manager [None req-19af79b0-543f-40ee-8f11-bd84fd11ae64 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938] Instance failed block device setup: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-d7a744e3-1168-454c-a618-08a3e150e9da)
Oct 23 21:40:53 user nova-compute[74337]: ERROR nova.compute.manager [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938] Traceback (most recent call last):
Oct 23 21:40:53 user nova-compute[74337]: ERROR nova.compute.manager [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938]   File "/opt/stack/nova/nova/compute/manager.py", line 2190, in _prep_block_device
Oct 23 21:40:53 user nova-compute[74337]: ERROR nova.compute.manager [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938]     driver_block_device.attach_block_devices(
Oct 23 21:40:53 user nova-compute[74337]: ERROR nova.compute.manager [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938]   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Oct 23 21:40:53 user nova-compute[74337]: ERROR nova.compute.manager [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938]     _log_and_attach(device)
Oct 23 21:40:53 user nova-compute[74337]: ERROR nova.compute.manager [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938]   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Oct 23 21:40:53 user nova-compute[74337]: ERROR nova.compute.manager [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938]     bdm.attach(*attach_args, **attach_kwargs)
Oct 23 21:40:53 user nova-compute[74337]: ERROR nova.compute.manager [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Oct 23 21:40:53 user nova-compute[74337]: ERROR nova.compute.manager [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938]     ret_val = method(obj, context, *args, **kwargs)
Oct 23 21:40:53 user nova-compute[74337]: ERROR nova.compute.manager [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Oct 23 21:40:53 user nova-compute[74337]: ERROR nova.compute.manager [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938]     self._do_attach(context, instance, volume, volume_api,
Oct 23 21:40:53 user nova-compute[74337]: ERROR nova.compute.manager [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Oct 23 21:40:53 user nova-compute[74337]: ERROR nova.compute.manager [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938]     self._volume_attach(context, volume, connector, instance,
Oct 23 21:40:53 user nova-compute[74337]: ERROR nova.compute.manager [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Oct 23 21:40:53 user nova-compute[74337]: ERROR nova.compute.manager [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938]     connection_info = volume_api.attachment_update(
Oct 23 21:40:53 user nova-compute[74337]: ERROR nova.compute.manager [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 23 21:40:53 user nova-compute[74337]: ERROR nova.compute.manager [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938]     res = method(self, ctx, *args, **kwargs)
Oct 23 21:40:53 user nova-compute[74337]: ERROR nova.compute.manager [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 23 21:40:53 user nova-compute[74337]: ERROR nova.compute.manager [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938]     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 23 21:40:53 user nova-compute[74337]: ERROR nova.compute.manager [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 23 21:40:53 user nova-compute[74337]: ERROR nova.compute.manager [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938]     with excutils.save_and_reraise_exception():
Oct 23 21:40:53 user nova-compute[74337]: ERROR nova.compute.manager [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 23 21:40:53 user nova-compute[74337]: ERROR nova.compute.manager [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938]     self.force_reraise()
Oct 23 21:40:53 user nova-compute[74337]: ERROR nova.compute.manager [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 23 21:40:53 user nova-compute[74337]: ERROR nova.compute.manager [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938]     raise self.value
Oct 23 21:40:53 user nova-compute[74337]: ERROR nova.compute.manager [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 23 21:40:53 user nova-compute[74337]: ERROR nova.compute.manager [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938]     context, '3.44', skip_version_check=True).attachments.update(
Oct 23 21:40:53 user nova-compute[74337]: ERROR nova.compute.manager [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 23 21:40:53 user nova-compute[74337]: ERROR nova.compute.manager [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938]     return method.func(obj, *args, **kwargs)
Oct 23 21:40:53 user nova-compute[74337]: ERROR nova.compute.manager [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 23 21:40:53 user nova-compute[74337]: ERROR nova.compute.manager [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938]     resp = self._update('/attachments/%s' % id, body)
Oct 23 21:40:53 user nova-compute[74337]: ERROR nova.compute.manager [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 23 21:40:53 user nova-compute[74337]: ERROR nova.compute.manager [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938]     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 23 21:40:53 user nova-compute[74337]: ERROR nova.compute.manager [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 23 21:40:53 user nova-compute[74337]: ERROR nova.compute.manager [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938]     return self._cs_request(url, 'PUT', **kwargs)
Oct 23 21:40:53 user nova-compute[74337]: ERROR nova.compute.manager [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 23 21:40:53 user nova-compute[74337]: ERROR nova.compute.manager [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938]     return self.request(url, method, **kwargs)
Oct 23 21:40:53 user nova-compute[74337]: ERROR nova.compute.manager [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 23 21:40:53 user nova-compute[74337]: ERROR nova.compute.manager [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938]     raise exceptions.from_response(resp, body)
Oct 23 21:40:53 user nova-compute[74337]: ERROR nova.compute.manager [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-d7a744e3-1168-454c-a618-08a3e150e9da)
Oct 23 21:40:53 user nova-compute[74337]: ERROR nova.compute.manager [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938] 
Oct 23 21:40:53 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-19af79b0-543f-40ee-8f11-bd84fd11ae64 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Lock "00f757cf-e5dd-476f-81c6-670ed2bf6938" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 12.510s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:40:53 user nova-compute[74337]: INFO nova.compute.manager [None req-19af79b0-543f-40ee-8f11-bd84fd11ae64 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: 00f757cf-e5dd-476f-81c6-670ed2bf6938] Successfully reverted task state from spawning on failure for instance.
Oct 23 21:40:53 user nova-compute[74337]: ERROR oslo_messaging.rpc.server [None req-19af79b0-543f-40ee-8f11-bd84fd11ae64 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Exception during message handling: nova.exception.InvalidBDM: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-d7a744e3-1168-454c-a618-08a3e150e9da)
Oct 23 21:40:53 user nova-compute[74337]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 23 21:40:53 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 2190, in _prep_block_device
Oct 23 21:40:53 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     driver_block_device.attach_block_devices(
Oct 23 21:40:53 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Oct 23 21:40:53 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     _log_and_attach(device)
Oct 23 21:40:53 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Oct 23 21:40:53 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     bdm.attach(*attach_args, **attach_kwargs)
Oct 23 21:40:53 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Oct 23 21:40:53 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Oct 23 21:40:53 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Oct 23 21:40:53 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Oct 23 21:40:53 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Oct 23 21:40:53 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Oct 23 21:40:53 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Oct 23 21:40:53 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Oct 23 21:40:53 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 23 21:40:53 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Oct 23 21:40:53 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 23 21:40:53 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 23 21:40:53 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 23 21:40:53 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 23 21:40:53 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 23 21:40:53 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 23 21:40:53 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 23 21:40:53 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 23 21:40:53 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 23 21:40:53 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Oct 23 21:40:53 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 23 21:40:53 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Oct 23 21:40:53 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 23 21:40:53 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Oct 23 21:40:53 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 23 21:40:53 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 23 21:40:53 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 23 21:40:53 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Oct 23 21:40:53 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 23 21:40:53 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Oct 23 21:40:53 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 23 21:40:53 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Oct 23 21:40:53 user nova-compute[74337]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-d7a744e3-1168-454c-a618-08a3e150e9da)
Oct 23 21:40:53 user nova-compute[74337]: ERROR oslo_messaging.rpc.server 
Oct 23 21:40:53 user nova-compute[74337]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred:
Oct 23 21:40:53 user nova-compute[74337]: ERROR oslo_messaging.rpc.server 
Oct 23 21:40:53 user nova-compute[74337]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 23 21:40:53 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 23 21:40:53 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 23 21:40:53 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 23 21:40:53 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 23 21:40:53 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 23 21:40:53 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 23 21:40:53 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 23 21:40:53 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 23 21:40:53 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 23 21:40:53 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 23 21:40:53 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 23 21:40:53 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 23 21:40:53 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 23 21:40:53 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 23 21:40:53 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 166, in decorated_function
Oct 23 21:40:53 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 23 21:40:53 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 23 21:40:53 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 23 21:40:53 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 23 21:40:53 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 23 21:40:53 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 157, in decorated_function
Oct 23 21:40:53 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 23 21:40:53 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Oct 23 21:40:53 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 23 21:40:53 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Oct 23 21:40:53 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 23 21:40:53 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 23 21:40:53 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 23 21:40:53 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 23 21:40:53 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 23 21:40:53 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Oct 23 21:40:53 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 23 21:40:53 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7082, in unshelve_instance
Oct 23 21:40:53 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     do_unshelve_instance()
Oct 23 21:40:53 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Oct 23 21:40:53 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Oct 23 21:40:53 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7079, in do_unshelve_instance
Oct 23 21:40:53 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     self._unshelve_instance(
Oct 23 21:40:53 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7111, in _unshelve_instance
Oct 23 21:40:53 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     block_device_info = self._prep_block_device(context, instance, bdms)
Oct 23 21:40:53 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 2209, in _prep_block_device
Oct 23 21:40:53 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     raise exception.InvalidBDM(str(ex))
Oct 23 21:40:53 user nova-compute[74337]: ERROR oslo_messaging.rpc.server nova.exception.InvalidBDM: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-d7a744e3-1168-454c-a618-08a3e150e9da)
Oct 23 21:40:53 user nova-compute[74337]: ERROR oslo_messaging.rpc.server 
Oct 23 21:40:54 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:40:54 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:40:54 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 21:40:54 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 21:40:54 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 21:40:54 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:40:57 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:40:58 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:40:58 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:40:59 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:40:59 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:41:00 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:41:01 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:41:01 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Starting heal instance info cache {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 21:41:01 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "refresh_cache-d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:41:01 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquired lock "refresh_cache-d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:41:01 user nova-compute[74337]: DEBUG nova.network.neutron [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Forcefully refreshing network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 21:41:02 user nova-compute[74337]: DEBUG nova.network.neutron [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Updating instance_info_cache with network_info: [{"id": "872b2a23-8054-4d26-b798-c0099d1c9a91", "address": "fa:16:3e:30:a6:90", "network": {"id": "b6a24032-0229-4ebe-83a3-8804e494838c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1472404179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17117e60d0d9484d80c0bc8de393921c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap872b2a23-80", "ovs_interfaceid": "872b2a23-8054-4d26-b798-c0099d1c9a91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:41:02 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Releasing lock "refresh_cache-d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:41:02 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Updated the network info_cache for instance {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 21:41:02 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:41:02 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:41:02 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 21:41:04 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:41:04 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:41:04 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:41:04 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:41:04 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:41:04 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Auditing locally available compute resources for user (node: user) {{(pid=74337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 21:41:04 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/547c4d4c-e0dd-495a-b83f-98426d0a4a99/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:41:04 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/547c4d4c-e0dd-495a-b83f-98426d0a4a99/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:41:04 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/547c4d4c-e0dd-495a-b83f-98426d0a4a99/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:41:04 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/547c4d4c-e0dd-495a-b83f-98426d0a4a99/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:41:04 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1189976f-8d02-468d-8fa7-bd5594c5f85a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:41:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1189976f-8d02-468d-8fa7-bd5594c5f85a/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:41:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1189976f-8d02-468d-8fa7-bd5594c5f85a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:41:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1189976f-8d02-468d-8fa7-bd5594c5f85a/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:41:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba8d1d0-5fac-4213-9a50-a4e273710b1b/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:41:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba8d1d0-5fac-4213-9a50-a4e273710b1b/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:41:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba8d1d0-5fac-4213-9a50-a4e273710b1b/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:41:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba8d1d0-5fac-4213-9a50-a4e273710b1b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:41:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:41:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:41:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:41:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:41:06 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 21:41:06 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:41:06 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:41:06 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:41:06 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Hypervisor/Node resource view: name=user free_ram=8198MB free_disk=25.55438232421875GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 21:41:06 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:41:06 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:41:07 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:41:07 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 2cae5b4d-96a0-41ae-9643-b7bf09581988 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:41:07 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 1189976f-8d02-468d-8fa7-bd5594c5f85a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:41:07 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 0ba8d1d0-5fac-4213-9a50-a4e273710b1b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:41:07 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 547c4d4c-e0dd-495a-b83f-98426d0a4a99 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:41:07 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 00f757cf-e5dd-476f-81c6-670ed2bf6938 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Oct 23 21:41:07 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 21:41:07 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 21:41:07 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:41:07 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:41:07 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Compute_service record updated for user:user {{(pid=74337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 21:41:07 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.513s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:41:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:41:08 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:41:08 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:41:08 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:41:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:41:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:41:13 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:41:13 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:41:14 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:41:15 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:41:18 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:41:19 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:41:19 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:41:20 user nova-compute[74337]: DEBUG nova.compute.manager [req-afee949c-fbd4-43e7-ae0e-473b369bf16a req-33e08c24-521e-4683-a694-8adec7850e2c service nova] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Received event volume-reimaged-f45407b0-0f4c-4120-8ef2-812f51f88f01 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:41:20 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-afee949c-fbd4-43e7-ae0e-473b369bf16a req-33e08c24-521e-4683-a694-8adec7850e2c service nova] Acquiring lock "2cae5b4d-96a0-41ae-9643-b7bf09581988-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:41:20 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-afee949c-fbd4-43e7-ae0e-473b369bf16a req-33e08c24-521e-4683-a694-8adec7850e2c service nova] Lock "2cae5b4d-96a0-41ae-9643-b7bf09581988-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:41:20 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-afee949c-fbd4-43e7-ae0e-473b369bf16a req-33e08c24-521e-4683-a694-8adec7850e2c service nova] Lock "2cae5b4d-96a0-41ae-9643-b7bf09581988-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:41:20 user nova-compute[74337]: DEBUG nova.compute.manager [req-afee949c-fbd4-43e7-ae0e-473b369bf16a req-33e08c24-521e-4683-a694-8adec7850e2c service nova] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Processing event volume-reimaged-f45407b0-0f4c-4120-8ef2-812f51f88f01 {{(pid=74337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10871}}
Oct 23 21:41:20 user nova-compute[74337]: DEBUG nova.compute.manager [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Instance event wait completed in 26 seconds for volume-reimaged {{(pid=74337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 21:41:20 user nova-compute[74337]: INFO nova.virt.block_device [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Booting with volume f45407b0-0f4c-4120-8ef2-812f51f88f01 at /dev/vda
Oct 23 21:41:20 user nova-compute[74337]: DEBUG os_brick.utils [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:41:20 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:41:20 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:41:20 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f8a7b4e-4353-4351-ba46-9e296a8d1b55]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f34011b66e40\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:41:20 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:41:20 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:41:20 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e10d050e-1e1b-4aad-a876-98adb43eca08]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:41:20 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:41:20 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:41:20 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[77778064-c177-4059-8a89-14680b7ac25e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:41:20 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[dda9e080-e2c3-4121-b9b6-41a89d311a58]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:41:20 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Running cmd (subprocess): nvme version {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:41:20 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] 'nvme version' failed. Not Retrying. {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 21:41:20 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] nvme not present on system {{(pid=74337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 21:41:20 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:41:20 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 21:41:20 user nova-compute[74337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 21:41:20 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e3545b-12e9-4b9d-8322-ce7fdeba81f4]: (4, '') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:41:20 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 21:41:20 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 21:41:20 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] LIGHTOS: no hostnqn found. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 21:41:20 user nova-compute[74337]: DEBUG os_brick.utils [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f34011b66e40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:41:20 user nova-compute[74337]: DEBUG nova.virt.block_device [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Updating existing volume attachment record: 03b42117-c451-433d-996c-ce3399e831e3 {{(pid=74337) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 21:41:23 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:41:24 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:41:25 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:41:27 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:41:28 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:41:29 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:41:30 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:41:31 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-6e9b7318-dc9b-4032-a1cb-0b6e7935176a tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Acquiring lock "56a4b932-486d-4b8d-9616-99e75592432a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:41:31 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-6e9b7318-dc9b-4032-a1cb-0b6e7935176a tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lock "56a4b932-486d-4b8d-9616-99e75592432a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:41:31 user nova-compute[74337]: DEBUG nova.compute.manager [None req-6e9b7318-dc9b-4032-a1cb-0b6e7935176a tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Starting instance... {{(pid=74337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 21:41:31 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-6e9b7318-dc9b-4032-a1cb-0b6e7935176a tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:41:31 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-6e9b7318-dc9b-4032-a1cb-0b6e7935176a tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:41:31 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-6e9b7318-dc9b-4032-a1cb-0b6e7935176a tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 21:41:31 user nova-compute[74337]: INFO nova.compute.claims [None req-6e9b7318-dc9b-4032-a1cb-0b6e7935176a tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Claim successful on node user
Oct 23 21:41:31 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-6e9b7318-dc9b-4032-a1cb-0b6e7935176a tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:41:31 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-6e9b7318-dc9b-4032-a1cb-0b6e7935176a tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:41:32 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-6e9b7318-dc9b-4032-a1cb-0b6e7935176a tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.412s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:41:32 user nova-compute[74337]: DEBUG nova.compute.manager [None req-6e9b7318-dc9b-4032-a1cb-0b6e7935176a tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Start building networks asynchronously for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 21:41:32 user nova-compute[74337]: DEBUG nova.compute.manager [None req-6e9b7318-dc9b-4032-a1cb-0b6e7935176a tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Allocating IP information in the background. {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 21:41:32 user nova-compute[74337]: DEBUG nova.network.neutron [None req-6e9b7318-dc9b-4032-a1cb-0b6e7935176a tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] allocate_for_instance() {{(pid=74337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 21:41:32 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-6e9b7318-dc9b-4032-a1cb-0b6e7935176a tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 21:41:32 user nova-compute[74337]: DEBUG nova.compute.manager [None req-6e9b7318-dc9b-4032-a1cb-0b6e7935176a tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Start building block device mappings for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 21:41:32 user nova-compute[74337]: DEBUG nova.policy [None req-6e9b7318-dc9b-4032-a1cb-0b6e7935176a tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c82d267bc4d142f8b48c66ffab721618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96dc585a51343db94529e22adbd6ef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74337) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 21:41:32 user nova-compute[74337]: DEBUG nova.compute.manager [None req-6e9b7318-dc9b-4032-a1cb-0b6e7935176a tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Start spawning the instance on the hypervisor. {{(pid=74337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 21:41:32 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-6e9b7318-dc9b-4032-a1cb-0b6e7935176a tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Creating instance directory {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 21:41:32 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-6e9b7318-dc9b-4032-a1cb-0b6e7935176a tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Creating image(s)
Oct 23 21:41:32 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-6e9b7318-dc9b-4032-a1cb-0b6e7935176a tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Acquiring lock "/opt/stack/data/nova/instances/56a4b932-486d-4b8d-9616-99e75592432a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:41:32 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-6e9b7318-dc9b-4032-a1cb-0b6e7935176a tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lock "/opt/stack/data/nova/instances/56a4b932-486d-4b8d-9616-99e75592432a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:41:32 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-6e9b7318-dc9b-4032-a1cb-0b6e7935176a tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lock "/opt/stack/data/nova/instances/56a4b932-486d-4b8d-9616-99e75592432a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:41:32 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-39bc1734-de3a-4db4-aee7-ab5da5d1ed41 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Acquiring lock "749a62c2-7517-4f57-9ba2-b139fe73c4e5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:41:32 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-39bc1734-de3a-4db4-aee7-ab5da5d1ed41 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Lock "749a62c2-7517-4f57-9ba2-b139fe73c4e5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:41:32 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-6e9b7318-dc9b-4032-a1cb-0b6e7935176a tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:41:32 user nova-compute[74337]: DEBUG nova.compute.manager [None req-39bc1734-de3a-4db4-aee7-ab5da5d1ed41 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] [instance: 749a62c2-7517-4f57-9ba2-b139fe73c4e5] Starting instance... {{(pid=74337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 21:41:32 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-39bc1734-de3a-4db4-aee7-ab5da5d1ed41 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:41:32 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-39bc1734-de3a-4db4-aee7-ab5da5d1ed41 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:41:32 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-39bc1734-de3a-4db4-aee7-ab5da5d1ed41 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 21:41:32 user nova-compute[74337]: INFO nova.compute.claims [None req-39bc1734-de3a-4db4-aee7-ab5da5d1ed41 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] [instance: 749a62c2-7517-4f57-9ba2-b139fe73c4e5] Claim successful on node user
Oct 23 21:41:32 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-6e9b7318-dc9b-4032-a1cb-0b6e7935176a tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.260s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:41:32 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-6e9b7318-dc9b-4032-a1cb-0b6e7935176a tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Acquiring lock "fc7b140751b8c385de81623e40fb09ce09374ab7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:41:32 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-6e9b7318-dc9b-4032-a1cb-0b6e7935176a tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lock "fc7b140751b8c385de81623e40fb09ce09374ab7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:41:32 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-6e9b7318-dc9b-4032-a1cb-0b6e7935176a tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:41:32 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-6e9b7318-dc9b-4032-a1cb-0b6e7935176a tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.237s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:41:32 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-6e9b7318-dc9b-4032-a1cb-0b6e7935176a tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7,backing_fmt=raw /opt/stack/data/nova/instances/56a4b932-486d-4b8d-9616-99e75592432a/disk 1073741824 {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:41:32 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-6e9b7318-dc9b-4032-a1cb-0b6e7935176a tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7,backing_fmt=raw /opt/stack/data/nova/instances/56a4b932-486d-4b8d-9616-99e75592432a/disk 1073741824" returned: 0 in 0.054s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:41:32 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-6e9b7318-dc9b-4032-a1cb-0b6e7935176a tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lock "fc7b140751b8c385de81623e40fb09ce09374ab7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.305s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:41:32 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-6e9b7318-dc9b-4032-a1cb-0b6e7935176a tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:41:33 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-39bc1734-de3a-4db4-aee7-ab5da5d1ed41 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:41:33 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-39bc1734-de3a-4db4-aee7-ab5da5d1ed41 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:41:33 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-6e9b7318-dc9b-4032-a1cb-0b6e7935176a tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.231s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:41:33 user nova-compute[74337]: DEBUG nova.virt.disk.api [None req-6e9b7318-dc9b-4032-a1cb-0b6e7935176a tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Checking if we can resize image /opt/stack/data/nova/instances/56a4b932-486d-4b8d-9616-99e75592432a/disk. size=1073741824 {{(pid=74337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 21:41:33 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-6e9b7318-dc9b-4032-a1cb-0b6e7935176a tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56a4b932-486d-4b8d-9616-99e75592432a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:41:33 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-39bc1734-de3a-4db4-aee7-ab5da5d1ed41 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.608s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:41:33 user nova-compute[74337]: DEBUG nova.compute.manager [None req-39bc1734-de3a-4db4-aee7-ab5da5d1ed41 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] [instance: 749a62c2-7517-4f57-9ba2-b139fe73c4e5] Start building networks asynchronously for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 21:41:33 user nova-compute[74337]: DEBUG nova.compute.manager [None req-39bc1734-de3a-4db4-aee7-ab5da5d1ed41 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] [instance: 749a62c2-7517-4f57-9ba2-b139fe73c4e5] Allocating IP information in the background. {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 21:41:33 user nova-compute[74337]: DEBUG nova.network.neutron [None req-39bc1734-de3a-4db4-aee7-ab5da5d1ed41 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] [instance: 749a62c2-7517-4f57-9ba2-b139fe73c4e5] allocate_for_instance() {{(pid=74337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 21:41:33 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:41:33 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-39bc1734-de3a-4db4-aee7-ab5da5d1ed41 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] [instance: 749a62c2-7517-4f57-9ba2-b139fe73c4e5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 21:41:33 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-6e9b7318-dc9b-4032-a1cb-0b6e7935176a tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56a4b932-486d-4b8d-9616-99e75592432a/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:41:33 user nova-compute[74337]: DEBUG nova.virt.disk.api [None req-6e9b7318-dc9b-4032-a1cb-0b6e7935176a tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Cannot resize image /opt/stack/data/nova/instances/56a4b932-486d-4b8d-9616-99e75592432a/disk to a smaller size. {{(pid=74337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 21:41:33 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-6e9b7318-dc9b-4032-a1cb-0b6e7935176a tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Created local disks {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 21:41:33 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-6e9b7318-dc9b-4032-a1cb-0b6e7935176a tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Ensure instance console log exists: /opt/stack/data/nova/instances/56a4b932-486d-4b8d-9616-99e75592432a/console.log {{(pid=74337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 21:41:33 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-6e9b7318-dc9b-4032-a1cb-0b6e7935176a tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:41:33 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-6e9b7318-dc9b-4032-a1cb-0b6e7935176a tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:41:33 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-6e9b7318-dc9b-4032-a1cb-0b6e7935176a tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:41:33 user nova-compute[74337]: DEBUG nova.compute.manager [None req-39bc1734-de3a-4db4-aee7-ab5da5d1ed41 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] [instance: 749a62c2-7517-4f57-9ba2-b139fe73c4e5] Start building block device mappings for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 21:41:33 user nova-compute[74337]: DEBUG nova.compute.manager [None req-39bc1734-de3a-4db4-aee7-ab5da5d1ed41 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] [instance: 749a62c2-7517-4f57-9ba2-b139fe73c4e5] Start spawning the instance on the hypervisor. {{(pid=74337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 21:41:33 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-39bc1734-de3a-4db4-aee7-ab5da5d1ed41 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] [instance: 749a62c2-7517-4f57-9ba2-b139fe73c4e5] Creating instance directory {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 21:41:33 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-39bc1734-de3a-4db4-aee7-ab5da5d1ed41 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] [instance: 749a62c2-7517-4f57-9ba2-b139fe73c4e5] Creating image(s)
Oct 23 21:41:33 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-39bc1734-de3a-4db4-aee7-ab5da5d1ed41 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Acquiring lock "/opt/stack/data/nova/instances/749a62c2-7517-4f57-9ba2-b139fe73c4e5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:41:33 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-39bc1734-de3a-4db4-aee7-ab5da5d1ed41 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Lock "/opt/stack/data/nova/instances/749a62c2-7517-4f57-9ba2-b139fe73c4e5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:41:33 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-39bc1734-de3a-4db4-aee7-ab5da5d1ed41 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Lock "/opt/stack/data/nova/instances/749a62c2-7517-4f57-9ba2-b139fe73c4e5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:41:33 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-39bc1734-de3a-4db4-aee7-ab5da5d1ed41 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:41:33 user nova-compute[74337]: DEBUG nova.policy [None req-39bc1734-de3a-4db4-aee7-ab5da5d1ed41 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c11f9fb1ab7c411fa9069976c4419bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83700495146c4b0e8d76491380b5f895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74337) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 21:41:33 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-39bc1734-de3a-4db4-aee7-ab5da5d1ed41 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.211s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:41:33 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-39bc1734-de3a-4db4-aee7-ab5da5d1ed41 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Acquiring lock "fc7b140751b8c385de81623e40fb09ce09374ab7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:41:33 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-39bc1734-de3a-4db4-aee7-ab5da5d1ed41 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Lock "fc7b140751b8c385de81623e40fb09ce09374ab7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:41:33 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-39bc1734-de3a-4db4-aee7-ab5da5d1ed41 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:41:33 user nova-compute[74337]: DEBUG nova.compute.manager [req-afecb60a-6e0b-4c8a-81fd-5e27a21ed403 req-848e22bb-45d9-41ba-99f0-d1256b976b5b service nova] [instance: 547c4d4c-e0dd-495a-b83f-98426d0a4a99] Received event network-changed-2dd20d7f-9490-476a-90ed-e6a1c9085e4d {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:41:33 user nova-compute[74337]: DEBUG nova.compute.manager [req-afecb60a-6e0b-4c8a-81fd-5e27a21ed403 req-848e22bb-45d9-41ba-99f0-d1256b976b5b service nova] [instance: 547c4d4c-e0dd-495a-b83f-98426d0a4a99] Refreshing instance network info cache due to event network-changed-2dd20d7f-9490-476a-90ed-e6a1c9085e4d. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 21:41:33 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-afecb60a-6e0b-4c8a-81fd-5e27a21ed403 req-848e22bb-45d9-41ba-99f0-d1256b976b5b service nova] Acquiring lock "refresh_cache-547c4d4c-e0dd-495a-b83f-98426d0a4a99" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:41:33 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-afecb60a-6e0b-4c8a-81fd-5e27a21ed403 req-848e22bb-45d9-41ba-99f0-d1256b976b5b service nova] Acquired lock "refresh_cache-547c4d4c-e0dd-495a-b83f-98426d0a4a99" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:41:33 user nova-compute[74337]: DEBUG nova.network.neutron [req-afecb60a-6e0b-4c8a-81fd-5e27a21ed403 req-848e22bb-45d9-41ba-99f0-d1256b976b5b service nova] [instance: 547c4d4c-e0dd-495a-b83f-98426d0a4a99] Refreshing network info cache for port 2dd20d7f-9490-476a-90ed-e6a1c9085e4d {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 21:41:33 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-39bc1734-de3a-4db4-aee7-ab5da5d1ed41 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.227s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:41:34 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-39bc1734-de3a-4db4-aee7-ab5da5d1ed41 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7,backing_fmt=raw /opt/stack/data/nova/instances/749a62c2-7517-4f57-9ba2-b139fe73c4e5/disk 1073741824 {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:41:34 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:41:34 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-39bc1734-de3a-4db4-aee7-ab5da5d1ed41 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7,backing_fmt=raw /opt/stack/data/nova/instances/749a62c2-7517-4f57-9ba2-b139fe73c4e5/disk 1073741824" returned: 0 in 0.079s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:41:34 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-39bc1734-de3a-4db4-aee7-ab5da5d1ed41 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Lock "fc7b140751b8c385de81623e40fb09ce09374ab7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.314s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:41:34 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-39bc1734-de3a-4db4-aee7-ab5da5d1ed41 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:41:34 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-39bc1734-de3a-4db4-aee7-ab5da5d1ed41 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.217s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:41:34 user nova-compute[74337]: DEBUG nova.virt.disk.api [None req-39bc1734-de3a-4db4-aee7-ab5da5d1ed41 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Checking if we can resize image /opt/stack/data/nova/instances/749a62c2-7517-4f57-9ba2-b139fe73c4e5/disk. size=1073741824 {{(pid=74337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 21:41:34 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-39bc1734-de3a-4db4-aee7-ab5da5d1ed41 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/749a62c2-7517-4f57-9ba2-b139fe73c4e5/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:41:34 user nova-compute[74337]: DEBUG nova.network.neutron [None req-6e9b7318-dc9b-4032-a1cb-0b6e7935176a tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Successfully created port: 5df71ce2-a116-44b3-856b-c0de0da5dcd6 {{(pid=74337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 21:41:34 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-39bc1734-de3a-4db4-aee7-ab5da5d1ed41 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/749a62c2-7517-4f57-9ba2-b139fe73c4e5/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:41:34 user nova-compute[74337]: DEBUG nova.virt.disk.api [None req-39bc1734-de3a-4db4-aee7-ab5da5d1ed41 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Cannot resize image /opt/stack/data/nova/instances/749a62c2-7517-4f57-9ba2-b139fe73c4e5/disk to a smaller size. {{(pid=74337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 21:41:34 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-39bc1734-de3a-4db4-aee7-ab5da5d1ed41 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] [instance: 749a62c2-7517-4f57-9ba2-b139fe73c4e5] Created local disks {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 21:41:34 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-39bc1734-de3a-4db4-aee7-ab5da5d1ed41 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] [instance: 749a62c2-7517-4f57-9ba2-b139fe73c4e5] Ensure instance console log exists: /opt/stack/data/nova/instances/749a62c2-7517-4f57-9ba2-b139fe73c4e5/console.log {{(pid=74337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 21:41:34 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-39bc1734-de3a-4db4-aee7-ab5da5d1ed41 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:41:34 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-39bc1734-de3a-4db4-aee7-ab5da5d1ed41 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:41:34 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-39bc1734-de3a-4db4-aee7-ab5da5d1ed41 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:41:34 user nova-compute[74337]: DEBUG nova.network.neutron [req-afecb60a-6e0b-4c8a-81fd-5e27a21ed403 req-848e22bb-45d9-41ba-99f0-d1256b976b5b service nova] [instance: 547c4d4c-e0dd-495a-b83f-98426d0a4a99] Updated VIF entry in instance network info cache for port 2dd20d7f-9490-476a-90ed-e6a1c9085e4d. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 21:41:34 user nova-compute[74337]: DEBUG nova.network.neutron [req-afecb60a-6e0b-4c8a-81fd-5e27a21ed403 req-848e22bb-45d9-41ba-99f0-d1256b976b5b service nova] [instance: 547c4d4c-e0dd-495a-b83f-98426d0a4a99] Updating instance_info_cache with network_info: [{"id": "2dd20d7f-9490-476a-90ed-e6a1c9085e4d", "address": "fa:16:3e:5f:e1:f7", "network": {"id": "aff1f95f-fda8-4f0f-8d10-7e3d587e4fda", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2048135647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1f57e58a9ec4c6384dc0d3ca58eb610", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd20d7f-94", "ovs_interfaceid": "2dd20d7f-9490-476a-90ed-e6a1c9085e4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:41:34 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-afecb60a-6e0b-4c8a-81fd-5e27a21ed403 req-848e22bb-45d9-41ba-99f0-d1256b976b5b service nova] Releasing lock "refresh_cache-547c4d4c-e0dd-495a-b83f-98426d0a4a99" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:41:35 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:41:35 user nova-compute[74337]: DEBUG nova.network.neutron [None req-39bc1734-de3a-4db4-aee7-ab5da5d1ed41 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] [instance: 749a62c2-7517-4f57-9ba2-b139fe73c4e5] Successfully created port: 33efeffb-9f5f-4b9f-a930-1e718e1624f1 {{(pid=74337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 21:41:36 user nova-compute[74337]: DEBUG nova.network.neutron [None req-6e9b7318-dc9b-4032-a1cb-0b6e7935176a tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Successfully updated port: 5df71ce2-a116-44b3-856b-c0de0da5dcd6 {{(pid=74337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 21:41:36 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-6e9b7318-dc9b-4032-a1cb-0b6e7935176a tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Acquiring lock "refresh_cache-56a4b932-486d-4b8d-9616-99e75592432a" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:41:36 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-6e9b7318-dc9b-4032-a1cb-0b6e7935176a tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Acquired lock "refresh_cache-56a4b932-486d-4b8d-9616-99e75592432a" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:41:36 user nova-compute[74337]: DEBUG nova.network.neutron [None req-6e9b7318-dc9b-4032-a1cb-0b6e7935176a tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Building network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 21:41:36 user nova-compute[74337]: DEBUG nova.compute.manager [req-848c0cc7-a548-4537-a603-8153f506d039 req-3f280d2a-d4ec-43c3-a8bb-1ba57157bd19 service nova] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Received event network-changed-5df71ce2-a116-44b3-856b-c0de0da5dcd6 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:41:36 user nova-compute[74337]: DEBUG nova.compute.manager [req-848c0cc7-a548-4537-a603-8153f506d039 req-3f280d2a-d4ec-43c3-a8bb-1ba57157bd19 service nova] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Refreshing instance network info cache due to event network-changed-5df71ce2-a116-44b3-856b-c0de0da5dcd6. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 21:41:36 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-848c0cc7-a548-4537-a603-8153f506d039 req-3f280d2a-d4ec-43c3-a8bb-1ba57157bd19 service nova] Acquiring lock "refresh_cache-56a4b932-486d-4b8d-9616-99e75592432a" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:41:36 user nova-compute[74337]: DEBUG nova.network.neutron [None req-6e9b7318-dc9b-4032-a1cb-0b6e7935176a tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Instance cache missing network info. {{(pid=74337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 21:41:37 user nova-compute[74337]: DEBUG nova.network.neutron [None req-6e9b7318-dc9b-4032-a1cb-0b6e7935176a tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Updating instance_info_cache with network_info: [{"id": "5df71ce2-a116-44b3-856b-c0de0da5dcd6", "address": "fa:16:3e:20:cc:6f", "network": {"id": "fe0a9f00-e17b-4064-96d2-fd1cc848afb2", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1294741219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96dc585a51343db94529e22adbd6ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5df71ce2-a1", "ovs_interfaceid": "5df71ce2-a116-44b3-856b-c0de0da5dcd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:41:37 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-6e9b7318-dc9b-4032-a1cb-0b6e7935176a tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Releasing lock "refresh_cache-56a4b932-486d-4b8d-9616-99e75592432a" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:41:37 user nova-compute[74337]: DEBUG nova.compute.manager [None req-6e9b7318-dc9b-4032-a1cb-0b6e7935176a tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Instance network_info: |[{"id": "5df71ce2-a116-44b3-856b-c0de0da5dcd6", "address": "fa:16:3e:20:cc:6f", "network": {"id": "fe0a9f00-e17b-4064-96d2-fd1cc848afb2", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1294741219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96dc585a51343db94529e22adbd6ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5df71ce2-a1", "ovs_interfaceid": "5df71ce2-a116-44b3-856b-c0de0da5dcd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 21:41:37 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-848c0cc7-a548-4537-a603-8153f506d039 req-3f280d2a-d4ec-43c3-a8bb-1ba57157bd19 service nova] Acquired lock "refresh_cache-56a4b932-486d-4b8d-9616-99e75592432a" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:41:37 user nova-compute[74337]: DEBUG nova.network.neutron [req-848c0cc7-a548-4537-a603-8153f506d039 req-3f280d2a-d4ec-43c3-a8bb-1ba57157bd19 service nova] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Refreshing network info cache for port 5df71ce2-a116-44b3-856b-c0de0da5dcd6 {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 21:41:37 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-6e9b7318-dc9b-4032-a1cb-0b6e7935176a tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Start _get_guest_xml network_info=[{"id": "5df71ce2-a116-44b3-856b-c0de0da5dcd6", "address": "fa:16:3e:20:cc:6f", "network": {"id": "fe0a9f00-e17b-4064-96d2-fd1cc848afb2", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1294741219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96dc585a51343db94529e22adbd6ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5df71ce2-a1", "ovs_interfaceid": "5df71ce2-a116-44b3-856b-c0de0da5dcd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T21:29:21Z,direct_url=<?>,disk_format='qcow2',id=d859d89d-998d-4109-b26a-0d6e28152932,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ff43462300764979a6cf688444336a56',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T21:29:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'image_id': 'd859d89d-998d-4109-b26a-0d6e28152932'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 21:41:37 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-6e9b7318-dc9b-4032-a1cb-0b6e7935176a tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:41:37 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-6e9b7318-dc9b-4032-a1cb-0b6e7935176a tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:41:37 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-6e9b7318-dc9b-4032-a1cb-0b6e7935176a tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 21:41:37 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-6e9b7318-dc9b-4032-a1cb-0b6e7935176a tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] CPU controller missing on host. {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 21:41:37 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-6e9b7318-dc9b-4032-a1cb-0b6e7935176a tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 21:41:37 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-6e9b7318-dc9b-4032-a1cb-0b6e7935176a tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] CPU controller found on host. {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 21:41:37 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-6e9b7318-dc9b-4032-a1cb-0b6e7935176a tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 21:41:37 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-6e9b7318-dc9b-4032-a1cb-0b6e7935176a tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T21:29:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T21:29:21Z,direct_url=<?>,disk_format='qcow2',id=d859d89d-998d-4109-b26a-0d6e28152932,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ff43462300764979a6cf688444336a56',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T21:29:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 21:41:37 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-6e9b7318-dc9b-4032-a1cb-0b6e7935176a tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Flavor limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 21:41:37 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-6e9b7318-dc9b-4032-a1cb-0b6e7935176a tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Image limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 21:41:37 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-6e9b7318-dc9b-4032-a1cb-0b6e7935176a tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Flavor pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 21:41:37 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-6e9b7318-dc9b-4032-a1cb-0b6e7935176a tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Image pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 21:41:37 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-6e9b7318-dc9b-4032-a1cb-0b6e7935176a tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 21:41:37 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-6e9b7318-dc9b-4032-a1cb-0b6e7935176a tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 21:41:37 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-6e9b7318-dc9b-4032-a1cb-0b6e7935176a tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 21:41:37 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-6e9b7318-dc9b-4032-a1cb-0b6e7935176a tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Got 1 possible topologies {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 21:41:37 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-6e9b7318-dc9b-4032-a1cb-0b6e7935176a tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 21:41:37 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-6e9b7318-dc9b-4032-a1cb-0b6e7935176a tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 21:41:37 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-6e9b7318-dc9b-4032-a1cb-0b6e7935176a tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:41:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1348448759',display_name='tempest-AttachVolumeTestJSON-server-1348448759',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1348448759',id=18,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOSyI2UfSbOjGClrd6s5yGjykCHAlq4p3VgQcvKHgSPXIAoK0vvVLu+A6LT9ePnSPyc9urTg/MN9ZHJ02yogPWhYeBoMR8cfZQeMkKqZLPuaXXx5keLozdFismgRTGZYug==',key_name='tempest-keypair-1796008721',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b96dc585a51343db94529e22adbd6ef3',ramdisk_id='',reservation_id='r-ydiij502',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-786463768',owner_user_name='tempest-AttachVolumeTestJSON-786463768-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:41:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c82d267bc4d142f8b48c66ffab721618',uuid=56a4b932-486d-4b8d-9616-99e75592432a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5df71ce2-a116-44b3-856b-c0de0da5dcd6", "address": "fa:16:3e:20:cc:6f", "network": {"id": "fe0a9f00-e17b-4064-96d2-fd1cc848afb2", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1294741219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96dc585a51343db94529e22adbd6ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5df71ce2-a1", "ovs_interfaceid": "5df71ce2-a116-44b3-856b-c0de0da5dcd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 21:41:37 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-6e9b7318-dc9b-4032-a1cb-0b6e7935176a tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Converting VIF {"id": "5df71ce2-a116-44b3-856b-c0de0da5dcd6", "address": "fa:16:3e:20:cc:6f", "network": {"id": "fe0a9f00-e17b-4064-96d2-fd1cc848afb2", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1294741219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96dc585a51343db94529e22adbd6ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5df71ce2-a1", "ovs_interfaceid": "5df71ce2-a116-44b3-856b-c0de0da5dcd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:41:37 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-6e9b7318-dc9b-4032-a1cb-0b6e7935176a tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:cc:6f,bridge_name='br-int',has_traffic_filtering=True,id=5df71ce2-a116-44b3-856b-c0de0da5dcd6,network=Network(fe0a9f00-e17b-4064-96d2-fd1cc848afb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5df71ce2-a1') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:41:37 user nova-compute[74337]: DEBUG nova.objects.instance [None req-6e9b7318-dc9b-4032-a1cb-0b6e7935176a tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lazy-loading 'pci_devices' on Instance uuid 56a4b932-486d-4b8d-9616-99e75592432a {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:41:37 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-6e9b7318-dc9b-4032-a1cb-0b6e7935176a tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] End _get_guest_xml xml=<domain type="kvm">
Oct 23 21:41:37 user nova-compute[74337]:   <uuid>56a4b932-486d-4b8d-9616-99e75592432a</uuid>
Oct 23 21:41:37 user nova-compute[74337]:   <name>instance-00000012</name>
Oct 23 21:41:37 user nova-compute[74337]:   <memory>524288</memory>
Oct 23 21:41:37 user nova-compute[74337]:   <vcpu>1</vcpu>
Oct 23 21:41:37 user nova-compute[74337]:   <metadata>
Oct 23 21:41:37 user nova-compute[74337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 21:41:37 user nova-compute[74337]:       <nova:package version="0.0.0"/>
Oct 23 21:41:37 user nova-compute[74337]:       <nova:name>tempest-AttachVolumeTestJSON-server-1348448759</nova:name>
Oct 23 21:41:37 user nova-compute[74337]:       <nova:creationTime>2023-10-23 21:41:37</nova:creationTime>
Oct 23 21:41:37 user nova-compute[74337]:       <nova:flavor name="m1.tiny">
Oct 23 21:41:37 user nova-compute[74337]:         <nova:memory>512</nova:memory>
Oct 23 21:41:37 user nova-compute[74337]:         <nova:disk>1</nova:disk>
Oct 23 21:41:37 user nova-compute[74337]:         <nova:swap>0</nova:swap>
Oct 23 21:41:37 user nova-compute[74337]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 21:41:37 user nova-compute[74337]:         <nova:vcpus>1</nova:vcpus>
Oct 23 21:41:37 user nova-compute[74337]:       </nova:flavor>
Oct 23 21:41:37 user nova-compute[74337]:       <nova:owner>
Oct 23 21:41:37 user nova-compute[74337]:         <nova:user uuid="c82d267bc4d142f8b48c66ffab721618">tempest-AttachVolumeTestJSON-786463768-project-member</nova:user>
Oct 23 21:41:37 user nova-compute[74337]:         <nova:project uuid="b96dc585a51343db94529e22adbd6ef3">tempest-AttachVolumeTestJSON-786463768</nova:project>
Oct 23 21:41:37 user nova-compute[74337]:       </nova:owner>
Oct 23 21:41:37 user nova-compute[74337]:       <nova:root type="image" uuid="d859d89d-998d-4109-b26a-0d6e28152932"/>
Oct 23 21:41:37 user nova-compute[74337]:       <nova:ports>
Oct 23 21:41:37 user nova-compute[74337]:         <nova:port uuid="5df71ce2-a116-44b3-856b-c0de0da5dcd6">
Oct 23 21:41:37 user nova-compute[74337]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 23 21:41:37 user nova-compute[74337]:         </nova:port>
Oct 23 21:41:37 user nova-compute[74337]:       </nova:ports>
Oct 23 21:41:37 user nova-compute[74337]:     </nova:instance>
Oct 23 21:41:37 user nova-compute[74337]:   </metadata>
Oct 23 21:41:37 user nova-compute[74337]:   <sysinfo type="smbios">
Oct 23 21:41:37 user nova-compute[74337]:     <system>
Oct 23 21:41:37 user nova-compute[74337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 21:41:37 user nova-compute[74337]:       <entry name="product">OpenStack Nova</entry>
Oct 23 21:41:37 user nova-compute[74337]:       <entry name="version">0.0.0</entry>
Oct 23 21:41:37 user nova-compute[74337]:       <entry name="serial">56a4b932-486d-4b8d-9616-99e75592432a</entry>
Oct 23 21:41:37 user nova-compute[74337]:       <entry name="uuid">56a4b932-486d-4b8d-9616-99e75592432a</entry>
Oct 23 21:41:37 user nova-compute[74337]:       <entry name="family">Virtual Machine</entry>
Oct 23 21:41:37 user nova-compute[74337]:     </system>
Oct 23 21:41:37 user nova-compute[74337]:   </sysinfo>
Oct 23 21:41:37 user nova-compute[74337]:   <os>
Oct 23 21:41:37 user nova-compute[74337]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 21:41:37 user nova-compute[74337]:     <boot dev="hd"/>
Oct 23 21:41:37 user nova-compute[74337]:     <smbios mode="sysinfo"/>
Oct 23 21:41:37 user nova-compute[74337]:   </os>
Oct 23 21:41:37 user nova-compute[74337]:   <features>
Oct 23 21:41:37 user nova-compute[74337]:     <acpi/>
Oct 23 21:41:37 user nova-compute[74337]:     <apic/>
Oct 23 21:41:37 user nova-compute[74337]:     <vmcoreinfo/>
Oct 23 21:41:37 user nova-compute[74337]:   </features>
Oct 23 21:41:37 user nova-compute[74337]:   <clock offset="utc">
Oct 23 21:41:37 user nova-compute[74337]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 21:41:37 user nova-compute[74337]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 21:41:37 user nova-compute[74337]:     <timer name="hpet" present="no"/>
Oct 23 21:41:37 user nova-compute[74337]:   </clock>
Oct 23 21:41:37 user nova-compute[74337]:   <cpu mode="custom" match="exact">
Oct 23 21:41:37 user nova-compute[74337]:     <model>Nehalem</model>
Oct 23 21:41:37 user nova-compute[74337]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 21:41:37 user nova-compute[74337]:   </cpu>
Oct 23 21:41:37 user nova-compute[74337]:   <devices>
Oct 23 21:41:37 user nova-compute[74337]:     <disk type="file" device="disk">
Oct 23 21:41:37 user nova-compute[74337]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 21:41:37 user nova-compute[74337]:       <source file="/opt/stack/data/nova/instances/56a4b932-486d-4b8d-9616-99e75592432a/disk"/>
Oct 23 21:41:37 user nova-compute[74337]:       <target dev="vda" bus="virtio"/>
Oct 23 21:41:37 user nova-compute[74337]:     </disk>
Oct 23 21:41:37 user nova-compute[74337]:     <interface type="ethernet">
Oct 23 21:41:37 user nova-compute[74337]:       <mac address="fa:16:3e:20:cc:6f"/>
Oct 23 21:41:37 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:41:37 user nova-compute[74337]:       <mtu size="1442"/>
Oct 23 21:41:37 user nova-compute[74337]:       <target dev="tap5df71ce2-a1"/>
Oct 23 21:41:37 user nova-compute[74337]:     </interface>
Oct 23 21:41:37 user nova-compute[74337]:     <serial type="pty">
Oct 23 21:41:37 user nova-compute[74337]:       <log file="/opt/stack/data/nova/instances/56a4b932-486d-4b8d-9616-99e75592432a/console.log" append="off"/>
Oct 23 21:41:37 user nova-compute[74337]:     </serial>
Oct 23 21:41:37 user nova-compute[74337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 21:41:37 user nova-compute[74337]:     <video>
Oct 23 21:41:37 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:41:37 user nova-compute[74337]:     </video>
Oct 23 21:41:37 user nova-compute[74337]:     <rng model="virtio">
Oct 23 21:41:37 user nova-compute[74337]:       <backend model="random">/dev/urandom</backend>
Oct 23 21:41:37 user nova-compute[74337]:     </rng>
Oct 23 21:41:37 user nova-compute[74337]:     <controller type="usb" index="0" model="none"/>
Oct 23 21:41:37 user nova-compute[74337]:     <memballoon model="virtio">
Oct 23 21:41:37 user nova-compute[74337]:       <stats period="10"/>
Oct 23 21:41:37 user nova-compute[74337]:     </memballoon>
Oct 23 21:41:37 user nova-compute[74337]:   </devices>
Oct 23 21:41:37 user nova-compute[74337]: </domain>
Oct 23 21:41:37 user nova-compute[74337]:  {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 21:41:37 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-6e9b7318-dc9b-4032-a1cb-0b6e7935176a tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:41:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1348448759',display_name='tempest-AttachVolumeTestJSON-server-1348448759',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1348448759',id=18,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOSyI2UfSbOjGClrd6s5yGjykCHAlq4p3VgQcvKHgSPXIAoK0vvVLu+A6LT9ePnSPyc9urTg/MN9ZHJ02yogPWhYeBoMR8cfZQeMkKqZLPuaXXx5keLozdFismgRTGZYug==',key_name='tempest-keypair-1796008721',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b96dc585a51343db94529e22adbd6ef3',ramdisk_id='',reservation_id='r-ydiij502',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-786463768',owner_user_name='tempest-AttachVolumeTestJSON-786463768-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:41:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c82d267bc4d142f8b48c66ffab721618',uuid=56a4b932-486d-4b8d-9616-99e75592432a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5df71ce2-a116-44b3-856b-c0de0da5dcd6", "address": "fa:16:3e:20:cc:6f", "network": {"id": "fe0a9f00-e17b-4064-96d2-fd1cc848afb2", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1294741219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96dc585a51343db94529e22adbd6ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5df71ce2-a1", "ovs_interfaceid": "5df71ce2-a116-44b3-856b-c0de0da5dcd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 21:41:37 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-6e9b7318-dc9b-4032-a1cb-0b6e7935176a tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Converting VIF {"id": "5df71ce2-a116-44b3-856b-c0de0da5dcd6", "address": "fa:16:3e:20:cc:6f", "network": {"id": "fe0a9f00-e17b-4064-96d2-fd1cc848afb2", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1294741219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96dc585a51343db94529e22adbd6ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5df71ce2-a1", "ovs_interfaceid": "5df71ce2-a116-44b3-856b-c0de0da5dcd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:41:37 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-6e9b7318-dc9b-4032-a1cb-0b6e7935176a tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:cc:6f,bridge_name='br-int',has_traffic_filtering=True,id=5df71ce2-a116-44b3-856b-c0de0da5dcd6,network=Network(fe0a9f00-e17b-4064-96d2-fd1cc848afb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5df71ce2-a1') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:41:37 user nova-compute[74337]: DEBUG os_vif [None req-6e9b7318-dc9b-4032-a1cb-0b6e7935176a tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:cc:6f,bridge_name='br-int',has_traffic_filtering=True,id=5df71ce2-a116-44b3-856b-c0de0da5dcd6,network=Network(fe0a9f00-e17b-4064-96d2-fd1cc848afb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5df71ce2-a1') {{(pid=74337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 21:41:37 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:41:37 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:41:37 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 21:41:37 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:41:37 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '43a2dca9-239f-5e8e-9bfc-a6775a79bbfb', '_type': 'linux-noop'}}, row=False) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:41:37 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:41:37 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:41:37 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:41:37 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5df71ce2-a1, may_exist=True, interface_attrs={}) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:41:37 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5df71ce2-a1, col_values=(('qos', UUID('ead21567-8d63-4cdd-9f00-6b01011fa225')),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:41:37 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5df71ce2-a1, col_values=(('external_ids', {'iface-id': '5df71ce2-a116-44b3-856b-c0de0da5dcd6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:20:cc:6f', 'vm-uuid': '56a4b932-486d-4b8d-9616-99e75592432a'}),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:41:37 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:41:37 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:41:37 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:41:37 user nova-compute[74337]: INFO os_vif [None req-6e9b7318-dc9b-4032-a1cb-0b6e7935176a tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:cc:6f,bridge_name='br-int',has_traffic_filtering=True,id=5df71ce2-a116-44b3-856b-c0de0da5dcd6,network=Network(fe0a9f00-e17b-4064-96d2-fd1cc848afb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5df71ce2-a1')
Oct 23 21:41:37 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-6e9b7318-dc9b-4032-a1cb-0b6e7935176a tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] No BDM found with device name vda, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 21:41:37 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-6e9b7318-dc9b-4032-a1cb-0b6e7935176a tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] No VIF found with MAC fa:16:3e:20:cc:6f, not building metadata {{(pid=74337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 21:41:37 user nova-compute[74337]: DEBUG nova.network.neutron [None req-39bc1734-de3a-4db4-aee7-ab5da5d1ed41 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] [instance: 749a62c2-7517-4f57-9ba2-b139fe73c4e5] Successfully updated port: 33efeffb-9f5f-4b9f-a930-1e718e1624f1 {{(pid=74337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 21:41:37 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-39bc1734-de3a-4db4-aee7-ab5da5d1ed41 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Acquiring lock "refresh_cache-749a62c2-7517-4f57-9ba2-b139fe73c4e5" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:41:37 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-39bc1734-de3a-4db4-aee7-ab5da5d1ed41 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Acquired lock "refresh_cache-749a62c2-7517-4f57-9ba2-b139fe73c4e5" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:41:37 user nova-compute[74337]: DEBUG nova.network.neutron [None req-39bc1734-de3a-4db4-aee7-ab5da5d1ed41 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] [instance: 749a62c2-7517-4f57-9ba2-b139fe73c4e5] Building network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 21:41:37 user nova-compute[74337]: DEBUG nova.network.neutron [None req-39bc1734-de3a-4db4-aee7-ab5da5d1ed41 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] [instance: 749a62c2-7517-4f57-9ba2-b139fe73c4e5] Instance cache missing network info. {{(pid=74337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 21:41:38 user nova-compute[74337]: DEBUG nova.network.neutron [req-848c0cc7-a548-4537-a603-8153f506d039 req-3f280d2a-d4ec-43c3-a8bb-1ba57157bd19 service nova] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Updated VIF entry in instance network info cache for port 5df71ce2-a116-44b3-856b-c0de0da5dcd6. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 21:41:38 user nova-compute[74337]: DEBUG nova.network.neutron [req-848c0cc7-a548-4537-a603-8153f506d039 req-3f280d2a-d4ec-43c3-a8bb-1ba57157bd19 service nova] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Updating instance_info_cache with network_info: [{"id": "5df71ce2-a116-44b3-856b-c0de0da5dcd6", "address": "fa:16:3e:20:cc:6f", "network": {"id": "fe0a9f00-e17b-4064-96d2-fd1cc848afb2", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1294741219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96dc585a51343db94529e22adbd6ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5df71ce2-a1", "ovs_interfaceid": "5df71ce2-a116-44b3-856b-c0de0da5dcd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:41:38 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-848c0cc7-a548-4537-a603-8153f506d039 req-3f280d2a-d4ec-43c3-a8bb-1ba57157bd19 service nova] Releasing lock "refresh_cache-56a4b932-486d-4b8d-9616-99e75592432a" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:41:38 user nova-compute[74337]: DEBUG nova.network.neutron [None req-39bc1734-de3a-4db4-aee7-ab5da5d1ed41 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] [instance: 749a62c2-7517-4f57-9ba2-b139fe73c4e5] Updating instance_info_cache with network_info: [{"id": "33efeffb-9f5f-4b9f-a930-1e718e1624f1", "address": "fa:16:3e:a7:95:34", "network": {"id": "3d6e3d17-6da2-4ac1-ab9f-b7ed54db79bc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1078020443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83700495146c4b0e8d76491380b5f895", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33efeffb-9f", "ovs_interfaceid": "33efeffb-9f5f-4b9f-a930-1e718e1624f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:41:38 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-39bc1734-de3a-4db4-aee7-ab5da5d1ed41 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Releasing lock "refresh_cache-749a62c2-7517-4f57-9ba2-b139fe73c4e5" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:41:38 user nova-compute[74337]: DEBUG nova.compute.manager [None req-39bc1734-de3a-4db4-aee7-ab5da5d1ed41 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] [instance: 749a62c2-7517-4f57-9ba2-b139fe73c4e5] Instance network_info: |[{"id": "33efeffb-9f5f-4b9f-a930-1e718e1624f1", "address": "fa:16:3e:a7:95:34", "network": {"id": "3d6e3d17-6da2-4ac1-ab9f-b7ed54db79bc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1078020443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83700495146c4b0e8d76491380b5f895", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33efeffb-9f", "ovs_interfaceid": "33efeffb-9f5f-4b9f-a930-1e718e1624f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 21:41:38 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-39bc1734-de3a-4db4-aee7-ab5da5d1ed41 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] [instance: 749a62c2-7517-4f57-9ba2-b139fe73c4e5] Start _get_guest_xml network_info=[{"id": "33efeffb-9f5f-4b9f-a930-1e718e1624f1", "address": "fa:16:3e:a7:95:34", "network": {"id": "3d6e3d17-6da2-4ac1-ab9f-b7ed54db79bc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1078020443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83700495146c4b0e8d76491380b5f895", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33efeffb-9f", "ovs_interfaceid": "33efeffb-9f5f-4b9f-a930-1e718e1624f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T21:29:21Z,direct_url=<?>,disk_format='qcow2',id=d859d89d-998d-4109-b26a-0d6e28152932,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ff43462300764979a6cf688444336a56',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T21:29:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'image_id': 'd859d89d-998d-4109-b26a-0d6e28152932'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 21:41:38 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-39bc1734-de3a-4db4-aee7-ab5da5d1ed41 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:41:38 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-39bc1734-de3a-4db4-aee7-ab5da5d1ed41 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:41:38 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-39bc1734-de3a-4db4-aee7-ab5da5d1ed41 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 21:41:38 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-39bc1734-de3a-4db4-aee7-ab5da5d1ed41 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] CPU controller missing on host. {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 21:41:38 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-39bc1734-de3a-4db4-aee7-ab5da5d1ed41 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 21:41:38 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-39bc1734-de3a-4db4-aee7-ab5da5d1ed41 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] CPU controller found on host. {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 21:41:38 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-39bc1734-de3a-4db4-aee7-ab5da5d1ed41 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 21:41:38 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-39bc1734-de3a-4db4-aee7-ab5da5d1ed41 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T21:29:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T21:29:21Z,direct_url=<?>,disk_format='qcow2',id=d859d89d-998d-4109-b26a-0d6e28152932,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ff43462300764979a6cf688444336a56',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T21:29:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 21:41:38 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-39bc1734-de3a-4db4-aee7-ab5da5d1ed41 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Flavor limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 21:41:38 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-39bc1734-de3a-4db4-aee7-ab5da5d1ed41 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Image limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 21:41:38 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-39bc1734-de3a-4db4-aee7-ab5da5d1ed41 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Flavor pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 21:41:38 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-39bc1734-de3a-4db4-aee7-ab5da5d1ed41 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Image pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 21:41:38 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-39bc1734-de3a-4db4-aee7-ab5da5d1ed41 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 21:41:38 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-39bc1734-de3a-4db4-aee7-ab5da5d1ed41 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 21:41:38 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-39bc1734-de3a-4db4-aee7-ab5da5d1ed41 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 21:41:38 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-39bc1734-de3a-4db4-aee7-ab5da5d1ed41 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Got 1 possible topologies {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 21:41:38 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-39bc1734-de3a-4db4-aee7-ab5da5d1ed41 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 21:41:38 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-39bc1734-de3a-4db4-aee7-ab5da5d1ed41 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 21:41:38 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-39bc1734-de3a-4db4-aee7-ab5da5d1ed41 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:41:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-902939246',display_name='tempest-ServersNegativeTestJSON-server-902939246',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-902939246',id=19,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83700495146c4b0e8d76491380b5f895',ramdisk_id='',reservation_id='r-ydazf46w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-2018044743',owner_user_name='tempest-ServersNegativeTestJSON-2018044743-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:41:33Z,user_data=None,user_id='c11f9fb1ab7c411fa9069976c4419bbf',uuid=749a62c2-7517-4f57-9ba2-b139fe73c4e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "33efeffb-9f5f-4b9f-a930-1e718e1624f1", "address": "fa:16:3e:a7:95:34", "network": {"id": "3d6e3d17-6da2-4ac1-ab9f-b7ed54db79bc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1078020443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83700495146c4b0e8d76491380b5f895", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33efeffb-9f", "ovs_interfaceid": "33efeffb-9f5f-4b9f-a930-1e718e1624f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 21:41:38 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-39bc1734-de3a-4db4-aee7-ab5da5d1ed41 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Converting VIF {"id": "33efeffb-9f5f-4b9f-a930-1e718e1624f1", "address": "fa:16:3e:a7:95:34", "network": {"id": "3d6e3d17-6da2-4ac1-ab9f-b7ed54db79bc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1078020443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83700495146c4b0e8d76491380b5f895", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33efeffb-9f", "ovs_interfaceid": "33efeffb-9f5f-4b9f-a930-1e718e1624f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:41:38 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-39bc1734-de3a-4db4-aee7-ab5da5d1ed41 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:95:34,bridge_name='br-int',has_traffic_filtering=True,id=33efeffb-9f5f-4b9f-a930-1e718e1624f1,network=Network(3d6e3d17-6da2-4ac1-ab9f-b7ed54db79bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33efeffb-9f') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:41:38 user nova-compute[74337]: DEBUG nova.objects.instance [None req-39bc1734-de3a-4db4-aee7-ab5da5d1ed41 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Lazy-loading 'pci_devices' on Instance uuid 749a62c2-7517-4f57-9ba2-b139fe73c4e5 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:41:38 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:41:38 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-39bc1734-de3a-4db4-aee7-ab5da5d1ed41 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] [instance: 749a62c2-7517-4f57-9ba2-b139fe73c4e5] End _get_guest_xml xml=<domain type="kvm">
Oct 23 21:41:38 user nova-compute[74337]:   <uuid>749a62c2-7517-4f57-9ba2-b139fe73c4e5</uuid>
Oct 23 21:41:38 user nova-compute[74337]:   <name>instance-00000013</name>
Oct 23 21:41:38 user nova-compute[74337]:   <memory>524288</memory>
Oct 23 21:41:38 user nova-compute[74337]:   <vcpu>1</vcpu>
Oct 23 21:41:38 user nova-compute[74337]:   <metadata>
Oct 23 21:41:38 user nova-compute[74337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 21:41:38 user nova-compute[74337]:       <nova:package version="0.0.0"/>
Oct 23 21:41:38 user nova-compute[74337]:       <nova:name>tempest-ServersNegativeTestJSON-server-902939246</nova:name>
Oct 23 21:41:38 user nova-compute[74337]:       <nova:creationTime>2023-10-23 21:41:38</nova:creationTime>
Oct 23 21:41:38 user nova-compute[74337]:       <nova:flavor name="m1.tiny">
Oct 23 21:41:38 user nova-compute[74337]:         <nova:memory>512</nova:memory>
Oct 23 21:41:38 user nova-compute[74337]:         <nova:disk>1</nova:disk>
Oct 23 21:41:38 user nova-compute[74337]:         <nova:swap>0</nova:swap>
Oct 23 21:41:38 user nova-compute[74337]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 21:41:38 user nova-compute[74337]:         <nova:vcpus>1</nova:vcpus>
Oct 23 21:41:38 user nova-compute[74337]:       </nova:flavor>
Oct 23 21:41:38 user nova-compute[74337]:       <nova:owner>
Oct 23 21:41:38 user nova-compute[74337]:         <nova:user uuid="c11f9fb1ab7c411fa9069976c4419bbf">tempest-ServersNegativeTestJSON-2018044743-project-member</nova:user>
Oct 23 21:41:38 user nova-compute[74337]:         <nova:project uuid="83700495146c4b0e8d76491380b5f895">tempest-ServersNegativeTestJSON-2018044743</nova:project>
Oct 23 21:41:38 user nova-compute[74337]:       </nova:owner>
Oct 23 21:41:38 user nova-compute[74337]:       <nova:root type="image" uuid="d859d89d-998d-4109-b26a-0d6e28152932"/>
Oct 23 21:41:38 user nova-compute[74337]:       <nova:ports>
Oct 23 21:41:38 user nova-compute[74337]:         <nova:port uuid="33efeffb-9f5f-4b9f-a930-1e718e1624f1">
Oct 23 21:41:38 user nova-compute[74337]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 23 21:41:38 user nova-compute[74337]:         </nova:port>
Oct 23 21:41:38 user nova-compute[74337]:       </nova:ports>
Oct 23 21:41:38 user nova-compute[74337]:     </nova:instance>
Oct 23 21:41:38 user nova-compute[74337]:   </metadata>
Oct 23 21:41:38 user nova-compute[74337]:   <sysinfo type="smbios">
Oct 23 21:41:38 user nova-compute[74337]:     <system>
Oct 23 21:41:38 user nova-compute[74337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 21:41:38 user nova-compute[74337]:       <entry name="product">OpenStack Nova</entry>
Oct 23 21:41:38 user nova-compute[74337]:       <entry name="version">0.0.0</entry>
Oct 23 21:41:38 user nova-compute[74337]:       <entry name="serial">749a62c2-7517-4f57-9ba2-b139fe73c4e5</entry>
Oct 23 21:41:38 user nova-compute[74337]:       <entry name="uuid">749a62c2-7517-4f57-9ba2-b139fe73c4e5</entry>
Oct 23 21:41:38 user nova-compute[74337]:       <entry name="family">Virtual Machine</entry>
Oct 23 21:41:38 user nova-compute[74337]:     </system>
Oct 23 21:41:38 user nova-compute[74337]:   </sysinfo>
Oct 23 21:41:38 user nova-compute[74337]:   <os>
Oct 23 21:41:38 user nova-compute[74337]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 21:41:38 user nova-compute[74337]:     <boot dev="hd"/>
Oct 23 21:41:38 user nova-compute[74337]:     <smbios mode="sysinfo"/>
Oct 23 21:41:38 user nova-compute[74337]:   </os>
Oct 23 21:41:38 user nova-compute[74337]:   <features>
Oct 23 21:41:38 user nova-compute[74337]:     <acpi/>
Oct 23 21:41:38 user nova-compute[74337]:     <apic/>
Oct 23 21:41:38 user nova-compute[74337]:     <vmcoreinfo/>
Oct 23 21:41:38 user nova-compute[74337]:   </features>
Oct 23 21:41:38 user nova-compute[74337]:   <clock offset="utc">
Oct 23 21:41:38 user nova-compute[74337]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 21:41:38 user nova-compute[74337]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 21:41:38 user nova-compute[74337]:     <timer name="hpet" present="no"/>
Oct 23 21:41:38 user nova-compute[74337]:   </clock>
Oct 23 21:41:38 user nova-compute[74337]:   <cpu mode="custom" match="exact">
Oct 23 21:41:38 user nova-compute[74337]:     <model>Nehalem</model>
Oct 23 21:41:38 user nova-compute[74337]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 21:41:38 user nova-compute[74337]:   </cpu>
Oct 23 21:41:38 user nova-compute[74337]:   <devices>
Oct 23 21:41:38 user nova-compute[74337]:     <disk type="file" device="disk">
Oct 23 21:41:38 user nova-compute[74337]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 21:41:38 user nova-compute[74337]:       <source file="/opt/stack/data/nova/instances/749a62c2-7517-4f57-9ba2-b139fe73c4e5/disk"/>
Oct 23 21:41:38 user nova-compute[74337]:       <target dev="vda" bus="virtio"/>
Oct 23 21:41:38 user nova-compute[74337]:     </disk>
Oct 23 21:41:38 user nova-compute[74337]:     <interface type="ethernet">
Oct 23 21:41:38 user nova-compute[74337]:       <mac address="fa:16:3e:a7:95:34"/>
Oct 23 21:41:38 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:41:38 user nova-compute[74337]:       <mtu size="1442"/>
Oct 23 21:41:38 user nova-compute[74337]:       <target dev="tap33efeffb-9f"/>
Oct 23 21:41:38 user nova-compute[74337]:     </interface>
Oct 23 21:41:38 user nova-compute[74337]:     <serial type="pty">
Oct 23 21:41:38 user nova-compute[74337]:       <log file="/opt/stack/data/nova/instances/749a62c2-7517-4f57-9ba2-b139fe73c4e5/console.log" append="off"/>
Oct 23 21:41:38 user nova-compute[74337]:     </serial>
Oct 23 21:41:38 user nova-compute[74337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 21:41:38 user nova-compute[74337]:     <video>
Oct 23 21:41:38 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:41:38 user nova-compute[74337]:     </video>
Oct 23 21:41:38 user nova-compute[74337]:     <rng model="virtio">
Oct 23 21:41:38 user nova-compute[74337]:       <backend model="random">/dev/urandom</backend>
Oct 23 21:41:38 user nova-compute[74337]:     </rng>
Oct 23 21:41:38 user nova-compute[74337]:     <controller type="usb" index="0" model="none"/>
Oct 23 21:41:38 user nova-compute[74337]:     <memballoon model="virtio">
Oct 23 21:41:38 user nova-compute[74337]:       <stats period="10"/>
Oct 23 21:41:38 user nova-compute[74337]:     </memballoon>
Oct 23 21:41:38 user nova-compute[74337]:   </devices>
Oct 23 21:41:38 user nova-compute[74337]: </domain>
Oct 23 21:41:38 user nova-compute[74337]:  {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 21:41:38 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-39bc1734-de3a-4db4-aee7-ab5da5d1ed41 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:41:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-902939246',display_name='tempest-ServersNegativeTestJSON-server-902939246',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-902939246',id=19,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83700495146c4b0e8d76491380b5f895',ramdisk_id='',reservation_id='r-ydazf46w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-2018044743',owner_user_name='tempest-ServersNegativeTestJSON-2018044743-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:41:33Z,user_data=None,user_id='c11f9fb1ab7c411fa9069976c4419bbf',uuid=749a62c2-7517-4f57-9ba2-b139fe73c4e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "33efeffb-9f5f-4b9f-a930-1e718e1624f1", "address": "fa:16:3e:a7:95:34", "network": {"id": "3d6e3d17-6da2-4ac1-ab9f-b7ed54db79bc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1078020443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83700495146c4b0e8d76491380b5f895", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33efeffb-9f", "ovs_interfaceid": "33efeffb-9f5f-4b9f-a930-1e718e1624f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 21:41:38 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-39bc1734-de3a-4db4-aee7-ab5da5d1ed41 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Converting VIF {"id": "33efeffb-9f5f-4b9f-a930-1e718e1624f1", "address": "fa:16:3e:a7:95:34", "network": {"id": "3d6e3d17-6da2-4ac1-ab9f-b7ed54db79bc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1078020443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83700495146c4b0e8d76491380b5f895", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33efeffb-9f", "ovs_interfaceid": "33efeffb-9f5f-4b9f-a930-1e718e1624f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:41:38 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-39bc1734-de3a-4db4-aee7-ab5da5d1ed41 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:95:34,bridge_name='br-int',has_traffic_filtering=True,id=33efeffb-9f5f-4b9f-a930-1e718e1624f1,network=Network(3d6e3d17-6da2-4ac1-ab9f-b7ed54db79bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33efeffb-9f') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:41:38 user nova-compute[74337]: DEBUG os_vif [None req-39bc1734-de3a-4db4-aee7-ab5da5d1ed41 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:95:34,bridge_name='br-int',has_traffic_filtering=True,id=33efeffb-9f5f-4b9f-a930-1e718e1624f1,network=Network(3d6e3d17-6da2-4ac1-ab9f-b7ed54db79bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33efeffb-9f') {{(pid=74337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 21:41:38 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:41:38 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:41:38 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 21:41:38 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:41:38 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '379a9a1c-969a-5f54-b1df-929abea13688', '_type': 'linux-noop'}}, row=False) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:41:38 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:41:38 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:41:38 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:41:38 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:41:38 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap33efeffb-9f, may_exist=True, interface_attrs={}) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:41:38 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap33efeffb-9f, col_values=(('qos', UUID('2bd88364-a9d4-4dd2-9f42-fa76cb8c0019')),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:41:38 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap33efeffb-9f, col_values=(('external_ids', {'iface-id': '33efeffb-9f5f-4b9f-a930-1e718e1624f1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a7:95:34', 'vm-uuid': '749a62c2-7517-4f57-9ba2-b139fe73c4e5'}),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:41:38 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:41:38 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:41:38 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:41:38 user nova-compute[74337]: INFO os_vif [None req-39bc1734-de3a-4db4-aee7-ab5da5d1ed41 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:95:34,bridge_name='br-int',has_traffic_filtering=True,id=33efeffb-9f5f-4b9f-a930-1e718e1624f1,network=Network(3d6e3d17-6da2-4ac1-ab9f-b7ed54db79bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33efeffb-9f')
Oct 23 21:41:38 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-39bc1734-de3a-4db4-aee7-ab5da5d1ed41 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] No BDM found with device name vda, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 21:41:38 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-39bc1734-de3a-4db4-aee7-ab5da5d1ed41 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] No VIF found with MAC fa:16:3e:a7:95:34, not building metadata {{(pid=74337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 21:41:38 user nova-compute[74337]: DEBUG nova.compute.manager [req-b15bcc48-b9ef-4d2d-a61e-f8010eceffbc req-0a37c8b5-f2de-4fc4-9f98-66422c268bea service nova] [instance: 749a62c2-7517-4f57-9ba2-b139fe73c4e5] Received event network-changed-33efeffb-9f5f-4b9f-a930-1e718e1624f1 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:41:38 user nova-compute[74337]: DEBUG nova.compute.manager [req-b15bcc48-b9ef-4d2d-a61e-f8010eceffbc req-0a37c8b5-f2de-4fc4-9f98-66422c268bea service nova] [instance: 749a62c2-7517-4f57-9ba2-b139fe73c4e5] Refreshing instance network info cache due to event network-changed-33efeffb-9f5f-4b9f-a930-1e718e1624f1. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 21:41:38 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-b15bcc48-b9ef-4d2d-a61e-f8010eceffbc req-0a37c8b5-f2de-4fc4-9f98-66422c268bea service nova] Acquiring lock "refresh_cache-749a62c2-7517-4f57-9ba2-b139fe73c4e5" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:41:38 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-b15bcc48-b9ef-4d2d-a61e-f8010eceffbc req-0a37c8b5-f2de-4fc4-9f98-66422c268bea service nova] Acquired lock "refresh_cache-749a62c2-7517-4f57-9ba2-b139fe73c4e5" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:41:38 user nova-compute[74337]: DEBUG nova.network.neutron [req-b15bcc48-b9ef-4d2d-a61e-f8010eceffbc req-0a37c8b5-f2de-4fc4-9f98-66422c268bea service nova] [instance: 749a62c2-7517-4f57-9ba2-b139fe73c4e5] Refreshing network info cache for port 33efeffb-9f5f-4b9f-a930-1e718e1624f1 {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 21:41:39 user nova-compute[74337]: DEBUG nova.network.neutron [req-b15bcc48-b9ef-4d2d-a61e-f8010eceffbc req-0a37c8b5-f2de-4fc4-9f98-66422c268bea service nova] [instance: 749a62c2-7517-4f57-9ba2-b139fe73c4e5] Updated VIF entry in instance network info cache for port 33efeffb-9f5f-4b9f-a930-1e718e1624f1. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 21:41:39 user nova-compute[74337]: DEBUG nova.network.neutron [req-b15bcc48-b9ef-4d2d-a61e-f8010eceffbc req-0a37c8b5-f2de-4fc4-9f98-66422c268bea service nova] [instance: 749a62c2-7517-4f57-9ba2-b139fe73c4e5] Updating instance_info_cache with network_info: [{"id": "33efeffb-9f5f-4b9f-a930-1e718e1624f1", "address": "fa:16:3e:a7:95:34", "network": {"id": "3d6e3d17-6da2-4ac1-ab9f-b7ed54db79bc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1078020443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83700495146c4b0e8d76491380b5f895", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33efeffb-9f", "ovs_interfaceid": "33efeffb-9f5f-4b9f-a930-1e718e1624f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:41:39 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-b15bcc48-b9ef-4d2d-a61e-f8010eceffbc req-0a37c8b5-f2de-4fc4-9f98-66422c268bea service nova] Releasing lock "refresh_cache-749a62c2-7517-4f57-9ba2-b139fe73c4e5" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:41:39 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:41:39 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:41:39 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:41:39 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:41:39 user nova-compute[74337]: DEBUG nova.compute.manager [req-81246bbb-8601-44bc-8601-39787aee25af req-78e3a1ce-fc5d-4e23-912a-9c4785c291ae service nova] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Received event network-vif-plugged-5df71ce2-a116-44b3-856b-c0de0da5dcd6 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:41:39 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-81246bbb-8601-44bc-8601-39787aee25af req-78e3a1ce-fc5d-4e23-912a-9c4785c291ae service nova] Acquiring lock "56a4b932-486d-4b8d-9616-99e75592432a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:41:39 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-81246bbb-8601-44bc-8601-39787aee25af req-78e3a1ce-fc5d-4e23-912a-9c4785c291ae service nova] Lock "56a4b932-486d-4b8d-9616-99e75592432a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:41:39 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-81246bbb-8601-44bc-8601-39787aee25af req-78e3a1ce-fc5d-4e23-912a-9c4785c291ae service nova] Lock "56a4b932-486d-4b8d-9616-99e75592432a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:41:39 user nova-compute[74337]: DEBUG nova.compute.manager [req-81246bbb-8601-44bc-8601-39787aee25af req-78e3a1ce-fc5d-4e23-912a-9c4785c291ae service nova] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] No waiting events found dispatching network-vif-plugged-5df71ce2-a116-44b3-856b-c0de0da5dcd6 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:41:39 user nova-compute[74337]: WARNING nova.compute.manager [req-81246bbb-8601-44bc-8601-39787aee25af req-78e3a1ce-fc5d-4e23-912a-9c4785c291ae service nova] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Received unexpected event network-vif-plugged-5df71ce2-a116-44b3-856b-c0de0da5dcd6 for instance with vm_state building and task_state spawning.
Oct 23 21:41:40 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:41:40 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:41:40 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:41:40 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:41:40 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:41:40 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Creating instance directory {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 21:41:40 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Creating image(s)
Oct 23 21:41:40 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Did not create local disks {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 23 21:41:40 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Ensure instance console log exists: /opt/stack/data/nova/instances/2cae5b4d-96a0-41ae-9643-b7bf09581988/console.log {{(pid=74337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 21:41:40 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:41:40 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:41:40 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:41:40 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Start _get_guest_xml network_info=[{"id": "fc418a9a-364a-4e52-a073-58a567680beb", "address": "fa:16:3e:5b:b9:06", "network": {"id": "e3ef8fef-f49d-46a8-b357-1ee41c4a17e4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-952280610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3abafb229d604b65a3fb50f0eebc70ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc418a9a-36", "ovs_interfaceid": "fc418a9a-364a-4e52-a073-58a567680beb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T21:29:21Z,direct_url=<?>,disk_format='qcow2',id=d859d89d-998d-4109-b26a-0d6e28152932,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ff43462300764979a6cf688444336a56',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T21:29:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '03b42117-c451-433d-996c-ce3399e831e3', 'delete_on_termination': True, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aMCXtGKR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2cae5b4d-96a0-41ae-9643-b7bf09581988', 'attached_at': '', 'detached_at': '', 'volume_id': 'f45407b0-0f4c-4120-8ef2-812f51f88f01', 'serial': 'f45407b0-0f4c-4120-8ef2-812f51f88f01'}, 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 21:41:40 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 23 21:41:40 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 23 21:41:40 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 21:41:40 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] CPU controller missing on host. {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 21:41:40 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 21:41:40 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] CPU controller found on host. {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 21:41:40 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 21:41:40 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T21:29:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T21:29:21Z,direct_url=<?>,disk_format='qcow2',id=d859d89d-998d-4109-b26a-0d6e28152932,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ff43462300764979a6cf688444336a56',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T21:29:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 21:41:40 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Flavor limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 21:41:40 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Image limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 21:41:40 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Flavor pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 21:41:40 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Image pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 21:41:40 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 21:41:40 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 21:41:40 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 21:41:40 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Got 1 possible topologies {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 21:41:40 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 21:41:40 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 21:41:40 user nova-compute[74337]: DEBUG nova.objects.instance [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2cae5b4d-96a0-41ae-9643-b7bf09581988 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:41:40 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Calling os-brick to attach iSCSI Volume {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 21:41:40 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aMCXtGKR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:41:40 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 23 21:41:40 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:41:40 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:41:40 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 23 21:41:40 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:41:40 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:41:40 user nova-compute[74337]: INFO os_brick.initiator.connectors.iscsi [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 21:41:40 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01 -p 172.16.0.220:3260 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:41:40 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:41:40 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[da302a0f-718c-4248-bac9-f48c6f4b476f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:41:40 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 21:41:40 user nova-compute[74337]:  {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:41:40 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01 -p 172.16.0.220:3260 --interface default --op new {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:41:40 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:41:40 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[3666b1d8-f911-4f0e-b1c3-dd22ae115d28]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01] added\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:41:40 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01] added
Oct 23 21:41:40 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:41:40 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:41:40 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:41:40 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[7025b868-fb07-49a1-abdc-c95a6a00f2b3]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:41:40 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:41:40 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:41:40 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:41:40 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[959bdd55-0875-4dd1-b9eb-a32b495440be]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:41:40 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:41:40 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aMCXtGKR {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:41:40 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aMCXtGKR" returned: 0 in 0.026s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:41:40 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[87d7bf15-3abe-4282-982e-8cd686c3fd02]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:41:40 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aMCXtGKR'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:41:40 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:41:40 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:41:40 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aff9db8-7c9d-4db3-8f5c-c3ed7c853018]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:41:40 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:41:40 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:41:40 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:41:40 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[2967d982-4179-495f-a99f-2814627000ae]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:41:40 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 (non-flash)
Oct 23 21:41:40 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:41:40 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 (non-flash)
Oct 23 21:41:40 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:41:40 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01 -p 172.16.0.220:3260 --login {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:41:40 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:41:40 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[519db58b-61fd-4b0d-b738-b1396c125c96]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:41:40 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01, portal: 172.16.0.220,3260]
Oct 23 21:41:40 user nova-compute[74337]: Login to [iface: default, target: iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01, portal: 172.16.0.220,3260] successful.
Oct 23 21:41:40 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:41:40 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:41:40 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:41:40 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[9163a034-84b6-4527-aee6-2cb9fac36518]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:41:40 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:41:40 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:41:40 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:41:40 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[529e4561-ef48-4413-aa86-473ed79ce02f]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:41:40 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 (non-flash)
Oct 23 21:41:40 user nova-compute[74337]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01 (non-flash)
Oct 23 21:41:40 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:41:40 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 (non-flash)
Oct 23 21:41:40 user nova-compute[74337]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01 (non-flash)
Oct 23 21:41:40 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:41:40 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.315s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:41:40 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Connected to 172.16.0.220:3260 {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 21:41:40 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] HCTL ('33', '-', '-', 0) found on session 21 with lun 0 {{(pid=74337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 21:41:40 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 21:41:40 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:41:40 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:41:40 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d28c03b9-6c95-4af4-87ab-f04053a3bdda]: (4, ('- - 0', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:41:40 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Searching for a device in session 21 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 21:41:40 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aMCXtGKR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 21:41:41 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:41:41 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:41:41 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:41:41 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:41:41 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:41:41 user nova-compute[74337]: DEBUG nova.compute.manager [req-6c935253-bf96-4f36-a3cb-e93d86736693 req-3c778cea-3b0e-4f45-94db-a66b22f1c7b1 service nova] [instance: 749a62c2-7517-4f57-9ba2-b139fe73c4e5] Received event network-vif-plugged-33efeffb-9f5f-4b9f-a930-1e718e1624f1 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:41:41 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-6c935253-bf96-4f36-a3cb-e93d86736693 req-3c778cea-3b0e-4f45-94db-a66b22f1c7b1 service nova] Acquiring lock "749a62c2-7517-4f57-9ba2-b139fe73c4e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:41:41 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-6c935253-bf96-4f36-a3cb-e93d86736693 req-3c778cea-3b0e-4f45-94db-a66b22f1c7b1 service nova] Lock "749a62c2-7517-4f57-9ba2-b139fe73c4e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:41:41 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-6c935253-bf96-4f36-a3cb-e93d86736693 req-3c778cea-3b0e-4f45-94db-a66b22f1c7b1 service nova] Lock "749a62c2-7517-4f57-9ba2-b139fe73c4e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:41:41 user nova-compute[74337]: DEBUG nova.compute.manager [req-6c935253-bf96-4f36-a3cb-e93d86736693 req-3c778cea-3b0e-4f45-94db-a66b22f1c7b1 service nova] [instance: 749a62c2-7517-4f57-9ba2-b139fe73c4e5] No waiting events found dispatching network-vif-plugged-33efeffb-9f5f-4b9f-a930-1e718e1624f1 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:41:41 user nova-compute[74337]: WARNING nova.compute.manager [req-6c935253-bf96-4f36-a3cb-e93d86736693 req-3c778cea-3b0e-4f45-94db-a66b22f1c7b1 service nova] [instance: 749a62c2-7517-4f57-9ba2-b139fe73c4e5] Received unexpected event network-vif-plugged-33efeffb-9f5f-4b9f-a930-1e718e1624f1 for instance with vm_state building and task_state spawning.
Oct 23 21:41:41 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.357s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:41:41 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] <== connect_volume: return (1359ms) {'type': 'block', 'scsi_wwn': '23263393864326637', 'path': '/dev/sdb'} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:41:41 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23263393864326637', 'path': '/dev/sdb'} {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 21:41:41 user nova-compute[74337]: DEBUG nova.compute.manager [req-12d702a7-e2f9-4c2e-a6f9-a8d8f9c010b5 req-16cfb3eb-856a-4616-b535-2b434d21e6c7 service nova] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Received event network-vif-plugged-5df71ce2-a116-44b3-856b-c0de0da5dcd6 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:41:41 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-12d702a7-e2f9-4c2e-a6f9-a8d8f9c010b5 req-16cfb3eb-856a-4616-b535-2b434d21e6c7 service nova] Acquiring lock "56a4b932-486d-4b8d-9616-99e75592432a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:41:41 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-12d702a7-e2f9-4c2e-a6f9-a8d8f9c010b5 req-16cfb3eb-856a-4616-b535-2b434d21e6c7 service nova] Lock "56a4b932-486d-4b8d-9616-99e75592432a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:41:41 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-12d702a7-e2f9-4c2e-a6f9-a8d8f9c010b5 req-16cfb3eb-856a-4616-b535-2b434d21e6c7 service nova] Lock "56a4b932-486d-4b8d-9616-99e75592432a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:41:41 user nova-compute[74337]: DEBUG nova.compute.manager [req-12d702a7-e2f9-4c2e-a6f9-a8d8f9c010b5 req-16cfb3eb-856a-4616-b535-2b434d21e6c7 service nova] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] No waiting events found dispatching network-vif-plugged-5df71ce2-a116-44b3-856b-c0de0da5dcd6 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:41:41 user nova-compute[74337]: WARNING nova.compute.manager [req-12d702a7-e2f9-4c2e-a6f9-a8d8f9c010b5 req-16cfb3eb-856a-4616-b535-2b434d21e6c7 service nova] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Received unexpected event network-vif-plugged-5df71ce2-a116-44b3-856b-c0de0da5dcd6 for instance with vm_state building and task_state spawning.
Oct 23 21:41:42 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-23T21:38:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1974624614',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1403410720',id=14,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNAij/gN9c1LogESmDyDRUK8aX9TNeBklW1117x1fKgPvWOfbQTMsxbBaU+oDUoFHSZouzNEg8DViCjOAm3WRLHflowTaqyVE9dl6GjV16zXbkR3EGgDaXXdXhXT1FiXhw==',key_name='tempest-keypair-1763181828',keypairs=<?>,launch_index=0,launched_at=2023-10-23T21:39:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3abafb229d604b65a3fb50f0eebc70ae',ramdisk_id='',reservation_id='r-0v9ax80p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1326198598',owner_user_name='tempest-ServerActionsV293TestJSON-1326198598-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:41:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c6d296964f545e78d8bc461d6f28dba',uuid=2cae5b4d-96a0-41ae-9643-b7bf09581988,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fc418a9a-364a-4e52-a073-58a567680beb", "address": "fa:16:3e:5b:b9:06", "network": {"id": "e3ef8fef-f49d-46a8-b357-1ee41c4a17e4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-952280610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3abafb229d604b65a3fb50f0eebc70ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc418a9a-36", "ovs_interfaceid": "fc418a9a-364a-4e52-a073-58a567680beb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 21:41:42 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Converting VIF {"id": "fc418a9a-364a-4e52-a073-58a567680beb", "address": "fa:16:3e:5b:b9:06", "network": {"id": "e3ef8fef-f49d-46a8-b357-1ee41c4a17e4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-952280610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3abafb229d604b65a3fb50f0eebc70ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc418a9a-36", "ovs_interfaceid": "fc418a9a-364a-4e52-a073-58a567680beb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:41:42 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5b:b9:06,bridge_name='br-int',has_traffic_filtering=True,id=fc418a9a-364a-4e52-a073-58a567680beb,network=Network(e3ef8fef-f49d-46a8-b357-1ee41c4a17e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc418a9a-36') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:41:42 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] End _get_guest_xml xml=<domain type="kvm">
Oct 23 21:41:42 user nova-compute[74337]:   <uuid>2cae5b4d-96a0-41ae-9643-b7bf09581988</uuid>
Oct 23 21:41:42 user nova-compute[74337]:   <name>instance-0000000e</name>
Oct 23 21:41:42 user nova-compute[74337]:   <memory>524288</memory>
Oct 23 21:41:42 user nova-compute[74337]:   <vcpu>1</vcpu>
Oct 23 21:41:42 user nova-compute[74337]:   <metadata>
Oct 23 21:41:42 user nova-compute[74337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 21:41:42 user nova-compute[74337]:       <nova:package version="0.0.0"/>
Oct 23 21:41:42 user nova-compute[74337]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1974624614</nova:name>
Oct 23 21:41:42 user nova-compute[74337]:       <nova:creationTime>2023-10-23 21:41:40</nova:creationTime>
Oct 23 21:41:42 user nova-compute[74337]:       <nova:flavor name="m1.tiny">
Oct 23 21:41:42 user nova-compute[74337]:         <nova:memory>512</nova:memory>
Oct 23 21:41:42 user nova-compute[74337]:         <nova:disk>1</nova:disk>
Oct 23 21:41:42 user nova-compute[74337]:         <nova:swap>0</nova:swap>
Oct 23 21:41:42 user nova-compute[74337]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 21:41:42 user nova-compute[74337]:         <nova:vcpus>1</nova:vcpus>
Oct 23 21:41:42 user nova-compute[74337]:       </nova:flavor>
Oct 23 21:41:42 user nova-compute[74337]:       <nova:owner>
Oct 23 21:41:42 user nova-compute[74337]:         <nova:user uuid="1c6d296964f545e78d8bc461d6f28dba">tempest-ServerActionsV293TestJSON-1326198598-project-member</nova:user>
Oct 23 21:41:42 user nova-compute[74337]:         <nova:project uuid="3abafb229d604b65a3fb50f0eebc70ae">tempest-ServerActionsV293TestJSON-1326198598</nova:project>
Oct 23 21:41:42 user nova-compute[74337]:       </nova:owner>
Oct 23 21:41:42 user nova-compute[74337]:       <nova:ports>
Oct 23 21:41:42 user nova-compute[74337]:         <nova:port uuid="fc418a9a-364a-4e52-a073-58a567680beb">
Oct 23 21:41:42 user nova-compute[74337]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 23 21:41:42 user nova-compute[74337]:         </nova:port>
Oct 23 21:41:42 user nova-compute[74337]:       </nova:ports>
Oct 23 21:41:42 user nova-compute[74337]:     </nova:instance>
Oct 23 21:41:42 user nova-compute[74337]:   </metadata>
Oct 23 21:41:42 user nova-compute[74337]:   <sysinfo type="smbios">
Oct 23 21:41:42 user nova-compute[74337]:     <system>
Oct 23 21:41:42 user nova-compute[74337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 21:41:42 user nova-compute[74337]:       <entry name="product">OpenStack Nova</entry>
Oct 23 21:41:42 user nova-compute[74337]:       <entry name="version">0.0.0</entry>
Oct 23 21:41:42 user nova-compute[74337]:       <entry name="serial">2cae5b4d-96a0-41ae-9643-b7bf09581988</entry>
Oct 23 21:41:42 user nova-compute[74337]:       <entry name="uuid">2cae5b4d-96a0-41ae-9643-b7bf09581988</entry>
Oct 23 21:41:42 user nova-compute[74337]:       <entry name="family">Virtual Machine</entry>
Oct 23 21:41:42 user nova-compute[74337]:     </system>
Oct 23 21:41:42 user nova-compute[74337]:   </sysinfo>
Oct 23 21:41:42 user nova-compute[74337]:   <os>
Oct 23 21:41:42 user nova-compute[74337]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 21:41:42 user nova-compute[74337]:     <boot dev="hd"/>
Oct 23 21:41:42 user nova-compute[74337]:     <smbios mode="sysinfo"/>
Oct 23 21:41:42 user nova-compute[74337]:   </os>
Oct 23 21:41:42 user nova-compute[74337]:   <features>
Oct 23 21:41:42 user nova-compute[74337]:     <acpi/>
Oct 23 21:41:42 user nova-compute[74337]:     <apic/>
Oct 23 21:41:42 user nova-compute[74337]:     <vmcoreinfo/>
Oct 23 21:41:42 user nova-compute[74337]:   </features>
Oct 23 21:41:42 user nova-compute[74337]:   <clock offset="utc">
Oct 23 21:41:42 user nova-compute[74337]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 21:41:42 user nova-compute[74337]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 21:41:42 user nova-compute[74337]:     <timer name="hpet" present="no"/>
Oct 23 21:41:42 user nova-compute[74337]:   </clock>
Oct 23 21:41:42 user nova-compute[74337]:   <cpu mode="custom" match="exact">
Oct 23 21:41:42 user nova-compute[74337]:     <model>Nehalem</model>
Oct 23 21:41:42 user nova-compute[74337]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 21:41:42 user nova-compute[74337]:   </cpu>
Oct 23 21:41:42 user nova-compute[74337]:   <devices>
Oct 23 21:41:42 user nova-compute[74337]:     <disk type="block" device="disk">
Oct 23 21:41:42 user nova-compute[74337]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 21:41:42 user nova-compute[74337]:       <source dev="/dev/sdb"/>
Oct 23 21:41:42 user nova-compute[74337]:       <target dev="vda" bus="virtio"/>
Oct 23 21:41:42 user nova-compute[74337]:       <serial>f45407b0-0f4c-4120-8ef2-812f51f88f01</serial>
Oct 23 21:41:42 user nova-compute[74337]:     </disk>
Oct 23 21:41:42 user nova-compute[74337]:     <interface type="ethernet">
Oct 23 21:41:42 user nova-compute[74337]:       <mac address="fa:16:3e:5b:b9:06"/>
Oct 23 21:41:42 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:41:42 user nova-compute[74337]:       <mtu size="1442"/>
Oct 23 21:41:42 user nova-compute[74337]:       <target dev="tapfc418a9a-36"/>
Oct 23 21:41:42 user nova-compute[74337]:     </interface>
Oct 23 21:41:42 user nova-compute[74337]:     <serial type="pty">
Oct 23 21:41:42 user nova-compute[74337]:       <log file="/opt/stack/data/nova/instances/2cae5b4d-96a0-41ae-9643-b7bf09581988/console.log" append="off"/>
Oct 23 21:41:42 user nova-compute[74337]:     </serial>
Oct 23 21:41:42 user nova-compute[74337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 21:41:42 user nova-compute[74337]:     <video>
Oct 23 21:41:42 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:41:42 user nova-compute[74337]:     </video>
Oct 23 21:41:42 user nova-compute[74337]:     <rng model="virtio">
Oct 23 21:41:42 user nova-compute[74337]:       <backend model="random">/dev/urandom</backend>
Oct 23 21:41:42 user nova-compute[74337]:     </rng>
Oct 23 21:41:42 user nova-compute[74337]:     <controller type="usb" index="0" model="none"/>
Oct 23 21:41:42 user nova-compute[74337]:     <memballoon model="virtio">
Oct 23 21:41:42 user nova-compute[74337]:       <stats period="10"/>
Oct 23 21:41:42 user nova-compute[74337]:     </memballoon>
Oct 23 21:41:42 user nova-compute[74337]:   </devices>
Oct 23 21:41:42 user nova-compute[74337]: </domain>
Oct 23 21:41:42 user nova-compute[74337]:  {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 21:41:42 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-23T21:38:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1974624614',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1403410720',id=14,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNAij/gN9c1LogESmDyDRUK8aX9TNeBklW1117x1fKgPvWOfbQTMsxbBaU+oDUoFHSZouzNEg8DViCjOAm3WRLHflowTaqyVE9dl6GjV16zXbkR3EGgDaXXdXhXT1FiXhw==',key_name='tempest-keypair-1763181828',keypairs=<?>,launch_index=0,launched_at=2023-10-23T21:39:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3abafb229d604b65a3fb50f0eebc70ae',ramdisk_id='',reservation_id='r-0v9ax80p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1326198598',owner_user_name='tempest-ServerActionsV293TestJSON-1326198598-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:41:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c6d296964f545e78d8bc461d6f28dba',uuid=2cae5b4d-96a0-41ae-9643-b7bf09581988,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fc418a9a-364a-4e52-a073-58a567680beb", "address": "fa:16:3e:5b:b9:06", "network": {"id": "e3ef8fef-f49d-46a8-b357-1ee41c4a17e4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-952280610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3abafb229d604b65a3fb50f0eebc70ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc418a9a-36", "ovs_interfaceid": "fc418a9a-364a-4e52-a073-58a567680beb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 21:41:42 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Converting VIF {"id": "fc418a9a-364a-4e52-a073-58a567680beb", "address": "fa:16:3e:5b:b9:06", "network": {"id": "e3ef8fef-f49d-46a8-b357-1ee41c4a17e4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-952280610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3abafb229d604b65a3fb50f0eebc70ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc418a9a-36", "ovs_interfaceid": "fc418a9a-364a-4e52-a073-58a567680beb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:41:42 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5b:b9:06,bridge_name='br-int',has_traffic_filtering=True,id=fc418a9a-364a-4e52-a073-58a567680beb,network=Network(e3ef8fef-f49d-46a8-b357-1ee41c4a17e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc418a9a-36') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:41:42 user nova-compute[74337]: DEBUG os_vif [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:b9:06,bridge_name='br-int',has_traffic_filtering=True,id=fc418a9a-364a-4e52-a073-58a567680beb,network=Network(e3ef8fef-f49d-46a8-b357-1ee41c4a17e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc418a9a-36') {{(pid=74337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 21:41:42 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:41:42 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:41:42 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 21:41:42 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:41:42 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '59335597-4f6b-54bc-957c-322c82ee5f40', '_type': 'linux-noop'}}, row=False) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:41:42 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:41:42 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:41:42 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:41:42 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfc418a9a-36, may_exist=True, interface_attrs={}) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:41:42 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfc418a9a-36, col_values=(('qos', UUID('0b238c75-b53f-474e-bbfc-11a6b73ab8bb')),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:41:42 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfc418a9a-36, col_values=(('external_ids', {'iface-id': 'fc418a9a-364a-4e52-a073-58a567680beb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:b9:06', 'vm-uuid': '2cae5b4d-96a0-41ae-9643-b7bf09581988'}),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:41:42 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:41:42 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:41:42 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:41:42 user nova-compute[74337]: INFO os_vif [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:b9:06,bridge_name='br-int',has_traffic_filtering=True,id=fc418a9a-364a-4e52-a073-58a567680beb,network=Network(e3ef8fef-f49d-46a8-b357-1ee41c4a17e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc418a9a-36')
Oct 23 21:41:42 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] No BDM found with device name vda, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 21:41:42 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] No VIF found with MAC fa:16:3e:5b:b9:06, not building metadata {{(pid=74337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 21:41:43 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:41:43 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:41:43 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:41:43 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:41:43 user nova-compute[74337]: DEBUG nova.compute.manager [None req-6e9b7318-dc9b-4032-a1cb-0b6e7935176a tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Instance event wait completed in 0 seconds for  {{(pid=74337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 21:41:43 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-6e9b7318-dc9b-4032-a1cb-0b6e7935176a tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Guest created on hypervisor {{(pid=74337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 21:41:43 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Instance spawned successfully.
Oct 23 21:41:43 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-6e9b7318-dc9b-4032-a1cb-0b6e7935176a tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 21:41:43 user nova-compute[74337]: DEBUG nova.compute.manager [req-9242a9ae-6ee5-4d05-abc7-47a6bb2fe433 req-d68e38a0-630b-44db-95c9-cceea7780248 service nova] [instance: 749a62c2-7517-4f57-9ba2-b139fe73c4e5] Received event network-vif-plugged-33efeffb-9f5f-4b9f-a930-1e718e1624f1 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:41:43 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-9242a9ae-6ee5-4d05-abc7-47a6bb2fe433 req-d68e38a0-630b-44db-95c9-cceea7780248 service nova] Acquiring lock "749a62c2-7517-4f57-9ba2-b139fe73c4e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:41:43 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-9242a9ae-6ee5-4d05-abc7-47a6bb2fe433 req-d68e38a0-630b-44db-95c9-cceea7780248 service nova] Lock "749a62c2-7517-4f57-9ba2-b139fe73c4e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:41:43 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-9242a9ae-6ee5-4d05-abc7-47a6bb2fe433 req-d68e38a0-630b-44db-95c9-cceea7780248 service nova] Lock "749a62c2-7517-4f57-9ba2-b139fe73c4e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:41:43 user nova-compute[74337]: DEBUG nova.compute.manager [req-9242a9ae-6ee5-4d05-abc7-47a6bb2fe433 req-d68e38a0-630b-44db-95c9-cceea7780248 service nova] [instance: 749a62c2-7517-4f57-9ba2-b139fe73c4e5] No waiting events found dispatching network-vif-plugged-33efeffb-9f5f-4b9f-a930-1e718e1624f1 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:41:43 user nova-compute[74337]: WARNING nova.compute.manager [req-9242a9ae-6ee5-4d05-abc7-47a6bb2fe433 req-d68e38a0-630b-44db-95c9-cceea7780248 service nova] [instance: 749a62c2-7517-4f57-9ba2-b139fe73c4e5] Received unexpected event network-vif-plugged-33efeffb-9f5f-4b9f-a930-1e718e1624f1 for instance with vm_state building and task_state spawning.
Oct 23 21:41:43 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-6e9b7318-dc9b-4032-a1cb-0b6e7935176a tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Found default for hw_cdrom_bus of ide {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:41:43 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-6e9b7318-dc9b-4032-a1cb-0b6e7935176a tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Found default for hw_disk_bus of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:41:43 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-6e9b7318-dc9b-4032-a1cb-0b6e7935176a tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Found default for hw_input_bus of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:41:43 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-6e9b7318-dc9b-4032-a1cb-0b6e7935176a tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Found default for hw_pointer_model of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:41:43 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-6e9b7318-dc9b-4032-a1cb-0b6e7935176a tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Found default for hw_video_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:41:43 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-6e9b7318-dc9b-4032-a1cb-0b6e7935176a tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Found default for hw_vif_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:41:43 user nova-compute[74337]: INFO nova.compute.manager [None req-6e9b7318-dc9b-4032-a1cb-0b6e7935176a tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Took 11.53 seconds to spawn the instance on the hypervisor.
Oct 23 21:41:43 user nova-compute[74337]: DEBUG nova.compute.manager [None req-6e9b7318-dc9b-4032-a1cb-0b6e7935176a tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Checking state {{(pid=74337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 21:41:43 user nova-compute[74337]: DEBUG nova.compute.manager [None req-39bc1734-de3a-4db4-aee7-ab5da5d1ed41 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] [instance: 749a62c2-7517-4f57-9ba2-b139fe73c4e5] Instance event wait completed in 0 seconds for  {{(pid=74337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 21:41:43 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-39bc1734-de3a-4db4-aee7-ab5da5d1ed41 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] [instance: 749a62c2-7517-4f57-9ba2-b139fe73c4e5] Guest created on hypervisor {{(pid=74337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 21:41:43 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: 749a62c2-7517-4f57-9ba2-b139fe73c4e5] Instance spawned successfully.
Oct 23 21:41:43 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-39bc1734-de3a-4db4-aee7-ab5da5d1ed41 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] [instance: 749a62c2-7517-4f57-9ba2-b139fe73c4e5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 21:41:43 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-39bc1734-de3a-4db4-aee7-ab5da5d1ed41 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] [instance: 749a62c2-7517-4f57-9ba2-b139fe73c4e5] Found default for hw_cdrom_bus of ide {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:41:43 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-39bc1734-de3a-4db4-aee7-ab5da5d1ed41 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] [instance: 749a62c2-7517-4f57-9ba2-b139fe73c4e5] Found default for hw_disk_bus of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:41:43 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-39bc1734-de3a-4db4-aee7-ab5da5d1ed41 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] [instance: 749a62c2-7517-4f57-9ba2-b139fe73c4e5] Found default for hw_input_bus of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:41:43 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-39bc1734-de3a-4db4-aee7-ab5da5d1ed41 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] [instance: 749a62c2-7517-4f57-9ba2-b139fe73c4e5] Found default for hw_pointer_model of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:41:43 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-39bc1734-de3a-4db4-aee7-ab5da5d1ed41 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] [instance: 749a62c2-7517-4f57-9ba2-b139fe73c4e5] Found default for hw_video_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:41:43 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-39bc1734-de3a-4db4-aee7-ab5da5d1ed41 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] [instance: 749a62c2-7517-4f57-9ba2-b139fe73c4e5] Found default for hw_vif_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:41:43 user nova-compute[74337]: INFO nova.compute.manager [None req-6e9b7318-dc9b-4032-a1cb-0b6e7935176a tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Took 12.42 seconds to build instance.
Oct 23 21:41:43 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-6e9b7318-dc9b-4032-a1cb-0b6e7935176a tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lock "56a4b932-486d-4b8d-9616-99e75592432a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.614s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:41:44 user nova-compute[74337]: INFO nova.compute.manager [None req-39bc1734-de3a-4db4-aee7-ab5da5d1ed41 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] [instance: 749a62c2-7517-4f57-9ba2-b139fe73c4e5] Took 10.46 seconds to spawn the instance on the hypervisor.
Oct 23 21:41:44 user nova-compute[74337]: DEBUG nova.compute.manager [None req-39bc1734-de3a-4db4-aee7-ab5da5d1ed41 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] [instance: 749a62c2-7517-4f57-9ba2-b139fe73c4e5] Checking state {{(pid=74337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 21:41:44 user nova-compute[74337]: DEBUG nova.compute.manager [req-bdf297ca-9938-4d6a-8e35-6062ee69e0b7 req-67122bef-aceb-4745-9d93-aa673c5f8a34 service nova] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Received event network-vif-plugged-fc418a9a-364a-4e52-a073-58a567680beb {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:41:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-bdf297ca-9938-4d6a-8e35-6062ee69e0b7 req-67122bef-aceb-4745-9d93-aa673c5f8a34 service nova] Acquiring lock "2cae5b4d-96a0-41ae-9643-b7bf09581988-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:41:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-bdf297ca-9938-4d6a-8e35-6062ee69e0b7 req-67122bef-aceb-4745-9d93-aa673c5f8a34 service nova] Lock "2cae5b4d-96a0-41ae-9643-b7bf09581988-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:41:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-bdf297ca-9938-4d6a-8e35-6062ee69e0b7 req-67122bef-aceb-4745-9d93-aa673c5f8a34 service nova] Lock "2cae5b4d-96a0-41ae-9643-b7bf09581988-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:41:44 user nova-compute[74337]: DEBUG nova.compute.manager [req-bdf297ca-9938-4d6a-8e35-6062ee69e0b7 req-67122bef-aceb-4745-9d93-aa673c5f8a34 service nova] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] No waiting events found dispatching network-vif-plugged-fc418a9a-364a-4e52-a073-58a567680beb {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:41:44 user nova-compute[74337]: WARNING nova.compute.manager [req-bdf297ca-9938-4d6a-8e35-6062ee69e0b7 req-67122bef-aceb-4745-9d93-aa673c5f8a34 service nova] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Received unexpected event network-vif-plugged-fc418a9a-364a-4e52-a073-58a567680beb for instance with vm_state active and task_state rebuild_spawning.
Oct 23 21:41:44 user nova-compute[74337]: INFO nova.compute.manager [None req-39bc1734-de3a-4db4-aee7-ab5da5d1ed41 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] [instance: 749a62c2-7517-4f57-9ba2-b139fe73c4e5] Took 11.63 seconds to build instance.
Oct 23 21:41:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-39bc1734-de3a-4db4-aee7-ab5da5d1ed41 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Lock "749a62c2-7517-4f57-9ba2-b139fe73c4e5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.850s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:41:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:41:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:41:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:41:46 user nova-compute[74337]: DEBUG nova.compute.manager [req-2e39f030-31cf-4820-842b-1b20e9f75b27 req-737e2ced-7500-4b9d-91c8-d018b5ec2123 service nova] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Received event network-vif-plugged-fc418a9a-364a-4e52-a073-58a567680beb {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:41:46 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-2e39f030-31cf-4820-842b-1b20e9f75b27 req-737e2ced-7500-4b9d-91c8-d018b5ec2123 service nova] Acquiring lock "2cae5b4d-96a0-41ae-9643-b7bf09581988-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:41:46 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-2e39f030-31cf-4820-842b-1b20e9f75b27 req-737e2ced-7500-4b9d-91c8-d018b5ec2123 service nova] Lock "2cae5b4d-96a0-41ae-9643-b7bf09581988-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:41:46 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-2e39f030-31cf-4820-842b-1b20e9f75b27 req-737e2ced-7500-4b9d-91c8-d018b5ec2123 service nova] Lock "2cae5b4d-96a0-41ae-9643-b7bf09581988-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:41:46 user nova-compute[74337]: DEBUG nova.compute.manager [req-2e39f030-31cf-4820-842b-1b20e9f75b27 req-737e2ced-7500-4b9d-91c8-d018b5ec2123 service nova] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] No waiting events found dispatching network-vif-plugged-fc418a9a-364a-4e52-a073-58a567680beb {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:41:46 user nova-compute[74337]: WARNING nova.compute.manager [req-2e39f030-31cf-4820-842b-1b20e9f75b27 req-737e2ced-7500-4b9d-91c8-d018b5ec2123 service nova] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Received unexpected event network-vif-plugged-fc418a9a-364a-4e52-a073-58a567680beb for instance with vm_state active and task_state rebuild_spawning.
Oct 23 21:41:46 user nova-compute[74337]: DEBUG nova.compute.manager [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Instance event wait completed in 0 seconds for  {{(pid=74337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 21:41:46 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Guest created on hypervisor {{(pid=74337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 21:41:46 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Instance spawned successfully.
Oct 23 21:41:46 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 21:41:46 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Found default for hw_cdrom_bus of ide {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:41:46 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Found default for hw_disk_bus of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:41:46 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Found default for hw_input_bus of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:41:46 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Found default for hw_pointer_model of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:41:46 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Found default for hw_video_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:41:46 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Found default for hw_vif_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:41:46 user nova-compute[74337]: DEBUG nova.compute.manager [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Checking state {{(pid=74337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 21:41:46 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:41:46 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:41:46 user nova-compute[74337]: DEBUG nova.objects.instance [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74337) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1078}}
Oct 23 21:41:46 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-afee949c-fbd4-43e7-ae0e-473b369bf16a tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.149s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:41:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:41:48 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:41:48 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:41:49 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Acquiring lock "c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:41:49 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lock "c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:41:49 user nova-compute[74337]: DEBUG nova.compute.manager [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] Starting instance... {{(pid=74337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 21:41:50 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:41:50 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:41:50 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 21:41:50 user nova-compute[74337]: INFO nova.compute.claims [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] Claim successful on node user
Oct 23 21:41:50 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:41:50 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:41:50 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.565s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:41:50 user nova-compute[74337]: DEBUG nova.compute.manager [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] Start building networks asynchronously for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 21:41:50 user nova-compute[74337]: DEBUG nova.compute.manager [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] Allocating IP information in the background. {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 21:41:50 user nova-compute[74337]: DEBUG nova.network.neutron [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] allocate_for_instance() {{(pid=74337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 21:41:50 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 21:41:50 user nova-compute[74337]: DEBUG nova.compute.manager [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] Start building block device mappings for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 21:41:50 user nova-compute[74337]: INFO nova.virt.block_device [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] Booting with blank volume at /dev/vda
Oct 23 21:41:50 user nova-compute[74337]: DEBUG nova.policy [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a2e424dd3c684c808de14c2a9c3c1ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b85c4f783a4ee7ab67422b49da85ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74337) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 21:41:51 user nova-compute[74337]: DEBUG nova.network.neutron [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] Successfully created port: 328722f1-b384-495c-8aea-81780b2d9ca1 {{(pid=74337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 21:41:52 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:41:52 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-bf89be4d-be48-4f59-9a98-d64cd32530a7 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Acquiring lock "01d407b0-a7cf-4222-9f2d-54b99eeeed84" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:41:52 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-bf89be4d-be48-4f59-9a98-d64cd32530a7 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lock "01d407b0-a7cf-4222-9f2d-54b99eeeed84" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:41:52 user nova-compute[74337]: DEBUG nova.compute.manager [None req-bf89be4d-be48-4f59-9a98-d64cd32530a7 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 01d407b0-a7cf-4222-9f2d-54b99eeeed84] Starting instance... {{(pid=74337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 21:41:52 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-bf89be4d-be48-4f59-9a98-d64cd32530a7 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:41:52 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-bf89be4d-be48-4f59-9a98-d64cd32530a7 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.014s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:41:52 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-bf89be4d-be48-4f59-9a98-d64cd32530a7 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 21:41:52 user nova-compute[74337]: INFO nova.compute.claims [None req-bf89be4d-be48-4f59-9a98-d64cd32530a7 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 01d407b0-a7cf-4222-9f2d-54b99eeeed84] Claim successful on node user
Oct 23 21:41:52 user nova-compute[74337]: DEBUG nova.network.neutron [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] Successfully updated port: 328722f1-b384-495c-8aea-81780b2d9ca1 {{(pid=74337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 21:41:52 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Acquiring lock "refresh_cache-c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:41:52 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Acquired lock "refresh_cache-c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:41:52 user nova-compute[74337]: DEBUG nova.network.neutron [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] Building network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 21:41:52 user nova-compute[74337]: DEBUG nova.compute.manager [req-e41dae36-4092-4eeb-8334-8504a71b4748 req-ee279ae4-14e5-4223-be09-043b8f19f210 service nova] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] Received event network-changed-328722f1-b384-495c-8aea-81780b2d9ca1 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:41:52 user nova-compute[74337]: DEBUG nova.compute.manager [req-e41dae36-4092-4eeb-8334-8504a71b4748 req-ee279ae4-14e5-4223-be09-043b8f19f210 service nova] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] Refreshing instance network info cache due to event network-changed-328722f1-b384-495c-8aea-81780b2d9ca1. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 21:41:52 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-e41dae36-4092-4eeb-8334-8504a71b4748 req-ee279ae4-14e5-4223-be09-043b8f19f210 service nova] Acquiring lock "refresh_cache-c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:41:52 user nova-compute[74337]: DEBUG nova.network.neutron [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] Instance cache missing network info. {{(pid=74337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 21:41:52 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-bf89be4d-be48-4f59-9a98-d64cd32530a7 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:41:52 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-bf89be4d-be48-4f59-9a98-d64cd32530a7 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:41:52 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-bf89be4d-be48-4f59-9a98-d64cd32530a7 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.576s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:41:52 user nova-compute[74337]: DEBUG nova.compute.manager [None req-bf89be4d-be48-4f59-9a98-d64cd32530a7 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 01d407b0-a7cf-4222-9f2d-54b99eeeed84] Start building networks asynchronously for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 21:41:52 user nova-compute[74337]: DEBUG nova.network.neutron [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] Updating instance_info_cache with network_info: [{"id": "328722f1-b384-495c-8aea-81780b2d9ca1", "address": "fa:16:3e:28:35:83", "network": {"id": "5f62b1d8-d5d0-4ff9-922b-fc6e72fb640d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-655282105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b85c4f783a4ee7ab67422b49da85ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap328722f1-b3", "ovs_interfaceid": "328722f1-b384-495c-8aea-81780b2d9ca1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:41:52 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Releasing lock "refresh_cache-c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:41:52 user nova-compute[74337]: DEBUG nova.compute.manager [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] Instance network_info: |[{"id": "328722f1-b384-495c-8aea-81780b2d9ca1", "address": "fa:16:3e:28:35:83", "network": {"id": "5f62b1d8-d5d0-4ff9-922b-fc6e72fb640d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-655282105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b85c4f783a4ee7ab67422b49da85ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap328722f1-b3", "ovs_interfaceid": "328722f1-b384-495c-8aea-81780b2d9ca1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 21:41:53 user nova-compute[74337]: DEBUG nova.compute.manager [None req-bf89be4d-be48-4f59-9a98-d64cd32530a7 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 01d407b0-a7cf-4222-9f2d-54b99eeeed84] Allocating IP information in the background. {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 21:41:53 user nova-compute[74337]: DEBUG nova.network.neutron [None req-bf89be4d-be48-4f59-9a98-d64cd32530a7 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 01d407b0-a7cf-4222-9f2d-54b99eeeed84] allocate_for_instance() {{(pid=74337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 21:41:53 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-e41dae36-4092-4eeb-8334-8504a71b4748 req-ee279ae4-14e5-4223-be09-043b8f19f210 service nova] Acquired lock "refresh_cache-c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:41:53 user nova-compute[74337]: DEBUG nova.network.neutron [req-e41dae36-4092-4eeb-8334-8504a71b4748 req-ee279ae4-14e5-4223-be09-043b8f19f210 service nova] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] Refreshing network info cache for port 328722f1-b384-495c-8aea-81780b2d9ca1 {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 21:41:53 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-bf89be4d-be48-4f59-9a98-d64cd32530a7 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 01d407b0-a7cf-4222-9f2d-54b99eeeed84] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 21:41:53 user nova-compute[74337]: DEBUG nova.compute.manager [None req-bf89be4d-be48-4f59-9a98-d64cd32530a7 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 01d407b0-a7cf-4222-9f2d-54b99eeeed84] Start building block device mappings for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 21:41:53 user nova-compute[74337]: DEBUG nova.policy [None req-bf89be4d-be48-4f59-9a98-d64cd32530a7 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6f6daa6653264905a5498e00f184080c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a25b3eed8548a5a324e55b28f26252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74337) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 21:41:53 user nova-compute[74337]: DEBUG nova.compute.manager [None req-bf89be4d-be48-4f59-9a98-d64cd32530a7 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 01d407b0-a7cf-4222-9f2d-54b99eeeed84] Start spawning the instance on the hypervisor. {{(pid=74337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 21:41:53 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-bf89be4d-be48-4f59-9a98-d64cd32530a7 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 01d407b0-a7cf-4222-9f2d-54b99eeeed84] Creating instance directory {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 21:41:53 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-bf89be4d-be48-4f59-9a98-d64cd32530a7 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 01d407b0-a7cf-4222-9f2d-54b99eeeed84] Creating image(s)
Oct 23 21:41:53 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-bf89be4d-be48-4f59-9a98-d64cd32530a7 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Acquiring lock "/opt/stack/data/nova/instances/01d407b0-a7cf-4222-9f2d-54b99eeeed84/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:41:53 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-bf89be4d-be48-4f59-9a98-d64cd32530a7 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lock "/opt/stack/data/nova/instances/01d407b0-a7cf-4222-9f2d-54b99eeeed84/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:41:53 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-bf89be4d-be48-4f59-9a98-d64cd32530a7 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lock "/opt/stack/data/nova/instances/01d407b0-a7cf-4222-9f2d-54b99eeeed84/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:41:53 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-bf89be4d-be48-4f59-9a98-d64cd32530a7 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:41:53 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:41:53 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-bf89be4d-be48-4f59-9a98-d64cd32530a7 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.233s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:41:53 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-bf89be4d-be48-4f59-9a98-d64cd32530a7 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Acquiring lock "fc7b140751b8c385de81623e40fb09ce09374ab7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:41:53 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-bf89be4d-be48-4f59-9a98-d64cd32530a7 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lock "fc7b140751b8c385de81623e40fb09ce09374ab7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:41:53 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-bf89be4d-be48-4f59-9a98-d64cd32530a7 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:41:53 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-bf89be4d-be48-4f59-9a98-d64cd32530a7 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.254s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:41:53 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-bf89be4d-be48-4f59-9a98-d64cd32530a7 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7,backing_fmt=raw /opt/stack/data/nova/instances/01d407b0-a7cf-4222-9f2d-54b99eeeed84/disk 1073741824 {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:41:53 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-bf89be4d-be48-4f59-9a98-d64cd32530a7 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7,backing_fmt=raw /opt/stack/data/nova/instances/01d407b0-a7cf-4222-9f2d-54b99eeeed84/disk 1073741824" returned: 0 in 0.086s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:41:53 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-bf89be4d-be48-4f59-9a98-d64cd32530a7 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lock "fc7b140751b8c385de81623e40fb09ce09374ab7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.349s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:41:53 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-bf89be4d-be48-4f59-9a98-d64cd32530a7 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:41:53 user nova-compute[74337]: DEBUG nova.network.neutron [req-e41dae36-4092-4eeb-8334-8504a71b4748 req-ee279ae4-14e5-4223-be09-043b8f19f210 service nova] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] Updated VIF entry in instance network info cache for port 328722f1-b384-495c-8aea-81780b2d9ca1. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 21:41:53 user nova-compute[74337]: DEBUG nova.network.neutron [req-e41dae36-4092-4eeb-8334-8504a71b4748 req-ee279ae4-14e5-4223-be09-043b8f19f210 service nova] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] Updating instance_info_cache with network_info: [{"id": "328722f1-b384-495c-8aea-81780b2d9ca1", "address": "fa:16:3e:28:35:83", "network": {"id": "5f62b1d8-d5d0-4ff9-922b-fc6e72fb640d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-655282105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b85c4f783a4ee7ab67422b49da85ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap328722f1-b3", "ovs_interfaceid": "328722f1-b384-495c-8aea-81780b2d9ca1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:41:53 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-bf89be4d-be48-4f59-9a98-d64cd32530a7 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.194s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:41:53 user nova-compute[74337]: DEBUG nova.virt.disk.api [None req-bf89be4d-be48-4f59-9a98-d64cd32530a7 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Checking if we can resize image /opt/stack/data/nova/instances/01d407b0-a7cf-4222-9f2d-54b99eeeed84/disk. size=1073741824 {{(pid=74337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 21:41:53 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-bf89be4d-be48-4f59-9a98-d64cd32530a7 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01d407b0-a7cf-4222-9f2d-54b99eeeed84/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:41:54 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-e41dae36-4092-4eeb-8334-8504a71b4748 req-ee279ae4-14e5-4223-be09-043b8f19f210 service nova] Releasing lock "refresh_cache-c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:41:54 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-bf89be4d-be48-4f59-9a98-d64cd32530a7 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01d407b0-a7cf-4222-9f2d-54b99eeeed84/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:41:54 user nova-compute[74337]: DEBUG nova.virt.disk.api [None req-bf89be4d-be48-4f59-9a98-d64cd32530a7 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Cannot resize image /opt/stack/data/nova/instances/01d407b0-a7cf-4222-9f2d-54b99eeeed84/disk to a smaller size. {{(pid=74337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 21:41:54 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-bf89be4d-be48-4f59-9a98-d64cd32530a7 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 01d407b0-a7cf-4222-9f2d-54b99eeeed84] Created local disks {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 21:41:54 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-bf89be4d-be48-4f59-9a98-d64cd32530a7 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 01d407b0-a7cf-4222-9f2d-54b99eeeed84] Ensure instance console log exists: /opt/stack/data/nova/instances/01d407b0-a7cf-4222-9f2d-54b99eeeed84/console.log {{(pid=74337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 21:41:54 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-bf89be4d-be48-4f59-9a98-d64cd32530a7 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:41:54 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-bf89be4d-be48-4f59-9a98-d64cd32530a7 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:41:54 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-bf89be4d-be48-4f59-9a98-d64cd32530a7 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:41:54 user nova-compute[74337]: DEBUG nova.network.neutron [None req-bf89be4d-be48-4f59-9a98-d64cd32530a7 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 01d407b0-a7cf-4222-9f2d-54b99eeeed84] Successfully created port: 720aee52-2c25-49de-bf60-743dea4b66ff {{(pid=74337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 21:41:55 user nova-compute[74337]: DEBUG nova.network.neutron [None req-bf89be4d-be48-4f59-9a98-d64cd32530a7 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 01d407b0-a7cf-4222-9f2d-54b99eeeed84] Successfully updated port: 720aee52-2c25-49de-bf60-743dea4b66ff {{(pid=74337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 21:41:55 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-bf89be4d-be48-4f59-9a98-d64cd32530a7 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Acquiring lock "refresh_cache-01d407b0-a7cf-4222-9f2d-54b99eeeed84" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:41:55 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-bf89be4d-be48-4f59-9a98-d64cd32530a7 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Acquired lock "refresh_cache-01d407b0-a7cf-4222-9f2d-54b99eeeed84" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:41:55 user nova-compute[74337]: DEBUG nova.network.neutron [None req-bf89be4d-be48-4f59-9a98-d64cd32530a7 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 01d407b0-a7cf-4222-9f2d-54b99eeeed84] Building network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 21:41:55 user nova-compute[74337]: DEBUG nova.compute.manager [req-919990fc-77cc-4afe-865e-52df33ee3000 req-2bc7c44a-f96b-47b3-98ee-64d05b72b90e service nova] [instance: 01d407b0-a7cf-4222-9f2d-54b99eeeed84] Received event network-changed-720aee52-2c25-49de-bf60-743dea4b66ff {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:41:55 user nova-compute[74337]: DEBUG nova.compute.manager [req-919990fc-77cc-4afe-865e-52df33ee3000 req-2bc7c44a-f96b-47b3-98ee-64d05b72b90e service nova] [instance: 01d407b0-a7cf-4222-9f2d-54b99eeeed84] Refreshing instance network info cache due to event network-changed-720aee52-2c25-49de-bf60-743dea4b66ff. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 21:41:55 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-919990fc-77cc-4afe-865e-52df33ee3000 req-2bc7c44a-f96b-47b3-98ee-64d05b72b90e service nova] Acquiring lock "refresh_cache-01d407b0-a7cf-4222-9f2d-54b99eeeed84" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:41:55 user nova-compute[74337]: DEBUG nova.network.neutron [None req-bf89be4d-be48-4f59-9a98-d64cd32530a7 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 01d407b0-a7cf-4222-9f2d-54b99eeeed84] Instance cache missing network info. {{(pid=74337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 21:41:55 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Acquiring lock "b531e297-3649-4bab-8e13-10304a002b30" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:41:55 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "b531e297-3649-4bab-8e13-10304a002b30" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:41:55 user nova-compute[74337]: DEBUG nova.compute.manager [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: b531e297-3649-4bab-8e13-10304a002b30] Starting instance... {{(pid=74337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 21:41:55 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:41:55 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:41:55 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 21:41:55 user nova-compute[74337]: INFO nova.compute.claims [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: b531e297-3649-4bab-8e13-10304a002b30] Claim successful on node user
Oct 23 21:41:55 user nova-compute[74337]: DEBUG nova.network.neutron [None req-bf89be4d-be48-4f59-9a98-d64cd32530a7 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 01d407b0-a7cf-4222-9f2d-54b99eeeed84] Updating instance_info_cache with network_info: [{"id": "720aee52-2c25-49de-bf60-743dea4b66ff", "address": "fa:16:3e:a6:0f:9d", "network": {"id": "787d9979-63ad-4318-b1d7-8ec69c5969fe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1847253864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84a25b3eed8548a5a324e55b28f26252", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap720aee52-2c", "ovs_interfaceid": "720aee52-2c25-49de-bf60-743dea4b66ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:41:55 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-bf89be4d-be48-4f59-9a98-d64cd32530a7 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Releasing lock "refresh_cache-01d407b0-a7cf-4222-9f2d-54b99eeeed84" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:41:55 user nova-compute[74337]: DEBUG nova.compute.manager [None req-bf89be4d-be48-4f59-9a98-d64cd32530a7 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 01d407b0-a7cf-4222-9f2d-54b99eeeed84] Instance network_info: |[{"id": "720aee52-2c25-49de-bf60-743dea4b66ff", "address": "fa:16:3e:a6:0f:9d", "network": {"id": "787d9979-63ad-4318-b1d7-8ec69c5969fe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1847253864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84a25b3eed8548a5a324e55b28f26252", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap720aee52-2c", "ovs_interfaceid": "720aee52-2c25-49de-bf60-743dea4b66ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 21:41:55 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-919990fc-77cc-4afe-865e-52df33ee3000 req-2bc7c44a-f96b-47b3-98ee-64d05b72b90e service nova] Acquired lock "refresh_cache-01d407b0-a7cf-4222-9f2d-54b99eeeed84" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:41:55 user nova-compute[74337]: DEBUG nova.network.neutron [req-919990fc-77cc-4afe-865e-52df33ee3000 req-2bc7c44a-f96b-47b3-98ee-64d05b72b90e service nova] [instance: 01d407b0-a7cf-4222-9f2d-54b99eeeed84] Refreshing network info cache for port 720aee52-2c25-49de-bf60-743dea4b66ff {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 21:41:55 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-bf89be4d-be48-4f59-9a98-d64cd32530a7 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 01d407b0-a7cf-4222-9f2d-54b99eeeed84] Start _get_guest_xml network_info=[{"id": "720aee52-2c25-49de-bf60-743dea4b66ff", "address": "fa:16:3e:a6:0f:9d", "network": {"id": "787d9979-63ad-4318-b1d7-8ec69c5969fe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1847253864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84a25b3eed8548a5a324e55b28f26252", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap720aee52-2c", "ovs_interfaceid": "720aee52-2c25-49de-bf60-743dea4b66ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T21:29:21Z,direct_url=<?>,disk_format='qcow2',id=d859d89d-998d-4109-b26a-0d6e28152932,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ff43462300764979a6cf688444336a56',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T21:29:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'image_id': 'd859d89d-998d-4109-b26a-0d6e28152932'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 21:41:55 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-bf89be4d-be48-4f59-9a98-d64cd32530a7 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:41:55 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-bf89be4d-be48-4f59-9a98-d64cd32530a7 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:41:55 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-bf89be4d-be48-4f59-9a98-d64cd32530a7 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 21:41:55 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-bf89be4d-be48-4f59-9a98-d64cd32530a7 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] CPU controller missing on host. {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 21:41:55 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-bf89be4d-be48-4f59-9a98-d64cd32530a7 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 21:41:55 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-bf89be4d-be48-4f59-9a98-d64cd32530a7 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] CPU controller found on host. {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 21:41:55 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-bf89be4d-be48-4f59-9a98-d64cd32530a7 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 21:41:55 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-bf89be4d-be48-4f59-9a98-d64cd32530a7 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T21:29:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T21:29:21Z,direct_url=<?>,disk_format='qcow2',id=d859d89d-998d-4109-b26a-0d6e28152932,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ff43462300764979a6cf688444336a56',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T21:29:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 21:41:55 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-bf89be4d-be48-4f59-9a98-d64cd32530a7 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Flavor limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 21:41:55 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-bf89be4d-be48-4f59-9a98-d64cd32530a7 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Image limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 21:41:55 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-bf89be4d-be48-4f59-9a98-d64cd32530a7 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Flavor pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 21:41:55 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-bf89be4d-be48-4f59-9a98-d64cd32530a7 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Image pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 21:41:55 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-bf89be4d-be48-4f59-9a98-d64cd32530a7 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 21:41:55 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-bf89be4d-be48-4f59-9a98-d64cd32530a7 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 21:41:55 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-bf89be4d-be48-4f59-9a98-d64cd32530a7 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 21:41:55 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-bf89be4d-be48-4f59-9a98-d64cd32530a7 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Got 1 possible topologies {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 21:41:55 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-bf89be4d-be48-4f59-9a98-d64cd32530a7 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 21:41:55 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-bf89be4d-be48-4f59-9a98-d64cd32530a7 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 21:41:55 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-bf89be4d-be48-4f59-9a98-d64cd32530a7 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:41:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1126935027',display_name='tempest-AttachVolumeNegativeTest-server-1126935027',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1126935027',id=21,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDBGw3df6OvFipVH/If42r9GmRritzHhx1HQKG+2Bdhtpbibp3+FRYZcul+/3ufTYP5zHi3D2n1KPMLFIBdDArFfKePpNO0gSfrb3AAPb2csCm6C6X4bN7DbdMjHsfWd6g==',key_name='tempest-keypair-211272591',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='84a25b3eed8548a5a324e55b28f26252',ramdisk_id='',reservation_id='r-wio9bm9k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1446109887',owner_user_name='tempest-AttachVolumeNegativeTest-1446109887-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:41:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6f6daa6653264905a5498e00f184080c',uuid=01d407b0-a7cf-4222-9f2d-54b99eeeed84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "720aee52-2c25-49de-bf60-743dea4b66ff", "address": "fa:16:3e:a6:0f:9d", "network": {"id": "787d9979-63ad-4318-b1d7-8ec69c5969fe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1847253864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84a25b3eed8548a5a324e55b28f26252", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap720aee52-2c", "ovs_interfaceid": "720aee52-2c25-49de-bf60-743dea4b66ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 21:41:55 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-bf89be4d-be48-4f59-9a98-d64cd32530a7 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Converting VIF {"id": "720aee52-2c25-49de-bf60-743dea4b66ff", "address": "fa:16:3e:a6:0f:9d", "network": {"id": "787d9979-63ad-4318-b1d7-8ec69c5969fe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1847253864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84a25b3eed8548a5a324e55b28f26252", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap720aee52-2c", "ovs_interfaceid": "720aee52-2c25-49de-bf60-743dea4b66ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:41:55 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-bf89be4d-be48-4f59-9a98-d64cd32530a7 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:0f:9d,bridge_name='br-int',has_traffic_filtering=True,id=720aee52-2c25-49de-bf60-743dea4b66ff,network=Network(787d9979-63ad-4318-b1d7-8ec69c5969fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap720aee52-2c') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:41:55 user nova-compute[74337]: DEBUG nova.objects.instance [None req-bf89be4d-be48-4f59-9a98-d64cd32530a7 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lazy-loading 'pci_devices' on Instance uuid 01d407b0-a7cf-4222-9f2d-54b99eeeed84 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:41:55 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-bf89be4d-be48-4f59-9a98-d64cd32530a7 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 01d407b0-a7cf-4222-9f2d-54b99eeeed84] End _get_guest_xml xml=<domain type="kvm">
Oct 23 21:41:55 user nova-compute[74337]:   <uuid>01d407b0-a7cf-4222-9f2d-54b99eeeed84</uuid>
Oct 23 21:41:55 user nova-compute[74337]:   <name>instance-00000015</name>
Oct 23 21:41:55 user nova-compute[74337]:   <memory>524288</memory>
Oct 23 21:41:55 user nova-compute[74337]:   <vcpu>1</vcpu>
Oct 23 21:41:55 user nova-compute[74337]:   <metadata>
Oct 23 21:41:55 user nova-compute[74337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 21:41:55 user nova-compute[74337]:       <nova:package version="0.0.0"/>
Oct 23 21:41:55 user nova-compute[74337]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1126935027</nova:name>
Oct 23 21:41:55 user nova-compute[74337]:       <nova:creationTime>2023-10-23 21:41:55</nova:creationTime>
Oct 23 21:41:55 user nova-compute[74337]:       <nova:flavor name="m1.tiny">
Oct 23 21:41:55 user nova-compute[74337]:         <nova:memory>512</nova:memory>
Oct 23 21:41:55 user nova-compute[74337]:         <nova:disk>1</nova:disk>
Oct 23 21:41:55 user nova-compute[74337]:         <nova:swap>0</nova:swap>
Oct 23 21:41:55 user nova-compute[74337]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 21:41:55 user nova-compute[74337]:         <nova:vcpus>1</nova:vcpus>
Oct 23 21:41:55 user nova-compute[74337]:       </nova:flavor>
Oct 23 21:41:55 user nova-compute[74337]:       <nova:owner>
Oct 23 21:41:55 user nova-compute[74337]:         <nova:user uuid="6f6daa6653264905a5498e00f184080c">tempest-AttachVolumeNegativeTest-1446109887-project-member</nova:user>
Oct 23 21:41:55 user nova-compute[74337]:         <nova:project uuid="84a25b3eed8548a5a324e55b28f26252">tempest-AttachVolumeNegativeTest-1446109887</nova:project>
Oct 23 21:41:55 user nova-compute[74337]:       </nova:owner>
Oct 23 21:41:55 user nova-compute[74337]:       <nova:root type="image" uuid="d859d89d-998d-4109-b26a-0d6e28152932"/>
Oct 23 21:41:55 user nova-compute[74337]:       <nova:ports>
Oct 23 21:41:55 user nova-compute[74337]:         <nova:port uuid="720aee52-2c25-49de-bf60-743dea4b66ff">
Oct 23 21:41:55 user nova-compute[74337]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 23 21:41:55 user nova-compute[74337]:         </nova:port>
Oct 23 21:41:55 user nova-compute[74337]:       </nova:ports>
Oct 23 21:41:55 user nova-compute[74337]:     </nova:instance>
Oct 23 21:41:55 user nova-compute[74337]:   </metadata>
Oct 23 21:41:55 user nova-compute[74337]:   <sysinfo type="smbios">
Oct 23 21:41:55 user nova-compute[74337]:     <system>
Oct 23 21:41:55 user nova-compute[74337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 21:41:55 user nova-compute[74337]:       <entry name="product">OpenStack Nova</entry>
Oct 23 21:41:55 user nova-compute[74337]:       <entry name="version">0.0.0</entry>
Oct 23 21:41:55 user nova-compute[74337]:       <entry name="serial">01d407b0-a7cf-4222-9f2d-54b99eeeed84</entry>
Oct 23 21:41:55 user nova-compute[74337]:       <entry name="uuid">01d407b0-a7cf-4222-9f2d-54b99eeeed84</entry>
Oct 23 21:41:55 user nova-compute[74337]:       <entry name="family">Virtual Machine</entry>
Oct 23 21:41:55 user nova-compute[74337]:     </system>
Oct 23 21:41:55 user nova-compute[74337]:   </sysinfo>
Oct 23 21:41:55 user nova-compute[74337]:   <os>
Oct 23 21:41:55 user nova-compute[74337]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 21:41:55 user nova-compute[74337]:     <boot dev="hd"/>
Oct 23 21:41:55 user nova-compute[74337]:     <smbios mode="sysinfo"/>
Oct 23 21:41:55 user nova-compute[74337]:   </os>
Oct 23 21:41:55 user nova-compute[74337]:   <features>
Oct 23 21:41:55 user nova-compute[74337]:     <acpi/>
Oct 23 21:41:55 user nova-compute[74337]:     <apic/>
Oct 23 21:41:55 user nova-compute[74337]:     <vmcoreinfo/>
Oct 23 21:41:55 user nova-compute[74337]:   </features>
Oct 23 21:41:55 user nova-compute[74337]:   <clock offset="utc">
Oct 23 21:41:55 user nova-compute[74337]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 21:41:55 user nova-compute[74337]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 21:41:55 user nova-compute[74337]:     <timer name="hpet" present="no"/>
Oct 23 21:41:55 user nova-compute[74337]:   </clock>
Oct 23 21:41:55 user nova-compute[74337]:   <cpu mode="custom" match="exact">
Oct 23 21:41:55 user nova-compute[74337]:     <model>Nehalem</model>
Oct 23 21:41:55 user nova-compute[74337]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 21:41:55 user nova-compute[74337]:   </cpu>
Oct 23 21:41:55 user nova-compute[74337]:   <devices>
Oct 23 21:41:55 user nova-compute[74337]:     <disk type="file" device="disk">
Oct 23 21:41:55 user nova-compute[74337]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 21:41:55 user nova-compute[74337]:       <source file="/opt/stack/data/nova/instances/01d407b0-a7cf-4222-9f2d-54b99eeeed84/disk"/>
Oct 23 21:41:55 user nova-compute[74337]:       <target dev="vda" bus="virtio"/>
Oct 23 21:41:55 user nova-compute[74337]:     </disk>
Oct 23 21:41:55 user nova-compute[74337]:     <interface type="ethernet">
Oct 23 21:41:55 user nova-compute[74337]:       <mac address="fa:16:3e:a6:0f:9d"/>
Oct 23 21:41:55 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:41:55 user nova-compute[74337]:       <mtu size="1442"/>
Oct 23 21:41:55 user nova-compute[74337]:       <target dev="tap720aee52-2c"/>
Oct 23 21:41:55 user nova-compute[74337]:     </interface>
Oct 23 21:41:55 user nova-compute[74337]:     <serial type="pty">
Oct 23 21:41:55 user nova-compute[74337]:       <log file="/opt/stack/data/nova/instances/01d407b0-a7cf-4222-9f2d-54b99eeeed84/console.log" append="off"/>
Oct 23 21:41:55 user nova-compute[74337]:     </serial>
Oct 23 21:41:55 user nova-compute[74337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 21:41:55 user nova-compute[74337]:     <video>
Oct 23 21:41:55 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:41:55 user nova-compute[74337]:     </video>
Oct 23 21:41:55 user nova-compute[74337]:     <rng model="virtio">
Oct 23 21:41:55 user nova-compute[74337]:       <backend model="random">/dev/urandom</backend>
Oct 23 21:41:55 user nova-compute[74337]:     </rng>
Oct 23 21:41:55 user nova-compute[74337]:     <controller type="usb" index="0" model="none"/>
Oct 23 21:41:55 user nova-compute[74337]:     <memballoon model="virtio">
Oct 23 21:41:55 user nova-compute[74337]:       <stats period="10"/>
Oct 23 21:41:55 user nova-compute[74337]:     </memballoon>
Oct 23 21:41:55 user nova-compute[74337]:   </devices>
Oct 23 21:41:55 user nova-compute[74337]: </domain>
Oct 23 21:41:55 user nova-compute[74337]:  {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 21:41:55 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-bf89be4d-be48-4f59-9a98-d64cd32530a7 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:41:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1126935027',display_name='tempest-AttachVolumeNegativeTest-server-1126935027',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1126935027',id=21,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDBGw3df6OvFipVH/If42r9GmRritzHhx1HQKG+2Bdhtpbibp3+FRYZcul+/3ufTYP5zHi3D2n1KPMLFIBdDArFfKePpNO0gSfrb3AAPb2csCm6C6X4bN7DbdMjHsfWd6g==',key_name='tempest-keypair-211272591',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='84a25b3eed8548a5a324e55b28f26252',ramdisk_id='',reservation_id='r-wio9bm9k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1446109887',owner_user_name='tempest-AttachVolumeNegativeTest-1446109887-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:41:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6f6daa6653264905a5498e00f184080c',uuid=01d407b0-a7cf-4222-9f2d-54b99eeeed84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "720aee52-2c25-49de-bf60-743dea4b66ff", "address": "fa:16:3e:a6:0f:9d", "network": {"id": "787d9979-63ad-4318-b1d7-8ec69c5969fe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1847253864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84a25b3eed8548a5a324e55b28f26252", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap720aee52-2c", "ovs_interfaceid": "720aee52-2c25-49de-bf60-743dea4b66ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 21:41:55 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-bf89be4d-be48-4f59-9a98-d64cd32530a7 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Converting VIF {"id": "720aee52-2c25-49de-bf60-743dea4b66ff", "address": "fa:16:3e:a6:0f:9d", "network": {"id": "787d9979-63ad-4318-b1d7-8ec69c5969fe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1847253864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84a25b3eed8548a5a324e55b28f26252", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap720aee52-2c", "ovs_interfaceid": "720aee52-2c25-49de-bf60-743dea4b66ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:41:55 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-bf89be4d-be48-4f59-9a98-d64cd32530a7 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:0f:9d,bridge_name='br-int',has_traffic_filtering=True,id=720aee52-2c25-49de-bf60-743dea4b66ff,network=Network(787d9979-63ad-4318-b1d7-8ec69c5969fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap720aee52-2c') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:41:55 user nova-compute[74337]: DEBUG os_vif [None req-bf89be4d-be48-4f59-9a98-d64cd32530a7 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:0f:9d,bridge_name='br-int',has_traffic_filtering=True,id=720aee52-2c25-49de-bf60-743dea4b66ff,network=Network(787d9979-63ad-4318-b1d7-8ec69c5969fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap720aee52-2c') {{(pid=74337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 21:41:55 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:41:55 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:41:55 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 21:41:55 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:41:55 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ec8e9089-d4be-52ce-bfff-b1fc4bb8f0f8', '_type': 'linux-noop'}}, row=False) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:41:55 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:41:55 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:41:55 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:41:55 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap720aee52-2c, may_exist=True, interface_attrs={}) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:41:55 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap720aee52-2c, col_values=(('qos', UUID('9501adb0-9359-41b6-a916-afe0d0c24fd9')),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:41:55 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap720aee52-2c, col_values=(('external_ids', {'iface-id': '720aee52-2c25-49de-bf60-743dea4b66ff', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a6:0f:9d', 'vm-uuid': '01d407b0-a7cf-4222-9f2d-54b99eeeed84'}),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:41:55 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:41:55 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:41:55 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:41:55 user nova-compute[74337]: INFO os_vif [None req-bf89be4d-be48-4f59-9a98-d64cd32530a7 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:0f:9d,bridge_name='br-int',has_traffic_filtering=True,id=720aee52-2c25-49de-bf60-743dea4b66ff,network=Network(787d9979-63ad-4318-b1d7-8ec69c5969fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap720aee52-2c')
Oct 23 21:41:55 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-bf89be4d-be48-4f59-9a98-d64cd32530a7 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] No BDM found with device name vda, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 21:41:55 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-bf89be4d-be48-4f59-9a98-d64cd32530a7 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] No VIF found with MAC fa:16:3e:a6:0f:9d, not building metadata {{(pid=74337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 21:41:55 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:41:55 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:41:55 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.567s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:41:55 user nova-compute[74337]: DEBUG nova.compute.manager [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: b531e297-3649-4bab-8e13-10304a002b30] Start building networks asynchronously for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 21:41:56 user nova-compute[74337]: DEBUG nova.compute.manager [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: b531e297-3649-4bab-8e13-10304a002b30] Allocating IP information in the background. {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 21:41:56 user nova-compute[74337]: DEBUG nova.network.neutron [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: b531e297-3649-4bab-8e13-10304a002b30] allocate_for_instance() {{(pid=74337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 21:41:56 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: b531e297-3649-4bab-8e13-10304a002b30] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 21:41:56 user nova-compute[74337]: DEBUG nova.compute.manager [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: b531e297-3649-4bab-8e13-10304a002b30] Start building block device mappings for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 21:41:56 user nova-compute[74337]: INFO nova.virt.block_device [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: b531e297-3649-4bab-8e13-10304a002b30] Booting with volume snapshot 5d895894-513b-4462-af5b-4ba3fffa0b3b at /dev/vda
Oct 23 21:41:56 user nova-compute[74337]: DEBUG nova.policy [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0c3e635e8e5447138a7f2db11695574c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb567547bd4941fb87435a841c9d17c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74337) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 21:41:56 user nova-compute[74337]: DEBUG nova.network.neutron [req-919990fc-77cc-4afe-865e-52df33ee3000 req-2bc7c44a-f96b-47b3-98ee-64d05b72b90e service nova] [instance: 01d407b0-a7cf-4222-9f2d-54b99eeeed84] Updated VIF entry in instance network info cache for port 720aee52-2c25-49de-bf60-743dea4b66ff. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 21:41:56 user nova-compute[74337]: DEBUG nova.network.neutron [req-919990fc-77cc-4afe-865e-52df33ee3000 req-2bc7c44a-f96b-47b3-98ee-64d05b72b90e service nova] [instance: 01d407b0-a7cf-4222-9f2d-54b99eeeed84] Updating instance_info_cache with network_info: [{"id": "720aee52-2c25-49de-bf60-743dea4b66ff", "address": "fa:16:3e:a6:0f:9d", "network": {"id": "787d9979-63ad-4318-b1d7-8ec69c5969fe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1847253864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84a25b3eed8548a5a324e55b28f26252", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap720aee52-2c", "ovs_interfaceid": "720aee52-2c25-49de-bf60-743dea4b66ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:41:56 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-919990fc-77cc-4afe-865e-52df33ee3000 req-2bc7c44a-f96b-47b3-98ee-64d05b72b90e service nova] Releasing lock "refresh_cache-01d407b0-a7cf-4222-9f2d-54b99eeeed84" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:41:57 user nova-compute[74337]: DEBUG nova.network.neutron [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: b531e297-3649-4bab-8e13-10304a002b30] Successfully created port: 104a5da2-c546-44ed-9d19-d4f7e0875baa {{(pid=74337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 21:41:57 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:41:57 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:41:57 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:41:57 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:41:57 user nova-compute[74337]: DEBUG nova.compute.manager [req-506dd53c-b492-4a56-ae62-2e4afaf810db req-e0e39301-be15-471e-b55a-7b6e5b805d89 service nova] [instance: 01d407b0-a7cf-4222-9f2d-54b99eeeed84] Received event network-vif-plugged-720aee52-2c25-49de-bf60-743dea4b66ff {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:41:57 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-506dd53c-b492-4a56-ae62-2e4afaf810db req-e0e39301-be15-471e-b55a-7b6e5b805d89 service nova] Acquiring lock "01d407b0-a7cf-4222-9f2d-54b99eeeed84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:41:57 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-506dd53c-b492-4a56-ae62-2e4afaf810db req-e0e39301-be15-471e-b55a-7b6e5b805d89 service nova] Lock "01d407b0-a7cf-4222-9f2d-54b99eeeed84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:41:57 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-506dd53c-b492-4a56-ae62-2e4afaf810db req-e0e39301-be15-471e-b55a-7b6e5b805d89 service nova] Lock "01d407b0-a7cf-4222-9f2d-54b99eeeed84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:41:57 user nova-compute[74337]: DEBUG nova.compute.manager [req-506dd53c-b492-4a56-ae62-2e4afaf810db req-e0e39301-be15-471e-b55a-7b6e5b805d89 service nova] [instance: 01d407b0-a7cf-4222-9f2d-54b99eeeed84] No waiting events found dispatching network-vif-plugged-720aee52-2c25-49de-bf60-743dea4b66ff {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:41:57 user nova-compute[74337]: WARNING nova.compute.manager [req-506dd53c-b492-4a56-ae62-2e4afaf810db req-e0e39301-be15-471e-b55a-7b6e5b805d89 service nova] [instance: 01d407b0-a7cf-4222-9f2d-54b99eeeed84] Received unexpected event network-vif-plugged-720aee52-2c25-49de-bf60-743dea4b66ff for instance with vm_state building and task_state spawning.
Oct 23 21:41:58 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:41:58 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:41:58 user nova-compute[74337]: DEBUG nova.network.neutron [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: b531e297-3649-4bab-8e13-10304a002b30] Successfully updated port: 104a5da2-c546-44ed-9d19-d4f7e0875baa {{(pid=74337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 21:41:58 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:41:58 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Acquiring lock "refresh_cache-b531e297-3649-4bab-8e13-10304a002b30" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:41:58 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Acquired lock "refresh_cache-b531e297-3649-4bab-8e13-10304a002b30" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:41:58 user nova-compute[74337]: DEBUG nova.network.neutron [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: b531e297-3649-4bab-8e13-10304a002b30] Building network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 21:41:58 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:41:58 user nova-compute[74337]: DEBUG nova.network.neutron [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: b531e297-3649-4bab-8e13-10304a002b30] Instance cache missing network info. {{(pid=74337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 21:41:58 user nova-compute[74337]: DEBUG nova.network.neutron [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: b531e297-3649-4bab-8e13-10304a002b30] Updating instance_info_cache with network_info: [{"id": "104a5da2-c546-44ed-9d19-d4f7e0875baa", "address": "fa:16:3e:ae:37:51", "network": {"id": "5a18e96f-a6eb-4989-9be3-154b54928b03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-507511840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb567547bd4941fb87435a841c9d17c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap104a5da2-c5", "ovs_interfaceid": "104a5da2-c546-44ed-9d19-d4f7e0875baa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:41:58 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Releasing lock "refresh_cache-b531e297-3649-4bab-8e13-10304a002b30" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:41:58 user nova-compute[74337]: DEBUG nova.compute.manager [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: b531e297-3649-4bab-8e13-10304a002b30] Instance network_info: |[{"id": "104a5da2-c546-44ed-9d19-d4f7e0875baa", "address": "fa:16:3e:ae:37:51", "network": {"id": "5a18e96f-a6eb-4989-9be3-154b54928b03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-507511840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb567547bd4941fb87435a841c9d17c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap104a5da2-c5", "ovs_interfaceid": "104a5da2-c546-44ed-9d19-d4f7e0875baa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 21:42:00 user nova-compute[74337]: DEBUG nova.compute.manager [req-6432f751-c7ce-480c-a9f3-61394029a1e3 req-12dddfcd-36ff-4cd8-b8b3-fa595d4d7ae4 service nova] [instance: 01d407b0-a7cf-4222-9f2d-54b99eeeed84] Received event network-vif-plugged-720aee52-2c25-49de-bf60-743dea4b66ff {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:42:00 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-6432f751-c7ce-480c-a9f3-61394029a1e3 req-12dddfcd-36ff-4cd8-b8b3-fa595d4d7ae4 service nova] Acquiring lock "01d407b0-a7cf-4222-9f2d-54b99eeeed84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:42:00 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-6432f751-c7ce-480c-a9f3-61394029a1e3 req-12dddfcd-36ff-4cd8-b8b3-fa595d4d7ae4 service nova] Lock "01d407b0-a7cf-4222-9f2d-54b99eeeed84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:42:00 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-6432f751-c7ce-480c-a9f3-61394029a1e3 req-12dddfcd-36ff-4cd8-b8b3-fa595d4d7ae4 service nova] Lock "01d407b0-a7cf-4222-9f2d-54b99eeeed84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:42:00 user nova-compute[74337]: DEBUG nova.compute.manager [req-6432f751-c7ce-480c-a9f3-61394029a1e3 req-12dddfcd-36ff-4cd8-b8b3-fa595d4d7ae4 service nova] [instance: 01d407b0-a7cf-4222-9f2d-54b99eeeed84] No waiting events found dispatching network-vif-plugged-720aee52-2c25-49de-bf60-743dea4b66ff {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:42:00 user nova-compute[74337]: WARNING nova.compute.manager [req-6432f751-c7ce-480c-a9f3-61394029a1e3 req-12dddfcd-36ff-4cd8-b8b3-fa595d4d7ae4 service nova] [instance: 01d407b0-a7cf-4222-9f2d-54b99eeeed84] Received unexpected event network-vif-plugged-720aee52-2c25-49de-bf60-743dea4b66ff for instance with vm_state building and task_state spawning.
Oct 23 21:42:00 user nova-compute[74337]: DEBUG nova.compute.manager [req-6432f751-c7ce-480c-a9f3-61394029a1e3 req-12dddfcd-36ff-4cd8-b8b3-fa595d4d7ae4 service nova] [instance: b531e297-3649-4bab-8e13-10304a002b30] Received event network-changed-104a5da2-c546-44ed-9d19-d4f7e0875baa {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:42:00 user nova-compute[74337]: DEBUG nova.compute.manager [req-6432f751-c7ce-480c-a9f3-61394029a1e3 req-12dddfcd-36ff-4cd8-b8b3-fa595d4d7ae4 service nova] [instance: b531e297-3649-4bab-8e13-10304a002b30] Refreshing instance network info cache due to event network-changed-104a5da2-c546-44ed-9d19-d4f7e0875baa. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 21:42:00 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-6432f751-c7ce-480c-a9f3-61394029a1e3 req-12dddfcd-36ff-4cd8-b8b3-fa595d4d7ae4 service nova] Acquiring lock "refresh_cache-b531e297-3649-4bab-8e13-10304a002b30" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:42:00 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-6432f751-c7ce-480c-a9f3-61394029a1e3 req-12dddfcd-36ff-4cd8-b8b3-fa595d4d7ae4 service nova] Acquired lock "refresh_cache-b531e297-3649-4bab-8e13-10304a002b30" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:42:00 user nova-compute[74337]: DEBUG nova.network.neutron [req-6432f751-c7ce-480c-a9f3-61394029a1e3 req-12dddfcd-36ff-4cd8-b8b3-fa595d4d7ae4 service nova] [instance: b531e297-3649-4bab-8e13-10304a002b30] Refreshing network info cache for port 104a5da2-c546-44ed-9d19-d4f7e0875baa {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 21:42:00 user nova-compute[74337]: DEBUG nova.compute.manager [None req-bf89be4d-be48-4f59-9a98-d64cd32530a7 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 01d407b0-a7cf-4222-9f2d-54b99eeeed84] Instance event wait completed in 0 seconds for  {{(pid=74337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 21:42:00 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-bf89be4d-be48-4f59-9a98-d64cd32530a7 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 01d407b0-a7cf-4222-9f2d-54b99eeeed84] Guest created on hypervisor {{(pid=74337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 21:42:00 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: 01d407b0-a7cf-4222-9f2d-54b99eeeed84] Instance spawned successfully.
Oct 23 21:42:00 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-bf89be4d-be48-4f59-9a98-d64cd32530a7 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 01d407b0-a7cf-4222-9f2d-54b99eeeed84] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 21:42:00 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-bf89be4d-be48-4f59-9a98-d64cd32530a7 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 01d407b0-a7cf-4222-9f2d-54b99eeeed84] Found default for hw_cdrom_bus of ide {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:42:00 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-bf89be4d-be48-4f59-9a98-d64cd32530a7 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 01d407b0-a7cf-4222-9f2d-54b99eeeed84] Found default for hw_disk_bus of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:42:00 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-bf89be4d-be48-4f59-9a98-d64cd32530a7 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 01d407b0-a7cf-4222-9f2d-54b99eeeed84] Found default for hw_input_bus of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:42:00 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-bf89be4d-be48-4f59-9a98-d64cd32530a7 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 01d407b0-a7cf-4222-9f2d-54b99eeeed84] Found default for hw_pointer_model of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:42:00 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-bf89be4d-be48-4f59-9a98-d64cd32530a7 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 01d407b0-a7cf-4222-9f2d-54b99eeeed84] Found default for hw_video_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:42:00 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-bf89be4d-be48-4f59-9a98-d64cd32530a7 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 01d407b0-a7cf-4222-9f2d-54b99eeeed84] Found default for hw_vif_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:42:00 user nova-compute[74337]: INFO nova.compute.manager [None req-bf89be4d-be48-4f59-9a98-d64cd32530a7 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 01d407b0-a7cf-4222-9f2d-54b99eeeed84] Took 7.22 seconds to spawn the instance on the hypervisor.
Oct 23 21:42:00 user nova-compute[74337]: DEBUG nova.compute.manager [None req-bf89be4d-be48-4f59-9a98-d64cd32530a7 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 01d407b0-a7cf-4222-9f2d-54b99eeeed84] Checking state {{(pid=74337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 21:42:00 user nova-compute[74337]: DEBUG nova.network.neutron [req-6432f751-c7ce-480c-a9f3-61394029a1e3 req-12dddfcd-36ff-4cd8-b8b3-fa595d4d7ae4 service nova] [instance: b531e297-3649-4bab-8e13-10304a002b30] Updated VIF entry in instance network info cache for port 104a5da2-c546-44ed-9d19-d4f7e0875baa. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 21:42:00 user nova-compute[74337]: DEBUG nova.network.neutron [req-6432f751-c7ce-480c-a9f3-61394029a1e3 req-12dddfcd-36ff-4cd8-b8b3-fa595d4d7ae4 service nova] [instance: b531e297-3649-4bab-8e13-10304a002b30] Updating instance_info_cache with network_info: [{"id": "104a5da2-c546-44ed-9d19-d4f7e0875baa", "address": "fa:16:3e:ae:37:51", "network": {"id": "5a18e96f-a6eb-4989-9be3-154b54928b03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-507511840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb567547bd4941fb87435a841c9d17c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap104a5da2-c5", "ovs_interfaceid": "104a5da2-c546-44ed-9d19-d4f7e0875baa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:42:00 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-6432f751-c7ce-480c-a9f3-61394029a1e3 req-12dddfcd-36ff-4cd8-b8b3-fa595d4d7ae4 service nova] Releasing lock "refresh_cache-b531e297-3649-4bab-8e13-10304a002b30" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:42:00 user nova-compute[74337]: INFO nova.compute.manager [None req-bf89be4d-be48-4f59-9a98-d64cd32530a7 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 01d407b0-a7cf-4222-9f2d-54b99eeeed84] Took 8.24 seconds to build instance.
Oct 23 21:42:00 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-bf89be4d-be48-4f59-9a98-d64cd32530a7 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lock "01d407b0-a7cf-4222-9f2d-54b99eeeed84" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.377s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:42:00 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:42:01 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:42:01 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:42:01 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 21:42:02 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:42:03 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:42:03 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:42:03 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Starting heal instance info cache {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 21:42:03 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "refresh_cache-2cae5b4d-96a0-41ae-9643-b7bf09581988" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:42:03 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquired lock "refresh_cache-2cae5b4d-96a0-41ae-9643-b7bf09581988" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:42:03 user nova-compute[74337]: DEBUG nova.network.neutron [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Forcefully refreshing network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 21:42:03 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:42:04 user nova-compute[74337]: DEBUG nova.network.neutron [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Updating instance_info_cache with network_info: [{"id": "fc418a9a-364a-4e52-a073-58a567680beb", "address": "fa:16:3e:5b:b9:06", "network": {"id": "e3ef8fef-f49d-46a8-b357-1ee41c4a17e4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-952280610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3abafb229d604b65a3fb50f0eebc70ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc418a9a-36", "ovs_interfaceid": "fc418a9a-364a-4e52-a073-58a567680beb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:42:04 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Releasing lock "refresh_cache-2cae5b4d-96a0-41ae-9643-b7bf09581988" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:42:04 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Updated the network info_cache for instance {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 21:42:05 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:42:05 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:42:05 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:42:05 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:42:05 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Auditing locally available compute resources for user (node: user) {{(pid=74337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 21:42:05 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:42:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:42:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:42:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:42:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50/disk --force-share --output=json" returned: 0 in 0.280s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:42:06 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 21:42:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56a4b932-486d-4b8d-9616-99e75592432a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:42:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56a4b932-486d-4b8d-9616-99e75592432a/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:42:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56a4b932-486d-4b8d-9616-99e75592432a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:42:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56a4b932-486d-4b8d-9616-99e75592432a/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:42:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/547c4d4c-e0dd-495a-b83f-98426d0a4a99/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:42:06 user nova-compute[74337]: DEBUG os_brick.utils [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:42:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:42:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:42:06 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[055c4304-66bb-44fb-a884-fec019db2239]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f34011b66e40\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:42:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:42:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:42:06 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b33b3ca0-6131-49f9-9e84-cedd1482a615]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:42:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:42:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:42:06 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb5d90ba-96ee-4ad7-8766-9faef68a37e0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:42:06 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eccd9b6-351d-4ce1-983a-a788084ce008]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:42:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Running cmd (subprocess): nvme version {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:42:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] 'nvme version' failed. Not Retrying. {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 21:42:06 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] nvme not present on system {{(pid=74337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 21:42:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/547c4d4c-e0dd-495a-b83f-98426d0a4a99/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:42:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/547c4d4c-e0dd-495a-b83f-98426d0a4a99/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:42:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:42:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 21:42:06 user nova-compute[74337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 21:42:06 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ff26f76-6159-4454-bcf3-ae771ddbe1ba]: (4, '') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:42:06 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 21:42:06 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 21:42:06 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] LIGHTOS: no hostnqn found. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 21:42:06 user nova-compute[74337]: DEBUG os_brick.utils [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f34011b66e40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:42:06 user nova-compute[74337]: DEBUG nova.virt.block_device [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] Updating existing volume attachment record: d0899d7d-f29d-4a6b-9d2f-08b1bdcec6e4 {{(pid=74337) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 21:42:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/547c4d4c-e0dd-495a-b83f-98426d0a4a99/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:42:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba8d1d0-5fac-4213-9a50-a4e273710b1b/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:42:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba8d1d0-5fac-4213-9a50-a4e273710b1b/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:42:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba8d1d0-5fac-4213-9a50-a4e273710b1b/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:42:07 user nova-compute[74337]: DEBUG os_brick.utils [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:42:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:42:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:42:07 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa34efb5-042b-4b78-b0e8-8a34b53c3e18]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f34011b66e40\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:42:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:42:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:42:07 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[08e75935-9bd6-4854-9351-503792110300]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:42:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:42:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:42:07 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e83d775a-801d-4987-8ebd-ecf1ed40c6a8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:42:07 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e86050b-5cdf-440e-9b93-c0cdcbceda46]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:42:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Running cmd (subprocess): nvme version {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:42:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] 'nvme version' failed. Not Retrying. {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 21:42:07 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] nvme not present on system {{(pid=74337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 21:42:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba8d1d0-5fac-4213-9a50-a4e273710b1b/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:42:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:42:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01d407b0-a7cf-4222-9f2d-54b99eeeed84/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:42:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 21:42:07 user nova-compute[74337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 21:42:07 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a3c7cc3-7f3e-4624-b659-532cf2231e94]: (4, '') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:42:07 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 21:42:07 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 21:42:07 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] LIGHTOS: no hostnqn found. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 21:42:07 user nova-compute[74337]: DEBUG os_brick.utils [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] <== get_connector_properties: return (179ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f34011b66e40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:42:07 user nova-compute[74337]: DEBUG nova.virt.block_device [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: b531e297-3649-4bab-8e13-10304a002b30] Updating existing volume attachment record: 37a2f82f-cf56-412e-95b0-0864167e2fa3 {{(pid=74337) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 21:42:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01d407b0-a7cf-4222-9f2d-54b99eeeed84/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:42:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01d407b0-a7cf-4222-9f2d-54b99eeeed84/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:42:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01d407b0-a7cf-4222-9f2d-54b99eeeed84/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:42:07 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 21:42:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/749a62c2-7517-4f57-9ba2-b139fe73c4e5/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:42:08 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/749a62c2-7517-4f57-9ba2-b139fe73c4e5/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:42:08 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/749a62c2-7517-4f57-9ba2-b139fe73c4e5/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:42:08 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/749a62c2-7517-4f57-9ba2-b139fe73c4e5/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:42:08 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1189976f-8d02-468d-8fa7-bd5594c5f85a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:42:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:42:08 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1189976f-8d02-468d-8fa7-bd5594c5f85a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:42:08 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1189976f-8d02-468d-8fa7-bd5594c5f85a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:42:08 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1189976f-8d02-468d-8fa7-bd5594c5f85a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:42:09 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:42:09 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:42:09 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Hypervisor/Node resource view: name=user free_ram=7742MB free_disk=25.484031677246094GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 21:42:09 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:42:09 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:42:09 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-9477de0d-bf93-4830-9c2d-feda0b9279f9 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Acquiring lock "d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:42:09 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-9477de0d-bf93-4830-9c2d-feda0b9279f9 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Lock "d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:42:09 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-9477de0d-bf93-4830-9c2d-feda0b9279f9 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Acquiring lock "d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:42:09 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-9477de0d-bf93-4830-9c2d-feda0b9279f9 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Lock "d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:42:09 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-9477de0d-bf93-4830-9c2d-feda0b9279f9 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Lock "d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:42:09 user nova-compute[74337]: INFO nova.compute.manager [None req-9477de0d-bf93-4830-9c2d-feda0b9279f9 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Terminating instance
Oct 23 21:42:09 user nova-compute[74337]: DEBUG nova.compute.manager [None req-9477de0d-bf93-4830-9c2d-feda0b9279f9 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Start destroying the instance on the hypervisor. {{(pid=74337) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 21:42:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:42:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:42:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:42:09 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:42:09 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 2cae5b4d-96a0-41ae-9643-b7bf09581988 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:42:09 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 1189976f-8d02-468d-8fa7-bd5594c5f85a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:42:09 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 0ba8d1d0-5fac-4213-9a50-a4e273710b1b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:42:09 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 547c4d4c-e0dd-495a-b83f-98426d0a4a99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:42:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:42:09 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 00f757cf-e5dd-476f-81c6-670ed2bf6938 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Oct 23 21:42:09 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 56a4b932-486d-4b8d-9616-99e75592432a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:42:09 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 749a62c2-7517-4f57-9ba2-b139fe73c4e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:42:09 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:42:09 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 01d407b0-a7cf-4222-9f2d-54b99eeeed84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:42:09 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance b531e297-3649-4bab-8e13-10304a002b30 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:42:09 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 21:42:09 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 21:42:09 user nova-compute[74337]: DEBUG nova.compute.manager [req-cb397fe3-8bec-44a5-be2c-ac7bba15c16c req-03331633-11cc-4add-961b-5853f0cd2b3a service nova] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Received event network-vif-unplugged-872b2a23-8054-4d26-b798-c0099d1c9a91 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:42:09 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-cb397fe3-8bec-44a5-be2c-ac7bba15c16c req-03331633-11cc-4add-961b-5853f0cd2b3a service nova] Acquiring lock "d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:42:09 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-cb397fe3-8bec-44a5-be2c-ac7bba15c16c req-03331633-11cc-4add-961b-5853f0cd2b3a service nova] Lock "d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:42:09 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-cb397fe3-8bec-44a5-be2c-ac7bba15c16c req-03331633-11cc-4add-961b-5853f0cd2b3a service nova] Lock "d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:42:09 user nova-compute[74337]: DEBUG nova.compute.manager [req-cb397fe3-8bec-44a5-be2c-ac7bba15c16c req-03331633-11cc-4add-961b-5853f0cd2b3a service nova] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] No waiting events found dispatching network-vif-unplugged-872b2a23-8054-4d26-b798-c0099d1c9a91 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:42:09 user nova-compute[74337]: DEBUG nova.compute.manager [req-cb397fe3-8bec-44a5-be2c-ac7bba15c16c req-03331633-11cc-4add-961b-5853f0cd2b3a service nova] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Received event network-vif-unplugged-872b2a23-8054-4d26-b798-c0099d1c9a91 for instance with task_state deleting. {{(pid=74337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 21:42:09 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:42:09 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:42:09 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Compute_service record updated for user:user {{(pid=74337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 21:42:09 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.662s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:42:10 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Instance destroyed successfully.
Oct 23 21:42:10 user nova-compute[74337]: DEBUG nova.objects.instance [None req-9477de0d-bf93-4830-9c2d-feda0b9279f9 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Lazy-loading 'resources' on Instance uuid d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:42:10 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-9477de0d-bf93-4830-9c2d-feda0b9279f9 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:33:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1887044710',display_name='tempest-ServerActionsTestOtherB-server-1887044710',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1887044710',id=3,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHU30kXpNK56Ek7qPPN2svMqEvJefmquCorzEt/taRsaipSAkpLIVwB8P5vsm9bHgo5LnJ4I5wS/V9f0J2TYkkYbtKjnjylT3HdP3iz0AGKDmStPt9PuAI+hC3gVCHen5Q==',key_name='tempest-keypair-1524952332',keypairs=<?>,launch_index=0,launched_at=2023-10-23T21:39:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='17117e60d0d9484d80c0bc8de393921c',ramdisk_id='',reservation_id='r-1ao5mr6t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1301864789',owner_user_name='tempest-ServerActionsTestOtherB-1301864789-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T21:39:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='92570d8849c646d882017142cac1b674',uuid=d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "872b2a23-8054-4d26-b798-c0099d1c9a91", "address": "fa:16:3e:30:a6:90", "network": {"id": "b6a24032-0229-4ebe-83a3-8804e494838c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1472404179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17117e60d0d9484d80c0bc8de393921c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap872b2a23-80", "ovs_interfaceid": "872b2a23-8054-4d26-b798-c0099d1c9a91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 21:42:10 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-9477de0d-bf93-4830-9c2d-feda0b9279f9 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Converting VIF {"id": "872b2a23-8054-4d26-b798-c0099d1c9a91", "address": "fa:16:3e:30:a6:90", "network": {"id": "b6a24032-0229-4ebe-83a3-8804e494838c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1472404179-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17117e60d0d9484d80c0bc8de393921c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap872b2a23-80", "ovs_interfaceid": "872b2a23-8054-4d26-b798-c0099d1c9a91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:42:10 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-9477de0d-bf93-4830-9c2d-feda0b9279f9 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:30:a6:90,bridge_name='br-int',has_traffic_filtering=True,id=872b2a23-8054-4d26-b798-c0099d1c9a91,network=Network(b6a24032-0229-4ebe-83a3-8804e494838c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap872b2a23-80') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:42:10 user nova-compute[74337]: DEBUG os_vif [None req-9477de0d-bf93-4830-9c2d-feda0b9279f9 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:a6:90,bridge_name='br-int',has_traffic_filtering=True,id=872b2a23-8054-4d26-b798-c0099d1c9a91,network=Network(b6a24032-0229-4ebe-83a3-8804e494838c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap872b2a23-80') {{(pid=74337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 21:42:10 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:42:10 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap872b2a23-80, bridge=br-int, if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:42:10 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:42:10 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:42:10 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:42:10 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=59010208-fdf6-4e0a-a727-a5c5e030522a) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:42:10 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:42:10 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:42:10 user nova-compute[74337]: INFO os_vif [None req-9477de0d-bf93-4830-9c2d-feda0b9279f9 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:a6:90,bridge_name='br-int',has_traffic_filtering=True,id=872b2a23-8054-4d26-b798-c0099d1c9a91,network=Network(b6a24032-0229-4ebe-83a3-8804e494838c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap872b2a23-80')
Oct 23 21:42:10 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9477de0d-bf93-4830-9c2d-feda0b9279f9 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] calling os-brick to detach iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 21:42:10 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-9477de0d-bf93-4830-9c2d-feda0b9279f9 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, {'target_iqn': 'iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cQHBUDwS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:42:10 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-9477de0d-bf93-4830-9c2d-feda0b9279f9 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:42:10 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-9477de0d-bf93-4830-9c2d-feda0b9279f9 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:42:10 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-9477de0d-bf93-4830-9c2d-feda0b9279f9 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:42:10 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:42:10 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:42:10 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d864d461-9f70-41ce-95d2-43d3fd2112d2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:42:10 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-9477de0d-bf93-4830-9c2d-feda0b9279f9 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 21:42:10 user nova-compute[74337]: No targets found.
Oct 23 21:42:10 user nova-compute[74337]: iSNS:
Oct 23 21:42:10 user nova-compute[74337]: No targets found.
Oct 23 21:42:10 user nova-compute[74337]: STATIC:
Oct 23 21:42:10 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01
Oct 23 21:42:10 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:42:10 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:42:10 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522
Oct 23 21:42:10 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:42:10 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:42:10 user nova-compute[74337]: FIRMWARE:
Oct 23 21:42:10 user nova-compute[74337]: No targets found.
Oct 23 21:42:10 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:42:10 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-9477de0d-bf93-4830-9c2d-feda0b9279f9 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 21:42:10 user nova-compute[74337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 21:42:10 user nova-compute[74337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 21:42:10 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-9477de0d-bf93-4830-9c2d-feda0b9279f9 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522', 0)] {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 21:42:10 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:42:10 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:42:10 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[34435dba-65ad-4d00-a46e-8b57c5be48ed]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:42:10 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:42:10 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:42:10 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d457c4c0-0700-438b-9e9d-1cb862dad0cf]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:42:10 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-9477de0d-bf93-4830-9c2d-feda0b9279f9 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 (non-flash)
Oct 23 21:42:10 user nova-compute[74337]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01 (non-flash)
Oct 23 21:42:10 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:42:10 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-9477de0d-bf93-4830-9c2d-feda0b9279f9 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 (non-flash)
Oct 23 21:42:10 user nova-compute[74337]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01 (non-flash)
Oct 23 21:42:10 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:42:10 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-9477de0d-bf93-4830-9c2d-feda0b9279f9 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5eec3cd2d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522'): ({'sdc'}, set())}) {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 21:42:10 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-9477de0d-bf93-4830-9c2d-feda0b9279f9 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Removing single pathed devices sdc {{(pid=74337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 21:42:10 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:42:10 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:42:10 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[31dc9b3e-10b2-4a8a-b8a7-7b3168c8b7fa]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:42:10 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:42:10 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:42:10 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[64c0a7b3-283e-4472-a83a-59216aec5970]: (4, ('ok\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:42:10 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-9477de0d-bf93-4830-9c2d-feda0b9279f9 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Flushing IO for device /dev/sdc {{(pid=74337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 21:42:10 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:42:10 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:42:10 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e56371d-7e45-454b-885a-046a41e3b061]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:42:10 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-9477de0d-bf93-4830-9c2d-feda0b9279f9 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 21:42:10 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:42:10 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:42:10 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5763edd-c141-4b19-9e9f-be1f57247a4a]: (4, ('1', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:42:10 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-9477de0d-bf93-4830-9c2d-feda0b9279f9 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 21:42:10 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-9477de0d-bf93-4830-9c2d-feda0b9279f9 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] SCSI volumes sdc have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 21:42:10 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-9477de0d-bf93-4830-9c2d-feda0b9279f9 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522')] {{(pid=74337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 21:42:10 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:42:10 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:42:10 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[4240239b-20dc-4863-a184-9e25e16e26e8]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:42:10 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-9477de0d-bf93-4830-9c2d-feda0b9279f9 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:42:10 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 -p 172.16.0.220:3260 --logout {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:42:10 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:42:10 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e1484fb-4d59-46f7-b102-a3416609439b]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:42:10 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-9477de0d-bf93-4830-9c2d-feda0b9279f9 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522, portal: 172.16.0.220,3260]
Oct 23 21:42:10 user nova-compute[74337]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522, portal: 172.16.0.220,3260] successful.
Oct 23 21:42:10 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:42:10 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 -p 172.16.0.220:3260 --op delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:42:10 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61659946-05f4-49d5-9e10-69b68340b522 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:42:10 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c299d065-10bb-42d2-8080-9540d000143b]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:42:10 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-9477de0d-bf93-4830-9c2d-feda0b9279f9 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:42:10 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-9477de0d-bf93-4830-9c2d-feda0b9279f9 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:42:10 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-9477de0d-bf93-4830-9c2d-feda0b9279f9 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] <== disconnect_volume: return (307ms) None {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:42:10 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9477de0d-bf93-4830-9c2d-feda0b9279f9 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Disconnected iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 21:42:10 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-9477de0d-bf93-4830-9c2d-feda0b9279f9 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Deleting instance files /opt/stack/data/nova/instances/d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50_del
Oct 23 21:42:10 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-9477de0d-bf93-4830-9c2d-feda0b9279f9 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Deletion of /opt/stack/data/nova/instances/d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50_del complete
Oct 23 21:42:10 user nova-compute[74337]: INFO nova.compute.manager [None req-9477de0d-bf93-4830-9c2d-feda0b9279f9 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Took 1.27 seconds to destroy the instance on the hypervisor.
Oct 23 21:42:10 user nova-compute[74337]: DEBUG oslo.service.loopingcall [None req-9477de0d-bf93-4830-9c2d-feda0b9279f9 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74337) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 21:42:10 user nova-compute[74337]: DEBUG nova.compute.manager [-] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Deallocating network for instance {{(pid=74337) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 21:42:10 user nova-compute[74337]: DEBUG nova.network.neutron [-] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] deallocate_for_instance() {{(pid=74337) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 21:42:10 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:42:10 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:42:10 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:42:11 user nova-compute[74337]: DEBUG nova.network.neutron [-] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Updating instance_info_cache with network_info: [] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:42:11 user nova-compute[74337]: INFO nova.compute.manager [-] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Took 0.87 seconds to deallocate network for instance.
Oct 23 21:42:11 user nova-compute[74337]: DEBUG nova.compute.manager [req-67202a82-96ff-44fd-af76-a69a32fd3777 req-a5a97534-1e8c-4c0b-b026-8e75ffade108 service nova] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Received event network-vif-deleted-872b2a23-8054-4d26-b798-c0099d1c9a91 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:42:11 user nova-compute[74337]: DEBUG nova.compute.manager [req-e9ebfac3-0865-49e2-ba06-eb8e9682dd62 req-1ca2d395-8e2e-4404-b00d-8f06fcbdbd89 service nova] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Received event network-vif-plugged-872b2a23-8054-4d26-b798-c0099d1c9a91 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:42:11 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-e9ebfac3-0865-49e2-ba06-eb8e9682dd62 req-1ca2d395-8e2e-4404-b00d-8f06fcbdbd89 service nova] Acquiring lock "d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:42:11 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-e9ebfac3-0865-49e2-ba06-eb8e9682dd62 req-1ca2d395-8e2e-4404-b00d-8f06fcbdbd89 service nova] Lock "d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:42:11 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-e9ebfac3-0865-49e2-ba06-eb8e9682dd62 req-1ca2d395-8e2e-4404-b00d-8f06fcbdbd89 service nova] Lock "d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:42:11 user nova-compute[74337]: DEBUG nova.compute.manager [req-e9ebfac3-0865-49e2-ba06-eb8e9682dd62 req-1ca2d395-8e2e-4404-b00d-8f06fcbdbd89 service nova] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] No waiting events found dispatching network-vif-plugged-872b2a23-8054-4d26-b798-c0099d1c9a91 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:42:11 user nova-compute[74337]: WARNING nova.compute.manager [req-e9ebfac3-0865-49e2-ba06-eb8e9682dd62 req-1ca2d395-8e2e-4404-b00d-8f06fcbdbd89 service nova] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Received unexpected event network-vif-plugged-872b2a23-8054-4d26-b798-c0099d1c9a91 for instance with vm_state active and task_state deleting.
Oct 23 21:42:12 user nova-compute[74337]: INFO nova.compute.manager [None req-9477de0d-bf93-4830-9c2d-feda0b9279f9 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] [instance: d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50] Took 0.95 seconds to detach 1 volumes for instance.
Oct 23 21:42:12 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-9477de0d-bf93-4830-9c2d-feda0b9279f9 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:42:12 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-9477de0d-bf93-4830-9c2d-feda0b9279f9 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:42:12 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-9477de0d-bf93-4830-9c2d-feda0b9279f9 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:42:12 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-9477de0d-bf93-4830-9c2d-feda0b9279f9 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:42:12 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-9477de0d-bf93-4830-9c2d-feda0b9279f9 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.366s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:42:12 user nova-compute[74337]: INFO nova.scheduler.client.report [None req-9477de0d-bf93-4830-9c2d-feda0b9279f9 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Deleted allocations for instance d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50
Oct 23 21:42:12 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-9477de0d-bf93-4830-9c2d-feda0b9279f9 tempest-ServerActionsTestOtherB-1301864789 tempest-ServerActionsTestOtherB-1301864789-project-member] Lock "d1dbccc7-0a00-4b8b-813d-e3ca38ee0d50" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.654s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:42:13 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:42:15 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:42:18 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:42:20 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:42:23 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:42:24 user nova-compute[74337]: DEBUG nova.compute.manager [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] Start spawning the instance on the hypervisor. {{(pid=74337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 21:42:24 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] Creating instance directory {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 21:42:24 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] Creating image(s)
Oct 23 21:42:24 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] Did not create local disks {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 23 21:42:24 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] Ensure instance console log exists: /opt/stack/data/nova/instances/c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d/console.log {{(pid=74337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 21:42:24 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:42:24 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:42:24 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:42:24 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] Start _get_guest_xml network_info=[{"id": "328722f1-b384-495c-8aea-81780b2d9ca1", "address": "fa:16:3e:28:35:83", "network": {"id": "5f62b1d8-d5d0-4ff9-922b-fc6e72fb640d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-655282105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b85c4f783a4ee7ab67422b49da85ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap328722f1-b3", "ovs_interfaceid": "328722f1-b384-495c-8aea-81780b2d9ca1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T21:29:21Z,direct_url=<?>,disk_format='qcow2',id=d859d89d-998d-4109-b26a-0d6e28152932,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ff43462300764979a6cf688444336a56',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T21:29:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'd0899d7d-f29d-4a6b-9d2f-08b1bdcec6e4', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YSOQyrej', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d', 'attached_at': '', 'detached_at': '', 'volume_id': '8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4', 'serial': '8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4'}, 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 21:42:24 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:42:24 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:42:24 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 21:42:24 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] CPU controller missing on host. {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 21:42:24 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 21:42:24 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] CPU controller found on host. {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 21:42:24 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 21:42:24 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T21:29:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T21:29:21Z,direct_url=<?>,disk_format='qcow2',id=d859d89d-998d-4109-b26a-0d6e28152932,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ff43462300764979a6cf688444336a56',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T21:29:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 21:42:24 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Flavor limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 21:42:24 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Image limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 21:42:24 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Flavor pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 21:42:24 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Image pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 21:42:24 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 21:42:24 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 21:42:24 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 21:42:24 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Got 1 possible topologies {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 21:42:24 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 21:42:24 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 21:42:24 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] Calling os-brick to attach iSCSI Volume {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 21:42:24 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YSOQyrej', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:42:24 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:42:24 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:42:24 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:42:24 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:42:24 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:42:24 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:42:24 user nova-compute[74337]: INFO os_brick.initiator.connectors.iscsi [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 21:42:24 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 -p 172.16.0.220:3260 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:42:24 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:42:24 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d897abd8-b0ef-4181-ab30-acc4959951ae]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:42:24 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 21:42:24 user nova-compute[74337]:  {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:42:24 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 -p 172.16.0.220:3260 --interface default --op new {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:42:24 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:42:24 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[015f654a-1b20-4db5-8fd4-5b03cef4d0dc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4] added\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:42:24 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4] added
Oct 23 21:42:24 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:42:24 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:42:24 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:42:24 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1280c8a-defa-4c07-9c3c-9c1a29b96205]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:42:24 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:42:24 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:42:24 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:42:24 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae486fe6-2e11-46e4-b455-04dec945dc1e]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:42:24 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:42:24 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YSOQyrej {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:42:24 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YSOQyrej" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:42:24 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d84de3ba-7529-4502-a567-a58d816d770c]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:42:24 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YSOQyrej'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:42:24 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:42:24 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:42:24 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a72e82-8a2e-4f37-b99a-7ef2410a918f]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:42:24 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:42:24 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:42:24 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:42:24 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[794708a7-6d23-405c-8733-80eecacc5539]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:42:24 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01 (non-flash)
Oct 23 21:42:24 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:42:24 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01 (non-flash)
Oct 23 21:42:24 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:42:24 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 -p 172.16.0.220:3260 --login {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:42:24 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:42:24 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[251db464-d8b7-47f6-8e59-63c84d0db7cd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:42:24 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4, portal: 172.16.0.220,3260]
Oct 23 21:42:24 user nova-compute[74337]: Login to [iface: default, target: iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4, portal: 172.16.0.220,3260] successful.
Oct 23 21:42:24 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:42:24 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:42:24 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:42:24 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e000968-6762-46d8-b83d-b4c6ae0a907b]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:42:24 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:42:24 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:42:24 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:42:24 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[57f502f1-88b8-4a71-b64c-788bb8bb561b]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:42:24 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01 (non-flash)
Oct 23 21:42:24 user nova-compute[74337]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:42:24 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:42:24 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01 (non-flash)
Oct 23 21:42:24 user nova-compute[74337]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:42:24 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:42:24 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:42:24 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Connected to 172.16.0.220:3260 {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 21:42:24 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] HCTL ('34', '-', '-', 0) found on session 22 with lun 0 {{(pid=74337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 21:42:24 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 21:42:24 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:42:24 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:42:24 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b3b334c-5a96-4bbe-9692-4a5c7611fe03]: (4, ('- - 0', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:42:24 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Searching for a device in session 22 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 21:42:24 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YSOQyrej', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 21:42:25 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:42:25 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:42:25 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '26366393234653661', 'path': '/dev/sdc'} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:42:25 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26366393234653661', 'path': '/dev/sdc'} {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 21:42:25 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:41:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1651996924',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1651996924',id=20,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83b85c4f783a4ee7ab67422b49da85ca',ramdisk_id='',reservation_id='r-53a64lky',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1944032280',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:41:51Z,user_data=None,user_id='a2e424dd3c684c808de14c2a9c3c1ed6',uuid=c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "328722f1-b384-495c-8aea-81780b2d9ca1", "address": "fa:16:3e:28:35:83", "network": {"id": "5f62b1d8-d5d0-4ff9-922b-fc6e72fb640d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-655282105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b85c4f783a4ee7ab67422b49da85ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap328722f1-b3", "ovs_interfaceid": "328722f1-b384-495c-8aea-81780b2d9ca1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 21:42:25 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Converting VIF {"id": "328722f1-b384-495c-8aea-81780b2d9ca1", "address": "fa:16:3e:28:35:83", "network": {"id": "5f62b1d8-d5d0-4ff9-922b-fc6e72fb640d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-655282105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b85c4f783a4ee7ab67422b49da85ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap328722f1-b3", "ovs_interfaceid": "328722f1-b384-495c-8aea-81780b2d9ca1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:42:25 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:35:83,bridge_name='br-int',has_traffic_filtering=True,id=328722f1-b384-495c-8aea-81780b2d9ca1,network=Network(5f62b1d8-d5d0-4ff9-922b-fc6e72fb640d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap328722f1-b3') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:42:25 user nova-compute[74337]: DEBUG nova.objects.instance [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lazy-loading 'pci_devices' on Instance uuid c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:42:25 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] End _get_guest_xml xml=<domain type="kvm">
Oct 23 21:42:25 user nova-compute[74337]:   <uuid>c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d</uuid>
Oct 23 21:42:25 user nova-compute[74337]:   <name>instance-00000014</name>
Oct 23 21:42:25 user nova-compute[74337]:   <memory>524288</memory>
Oct 23 21:42:25 user nova-compute[74337]:   <vcpu>1</vcpu>
Oct 23 21:42:25 user nova-compute[74337]:   <metadata>
Oct 23 21:42:25 user nova-compute[74337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 21:42:25 user nova-compute[74337]:       <nova:package version="0.0.0"/>
Oct 23 21:42:25 user nova-compute[74337]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1651996924</nova:name>
Oct 23 21:42:25 user nova-compute[74337]:       <nova:creationTime>2023-10-23 21:42:24</nova:creationTime>
Oct 23 21:42:25 user nova-compute[74337]:       <nova:flavor name="m1.tiny">
Oct 23 21:42:25 user nova-compute[74337]:         <nova:memory>512</nova:memory>
Oct 23 21:42:25 user nova-compute[74337]:         <nova:disk>1</nova:disk>
Oct 23 21:42:25 user nova-compute[74337]:         <nova:swap>0</nova:swap>
Oct 23 21:42:25 user nova-compute[74337]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 21:42:25 user nova-compute[74337]:         <nova:vcpus>1</nova:vcpus>
Oct 23 21:42:25 user nova-compute[74337]:       </nova:flavor>
Oct 23 21:42:25 user nova-compute[74337]:       <nova:owner>
Oct 23 21:42:25 user nova-compute[74337]:         <nova:user uuid="a2e424dd3c684c808de14c2a9c3c1ed6">tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member</nova:user>
Oct 23 21:42:25 user nova-compute[74337]:         <nova:project uuid="83b85c4f783a4ee7ab67422b49da85ca">tempest-ServerBootFromVolumeStableRescueTest-1944032280</nova:project>
Oct 23 21:42:25 user nova-compute[74337]:       </nova:owner>
Oct 23 21:42:25 user nova-compute[74337]:       <nova:root type="image" uuid="d859d89d-998d-4109-b26a-0d6e28152932"/>
Oct 23 21:42:25 user nova-compute[74337]:       <nova:ports>
Oct 23 21:42:25 user nova-compute[74337]:         <nova:port uuid="328722f1-b384-495c-8aea-81780b2d9ca1">
Oct 23 21:42:25 user nova-compute[74337]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 23 21:42:25 user nova-compute[74337]:         </nova:port>
Oct 23 21:42:25 user nova-compute[74337]:       </nova:ports>
Oct 23 21:42:25 user nova-compute[74337]:     </nova:instance>
Oct 23 21:42:25 user nova-compute[74337]:   </metadata>
Oct 23 21:42:25 user nova-compute[74337]:   <sysinfo type="smbios">
Oct 23 21:42:25 user nova-compute[74337]:     <system>
Oct 23 21:42:25 user nova-compute[74337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 21:42:25 user nova-compute[74337]:       <entry name="product">OpenStack Nova</entry>
Oct 23 21:42:25 user nova-compute[74337]:       <entry name="version">0.0.0</entry>
Oct 23 21:42:25 user nova-compute[74337]:       <entry name="serial">c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d</entry>
Oct 23 21:42:25 user nova-compute[74337]:       <entry name="uuid">c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d</entry>
Oct 23 21:42:25 user nova-compute[74337]:       <entry name="family">Virtual Machine</entry>
Oct 23 21:42:25 user nova-compute[74337]:     </system>
Oct 23 21:42:25 user nova-compute[74337]:   </sysinfo>
Oct 23 21:42:25 user nova-compute[74337]:   <os>
Oct 23 21:42:25 user nova-compute[74337]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 21:42:25 user nova-compute[74337]:     <boot dev="hd"/>
Oct 23 21:42:25 user nova-compute[74337]:     <smbios mode="sysinfo"/>
Oct 23 21:42:25 user nova-compute[74337]:   </os>
Oct 23 21:42:25 user nova-compute[74337]:   <features>
Oct 23 21:42:25 user nova-compute[74337]:     <acpi/>
Oct 23 21:42:25 user nova-compute[74337]:     <apic/>
Oct 23 21:42:25 user nova-compute[74337]:     <vmcoreinfo/>
Oct 23 21:42:25 user nova-compute[74337]:   </features>
Oct 23 21:42:25 user nova-compute[74337]:   <clock offset="utc">
Oct 23 21:42:25 user nova-compute[74337]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 21:42:25 user nova-compute[74337]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 21:42:25 user nova-compute[74337]:     <timer name="hpet" present="no"/>
Oct 23 21:42:25 user nova-compute[74337]:   </clock>
Oct 23 21:42:25 user nova-compute[74337]:   <cpu mode="custom" match="exact">
Oct 23 21:42:25 user nova-compute[74337]:     <model>Nehalem</model>
Oct 23 21:42:25 user nova-compute[74337]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 21:42:25 user nova-compute[74337]:   </cpu>
Oct 23 21:42:25 user nova-compute[74337]:   <devices>
Oct 23 21:42:25 user nova-compute[74337]:     <disk type="block" device="disk">
Oct 23 21:42:25 user nova-compute[74337]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 21:42:25 user nova-compute[74337]:       <source dev="/dev/sdc"/>
Oct 23 21:42:25 user nova-compute[74337]:       <target dev="vda" bus="virtio"/>
Oct 23 21:42:25 user nova-compute[74337]:       <serial>8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4</serial>
Oct 23 21:42:25 user nova-compute[74337]:     </disk>
Oct 23 21:42:25 user nova-compute[74337]:     <interface type="ethernet">
Oct 23 21:42:25 user nova-compute[74337]:       <mac address="fa:16:3e:28:35:83"/>
Oct 23 21:42:25 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:42:25 user nova-compute[74337]:       <mtu size="1442"/>
Oct 23 21:42:25 user nova-compute[74337]:       <target dev="tap328722f1-b3"/>
Oct 23 21:42:25 user nova-compute[74337]:     </interface>
Oct 23 21:42:25 user nova-compute[74337]:     <serial type="pty">
Oct 23 21:42:25 user nova-compute[74337]:       <log file="/opt/stack/data/nova/instances/c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d/console.log" append="off"/>
Oct 23 21:42:25 user nova-compute[74337]:     </serial>
Oct 23 21:42:25 user nova-compute[74337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 21:42:25 user nova-compute[74337]:     <video>
Oct 23 21:42:25 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:42:25 user nova-compute[74337]:     </video>
Oct 23 21:42:25 user nova-compute[74337]:     <rng model="virtio">
Oct 23 21:42:25 user nova-compute[74337]:       <backend model="random">/dev/urandom</backend>
Oct 23 21:42:25 user nova-compute[74337]:     </rng>
Oct 23 21:42:25 user nova-compute[74337]:     <controller type="usb" index="0" model="none"/>
Oct 23 21:42:25 user nova-compute[74337]:     <memballoon model="virtio">
Oct 23 21:42:25 user nova-compute[74337]:       <stats period="10"/>
Oct 23 21:42:25 user nova-compute[74337]:     </memballoon>
Oct 23 21:42:25 user nova-compute[74337]:   </devices>
Oct 23 21:42:25 user nova-compute[74337]: </domain>
Oct 23 21:42:25 user nova-compute[74337]:  {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 21:42:25 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:41:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1651996924',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1651996924',id=20,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83b85c4f783a4ee7ab67422b49da85ca',ramdisk_id='',reservation_id='r-53a64lky',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1944032280',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:41:51Z,user_data=None,user_id='a2e424dd3c684c808de14c2a9c3c1ed6',uuid=c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "328722f1-b384-495c-8aea-81780b2d9ca1", "address": "fa:16:3e:28:35:83", "network": {"id": "5f62b1d8-d5d0-4ff9-922b-fc6e72fb640d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-655282105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b85c4f783a4ee7ab67422b49da85ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap328722f1-b3", "ovs_interfaceid": "328722f1-b384-495c-8aea-81780b2d9ca1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 21:42:25 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Converting VIF {"id": "328722f1-b384-495c-8aea-81780b2d9ca1", "address": "fa:16:3e:28:35:83", "network": {"id": "5f62b1d8-d5d0-4ff9-922b-fc6e72fb640d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-655282105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b85c4f783a4ee7ab67422b49da85ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap328722f1-b3", "ovs_interfaceid": "328722f1-b384-495c-8aea-81780b2d9ca1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:42:25 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:35:83,bridge_name='br-int',has_traffic_filtering=True,id=328722f1-b384-495c-8aea-81780b2d9ca1,network=Network(5f62b1d8-d5d0-4ff9-922b-fc6e72fb640d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap328722f1-b3') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:42:25 user nova-compute[74337]: DEBUG os_vif [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:35:83,bridge_name='br-int',has_traffic_filtering=True,id=328722f1-b384-495c-8aea-81780b2d9ca1,network=Network(5f62b1d8-d5d0-4ff9-922b-fc6e72fb640d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap328722f1-b3') {{(pid=74337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 21:42:25 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:42:25 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:42:25 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 21:42:25 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:42:25 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2e0d8f10-a893-5cbe-94cc-56f59f141a5c', '_type': 'linux-noop'}}, row=False) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:42:25 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:42:25 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:42:25 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:42:25 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap328722f1-b3, may_exist=True, interface_attrs={}) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:42:25 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap328722f1-b3, col_values=(('qos', UUID('7fadbe8c-bca6-41b0-8bf4-d89b494612ca')),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:42:25 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap328722f1-b3, col_values=(('external_ids', {'iface-id': '328722f1-b384-495c-8aea-81780b2d9ca1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:35:83', 'vm-uuid': 'c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d'}),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:42:25 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:42:25 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:42:25 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:42:25 user nova-compute[74337]: INFO os_vif [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:35:83,bridge_name='br-int',has_traffic_filtering=True,id=328722f1-b384-495c-8aea-81780b2d9ca1,network=Network(5f62b1d8-d5d0-4ff9-922b-fc6e72fb640d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap328722f1-b3')
Oct 23 21:42:25 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] No BDM found with device name vda, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 21:42:25 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] No VIF found with MAC fa:16:3e:28:35:83, not building metadata {{(pid=74337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 21:42:27 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:42:27 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:42:27 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:42:27 user nova-compute[74337]: DEBUG nova.compute.manager [req-4e47786d-9e29-42c1-b36b-72b76839df8b req-64110143-19c2-40ab-9d30-b6db33226f17 service nova] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] Received event network-vif-plugged-328722f1-b384-495c-8aea-81780b2d9ca1 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:42:27 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-4e47786d-9e29-42c1-b36b-72b76839df8b req-64110143-19c2-40ab-9d30-b6db33226f17 service nova] Acquiring lock "c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:42:27 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-4e47786d-9e29-42c1-b36b-72b76839df8b req-64110143-19c2-40ab-9d30-b6db33226f17 service nova] Lock "c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:42:27 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-4e47786d-9e29-42c1-b36b-72b76839df8b req-64110143-19c2-40ab-9d30-b6db33226f17 service nova] Lock "c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:42:27 user nova-compute[74337]: DEBUG nova.compute.manager [req-4e47786d-9e29-42c1-b36b-72b76839df8b req-64110143-19c2-40ab-9d30-b6db33226f17 service nova] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] No waiting events found dispatching network-vif-plugged-328722f1-b384-495c-8aea-81780b2d9ca1 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:42:27 user nova-compute[74337]: WARNING nova.compute.manager [req-4e47786d-9e29-42c1-b36b-72b76839df8b req-64110143-19c2-40ab-9d30-b6db33226f17 service nova] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] Received unexpected event network-vif-plugged-328722f1-b384-495c-8aea-81780b2d9ca1 for instance with vm_state building and task_state spawning.
Oct 23 21:42:27 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:42:28 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:42:29 user nova-compute[74337]: DEBUG nova.compute.manager [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] Instance event wait completed in 0 seconds for  {{(pid=74337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 21:42:29 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] Guest created on hypervisor {{(pid=74337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 21:42:29 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] Instance spawned successfully.
Oct 23 21:42:29 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 21:42:29 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] Found default for hw_cdrom_bus of ide {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:42:29 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] Found default for hw_disk_bus of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:42:29 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] Found default for hw_input_bus of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:42:29 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] Found default for hw_pointer_model of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:42:29 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] Found default for hw_video_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:42:29 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] Found default for hw_vif_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:42:29 user nova-compute[74337]: DEBUG nova.compute.manager [req-f33a9fb2-4d7c-42bf-8aec-a5d6092ad5be req-24760c91-37ac-469f-b39f-dfcfd0e9487d service nova] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] Received event network-vif-plugged-328722f1-b384-495c-8aea-81780b2d9ca1 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:42:29 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-f33a9fb2-4d7c-42bf-8aec-a5d6092ad5be req-24760c91-37ac-469f-b39f-dfcfd0e9487d service nova] Acquiring lock "c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:42:29 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-f33a9fb2-4d7c-42bf-8aec-a5d6092ad5be req-24760c91-37ac-469f-b39f-dfcfd0e9487d service nova] Lock "c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:42:29 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-f33a9fb2-4d7c-42bf-8aec-a5d6092ad5be req-24760c91-37ac-469f-b39f-dfcfd0e9487d service nova] Lock "c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:42:29 user nova-compute[74337]: DEBUG nova.compute.manager [req-f33a9fb2-4d7c-42bf-8aec-a5d6092ad5be req-24760c91-37ac-469f-b39f-dfcfd0e9487d service nova] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] No waiting events found dispatching network-vif-plugged-328722f1-b384-495c-8aea-81780b2d9ca1 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:42:29 user nova-compute[74337]: WARNING nova.compute.manager [req-f33a9fb2-4d7c-42bf-8aec-a5d6092ad5be req-24760c91-37ac-469f-b39f-dfcfd0e9487d service nova] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] Received unexpected event network-vif-plugged-328722f1-b384-495c-8aea-81780b2d9ca1 for instance with vm_state building and task_state spawning.
Oct 23 21:42:29 user nova-compute[74337]: INFO nova.compute.manager [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] Took 5.15 seconds to spawn the instance on the hypervisor.
Oct 23 21:42:29 user nova-compute[74337]: DEBUG nova.compute.manager [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] Checking state {{(pid=74337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 21:42:29 user nova-compute[74337]: INFO nova.compute.manager [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] Took 39.57 seconds to build instance.
Oct 23 21:42:29 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-a91b9fa9-301a-4f98-a027-b0846734bd57 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lock "c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 39.688s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:42:30 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:42:33 user nova-compute[74337]: DEBUG nova.compute.manager [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: b531e297-3649-4bab-8e13-10304a002b30] Start spawning the instance on the hypervisor. {{(pid=74337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 21:42:33 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: b531e297-3649-4bab-8e13-10304a002b30] Creating instance directory {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 21:42:33 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: b531e297-3649-4bab-8e13-10304a002b30] Creating image(s)
Oct 23 21:42:33 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: b531e297-3649-4bab-8e13-10304a002b30] Did not create local disks {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 23 21:42:33 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: b531e297-3649-4bab-8e13-10304a002b30] Ensure instance console log exists: /opt/stack/data/nova/instances/b531e297-3649-4bab-8e13-10304a002b30/console.log {{(pid=74337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 21:42:33 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:42:33 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:42:33 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:42:33 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: b531e297-3649-4bab-8e13-10304a002b30] Start _get_guest_xml network_info=[{"id": "104a5da2-c546-44ed-9d19-d4f7e0875baa", "address": "fa:16:3e:ae:37:51", "network": {"id": "5a18e96f-a6eb-4989-9be3-154b54928b03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-507511840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb567547bd4941fb87435a841c9d17c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap104a5da2-c5", "ovs_interfaceid": "104a5da2-c546-44ed-9d19-d4f7e0875baa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '37a2f82f-cf56-412e-95b0-0864167e2fa3', 'delete_on_termination': True, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:611608fb-34d9-455e-9fdd-603b5897e666', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mKXBxTda', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b531e297-3649-4bab-8e13-10304a002b30', 'attached_at': '', 'detached_at': '', 'volume_id': '611608fb-34d9-455e-9fdd-603b5897e666', 'serial': '611608fb-34d9-455e-9fdd-603b5897e666'}, 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 21:42:33 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:42:33 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:42:33 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 21:42:33 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] CPU controller missing on host. {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 21:42:33 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 21:42:33 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] CPU controller found on host. {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 21:42:33 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 21:42:33 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T21:29:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 21:42:33 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Flavor limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 21:42:33 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Image limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 21:42:33 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Flavor pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 21:42:33 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Image pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 21:42:33 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 21:42:33 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 21:42:33 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 21:42:33 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Got 1 possible topologies {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 21:42:33 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 21:42:33 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 21:42:33 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: b531e297-3649-4bab-8e13-10304a002b30] Calling os-brick to attach iSCSI Volume {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 21:42:33 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:611608fb-34d9-455e-9fdd-603b5897e666', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mKXBxTda', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:42:33 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:42:33 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:42:33 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:42:33 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:42:33 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:611608fb-34d9-455e-9fdd-603b5897e666" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:42:33 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:611608fb-34d9-455e-9fdd-603b5897e666" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:42:33 user nova-compute[74337]: INFO os_brick.initiator.connectors.iscsi [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 21:42:33 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:611608fb-34d9-455e-9fdd-603b5897e666 -p 172.16.0.220:3260 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:42:33 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:611608fb-34d9-455e-9fdd-603b5897e666 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:42:33 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[761de7de-b272-4ddb-9732-fb3a475fea0b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:42:33 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 21:42:33 user nova-compute[74337]:  {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:42:33 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:611608fb-34d9-455e-9fdd-603b5897e666 -p 172.16.0.220:3260 --interface default --op new {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:42:33 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:611608fb-34d9-455e-9fdd-603b5897e666 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:42:33 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a10262-da2d-47a7-ae86-ca3123523b40]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:611608fb-34d9-455e-9fdd-603b5897e666] added\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:42:33 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:611608fb-34d9-455e-9fdd-603b5897e666] added
Oct 23 21:42:33 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:42:33 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:611608fb-34d9-455e-9fdd-603b5897e666 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:42:33 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:611608fb-34d9-455e-9fdd-603b5897e666 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:42:33 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[df8c9472-066b-4c75-8015-6cbf5ed57c1a]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:42:33 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:42:33 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:611608fb-34d9-455e-9fdd-603b5897e666 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:42:33 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:611608fb-34d9-455e-9fdd-603b5897e666 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:42:33 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b65ef1-a368-4a2a-879a-4f4fe2d515f7]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:42:33 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:42:33 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:611608fb-34d9-455e-9fdd-603b5897e666 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mKXBxTda {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:42:33 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:611608fb-34d9-455e-9fdd-603b5897e666 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mKXBxTda" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:42:33 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[fed85c46-0f71-49b6-8ff8-234f36c45f10]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:42:33 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mKXBxTda'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:42:33 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:611608fb-34d9-455e-9fdd-603b5897e666 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:42:34 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:611608fb-34d9-455e-9fdd-603b5897e666 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:42:34 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b0f7ff-4c5e-44ab-b2e6-4df9df92be70]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:42:34 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:42:34 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:42:34 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:42:34 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c9d8c3-2410-4801-8cd6-1c72abda610c]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:42:34 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01 (non-flash)
Oct 23 21:42:34 user nova-compute[74337]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:42:34 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:42:34 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01 (non-flash)
Oct 23 21:42:34 user nova-compute[74337]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:42:34 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:42:34 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:611608fb-34d9-455e-9fdd-603b5897e666 -p 172.16.0.220:3260 --login {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:42:34 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:611608fb-34d9-455e-9fdd-603b5897e666 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:42:34 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[5adfc6e9-7944-43bb-aa67-1ead76dfd7aa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:611608fb-34d9-455e-9fdd-603b5897e666, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:611608fb-34d9-455e-9fdd-603b5897e666, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:42:34 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:611608fb-34d9-455e-9fdd-603b5897e666, portal: 172.16.0.220,3260]
Oct 23 21:42:34 user nova-compute[74337]: Login to [iface: default, target: iqn.2010-10.org.openstack:611608fb-34d9-455e-9fdd-603b5897e666, portal: 172.16.0.220,3260] successful.
Oct 23 21:42:34 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:42:34 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:611608fb-34d9-455e-9fdd-603b5897e666 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:42:34 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:611608fb-34d9-455e-9fdd-603b5897e666 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:42:34 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4de4bad-8250-455f-bb0f-bb0246565a9e]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:42:34 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:42:34 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:42:34 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:42:34 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d5e93c-3534-4c10-bfcd-d9330a526814]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611608fb-34d9-455e-9fdd-603b5897e666 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:42:34 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01 (non-flash)
Oct 23 21:42:34 user nova-compute[74337]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:42:34 user nova-compute[74337]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611608fb-34d9-455e-9fdd-603b5897e666 (non-flash)
Oct 23 21:42:34 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:42:34 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01 (non-flash)
Oct 23 21:42:34 user nova-compute[74337]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:42:34 user nova-compute[74337]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611608fb-34d9-455e-9fdd-603b5897e666 (non-flash)
Oct 23 21:42:34 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:42:34 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:611608fb-34d9-455e-9fdd-603b5897e666" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:42:34 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Connected to 172.16.0.220:3260 {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 21:42:34 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] HCTL ('35', '-', '-', 0) found on session 23 with lun 0 {{(pid=74337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 21:42:34 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 21:42:34 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:42:34 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:42:34 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[282b90c5-8728-4217-a9d9-83ce49f31833]: (4, ('- - 0', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:42:34 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Searching for a device in session 23 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 21:42:34 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:611608fb-34d9-455e-9fdd-603b5897e666', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mKXBxTda', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 21:42:35 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:42:35 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '26562623961376537', 'path': '/dev/sdd'} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:42:35 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: b531e297-3649-4bab-8e13-10304a002b30] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26562623961376537', 'path': '/dev/sdd'} {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 21:42:35 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:41:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2100654115',display_name='tempest-TestVolumeBootPattern-server-2100654115',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2100654115',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb567547bd4941fb87435a841c9d17c4',ramdisk_id='',reservation_id='r-fc3w6u1u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-499971371',owner_user_name='tempest-TestVolumeBootPattern-499971371-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:41:56Z,user_data=None,user_id='0c3e635e8e5447138a7f2db11695574c',uuid=b531e297-3649-4bab-8e13-10304a002b30,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "104a5da2-c546-44ed-9d19-d4f7e0875baa", "address": "fa:16:3e:ae:37:51", "network": {"id": "5a18e96f-a6eb-4989-9be3-154b54928b03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-507511840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb567547bd4941fb87435a841c9d17c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap104a5da2-c5", "ovs_interfaceid": "104a5da2-c546-44ed-9d19-d4f7e0875baa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 21:42:35 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Converting VIF {"id": "104a5da2-c546-44ed-9d19-d4f7e0875baa", "address": "fa:16:3e:ae:37:51", "network": {"id": "5a18e96f-a6eb-4989-9be3-154b54928b03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-507511840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb567547bd4941fb87435a841c9d17c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap104a5da2-c5", "ovs_interfaceid": "104a5da2-c546-44ed-9d19-d4f7e0875baa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:42:35 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:37:51,bridge_name='br-int',has_traffic_filtering=True,id=104a5da2-c546-44ed-9d19-d4f7e0875baa,network=Network(5a18e96f-a6eb-4989-9be3-154b54928b03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap104a5da2-c5') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:42:35 user nova-compute[74337]: DEBUG nova.objects.instance [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lazy-loading 'pci_devices' on Instance uuid b531e297-3649-4bab-8e13-10304a002b30 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:42:35 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: b531e297-3649-4bab-8e13-10304a002b30] End _get_guest_xml xml=<domain type="kvm">
Oct 23 21:42:35 user nova-compute[74337]:   <uuid>b531e297-3649-4bab-8e13-10304a002b30</uuid>
Oct 23 21:42:35 user nova-compute[74337]:   <name>instance-00000016</name>
Oct 23 21:42:35 user nova-compute[74337]:   <memory>524288</memory>
Oct 23 21:42:35 user nova-compute[74337]:   <vcpu>1</vcpu>
Oct 23 21:42:35 user nova-compute[74337]:   <metadata>
Oct 23 21:42:35 user nova-compute[74337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 21:42:35 user nova-compute[74337]:       <nova:package version="0.0.0"/>
Oct 23 21:42:35 user nova-compute[74337]:       <nova:name>tempest-TestVolumeBootPattern-server-2100654115</nova:name>
Oct 23 21:42:35 user nova-compute[74337]:       <nova:creationTime>2023-10-23 21:42:33</nova:creationTime>
Oct 23 21:42:35 user nova-compute[74337]:       <nova:flavor name="m1.tiny">
Oct 23 21:42:35 user nova-compute[74337]:         <nova:memory>512</nova:memory>
Oct 23 21:42:35 user nova-compute[74337]:         <nova:disk>1</nova:disk>
Oct 23 21:42:35 user nova-compute[74337]:         <nova:swap>0</nova:swap>
Oct 23 21:42:35 user nova-compute[74337]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 21:42:35 user nova-compute[74337]:         <nova:vcpus>1</nova:vcpus>
Oct 23 21:42:35 user nova-compute[74337]:       </nova:flavor>
Oct 23 21:42:35 user nova-compute[74337]:       <nova:owner>
Oct 23 21:42:35 user nova-compute[74337]:         <nova:user uuid="0c3e635e8e5447138a7f2db11695574c">tempest-TestVolumeBootPattern-499971371-project-member</nova:user>
Oct 23 21:42:35 user nova-compute[74337]:         <nova:project uuid="cb567547bd4941fb87435a841c9d17c4">tempest-TestVolumeBootPattern-499971371</nova:project>
Oct 23 21:42:35 user nova-compute[74337]:       </nova:owner>
Oct 23 21:42:35 user nova-compute[74337]:       <nova:ports>
Oct 23 21:42:35 user nova-compute[74337]:         <nova:port uuid="104a5da2-c546-44ed-9d19-d4f7e0875baa">
Oct 23 21:42:35 user nova-compute[74337]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 23 21:42:35 user nova-compute[74337]:         </nova:port>
Oct 23 21:42:35 user nova-compute[74337]:       </nova:ports>
Oct 23 21:42:35 user nova-compute[74337]:     </nova:instance>
Oct 23 21:42:35 user nova-compute[74337]:   </metadata>
Oct 23 21:42:35 user nova-compute[74337]:   <sysinfo type="smbios">
Oct 23 21:42:35 user nova-compute[74337]:     <system>
Oct 23 21:42:35 user nova-compute[74337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 21:42:35 user nova-compute[74337]:       <entry name="product">OpenStack Nova</entry>
Oct 23 21:42:35 user nova-compute[74337]:       <entry name="version">0.0.0</entry>
Oct 23 21:42:35 user nova-compute[74337]:       <entry name="serial">b531e297-3649-4bab-8e13-10304a002b30</entry>
Oct 23 21:42:35 user nova-compute[74337]:       <entry name="uuid">b531e297-3649-4bab-8e13-10304a002b30</entry>
Oct 23 21:42:35 user nova-compute[74337]:       <entry name="family">Virtual Machine</entry>
Oct 23 21:42:35 user nova-compute[74337]:     </system>
Oct 23 21:42:35 user nova-compute[74337]:   </sysinfo>
Oct 23 21:42:35 user nova-compute[74337]:   <os>
Oct 23 21:42:35 user nova-compute[74337]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 21:42:35 user nova-compute[74337]:     <boot dev="hd"/>
Oct 23 21:42:35 user nova-compute[74337]:     <smbios mode="sysinfo"/>
Oct 23 21:42:35 user nova-compute[74337]:   </os>
Oct 23 21:42:35 user nova-compute[74337]:   <features>
Oct 23 21:42:35 user nova-compute[74337]:     <acpi/>
Oct 23 21:42:35 user nova-compute[74337]:     <apic/>
Oct 23 21:42:35 user nova-compute[74337]:     <vmcoreinfo/>
Oct 23 21:42:35 user nova-compute[74337]:   </features>
Oct 23 21:42:35 user nova-compute[74337]:   <clock offset="utc">
Oct 23 21:42:35 user nova-compute[74337]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 21:42:35 user nova-compute[74337]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 21:42:35 user nova-compute[74337]:     <timer name="hpet" present="no"/>
Oct 23 21:42:35 user nova-compute[74337]:   </clock>
Oct 23 21:42:35 user nova-compute[74337]:   <cpu mode="custom" match="exact">
Oct 23 21:42:35 user nova-compute[74337]:     <model>Nehalem</model>
Oct 23 21:42:35 user nova-compute[74337]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 21:42:35 user nova-compute[74337]:   </cpu>
Oct 23 21:42:35 user nova-compute[74337]:   <devices>
Oct 23 21:42:35 user nova-compute[74337]:     <disk type="block" device="disk">
Oct 23 21:42:35 user nova-compute[74337]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 21:42:35 user nova-compute[74337]:       <source dev="/dev/sdd"/>
Oct 23 21:42:35 user nova-compute[74337]:       <target dev="vda" bus="virtio"/>
Oct 23 21:42:35 user nova-compute[74337]:       <serial>611608fb-34d9-455e-9fdd-603b5897e666</serial>
Oct 23 21:42:35 user nova-compute[74337]:     </disk>
Oct 23 21:42:35 user nova-compute[74337]:     <interface type="ethernet">
Oct 23 21:42:35 user nova-compute[74337]:       <mac address="fa:16:3e:ae:37:51"/>
Oct 23 21:42:35 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:42:35 user nova-compute[74337]:       <mtu size="1442"/>
Oct 23 21:42:35 user nova-compute[74337]:       <target dev="tap104a5da2-c5"/>
Oct 23 21:42:35 user nova-compute[74337]:     </interface>
Oct 23 21:42:35 user nova-compute[74337]:     <serial type="pty">
Oct 23 21:42:35 user nova-compute[74337]:       <log file="/opt/stack/data/nova/instances/b531e297-3649-4bab-8e13-10304a002b30/console.log" append="off"/>
Oct 23 21:42:35 user nova-compute[74337]:     </serial>
Oct 23 21:42:35 user nova-compute[74337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 21:42:35 user nova-compute[74337]:     <video>
Oct 23 21:42:35 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:42:35 user nova-compute[74337]:     </video>
Oct 23 21:42:35 user nova-compute[74337]:     <rng model="virtio">
Oct 23 21:42:35 user nova-compute[74337]:       <backend model="random">/dev/urandom</backend>
Oct 23 21:42:35 user nova-compute[74337]:     </rng>
Oct 23 21:42:35 user nova-compute[74337]:     <controller type="usb" index="0" model="none"/>
Oct 23 21:42:35 user nova-compute[74337]:     <memballoon model="virtio">
Oct 23 21:42:35 user nova-compute[74337]:       <stats period="10"/>
Oct 23 21:42:35 user nova-compute[74337]:     </memballoon>
Oct 23 21:42:35 user nova-compute[74337]:   </devices>
Oct 23 21:42:35 user nova-compute[74337]: </domain>
Oct 23 21:42:35 user nova-compute[74337]:  {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 21:42:35 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:41:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2100654115',display_name='tempest-TestVolumeBootPattern-server-2100654115',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2100654115',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb567547bd4941fb87435a841c9d17c4',ramdisk_id='',reservation_id='r-fc3w6u1u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-499971371',owner_user_name='tempest-TestVolumeBootPattern-499971371-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:41:56Z,user_data=None,user_id='0c3e635e8e5447138a7f2db11695574c',uuid=b531e297-3649-4bab-8e13-10304a002b30,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "104a5da2-c546-44ed-9d19-d4f7e0875baa", "address": "fa:16:3e:ae:37:51", "network": {"id": "5a18e96f-a6eb-4989-9be3-154b54928b03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-507511840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb567547bd4941fb87435a841c9d17c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap104a5da2-c5", "ovs_interfaceid": "104a5da2-c546-44ed-9d19-d4f7e0875baa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 21:42:35 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Converting VIF {"id": "104a5da2-c546-44ed-9d19-d4f7e0875baa", "address": "fa:16:3e:ae:37:51", "network": {"id": "5a18e96f-a6eb-4989-9be3-154b54928b03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-507511840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb567547bd4941fb87435a841c9d17c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap104a5da2-c5", "ovs_interfaceid": "104a5da2-c546-44ed-9d19-d4f7e0875baa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:42:35 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:37:51,bridge_name='br-int',has_traffic_filtering=True,id=104a5da2-c546-44ed-9d19-d4f7e0875baa,network=Network(5a18e96f-a6eb-4989-9be3-154b54928b03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap104a5da2-c5') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:42:35 user nova-compute[74337]: DEBUG os_vif [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:37:51,bridge_name='br-int',has_traffic_filtering=True,id=104a5da2-c546-44ed-9d19-d4f7e0875baa,network=Network(5a18e96f-a6eb-4989-9be3-154b54928b03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap104a5da2-c5') {{(pid=74337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 21:42:35 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:42:35 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:42:35 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 21:42:35 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:42:35 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b571dca8-ad6a-501a-a2e6-118357854780', '_type': 'linux-noop'}}, row=False) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:42:35 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:42:35 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:42:35 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:42:35 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap104a5da2-c5, may_exist=True, interface_attrs={}) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:42:35 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap104a5da2-c5, col_values=(('qos', UUID('7e94fdec-f310-4eef-8cad-f0a8ec6ebf95')),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:42:35 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap104a5da2-c5, col_values=(('external_ids', {'iface-id': '104a5da2-c546-44ed-9d19-d4f7e0875baa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ae:37:51', 'vm-uuid': 'b531e297-3649-4bab-8e13-10304a002b30'}),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:42:35 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:42:35 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:42:35 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:42:35 user nova-compute[74337]: INFO os_vif [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:37:51,bridge_name='br-int',has_traffic_filtering=True,id=104a5da2-c546-44ed-9d19-d4f7e0875baa,network=Network(5a18e96f-a6eb-4989-9be3-154b54928b03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap104a5da2-c5')
Oct 23 21:42:35 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] No BDM found with device name vda, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 21:42:35 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] No VIF found with MAC fa:16:3e:ae:37:51, not building metadata {{(pid=74337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 21:42:36 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:42:36 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:42:36 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:42:36 user nova-compute[74337]: DEBUG nova.compute.manager [req-b0c03729-b0b1-41bb-8bed-9db295f15954 req-9816a805-aca0-478a-9df7-87b72a9f2cee service nova] [instance: b531e297-3649-4bab-8e13-10304a002b30] Received event network-vif-plugged-104a5da2-c546-44ed-9d19-d4f7e0875baa {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:42:36 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-b0c03729-b0b1-41bb-8bed-9db295f15954 req-9816a805-aca0-478a-9df7-87b72a9f2cee service nova] Acquiring lock "b531e297-3649-4bab-8e13-10304a002b30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:42:36 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-b0c03729-b0b1-41bb-8bed-9db295f15954 req-9816a805-aca0-478a-9df7-87b72a9f2cee service nova] Lock "b531e297-3649-4bab-8e13-10304a002b30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:42:36 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-b0c03729-b0b1-41bb-8bed-9db295f15954 req-9816a805-aca0-478a-9df7-87b72a9f2cee service nova] Lock "b531e297-3649-4bab-8e13-10304a002b30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:42:36 user nova-compute[74337]: DEBUG nova.compute.manager [req-b0c03729-b0b1-41bb-8bed-9db295f15954 req-9816a805-aca0-478a-9df7-87b72a9f2cee service nova] [instance: b531e297-3649-4bab-8e13-10304a002b30] No waiting events found dispatching network-vif-plugged-104a5da2-c546-44ed-9d19-d4f7e0875baa {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:42:36 user nova-compute[74337]: WARNING nova.compute.manager [req-b0c03729-b0b1-41bb-8bed-9db295f15954 req-9816a805-aca0-478a-9df7-87b72a9f2cee service nova] [instance: b531e297-3649-4bab-8e13-10304a002b30] Received unexpected event network-vif-plugged-104a5da2-c546-44ed-9d19-d4f7e0875baa for instance with vm_state building and task_state spawning.
Oct 23 21:42:37 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:42:37 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:42:37 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:42:38 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:42:38 user nova-compute[74337]: DEBUG nova.compute.manager [req-5867927e-1d6e-47b7-87b3-840c2aabf9f7 req-a8903e6f-270b-4278-94c5-dcdb9bec6dd5 service nova] [instance: b531e297-3649-4bab-8e13-10304a002b30] Received event network-vif-plugged-104a5da2-c546-44ed-9d19-d4f7e0875baa {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:42:38 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-5867927e-1d6e-47b7-87b3-840c2aabf9f7 req-a8903e6f-270b-4278-94c5-dcdb9bec6dd5 service nova] Acquiring lock "b531e297-3649-4bab-8e13-10304a002b30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:42:38 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-5867927e-1d6e-47b7-87b3-840c2aabf9f7 req-a8903e6f-270b-4278-94c5-dcdb9bec6dd5 service nova] Lock "b531e297-3649-4bab-8e13-10304a002b30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:42:38 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-5867927e-1d6e-47b7-87b3-840c2aabf9f7 req-a8903e6f-270b-4278-94c5-dcdb9bec6dd5 service nova] Lock "b531e297-3649-4bab-8e13-10304a002b30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:42:38 user nova-compute[74337]: DEBUG nova.compute.manager [req-5867927e-1d6e-47b7-87b3-840c2aabf9f7 req-a8903e6f-270b-4278-94c5-dcdb9bec6dd5 service nova] [instance: b531e297-3649-4bab-8e13-10304a002b30] No waiting events found dispatching network-vif-plugged-104a5da2-c546-44ed-9d19-d4f7e0875baa {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:42:38 user nova-compute[74337]: WARNING nova.compute.manager [req-5867927e-1d6e-47b7-87b3-840c2aabf9f7 req-a8903e6f-270b-4278-94c5-dcdb9bec6dd5 service nova] [instance: b531e297-3649-4bab-8e13-10304a002b30] Received unexpected event network-vif-plugged-104a5da2-c546-44ed-9d19-d4f7e0875baa for instance with vm_state building and task_state spawning.
Oct 23 21:42:39 user nova-compute[74337]: DEBUG nova.compute.manager [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: b531e297-3649-4bab-8e13-10304a002b30] Instance event wait completed in 0 seconds for  {{(pid=74337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 21:42:39 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: b531e297-3649-4bab-8e13-10304a002b30] Guest created on hypervisor {{(pid=74337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 21:42:39 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: b531e297-3649-4bab-8e13-10304a002b30] Instance spawned successfully.
Oct 23 21:42:39 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: b531e297-3649-4bab-8e13-10304a002b30] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 21:42:39 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: b531e297-3649-4bab-8e13-10304a002b30] Found default for hw_cdrom_bus of ide {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:42:39 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: b531e297-3649-4bab-8e13-10304a002b30] Found default for hw_disk_bus of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:42:39 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: b531e297-3649-4bab-8e13-10304a002b30] Found default for hw_input_bus of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:42:39 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: b531e297-3649-4bab-8e13-10304a002b30] Found default for hw_pointer_model of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:42:39 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: b531e297-3649-4bab-8e13-10304a002b30] Found default for hw_video_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:42:39 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: b531e297-3649-4bab-8e13-10304a002b30] Found default for hw_vif_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:42:39 user nova-compute[74337]: INFO nova.compute.manager [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: b531e297-3649-4bab-8e13-10304a002b30] Took 5.42 seconds to spawn the instance on the hypervisor.
Oct 23 21:42:39 user nova-compute[74337]: DEBUG nova.compute.manager [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: b531e297-3649-4bab-8e13-10304a002b30] Checking state {{(pid=74337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 21:42:39 user nova-compute[74337]: INFO nova.compute.manager [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: b531e297-3649-4bab-8e13-10304a002b30] Took 43.97 seconds to build instance.
Oct 23 21:42:39 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-7ba4828a-5f77-4aad-b302-0afc6b27692a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "b531e297-3649-4bab-8e13-10304a002b30" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 44.117s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:42:40 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:42:43 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:42:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:42:50 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:42:50 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:42:50 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 21:42:50 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 21:42:50 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 21:42:50 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:42:55 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:42:58 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:42:58 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:43:00 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:43:00 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:43:01 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:43:02 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:43:02 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 21:43:03 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:43:03 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:43:03 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Starting heal instance info cache {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 21:43:03 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "refresh_cache-1189976f-8d02-468d-8fa7-bd5594c5f85a" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:43:03 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquired lock "refresh_cache-1189976f-8d02-468d-8fa7-bd5594c5f85a" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:43:03 user nova-compute[74337]: DEBUG nova.network.neutron [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 1189976f-8d02-468d-8fa7-bd5594c5f85a] Forcefully refreshing network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 21:43:04 user nova-compute[74337]: DEBUG nova.network.neutron [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 1189976f-8d02-468d-8fa7-bd5594c5f85a] Updating instance_info_cache with network_info: [{"id": "9c888931-1180-4efd-8ca1-a57252bf8dc5", "address": "fa:16:3e:f9:a2:b8", "network": {"id": "5f62b1d8-d5d0-4ff9-922b-fc6e72fb640d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-655282105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b85c4f783a4ee7ab67422b49da85ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c888931-11", "ovs_interfaceid": "9c888931-1180-4efd-8ca1-a57252bf8dc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:43:04 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Releasing lock "refresh_cache-1189976f-8d02-468d-8fa7-bd5594c5f85a" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:43:04 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 1189976f-8d02-468d-8fa7-bd5594c5f85a] Updated the network info_cache for instance {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 21:43:04 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:43:05 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:43:05 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:43:05 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:43:05 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:43:05 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:43:05 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Auditing locally available compute resources for user (node: user) {{(pid=74337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 21:43:05 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 21:43:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56a4b932-486d-4b8d-9616-99e75592432a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:43:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56a4b932-486d-4b8d-9616-99e75592432a/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:43:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56a4b932-486d-4b8d-9616-99e75592432a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:43:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56a4b932-486d-4b8d-9616-99e75592432a/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:43:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/547c4d4c-e0dd-495a-b83f-98426d0a4a99/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:43:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/547c4d4c-e0dd-495a-b83f-98426d0a4a99/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:43:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/547c4d4c-e0dd-495a-b83f-98426d0a4a99/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:43:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/547c4d4c-e0dd-495a-b83f-98426d0a4a99/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:43:06 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 21:43:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba8d1d0-5fac-4213-9a50-a4e273710b1b/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:43:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba8d1d0-5fac-4213-9a50-a4e273710b1b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:43:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba8d1d0-5fac-4213-9a50-a4e273710b1b/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:43:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba8d1d0-5fac-4213-9a50-a4e273710b1b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:43:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01d407b0-a7cf-4222-9f2d-54b99eeeed84/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:43:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01d407b0-a7cf-4222-9f2d-54b99eeeed84/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:43:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01d407b0-a7cf-4222-9f2d-54b99eeeed84/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:43:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01d407b0-a7cf-4222-9f2d-54b99eeeed84/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:43:07 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 21:43:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/749a62c2-7517-4f57-9ba2-b139fe73c4e5/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:43:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/749a62c2-7517-4f57-9ba2-b139fe73c4e5/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:43:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/749a62c2-7517-4f57-9ba2-b139fe73c4e5/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:43:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/749a62c2-7517-4f57-9ba2-b139fe73c4e5/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:43:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1189976f-8d02-468d-8fa7-bd5594c5f85a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:43:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1189976f-8d02-468d-8fa7-bd5594c5f85a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:43:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1189976f-8d02-468d-8fa7-bd5594c5f85a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:43:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1189976f-8d02-468d-8fa7-bd5594c5f85a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:43:08 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:43:08 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:43:08 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Hypervisor/Node resource view: name=user free_ram=7716MB free_disk=25.46961212158203GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 21:43:08 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:43:08 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:43:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:43:08 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 2cae5b4d-96a0-41ae-9643-b7bf09581988 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:43:08 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 1189976f-8d02-468d-8fa7-bd5594c5f85a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:43:08 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 0ba8d1d0-5fac-4213-9a50-a4e273710b1b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:43:08 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 547c4d4c-e0dd-495a-b83f-98426d0a4a99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:43:08 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 00f757cf-e5dd-476f-81c6-670ed2bf6938 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Oct 23 21:43:08 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 56a4b932-486d-4b8d-9616-99e75592432a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:43:08 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 749a62c2-7517-4f57-9ba2-b139fe73c4e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:43:08 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:43:08 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 01d407b0-a7cf-4222-9f2d-54b99eeeed84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:43:08 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance b531e297-3649-4bab-8e13-10304a002b30 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:43:08 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 21:43:08 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 21:43:08 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:43:08 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:43:08 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Compute_service record updated for user:user {{(pid=74337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 21:43:08 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.502s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:43:10 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:43:10 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:43:11 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:43:11 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:43:11 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:43:13 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:43:13 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:43:15 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:43:20 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:43:22 user nova-compute[74337]: DEBUG nova.compute.manager [req-533cba1a-8902-4347-9e23-4118f33f392b req-6c173cf6-5503-4b8f-a2c0-6eb27699b3d7 service nova] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Received event network-changed-5df71ce2-a116-44b3-856b-c0de0da5dcd6 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:43:22 user nova-compute[74337]: DEBUG nova.compute.manager [req-533cba1a-8902-4347-9e23-4118f33f392b req-6c173cf6-5503-4b8f-a2c0-6eb27699b3d7 service nova] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Refreshing instance network info cache due to event network-changed-5df71ce2-a116-44b3-856b-c0de0da5dcd6. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 21:43:22 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-533cba1a-8902-4347-9e23-4118f33f392b req-6c173cf6-5503-4b8f-a2c0-6eb27699b3d7 service nova] Acquiring lock "refresh_cache-56a4b932-486d-4b8d-9616-99e75592432a" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:43:22 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-533cba1a-8902-4347-9e23-4118f33f392b req-6c173cf6-5503-4b8f-a2c0-6eb27699b3d7 service nova] Acquired lock "refresh_cache-56a4b932-486d-4b8d-9616-99e75592432a" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:43:22 user nova-compute[74337]: DEBUG nova.network.neutron [req-533cba1a-8902-4347-9e23-4118f33f392b req-6c173cf6-5503-4b8f-a2c0-6eb27699b3d7 service nova] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Refreshing network info cache for port 5df71ce2-a116-44b3-856b-c0de0da5dcd6 {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 21:43:22 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-68e89196-1a66-42b1-badb-0673056ceebf tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Acquiring lock "749a62c2-7517-4f57-9ba2-b139fe73c4e5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:43:22 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-68e89196-1a66-42b1-badb-0673056ceebf tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Lock "749a62c2-7517-4f57-9ba2-b139fe73c4e5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:43:22 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-68e89196-1a66-42b1-badb-0673056ceebf tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Acquiring lock "749a62c2-7517-4f57-9ba2-b139fe73c4e5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:43:22 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-68e89196-1a66-42b1-badb-0673056ceebf tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Lock "749a62c2-7517-4f57-9ba2-b139fe73c4e5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:43:22 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-68e89196-1a66-42b1-badb-0673056ceebf tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Lock "749a62c2-7517-4f57-9ba2-b139fe73c4e5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:43:22 user nova-compute[74337]: INFO nova.compute.manager [None req-68e89196-1a66-42b1-badb-0673056ceebf tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] [instance: 749a62c2-7517-4f57-9ba2-b139fe73c4e5] Terminating instance
Oct 23 21:43:22 user nova-compute[74337]: DEBUG nova.compute.manager [None req-68e89196-1a66-42b1-badb-0673056ceebf tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] [instance: 749a62c2-7517-4f57-9ba2-b139fe73c4e5] Start destroying the instance on the hypervisor. {{(pid=74337) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 21:43:22 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:43:22 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:43:22 user nova-compute[74337]: DEBUG nova.network.neutron [req-533cba1a-8902-4347-9e23-4118f33f392b req-6c173cf6-5503-4b8f-a2c0-6eb27699b3d7 service nova] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Updated VIF entry in instance network info cache for port 5df71ce2-a116-44b3-856b-c0de0da5dcd6. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 21:43:22 user nova-compute[74337]: DEBUG nova.network.neutron [req-533cba1a-8902-4347-9e23-4118f33f392b req-6c173cf6-5503-4b8f-a2c0-6eb27699b3d7 service nova] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Updating instance_info_cache with network_info: [{"id": "5df71ce2-a116-44b3-856b-c0de0da5dcd6", "address": "fa:16:3e:20:cc:6f", "network": {"id": "fe0a9f00-e17b-4064-96d2-fd1cc848afb2", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1294741219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96dc585a51343db94529e22adbd6ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5df71ce2-a1", "ovs_interfaceid": "5df71ce2-a116-44b3-856b-c0de0da5dcd6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:43:22 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-533cba1a-8902-4347-9e23-4118f33f392b req-6c173cf6-5503-4b8f-a2c0-6eb27699b3d7 service nova] Releasing lock "refresh_cache-56a4b932-486d-4b8d-9616-99e75592432a" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:43:22 user nova-compute[74337]: DEBUG nova.compute.manager [req-0e7d6979-59c7-49de-9d61-ff0164f86a46 req-d8f3c760-b6e9-4f08-9776-9f6b331d045e service nova] [instance: 749a62c2-7517-4f57-9ba2-b139fe73c4e5] Received event network-vif-unplugged-33efeffb-9f5f-4b9f-a930-1e718e1624f1 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:43:22 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-0e7d6979-59c7-49de-9d61-ff0164f86a46 req-d8f3c760-b6e9-4f08-9776-9f6b331d045e service nova] Acquiring lock "749a62c2-7517-4f57-9ba2-b139fe73c4e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:43:22 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-0e7d6979-59c7-49de-9d61-ff0164f86a46 req-d8f3c760-b6e9-4f08-9776-9f6b331d045e service nova] Lock "749a62c2-7517-4f57-9ba2-b139fe73c4e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:43:22 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-0e7d6979-59c7-49de-9d61-ff0164f86a46 req-d8f3c760-b6e9-4f08-9776-9f6b331d045e service nova] Lock "749a62c2-7517-4f57-9ba2-b139fe73c4e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:43:22 user nova-compute[74337]: DEBUG nova.compute.manager [req-0e7d6979-59c7-49de-9d61-ff0164f86a46 req-d8f3c760-b6e9-4f08-9776-9f6b331d045e service nova] [instance: 749a62c2-7517-4f57-9ba2-b139fe73c4e5] No waiting events found dispatching network-vif-unplugged-33efeffb-9f5f-4b9f-a930-1e718e1624f1 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:43:22 user nova-compute[74337]: DEBUG nova.compute.manager [req-0e7d6979-59c7-49de-9d61-ff0164f86a46 req-d8f3c760-b6e9-4f08-9776-9f6b331d045e service nova] [instance: 749a62c2-7517-4f57-9ba2-b139fe73c4e5] Received event network-vif-unplugged-33efeffb-9f5f-4b9f-a930-1e718e1624f1 for instance with task_state deleting. {{(pid=74337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 21:43:22 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:43:22 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:43:23 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: 749a62c2-7517-4f57-9ba2-b139fe73c4e5] Instance destroyed successfully.
Oct 23 21:43:23 user nova-compute[74337]: DEBUG nova.objects.instance [None req-68e89196-1a66-42b1-badb-0673056ceebf tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Lazy-loading 'resources' on Instance uuid 749a62c2-7517-4f57-9ba2-b139fe73c4e5 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:43:23 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-68e89196-1a66-42b1-badb-0673056ceebf tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:41:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-902939246',display_name='tempest-ServersNegativeTestJSON-server-902939246',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-902939246',id=19,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-23T21:41:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='83700495146c4b0e8d76491380b5f895',ramdisk_id='',reservation_id='r-ydazf46w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-2018044743',owner_user_name='tempest-ServersNegativeTestJSON-2018044743-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T21:41:44Z,user_data=None,user_id='c11f9fb1ab7c411fa9069976c4419bbf',uuid=749a62c2-7517-4f57-9ba2-b139fe73c4e5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "33efeffb-9f5f-4b9f-a930-1e718e1624f1", "address": "fa:16:3e:a7:95:34", "network": {"id": "3d6e3d17-6da2-4ac1-ab9f-b7ed54db79bc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1078020443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83700495146c4b0e8d76491380b5f895", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33efeffb-9f", "ovs_interfaceid": "33efeffb-9f5f-4b9f-a930-1e718e1624f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 21:43:23 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-68e89196-1a66-42b1-badb-0673056ceebf tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Converting VIF {"id": "33efeffb-9f5f-4b9f-a930-1e718e1624f1", "address": "fa:16:3e:a7:95:34", "network": {"id": "3d6e3d17-6da2-4ac1-ab9f-b7ed54db79bc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1078020443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83700495146c4b0e8d76491380b5f895", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33efeffb-9f", "ovs_interfaceid": "33efeffb-9f5f-4b9f-a930-1e718e1624f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:43:23 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-68e89196-1a66-42b1-badb-0673056ceebf tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:95:34,bridge_name='br-int',has_traffic_filtering=True,id=33efeffb-9f5f-4b9f-a930-1e718e1624f1,network=Network(3d6e3d17-6da2-4ac1-ab9f-b7ed54db79bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33efeffb-9f') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:43:23 user nova-compute[74337]: DEBUG os_vif [None req-68e89196-1a66-42b1-badb-0673056ceebf tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:95:34,bridge_name='br-int',has_traffic_filtering=True,id=33efeffb-9f5f-4b9f-a930-1e718e1624f1,network=Network(3d6e3d17-6da2-4ac1-ab9f-b7ed54db79bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33efeffb-9f') {{(pid=74337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 21:43:23 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:43:23 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap33efeffb-9f, bridge=br-int, if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:43:23 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:43:23 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:43:23 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:43:23 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2bd88364-a9d4-4dd2-9f42-fa76cb8c0019) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:43:23 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:43:23 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:43:23 user nova-compute[74337]: INFO os_vif [None req-68e89196-1a66-42b1-badb-0673056ceebf tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:95:34,bridge_name='br-int',has_traffic_filtering=True,id=33efeffb-9f5f-4b9f-a930-1e718e1624f1,network=Network(3d6e3d17-6da2-4ac1-ab9f-b7ed54db79bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33efeffb-9f')
Oct 23 21:43:23 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-68e89196-1a66-42b1-badb-0673056ceebf tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] [instance: 749a62c2-7517-4f57-9ba2-b139fe73c4e5] Deleting instance files /opt/stack/data/nova/instances/749a62c2-7517-4f57-9ba2-b139fe73c4e5_del
Oct 23 21:43:23 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-68e89196-1a66-42b1-badb-0673056ceebf tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] [instance: 749a62c2-7517-4f57-9ba2-b139fe73c4e5] Deletion of /opt/stack/data/nova/instances/749a62c2-7517-4f57-9ba2-b139fe73c4e5_del complete
Oct 23 21:43:23 user nova-compute[74337]: INFO nova.compute.manager [None req-68e89196-1a66-42b1-badb-0673056ceebf tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] [instance: 749a62c2-7517-4f57-9ba2-b139fe73c4e5] Took 0.91 seconds to destroy the instance on the hypervisor.
Oct 23 21:43:23 user nova-compute[74337]: DEBUG oslo.service.loopingcall [None req-68e89196-1a66-42b1-badb-0673056ceebf tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74337) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 21:43:23 user nova-compute[74337]: DEBUG nova.compute.manager [-] [instance: 749a62c2-7517-4f57-9ba2-b139fe73c4e5] Deallocating network for instance {{(pid=74337) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 21:43:23 user nova-compute[74337]: DEBUG nova.network.neutron [-] [instance: 749a62c2-7517-4f57-9ba2-b139fe73c4e5] deallocate_for_instance() {{(pid=74337) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 21:43:23 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:43:23 user nova-compute[74337]: DEBUG nova.network.neutron [-] [instance: 749a62c2-7517-4f57-9ba2-b139fe73c4e5] Updating instance_info_cache with network_info: [] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:43:23 user nova-compute[74337]: INFO nova.compute.manager [-] [instance: 749a62c2-7517-4f57-9ba2-b139fe73c4e5] Took 0.44 seconds to deallocate network for instance.
Oct 23 21:43:23 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-68e89196-1a66-42b1-badb-0673056ceebf tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:43:23 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-68e89196-1a66-42b1-badb-0673056ceebf tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:43:24 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-68e89196-1a66-42b1-badb-0673056ceebf tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:43:24 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-68e89196-1a66-42b1-badb-0673056ceebf tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:43:24 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-68e89196-1a66-42b1-badb-0673056ceebf tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.329s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:43:24 user nova-compute[74337]: INFO nova.scheduler.client.report [None req-68e89196-1a66-42b1-badb-0673056ceebf tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Deleted allocations for instance 749a62c2-7517-4f57-9ba2-b139fe73c4e5
Oct 23 21:43:24 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-68e89196-1a66-42b1-badb-0673056ceebf tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Lock "749a62c2-7517-4f57-9ba2-b139fe73c4e5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.905s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:43:24 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-515f1130-21af-4ab8-9baa-3e77335e132b tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Acquiring lock "2cae5b4d-96a0-41ae-9643-b7bf09581988" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:43:24 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-515f1130-21af-4ab8-9baa-3e77335e132b tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Lock "2cae5b4d-96a0-41ae-9643-b7bf09581988" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:43:24 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-515f1130-21af-4ab8-9baa-3e77335e132b tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Acquiring lock "2cae5b4d-96a0-41ae-9643-b7bf09581988-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:43:24 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-515f1130-21af-4ab8-9baa-3e77335e132b tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Lock "2cae5b4d-96a0-41ae-9643-b7bf09581988-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:43:24 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-515f1130-21af-4ab8-9baa-3e77335e132b tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Lock "2cae5b4d-96a0-41ae-9643-b7bf09581988-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:43:24 user nova-compute[74337]: INFO nova.compute.manager [None req-515f1130-21af-4ab8-9baa-3e77335e132b tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Terminating instance
Oct 23 21:43:24 user nova-compute[74337]: DEBUG nova.compute.manager [None req-515f1130-21af-4ab8-9baa-3e77335e132b tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Start destroying the instance on the hypervisor. {{(pid=74337) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 21:43:24 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:43:24 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:43:24 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:43:24 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:43:24 user nova-compute[74337]: DEBUG nova.compute.manager [req-be3bfc6e-ea97-4e4f-9090-0501694954be req-791aeed5-c742-449f-8e55-ad17acdbb777 service nova] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Received event network-vif-unplugged-fc418a9a-364a-4e52-a073-58a567680beb {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:43:24 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-be3bfc6e-ea97-4e4f-9090-0501694954be req-791aeed5-c742-449f-8e55-ad17acdbb777 service nova] Acquiring lock "2cae5b4d-96a0-41ae-9643-b7bf09581988-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:43:24 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-be3bfc6e-ea97-4e4f-9090-0501694954be req-791aeed5-c742-449f-8e55-ad17acdbb777 service nova] Lock "2cae5b4d-96a0-41ae-9643-b7bf09581988-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:43:24 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-be3bfc6e-ea97-4e4f-9090-0501694954be req-791aeed5-c742-449f-8e55-ad17acdbb777 service nova] Lock "2cae5b4d-96a0-41ae-9643-b7bf09581988-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:43:24 user nova-compute[74337]: DEBUG nova.compute.manager [req-be3bfc6e-ea97-4e4f-9090-0501694954be req-791aeed5-c742-449f-8e55-ad17acdbb777 service nova] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] No waiting events found dispatching network-vif-unplugged-fc418a9a-364a-4e52-a073-58a567680beb {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:43:24 user nova-compute[74337]: DEBUG nova.compute.manager [req-be3bfc6e-ea97-4e4f-9090-0501694954be req-791aeed5-c742-449f-8e55-ad17acdbb777 service nova] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Received event network-vif-unplugged-fc418a9a-364a-4e52-a073-58a567680beb for instance with task_state deleting. {{(pid=74337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 21:43:25 user nova-compute[74337]: DEBUG nova.compute.manager [req-2025e7ec-307c-4a20-88d7-ac0485966f45 req-3c02d00b-42e2-40c2-b2c1-dec061f10030 service nova] [instance: 749a62c2-7517-4f57-9ba2-b139fe73c4e5] Received event network-vif-plugged-33efeffb-9f5f-4b9f-a930-1e718e1624f1 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:43:25 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-2025e7ec-307c-4a20-88d7-ac0485966f45 req-3c02d00b-42e2-40c2-b2c1-dec061f10030 service nova] Acquiring lock "749a62c2-7517-4f57-9ba2-b139fe73c4e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:43:25 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-2025e7ec-307c-4a20-88d7-ac0485966f45 req-3c02d00b-42e2-40c2-b2c1-dec061f10030 service nova] Lock "749a62c2-7517-4f57-9ba2-b139fe73c4e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:43:25 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-2025e7ec-307c-4a20-88d7-ac0485966f45 req-3c02d00b-42e2-40c2-b2c1-dec061f10030 service nova] Lock "749a62c2-7517-4f57-9ba2-b139fe73c4e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:43:25 user nova-compute[74337]: DEBUG nova.compute.manager [req-2025e7ec-307c-4a20-88d7-ac0485966f45 req-3c02d00b-42e2-40c2-b2c1-dec061f10030 service nova] [instance: 749a62c2-7517-4f57-9ba2-b139fe73c4e5] No waiting events found dispatching network-vif-plugged-33efeffb-9f5f-4b9f-a930-1e718e1624f1 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:43:25 user nova-compute[74337]: WARNING nova.compute.manager [req-2025e7ec-307c-4a20-88d7-ac0485966f45 req-3c02d00b-42e2-40c2-b2c1-dec061f10030 service nova] [instance: 749a62c2-7517-4f57-9ba2-b139fe73c4e5] Received unexpected event network-vif-plugged-33efeffb-9f5f-4b9f-a930-1e718e1624f1 for instance with vm_state deleted and task_state None.
Oct 23 21:43:25 user nova-compute[74337]: DEBUG nova.compute.manager [req-2025e7ec-307c-4a20-88d7-ac0485966f45 req-3c02d00b-42e2-40c2-b2c1-dec061f10030 service nova] [instance: 749a62c2-7517-4f57-9ba2-b139fe73c4e5] Received event network-vif-deleted-33efeffb-9f5f-4b9f-a930-1e718e1624f1 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:43:25 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Instance destroyed successfully.
Oct 23 21:43:25 user nova-compute[74337]: DEBUG nova.objects.instance [None req-515f1130-21af-4ab8-9baa-3e77335e132b tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Lazy-loading 'resources' on Instance uuid 2cae5b4d-96a0-41ae-9643-b7bf09581988 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:43:25 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-515f1130-21af-4ab8-9baa-3e77335e132b tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-23T21:38:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1974624614',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1403410720',id=14,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNAij/gN9c1LogESmDyDRUK8aX9TNeBklW1117x1fKgPvWOfbQTMsxbBaU+oDUoFHSZouzNEg8DViCjOAm3WRLHflowTaqyVE9dl6GjV16zXbkR3EGgDaXXdXhXT1FiXhw==',key_name='tempest-keypair-1763181828',keypairs=<?>,launch_index=0,launched_at=2023-10-23T21:41:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3abafb229d604b65a3fb50f0eebc70ae',ramdisk_id='',reservation_id='r-0v9ax80p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1326198598',owner_user_name='tempest-ServerActionsV293TestJSON-1326198598-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T21:41:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c6d296964f545e78d8bc461d6f28dba',uuid=2cae5b4d-96a0-41ae-9643-b7bf09581988,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fc418a9a-364a-4e52-a073-58a567680beb", "address": "fa:16:3e:5b:b9:06", "network": {"id": "e3ef8fef-f49d-46a8-b357-1ee41c4a17e4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-952280610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3abafb229d604b65a3fb50f0eebc70ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc418a9a-36", "ovs_interfaceid": "fc418a9a-364a-4e52-a073-58a567680beb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 21:43:25 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-515f1130-21af-4ab8-9baa-3e77335e132b tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Converting VIF {"id": "fc418a9a-364a-4e52-a073-58a567680beb", "address": "fa:16:3e:5b:b9:06", "network": {"id": "e3ef8fef-f49d-46a8-b357-1ee41c4a17e4", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-952280610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3abafb229d604b65a3fb50f0eebc70ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc418a9a-36", "ovs_interfaceid": "fc418a9a-364a-4e52-a073-58a567680beb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:43:25 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-515f1130-21af-4ab8-9baa-3e77335e132b tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5b:b9:06,bridge_name='br-int',has_traffic_filtering=True,id=fc418a9a-364a-4e52-a073-58a567680beb,network=Network(e3ef8fef-f49d-46a8-b357-1ee41c4a17e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc418a9a-36') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:43:25 user nova-compute[74337]: DEBUG os_vif [None req-515f1130-21af-4ab8-9baa-3e77335e132b tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:b9:06,bridge_name='br-int',has_traffic_filtering=True,id=fc418a9a-364a-4e52-a073-58a567680beb,network=Network(e3ef8fef-f49d-46a8-b357-1ee41c4a17e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc418a9a-36') {{(pid=74337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 21:43:25 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:43:25 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfc418a9a-36, bridge=br-int, if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:43:25 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:43:25 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:43:25 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:43:25 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0b238c75-b53f-474e-bbfc-11a6b73ab8bb) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:43:25 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:43:25 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:43:25 user nova-compute[74337]: INFO os_vif [None req-515f1130-21af-4ab8-9baa-3e77335e132b tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:b9:06,bridge_name='br-int',has_traffic_filtering=True,id=fc418a9a-364a-4e52-a073-58a567680beb,network=Network(e3ef8fef-f49d-46a8-b357-1ee41c4a17e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc418a9a-36')
Oct 23 21:43:25 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-515f1130-21af-4ab8-9baa-3e77335e132b tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] calling os-brick to detach iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 21:43:25 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-515f1130-21af-4ab8-9baa-3e77335e132b tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, {'target_iqn': 'iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aMCXtGKR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:43:25 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-515f1130-21af-4ab8-9baa-3e77335e132b tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:43:25 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-515f1130-21af-4ab8-9baa-3e77335e132b tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:43:25 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-515f1130-21af-4ab8-9baa-3e77335e132b tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.005s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:43:25 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:43:25 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:43:25 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[9976a44a-f078-4db3-8d2a-87f2ba8ec142]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:611608fb-34d9-455e-9fdd-603b5897e666\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:43:25 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-515f1130-21af-4ab8-9baa-3e77335e132b tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 21:43:25 user nova-compute[74337]: No targets found.
Oct 23 21:43:25 user nova-compute[74337]: iSNS:
Oct 23 21:43:25 user nova-compute[74337]: No targets found.
Oct 23 21:43:25 user nova-compute[74337]: STATIC:
Oct 23 21:43:25 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01
Oct 23 21:43:25 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:43:25 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:43:25 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4
Oct 23 21:43:25 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:43:25 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:43:25 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:611608fb-34d9-455e-9fdd-603b5897e666
Oct 23 21:43:25 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:43:25 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:43:25 user nova-compute[74337]: FIRMWARE:
Oct 23 21:43:25 user nova-compute[74337]: No targets found.
Oct 23 21:43:25 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:43:25 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-515f1130-21af-4ab8-9baa-3e77335e132b tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 21:43:25 user nova-compute[74337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 21:43:25 user nova-compute[74337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 21:43:25 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-515f1130-21af-4ab8-9baa-3e77335e132b tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01', 0)] {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 21:43:25 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:43:25 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:43:25 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[709993e8-8b6e-4dfe-a383-1f2c89ade3b9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:611608fb-34d9-455e-9fdd-603b5897e666\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:43:25 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:43:25 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:43:25 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b99b15-2fee-4556-9554-9d8b36e955ff]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611608fb-34d9-455e-9fdd-603b5897e666 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:43:25 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-515f1130-21af-4ab8-9baa-3e77335e132b tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01 (non-flash)
Oct 23 21:43:25 user nova-compute[74337]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:43:25 user nova-compute[74337]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611608fb-34d9-455e-9fdd-603b5897e666 (non-flash)
Oct 23 21:43:25 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:43:25 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-515f1130-21af-4ab8-9baa-3e77335e132b tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01 (non-flash)
Oct 23 21:43:25 user nova-compute[74337]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:43:25 user nova-compute[74337]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611608fb-34d9-455e-9fdd-603b5897e666 (non-flash)
Oct 23 21:43:25 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:43:25 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-515f1130-21af-4ab8-9baa-3e77335e132b tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5ef4063250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01'): ({'sdb'}, set())}) {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 21:43:25 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-515f1130-21af-4ab8-9baa-3e77335e132b tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Removing single pathed devices sdb {{(pid=74337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 21:43:25 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:43:25 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:43:25 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[09332637-b3c1-4ad9-afae-958c70c89a94]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:43:25 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:43:25 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:43:25 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[11366931-3941-4f4c-8f30-8d7e8d545740]: (4, ('ok\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:43:25 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-515f1130-21af-4ab8-9baa-3e77335e132b tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Flushing IO for device /dev/sdb {{(pid=74337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 21:43:25 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:43:25 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:43:25 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df4d7d3-6edf-4bdf-ba1f-386a6d2bb383]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:43:25 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-515f1130-21af-4ab8-9baa-3e77335e132b tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 21:43:25 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:43:25 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:43:25 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd43808-25b7-4931-98f6-34541f2906f3]: (4, ('1', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:43:25 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-515f1130-21af-4ab8-9baa-3e77335e132b tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 21:43:25 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-515f1130-21af-4ab8-9baa-3e77335e132b tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] SCSI volumes sdb have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 21:43:25 user nova-compute[74337]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23263393864326637', '/dev/disk/by-id/scsi-1SCST_BIOd68cecde-2c98d2f7a4866f91', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_d68cecde') {{(pid=85566) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 23 21:43:25 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ecef63-eaaa-4a48-b137-72cce706cb17]: (4, None) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:43:25 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-515f1130-21af-4ab8-9baa-3e77335e132b tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01')] {{(pid=74337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 21:43:25 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:43:25 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:43:25 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[9236b71e-0bf0-43d9-bb81-28ac6bcb0679]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:43:25 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-515f1130-21af-4ab8-9baa-3e77335e132b tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:43:25 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01 -p 172.16.0.220:3260 --logout {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:43:25 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:43:25 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d36a8630-9547-4961-ad67-4c7c84a2b14b]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:43:25 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-515f1130-21af-4ab8-9baa-3e77335e132b tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01, portal: 172.16.0.220,3260]
Oct 23 21:43:25 user nova-compute[74337]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01, portal: 172.16.0.220,3260] successful.
Oct 23 21:43:25 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:43:25 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01 -p 172.16.0.220:3260 --op delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:43:25 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f45407b0-0f4c-4120-8ef2-812f51f88f01 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:43:25 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[afe67093-3f70-48e7-af15-ced5c7f5aa94]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:43:25 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-515f1130-21af-4ab8-9baa-3e77335e132b tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:43:25 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-515f1130-21af-4ab8-9baa-3e77335e132b tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:43:25 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-515f1130-21af-4ab8-9baa-3e77335e132b tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] <== disconnect_volume: return (341ms) None {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:43:25 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-515f1130-21af-4ab8-9baa-3e77335e132b tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Disconnected iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 21:43:25 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-515f1130-21af-4ab8-9baa-3e77335e132b tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Deleting instance files /opt/stack/data/nova/instances/2cae5b4d-96a0-41ae-9643-b7bf09581988_del
Oct 23 21:43:25 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-515f1130-21af-4ab8-9baa-3e77335e132b tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Deletion of /opt/stack/data/nova/instances/2cae5b4d-96a0-41ae-9643-b7bf09581988_del complete
Oct 23 21:43:25 user nova-compute[74337]: INFO nova.compute.manager [None req-515f1130-21af-4ab8-9baa-3e77335e132b tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Took 1.22 seconds to destroy the instance on the hypervisor.
Oct 23 21:43:25 user nova-compute[74337]: DEBUG oslo.service.loopingcall [None req-515f1130-21af-4ab8-9baa-3e77335e132b tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74337) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 21:43:25 user nova-compute[74337]: DEBUG nova.compute.manager [-] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Deallocating network for instance {{(pid=74337) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 21:43:25 user nova-compute[74337]: DEBUG nova.network.neutron [-] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] deallocate_for_instance() {{(pid=74337) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 21:43:26 user nova-compute[74337]: DEBUG nova.network.neutron [-] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Updating instance_info_cache with network_info: [] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:43:26 user nova-compute[74337]: INFO nova.compute.manager [-] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Took 0.72 seconds to deallocate network for instance.
Oct 23 21:43:27 user nova-compute[74337]: DEBUG nova.compute.manager [req-87a2009c-8ce2-437e-80bd-a9fac52004cc req-fa0c4e8d-57e0-471c-ba49-885ec1e83b3e service nova] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Received event network-vif-deleted-fc418a9a-364a-4e52-a073-58a567680beb {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:43:27 user nova-compute[74337]: DEBUG nova.compute.manager [req-745e0ebf-71b2-4919-92cc-be7cd4ea6a83 req-c1ee63da-16da-4e21-ade1-00131249e419 service nova] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Received event network-vif-plugged-fc418a9a-364a-4e52-a073-58a567680beb {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:43:27 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-745e0ebf-71b2-4919-92cc-be7cd4ea6a83 req-c1ee63da-16da-4e21-ade1-00131249e419 service nova] Acquiring lock "2cae5b4d-96a0-41ae-9643-b7bf09581988-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:43:27 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-745e0ebf-71b2-4919-92cc-be7cd4ea6a83 req-c1ee63da-16da-4e21-ade1-00131249e419 service nova] Lock "2cae5b4d-96a0-41ae-9643-b7bf09581988-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:43:27 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-745e0ebf-71b2-4919-92cc-be7cd4ea6a83 req-c1ee63da-16da-4e21-ade1-00131249e419 service nova] Lock "2cae5b4d-96a0-41ae-9643-b7bf09581988-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:43:27 user nova-compute[74337]: DEBUG nova.compute.manager [req-745e0ebf-71b2-4919-92cc-be7cd4ea6a83 req-c1ee63da-16da-4e21-ade1-00131249e419 service nova] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] No waiting events found dispatching network-vif-plugged-fc418a9a-364a-4e52-a073-58a567680beb {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:43:27 user nova-compute[74337]: WARNING nova.compute.manager [req-745e0ebf-71b2-4919-92cc-be7cd4ea6a83 req-c1ee63da-16da-4e21-ade1-00131249e419 service nova] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Received unexpected event network-vif-plugged-fc418a9a-364a-4e52-a073-58a567680beb for instance with vm_state active and task_state deleting.
Oct 23 21:43:27 user nova-compute[74337]: INFO nova.compute.manager [None req-515f1130-21af-4ab8-9baa-3e77335e132b tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Took 1.15 seconds to detach 1 volumes for instance.
Oct 23 21:43:27 user nova-compute[74337]: DEBUG nova.compute.manager [None req-515f1130-21af-4ab8-9baa-3e77335e132b tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] [instance: 2cae5b4d-96a0-41ae-9643-b7bf09581988] Deleting volume: f45407b0-0f4c-4120-8ef2-812f51f88f01 {{(pid=74337) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 23 21:43:27 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-515f1130-21af-4ab8-9baa-3e77335e132b tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:43:27 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-515f1130-21af-4ab8-9baa-3e77335e132b tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:43:28 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-515f1130-21af-4ab8-9baa-3e77335e132b tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:43:28 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-515f1130-21af-4ab8-9baa-3e77335e132b tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:43:28 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-515f1130-21af-4ab8-9baa-3e77335e132b tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.362s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:43:28 user nova-compute[74337]: INFO nova.scheduler.client.report [None req-515f1130-21af-4ab8-9baa-3e77335e132b tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Deleted allocations for instance 2cae5b4d-96a0-41ae-9643-b7bf09581988
Oct 23 21:43:28 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:43:28 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-515f1130-21af-4ab8-9baa-3e77335e132b tempest-ServerActionsV293TestJSON-1326198598 tempest-ServerActionsV293TestJSON-1326198598-project-member] Lock "2cae5b4d-96a0-41ae-9643-b7bf09581988" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.842s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:43:28 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-0806fc50-07de-47e0-b728-3f674b77dbf4 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Acquiring lock "56a4b932-486d-4b8d-9616-99e75592432a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:43:28 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-0806fc50-07de-47e0-b728-3f674b77dbf4 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lock "56a4b932-486d-4b8d-9616-99e75592432a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:43:28 user nova-compute[74337]: DEBUG nova.objects.instance [None req-0806fc50-07de-47e0-b728-3f674b77dbf4 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lazy-loading 'flavor' on Instance uuid 56a4b932-486d-4b8d-9616-99e75592432a {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:43:28 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-0806fc50-07de-47e0-b728-3f674b77dbf4 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lock "56a4b932-486d-4b8d-9616-99e75592432a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:43:28 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-0806fc50-07de-47e0-b728-3f674b77dbf4 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Acquiring lock "56a4b932-486d-4b8d-9616-99e75592432a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:43:28 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-0806fc50-07de-47e0-b728-3f674b77dbf4 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lock "56a4b932-486d-4b8d-9616-99e75592432a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:43:28 user nova-compute[74337]: INFO nova.compute.manager [None req-0806fc50-07de-47e0-b728-3f674b77dbf4 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Attaching volume a8e8efe4-f74d-477f-ad38-999c514047ac to /dev/vdb
Oct 23 21:43:28 user nova-compute[74337]: DEBUG os_brick.utils [None req-0806fc50-07de-47e0-b728-3f674b77dbf4 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:43:28 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:43:28 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:43:28 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac96ea6-c317-46eb-aea5-72543470f9b7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f34011b66e40\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:43:28 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:43:28 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:43:28 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc0fed1c-caee-4311-854f-7ed6b6b00784]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:43:28 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:43:28 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:43:28 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e325b9bf-4fb9-490a-824b-ddf47349ede4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:43:28 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-a25db3b2-fb33-43f4-9597-f4d441d0cb2b tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Acquiring lock "195a4056-3254-4558-b2f5-299bcd4af07c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:43:28 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-a25db3b2-fb33-43f4-9597-f4d441d0cb2b tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lock "195a4056-3254-4558-b2f5-299bcd4af07c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:43:28 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8557d2b-57e8-45cf-ab0e-30a83ff3cd56]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:43:28 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-0806fc50-07de-47e0-b728-3f674b77dbf4 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Running cmd (subprocess): nvme version {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:43:28 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-0806fc50-07de-47e0-b728-3f674b77dbf4 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] 'nvme version' failed. Not Retrying. {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 21:43:28 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0806fc50-07de-47e0-b728-3f674b77dbf4 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] nvme not present on system {{(pid=74337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 21:43:28 user nova-compute[74337]: DEBUG nova.compute.manager [None req-a25db3b2-fb33-43f4-9597-f4d441d0cb2b tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Starting instance... {{(pid=74337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 21:43:28 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:43:28 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 21:43:28 user nova-compute[74337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 21:43:28 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a52cb16-4c97-487d-bac7-6edff6088a42]: (4, '') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:43:28 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-0806fc50-07de-47e0-b728-3f674b77dbf4 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 21:43:28 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-0806fc50-07de-47e0-b728-3f674b77dbf4 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 21:43:28 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-0806fc50-07de-47e0-b728-3f674b77dbf4 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] LIGHTOS: no hostnqn found. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 21:43:28 user nova-compute[74337]: DEBUG os_brick.utils [None req-0806fc50-07de-47e0-b728-3f674b77dbf4 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f34011b66e40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:43:28 user nova-compute[74337]: DEBUG nova.virt.block_device [None req-0806fc50-07de-47e0-b728-3f674b77dbf4 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Updating existing volume attachment record: 989c5846-2921-45f4-8c1c-504bb16ccb4e {{(pid=74337) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 21:43:29 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-a25db3b2-fb33-43f4-9597-f4d441d0cb2b tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:43:29 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-a25db3b2-fb33-43f4-9597-f4d441d0cb2b tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:43:29 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-a25db3b2-fb33-43f4-9597-f4d441d0cb2b tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 21:43:29 user nova-compute[74337]: INFO nova.compute.claims [None req-a25db3b2-fb33-43f4-9597-f4d441d0cb2b tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Claim successful on node user
Oct 23 21:43:29 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-a25db3b2-fb33-43f4-9597-f4d441d0cb2b tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:43:29 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-a25db3b2-fb33-43f4-9597-f4d441d0cb2b tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:43:29 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-a25db3b2-fb33-43f4-9597-f4d441d0cb2b tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.389s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:43:29 user nova-compute[74337]: DEBUG nova.compute.manager [None req-a25db3b2-fb33-43f4-9597-f4d441d0cb2b tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Start building networks asynchronously for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 21:43:29 user nova-compute[74337]: DEBUG nova.compute.manager [None req-a25db3b2-fb33-43f4-9597-f4d441d0cb2b tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Allocating IP information in the background. {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 21:43:29 user nova-compute[74337]: DEBUG nova.network.neutron [None req-a25db3b2-fb33-43f4-9597-f4d441d0cb2b tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] allocate_for_instance() {{(pid=74337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 21:43:29 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-a25db3b2-fb33-43f4-9597-f4d441d0cb2b tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 21:43:29 user nova-compute[74337]: DEBUG nova.compute.manager [None req-a25db3b2-fb33-43f4-9597-f4d441d0cb2b tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Start building block device mappings for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 21:43:29 user nova-compute[74337]: DEBUG nova.policy [None req-a25db3b2-fb33-43f4-9597-f4d441d0cb2b tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '891ee2e3acc54ed0bc4571f63ff491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f57e58a9ec4c6384dc0d3ca58eb610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74337) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 21:43:29 user nova-compute[74337]: DEBUG nova.compute.manager [None req-a25db3b2-fb33-43f4-9597-f4d441d0cb2b tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Start spawning the instance on the hypervisor. {{(pid=74337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 21:43:29 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-a25db3b2-fb33-43f4-9597-f4d441d0cb2b tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Creating instance directory {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 21:43:29 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-a25db3b2-fb33-43f4-9597-f4d441d0cb2b tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Creating image(s)
Oct 23 21:43:29 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-a25db3b2-fb33-43f4-9597-f4d441d0cb2b tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Acquiring lock "/opt/stack/data/nova/instances/195a4056-3254-4558-b2f5-299bcd4af07c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:43:29 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-a25db3b2-fb33-43f4-9597-f4d441d0cb2b tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lock "/opt/stack/data/nova/instances/195a4056-3254-4558-b2f5-299bcd4af07c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:43:29 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-a25db3b2-fb33-43f4-9597-f4d441d0cb2b tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lock "/opt/stack/data/nova/instances/195a4056-3254-4558-b2f5-299bcd4af07c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:43:29 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-a25db3b2-fb33-43f4-9597-f4d441d0cb2b tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:43:29 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-a25db3b2-fb33-43f4-9597-f4d441d0cb2b tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.177s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:43:29 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-a25db3b2-fb33-43f4-9597-f4d441d0cb2b tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Acquiring lock "fc7b140751b8c385de81623e40fb09ce09374ab7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:43:29 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-a25db3b2-fb33-43f4-9597-f4d441d0cb2b tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lock "fc7b140751b8c385de81623e40fb09ce09374ab7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:43:29 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-a25db3b2-fb33-43f4-9597-f4d441d0cb2b tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:43:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-a25db3b2-fb33-43f4-9597-f4d441d0cb2b tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.172s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:43:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-a25db3b2-fb33-43f4-9597-f4d441d0cb2b tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7,backing_fmt=raw /opt/stack/data/nova/instances/195a4056-3254-4558-b2f5-299bcd4af07c/disk 1073741824 {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:43:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-a25db3b2-fb33-43f4-9597-f4d441d0cb2b tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7,backing_fmt=raw /opt/stack/data/nova/instances/195a4056-3254-4558-b2f5-299bcd4af07c/disk 1073741824" returned: 0 in 0.051s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:43:30 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-a25db3b2-fb33-43f4-9597-f4d441d0cb2b tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lock "fc7b140751b8c385de81623e40fb09ce09374ab7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:43:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-a25db3b2-fb33-43f4-9597-f4d441d0cb2b tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:43:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-a25db3b2-fb33-43f4-9597-f4d441d0cb2b tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.236s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:43:30 user nova-compute[74337]: DEBUG nova.virt.disk.api [None req-a25db3b2-fb33-43f4-9597-f4d441d0cb2b tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Checking if we can resize image /opt/stack/data/nova/instances/195a4056-3254-4558-b2f5-299bcd4af07c/disk. size=1073741824 {{(pid=74337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 21:43:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-a25db3b2-fb33-43f4-9597-f4d441d0cb2b tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195a4056-3254-4558-b2f5-299bcd4af07c/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:43:30 user nova-compute[74337]: DEBUG nova.network.neutron [None req-a25db3b2-fb33-43f4-9597-f4d441d0cb2b tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Successfully created port: efec7d56-28cb-4da2-b6f7-6e9777d3377b {{(pid=74337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 21:43:30 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:43:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-a25db3b2-fb33-43f4-9597-f4d441d0cb2b tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195a4056-3254-4558-b2f5-299bcd4af07c/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:43:30 user nova-compute[74337]: DEBUG nova.virt.disk.api [None req-a25db3b2-fb33-43f4-9597-f4d441d0cb2b tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Cannot resize image /opt/stack/data/nova/instances/195a4056-3254-4558-b2f5-299bcd4af07c/disk to a smaller size. {{(pid=74337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 21:43:30 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-a25db3b2-fb33-43f4-9597-f4d441d0cb2b tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Created local disks {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 21:43:30 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-a25db3b2-fb33-43f4-9597-f4d441d0cb2b tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Ensure instance console log exists: /opt/stack/data/nova/instances/195a4056-3254-4558-b2f5-299bcd4af07c/console.log {{(pid=74337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 21:43:30 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-a25db3b2-fb33-43f4-9597-f4d441d0cb2b tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:43:30 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-a25db3b2-fb33-43f4-9597-f4d441d0cb2b tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:43:30 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-a25db3b2-fb33-43f4-9597-f4d441d0cb2b tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:43:31 user nova-compute[74337]: DEBUG nova.network.neutron [None req-a25db3b2-fb33-43f4-9597-f4d441d0cb2b tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Successfully updated port: efec7d56-28cb-4da2-b6f7-6e9777d3377b {{(pid=74337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 21:43:31 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-a25db3b2-fb33-43f4-9597-f4d441d0cb2b tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Acquiring lock "refresh_cache-195a4056-3254-4558-b2f5-299bcd4af07c" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:43:31 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-a25db3b2-fb33-43f4-9597-f4d441d0cb2b tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Acquired lock "refresh_cache-195a4056-3254-4558-b2f5-299bcd4af07c" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:43:31 user nova-compute[74337]: DEBUG nova.network.neutron [None req-a25db3b2-fb33-43f4-9597-f4d441d0cb2b tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Building network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 21:43:31 user nova-compute[74337]: DEBUG nova.compute.manager [req-d82831d0-11d6-46b7-a00e-865b4cceb884 req-66f058c2-5c53-44a1-af09-c8e346b605a5 service nova] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Received event network-changed-efec7d56-28cb-4da2-b6f7-6e9777d3377b {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:43:31 user nova-compute[74337]: DEBUG nova.compute.manager [req-d82831d0-11d6-46b7-a00e-865b4cceb884 req-66f058c2-5c53-44a1-af09-c8e346b605a5 service nova] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Refreshing instance network info cache due to event network-changed-efec7d56-28cb-4da2-b6f7-6e9777d3377b. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 21:43:31 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-d82831d0-11d6-46b7-a00e-865b4cceb884 req-66f058c2-5c53-44a1-af09-c8e346b605a5 service nova] Acquiring lock "refresh_cache-195a4056-3254-4558-b2f5-299bcd4af07c" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:43:31 user nova-compute[74337]: DEBUG nova.network.neutron [None req-a25db3b2-fb33-43f4-9597-f4d441d0cb2b tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Instance cache missing network info. {{(pid=74337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 21:43:31 user nova-compute[74337]: DEBUG nova.network.neutron [None req-a25db3b2-fb33-43f4-9597-f4d441d0cb2b tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Updating instance_info_cache with network_info: [{"id": "efec7d56-28cb-4da2-b6f7-6e9777d3377b", "address": "fa:16:3e:26:a4:b5", "network": {"id": "aff1f95f-fda8-4f0f-8d10-7e3d587e4fda", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2048135647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1f57e58a9ec4c6384dc0d3ca58eb610", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefec7d56-28", "ovs_interfaceid": "efec7d56-28cb-4da2-b6f7-6e9777d3377b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:43:31 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-a25db3b2-fb33-43f4-9597-f4d441d0cb2b tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Releasing lock "refresh_cache-195a4056-3254-4558-b2f5-299bcd4af07c" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:43:31 user nova-compute[74337]: DEBUG nova.compute.manager [None req-a25db3b2-fb33-43f4-9597-f4d441d0cb2b tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Instance network_info: |[{"id": "efec7d56-28cb-4da2-b6f7-6e9777d3377b", "address": "fa:16:3e:26:a4:b5", "network": {"id": "aff1f95f-fda8-4f0f-8d10-7e3d587e4fda", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2048135647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1f57e58a9ec4c6384dc0d3ca58eb610", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefec7d56-28", "ovs_interfaceid": "efec7d56-28cb-4da2-b6f7-6e9777d3377b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 21:43:31 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-d82831d0-11d6-46b7-a00e-865b4cceb884 req-66f058c2-5c53-44a1-af09-c8e346b605a5 service nova] Acquired lock "refresh_cache-195a4056-3254-4558-b2f5-299bcd4af07c" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:43:31 user nova-compute[74337]: DEBUG nova.network.neutron [req-d82831d0-11d6-46b7-a00e-865b4cceb884 req-66f058c2-5c53-44a1-af09-c8e346b605a5 service nova] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Refreshing network info cache for port efec7d56-28cb-4da2-b6f7-6e9777d3377b {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 21:43:31 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-a25db3b2-fb33-43f4-9597-f4d441d0cb2b tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Start _get_guest_xml network_info=[{"id": "efec7d56-28cb-4da2-b6f7-6e9777d3377b", "address": "fa:16:3e:26:a4:b5", "network": {"id": "aff1f95f-fda8-4f0f-8d10-7e3d587e4fda", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2048135647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1f57e58a9ec4c6384dc0d3ca58eb610", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefec7d56-28", "ovs_interfaceid": "efec7d56-28cb-4da2-b6f7-6e9777d3377b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T21:29:21Z,direct_url=<?>,disk_format='qcow2',id=d859d89d-998d-4109-b26a-0d6e28152932,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ff43462300764979a6cf688444336a56',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T21:29:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'image_id': 'd859d89d-998d-4109-b26a-0d6e28152932'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 21:43:31 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-a25db3b2-fb33-43f4-9597-f4d441d0cb2b tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:43:31 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-a25db3b2-fb33-43f4-9597-f4d441d0cb2b tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:43:31 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-a25db3b2-fb33-43f4-9597-f4d441d0cb2b tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 21:43:31 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-a25db3b2-fb33-43f4-9597-f4d441d0cb2b tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] CPU controller missing on host. {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 21:43:31 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-a25db3b2-fb33-43f4-9597-f4d441d0cb2b tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 21:43:31 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-a25db3b2-fb33-43f4-9597-f4d441d0cb2b tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] CPU controller found on host. {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 21:43:31 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-a25db3b2-fb33-43f4-9597-f4d441d0cb2b tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 21:43:31 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-a25db3b2-fb33-43f4-9597-f4d441d0cb2b tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T21:29:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T21:29:21Z,direct_url=<?>,disk_format='qcow2',id=d859d89d-998d-4109-b26a-0d6e28152932,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ff43462300764979a6cf688444336a56',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T21:29:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 21:43:31 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-a25db3b2-fb33-43f4-9597-f4d441d0cb2b tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Flavor limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 21:43:31 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-a25db3b2-fb33-43f4-9597-f4d441d0cb2b tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Image limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 21:43:31 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-a25db3b2-fb33-43f4-9597-f4d441d0cb2b tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Flavor pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 21:43:31 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-a25db3b2-fb33-43f4-9597-f4d441d0cb2b tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Image pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 21:43:31 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-a25db3b2-fb33-43f4-9597-f4d441d0cb2b tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 21:43:31 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-a25db3b2-fb33-43f4-9597-f4d441d0cb2b tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 21:43:31 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-a25db3b2-fb33-43f4-9597-f4d441d0cb2b tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 21:43:31 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-a25db3b2-fb33-43f4-9597-f4d441d0cb2b tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Got 1 possible topologies {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 21:43:31 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-a25db3b2-fb33-43f4-9597-f4d441d0cb2b tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 21:43:31 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-a25db3b2-fb33-43f4-9597-f4d441d0cb2b tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 21:43:31 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-a25db3b2-fb33-43f4-9597-f4d441d0cb2b tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:43:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-696848694',display_name='tempest-tempest.common.compute-instance-696848694',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-696848694',id=23,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAWzQm4+V4g91dNEdG8YLkJhCynO3Ap8ILaI8oMN1LNLl54g3kIsrbEh6Mxm9fgmaJnzv3izz6qYqT1bG4NWKyccXk+mb+zPPixuCgYlO6IQfM8pLRdMrw36YsRSiIFnHQ==',key_name='tempest-keypair-1081806285',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e1f57e58a9ec4c6384dc0d3ca58eb610',ramdisk_id='',reservation_id='r-8no3m5aa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-100075475',owner_user_name='tempest-ServerActionsTestOtherA-100075475-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:43:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='891ee2e3acc54ed0bc4571f63ff491a0',uuid=195a4056-3254-4558-b2f5-299bcd4af07c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "efec7d56-28cb-4da2-b6f7-6e9777d3377b", "address": "fa:16:3e:26:a4:b5", "network": {"id": "aff1f95f-fda8-4f0f-8d10-7e3d587e4fda", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2048135647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1f57e58a9ec4c6384dc0d3ca58eb610", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefec7d56-28", "ovs_interfaceid": "efec7d56-28cb-4da2-b6f7-6e9777d3377b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 21:43:31 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-a25db3b2-fb33-43f4-9597-f4d441d0cb2b tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Converting VIF {"id": "efec7d56-28cb-4da2-b6f7-6e9777d3377b", "address": "fa:16:3e:26:a4:b5", "network": {"id": "aff1f95f-fda8-4f0f-8d10-7e3d587e4fda", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2048135647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1f57e58a9ec4c6384dc0d3ca58eb610", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefec7d56-28", "ovs_interfaceid": "efec7d56-28cb-4da2-b6f7-6e9777d3377b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:43:31 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-a25db3b2-fb33-43f4-9597-f4d441d0cb2b tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:a4:b5,bridge_name='br-int',has_traffic_filtering=True,id=efec7d56-28cb-4da2-b6f7-6e9777d3377b,network=Network(aff1f95f-fda8-4f0f-8d10-7e3d587e4fda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefec7d56-28') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:43:31 user nova-compute[74337]: DEBUG nova.objects.instance [None req-a25db3b2-fb33-43f4-9597-f4d441d0cb2b tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lazy-loading 'pci_devices' on Instance uuid 195a4056-3254-4558-b2f5-299bcd4af07c {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:43:31 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-a25db3b2-fb33-43f4-9597-f4d441d0cb2b tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] End _get_guest_xml xml=<domain type="kvm">
Oct 23 21:43:31 user nova-compute[74337]:   <uuid>195a4056-3254-4558-b2f5-299bcd4af07c</uuid>
Oct 23 21:43:31 user nova-compute[74337]:   <name>instance-00000017</name>
Oct 23 21:43:31 user nova-compute[74337]:   <memory>524288</memory>
Oct 23 21:43:31 user nova-compute[74337]:   <vcpu>1</vcpu>
Oct 23 21:43:31 user nova-compute[74337]:   <metadata>
Oct 23 21:43:31 user nova-compute[74337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 21:43:31 user nova-compute[74337]:       <nova:package version="0.0.0"/>
Oct 23 21:43:31 user nova-compute[74337]:       <nova:name>tempest-tempest.common.compute-instance-696848694</nova:name>
Oct 23 21:43:31 user nova-compute[74337]:       <nova:creationTime>2023-10-23 21:43:31</nova:creationTime>
Oct 23 21:43:31 user nova-compute[74337]:       <nova:flavor name="m1.tiny">
Oct 23 21:43:31 user nova-compute[74337]:         <nova:memory>512</nova:memory>
Oct 23 21:43:31 user nova-compute[74337]:         <nova:disk>1</nova:disk>
Oct 23 21:43:31 user nova-compute[74337]:         <nova:swap>0</nova:swap>
Oct 23 21:43:31 user nova-compute[74337]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 21:43:31 user nova-compute[74337]:         <nova:vcpus>1</nova:vcpus>
Oct 23 21:43:31 user nova-compute[74337]:       </nova:flavor>
Oct 23 21:43:31 user nova-compute[74337]:       <nova:owner>
Oct 23 21:43:31 user nova-compute[74337]:         <nova:user uuid="891ee2e3acc54ed0bc4571f63ff491a0">tempest-ServerActionsTestOtherA-100075475-project-member</nova:user>
Oct 23 21:43:31 user nova-compute[74337]:         <nova:project uuid="e1f57e58a9ec4c6384dc0d3ca58eb610">tempest-ServerActionsTestOtherA-100075475</nova:project>
Oct 23 21:43:31 user nova-compute[74337]:       </nova:owner>
Oct 23 21:43:31 user nova-compute[74337]:       <nova:root type="image" uuid="d859d89d-998d-4109-b26a-0d6e28152932"/>
Oct 23 21:43:31 user nova-compute[74337]:       <nova:ports>
Oct 23 21:43:31 user nova-compute[74337]:         <nova:port uuid="efec7d56-28cb-4da2-b6f7-6e9777d3377b">
Oct 23 21:43:31 user nova-compute[74337]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 23 21:43:31 user nova-compute[74337]:         </nova:port>
Oct 23 21:43:31 user nova-compute[74337]:       </nova:ports>
Oct 23 21:43:31 user nova-compute[74337]:     </nova:instance>
Oct 23 21:43:31 user nova-compute[74337]:   </metadata>
Oct 23 21:43:31 user nova-compute[74337]:   <sysinfo type="smbios">
Oct 23 21:43:31 user nova-compute[74337]:     <system>
Oct 23 21:43:31 user nova-compute[74337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 21:43:31 user nova-compute[74337]:       <entry name="product">OpenStack Nova</entry>
Oct 23 21:43:31 user nova-compute[74337]:       <entry name="version">0.0.0</entry>
Oct 23 21:43:31 user nova-compute[74337]:       <entry name="serial">195a4056-3254-4558-b2f5-299bcd4af07c</entry>
Oct 23 21:43:31 user nova-compute[74337]:       <entry name="uuid">195a4056-3254-4558-b2f5-299bcd4af07c</entry>
Oct 23 21:43:31 user nova-compute[74337]:       <entry name="family">Virtual Machine</entry>
Oct 23 21:43:31 user nova-compute[74337]:     </system>
Oct 23 21:43:31 user nova-compute[74337]:   </sysinfo>
Oct 23 21:43:31 user nova-compute[74337]:   <os>
Oct 23 21:43:31 user nova-compute[74337]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 21:43:31 user nova-compute[74337]:     <boot dev="hd"/>
Oct 23 21:43:31 user nova-compute[74337]:     <smbios mode="sysinfo"/>
Oct 23 21:43:31 user nova-compute[74337]:   </os>
Oct 23 21:43:31 user nova-compute[74337]:   <features>
Oct 23 21:43:31 user nova-compute[74337]:     <acpi/>
Oct 23 21:43:31 user nova-compute[74337]:     <apic/>
Oct 23 21:43:31 user nova-compute[74337]:     <vmcoreinfo/>
Oct 23 21:43:31 user nova-compute[74337]:   </features>
Oct 23 21:43:31 user nova-compute[74337]:   <clock offset="utc">
Oct 23 21:43:31 user nova-compute[74337]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 21:43:31 user nova-compute[74337]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 21:43:31 user nova-compute[74337]:     <timer name="hpet" present="no"/>
Oct 23 21:43:31 user nova-compute[74337]:   </clock>
Oct 23 21:43:31 user nova-compute[74337]:   <cpu mode="custom" match="exact">
Oct 23 21:43:31 user nova-compute[74337]:     <model>Nehalem</model>
Oct 23 21:43:31 user nova-compute[74337]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 21:43:31 user nova-compute[74337]:   </cpu>
Oct 23 21:43:31 user nova-compute[74337]:   <devices>
Oct 23 21:43:31 user nova-compute[74337]:     <disk type="file" device="disk">
Oct 23 21:43:31 user nova-compute[74337]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 21:43:31 user nova-compute[74337]:       <source file="/opt/stack/data/nova/instances/195a4056-3254-4558-b2f5-299bcd4af07c/disk"/>
Oct 23 21:43:31 user nova-compute[74337]:       <target dev="vda" bus="virtio"/>
Oct 23 21:43:31 user nova-compute[74337]:     </disk>
Oct 23 21:43:31 user nova-compute[74337]:     <interface type="ethernet">
Oct 23 21:43:31 user nova-compute[74337]:       <mac address="fa:16:3e:26:a4:b5"/>
Oct 23 21:43:31 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:43:31 user nova-compute[74337]:       <mtu size="1442"/>
Oct 23 21:43:31 user nova-compute[74337]:       <target dev="tapefec7d56-28"/>
Oct 23 21:43:31 user nova-compute[74337]:     </interface>
Oct 23 21:43:31 user nova-compute[74337]:     <serial type="pty">
Oct 23 21:43:31 user nova-compute[74337]:       <log file="/opt/stack/data/nova/instances/195a4056-3254-4558-b2f5-299bcd4af07c/console.log" append="off"/>
Oct 23 21:43:31 user nova-compute[74337]:     </serial>
Oct 23 21:43:31 user nova-compute[74337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 21:43:31 user nova-compute[74337]:     <video>
Oct 23 21:43:31 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:43:31 user nova-compute[74337]:     </video>
Oct 23 21:43:31 user nova-compute[74337]:     <rng model="virtio">
Oct 23 21:43:31 user nova-compute[74337]:       <backend model="random">/dev/urandom</backend>
Oct 23 21:43:31 user nova-compute[74337]:     </rng>
Oct 23 21:43:31 user nova-compute[74337]:     <controller type="usb" index="0" model="none"/>
Oct 23 21:43:31 user nova-compute[74337]:     <memballoon model="virtio">
Oct 23 21:43:31 user nova-compute[74337]:       <stats period="10"/>
Oct 23 21:43:31 user nova-compute[74337]:     </memballoon>
Oct 23 21:43:31 user nova-compute[74337]:   </devices>
Oct 23 21:43:31 user nova-compute[74337]: </domain>
Oct 23 21:43:31 user nova-compute[74337]:  {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 21:43:31 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-a25db3b2-fb33-43f4-9597-f4d441d0cb2b tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:43:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-696848694',display_name='tempest-tempest.common.compute-instance-696848694',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-696848694',id=23,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAWzQm4+V4g91dNEdG8YLkJhCynO3Ap8ILaI8oMN1LNLl54g3kIsrbEh6Mxm9fgmaJnzv3izz6qYqT1bG4NWKyccXk+mb+zPPixuCgYlO6IQfM8pLRdMrw36YsRSiIFnHQ==',key_name='tempest-keypair-1081806285',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e1f57e58a9ec4c6384dc0d3ca58eb610',ramdisk_id='',reservation_id='r-8no3m5aa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-100075475',owner_user_name='tempest-ServerActionsTestOtherA-100075475-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:43:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='891ee2e3acc54ed0bc4571f63ff491a0',uuid=195a4056-3254-4558-b2f5-299bcd4af07c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "efec7d56-28cb-4da2-b6f7-6e9777d3377b", "address": "fa:16:3e:26:a4:b5", "network": {"id": "aff1f95f-fda8-4f0f-8d10-7e3d587e4fda", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2048135647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1f57e58a9ec4c6384dc0d3ca58eb610", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefec7d56-28", "ovs_interfaceid": "efec7d56-28cb-4da2-b6f7-6e9777d3377b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 21:43:31 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-a25db3b2-fb33-43f4-9597-f4d441d0cb2b tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Converting VIF {"id": "efec7d56-28cb-4da2-b6f7-6e9777d3377b", "address": "fa:16:3e:26:a4:b5", "network": {"id": "aff1f95f-fda8-4f0f-8d10-7e3d587e4fda", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2048135647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1f57e58a9ec4c6384dc0d3ca58eb610", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefec7d56-28", "ovs_interfaceid": "efec7d56-28cb-4da2-b6f7-6e9777d3377b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:43:31 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-a25db3b2-fb33-43f4-9597-f4d441d0cb2b tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:a4:b5,bridge_name='br-int',has_traffic_filtering=True,id=efec7d56-28cb-4da2-b6f7-6e9777d3377b,network=Network(aff1f95f-fda8-4f0f-8d10-7e3d587e4fda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefec7d56-28') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:43:31 user nova-compute[74337]: DEBUG os_vif [None req-a25db3b2-fb33-43f4-9597-f4d441d0cb2b tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:a4:b5,bridge_name='br-int',has_traffic_filtering=True,id=efec7d56-28cb-4da2-b6f7-6e9777d3377b,network=Network(aff1f95f-fda8-4f0f-8d10-7e3d587e4fda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefec7d56-28') {{(pid=74337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 21:43:31 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:43:31 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:43:31 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 21:43:31 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:43:31 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bc0d3ecb-81f0-5244-9589-dbd71808393f', '_type': 'linux-noop'}}, row=False) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:43:31 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:43:31 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:43:31 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:43:31 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapefec7d56-28, may_exist=True, interface_attrs={}) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:43:31 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapefec7d56-28, col_values=(('qos', UUID('04fd3521-351a-4bf6-9c74-5a437ae16152')),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:43:31 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapefec7d56-28, col_values=(('external_ids', {'iface-id': 'efec7d56-28cb-4da2-b6f7-6e9777d3377b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:26:a4:b5', 'vm-uuid': '195a4056-3254-4558-b2f5-299bcd4af07c'}),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:43:31 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:43:31 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:43:31 user nova-compute[74337]: INFO os_vif [None req-a25db3b2-fb33-43f4-9597-f4d441d0cb2b tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:a4:b5,bridge_name='br-int',has_traffic_filtering=True,id=efec7d56-28cb-4da2-b6f7-6e9777d3377b,network=Network(aff1f95f-fda8-4f0f-8d10-7e3d587e4fda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefec7d56-28')
Oct 23 21:43:31 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-a25db3b2-fb33-43f4-9597-f4d441d0cb2b tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] No BDM found with device name vda, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 21:43:31 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-a25db3b2-fb33-43f4-9597-f4d441d0cb2b tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] No VIF found with MAC fa:16:3e:26:a4:b5, not building metadata {{(pid=74337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 21:43:31 user nova-compute[74337]: DEBUG nova.network.neutron [req-d82831d0-11d6-46b7-a00e-865b4cceb884 req-66f058c2-5c53-44a1-af09-c8e346b605a5 service nova] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Updated VIF entry in instance network info cache for port efec7d56-28cb-4da2-b6f7-6e9777d3377b. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 21:43:31 user nova-compute[74337]: DEBUG nova.network.neutron [req-d82831d0-11d6-46b7-a00e-865b4cceb884 req-66f058c2-5c53-44a1-af09-c8e346b605a5 service nova] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Updating instance_info_cache with network_info: [{"id": "efec7d56-28cb-4da2-b6f7-6e9777d3377b", "address": "fa:16:3e:26:a4:b5", "network": {"id": "aff1f95f-fda8-4f0f-8d10-7e3d587e4fda", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2048135647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1f57e58a9ec4c6384dc0d3ca58eb610", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefec7d56-28", "ovs_interfaceid": "efec7d56-28cb-4da2-b6f7-6e9777d3377b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:43:31 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-d82831d0-11d6-46b7-a00e-865b4cceb884 req-66f058c2-5c53-44a1-af09-c8e346b605a5 service nova] Releasing lock "refresh_cache-195a4056-3254-4558-b2f5-299bcd4af07c" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:43:32 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:43:32 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:43:32 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:43:33 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:43:33 user nova-compute[74337]: DEBUG nova.compute.manager [req-840ca4cd-bf3f-4348-b70f-7b893bfa0a0a req-09a76876-288b-4a69-8e42-b8546b710c78 service nova] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Received event network-vif-plugged-efec7d56-28cb-4da2-b6f7-6e9777d3377b {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:43:33 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-840ca4cd-bf3f-4348-b70f-7b893bfa0a0a req-09a76876-288b-4a69-8e42-b8546b710c78 service nova] Acquiring lock "195a4056-3254-4558-b2f5-299bcd4af07c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:43:33 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-840ca4cd-bf3f-4348-b70f-7b893bfa0a0a req-09a76876-288b-4a69-8e42-b8546b710c78 service nova] Lock "195a4056-3254-4558-b2f5-299bcd4af07c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:43:33 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-840ca4cd-bf3f-4348-b70f-7b893bfa0a0a req-09a76876-288b-4a69-8e42-b8546b710c78 service nova] Lock "195a4056-3254-4558-b2f5-299bcd4af07c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:43:33 user nova-compute[74337]: DEBUG nova.compute.manager [req-840ca4cd-bf3f-4348-b70f-7b893bfa0a0a req-09a76876-288b-4a69-8e42-b8546b710c78 service nova] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] No waiting events found dispatching network-vif-plugged-efec7d56-28cb-4da2-b6f7-6e9777d3377b {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:43:33 user nova-compute[74337]: WARNING nova.compute.manager [req-840ca4cd-bf3f-4348-b70f-7b893bfa0a0a req-09a76876-288b-4a69-8e42-b8546b710c78 service nova] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Received unexpected event network-vif-plugged-efec7d56-28cb-4da2-b6f7-6e9777d3377b for instance with vm_state building and task_state spawning.
Oct 23 21:43:33 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:43:35 user nova-compute[74337]: DEBUG nova.compute.manager [None req-a25db3b2-fb33-43f4-9597-f4d441d0cb2b tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Instance event wait completed in 0 seconds for  {{(pid=74337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 21:43:35 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-a25db3b2-fb33-43f4-9597-f4d441d0cb2b tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Guest created on hypervisor {{(pid=74337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 21:43:35 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Instance spawned successfully.
Oct 23 21:43:35 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-a25db3b2-fb33-43f4-9597-f4d441d0cb2b tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 21:43:35 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-a25db3b2-fb33-43f4-9597-f4d441d0cb2b tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Found default for hw_cdrom_bus of ide {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:43:35 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-a25db3b2-fb33-43f4-9597-f4d441d0cb2b tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Found default for hw_disk_bus of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:43:35 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-a25db3b2-fb33-43f4-9597-f4d441d0cb2b tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Found default for hw_input_bus of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:43:35 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-a25db3b2-fb33-43f4-9597-f4d441d0cb2b tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Found default for hw_pointer_model of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:43:35 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-a25db3b2-fb33-43f4-9597-f4d441d0cb2b tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Found default for hw_video_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:43:35 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-a25db3b2-fb33-43f4-9597-f4d441d0cb2b tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Found default for hw_vif_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:43:35 user nova-compute[74337]: INFO nova.compute.manager [None req-a25db3b2-fb33-43f4-9597-f4d441d0cb2b tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Took 5.48 seconds to spawn the instance on the hypervisor.
Oct 23 21:43:35 user nova-compute[74337]: DEBUG nova.compute.manager [None req-a25db3b2-fb33-43f4-9597-f4d441d0cb2b tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Checking state {{(pid=74337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 21:43:35 user nova-compute[74337]: DEBUG nova.compute.manager [req-fc43f456-e9da-4a85-a3ff-d1cb03be1a6a req-8af88218-f359-4d2f-89ef-df8bc1455fa4 service nova] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Received event network-vif-plugged-efec7d56-28cb-4da2-b6f7-6e9777d3377b {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:43:35 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-fc43f456-e9da-4a85-a3ff-d1cb03be1a6a req-8af88218-f359-4d2f-89ef-df8bc1455fa4 service nova] Acquiring lock "195a4056-3254-4558-b2f5-299bcd4af07c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:43:35 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-fc43f456-e9da-4a85-a3ff-d1cb03be1a6a req-8af88218-f359-4d2f-89ef-df8bc1455fa4 service nova] Lock "195a4056-3254-4558-b2f5-299bcd4af07c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:43:35 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-fc43f456-e9da-4a85-a3ff-d1cb03be1a6a req-8af88218-f359-4d2f-89ef-df8bc1455fa4 service nova] Lock "195a4056-3254-4558-b2f5-299bcd4af07c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:43:35 user nova-compute[74337]: DEBUG nova.compute.manager [req-fc43f456-e9da-4a85-a3ff-d1cb03be1a6a req-8af88218-f359-4d2f-89ef-df8bc1455fa4 service nova] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] No waiting events found dispatching network-vif-plugged-efec7d56-28cb-4da2-b6f7-6e9777d3377b {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:43:35 user nova-compute[74337]: WARNING nova.compute.manager [req-fc43f456-e9da-4a85-a3ff-d1cb03be1a6a req-8af88218-f359-4d2f-89ef-df8bc1455fa4 service nova] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Received unexpected event network-vif-plugged-efec7d56-28cb-4da2-b6f7-6e9777d3377b for instance with vm_state building and task_state spawning.
Oct 23 21:43:35 user nova-compute[74337]: INFO nova.compute.manager [None req-a25db3b2-fb33-43f4-9597-f4d441d0cb2b tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Took 6.26 seconds to build instance.
Oct 23 21:43:35 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-a25db3b2-fb33-43f4-9597-f4d441d0cb2b tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lock "195a4056-3254-4558-b2f5-299bcd4af07c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.400s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:43:36 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:43:38 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:43:41 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:43:41 user nova-compute[74337]: INFO nova.compute.manager [None req-b6e99ea2-973f-4ddb-bd2b-4ba318934a4a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] Rescuing
Oct 23 21:43:41 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-b6e99ea2-973f-4ddb-bd2b-4ba318934a4a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Acquiring lock "refresh_cache-c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:43:41 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-b6e99ea2-973f-4ddb-bd2b-4ba318934a4a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Acquired lock "refresh_cache-c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:43:41 user nova-compute[74337]: DEBUG nova.network.neutron [None req-b6e99ea2-973f-4ddb-bd2b-4ba318934a4a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] Building network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 21:43:42 user nova-compute[74337]: DEBUG nova.network.neutron [None req-b6e99ea2-973f-4ddb-bd2b-4ba318934a4a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] Updating instance_info_cache with network_info: [{"id": "328722f1-b384-495c-8aea-81780b2d9ca1", "address": "fa:16:3e:28:35:83", "network": {"id": "5f62b1d8-d5d0-4ff9-922b-fc6e72fb640d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-655282105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b85c4f783a4ee7ab67422b49da85ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap328722f1-b3", "ovs_interfaceid": "328722f1-b384-495c-8aea-81780b2d9ca1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:43:42 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-b6e99ea2-973f-4ddb-bd2b-4ba318934a4a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Releasing lock "refresh_cache-c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:43:42 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:43:42 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:43:42 user nova-compute[74337]: DEBUG nova.compute.manager [req-babec93f-341b-45a9-ad04-cb698c68bc96 req-ede0b1ed-d69b-4527-ba4f-b3a7ce7c30ba service nova] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] Received event network-vif-unplugged-328722f1-b384-495c-8aea-81780b2d9ca1 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:43:42 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-babec93f-341b-45a9-ad04-cb698c68bc96 req-ede0b1ed-d69b-4527-ba4f-b3a7ce7c30ba service nova] Acquiring lock "c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:43:42 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-babec93f-341b-45a9-ad04-cb698c68bc96 req-ede0b1ed-d69b-4527-ba4f-b3a7ce7c30ba service nova] Lock "c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:43:42 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-babec93f-341b-45a9-ad04-cb698c68bc96 req-ede0b1ed-d69b-4527-ba4f-b3a7ce7c30ba service nova] Lock "c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:43:42 user nova-compute[74337]: DEBUG nova.compute.manager [req-babec93f-341b-45a9-ad04-cb698c68bc96 req-ede0b1ed-d69b-4527-ba4f-b3a7ce7c30ba service nova] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] No waiting events found dispatching network-vif-unplugged-328722f1-b384-495c-8aea-81780b2d9ca1 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:43:42 user nova-compute[74337]: WARNING nova.compute.manager [req-babec93f-341b-45a9-ad04-cb698c68bc96 req-ede0b1ed-d69b-4527-ba4f-b3a7ce7c30ba service nova] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] Received unexpected event network-vif-unplugged-328722f1-b384-495c-8aea-81780b2d9ca1 for instance with vm_state active and task_state rescuing.
Oct 23 21:43:42 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:43:42 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:43:43 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] Instance destroyed successfully.
Oct 23 21:43:43 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-b6e99ea2-973f-4ddb-bd2b-4ba318934a4a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] Attempting a stable device rescue
Oct 23 21:43:43 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-b6e99ea2-973f-4ddb-bd2b-4ba318934a4a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74337) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 23 21:43:43 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-b6e99ea2-973f-4ddb-bd2b-4ba318934a4a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] Instance directory exists: not creating {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 23 21:43:43 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-b6e99ea2-973f-4ddb-bd2b-4ba318934a4a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] Creating image(s)
Oct 23 21:43:43 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-b6e99ea2-973f-4ddb-bd2b-4ba318934a4a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Acquiring lock "/opt/stack/data/nova/instances/c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:43:43 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-b6e99ea2-973f-4ddb-bd2b-4ba318934a4a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lock "/opt/stack/data/nova/instances/c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:43:43 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-b6e99ea2-973f-4ddb-bd2b-4ba318934a4a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lock "/opt/stack/data/nova/instances/c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:43:43 user nova-compute[74337]: DEBUG nova.objects.instance [None req-b6e99ea2-973f-4ddb-bd2b-4ba318934a4a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lazy-loading 'trusted_certs' on Instance uuid c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:43:43 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-b6e99ea2-973f-4ddb-bd2b-4ba318934a4a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Acquiring lock "beb91e538b7d20de7d02330d4c518759cd6c43c3" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:43:43 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-b6e99ea2-973f-4ddb-bd2b-4ba318934a4a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lock "beb91e538b7d20de7d02330d4c518759cd6c43c3" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:43:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-b6e99ea2-973f-4ddb-bd2b-4ba318934a4a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/beb91e538b7d20de7d02330d4c518759cd6c43c3.part --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:43:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:43:44 user nova-compute[74337]: DEBUG nova.compute.manager [req-929500ef-8655-41cf-8d86-b3f2cc2d6b41 req-b8287067-6569-4847-aa20-eb17863b29ff service nova] [instance: 01d407b0-a7cf-4222-9f2d-54b99eeeed84] Received event network-changed-720aee52-2c25-49de-bf60-743dea4b66ff {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:43:44 user nova-compute[74337]: DEBUG nova.compute.manager [req-929500ef-8655-41cf-8d86-b3f2cc2d6b41 req-b8287067-6569-4847-aa20-eb17863b29ff service nova] [instance: 01d407b0-a7cf-4222-9f2d-54b99eeeed84] Refreshing instance network info cache due to event network-changed-720aee52-2c25-49de-bf60-743dea4b66ff. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 21:43:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-929500ef-8655-41cf-8d86-b3f2cc2d6b41 req-b8287067-6569-4847-aa20-eb17863b29ff service nova] Acquiring lock "refresh_cache-01d407b0-a7cf-4222-9f2d-54b99eeeed84" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:43:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-929500ef-8655-41cf-8d86-b3f2cc2d6b41 req-b8287067-6569-4847-aa20-eb17863b29ff service nova] Acquired lock "refresh_cache-01d407b0-a7cf-4222-9f2d-54b99eeeed84" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:43:44 user nova-compute[74337]: DEBUG nova.network.neutron [req-929500ef-8655-41cf-8d86-b3f2cc2d6b41 req-b8287067-6569-4847-aa20-eb17863b29ff service nova] [instance: 01d407b0-a7cf-4222-9f2d-54b99eeeed84] Refreshing network info cache for port 720aee52-2c25-49de-bf60-743dea4b66ff {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 21:43:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-b6e99ea2-973f-4ddb-bd2b-4ba318934a4a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/beb91e538b7d20de7d02330d4c518759cd6c43c3.part --force-share --output=json" returned: 0 in 0.205s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:43:44 user nova-compute[74337]: DEBUG nova.virt.images [None req-b6e99ea2-973f-4ddb-bd2b-4ba318934a4a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] d0f0afc9-fac6-44f8-8aec-a022175a3e59 was qcow2, converting to raw {{(pid=74337) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 23 21:43:44 user nova-compute[74337]: DEBUG nova.privsep.utils [None req-b6e99ea2-973f-4ddb-bd2b-4ba318934a4a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74337) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 23 21:43:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-b6e99ea2-973f-4ddb-bd2b-4ba318934a4a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/beb91e538b7d20de7d02330d4c518759cd6c43c3.part /opt/stack/data/nova/instances/_base/beb91e538b7d20de7d02330d4c518759cd6c43c3.converted {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:43:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-b6e99ea2-973f-4ddb-bd2b-4ba318934a4a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/beb91e538b7d20de7d02330d4c518759cd6c43c3.part /opt/stack/data/nova/instances/_base/beb91e538b7d20de7d02330d4c518759cd6c43c3.converted" returned: 0 in 0.289s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:43:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-b6e99ea2-973f-4ddb-bd2b-4ba318934a4a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/beb91e538b7d20de7d02330d4c518759cd6c43c3.converted --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:43:44 user nova-compute[74337]: DEBUG nova.compute.manager [req-bdf71359-0ccc-419c-9a83-14ddec219120 req-d2cc4026-c151-4005-a581-c93a95d586a7 service nova] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] Received event network-vif-plugged-328722f1-b384-495c-8aea-81780b2d9ca1 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:43:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-bdf71359-0ccc-419c-9a83-14ddec219120 req-d2cc4026-c151-4005-a581-c93a95d586a7 service nova] Acquiring lock "c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:43:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-bdf71359-0ccc-419c-9a83-14ddec219120 req-d2cc4026-c151-4005-a581-c93a95d586a7 service nova] Lock "c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:43:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-bdf71359-0ccc-419c-9a83-14ddec219120 req-d2cc4026-c151-4005-a581-c93a95d586a7 service nova] Lock "c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:43:44 user nova-compute[74337]: DEBUG nova.compute.manager [req-bdf71359-0ccc-419c-9a83-14ddec219120 req-d2cc4026-c151-4005-a581-c93a95d586a7 service nova] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] No waiting events found dispatching network-vif-plugged-328722f1-b384-495c-8aea-81780b2d9ca1 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:43:44 user nova-compute[74337]: WARNING nova.compute.manager [req-bdf71359-0ccc-419c-9a83-14ddec219120 req-d2cc4026-c151-4005-a581-c93a95d586a7 service nova] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] Received unexpected event network-vif-plugged-328722f1-b384-495c-8aea-81780b2d9ca1 for instance with vm_state active and task_state rescuing.
Oct 23 21:43:44 user nova-compute[74337]: DEBUG nova.network.neutron [req-929500ef-8655-41cf-8d86-b3f2cc2d6b41 req-b8287067-6569-4847-aa20-eb17863b29ff service nova] [instance: 01d407b0-a7cf-4222-9f2d-54b99eeeed84] Updated VIF entry in instance network info cache for port 720aee52-2c25-49de-bf60-743dea4b66ff. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 21:43:44 user nova-compute[74337]: DEBUG nova.network.neutron [req-929500ef-8655-41cf-8d86-b3f2cc2d6b41 req-b8287067-6569-4847-aa20-eb17863b29ff service nova] [instance: 01d407b0-a7cf-4222-9f2d-54b99eeeed84] Updating instance_info_cache with network_info: [{"id": "720aee52-2c25-49de-bf60-743dea4b66ff", "address": "fa:16:3e:a6:0f:9d", "network": {"id": "787d9979-63ad-4318-b1d7-8ec69c5969fe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1847253864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84a25b3eed8548a5a324e55b28f26252", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap720aee52-2c", "ovs_interfaceid": "720aee52-2c25-49de-bf60-743dea4b66ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:43:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-929500ef-8655-41cf-8d86-b3f2cc2d6b41 req-b8287067-6569-4847-aa20-eb17863b29ff service nova] Releasing lock "refresh_cache-01d407b0-a7cf-4222-9f2d-54b99eeeed84" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:43:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-b6e99ea2-973f-4ddb-bd2b-4ba318934a4a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/beb91e538b7d20de7d02330d4c518759cd6c43c3.converted --force-share --output=json" returned: 0 in 0.203s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:43:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-b6e99ea2-973f-4ddb-bd2b-4ba318934a4a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lock "beb91e538b7d20de7d02330d4c518759cd6c43c3" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.756s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:43:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-b6e99ea2-973f-4ddb-bd2b-4ba318934a4a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Acquiring lock "beb91e538b7d20de7d02330d4c518759cd6c43c3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:43:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-b6e99ea2-973f-4ddb-bd2b-4ba318934a4a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lock "beb91e538b7d20de7d02330d4c518759cd6c43c3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:43:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-b6e99ea2-973f-4ddb-bd2b-4ba318934a4a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/beb91e538b7d20de7d02330d4c518759cd6c43c3 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:43:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-b6e99ea2-973f-4ddb-bd2b-4ba318934a4a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/beb91e538b7d20de7d02330d4c518759cd6c43c3 --force-share --output=json" returned: 0 in 0.197s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:43:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-b6e99ea2-973f-4ddb-bd2b-4ba318934a4a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/beb91e538b7d20de7d02330d4c518759cd6c43c3,backing_fmt=raw /opt/stack/data/nova/instances/c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d/disk.rescue {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:43:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-b6e99ea2-973f-4ddb-bd2b-4ba318934a4a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/beb91e538b7d20de7d02330d4c518759cd6c43c3,backing_fmt=raw /opt/stack/data/nova/instances/c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d/disk.rescue" returned: 0 in 0.051s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:43:45 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-b6e99ea2-973f-4ddb-bd2b-4ba318934a4a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lock "beb91e538b7d20de7d02330d4c518759cd6c43c3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:43:45 user nova-compute[74337]: DEBUG nova.objects.instance [None req-b6e99ea2-973f-4ddb-bd2b-4ba318934a4a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lazy-loading 'migration_context' on Instance uuid c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:43:45 user nova-compute[74337]: DEBUG nova.objects.base [None req-b6e99ea2-973f-4ddb-bd2b-4ba318934a4a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Object Instance<c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 21:43:45 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-b6e99ea2-973f-4ddb-bd2b-4ba318934a4a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] Created local disks {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 21:43:45 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-b6e99ea2-973f-4ddb-bd2b-4ba318934a4a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] Start _get_guest_xml network_info=[{"id": "328722f1-b384-495c-8aea-81780b2d9ca1", "address": "fa:16:3e:28:35:83", "network": {"id": "5f62b1d8-d5d0-4ff9-922b-fc6e72fb640d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-655282105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-655282105-network", "vif_mac": "fa:16:3e:28:35:83"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b85c4f783a4ee7ab67422b49da85ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap328722f1-b3", "ovs_interfaceid": "328722f1-b384-495c-8aea-81780b2d9ca1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T21:29:21Z,direct_url=<?>,disk_format='qcow2',id=d859d89d-998d-4109-b26a-0d6e28152932,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ff43462300764979a6cf688444336a56',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T21:29:22Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'd0f0afc9-fac6-44f8-8aec-a022175a3e59', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'd0899d7d-f29d-4a6b-9d2f-08b1bdcec6e4', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YSOQyrej', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d', 'attached_at': '', 'detached_at': '', 'volume_id': '8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4', 'serial': '8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4'}, 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 21:43:45 user nova-compute[74337]: DEBUG nova.objects.instance [None req-b6e99ea2-973f-4ddb-bd2b-4ba318934a4a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lazy-loading 'resources' on Instance uuid c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:43:45 user nova-compute[74337]: DEBUG nova.objects.base [None req-b6e99ea2-973f-4ddb-bd2b-4ba318934a4a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Object Instance<c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 21:43:45 user nova-compute[74337]: DEBUG nova.objects.instance [None req-b6e99ea2-973f-4ddb-bd2b-4ba318934a4a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lazy-loading 'numa_topology' on Instance uuid c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:43:45 user nova-compute[74337]: DEBUG nova.objects.base [None req-b6e99ea2-973f-4ddb-bd2b-4ba318934a4a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Object Instance<c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 21:43:45 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-b6e99ea2-973f-4ddb-bd2b-4ba318934a4a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:43:45 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-b6e99ea2-973f-4ddb-bd2b-4ba318934a4a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:43:45 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-b6e99ea2-973f-4ddb-bd2b-4ba318934a4a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 21:43:45 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-b6e99ea2-973f-4ddb-bd2b-4ba318934a4a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] CPU controller missing on host. {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 21:43:45 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-b6e99ea2-973f-4ddb-bd2b-4ba318934a4a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 21:43:45 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-b6e99ea2-973f-4ddb-bd2b-4ba318934a4a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] CPU controller found on host. {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 21:43:45 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-b6e99ea2-973f-4ddb-bd2b-4ba318934a4a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 21:43:45 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-b6e99ea2-973f-4ddb-bd2b-4ba318934a4a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T21:29:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T21:29:21Z,direct_url=<?>,disk_format='qcow2',id=d859d89d-998d-4109-b26a-0d6e28152932,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ff43462300764979a6cf688444336a56',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T21:29:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 21:43:45 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-b6e99ea2-973f-4ddb-bd2b-4ba318934a4a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Flavor limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 21:43:45 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-b6e99ea2-973f-4ddb-bd2b-4ba318934a4a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Image limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 21:43:45 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-b6e99ea2-973f-4ddb-bd2b-4ba318934a4a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Flavor pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 21:43:45 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-b6e99ea2-973f-4ddb-bd2b-4ba318934a4a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Image pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 21:43:45 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-b6e99ea2-973f-4ddb-bd2b-4ba318934a4a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 21:43:45 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-b6e99ea2-973f-4ddb-bd2b-4ba318934a4a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 21:43:45 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-b6e99ea2-973f-4ddb-bd2b-4ba318934a4a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 21:43:45 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-b6e99ea2-973f-4ddb-bd2b-4ba318934a4a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Got 1 possible topologies {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 21:43:45 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-b6e99ea2-973f-4ddb-bd2b-4ba318934a4a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 21:43:45 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-b6e99ea2-973f-4ddb-bd2b-4ba318934a4a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 21:43:45 user nova-compute[74337]: DEBUG nova.objects.instance [None req-b6e99ea2-973f-4ddb-bd2b-4ba318934a4a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lazy-loading 'vcpu_model' on Instance uuid c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:43:45 user nova-compute[74337]: DEBUG nova.objects.base [None req-b6e99ea2-973f-4ddb-bd2b-4ba318934a4a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Object Instance<c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 21:43:45 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6e99ea2-973f-4ddb-bd2b-4ba318934a4a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] Calling os-brick to attach iSCSI Volume {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 21:43:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6e99ea2-973f-4ddb-bd2b-4ba318934a4a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YSOQyrej', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:43:45 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-b6e99ea2-973f-4ddb-bd2b-4ba318934a4a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:43:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-b6e99ea2-973f-4ddb-bd2b-4ba318934a4a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:43:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-b6e99ea2-973f-4ddb-bd2b-4ba318934a4a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:43:45 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-b6e99ea2-973f-4ddb-bd2b-4ba318934a4a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:43:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-b6e99ea2-973f-4ddb-bd2b-4ba318934a4a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:43:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-b6e99ea2-973f-4ddb-bd2b-4ba318934a4a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:43:45 user nova-compute[74337]: INFO os_brick.initiator.connectors.iscsi [None req-b6e99ea2-973f-4ddb-bd2b-4ba318934a4a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 21:43:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 -p 172.16.0.220:3260 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:43:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:43:45 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef648d81-ecce-4276-936c-848fa53f6e84]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = YSOQyrej\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:43:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6e99ea2-973f-4ddb-bd2b-4ba318934a4a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Oct 23 21:43:45 user nova-compute[74337]: node.name = iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4
Oct 23 21:43:45 user nova-compute[74337]: node.tpgt = -1
Oct 23 21:43:45 user nova-compute[74337]: node.startup = automatic
Oct 23 21:43:45 user nova-compute[74337]: node.leading_login = No
Oct 23 21:43:45 user nova-compute[74337]: iface.iscsi_ifacename = default
Oct 23 21:43:45 user nova-compute[74337]: iface.net_ifacename = <empty>
Oct 23 21:43:45 user nova-compute[74337]: iface.ipaddress = <empty>
Oct 23 21:43:45 user nova-compute[74337]: iface.prefix_len = 0
Oct 23 21:43:45 user nova-compute[74337]: iface.hwaddress = <empty>
Oct 23 21:43:45 user nova-compute[74337]: iface.transport_name = tcp
Oct 23 21:43:45 user nova-compute[74337]: iface.initiatorname = <empty>
Oct 23 21:43:45 user nova-compute[74337]: iface.state = <empty>
Oct 23 21:43:45 user nova-compute[74337]: iface.vlan_id = 0
Oct 23 21:43:45 user nova-compute[74337]: iface.vlan_priority = 0
Oct 23 21:43:45 user nova-compute[74337]: iface.vlan_state = <empty>
Oct 23 21:43:45 user nova-compute[74337]: iface.iface_num = 0
Oct 23 21:43:45 user nova-compute[74337]: iface.mtu = 0
Oct 23 21:43:45 user nova-compute[74337]: iface.port = 0
Oct 23 21:43:45 user nova-compute[74337]: iface.bootproto = <empty>
Oct 23 21:43:45 user nova-compute[74337]: iface.subnet_mask = <empty>
Oct 23 21:43:45 user nova-compute[74337]: iface.gateway = <empty>
Oct 23 21:43:45 user nova-compute[74337]: iface.dhcp_alt_client_id_state = <empty>
Oct 23 21:43:45 user nova-compute[74337]: iface.dhcp_alt_client_id = <empty>
Oct 23 21:43:45 user nova-compute[74337]: iface.dhcp_dns = <empty>
Oct 23 21:43:45 user nova-compute[74337]: iface.dhcp_learn_iqn = <empty>
Oct 23 21:43:45 user nova-compute[74337]: iface.dhcp_req_vendor_id_state = <empty>
Oct 23 21:43:45 user nova-compute[74337]: iface.dhcp_vendor_id_state = <empty>
Oct 23 21:43:45 user nova-compute[74337]: iface.dhcp_vendor_id = <empty>
Oct 23 21:43:45 user nova-compute[74337]: iface.dhcp_slp_da = <empty>
Oct 23 21:43:45 user nova-compute[74337]: iface.fragmentation = <empty>
Oct 23 21:43:45 user nova-compute[74337]: iface.gratuitous_arp = <empty>
Oct 23 21:43:45 user nova-compute[74337]: iface.incoming_forwarding = <empty>
Oct 23 21:43:45 user nova-compute[74337]: iface.tos_state = <empty>
Oct 23 21:43:45 user nova-compute[74337]: iface.tos = 0
Oct 23 21:43:45 user nova-compute[74337]: iface.ttl = 0
Oct 23 21:43:45 user nova-compute[74337]: iface.delayed_ack = <empty>
Oct 23 21:43:45 user nova-compute[74337]: iface.tcp_nagle = <empty>
Oct 23 21:43:45 user nova-compute[74337]: iface.tcp_wsf_state = <empty>
Oct 23 21:43:45 user nova-compute[74337]: iface.tcp_wsf = 0
Oct 23 21:43:45 user nova-compute[74337]: iface.tcp_timer_scale = 0
Oct 23 21:43:45 user nova-compute[74337]: iface.tcp_timestamp = <empty>
Oct 23 21:43:45 user nova-compute[74337]: iface.redirect = <empty>
Oct 23 21:43:45 user nova-compute[74337]: iface.def_task_mgmt_timeout = 0
Oct 23 21:43:45 user nova-compute[74337]: iface.header_digest = <empty>
Oct 23 21:43:45 user nova-compute[74337]: iface.data_digest = <empty>
Oct 23 21:43:45 user nova-compute[74337]: iface.immediate_data = <empty>
Oct 23 21:43:45 user nova-compute[74337]: iface.initial_r2t = <empty>
Oct 23 21:43:45 user nova-compute[74337]: iface.data_seq_inorder = <empty>
Oct 23 21:43:45 user nova-compute[74337]: iface.data_pdu_inorder = <empty>
Oct 23 21:43:45 user nova-compute[74337]: iface.erl = 0
Oct 23 21:43:45 user nova-compute[74337]: iface.max_receive_data_len = 0
Oct 23 21:43:45 user nova-compute[74337]: iface.first_burst_len = 0
Oct 23 21:43:45 user nova-compute[74337]: iface.max_outstanding_r2t = 0
Oct 23 21:43:45 user nova-compute[74337]: iface.max_burst_len = 0
Oct 23 21:43:45 user nova-compute[74337]: iface.chap_auth = <empty>
Oct 23 21:43:45 user nova-compute[74337]: iface.bidi_chap = <empty>
Oct 23 21:43:45 user nova-compute[74337]: iface.strict_login_compliance = <empty>
Oct 23 21:43:45 user nova-compute[74337]: iface.discovery_auth = <empty>
Oct 23 21:43:45 user nova-compute[74337]: iface.discovery_logout = <empty>
Oct 23 21:43:45 user nova-compute[74337]: node.discovery_address = <empty>
Oct 23 21:43:45 user nova-compute[74337]: node.discovery_port = 0
Oct 23 21:43:45 user nova-compute[74337]: node.discovery_type = static
Oct 23 21:43:45 user nova-compute[74337]: node.session.initial_cmdsn = 0
Oct 23 21:43:45 user nova-compute[74337]: node.session.initial_login_retry_max = 8
Oct 23 21:43:45 user nova-compute[74337]: node.session.xmit_thread_priority = -20
Oct 23 21:43:45 user nova-compute[74337]: node.session.cmds_max = 128
Oct 23 21:43:45 user nova-compute[74337]: node.session.queue_depth = 32
Oct 23 21:43:45 user nova-compute[74337]: node.session.nr_sessions = 1
Oct 23 21:43:45 user nova-compute[74337]: node.session.auth.authmethod = CHAP
Oct 23 21:43:45 user nova-compute[74337]: node.session.auth.username = YSOQyrej
Oct 23 21:43:45 user nova-compute[74337]: node.session.auth.password = ***
Oct 23 21:43:45 user nova-compute[74337]: node.session.auth.username_in = <empty>
Oct 23 21:43:45 user nova-compute[74337]: node.session.auth.password_in = <empty>
Oct 23 21:43:45 user nova-compute[74337]: node.session.auth.chap_algs = MD5
Oct 23 21:43:45 user nova-compute[74337]: node.session.timeo.replacement_timeout = 120
Oct 23 21:43:45 user nova-compute[74337]: node.session.err_timeo.abort_timeout = 15
Oct 23 21:43:45 user nova-compute[74337]: node.session.err_timeo.lu_reset_timeout = 30
Oct 23 21:43:45 user nova-compute[74337]: node.session.err_timeo.tgt_reset_timeout = 30
Oct 23 21:43:45 user nova-compute[74337]: node.session.err_timeo.host_reset_timeout = 60
Oct 23 21:43:45 user nova-compute[74337]: node.session.iscsi.FastAbort = Yes
Oct 23 21:43:45 user nova-compute[74337]: node.session.iscsi.InitialR2T = No
Oct 23 21:43:45 user nova-compute[74337]: node.session.iscsi.ImmediateData = Yes
Oct 23 21:43:45 user nova-compute[74337]: node.session.iscsi.FirstBurstLength = 262144
Oct 23 21:43:45 user nova-compute[74337]: node.session.iscsi.MaxBurstLength = 16776192
Oct 23 21:43:45 user nova-compute[74337]: node.session.iscsi.DefaultTime2Retain = 0
Oct 23 21:43:45 user nova-compute[74337]: node.session.iscsi.DefaultTime2Wait = 2
Oct 23 21:43:45 user nova-compute[74337]: node.session.iscsi.MaxConnections = 1
Oct 23 21:43:45 user nova-compute[74337]: node.session.iscsi.MaxOutstandingR2T = 1
Oct 23 21:43:45 user nova-compute[74337]: node.session.iscsi.ERL = 0
Oct 23 21:43:45 user nova-compute[74337]: node.session.scan = manual
Oct 23 21:43:45 user nova-compute[74337]: node.session.reopen_max = 0
Oct 23 21:43:45 user nova-compute[74337]: node.conn[0].address = 172.16.0.220
Oct 23 21:43:45 user nova-compute[74337]: node.conn[0].port = 3260
Oct 23 21:43:45 user nova-compute[74337]: node.conn[0].startup = manual
Oct 23 21:43:45 user nova-compute[74337]: node.conn[0].tcp.window_size = 524288
Oct 23 21:43:45 user nova-compute[74337]: node.conn[0].tcp.type_of_service = 0
Oct 23 21:43:45 user nova-compute[74337]: node.conn[0].timeo.logout_timeout = 15
Oct 23 21:43:45 user nova-compute[74337]: node.conn[0].timeo.login_timeout = 15
Oct 23 21:43:45 user nova-compute[74337]: node.conn[0].timeo.auth_timeout = 45
Oct 23 21:43:45 user nova-compute[74337]: node.conn[0].timeo.noop_out_interval = 5
Oct 23 21:43:45 user nova-compute[74337]: node.conn[0].timeo.noop_out_timeout = 5
Oct 23 21:43:45 user nova-compute[74337]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Oct 23 21:43:45 user nova-compute[74337]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Oct 23 21:43:45 user nova-compute[74337]: node.conn[0].iscsi.HeaderDigest = None
Oct 23 21:43:45 user nova-compute[74337]: node.conn[0].iscsi.DataDigest = None
Oct 23 21:43:45 user nova-compute[74337]: node.conn[0].iscsi.IFMarker = No
Oct 23 21:43:45 user nova-compute[74337]: node.conn[0].iscsi.OFMarker = No
Oct 23 21:43:45 user nova-compute[74337]: # END RECORD
Oct 23 21:43:45 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:43:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:43:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:43:45 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce518468-e5e8-414a-b2f8-ad241e9fcb4a]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:43:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6e99ea2-973f-4ddb-bd2b-4ba318934a4a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:43:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:43:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:43:45 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e2905a0-497a-4632-8a35-c83dea2ee54e]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:43:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6e99ea2-973f-4ddb-bd2b-4ba318934a4a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:43:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YSOQyrej {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:43:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YSOQyrej" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:43:45 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f0d91d3-2592-4e16-94fb-24f8d7f160c2]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:43:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6e99ea2-973f-4ddb-bd2b-4ba318934a4a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YSOQyrej'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:43:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:43:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:43:45 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[9884faa5-a863-479d-a4c1-97b63f34780c]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:43:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6e99ea2-973f-4ddb-bd2b-4ba318934a4a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:43:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:43:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:43:45 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[987107d7-a2be-4527-881c-4c71f8da3a1f]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611608fb-34d9-455e-9fdd-603b5897e666 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:43:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6e99ea2-973f-4ddb-bd2b-4ba318934a4a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:43:45 user nova-compute[74337]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611608fb-34d9-455e-9fdd-603b5897e666 (non-flash)
Oct 23 21:43:45 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:43:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6e99ea2-973f-4ddb-bd2b-4ba318934a4a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:43:45 user nova-compute[74337]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611608fb-34d9-455e-9fdd-603b5897e666 (non-flash)
Oct 23 21:43:45 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:43:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-b6e99ea2-973f-4ddb-bd2b-4ba318934a4a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.145s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:43:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6e99ea2-973f-4ddb-bd2b-4ba318934a4a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Connected to 172.16.0.220:3260 {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 21:43:45 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-b6e99ea2-973f-4ddb-bd2b-4ba318934a4a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] HCTL ('34', '0', '0', 0) found on session 22 with lun 0 {{(pid=74337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 21:43:45 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-b6e99ea2-973f-4ddb-bd2b-4ba318934a4a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=74337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 21:43:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:43:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:43:45 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[273a8503-a4f9-4b02-ab50-b7fbcdc08b18]: (4, ('0 0 0', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:43:45 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-b6e99ea2-973f-4ddb-bd2b-4ba318934a4a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Searching for a device in session 22 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=74337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 21:43:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6e99ea2-973f-4ddb-bd2b-4ba318934a4a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YSOQyrej', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 21:43:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-b6e99ea2-973f-4ddb-bd2b-4ba318934a4a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.173s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:43:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6e99ea2-973f-4ddb-bd2b-4ba318934a4a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] <== connect_volume: return (174ms) {'type': 'block', 'scsi_wwn': '26366393234653661', 'path': '/dev/sdc'} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:43:45 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6e99ea2-973f-4ddb-bd2b-4ba318934a4a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26366393234653661', 'path': '/dev/sdc'} {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 21:43:45 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-b6e99ea2-973f-4ddb-bd2b-4ba318934a4a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:41:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1651996924',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1651996924',id=20,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-23T21:42:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='83b85c4f783a4ee7ab67422b49da85ca',ramdisk_id='',reservation_id='r-53a64lky',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1944032280',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:42:30Z,user_data=None,user_id='a2e424dd3c684c808de14c2a9c3c1ed6',uuid=c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "328722f1-b384-495c-8aea-81780b2d9ca1", "address": "fa:16:3e:28:35:83", "network": {"id": "5f62b1d8-d5d0-4ff9-922b-fc6e72fb640d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-655282105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-655282105-network", "vif_mac": "fa:16:3e:28:35:83"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b85c4f783a4ee7ab67422b49da85ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap328722f1-b3", "ovs_interfaceid": "328722f1-b384-495c-8aea-81780b2d9ca1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 21:43:45 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-b6e99ea2-973f-4ddb-bd2b-4ba318934a4a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Converting VIF {"id": "328722f1-b384-495c-8aea-81780b2d9ca1", "address": "fa:16:3e:28:35:83", "network": {"id": "5f62b1d8-d5d0-4ff9-922b-fc6e72fb640d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-655282105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-655282105-network", "vif_mac": "fa:16:3e:28:35:83"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b85c4f783a4ee7ab67422b49da85ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap328722f1-b3", "ovs_interfaceid": "328722f1-b384-495c-8aea-81780b2d9ca1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:43:45 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-b6e99ea2-973f-4ddb-bd2b-4ba318934a4a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:28:35:83,bridge_name='br-int',has_traffic_filtering=True,id=328722f1-b384-495c-8aea-81780b2d9ca1,network=Network(5f62b1d8-d5d0-4ff9-922b-fc6e72fb640d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap328722f1-b3') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:43:45 user nova-compute[74337]: DEBUG nova.objects.instance [None req-b6e99ea2-973f-4ddb-bd2b-4ba318934a4a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lazy-loading 'pci_devices' on Instance uuid c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:43:45 user nova-compute[74337]: DEBUG nova.objects.base [None req-b6e99ea2-973f-4ddb-bd2b-4ba318934a4a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Object Instance<c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 21:43:45 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-b6e99ea2-973f-4ddb-bd2b-4ba318934a4a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] End _get_guest_xml xml=<domain type="kvm">
Oct 23 21:43:45 user nova-compute[74337]:   <uuid>c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d</uuid>
Oct 23 21:43:45 user nova-compute[74337]:   <name>instance-00000014</name>
Oct 23 21:43:45 user nova-compute[74337]:   <memory>524288</memory>
Oct 23 21:43:45 user nova-compute[74337]:   <vcpu>1</vcpu>
Oct 23 21:43:45 user nova-compute[74337]:   <metadata>
Oct 23 21:43:45 user nova-compute[74337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 21:43:45 user nova-compute[74337]:       <nova:package version="0.0.0"/>
Oct 23 21:43:45 user nova-compute[74337]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1651996924</nova:name>
Oct 23 21:43:45 user nova-compute[74337]:       <nova:creationTime>2023-10-23 21:43:45</nova:creationTime>
Oct 23 21:43:45 user nova-compute[74337]:       <nova:flavor name="m1.tiny">
Oct 23 21:43:45 user nova-compute[74337]:         <nova:memory>512</nova:memory>
Oct 23 21:43:45 user nova-compute[74337]:         <nova:disk>1</nova:disk>
Oct 23 21:43:45 user nova-compute[74337]:         <nova:swap>0</nova:swap>
Oct 23 21:43:45 user nova-compute[74337]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 21:43:45 user nova-compute[74337]:         <nova:vcpus>1</nova:vcpus>
Oct 23 21:43:45 user nova-compute[74337]:       </nova:flavor>
Oct 23 21:43:45 user nova-compute[74337]:       <nova:owner>
Oct 23 21:43:45 user nova-compute[74337]:         <nova:user uuid="a2e424dd3c684c808de14c2a9c3c1ed6">tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member</nova:user>
Oct 23 21:43:45 user nova-compute[74337]:         <nova:project uuid="83b85c4f783a4ee7ab67422b49da85ca">tempest-ServerBootFromVolumeStableRescueTest-1944032280</nova:project>
Oct 23 21:43:45 user nova-compute[74337]:       </nova:owner>
Oct 23 21:43:45 user nova-compute[74337]:       <nova:root type="image" uuid="d859d89d-998d-4109-b26a-0d6e28152932"/>
Oct 23 21:43:45 user nova-compute[74337]:       <nova:ports>
Oct 23 21:43:45 user nova-compute[74337]:         <nova:port uuid="328722f1-b384-495c-8aea-81780b2d9ca1">
Oct 23 21:43:45 user nova-compute[74337]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 23 21:43:45 user nova-compute[74337]:         </nova:port>
Oct 23 21:43:45 user nova-compute[74337]:       </nova:ports>
Oct 23 21:43:45 user nova-compute[74337]:     </nova:instance>
Oct 23 21:43:45 user nova-compute[74337]:   </metadata>
Oct 23 21:43:45 user nova-compute[74337]:   <sysinfo type="smbios">
Oct 23 21:43:45 user nova-compute[74337]:     <system>
Oct 23 21:43:45 user nova-compute[74337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 21:43:45 user nova-compute[74337]:       <entry name="product">OpenStack Nova</entry>
Oct 23 21:43:45 user nova-compute[74337]:       <entry name="version">0.0.0</entry>
Oct 23 21:43:45 user nova-compute[74337]:       <entry name="serial">c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d</entry>
Oct 23 21:43:45 user nova-compute[74337]:       <entry name="uuid">c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d</entry>
Oct 23 21:43:45 user nova-compute[74337]:       <entry name="family">Virtual Machine</entry>
Oct 23 21:43:45 user nova-compute[74337]:     </system>
Oct 23 21:43:45 user nova-compute[74337]:   </sysinfo>
Oct 23 21:43:45 user nova-compute[74337]:   <os>
Oct 23 21:43:45 user nova-compute[74337]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 21:43:45 user nova-compute[74337]:     <smbios mode="sysinfo"/>
Oct 23 21:43:45 user nova-compute[74337]:   </os>
Oct 23 21:43:45 user nova-compute[74337]:   <features>
Oct 23 21:43:45 user nova-compute[74337]:     <acpi/>
Oct 23 21:43:45 user nova-compute[74337]:     <apic/>
Oct 23 21:43:45 user nova-compute[74337]:     <vmcoreinfo/>
Oct 23 21:43:45 user nova-compute[74337]:   </features>
Oct 23 21:43:45 user nova-compute[74337]:   <clock offset="utc">
Oct 23 21:43:45 user nova-compute[74337]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 21:43:45 user nova-compute[74337]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 21:43:45 user nova-compute[74337]:     <timer name="hpet" present="no"/>
Oct 23 21:43:45 user nova-compute[74337]:   </clock>
Oct 23 21:43:45 user nova-compute[74337]:   <cpu mode="custom" match="exact">
Oct 23 21:43:45 user nova-compute[74337]:     <model>Nehalem</model>
Oct 23 21:43:45 user nova-compute[74337]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 21:43:45 user nova-compute[74337]:   </cpu>
Oct 23 21:43:45 user nova-compute[74337]:   <devices>
Oct 23 21:43:45 user nova-compute[74337]:     <disk type="block" device="disk">
Oct 23 21:43:45 user nova-compute[74337]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 21:43:45 user nova-compute[74337]:       <source dev="/dev/sdc"/>
Oct 23 21:43:45 user nova-compute[74337]:       <target dev="vda" bus="virtio"/>
Oct 23 21:43:45 user nova-compute[74337]:       <serial>8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4</serial>
Oct 23 21:43:45 user nova-compute[74337]:     </disk>
Oct 23 21:43:45 user nova-compute[74337]:     <disk type="file" device="disk">
Oct 23 21:43:45 user nova-compute[74337]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 21:43:45 user nova-compute[74337]:       <source file="/opt/stack/data/nova/instances/c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d/disk.rescue"/>
Oct 23 21:43:45 user nova-compute[74337]:       <target dev="vdb" bus="virtio"/>
Oct 23 21:43:45 user nova-compute[74337]:       <boot order="1"/>
Oct 23 21:43:45 user nova-compute[74337]:     </disk>
Oct 23 21:43:45 user nova-compute[74337]:     <interface type="ethernet">
Oct 23 21:43:45 user nova-compute[74337]:       <mac address="fa:16:3e:28:35:83"/>
Oct 23 21:43:45 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:43:45 user nova-compute[74337]:       <mtu size="1442"/>
Oct 23 21:43:45 user nova-compute[74337]:       <target dev="tap328722f1-b3"/>
Oct 23 21:43:45 user nova-compute[74337]:     </interface>
Oct 23 21:43:45 user nova-compute[74337]:     <serial type="pty">
Oct 23 21:43:45 user nova-compute[74337]:       <log file="/opt/stack/data/nova/instances/c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d/console.log" append="off"/>
Oct 23 21:43:45 user nova-compute[74337]:     </serial>
Oct 23 21:43:45 user nova-compute[74337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 21:43:45 user nova-compute[74337]:     <video>
Oct 23 21:43:45 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:43:45 user nova-compute[74337]:     </video>
Oct 23 21:43:45 user nova-compute[74337]:     <rng model="virtio">
Oct 23 21:43:45 user nova-compute[74337]:       <backend model="random">/dev/urandom</backend>
Oct 23 21:43:45 user nova-compute[74337]:     </rng>
Oct 23 21:43:45 user nova-compute[74337]:     <controller type="usb" index="0" model="none"/>
Oct 23 21:43:45 user nova-compute[74337]:     <memballoon model="virtio">
Oct 23 21:43:45 user nova-compute[74337]:       <stats period="10"/>
Oct 23 21:43:45 user nova-compute[74337]:     </memballoon>
Oct 23 21:43:45 user nova-compute[74337]:   </devices>
Oct 23 21:43:45 user nova-compute[74337]: </domain>
Oct 23 21:43:45 user nova-compute[74337]:  {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 21:43:45 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] Instance destroyed successfully.
Oct 23 21:43:45 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-b6e99ea2-973f-4ddb-bd2b-4ba318934a4a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] No BDM found with device name vda, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 21:43:45 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-b6e99ea2-973f-4ddb-bd2b-4ba318934a4a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 21:43:45 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-b6e99ea2-973f-4ddb-bd2b-4ba318934a4a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] No VIF found with MAC fa:16:3e:28:35:83, not building metadata {{(pid=74337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 21:43:46 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-c4ef7214-d2ad-4ec4-bf76-755f859c2982 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Acquiring lock "b531e297-3649-4bab-8e13-10304a002b30" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:43:46 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-c4ef7214-d2ad-4ec4-bf76-755f859c2982 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "b531e297-3649-4bab-8e13-10304a002b30" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:43:46 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-c4ef7214-d2ad-4ec4-bf76-755f859c2982 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Acquiring lock "b531e297-3649-4bab-8e13-10304a002b30-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:43:46 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-c4ef7214-d2ad-4ec4-bf76-755f859c2982 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "b531e297-3649-4bab-8e13-10304a002b30-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:43:46 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-c4ef7214-d2ad-4ec4-bf76-755f859c2982 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "b531e297-3649-4bab-8e13-10304a002b30-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:43:46 user nova-compute[74337]: INFO nova.compute.manager [None req-c4ef7214-d2ad-4ec4-bf76-755f859c2982 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: b531e297-3649-4bab-8e13-10304a002b30] Terminating instance
Oct 23 21:43:46 user nova-compute[74337]: DEBUG nova.compute.manager [None req-c4ef7214-d2ad-4ec4-bf76-755f859c2982 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: b531e297-3649-4bab-8e13-10304a002b30] Start destroying the instance on the hypervisor. {{(pid=74337) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 21:43:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:43:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:43:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:43:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:43:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:43:46 user nova-compute[74337]: DEBUG nova.compute.manager [req-48e5b874-2328-4eda-855e-6ca6ba5ac8f7 req-bd7d63d0-b952-4045-a2dc-f1f85c5d3383 service nova] [instance: b531e297-3649-4bab-8e13-10304a002b30] Received event network-vif-unplugged-104a5da2-c546-44ed-9d19-d4f7e0875baa {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:43:46 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-48e5b874-2328-4eda-855e-6ca6ba5ac8f7 req-bd7d63d0-b952-4045-a2dc-f1f85c5d3383 service nova] Acquiring lock "b531e297-3649-4bab-8e13-10304a002b30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:43:46 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-48e5b874-2328-4eda-855e-6ca6ba5ac8f7 req-bd7d63d0-b952-4045-a2dc-f1f85c5d3383 service nova] Lock "b531e297-3649-4bab-8e13-10304a002b30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:43:46 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-48e5b874-2328-4eda-855e-6ca6ba5ac8f7 req-bd7d63d0-b952-4045-a2dc-f1f85c5d3383 service nova] Lock "b531e297-3649-4bab-8e13-10304a002b30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:43:46 user nova-compute[74337]: DEBUG nova.compute.manager [req-48e5b874-2328-4eda-855e-6ca6ba5ac8f7 req-bd7d63d0-b952-4045-a2dc-f1f85c5d3383 service nova] [instance: b531e297-3649-4bab-8e13-10304a002b30] No waiting events found dispatching network-vif-unplugged-104a5da2-c546-44ed-9d19-d4f7e0875baa {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:43:46 user nova-compute[74337]: DEBUG nova.compute.manager [req-48e5b874-2328-4eda-855e-6ca6ba5ac8f7 req-bd7d63d0-b952-4045-a2dc-f1f85c5d3383 service nova] [instance: b531e297-3649-4bab-8e13-10304a002b30] Received event network-vif-unplugged-104a5da2-c546-44ed-9d19-d4f7e0875baa for instance with task_state deleting. {{(pid=74337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 21:43:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:43:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:43:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:43:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:43:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:43:47 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: b531e297-3649-4bab-8e13-10304a002b30] Instance destroyed successfully.
Oct 23 21:43:47 user nova-compute[74337]: DEBUG nova.objects.instance [None req-c4ef7214-d2ad-4ec4-bf76-755f859c2982 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lazy-loading 'resources' on Instance uuid b531e297-3649-4bab-8e13-10304a002b30 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:43:47 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-c4ef7214-d2ad-4ec4-bf76-755f859c2982 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:41:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2100654115',display_name='tempest-TestVolumeBootPattern-server-2100654115',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2100654115',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-23T21:42:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cb567547bd4941fb87435a841c9d17c4',ramdisk_id='',reservation_id='r-fc3w6u1u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-499971371',owner_user_name='tempest-TestVolumeBootPattern-499971371-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T21:42:39Z,user_data=None,user_id='0c3e635e8e5447138a7f2db11695574c',uuid=b531e297-3649-4bab-8e13-10304a002b30,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "104a5da2-c546-44ed-9d19-d4f7e0875baa", "address": "fa:16:3e:ae:37:51", "network": {"id": "5a18e96f-a6eb-4989-9be3-154b54928b03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-507511840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb567547bd4941fb87435a841c9d17c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap104a5da2-c5", "ovs_interfaceid": "104a5da2-c546-44ed-9d19-d4f7e0875baa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 21:43:47 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-c4ef7214-d2ad-4ec4-bf76-755f859c2982 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Converting VIF {"id": "104a5da2-c546-44ed-9d19-d4f7e0875baa", "address": "fa:16:3e:ae:37:51", "network": {"id": "5a18e96f-a6eb-4989-9be3-154b54928b03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-507511840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb567547bd4941fb87435a841c9d17c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap104a5da2-c5", "ovs_interfaceid": "104a5da2-c546-44ed-9d19-d4f7e0875baa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:43:47 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-c4ef7214-d2ad-4ec4-bf76-755f859c2982 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:37:51,bridge_name='br-int',has_traffic_filtering=True,id=104a5da2-c546-44ed-9d19-d4f7e0875baa,network=Network(5a18e96f-a6eb-4989-9be3-154b54928b03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap104a5da2-c5') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:43:47 user nova-compute[74337]: DEBUG os_vif [None req-c4ef7214-d2ad-4ec4-bf76-755f859c2982 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:37:51,bridge_name='br-int',has_traffic_filtering=True,id=104a5da2-c546-44ed-9d19-d4f7e0875baa,network=Network(5a18e96f-a6eb-4989-9be3-154b54928b03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap104a5da2-c5') {{(pid=74337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 21:43:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:43:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap104a5da2-c5, bridge=br-int, if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:43:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:43:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:43:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7e94fdec-f310-4eef-8cad-f0a8ec6ebf95) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:43:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:43:47 user nova-compute[74337]: INFO os_vif [None req-c4ef7214-d2ad-4ec4-bf76-755f859c2982 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:37:51,bridge_name='br-int',has_traffic_filtering=True,id=104a5da2-c546-44ed-9d19-d4f7e0875baa,network=Network(5a18e96f-a6eb-4989-9be3-154b54928b03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap104a5da2-c5')
Oct 23 21:43:47 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4ef7214-d2ad-4ec4-bf76-755f859c2982 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: b531e297-3649-4bab-8e13-10304a002b30] calling os-brick to detach iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 21:43:47 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ef7214-d2ad-4ec4-bf76-755f859c2982 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, {'target_iqn': 'iqn.2010-10.org.openstack:611608fb-34d9-455e-9fdd-603b5897e666', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mKXBxTda', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:43:47 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-c4ef7214-d2ad-4ec4-bf76-755f859c2982 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:43:47 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-c4ef7214-d2ad-4ec4-bf76-755f859c2982 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:43:47 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-c4ef7214-d2ad-4ec4-bf76-755f859c2982 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:43:47 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:43:47 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:43:47 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[be3e5e92-a510-4edc-8a77-047840fe696f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:611608fb-34d9-455e-9fdd-603b5897e666\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:43:47 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ef7214-d2ad-4ec4-bf76-755f859c2982 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 21:43:47 user nova-compute[74337]: No targets found.
Oct 23 21:43:47 user nova-compute[74337]: iSNS:
Oct 23 21:43:47 user nova-compute[74337]: No targets found.
Oct 23 21:43:47 user nova-compute[74337]: STATIC:
Oct 23 21:43:47 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4
Oct 23 21:43:47 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:43:47 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:43:47 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:611608fb-34d9-455e-9fdd-603b5897e666
Oct 23 21:43:47 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:43:47 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:43:47 user nova-compute[74337]: FIRMWARE:
Oct 23 21:43:47 user nova-compute[74337]: No targets found.
Oct 23 21:43:47 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:43:47 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ef7214-d2ad-4ec4-bf76-755f859c2982 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 21:43:47 user nova-compute[74337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 21:43:47 user nova-compute[74337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 21:43:47 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ef7214-d2ad-4ec4-bf76-755f859c2982 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:611608fb-34d9-455e-9fdd-603b5897e666', 0)] {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 21:43:47 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:43:47 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:43:47 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8937571-e757-467a-87a2-e60dcd161c75]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:611608fb-34d9-455e-9fdd-603b5897e666\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:43:47 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:43:47 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:43:47 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e0d40f2-f72f-4947-8d14-4480b7b85367]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611608fb-34d9-455e-9fdd-603b5897e666 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:43:47 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ef7214-d2ad-4ec4-bf76-755f859c2982 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:43:47 user nova-compute[74337]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611608fb-34d9-455e-9fdd-603b5897e666 (non-flash)
Oct 23 21:43:47 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:43:47 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ef7214-d2ad-4ec4-bf76-755f859c2982 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:43:47 user nova-compute[74337]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611608fb-34d9-455e-9fdd-603b5897e666 (non-flash)
Oct 23 21:43:47 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:43:47 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ef7214-d2ad-4ec4-bf76-755f859c2982 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5eec2bc8b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:611608fb-34d9-455e-9fdd-603b5897e666'): ({'sdd'}, set())}) {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 21:43:47 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-c4ef7214-d2ad-4ec4-bf76-755f859c2982 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Removing single pathed devices sdd {{(pid=74337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 21:43:47 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:43:47 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:43:47 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e06676-e630-4173-a659-b2dea176599d]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:43:47 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:43:47 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:43:47 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ed1e9ae-b886-48b7-9381-c7ad470e7d1b]: (4, ('ok\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:43:47 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-c4ef7214-d2ad-4ec4-bf76-755f859c2982 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Flushing IO for device /dev/sdd {{(pid=74337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 21:43:47 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:43:48 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.073s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:43:48 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[12669874-9f8b-48d5-a362-4dffd57defc8]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:43:48 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-c4ef7214-d2ad-4ec4-bf76-755f859c2982 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 21:43:48 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:43:48 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.055s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:43:48 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d444585-ab1f-4710-9152-29d29cb6a471]: (4, ('1', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:43:48 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-c4ef7214-d2ad-4ec4-bf76-755f859c2982 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 21:43:48 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-c4ef7214-d2ad-4ec4-bf76-755f859c2982 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] SCSI volumes sdd have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 21:43:48 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ef7214-d2ad-4ec4-bf76-755f859c2982 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:611608fb-34d9-455e-9fdd-603b5897e666')] {{(pid=74337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 21:43:48 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:611608fb-34d9-455e-9fdd-603b5897e666 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:43:48 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:611608fb-34d9-455e-9fdd-603b5897e666 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.039s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:43:48 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b888f9f8-b05b-40e0-918f-4786d0695f41]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:43:48 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ef7214-d2ad-4ec4-bf76-755f859c2982 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:43:48 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:611608fb-34d9-455e-9fdd-603b5897e666 -p 172.16.0.220:3260 --logout {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:43:48 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0806fc50-07de-47e0-b728-3f674b77dbf4 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Calling os-brick to attach iSCSI Volume {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 21:43:48 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0806fc50-07de-47e0-b728-3f674b77dbf4 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vUTnNRCq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:43:48 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-0806fc50-07de-47e0-b728-3f674b77dbf4 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:43:48 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-0806fc50-07de-47e0-b728-3f674b77dbf4 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:43:48 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:611608fb-34d9-455e-9fdd-603b5897e666 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:43:48 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[db9241d7-1143-4717-8cd7-d1b49c194e01]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:611608fb-34d9-455e-9fdd-603b5897e666, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:611608fb-34d9-455e-9fdd-603b5897e666, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:43:48 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ef7214-d2ad-4ec4-bf76-755f859c2982 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:611608fb-34d9-455e-9fdd-603b5897e666, portal: 172.16.0.220,3260]
Oct 23 21:43:48 user nova-compute[74337]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:611608fb-34d9-455e-9fdd-603b5897e666, portal: 172.16.0.220,3260] successful.
Oct 23 21:43:48 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:43:48 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:611608fb-34d9-455e-9fdd-603b5897e666 -p 172.16.0.220:3260 --op delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:43:48 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:611608fb-34d9-455e-9fdd-603b5897e666 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:43:48 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[3219d85d-2de0-4875-a868-bfcdb0586839]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:43:48 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ef7214-d2ad-4ec4-bf76-755f859c2982 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:43:48 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-c4ef7214-d2ad-4ec4-bf76-755f859c2982 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.437s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:43:48 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ef7214-d2ad-4ec4-bf76-755f859c2982 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] <== disconnect_volume: return (438ms) None {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:43:48 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4ef7214-d2ad-4ec4-bf76-755f859c2982 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: b531e297-3649-4bab-8e13-10304a002b30] Disconnected iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 21:43:48 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-c4ef7214-d2ad-4ec4-bf76-755f859c2982 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: b531e297-3649-4bab-8e13-10304a002b30] Deleting instance files /opt/stack/data/nova/instances/b531e297-3649-4bab-8e13-10304a002b30_del
Oct 23 21:43:48 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-c4ef7214-d2ad-4ec4-bf76-755f859c2982 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: b531e297-3649-4bab-8e13-10304a002b30] Deletion of /opt/stack/data/nova/instances/b531e297-3649-4bab-8e13-10304a002b30_del complete
Oct 23 21:43:48 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-0806fc50-07de-47e0-b728-3f674b77dbf4 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.086s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:43:48 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-0806fc50-07de-47e0-b728-3f674b77dbf4 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:43:48 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-0806fc50-07de-47e0-b728-3f674b77dbf4 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:43:48 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-0806fc50-07de-47e0-b728-3f674b77dbf4 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:43:48 user nova-compute[74337]: INFO os_brick.initiator.connectors.iscsi [None req-0806fc50-07de-47e0-b728-3f674b77dbf4 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 21:43:48 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac -p 172.16.0.220:3260 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:43:48 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:43:48 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[290c96ed-09f1-4d09-8754-a21e0067409e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:43:48 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0806fc50-07de-47e0-b728-3f674b77dbf4 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 21:43:48 user nova-compute[74337]:  {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:43:48 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac -p 172.16.0.220:3260 --interface default --op new {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:43:48 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:43:48 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3780ffb-fcc9-40db-8757-f344911a519b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac] added\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:43:48 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0806fc50-07de-47e0-b728-3f674b77dbf4 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac] added
Oct 23 21:43:48 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:43:48 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:43:48 user nova-compute[74337]: INFO nova.compute.manager [None req-c4ef7214-d2ad-4ec4-bf76-755f859c2982 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: b531e297-3649-4bab-8e13-10304a002b30] Took 1.93 seconds to destroy the instance on the hypervisor.
Oct 23 21:43:48 user nova-compute[74337]: DEBUG oslo.service.loopingcall [None req-c4ef7214-d2ad-4ec4-bf76-755f859c2982 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74337) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 21:43:48 user nova-compute[74337]: DEBUG nova.compute.manager [-] [instance: b531e297-3649-4bab-8e13-10304a002b30] Deallocating network for instance {{(pid=74337) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 21:43:48 user nova-compute[74337]: DEBUG nova.network.neutron [-] [instance: b531e297-3649-4bab-8e13-10304a002b30] deallocate_for_instance() {{(pid=74337) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 21:43:48 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:43:48 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef6d755-3706-4de1-a81f-28488d851b2c]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:43:48 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0806fc50-07de-47e0-b728-3f674b77dbf4 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:43:48 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:43:48 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:43:48 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a440959e-625c-4f84-b675-4980800ec846]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:43:48 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0806fc50-07de-47e0-b728-3f674b77dbf4 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:43:48 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vUTnNRCq {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:43:48 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vUTnNRCq" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:43:48 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ff72542-0f26-42ba-bd3f-87a9b2c4b5d3]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:43:48 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0806fc50-07de-47e0-b728-3f674b77dbf4 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vUTnNRCq'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:43:48 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:43:48 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:43:48 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[675ba812-ec68-4ecf-be32-1b144a0a522b]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:43:48 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0806fc50-07de-47e0-b728-3f674b77dbf4 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:43:48 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:43:48 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:43:48 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:43:48 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d9d210-9bf6-464c-83e9-daa960cff651]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:43:48 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0806fc50-07de-47e0-b728-3f674b77dbf4 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:43:48 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:43:48 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0806fc50-07de-47e0-b728-3f674b77dbf4 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:43:48 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:43:48 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac -p 172.16.0.220:3260 --login {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:43:48 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:43:48 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[596084a6-027a-4754-8e72-1da0df46f8ee]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:43:48 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0806fc50-07de-47e0-b728-3f674b77dbf4 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac, portal: 172.16.0.220,3260]
Oct 23 21:43:48 user nova-compute[74337]: Login to [iface: default, target: iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac, portal: 172.16.0.220,3260] successful.
Oct 23 21:43:48 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:43:48 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:43:48 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.067s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:43:48 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b3c052-b633-47a2-b9b6-755d317e3201]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:43:48 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0806fc50-07de-47e0-b728-3f674b77dbf4 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:43:48 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:43:48 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:43:48 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[326ab96f-cc2d-42d8-b44b-caabced40a13]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:43:48 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0806fc50-07de-47e0-b728-3f674b77dbf4 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:43:48 user nova-compute[74337]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac (non-flash)
Oct 23 21:43:48 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:43:48 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0806fc50-07de-47e0-b728-3f674b77dbf4 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:43:48 user nova-compute[74337]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac (non-flash)
Oct 23 21:43:48 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:43:48 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-0806fc50-07de-47e0-b728-3f674b77dbf4 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:43:48 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0806fc50-07de-47e0-b728-3f674b77dbf4 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Connected to 172.16.0.220:3260 {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 21:43:48 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-0806fc50-07de-47e0-b728-3f674b77dbf4 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] HCTL ('33', '-', '-', 0) found on session 24 with lun 0 {{(pid=74337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 21:43:48 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-0806fc50-07de-47e0-b728-3f674b77dbf4 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 21:43:48 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:43:48 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.024s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:43:48 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af2ff1d-53e3-4db3-a6d7-d028607b471f]: (4, ('- - 0', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:43:48 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-0806fc50-07de-47e0-b728-3f674b77dbf4 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Searching for a device in session 24 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 21:43:48 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0806fc50-07de-47e0-b728-3f674b77dbf4 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vUTnNRCq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 21:43:48 user nova-compute[74337]: DEBUG nova.compute.manager [req-76f45e0b-9d32-495d-a858-f8993982ea33 req-c27568cd-0d4a-45b8-a04a-c688c0973bac service nova] [instance: b531e297-3649-4bab-8e13-10304a002b30] Received event network-vif-plugged-104a5da2-c546-44ed-9d19-d4f7e0875baa {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:43:48 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-76f45e0b-9d32-495d-a858-f8993982ea33 req-c27568cd-0d4a-45b8-a04a-c688c0973bac service nova] Acquiring lock "b531e297-3649-4bab-8e13-10304a002b30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:43:48 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-76f45e0b-9d32-495d-a858-f8993982ea33 req-c27568cd-0d4a-45b8-a04a-c688c0973bac service nova] Lock "b531e297-3649-4bab-8e13-10304a002b30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:43:48 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-76f45e0b-9d32-495d-a858-f8993982ea33 req-c27568cd-0d4a-45b8-a04a-c688c0973bac service nova] Lock "b531e297-3649-4bab-8e13-10304a002b30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:43:48 user nova-compute[74337]: DEBUG nova.compute.manager [req-76f45e0b-9d32-495d-a858-f8993982ea33 req-c27568cd-0d4a-45b8-a04a-c688c0973bac service nova] [instance: b531e297-3649-4bab-8e13-10304a002b30] No waiting events found dispatching network-vif-plugged-104a5da2-c546-44ed-9d19-d4f7e0875baa {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:43:48 user nova-compute[74337]: WARNING nova.compute.manager [req-76f45e0b-9d32-495d-a858-f8993982ea33 req-c27568cd-0d4a-45b8-a04a-c688c0973bac service nova] [instance: b531e297-3649-4bab-8e13-10304a002b30] Received unexpected event network-vif-plugged-104a5da2-c546-44ed-9d19-d4f7e0875baa for instance with vm_state active and task_state deleting.
Oct 23 21:43:48 user nova-compute[74337]: DEBUG nova.compute.manager [req-76f45e0b-9d32-495d-a858-f8993982ea33 req-c27568cd-0d4a-45b8-a04a-c688c0973bac service nova] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] Received event network-vif-plugged-328722f1-b384-495c-8aea-81780b2d9ca1 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:43:48 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-76f45e0b-9d32-495d-a858-f8993982ea33 req-c27568cd-0d4a-45b8-a04a-c688c0973bac service nova] Acquiring lock "c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:43:48 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-76f45e0b-9d32-495d-a858-f8993982ea33 req-c27568cd-0d4a-45b8-a04a-c688c0973bac service nova] Lock "c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:43:48 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-76f45e0b-9d32-495d-a858-f8993982ea33 req-c27568cd-0d4a-45b8-a04a-c688c0973bac service nova] Lock "c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:43:48 user nova-compute[74337]: DEBUG nova.compute.manager [req-76f45e0b-9d32-495d-a858-f8993982ea33 req-c27568cd-0d4a-45b8-a04a-c688c0973bac service nova] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] No waiting events found dispatching network-vif-plugged-328722f1-b384-495c-8aea-81780b2d9ca1 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:43:48 user nova-compute[74337]: WARNING nova.compute.manager [req-76f45e0b-9d32-495d-a858-f8993982ea33 req-c27568cd-0d4a-45b8-a04a-c688c0973bac service nova] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] Received unexpected event network-vif-plugged-328722f1-b384-495c-8aea-81780b2d9ca1 for instance with vm_state active and task_state rescuing.
Oct 23 21:43:48 user nova-compute[74337]: DEBUG nova.compute.manager [req-76f45e0b-9d32-495d-a858-f8993982ea33 req-c27568cd-0d4a-45b8-a04a-c688c0973bac service nova] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] Received event network-vif-plugged-328722f1-b384-495c-8aea-81780b2d9ca1 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:43:48 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-76f45e0b-9d32-495d-a858-f8993982ea33 req-c27568cd-0d4a-45b8-a04a-c688c0973bac service nova] Acquiring lock "c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:43:48 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-76f45e0b-9d32-495d-a858-f8993982ea33 req-c27568cd-0d4a-45b8-a04a-c688c0973bac service nova] Lock "c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:43:48 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-76f45e0b-9d32-495d-a858-f8993982ea33 req-c27568cd-0d4a-45b8-a04a-c688c0973bac service nova] Lock "c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:43:48 user nova-compute[74337]: DEBUG nova.compute.manager [req-76f45e0b-9d32-495d-a858-f8993982ea33 req-c27568cd-0d4a-45b8-a04a-c688c0973bac service nova] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] No waiting events found dispatching network-vif-plugged-328722f1-b384-495c-8aea-81780b2d9ca1 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:43:48 user nova-compute[74337]: WARNING nova.compute.manager [req-76f45e0b-9d32-495d-a858-f8993982ea33 req-c27568cd-0d4a-45b8-a04a-c688c0973bac service nova] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] Received unexpected event network-vif-plugged-328722f1-b384-495c-8aea-81780b2d9ca1 for instance with vm_state active and task_state rescuing.
Oct 23 21:43:49 user nova-compute[74337]: DEBUG nova.network.neutron [-] [instance: b531e297-3649-4bab-8e13-10304a002b30] Updating instance_info_cache with network_info: [] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:43:49 user nova-compute[74337]: INFO nova.compute.manager [-] [instance: b531e297-3649-4bab-8e13-10304a002b30] Took 0.67 seconds to deallocate network for instance.
Oct 23 21:43:49 user nova-compute[74337]: DEBUG nova.compute.manager [req-b8a76d48-c6d6-471e-908f-2281a053bce7 req-8feafb21-092a-4628-a9c1-fde7124f9907 service nova] [instance: b531e297-3649-4bab-8e13-10304a002b30] Received event network-vif-deleted-104a5da2-c546-44ed-9d19-d4f7e0875baa {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:43:49 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-0969268f-0117-49b7-b05c-cb4fe57eeb11 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Acquiring lock "01d407b0-a7cf-4222-9f2d-54b99eeeed84" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:43:49 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-0969268f-0117-49b7-b05c-cb4fe57eeb11 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lock "01d407b0-a7cf-4222-9f2d-54b99eeeed84" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:43:49 user nova-compute[74337]: DEBUG nova.objects.instance [None req-0969268f-0117-49b7-b05c-cb4fe57eeb11 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lazy-loading 'flavor' on Instance uuid 01d407b0-a7cf-4222-9f2d-54b99eeeed84 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:43:49 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-0969268f-0117-49b7-b05c-cb4fe57eeb11 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lock "01d407b0-a7cf-4222-9f2d-54b99eeeed84" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:43:49 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-0806fc50-07de-47e0-b728-3f674b77dbf4 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.379s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:43:49 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0806fc50-07de-47e0-b728-3f674b77dbf4 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] <== connect_volume: return (1465ms) {'type': 'block', 'scsi_wwn': '26535623437663462', 'path': '/dev/sdb'} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:43:49 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0806fc50-07de-47e0-b728-3f674b77dbf4 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26535623437663462', 'path': '/dev/sdb'} {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 21:43:49 user nova-compute[74337]: DEBUG nova.objects.instance [None req-0806fc50-07de-47e0-b728-3f674b77dbf4 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lazy-loading 'flavor' on Instance uuid 56a4b932-486d-4b8d-9616-99e75592432a {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:43:49 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-0969268f-0117-49b7-b05c-cb4fe57eeb11 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Acquiring lock "01d407b0-a7cf-4222-9f2d-54b99eeeed84" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:43:49 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-0969268f-0117-49b7-b05c-cb4fe57eeb11 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lock "01d407b0-a7cf-4222-9f2d-54b99eeeed84" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:43:49 user nova-compute[74337]: INFO nova.compute.manager [None req-0969268f-0117-49b7-b05c-cb4fe57eeb11 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 01d407b0-a7cf-4222-9f2d-54b99eeeed84] Attaching volume 83240a3d-a866-4ba1-9d61-472c1d1a86f7 to /dev/vdb
Oct 23 21:43:49 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-0806fc50-07de-47e0-b728-3f674b77dbf4 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 21:43:49 user nova-compute[74337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 21:43:49 user nova-compute[74337]:   <source dev="/dev/sdb"/>
Oct 23 21:43:49 user nova-compute[74337]:   <target dev="vdb" bus="virtio"/>
Oct 23 21:43:49 user nova-compute[74337]:   <serial>a8e8efe4-f74d-477f-ad38-999c514047ac</serial>
Oct 23 21:43:49 user nova-compute[74337]: </disk>
Oct 23 21:43:49 user nova-compute[74337]:  {{(pid=74337) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 21:43:49 user nova-compute[74337]: DEBUG os_brick.utils [None req-0969268f-0117-49b7-b05c-cb4fe57eeb11 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:43:49 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:43:49 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:43:49 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae6089c6-bb31-4011-b4ad-2f17c7c1283b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f34011b66e40\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:43:49 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:43:49 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:43:49 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac68be50-1f7e-47ce-9106-2a55310c6ff1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:43:49 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:43:49 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:43:49 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c8bc34-6241-4dd8-bcab-831d6991e169]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:43:49 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca0f848-0522-4edd-81c0-229dd72b1d2d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:43:49 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-0969268f-0117-49b7-b05c-cb4fe57eeb11 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Running cmd (subprocess): nvme version {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:43:49 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-0969268f-0117-49b7-b05c-cb4fe57eeb11 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] 'nvme version' failed. Not Retrying. {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 21:43:49 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0969268f-0117-49b7-b05c-cb4fe57eeb11 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] nvme not present on system {{(pid=74337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 21:43:49 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:43:49 user nova-compute[74337]: INFO nova.compute.manager [None req-c4ef7214-d2ad-4ec4-bf76-755f859c2982 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: b531e297-3649-4bab-8e13-10304a002b30] Took 0.86 seconds to detach 1 volumes for instance.
Oct 23 21:43:49 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 21:43:49 user nova-compute[74337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 21:43:49 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[447640d7-0598-49da-ba4e-1f0420fc6d84]: (4, '') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:43:49 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-0969268f-0117-49b7-b05c-cb4fe57eeb11 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 21:43:49 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-0969268f-0117-49b7-b05c-cb4fe57eeb11 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 21:43:49 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-0969268f-0117-49b7-b05c-cb4fe57eeb11 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] LIGHTOS: no hostnqn found. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 21:43:49 user nova-compute[74337]: DEBUG os_brick.utils [None req-0969268f-0117-49b7-b05c-cb4fe57eeb11 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f34011b66e40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:43:49 user nova-compute[74337]: DEBUG nova.virt.block_device [None req-0969268f-0117-49b7-b05c-cb4fe57eeb11 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 01d407b0-a7cf-4222-9f2d-54b99eeeed84] Updating existing volume attachment record: 647b3ad1-447c-49a0-83cd-13e88dd6c6ce {{(pid=74337) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 21:43:49 user nova-compute[74337]: DEBUG nova.compute.manager [None req-b6e99ea2-973f-4ddb-bd2b-4ba318934a4a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] Checking state {{(pid=74337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 21:43:49 user nova-compute[74337]: DEBUG nova.compute.manager [None req-c4ef7214-d2ad-4ec4-bf76-755f859c2982 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: b531e297-3649-4bab-8e13-10304a002b30] Deleting volume: 611608fb-34d9-455e-9fdd-603b5897e666 {{(pid=74337) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 23 21:43:50 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-c4ef7214-d2ad-4ec4-bf76-755f859c2982 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:43:50 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-c4ef7214-d2ad-4ec4-bf76-755f859c2982 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:43:50 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-0806fc50-07de-47e0-b728-3f674b77dbf4 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] No BDM found with device name vda, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 21:43:50 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-0806fc50-07de-47e0-b728-3f674b77dbf4 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 21:43:50 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-0806fc50-07de-47e0-b728-3f674b77dbf4 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] No VIF found with MAC fa:16:3e:20:cc:6f, not building metadata {{(pid=74337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 21:43:50 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-0806fc50-07de-47e0-b728-3f674b77dbf4 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lock "56a4b932-486d-4b8d-9616-99e75592432a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.515s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:43:50 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-c4ef7214-d2ad-4ec4-bf76-755f859c2982 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:43:50 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-c4ef7214-d2ad-4ec4-bf76-755f859c2982 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:43:50 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-c4ef7214-d2ad-4ec4-bf76-755f859c2982 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.402s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:43:50 user nova-compute[74337]: INFO nova.scheduler.client.report [None req-c4ef7214-d2ad-4ec4-bf76-755f859c2982 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Deleted allocations for instance b531e297-3649-4bab-8e13-10304a002b30
Oct 23 21:43:50 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-0c50f703-8b25-4855-a1a5-f6806e69aae5 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Acquiring lock "56a4b932-486d-4b8d-9616-99e75592432a" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:43:50 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-0c50f703-8b25-4855-a1a5-f6806e69aae5 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lock "56a4b932-486d-4b8d-9616-99e75592432a" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:43:50 user nova-compute[74337]: DEBUG nova.compute.manager [None req-0c50f703-8b25-4855-a1a5-f6806e69aae5 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Checking state {{(pid=74337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 21:43:50 user nova-compute[74337]: DEBUG nova.compute.manager [None req-0c50f703-8b25-4855-a1a5-f6806e69aae5 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74337) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Oct 23 21:43:50 user nova-compute[74337]: DEBUG nova.objects.instance [None req-0c50f703-8b25-4855-a1a5-f6806e69aae5 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lazy-loading 'flavor' on Instance uuid 56a4b932-486d-4b8d-9616-99e75592432a {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:43:50 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-c4ef7214-d2ad-4ec4-bf76-755f859c2982 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "b531e297-3649-4bab-8e13-10304a002b30" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.208s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:43:50 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:43:50 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:43:50 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:43:50 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:43:51 user nova-compute[74337]: DEBUG nova.compute.manager [req-74e0f9ba-735c-455a-985c-8829d3906f91 req-84ffdb91-5e21-4cc4-b458-1281f76afb71 service nova] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Received event network-vif-unplugged-5df71ce2-a116-44b3-856b-c0de0da5dcd6 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:43:51 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-74e0f9ba-735c-455a-985c-8829d3906f91 req-84ffdb91-5e21-4cc4-b458-1281f76afb71 service nova] Acquiring lock "56a4b932-486d-4b8d-9616-99e75592432a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:43:51 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-74e0f9ba-735c-455a-985c-8829d3906f91 req-84ffdb91-5e21-4cc4-b458-1281f76afb71 service nova] Lock "56a4b932-486d-4b8d-9616-99e75592432a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:43:51 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-74e0f9ba-735c-455a-985c-8829d3906f91 req-84ffdb91-5e21-4cc4-b458-1281f76afb71 service nova] Lock "56a4b932-486d-4b8d-9616-99e75592432a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:43:51 user nova-compute[74337]: DEBUG nova.compute.manager [req-74e0f9ba-735c-455a-985c-8829d3906f91 req-84ffdb91-5e21-4cc4-b458-1281f76afb71 service nova] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] No waiting events found dispatching network-vif-unplugged-5df71ce2-a116-44b3-856b-c0de0da5dcd6 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:43:51 user nova-compute[74337]: WARNING nova.compute.manager [req-74e0f9ba-735c-455a-985c-8829d3906f91 req-84ffdb91-5e21-4cc4-b458-1281f76afb71 service nova] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Received unexpected event network-vif-unplugged-5df71ce2-a116-44b3-856b-c0de0da5dcd6 for instance with vm_state active and task_state powering-off.
Oct 23 21:43:51 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Instance destroyed successfully.
Oct 23 21:43:51 user nova-compute[74337]: DEBUG nova.compute.manager [None req-0c50f703-8b25-4855-a1a5-f6806e69aae5 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Checking state {{(pid=74337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 21:43:51 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-0c50f703-8b25-4855-a1a5-f6806e69aae5 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lock "56a4b932-486d-4b8d-9616-99e75592432a" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.901s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:43:52 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:43:53 user nova-compute[74337]: DEBUG nova.compute.manager [req-9d62b82e-d9e8-440a-9350-3043ef8cd6e3 req-12afd607-e12c-4c78-999b-9291f5c031ae service nova] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Received event network-vif-plugged-5df71ce2-a116-44b3-856b-c0de0da5dcd6 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:43:53 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-9d62b82e-d9e8-440a-9350-3043ef8cd6e3 req-12afd607-e12c-4c78-999b-9291f5c031ae service nova] Acquiring lock "56a4b932-486d-4b8d-9616-99e75592432a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:43:53 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-9d62b82e-d9e8-440a-9350-3043ef8cd6e3 req-12afd607-e12c-4c78-999b-9291f5c031ae service nova] Lock "56a4b932-486d-4b8d-9616-99e75592432a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:43:53 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-9d62b82e-d9e8-440a-9350-3043ef8cd6e3 req-12afd607-e12c-4c78-999b-9291f5c031ae service nova] Lock "56a4b932-486d-4b8d-9616-99e75592432a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:43:53 user nova-compute[74337]: DEBUG nova.compute.manager [req-9d62b82e-d9e8-440a-9350-3043ef8cd6e3 req-12afd607-e12c-4c78-999b-9291f5c031ae service nova] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] No waiting events found dispatching network-vif-plugged-5df71ce2-a116-44b3-856b-c0de0da5dcd6 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:43:53 user nova-compute[74337]: WARNING nova.compute.manager [req-9d62b82e-d9e8-440a-9350-3043ef8cd6e3 req-12afd607-e12c-4c78-999b-9291f5c031ae service nova] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Received unexpected event network-vif-plugged-5df71ce2-a116-44b3-856b-c0de0da5dcd6 for instance with vm_state stopped and task_state None.
Oct 23 21:43:53 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:43:55 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:43:57 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:43:58 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:44:00 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:44:00 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:44:02 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:44:03 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:44:03 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:44:03 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Starting heal instance info cache {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 21:44:03 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "refresh_cache-0ba8d1d0-5fac-4213-9a50-a4e273710b1b" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:44:03 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquired lock "refresh_cache-0ba8d1d0-5fac-4213-9a50-a4e273710b1b" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:44:03 user nova-compute[74337]: DEBUG nova.network.neutron [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 0ba8d1d0-5fac-4213-9a50-a4e273710b1b] Forcefully refreshing network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 21:44:03 user nova-compute[74337]: DEBUG nova.network.neutron [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 0ba8d1d0-5fac-4213-9a50-a4e273710b1b] Updating instance_info_cache with network_info: [{"id": "c7a03b6c-5d0f-4a54-b615-16c7546eb5f7", "address": "fa:16:3e:b6:7b:d0", "network": {"id": "3d6e3d17-6da2-4ac1-ab9f-b7ed54db79bc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1078020443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83700495146c4b0e8d76491380b5f895", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7a03b6c-5d", "ovs_interfaceid": "c7a03b6c-5d0f-4a54-b615-16c7546eb5f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:44:03 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Releasing lock "refresh_cache-0ba8d1d0-5fac-4213-9a50-a4e273710b1b" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:44:03 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 0ba8d1d0-5fac-4213-9a50-a4e273710b1b] Updated the network info_cache for instance {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 21:44:03 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:44:03 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:44:03 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 21:44:04 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:44:06 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:44:06 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:44:06 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:44:06 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:44:06 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Auditing locally available compute resources for user (node: user) {{(pid=74337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 21:44:06 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 21:44:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d/disk.rescue --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:44:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:44:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d/disk.rescue --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:44:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:44:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56a4b932-486d-4b8d-9616-99e75592432a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:44:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56a4b932-486d-4b8d-9616-99e75592432a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:44:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56a4b932-486d-4b8d-9616-99e75592432a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:44:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56a4b932-486d-4b8d-9616-99e75592432a/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:44:07 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 21:44:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/547c4d4c-e0dd-495a-b83f-98426d0a4a99/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:44:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/547c4d4c-e0dd-495a-b83f-98426d0a4a99/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:44:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/547c4d4c-e0dd-495a-b83f-98426d0a4a99/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:44:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/547c4d4c-e0dd-495a-b83f-98426d0a4a99/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:44:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba8d1d0-5fac-4213-9a50-a4e273710b1b/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:44:07 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0969268f-0117-49b7-b05c-cb4fe57eeb11 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 01d407b0-a7cf-4222-9f2d-54b99eeeed84] Calling os-brick to attach iSCSI Volume {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 21:44:07 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0969268f-0117-49b7-b05c-cb4fe57eeb11 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:83240a3d-a866-4ba1-9d61-472c1d1a86f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oMDVAiCz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:44:07 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-0969268f-0117-49b7-b05c-cb4fe57eeb11 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:44:07 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-0969268f-0117-49b7-b05c-cb4fe57eeb11 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:44:07 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-0969268f-0117-49b7-b05c-cb4fe57eeb11 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:44:07 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-0969268f-0117-49b7-b05c-cb4fe57eeb11 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:44:07 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-0969268f-0117-49b7-b05c-cb4fe57eeb11 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83240a3d-a866-4ba1-9d61-472c1d1a86f7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:44:07 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-0969268f-0117-49b7-b05c-cb4fe57eeb11 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83240a3d-a866-4ba1-9d61-472c1d1a86f7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:44:07 user nova-compute[74337]: INFO os_brick.initiator.connectors.iscsi [None req-0969268f-0117-49b7-b05c-cb4fe57eeb11 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 21:44:07 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:44:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83240a3d-a866-4ba1-9d61-472c1d1a86f7 -p 172.16.0.220:3260 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:44:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83240a3d-a866-4ba1-9d61-472c1d1a86f7 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:44:07 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[18af76a2-0d22-4fbb-bb91-5fb7a24b11fc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:44:07 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0969268f-0117-49b7-b05c-cb4fe57eeb11 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 21:44:07 user nova-compute[74337]:  {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:44:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83240a3d-a866-4ba1-9d61-472c1d1a86f7 -p 172.16.0.220:3260 --interface default --op new {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:44:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83240a3d-a866-4ba1-9d61-472c1d1a86f7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:44:07 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[686ce3a5-ca94-43e4-b5ee-963e13f066e3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:83240a3d-a866-4ba1-9d61-472c1d1a86f7] added\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:44:07 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0969268f-0117-49b7-b05c-cb4fe57eeb11 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:83240a3d-a866-4ba1-9d61-472c1d1a86f7] added
Oct 23 21:44:07 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:44:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83240a3d-a866-4ba1-9d61-472c1d1a86f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:44:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83240a3d-a866-4ba1-9d61-472c1d1a86f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:44:07 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5929ddb-638c-4e58-bb4b-7ce4c0b6d94e]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:44:07 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0969268f-0117-49b7-b05c-cb4fe57eeb11 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:44:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83240a3d-a866-4ba1-9d61-472c1d1a86f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:44:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba8d1d0-5fac-4213-9a50-a4e273710b1b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:44:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba8d1d0-5fac-4213-9a50-a4e273710b1b/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:44:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83240a3d-a866-4ba1-9d61-472c1d1a86f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:44:07 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b1f61c5-d1ac-47c9-9e0d-c8f4c4a7e43b]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:44:07 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0969268f-0117-49b7-b05c-cb4fe57eeb11 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:44:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83240a3d-a866-4ba1-9d61-472c1d1a86f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oMDVAiCz {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:44:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83240a3d-a866-4ba1-9d61-472c1d1a86f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oMDVAiCz" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:44:07 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c60e9769-143f-4d96-8095-f34c0e03c317]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:44:07 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0969268f-0117-49b7-b05c-cb4fe57eeb11 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oMDVAiCz'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:44:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83240a3d-a866-4ba1-9d61-472c1d1a86f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:44:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83240a3d-a866-4ba1-9d61-472c1d1a86f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:44:07 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad5d674f-5e82-47b9-981f-d896226da3a4]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:44:07 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0969268f-0117-49b7-b05c-cb4fe57eeb11 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:44:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:44:08 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:44:08 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed0478f-7da7-431a-a043-4040364bbadd]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:44:08 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0969268f-0117-49b7-b05c-cb4fe57eeb11 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:44:08 user nova-compute[74337]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac (non-flash)
Oct 23 21:44:08 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:44:08 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0969268f-0117-49b7-b05c-cb4fe57eeb11 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:44:08 user nova-compute[74337]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac (non-flash)
Oct 23 21:44:08 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:44:08 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83240a3d-a866-4ba1-9d61-472c1d1a86f7 -p 172.16.0.220:3260 --login {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:44:08 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83240a3d-a866-4ba1-9d61-472c1d1a86f7 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:44:08 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b451408-24f6-4945-8a8a-f45a6673b9cb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:83240a3d-a866-4ba1-9d61-472c1d1a86f7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:83240a3d-a866-4ba1-9d61-472c1d1a86f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:44:08 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0969268f-0117-49b7-b05c-cb4fe57eeb11 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:83240a3d-a866-4ba1-9d61-472c1d1a86f7, portal: 172.16.0.220,3260]
Oct 23 21:44:08 user nova-compute[74337]: Login to [iface: default, target: iqn.2010-10.org.openstack:83240a3d-a866-4ba1-9d61-472c1d1a86f7, portal: 172.16.0.220,3260] successful.
Oct 23 21:44:08 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:44:08 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83240a3d-a866-4ba1-9d61-472c1d1a86f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:44:08 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba8d1d0-5fac-4213-9a50-a4e273710b1b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:44:08 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83240a3d-a866-4ba1-9d61-472c1d1a86f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:44:08 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01d407b0-a7cf-4222-9f2d-54b99eeeed84/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:44:08 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[871f7657-d08d-4bfb-8eab-087720c295c7]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:44:08 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0969268f-0117-49b7-b05c-cb4fe57eeb11 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:44:08 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:44:08 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:44:08 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[46d5415f-8e93-4407-8da6-70455befce2c]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83240a3d-a866-4ba1-9d61-472c1d1a86f7 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:44:08 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0969268f-0117-49b7-b05c-cb4fe57eeb11 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:44:08 user nova-compute[74337]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac (non-flash)
Oct 23 21:44:08 user nova-compute[74337]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83240a3d-a866-4ba1-9d61-472c1d1a86f7 (non-flash)
Oct 23 21:44:08 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:44:08 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0969268f-0117-49b7-b05c-cb4fe57eeb11 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:44:08 user nova-compute[74337]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac (non-flash)
Oct 23 21:44:08 user nova-compute[74337]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83240a3d-a866-4ba1-9d61-472c1d1a86f7 (non-flash)
Oct 23 21:44:08 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:44:08 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-0969268f-0117-49b7-b05c-cb4fe57eeb11 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83240a3d-a866-4ba1-9d61-472c1d1a86f7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.344s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:44:08 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0969268f-0117-49b7-b05c-cb4fe57eeb11 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Connected to 172.16.0.220:3260 {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 21:44:08 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-0969268f-0117-49b7-b05c-cb4fe57eeb11 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] HCTL ('35', '-', '-', 0) found on session 25 with lun 0 {{(pid=74337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 21:44:08 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-0969268f-0117-49b7-b05c-cb4fe57eeb11 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 21:44:08 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:44:08 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:44:08 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c9f2723-22a6-4f31-b639-92ba054bcbb3]: (4, ('- - 0', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:44:08 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-0969268f-0117-49b7-b05c-cb4fe57eeb11 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Searching for a device in session 25 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 21:44:08 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0969268f-0117-49b7-b05c-cb4fe57eeb11 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:83240a3d-a866-4ba1-9d61-472c1d1a86f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oMDVAiCz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 21:44:08 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01d407b0-a7cf-4222-9f2d-54b99eeeed84/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:44:08 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01d407b0-a7cf-4222-9f2d-54b99eeeed84/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:44:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:44:08 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01d407b0-a7cf-4222-9f2d-54b99eeeed84/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:44:08 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195a4056-3254-4558-b2f5-299bcd4af07c/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:44:08 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195a4056-3254-4558-b2f5-299bcd4af07c/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:44:08 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195a4056-3254-4558-b2f5-299bcd4af07c/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:44:08 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195a4056-3254-4558-b2f5-299bcd4af07c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:44:08 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1189976f-8d02-468d-8fa7-bd5594c5f85a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:44:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1189976f-8d02-468d-8fa7-bd5594c5f85a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:44:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1189976f-8d02-468d-8fa7-bd5594c5f85a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:44:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1189976f-8d02-468d-8fa7-bd5594c5f85a/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:44:09 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-0969268f-0117-49b7-b05c-cb4fe57eeb11 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.380s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:44:09 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0969268f-0117-49b7-b05c-cb4fe57eeb11 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] <== connect_volume: return (1383ms) {'type': 'block', 'scsi_wwn': '23661666161613162', 'path': '/dev/sdd'} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:44:09 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0969268f-0117-49b7-b05c-cb4fe57eeb11 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 01d407b0-a7cf-4222-9f2d-54b99eeeed84] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23661666161613162', 'path': '/dev/sdd'} {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 21:44:09 user nova-compute[74337]: DEBUG nova.objects.instance [None req-0969268f-0117-49b7-b05c-cb4fe57eeb11 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lazy-loading 'flavor' on Instance uuid 01d407b0-a7cf-4222-9f2d-54b99eeeed84 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:44:09 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-0969268f-0117-49b7-b05c-cb4fe57eeb11 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 21:44:09 user nova-compute[74337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 21:44:09 user nova-compute[74337]:   <source dev="/dev/sdd"/>
Oct 23 21:44:09 user nova-compute[74337]:   <target dev="vdb" bus="virtio"/>
Oct 23 21:44:09 user nova-compute[74337]:   <serial>83240a3d-a866-4ba1-9d61-472c1d1a86f7</serial>
Oct 23 21:44:09 user nova-compute[74337]: </disk>
Oct 23 21:44:09 user nova-compute[74337]:  {{(pid=74337) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 21:44:09 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:44:09 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:44:09 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Hypervisor/Node resource view: name=user free_ram=8072MB free_disk=25.360424041748047GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 21:44:09 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:44:09 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:44:09 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 1189976f-8d02-468d-8fa7-bd5594c5f85a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:44:09 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 0ba8d1d0-5fac-4213-9a50-a4e273710b1b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:44:09 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 547c4d4c-e0dd-495a-b83f-98426d0a4a99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:44:09 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 00f757cf-e5dd-476f-81c6-670ed2bf6938 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Oct 23 21:44:09 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 56a4b932-486d-4b8d-9616-99e75592432a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:44:09 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:44:09 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 01d407b0-a7cf-4222-9f2d-54b99eeeed84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:44:09 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 195a4056-3254-4558-b2f5-299bcd4af07c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:44:09 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 21:44:09 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 21:44:09 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Refreshing inventories for resource provider dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 23 21:44:09 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Updating ProviderTree inventory for provider dfcf3942-a432-4293-945b-14b86f57d794 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 23 21:44:09 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Updating inventory in ProviderTree for provider dfcf3942-a432-4293-945b-14b86f57d794 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 23 21:44:09 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Refreshing aggregate associations for resource provider dfcf3942-a432-4293-945b-14b86f57d794, aggregates: None {{(pid=74337) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 23 21:44:09 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-0969268f-0117-49b7-b05c-cb4fe57eeb11 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] No BDM found with device name vda, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 21:44:09 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-0969268f-0117-49b7-b05c-cb4fe57eeb11 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 21:44:09 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-0969268f-0117-49b7-b05c-cb4fe57eeb11 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] No VIF found with MAC fa:16:3e:a6:0f:9d, not building metadata {{(pid=74337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 21:44:09 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Refreshing trait associations for resource provider dfcf3942-a432-4293-945b-14b86f57d794, traits: COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE2,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE42,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_EXTEND,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_TRUSTED_CERTS {{(pid=74337) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 23 21:44:10 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-0969268f-0117-49b7-b05c-cb4fe57eeb11 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lock "01d407b0-a7cf-4222-9f2d-54b99eeeed84" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.416s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:44:10 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:44:10 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:44:10 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Compute_service record updated for user:user {{(pid=74337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 21:44:10 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.677s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:44:10 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:44:10 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Cleaning up deleted instances {{(pid=74337) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 23 21:44:10 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] There are 0 instances to clean {{(pid=74337) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 23 21:44:12 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:44:13 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:44:13 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-57564de0-d0f1-43e8-98e0-43af4abc91c3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Acquiring lock "60bd4497-75ce-4ad2-bef9-303f293244db" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:44:14 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-57564de0-d0f1-43e8-98e0-43af4abc91c3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lock "60bd4497-75ce-4ad2-bef9-303f293244db" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:44:14 user nova-compute[74337]: DEBUG nova.compute.manager [None req-57564de0-d0f1-43e8-98e0-43af4abc91c3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 60bd4497-75ce-4ad2-bef9-303f293244db] Starting instance... {{(pid=74337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 21:44:14 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-57564de0-d0f1-43e8-98e0-43af4abc91c3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:44:14 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-57564de0-d0f1-43e8-98e0-43af4abc91c3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:44:14 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-57564de0-d0f1-43e8-98e0-43af4abc91c3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 21:44:14 user nova-compute[74337]: INFO nova.compute.claims [None req-57564de0-d0f1-43e8-98e0-43af4abc91c3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 60bd4497-75ce-4ad2-bef9-303f293244db] Claim successful on node user
Oct 23 21:44:14 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:44:14 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:44:14 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:44:14 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-57564de0-d0f1-43e8-98e0-43af4abc91c3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:44:14 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-57564de0-d0f1-43e8-98e0-43af4abc91c3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:44:14 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-57564de0-d0f1-43e8-98e0-43af4abc91c3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.374s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:44:14 user nova-compute[74337]: DEBUG nova.compute.manager [None req-57564de0-d0f1-43e8-98e0-43af4abc91c3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 60bd4497-75ce-4ad2-bef9-303f293244db] Start building networks asynchronously for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 21:44:14 user nova-compute[74337]: DEBUG nova.compute.manager [None req-57564de0-d0f1-43e8-98e0-43af4abc91c3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 60bd4497-75ce-4ad2-bef9-303f293244db] Allocating IP information in the background. {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 21:44:14 user nova-compute[74337]: DEBUG nova.network.neutron [None req-57564de0-d0f1-43e8-98e0-43af4abc91c3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 60bd4497-75ce-4ad2-bef9-303f293244db] allocate_for_instance() {{(pid=74337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 21:44:14 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-57564de0-d0f1-43e8-98e0-43af4abc91c3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 60bd4497-75ce-4ad2-bef9-303f293244db] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 21:44:14 user nova-compute[74337]: DEBUG nova.compute.manager [None req-57564de0-d0f1-43e8-98e0-43af4abc91c3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 60bd4497-75ce-4ad2-bef9-303f293244db] Start building block device mappings for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 21:44:14 user nova-compute[74337]: DEBUG nova.policy [None req-57564de0-d0f1-43e8-98e0-43af4abc91c3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6f6daa6653264905a5498e00f184080c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a25b3eed8548a5a324e55b28f26252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74337) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 21:44:14 user nova-compute[74337]: DEBUG nova.compute.manager [None req-57564de0-d0f1-43e8-98e0-43af4abc91c3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 60bd4497-75ce-4ad2-bef9-303f293244db] Start spawning the instance on the hypervisor. {{(pid=74337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 21:44:14 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-57564de0-d0f1-43e8-98e0-43af4abc91c3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 60bd4497-75ce-4ad2-bef9-303f293244db] Creating instance directory {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 21:44:14 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-57564de0-d0f1-43e8-98e0-43af4abc91c3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 60bd4497-75ce-4ad2-bef9-303f293244db] Creating image(s)
Oct 23 21:44:14 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-57564de0-d0f1-43e8-98e0-43af4abc91c3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Acquiring lock "/opt/stack/data/nova/instances/60bd4497-75ce-4ad2-bef9-303f293244db/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:44:14 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-57564de0-d0f1-43e8-98e0-43af4abc91c3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lock "/opt/stack/data/nova/instances/60bd4497-75ce-4ad2-bef9-303f293244db/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:44:14 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-57564de0-d0f1-43e8-98e0-43af4abc91c3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lock "/opt/stack/data/nova/instances/60bd4497-75ce-4ad2-bef9-303f293244db/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:44:14 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-57564de0-d0f1-43e8-98e0-43af4abc91c3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:44:14 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-57564de0-d0f1-43e8-98e0-43af4abc91c3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.174s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:44:14 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-57564de0-d0f1-43e8-98e0-43af4abc91c3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Acquiring lock "fc7b140751b8c385de81623e40fb09ce09374ab7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:44:14 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-57564de0-d0f1-43e8-98e0-43af4abc91c3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lock "fc7b140751b8c385de81623e40fb09ce09374ab7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:44:14 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-57564de0-d0f1-43e8-98e0-43af4abc91c3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:44:15 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-57564de0-d0f1-43e8-98e0-43af4abc91c3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.171s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:44:15 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-57564de0-d0f1-43e8-98e0-43af4abc91c3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7,backing_fmt=raw /opt/stack/data/nova/instances/60bd4497-75ce-4ad2-bef9-303f293244db/disk 1073741824 {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:44:15 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-57564de0-d0f1-43e8-98e0-43af4abc91c3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7,backing_fmt=raw /opt/stack/data/nova/instances/60bd4497-75ce-4ad2-bef9-303f293244db/disk 1073741824" returned: 0 in 0.051s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:44:15 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-57564de0-d0f1-43e8-98e0-43af4abc91c3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lock "fc7b140751b8c385de81623e40fb09ce09374ab7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:44:15 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-57564de0-d0f1-43e8-98e0-43af4abc91c3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:44:15 user nova-compute[74337]: DEBUG nova.network.neutron [None req-57564de0-d0f1-43e8-98e0-43af4abc91c3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 60bd4497-75ce-4ad2-bef9-303f293244db] Successfully created port: 4bf6b6b9-0602-4d1e-a34d-c46f903a45b0 {{(pid=74337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 21:44:15 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-57564de0-d0f1-43e8-98e0-43af4abc91c3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.216s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:44:15 user nova-compute[74337]: DEBUG nova.virt.disk.api [None req-57564de0-d0f1-43e8-98e0-43af4abc91c3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Checking if we can resize image /opt/stack/data/nova/instances/60bd4497-75ce-4ad2-bef9-303f293244db/disk. size=1073741824 {{(pid=74337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 21:44:15 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-57564de0-d0f1-43e8-98e0-43af4abc91c3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60bd4497-75ce-4ad2-bef9-303f293244db/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:44:15 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-57564de0-d0f1-43e8-98e0-43af4abc91c3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60bd4497-75ce-4ad2-bef9-303f293244db/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:44:15 user nova-compute[74337]: DEBUG nova.virt.disk.api [None req-57564de0-d0f1-43e8-98e0-43af4abc91c3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Cannot resize image /opt/stack/data/nova/instances/60bd4497-75ce-4ad2-bef9-303f293244db/disk to a smaller size. {{(pid=74337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 21:44:15 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-57564de0-d0f1-43e8-98e0-43af4abc91c3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 60bd4497-75ce-4ad2-bef9-303f293244db] Created local disks {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 21:44:15 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-57564de0-d0f1-43e8-98e0-43af4abc91c3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 60bd4497-75ce-4ad2-bef9-303f293244db] Ensure instance console log exists: /opt/stack/data/nova/instances/60bd4497-75ce-4ad2-bef9-303f293244db/console.log {{(pid=74337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 21:44:15 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-57564de0-d0f1-43e8-98e0-43af4abc91c3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:44:15 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-57564de0-d0f1-43e8-98e0-43af4abc91c3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:44:15 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-57564de0-d0f1-43e8-98e0-43af4abc91c3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:44:16 user nova-compute[74337]: DEBUG nova.network.neutron [None req-57564de0-d0f1-43e8-98e0-43af4abc91c3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 60bd4497-75ce-4ad2-bef9-303f293244db] Successfully updated port: 4bf6b6b9-0602-4d1e-a34d-c46f903a45b0 {{(pid=74337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 21:44:16 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-57564de0-d0f1-43e8-98e0-43af4abc91c3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Acquiring lock "refresh_cache-60bd4497-75ce-4ad2-bef9-303f293244db" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:44:16 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-57564de0-d0f1-43e8-98e0-43af4abc91c3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Acquired lock "refresh_cache-60bd4497-75ce-4ad2-bef9-303f293244db" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:44:16 user nova-compute[74337]: DEBUG nova.network.neutron [None req-57564de0-d0f1-43e8-98e0-43af4abc91c3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 60bd4497-75ce-4ad2-bef9-303f293244db] Building network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 21:44:16 user nova-compute[74337]: DEBUG nova.network.neutron [None req-57564de0-d0f1-43e8-98e0-43af4abc91c3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 60bd4497-75ce-4ad2-bef9-303f293244db] Instance cache missing network info. {{(pid=74337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 21:44:16 user nova-compute[74337]: DEBUG nova.compute.manager [req-49aa3fa2-4f8a-42b0-bad3-629aac55799d req-2bbb58b8-1b14-4ad3-9df6-7167070693f7 service nova] [instance: 60bd4497-75ce-4ad2-bef9-303f293244db] Received event network-changed-4bf6b6b9-0602-4d1e-a34d-c46f903a45b0 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:44:16 user nova-compute[74337]: DEBUG nova.compute.manager [req-49aa3fa2-4f8a-42b0-bad3-629aac55799d req-2bbb58b8-1b14-4ad3-9df6-7167070693f7 service nova] [instance: 60bd4497-75ce-4ad2-bef9-303f293244db] Refreshing instance network info cache due to event network-changed-4bf6b6b9-0602-4d1e-a34d-c46f903a45b0. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 21:44:16 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-49aa3fa2-4f8a-42b0-bad3-629aac55799d req-2bbb58b8-1b14-4ad3-9df6-7167070693f7 service nova] Acquiring lock "refresh_cache-60bd4497-75ce-4ad2-bef9-303f293244db" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:44:16 user nova-compute[74337]: DEBUG nova.network.neutron [None req-57564de0-d0f1-43e8-98e0-43af4abc91c3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 60bd4497-75ce-4ad2-bef9-303f293244db] Updating instance_info_cache with network_info: [{"id": "4bf6b6b9-0602-4d1e-a34d-c46f903a45b0", "address": "fa:16:3e:f2:0a:14", "network": {"id": "787d9979-63ad-4318-b1d7-8ec69c5969fe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1847253864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84a25b3eed8548a5a324e55b28f26252", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bf6b6b9-06", "ovs_interfaceid": "4bf6b6b9-0602-4d1e-a34d-c46f903a45b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:44:16 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-57564de0-d0f1-43e8-98e0-43af4abc91c3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Releasing lock "refresh_cache-60bd4497-75ce-4ad2-bef9-303f293244db" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:44:16 user nova-compute[74337]: DEBUG nova.compute.manager [None req-57564de0-d0f1-43e8-98e0-43af4abc91c3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 60bd4497-75ce-4ad2-bef9-303f293244db] Instance network_info: |[{"id": "4bf6b6b9-0602-4d1e-a34d-c46f903a45b0", "address": "fa:16:3e:f2:0a:14", "network": {"id": "787d9979-63ad-4318-b1d7-8ec69c5969fe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1847253864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84a25b3eed8548a5a324e55b28f26252", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bf6b6b9-06", "ovs_interfaceid": "4bf6b6b9-0602-4d1e-a34d-c46f903a45b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 21:44:16 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-49aa3fa2-4f8a-42b0-bad3-629aac55799d req-2bbb58b8-1b14-4ad3-9df6-7167070693f7 service nova] Acquired lock "refresh_cache-60bd4497-75ce-4ad2-bef9-303f293244db" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:44:16 user nova-compute[74337]: DEBUG nova.network.neutron [req-49aa3fa2-4f8a-42b0-bad3-629aac55799d req-2bbb58b8-1b14-4ad3-9df6-7167070693f7 service nova] [instance: 60bd4497-75ce-4ad2-bef9-303f293244db] Refreshing network info cache for port 4bf6b6b9-0602-4d1e-a34d-c46f903a45b0 {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 21:44:16 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-57564de0-d0f1-43e8-98e0-43af4abc91c3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 60bd4497-75ce-4ad2-bef9-303f293244db] Start _get_guest_xml network_info=[{"id": "4bf6b6b9-0602-4d1e-a34d-c46f903a45b0", "address": "fa:16:3e:f2:0a:14", "network": {"id": "787d9979-63ad-4318-b1d7-8ec69c5969fe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1847253864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84a25b3eed8548a5a324e55b28f26252", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bf6b6b9-06", "ovs_interfaceid": "4bf6b6b9-0602-4d1e-a34d-c46f903a45b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T21:29:21Z,direct_url=<?>,disk_format='qcow2',id=d859d89d-998d-4109-b26a-0d6e28152932,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ff43462300764979a6cf688444336a56',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T21:29:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'image_id': 'd859d89d-998d-4109-b26a-0d6e28152932'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 21:44:16 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-57564de0-d0f1-43e8-98e0-43af4abc91c3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:44:16 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-57564de0-d0f1-43e8-98e0-43af4abc91c3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:44:16 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-57564de0-d0f1-43e8-98e0-43af4abc91c3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 21:44:16 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-57564de0-d0f1-43e8-98e0-43af4abc91c3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] CPU controller missing on host. {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 21:44:16 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-57564de0-d0f1-43e8-98e0-43af4abc91c3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 21:44:16 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-57564de0-d0f1-43e8-98e0-43af4abc91c3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] CPU controller found on host. {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 21:44:16 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-57564de0-d0f1-43e8-98e0-43af4abc91c3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 21:44:16 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-57564de0-d0f1-43e8-98e0-43af4abc91c3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T21:29:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T21:29:21Z,direct_url=<?>,disk_format='qcow2',id=d859d89d-998d-4109-b26a-0d6e28152932,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ff43462300764979a6cf688444336a56',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T21:29:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 21:44:16 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-57564de0-d0f1-43e8-98e0-43af4abc91c3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Flavor limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 21:44:16 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-57564de0-d0f1-43e8-98e0-43af4abc91c3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Image limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 21:44:16 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-57564de0-d0f1-43e8-98e0-43af4abc91c3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Flavor pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 21:44:16 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-57564de0-d0f1-43e8-98e0-43af4abc91c3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Image pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 21:44:16 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-57564de0-d0f1-43e8-98e0-43af4abc91c3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 21:44:16 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-57564de0-d0f1-43e8-98e0-43af4abc91c3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 21:44:16 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-57564de0-d0f1-43e8-98e0-43af4abc91c3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 21:44:16 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-57564de0-d0f1-43e8-98e0-43af4abc91c3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Got 1 possible topologies {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 21:44:16 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-57564de0-d0f1-43e8-98e0-43af4abc91c3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 21:44:16 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-57564de0-d0f1-43e8-98e0-43af4abc91c3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 21:44:16 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-57564de0-d0f1-43e8-98e0-43af4abc91c3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:44:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1418196360',display_name='tempest-AttachVolumeNegativeTest-server-1418196360',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1418196360',id=24,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMqpTmUjCnPdieLTDPp1y1MCX4lfK3eM9p1yQICqheaqwuZyeQg2hTPtUbygEzENB6PDYMQ7deWPrk2woG/HFz3DenbgRAR+VTDVwqodZBGNM1FB+MR3JrC8fHsKnk7aiA==',key_name='tempest-keypair-1018291788',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='84a25b3eed8548a5a324e55b28f26252',ramdisk_id='',reservation_id='r-k2b12u0m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1446109887',owner_user_name='tempest-AttachVolumeNegativeTest-1446109887-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:44:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6f6daa6653264905a5498e00f184080c',uuid=60bd4497-75ce-4ad2-bef9-303f293244db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4bf6b6b9-0602-4d1e-a34d-c46f903a45b0", "address": "fa:16:3e:f2:0a:14", "network": {"id": "787d9979-63ad-4318-b1d7-8ec69c5969fe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1847253864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84a25b3eed8548a5a324e55b28f26252", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bf6b6b9-06", "ovs_interfaceid": "4bf6b6b9-0602-4d1e-a34d-c46f903a45b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 21:44:16 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-57564de0-d0f1-43e8-98e0-43af4abc91c3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Converting VIF {"id": "4bf6b6b9-0602-4d1e-a34d-c46f903a45b0", "address": "fa:16:3e:f2:0a:14", "network": {"id": "787d9979-63ad-4318-b1d7-8ec69c5969fe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1847253864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84a25b3eed8548a5a324e55b28f26252", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bf6b6b9-06", "ovs_interfaceid": "4bf6b6b9-0602-4d1e-a34d-c46f903a45b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:44:16 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-57564de0-d0f1-43e8-98e0-43af4abc91c3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:0a:14,bridge_name='br-int',has_traffic_filtering=True,id=4bf6b6b9-0602-4d1e-a34d-c46f903a45b0,network=Network(787d9979-63ad-4318-b1d7-8ec69c5969fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bf6b6b9-06') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:44:16 user nova-compute[74337]: DEBUG nova.objects.instance [None req-57564de0-d0f1-43e8-98e0-43af4abc91c3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lazy-loading 'pci_devices' on Instance uuid 60bd4497-75ce-4ad2-bef9-303f293244db {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:44:16 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-57564de0-d0f1-43e8-98e0-43af4abc91c3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 60bd4497-75ce-4ad2-bef9-303f293244db] End _get_guest_xml xml=<domain type="kvm">
Oct 23 21:44:16 user nova-compute[74337]:   <uuid>60bd4497-75ce-4ad2-bef9-303f293244db</uuid>
Oct 23 21:44:16 user nova-compute[74337]:   <name>instance-00000018</name>
Oct 23 21:44:16 user nova-compute[74337]:   <memory>524288</memory>
Oct 23 21:44:16 user nova-compute[74337]:   <vcpu>1</vcpu>
Oct 23 21:44:16 user nova-compute[74337]:   <metadata>
Oct 23 21:44:16 user nova-compute[74337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 21:44:16 user nova-compute[74337]:       <nova:package version="0.0.0"/>
Oct 23 21:44:16 user nova-compute[74337]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1418196360</nova:name>
Oct 23 21:44:16 user nova-compute[74337]:       <nova:creationTime>2023-10-23 21:44:16</nova:creationTime>
Oct 23 21:44:16 user nova-compute[74337]:       <nova:flavor name="m1.tiny">
Oct 23 21:44:16 user nova-compute[74337]:         <nova:memory>512</nova:memory>
Oct 23 21:44:16 user nova-compute[74337]:         <nova:disk>1</nova:disk>
Oct 23 21:44:16 user nova-compute[74337]:         <nova:swap>0</nova:swap>
Oct 23 21:44:16 user nova-compute[74337]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 21:44:16 user nova-compute[74337]:         <nova:vcpus>1</nova:vcpus>
Oct 23 21:44:16 user nova-compute[74337]:       </nova:flavor>
Oct 23 21:44:16 user nova-compute[74337]:       <nova:owner>
Oct 23 21:44:16 user nova-compute[74337]:         <nova:user uuid="6f6daa6653264905a5498e00f184080c">tempest-AttachVolumeNegativeTest-1446109887-project-member</nova:user>
Oct 23 21:44:16 user nova-compute[74337]:         <nova:project uuid="84a25b3eed8548a5a324e55b28f26252">tempest-AttachVolumeNegativeTest-1446109887</nova:project>
Oct 23 21:44:16 user nova-compute[74337]:       </nova:owner>
Oct 23 21:44:16 user nova-compute[74337]:       <nova:root type="image" uuid="d859d89d-998d-4109-b26a-0d6e28152932"/>
Oct 23 21:44:16 user nova-compute[74337]:       <nova:ports>
Oct 23 21:44:16 user nova-compute[74337]:         <nova:port uuid="4bf6b6b9-0602-4d1e-a34d-c46f903a45b0">
Oct 23 21:44:16 user nova-compute[74337]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 23 21:44:16 user nova-compute[74337]:         </nova:port>
Oct 23 21:44:16 user nova-compute[74337]:       </nova:ports>
Oct 23 21:44:16 user nova-compute[74337]:     </nova:instance>
Oct 23 21:44:16 user nova-compute[74337]:   </metadata>
Oct 23 21:44:16 user nova-compute[74337]:   <sysinfo type="smbios">
Oct 23 21:44:16 user nova-compute[74337]:     <system>
Oct 23 21:44:16 user nova-compute[74337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 21:44:16 user nova-compute[74337]:       <entry name="product">OpenStack Nova</entry>
Oct 23 21:44:16 user nova-compute[74337]:       <entry name="version">0.0.0</entry>
Oct 23 21:44:16 user nova-compute[74337]:       <entry name="serial">60bd4497-75ce-4ad2-bef9-303f293244db</entry>
Oct 23 21:44:16 user nova-compute[74337]:       <entry name="uuid">60bd4497-75ce-4ad2-bef9-303f293244db</entry>
Oct 23 21:44:16 user nova-compute[74337]:       <entry name="family">Virtual Machine</entry>
Oct 23 21:44:16 user nova-compute[74337]:     </system>
Oct 23 21:44:16 user nova-compute[74337]:   </sysinfo>
Oct 23 21:44:16 user nova-compute[74337]:   <os>
Oct 23 21:44:16 user nova-compute[74337]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 21:44:16 user nova-compute[74337]:     <boot dev="hd"/>
Oct 23 21:44:16 user nova-compute[74337]:     <smbios mode="sysinfo"/>
Oct 23 21:44:16 user nova-compute[74337]:   </os>
Oct 23 21:44:16 user nova-compute[74337]:   <features>
Oct 23 21:44:16 user nova-compute[74337]:     <acpi/>
Oct 23 21:44:16 user nova-compute[74337]:     <apic/>
Oct 23 21:44:16 user nova-compute[74337]:     <vmcoreinfo/>
Oct 23 21:44:16 user nova-compute[74337]:   </features>
Oct 23 21:44:16 user nova-compute[74337]:   <clock offset="utc">
Oct 23 21:44:16 user nova-compute[74337]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 21:44:16 user nova-compute[74337]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 21:44:16 user nova-compute[74337]:     <timer name="hpet" present="no"/>
Oct 23 21:44:16 user nova-compute[74337]:   </clock>
Oct 23 21:44:16 user nova-compute[74337]:   <cpu mode="custom" match="exact">
Oct 23 21:44:16 user nova-compute[74337]:     <model>Nehalem</model>
Oct 23 21:44:16 user nova-compute[74337]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 21:44:16 user nova-compute[74337]:   </cpu>
Oct 23 21:44:16 user nova-compute[74337]:   <devices>
Oct 23 21:44:16 user nova-compute[74337]:     <disk type="file" device="disk">
Oct 23 21:44:16 user nova-compute[74337]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 21:44:16 user nova-compute[74337]:       <source file="/opt/stack/data/nova/instances/60bd4497-75ce-4ad2-bef9-303f293244db/disk"/>
Oct 23 21:44:16 user nova-compute[74337]:       <target dev="vda" bus="virtio"/>
Oct 23 21:44:16 user nova-compute[74337]:     </disk>
Oct 23 21:44:16 user nova-compute[74337]:     <interface type="ethernet">
Oct 23 21:44:16 user nova-compute[74337]:       <mac address="fa:16:3e:f2:0a:14"/>
Oct 23 21:44:16 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:44:16 user nova-compute[74337]:       <mtu size="1442"/>
Oct 23 21:44:16 user nova-compute[74337]:       <target dev="tap4bf6b6b9-06"/>
Oct 23 21:44:16 user nova-compute[74337]:     </interface>
Oct 23 21:44:16 user nova-compute[74337]:     <serial type="pty">
Oct 23 21:44:16 user nova-compute[74337]:       <log file="/opt/stack/data/nova/instances/60bd4497-75ce-4ad2-bef9-303f293244db/console.log" append="off"/>
Oct 23 21:44:16 user nova-compute[74337]:     </serial>
Oct 23 21:44:16 user nova-compute[74337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 21:44:16 user nova-compute[74337]:     <video>
Oct 23 21:44:16 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:44:16 user nova-compute[74337]:     </video>
Oct 23 21:44:16 user nova-compute[74337]:     <rng model="virtio">
Oct 23 21:44:16 user nova-compute[74337]:       <backend model="random">/dev/urandom</backend>
Oct 23 21:44:16 user nova-compute[74337]:     </rng>
Oct 23 21:44:16 user nova-compute[74337]:     <controller type="usb" index="0" model="none"/>
Oct 23 21:44:16 user nova-compute[74337]:     <memballoon model="virtio">
Oct 23 21:44:16 user nova-compute[74337]:       <stats period="10"/>
Oct 23 21:44:16 user nova-compute[74337]:     </memballoon>
Oct 23 21:44:16 user nova-compute[74337]:   </devices>
Oct 23 21:44:16 user nova-compute[74337]: </domain>
Oct 23 21:44:16 user nova-compute[74337]:  {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 21:44:16 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-57564de0-d0f1-43e8-98e0-43af4abc91c3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:44:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1418196360',display_name='tempest-AttachVolumeNegativeTest-server-1418196360',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1418196360',id=24,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMqpTmUjCnPdieLTDPp1y1MCX4lfK3eM9p1yQICqheaqwuZyeQg2hTPtUbygEzENB6PDYMQ7deWPrk2woG/HFz3DenbgRAR+VTDVwqodZBGNM1FB+MR3JrC8fHsKnk7aiA==',key_name='tempest-keypair-1018291788',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='84a25b3eed8548a5a324e55b28f26252',ramdisk_id='',reservation_id='r-k2b12u0m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1446109887',owner_user_name='tempest-AttachVolumeNegativeTest-1446109887-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:44:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6f6daa6653264905a5498e00f184080c',uuid=60bd4497-75ce-4ad2-bef9-303f293244db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4bf6b6b9-0602-4d1e-a34d-c46f903a45b0", "address": "fa:16:3e:f2:0a:14", "network": {"id": "787d9979-63ad-4318-b1d7-8ec69c5969fe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1847253864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84a25b3eed8548a5a324e55b28f26252", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bf6b6b9-06", "ovs_interfaceid": "4bf6b6b9-0602-4d1e-a34d-c46f903a45b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 21:44:16 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-57564de0-d0f1-43e8-98e0-43af4abc91c3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Converting VIF {"id": "4bf6b6b9-0602-4d1e-a34d-c46f903a45b0", "address": "fa:16:3e:f2:0a:14", "network": {"id": "787d9979-63ad-4318-b1d7-8ec69c5969fe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1847253864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84a25b3eed8548a5a324e55b28f26252", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bf6b6b9-06", "ovs_interfaceid": "4bf6b6b9-0602-4d1e-a34d-c46f903a45b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:44:16 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-57564de0-d0f1-43e8-98e0-43af4abc91c3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:0a:14,bridge_name='br-int',has_traffic_filtering=True,id=4bf6b6b9-0602-4d1e-a34d-c46f903a45b0,network=Network(787d9979-63ad-4318-b1d7-8ec69c5969fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bf6b6b9-06') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:44:16 user nova-compute[74337]: DEBUG os_vif [None req-57564de0-d0f1-43e8-98e0-43af4abc91c3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:0a:14,bridge_name='br-int',has_traffic_filtering=True,id=4bf6b6b9-0602-4d1e-a34d-c46f903a45b0,network=Network(787d9979-63ad-4318-b1d7-8ec69c5969fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bf6b6b9-06') {{(pid=74337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 21:44:16 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:44:16 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:44:16 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 21:44:16 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:44:16 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a788c7cd-9036-5634-bb8e-056ea0a75988', '_type': 'linux-noop'}}, row=False) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:44:16 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:44:16 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:44:16 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:44:16 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:44:16 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4bf6b6b9-06, may_exist=True, interface_attrs={}) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:44:16 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4bf6b6b9-06, col_values=(('qos', UUID('5737698e-349c-48ea-9b1b-5301f623dc27')),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:44:16 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4bf6b6b9-06, col_values=(('external_ids', {'iface-id': '4bf6b6b9-0602-4d1e-a34d-c46f903a45b0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f2:0a:14', 'vm-uuid': '60bd4497-75ce-4ad2-bef9-303f293244db'}),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:44:16 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:44:16 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:44:16 user nova-compute[74337]: INFO os_vif [None req-57564de0-d0f1-43e8-98e0-43af4abc91c3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:0a:14,bridge_name='br-int',has_traffic_filtering=True,id=4bf6b6b9-0602-4d1e-a34d-c46f903a45b0,network=Network(787d9979-63ad-4318-b1d7-8ec69c5969fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bf6b6b9-06')
Oct 23 21:44:16 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-57564de0-d0f1-43e8-98e0-43af4abc91c3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] No BDM found with device name vda, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 21:44:16 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-57564de0-d0f1-43e8-98e0-43af4abc91c3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] No VIF found with MAC fa:16:3e:f2:0a:14, not building metadata {{(pid=74337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 21:44:17 user nova-compute[74337]: DEBUG nova.network.neutron [req-49aa3fa2-4f8a-42b0-bad3-629aac55799d req-2bbb58b8-1b14-4ad3-9df6-7167070693f7 service nova] [instance: 60bd4497-75ce-4ad2-bef9-303f293244db] Updated VIF entry in instance network info cache for port 4bf6b6b9-0602-4d1e-a34d-c46f903a45b0. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 21:44:17 user nova-compute[74337]: DEBUG nova.network.neutron [req-49aa3fa2-4f8a-42b0-bad3-629aac55799d req-2bbb58b8-1b14-4ad3-9df6-7167070693f7 service nova] [instance: 60bd4497-75ce-4ad2-bef9-303f293244db] Updating instance_info_cache with network_info: [{"id": "4bf6b6b9-0602-4d1e-a34d-c46f903a45b0", "address": "fa:16:3e:f2:0a:14", "network": {"id": "787d9979-63ad-4318-b1d7-8ec69c5969fe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1847253864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84a25b3eed8548a5a324e55b28f26252", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bf6b6b9-06", "ovs_interfaceid": "4bf6b6b9-0602-4d1e-a34d-c46f903a45b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:44:17 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-49aa3fa2-4f8a-42b0-bad3-629aac55799d req-2bbb58b8-1b14-4ad3-9df6-7167070693f7 service nova] Releasing lock "refresh_cache-60bd4497-75ce-4ad2-bef9-303f293244db" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:44:18 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:44:18 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:44:18 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:44:18 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:44:18 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:44:18 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:44:18 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:44:18 user nova-compute[74337]: DEBUG nova.compute.manager [req-0a7156bf-2a27-43fb-b34d-8e052188c9be req-eb9b4832-c12f-4367-9c3e-5aab3ff98653 service nova] [instance: 60bd4497-75ce-4ad2-bef9-303f293244db] Received event network-vif-plugged-4bf6b6b9-0602-4d1e-a34d-c46f903a45b0 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:44:18 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-0a7156bf-2a27-43fb-b34d-8e052188c9be req-eb9b4832-c12f-4367-9c3e-5aab3ff98653 service nova] Acquiring lock "60bd4497-75ce-4ad2-bef9-303f293244db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:44:18 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-0a7156bf-2a27-43fb-b34d-8e052188c9be req-eb9b4832-c12f-4367-9c3e-5aab3ff98653 service nova] Lock "60bd4497-75ce-4ad2-bef9-303f293244db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:44:18 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-0a7156bf-2a27-43fb-b34d-8e052188c9be req-eb9b4832-c12f-4367-9c3e-5aab3ff98653 service nova] Lock "60bd4497-75ce-4ad2-bef9-303f293244db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:44:18 user nova-compute[74337]: DEBUG nova.compute.manager [req-0a7156bf-2a27-43fb-b34d-8e052188c9be req-eb9b4832-c12f-4367-9c3e-5aab3ff98653 service nova] [instance: 60bd4497-75ce-4ad2-bef9-303f293244db] No waiting events found dispatching network-vif-plugged-4bf6b6b9-0602-4d1e-a34d-c46f903a45b0 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:44:18 user nova-compute[74337]: WARNING nova.compute.manager [req-0a7156bf-2a27-43fb-b34d-8e052188c9be req-eb9b4832-c12f-4367-9c3e-5aab3ff98653 service nova] [instance: 60bd4497-75ce-4ad2-bef9-303f293244db] Received unexpected event network-vif-plugged-4bf6b6b9-0602-4d1e-a34d-c46f903a45b0 for instance with vm_state building and task_state spawning.
Oct 23 21:44:19 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:44:19 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:44:19 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74337) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 23 21:44:20 user nova-compute[74337]: DEBUG nova.compute.manager [None req-57564de0-d0f1-43e8-98e0-43af4abc91c3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 60bd4497-75ce-4ad2-bef9-303f293244db] Instance event wait completed in 0 seconds for  {{(pid=74337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 21:44:20 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-57564de0-d0f1-43e8-98e0-43af4abc91c3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 60bd4497-75ce-4ad2-bef9-303f293244db] Guest created on hypervisor {{(pid=74337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 21:44:20 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: 60bd4497-75ce-4ad2-bef9-303f293244db] Instance spawned successfully.
Oct 23 21:44:20 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-57564de0-d0f1-43e8-98e0-43af4abc91c3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 60bd4497-75ce-4ad2-bef9-303f293244db] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 21:44:20 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-57564de0-d0f1-43e8-98e0-43af4abc91c3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 60bd4497-75ce-4ad2-bef9-303f293244db] Found default for hw_cdrom_bus of ide {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:44:20 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-57564de0-d0f1-43e8-98e0-43af4abc91c3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 60bd4497-75ce-4ad2-bef9-303f293244db] Found default for hw_disk_bus of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:44:20 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-57564de0-d0f1-43e8-98e0-43af4abc91c3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 60bd4497-75ce-4ad2-bef9-303f293244db] Found default for hw_input_bus of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:44:20 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-57564de0-d0f1-43e8-98e0-43af4abc91c3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 60bd4497-75ce-4ad2-bef9-303f293244db] Found default for hw_pointer_model of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:44:20 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-57564de0-d0f1-43e8-98e0-43af4abc91c3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 60bd4497-75ce-4ad2-bef9-303f293244db] Found default for hw_video_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:44:20 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-57564de0-d0f1-43e8-98e0-43af4abc91c3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 60bd4497-75ce-4ad2-bef9-303f293244db] Found default for hw_vif_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:44:20 user nova-compute[74337]: INFO nova.compute.manager [None req-57564de0-d0f1-43e8-98e0-43af4abc91c3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 60bd4497-75ce-4ad2-bef9-303f293244db] Took 5.86 seconds to spawn the instance on the hypervisor.
Oct 23 21:44:20 user nova-compute[74337]: DEBUG nova.compute.manager [None req-57564de0-d0f1-43e8-98e0-43af4abc91c3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 60bd4497-75ce-4ad2-bef9-303f293244db] Checking state {{(pid=74337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 21:44:20 user nova-compute[74337]: INFO nova.compute.manager [None req-57564de0-d0f1-43e8-98e0-43af4abc91c3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 60bd4497-75ce-4ad2-bef9-303f293244db] Took 6.58 seconds to build instance.
Oct 23 21:44:20 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-57564de0-d0f1-43e8-98e0-43af4abc91c3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lock "60bd4497-75ce-4ad2-bef9-303f293244db" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.677s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:44:20 user nova-compute[74337]: DEBUG nova.compute.manager [req-529f1906-6ee7-4252-86ce-70cc8ec60560 req-f805eba1-46c3-48de-bc95-2c8e03d28842 service nova] [instance: 60bd4497-75ce-4ad2-bef9-303f293244db] Received event network-vif-plugged-4bf6b6b9-0602-4d1e-a34d-c46f903a45b0 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:44:20 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-529f1906-6ee7-4252-86ce-70cc8ec60560 req-f805eba1-46c3-48de-bc95-2c8e03d28842 service nova] Acquiring lock "60bd4497-75ce-4ad2-bef9-303f293244db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:44:20 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-529f1906-6ee7-4252-86ce-70cc8ec60560 req-f805eba1-46c3-48de-bc95-2c8e03d28842 service nova] Lock "60bd4497-75ce-4ad2-bef9-303f293244db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:44:20 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-529f1906-6ee7-4252-86ce-70cc8ec60560 req-f805eba1-46c3-48de-bc95-2c8e03d28842 service nova] Lock "60bd4497-75ce-4ad2-bef9-303f293244db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:44:20 user nova-compute[74337]: DEBUG nova.compute.manager [req-529f1906-6ee7-4252-86ce-70cc8ec60560 req-f805eba1-46c3-48de-bc95-2c8e03d28842 service nova] [instance: 60bd4497-75ce-4ad2-bef9-303f293244db] No waiting events found dispatching network-vif-plugged-4bf6b6b9-0602-4d1e-a34d-c46f903a45b0 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:44:20 user nova-compute[74337]: WARNING nova.compute.manager [req-529f1906-6ee7-4252-86ce-70cc8ec60560 req-f805eba1-46c3-48de-bc95-2c8e03d28842 service nova] [instance: 60bd4497-75ce-4ad2-bef9-303f293244db] Received unexpected event network-vif-plugged-4bf6b6b9-0602-4d1e-a34d-c46f903a45b0 for instance with vm_state active and task_state None.
Oct 23 21:44:21 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:44:23 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:44:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:44:28 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:44:31 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:44:33 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:44:36 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:44:38 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:44:41 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:44:43 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:44:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:44:48 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:44:51 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:44:56 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:45:01 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:45:01 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:45:01 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 21:45:01 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 21:45:01 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 21:45:01 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:45:02 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:45:03 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:45:03 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Starting heal instance info cache {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 21:45:03 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "refresh_cache-547c4d4c-e0dd-495a-b83f-98426d0a4a99" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:45:03 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquired lock "refresh_cache-547c4d4c-e0dd-495a-b83f-98426d0a4a99" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:45:03 user nova-compute[74337]: DEBUG nova.network.neutron [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 547c4d4c-e0dd-495a-b83f-98426d0a4a99] Forcefully refreshing network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 21:45:03 user nova-compute[74337]: DEBUG nova.network.neutron [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 547c4d4c-e0dd-495a-b83f-98426d0a4a99] Updating instance_info_cache with network_info: [{"id": "2dd20d7f-9490-476a-90ed-e6a1c9085e4d", "address": "fa:16:3e:5f:e1:f7", "network": {"id": "aff1f95f-fda8-4f0f-8d10-7e3d587e4fda", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2048135647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1f57e58a9ec4c6384dc0d3ca58eb610", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd20d7f-94", "ovs_interfaceid": "2dd20d7f-9490-476a-90ed-e6a1c9085e4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:45:03 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Releasing lock "refresh_cache-547c4d4c-e0dd-495a-b83f-98426d0a4a99" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:45:03 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 547c4d4c-e0dd-495a-b83f-98426d0a4a99] Updated the network info_cache for instance {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 21:45:04 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:45:04 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:45:05 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:45:05 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:45:05 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 21:45:06 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:45:08 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:45:08 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:45:08 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:45:08 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:45:08 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Auditing locally available compute resources for user (node: user) {{(pid=74337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 21:45:08 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 21:45:08 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d/disk.rescue --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:45:08 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d/disk.rescue --force-share --output=json" returned: 0 in 0.246s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:45:08 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d/disk.rescue --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:45:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:45:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60bd4497-75ce-4ad2-bef9-303f293244db/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:45:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60bd4497-75ce-4ad2-bef9-303f293244db/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:45:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60bd4497-75ce-4ad2-bef9-303f293244db/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:45:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60bd4497-75ce-4ad2-bef9-303f293244db/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:45:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56a4b932-486d-4b8d-9616-99e75592432a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:45:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56a4b932-486d-4b8d-9616-99e75592432a/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:45:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56a4b932-486d-4b8d-9616-99e75592432a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:45:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56a4b932-486d-4b8d-9616-99e75592432a/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:45:09 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 21:45:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/547c4d4c-e0dd-495a-b83f-98426d0a4a99/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:45:10 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/547c4d4c-e0dd-495a-b83f-98426d0a4a99/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:45:10 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/547c4d4c-e0dd-495a-b83f-98426d0a4a99/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:45:10 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/547c4d4c-e0dd-495a-b83f-98426d0a4a99/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:45:10 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba8d1d0-5fac-4213-9a50-a4e273710b1b/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:45:10 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba8d1d0-5fac-4213-9a50-a4e273710b1b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:45:10 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba8d1d0-5fac-4213-9a50-a4e273710b1b/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:45:10 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba8d1d0-5fac-4213-9a50-a4e273710b1b/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:45:10 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01d407b0-a7cf-4222-9f2d-54b99eeeed84/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:45:10 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01d407b0-a7cf-4222-9f2d-54b99eeeed84/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:45:10 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01d407b0-a7cf-4222-9f2d-54b99eeeed84/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:45:10 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:45:11 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01d407b0-a7cf-4222-9f2d-54b99eeeed84/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:45:11 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 21:45:11 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195a4056-3254-4558-b2f5-299bcd4af07c/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:45:11 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195a4056-3254-4558-b2f5-299bcd4af07c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:45:11 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195a4056-3254-4558-b2f5-299bcd4af07c/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:45:11 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195a4056-3254-4558-b2f5-299bcd4af07c/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:45:11 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1189976f-8d02-468d-8fa7-bd5594c5f85a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:45:11 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1189976f-8d02-468d-8fa7-bd5594c5f85a/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:45:11 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1189976f-8d02-468d-8fa7-bd5594c5f85a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:45:11 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:45:11 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1189976f-8d02-468d-8fa7-bd5594c5f85a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:45:12 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:45:12 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:45:12 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Hypervisor/Node resource view: name=user free_ram=7963MB free_disk=25.320175170898438GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 21:45:12 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:45:12 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:45:12 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 1189976f-8d02-468d-8fa7-bd5594c5f85a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:45:12 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 0ba8d1d0-5fac-4213-9a50-a4e273710b1b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:45:12 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 547c4d4c-e0dd-495a-b83f-98426d0a4a99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:45:12 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 00f757cf-e5dd-476f-81c6-670ed2bf6938 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Oct 23 21:45:12 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 56a4b932-486d-4b8d-9616-99e75592432a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:45:12 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:45:12 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 01d407b0-a7cf-4222-9f2d-54b99eeeed84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:45:12 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 195a4056-3254-4558-b2f5-299bcd4af07c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:45:12 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 60bd4497-75ce-4ad2-bef9-303f293244db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:45:12 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 21:45:12 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 21:45:12 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:45:12 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:45:12 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Compute_service record updated for user:user {{(pid=74337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 21:45:12 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.535s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:45:13 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Acquiring lock "89e792eb-ad8f-4bb7-adac-315c3415cd6d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:45:13 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "89e792eb-ad8f-4bb7-adac-315c3415cd6d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:45:13 user nova-compute[74337]: DEBUG nova.compute.manager [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 89e792eb-ad8f-4bb7-adac-315c3415cd6d] Starting instance... {{(pid=74337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 21:45:13 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:45:13 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:45:13 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 21:45:13 user nova-compute[74337]: INFO nova.compute.claims [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 89e792eb-ad8f-4bb7-adac-315c3415cd6d] Claim successful on node user
Oct 23 21:45:13 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:45:13 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:45:13 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.552s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:45:13 user nova-compute[74337]: DEBUG nova.compute.manager [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 89e792eb-ad8f-4bb7-adac-315c3415cd6d] Start building networks asynchronously for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 21:45:13 user nova-compute[74337]: DEBUG nova.compute.manager [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 89e792eb-ad8f-4bb7-adac-315c3415cd6d] Allocating IP information in the background. {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 21:45:13 user nova-compute[74337]: DEBUG nova.network.neutron [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 89e792eb-ad8f-4bb7-adac-315c3415cd6d] allocate_for_instance() {{(pid=74337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 21:45:13 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 89e792eb-ad8f-4bb7-adac-315c3415cd6d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 21:45:13 user nova-compute[74337]: DEBUG nova.compute.manager [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 89e792eb-ad8f-4bb7-adac-315c3415cd6d] Start building block device mappings for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 21:45:13 user nova-compute[74337]: INFO nova.virt.block_device [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 89e792eb-ad8f-4bb7-adac-315c3415cd6d] Booting with volume 8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c at /dev/vda
Oct 23 21:45:13 user nova-compute[74337]: DEBUG nova.policy [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0c3e635e8e5447138a7f2db11695574c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb567547bd4941fb87435a841c9d17c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74337) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 21:45:14 user nova-compute[74337]: DEBUG os_brick.utils [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:45:14 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:45:14 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:45:14 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[88eaef9c-cc6b-445f-9896-455ae45ae301]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f34011b66e40\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:45:14 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:45:14 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:45:14 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[762053d4-f940-4291-93e4-664850a64370]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:45:14 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:45:14 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:45:14 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a2fda07-8c09-49d9-a3ac-b66059fef85e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:45:14 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[4170fa27-da51-4d80-a3a2-4d95cc2a38f4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:45:14 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Running cmd (subprocess): nvme version {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:45:14 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] 'nvme version' failed. Not Retrying. {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 21:45:14 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] nvme not present on system {{(pid=74337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 21:45:14 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:45:14 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 21:45:14 user nova-compute[74337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 21:45:14 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd5ea26d-8326-4d8e-9ba3-ac1a64a51c80]: (4, '') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:45:14 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 21:45:14 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 21:45:14 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] LIGHTOS: no hostnqn found. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 21:45:14 user nova-compute[74337]: DEBUG os_brick.utils [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f34011b66e40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:45:14 user nova-compute[74337]: DEBUG nova.virt.block_device [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 89e792eb-ad8f-4bb7-adac-315c3415cd6d] Updating existing volume attachment record: fcd97dd5-f36d-4199-9429-81e6b63cb759 {{(pid=74337) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 21:45:14 user nova-compute[74337]: DEBUG nova.network.neutron [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 89e792eb-ad8f-4bb7-adac-315c3415cd6d] Successfully created port: c23a4c6d-9fd0-4cd3-afa9-5ccf4520d90e {{(pid=74337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 21:45:14 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:45:14 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:45:14 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:45:15 user nova-compute[74337]: DEBUG nova.network.neutron [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 89e792eb-ad8f-4bb7-adac-315c3415cd6d] Successfully updated port: c23a4c6d-9fd0-4cd3-afa9-5ccf4520d90e {{(pid=74337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 21:45:15 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Acquiring lock "refresh_cache-89e792eb-ad8f-4bb7-adac-315c3415cd6d" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:45:15 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Acquired lock "refresh_cache-89e792eb-ad8f-4bb7-adac-315c3415cd6d" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:45:15 user nova-compute[74337]: DEBUG nova.network.neutron [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 89e792eb-ad8f-4bb7-adac-315c3415cd6d] Building network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 21:45:15 user nova-compute[74337]: DEBUG nova.compute.manager [req-bf4c3980-42e3-4ec6-9628-df39d22503be req-959a5ebe-a447-4b0b-9c10-57225fd54dcc service nova] [instance: 89e792eb-ad8f-4bb7-adac-315c3415cd6d] Received event network-changed-c23a4c6d-9fd0-4cd3-afa9-5ccf4520d90e {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:45:15 user nova-compute[74337]: DEBUG nova.compute.manager [req-bf4c3980-42e3-4ec6-9628-df39d22503be req-959a5ebe-a447-4b0b-9c10-57225fd54dcc service nova] [instance: 89e792eb-ad8f-4bb7-adac-315c3415cd6d] Refreshing instance network info cache due to event network-changed-c23a4c6d-9fd0-4cd3-afa9-5ccf4520d90e. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 21:45:15 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-bf4c3980-42e3-4ec6-9628-df39d22503be req-959a5ebe-a447-4b0b-9c10-57225fd54dcc service nova] Acquiring lock "refresh_cache-89e792eb-ad8f-4bb7-adac-315c3415cd6d" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:45:15 user nova-compute[74337]: DEBUG nova.network.neutron [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 89e792eb-ad8f-4bb7-adac-315c3415cd6d] Instance cache missing network info. {{(pid=74337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 21:45:15 user nova-compute[74337]: DEBUG nova.network.neutron [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 89e792eb-ad8f-4bb7-adac-315c3415cd6d] Updating instance_info_cache with network_info: [{"id": "c23a4c6d-9fd0-4cd3-afa9-5ccf4520d90e", "address": "fa:16:3e:9e:8d:44", "network": {"id": "5a18e96f-a6eb-4989-9be3-154b54928b03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-507511840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb567547bd4941fb87435a841c9d17c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc23a4c6d-9f", "ovs_interfaceid": "c23a4c6d-9fd0-4cd3-afa9-5ccf4520d90e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:45:15 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Releasing lock "refresh_cache-89e792eb-ad8f-4bb7-adac-315c3415cd6d" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:45:15 user nova-compute[74337]: DEBUG nova.compute.manager [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 89e792eb-ad8f-4bb7-adac-315c3415cd6d] Instance network_info: |[{"id": "c23a4c6d-9fd0-4cd3-afa9-5ccf4520d90e", "address": "fa:16:3e:9e:8d:44", "network": {"id": "5a18e96f-a6eb-4989-9be3-154b54928b03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-507511840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb567547bd4941fb87435a841c9d17c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc23a4c6d-9f", "ovs_interfaceid": "c23a4c6d-9fd0-4cd3-afa9-5ccf4520d90e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 21:45:15 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-bf4c3980-42e3-4ec6-9628-df39d22503be req-959a5ebe-a447-4b0b-9c10-57225fd54dcc service nova] Acquired lock "refresh_cache-89e792eb-ad8f-4bb7-adac-315c3415cd6d" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:45:15 user nova-compute[74337]: DEBUG nova.network.neutron [req-bf4c3980-42e3-4ec6-9628-df39d22503be req-959a5ebe-a447-4b0b-9c10-57225fd54dcc service nova] [instance: 89e792eb-ad8f-4bb7-adac-315c3415cd6d] Refreshing network info cache for port c23a4c6d-9fd0-4cd3-afa9-5ccf4520d90e {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 21:45:16 user nova-compute[74337]: DEBUG nova.network.neutron [req-bf4c3980-42e3-4ec6-9628-df39d22503be req-959a5ebe-a447-4b0b-9c10-57225fd54dcc service nova] [instance: 89e792eb-ad8f-4bb7-adac-315c3415cd6d] Updated VIF entry in instance network info cache for port c23a4c6d-9fd0-4cd3-afa9-5ccf4520d90e. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 21:45:16 user nova-compute[74337]: DEBUG nova.network.neutron [req-bf4c3980-42e3-4ec6-9628-df39d22503be req-959a5ebe-a447-4b0b-9c10-57225fd54dcc service nova] [instance: 89e792eb-ad8f-4bb7-adac-315c3415cd6d] Updating instance_info_cache with network_info: [{"id": "c23a4c6d-9fd0-4cd3-afa9-5ccf4520d90e", "address": "fa:16:3e:9e:8d:44", "network": {"id": "5a18e96f-a6eb-4989-9be3-154b54928b03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-507511840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb567547bd4941fb87435a841c9d17c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc23a4c6d-9f", "ovs_interfaceid": "c23a4c6d-9fd0-4cd3-afa9-5ccf4520d90e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:45:16 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-bf4c3980-42e3-4ec6-9628-df39d22503be req-959a5ebe-a447-4b0b-9c10-57225fd54dcc service nova] Releasing lock "refresh_cache-89e792eb-ad8f-4bb7-adac-315c3415cd6d" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:45:16 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:45:16 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:45:16 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 21:45:16 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 21:45:16 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 21:45:16 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:45:20 user nova-compute[74337]: DEBUG nova.compute.manager [req-d23c21da-e977-4c0f-a76b-79a220df9cf4 req-81db5a7c-4c34-4b17-9acd-35115200e4ea service nova] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Received event network-changed-efec7d56-28cb-4da2-b6f7-6e9777d3377b {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:45:20 user nova-compute[74337]: DEBUG nova.compute.manager [req-d23c21da-e977-4c0f-a76b-79a220df9cf4 req-81db5a7c-4c34-4b17-9acd-35115200e4ea service nova] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Refreshing instance network info cache due to event network-changed-efec7d56-28cb-4da2-b6f7-6e9777d3377b. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 21:45:20 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-d23c21da-e977-4c0f-a76b-79a220df9cf4 req-81db5a7c-4c34-4b17-9acd-35115200e4ea service nova] Acquiring lock "refresh_cache-195a4056-3254-4558-b2f5-299bcd4af07c" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:45:20 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-d23c21da-e977-4c0f-a76b-79a220df9cf4 req-81db5a7c-4c34-4b17-9acd-35115200e4ea service nova] Acquired lock "refresh_cache-195a4056-3254-4558-b2f5-299bcd4af07c" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:45:20 user nova-compute[74337]: DEBUG nova.network.neutron [req-d23c21da-e977-4c0f-a76b-79a220df9cf4 req-81db5a7c-4c34-4b17-9acd-35115200e4ea service nova] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Refreshing network info cache for port efec7d56-28cb-4da2-b6f7-6e9777d3377b {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 21:45:20 user nova-compute[74337]: DEBUG nova.network.neutron [req-d23c21da-e977-4c0f-a76b-79a220df9cf4 req-81db5a7c-4c34-4b17-9acd-35115200e4ea service nova] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Updated VIF entry in instance network info cache for port efec7d56-28cb-4da2-b6f7-6e9777d3377b. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 21:45:20 user nova-compute[74337]: DEBUG nova.network.neutron [req-d23c21da-e977-4c0f-a76b-79a220df9cf4 req-81db5a7c-4c34-4b17-9acd-35115200e4ea service nova] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Updating instance_info_cache with network_info: [{"id": "efec7d56-28cb-4da2-b6f7-6e9777d3377b", "address": "fa:16:3e:26:a4:b5", "network": {"id": "aff1f95f-fda8-4f0f-8d10-7e3d587e4fda", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2048135647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1f57e58a9ec4c6384dc0d3ca58eb610", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefec7d56-28", "ovs_interfaceid": "efec7d56-28cb-4da2-b6f7-6e9777d3377b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:45:20 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-d23c21da-e977-4c0f-a76b-79a220df9cf4 req-81db5a7c-4c34-4b17-9acd-35115200e4ea service nova] Releasing lock "refresh_cache-195a4056-3254-4558-b2f5-299bcd4af07c" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:45:20 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-bbe4bc29-a759-454e-9bdf-0802b617f2d8 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Acquiring lock "195a4056-3254-4558-b2f5-299bcd4af07c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:45:20 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-bbe4bc29-a759-454e-9bdf-0802b617f2d8 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lock "195a4056-3254-4558-b2f5-299bcd4af07c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:45:20 user nova-compute[74337]: DEBUG nova.objects.instance [None req-bbe4bc29-a759-454e-9bdf-0802b617f2d8 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lazy-loading 'flavor' on Instance uuid 195a4056-3254-4558-b2f5-299bcd4af07c {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:45:20 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-bbe4bc29-a759-454e-9bdf-0802b617f2d8 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lock "195a4056-3254-4558-b2f5-299bcd4af07c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:45:21 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-bbe4bc29-a759-454e-9bdf-0802b617f2d8 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Acquiring lock "195a4056-3254-4558-b2f5-299bcd4af07c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:45:21 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-bbe4bc29-a759-454e-9bdf-0802b617f2d8 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lock "195a4056-3254-4558-b2f5-299bcd4af07c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:45:21 user nova-compute[74337]: INFO nova.compute.manager [None req-bbe4bc29-a759-454e-9bdf-0802b617f2d8 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Attaching volume 9a863deb-8b0f-4e44-b7d7-16ace509f43c to /dev/vdb
Oct 23 21:45:21 user nova-compute[74337]: DEBUG os_brick.utils [None req-bbe4bc29-a759-454e-9bdf-0802b617f2d8 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:45:21 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:45:21 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:45:21 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e18b86e-eb46-4377-9f81-6dea930dd56d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f34011b66e40\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:45:21 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:45:21 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:45:21 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf08d8b-553d-400b-bca9-52ff0156c46e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:45:21 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:45:21 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:45:21 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd9161c-9985-41bc-a796-66e0a4ad696a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:45:21 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[296a5828-774a-45e8-8168-0e40c4d3c84b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:45:21 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-bbe4bc29-a759-454e-9bdf-0802b617f2d8 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Running cmd (subprocess): nvme version {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:45:21 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-bbe4bc29-a759-454e-9bdf-0802b617f2d8 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] 'nvme version' failed. Not Retrying. {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 21:45:21 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bbe4bc29-a759-454e-9bdf-0802b617f2d8 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] nvme not present on system {{(pid=74337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 21:45:21 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:45:21 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 21:45:21 user nova-compute[74337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 21:45:21 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[067c02f3-0b77-4342-80d7-c771838de51a]: (4, '') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:45:21 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-bbe4bc29-a759-454e-9bdf-0802b617f2d8 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 21:45:21 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-bbe4bc29-a759-454e-9bdf-0802b617f2d8 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 21:45:21 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-bbe4bc29-a759-454e-9bdf-0802b617f2d8 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] LIGHTOS: no hostnqn found. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 21:45:21 user nova-compute[74337]: DEBUG os_brick.utils [None req-bbe4bc29-a759-454e-9bdf-0802b617f2d8 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f34011b66e40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:45:21 user nova-compute[74337]: DEBUG nova.virt.block_device [None req-bbe4bc29-a759-454e-9bdf-0802b617f2d8 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Updating existing volume attachment record: e480b567-71b0-4ae2-aa6d-fddc88aa0002 {{(pid=74337) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 21:45:21 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:45:23 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:45:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:45:28 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:45:31 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:45:32 user nova-compute[74337]: DEBUG nova.compute.manager [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 89e792eb-ad8f-4bb7-adac-315c3415cd6d] Start spawning the instance on the hypervisor. {{(pid=74337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 21:45:32 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 89e792eb-ad8f-4bb7-adac-315c3415cd6d] Creating instance directory {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 21:45:32 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 89e792eb-ad8f-4bb7-adac-315c3415cd6d] Creating image(s)
Oct 23 21:45:32 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 89e792eb-ad8f-4bb7-adac-315c3415cd6d] Did not create local disks {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 23 21:45:32 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 89e792eb-ad8f-4bb7-adac-315c3415cd6d] Ensure instance console log exists: /opt/stack/data/nova/instances/89e792eb-ad8f-4bb7-adac-315c3415cd6d/console.log {{(pid=74337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 21:45:32 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:45:32 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:45:32 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:45:32 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 89e792eb-ad8f-4bb7-adac-315c3415cd6d] Start _get_guest_xml network_info=[{"id": "c23a4c6d-9fd0-4cd3-afa9-5ccf4520d90e", "address": "fa:16:3e:9e:8d:44", "network": {"id": "5a18e96f-a6eb-4989-9be3-154b54928b03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-507511840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb567547bd4941fb87435a841c9d17c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc23a4c6d-9f", "ovs_interfaceid": "c23a4c6d-9fd0-4cd3-afa9-5ccf4520d90e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'fcd97dd5-f36d-4199-9429-81e6b63cb759', 'delete_on_termination': True, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bQqHTWFg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '89e792eb-ad8f-4bb7-adac-315c3415cd6d', 'attached_at': '', 'detached_at': '', 'volume_id': '8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c', 'serial': '8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c'}, 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 21:45:32 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:45:32 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:45:32 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 21:45:32 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] CPU controller missing on host. {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 21:45:32 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 21:45:32 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] CPU controller found on host. {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 21:45:32 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 21:45:32 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T21:29:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 21:45:32 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Flavor limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 21:45:32 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Image limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 21:45:32 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Flavor pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 21:45:32 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Image pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 21:45:32 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 21:45:32 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 21:45:32 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 21:45:32 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Got 1 possible topologies {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 21:45:32 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 21:45:32 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 21:45:32 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 89e792eb-ad8f-4bb7-adac-315c3415cd6d] Calling os-brick to attach iSCSI Volume {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 21:45:32 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bQqHTWFg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:45:32 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:45:32 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:45:32 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:45:32 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:45:32 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:45:32 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:45:32 user nova-compute[74337]: INFO os_brick.initiator.connectors.iscsi [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 21:45:32 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c -p 172.16.0.220:3260 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:45:32 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:45:32 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d257a33f-f461-47bc-a7ef-00b04e75100d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:45:32 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 21:45:32 user nova-compute[74337]:  {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:45:32 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c -p 172.16.0.220:3260 --interface default --op new {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:45:32 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:45:32 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[3242939f-439c-468c-9782-749c20dc7398]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c] added\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:45:32 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c] added
Oct 23 21:45:32 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:45:32 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:45:32 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:45:32 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d96cde-735b-43bf-b95f-b3218a90529a]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:45:32 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:45:32 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:45:32 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:45:32 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf4b3ead-f80a-4041-aa83-ebe74c950051]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:45:32 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:45:32 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bQqHTWFg {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:45:32 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bQqHTWFg" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:45:32 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[addf5ac8-57f5-4215-8ea8-58e7352b2c08]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:45:32 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bQqHTWFg'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:45:32 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:45:32 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:45:32 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f6a013f-d2d9-433b-9789-e6e99898d843]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:45:32 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:45:32 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:45:32 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:45:32 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[201e3824-23ea-4b49-b964-5090a154c185]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83240a3d-a866-4ba1-9d61-472c1d1a86f7 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:45:32 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:45:32 user nova-compute[74337]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac (non-flash)
Oct 23 21:45:32 user nova-compute[74337]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83240a3d-a866-4ba1-9d61-472c1d1a86f7 (non-flash)
Oct 23 21:45:32 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:45:32 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:45:32 user nova-compute[74337]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac (non-flash)
Oct 23 21:45:32 user nova-compute[74337]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83240a3d-a866-4ba1-9d61-472c1d1a86f7 (non-flash)
Oct 23 21:45:32 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:45:32 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c -p 172.16.0.220:3260 --login {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:45:32 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:45:32 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[16018532-d044-4717-b2de-b0c591cf1589]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:45:32 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c, portal: 172.16.0.220,3260]
Oct 23 21:45:32 user nova-compute[74337]: Login to [iface: default, target: iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c, portal: 172.16.0.220,3260] successful.
Oct 23 21:45:32 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:45:32 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:45:32 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:45:32 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[0483ca92-f17b-4200-b070-7bced384e321]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:45:32 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:45:32 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:45:32 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:45:32 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[86b57fbe-4b4b-48c9-b12e-71723f81c59d]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83240a3d-a866-4ba1-9d61-472c1d1a86f7 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:45:32 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:45:32 user nova-compute[74337]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac (non-flash)
Oct 23 21:45:32 user nova-compute[74337]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83240a3d-a866-4ba1-9d61-472c1d1a86f7 (non-flash)
Oct 23 21:45:32 user nova-compute[74337]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c (non-flash)
Oct 23 21:45:32 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:45:32 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:45:32 user nova-compute[74337]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac (non-flash)
Oct 23 21:45:32 user nova-compute[74337]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83240a3d-a866-4ba1-9d61-472c1d1a86f7 (non-flash)
Oct 23 21:45:32 user nova-compute[74337]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c (non-flash)
Oct 23 21:45:32 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:45:32 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:45:32 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Connected to 172.16.0.220:3260 {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 21:45:32 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] HCTL ('36', '-', '-', 0) found on session 26 with lun 0 {{(pid=74337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 21:45:32 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 21:45:32 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:45:32 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:45:32 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb5bf4d6-12ba-4662-89db-4ba1bcc6761d]: (4, ('- - 0', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:45:32 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Searching for a device in session 26 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 21:45:32 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bQqHTWFg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 21:45:32 user nova-compute[74337]: INFO nova.compute.manager [None req-8539b17e-0bd5-4a83-86dc-a25edd7fc480 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] Unrescuing
Oct 23 21:45:32 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-8539b17e-0bd5-4a83-86dc-a25edd7fc480 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Acquiring lock "refresh_cache-c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:45:32 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-8539b17e-0bd5-4a83-86dc-a25edd7fc480 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Acquired lock "refresh_cache-c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:45:32 user nova-compute[74337]: DEBUG nova.network.neutron [None req-8539b17e-0bd5-4a83-86dc-a25edd7fc480 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] Building network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 21:45:33 user nova-compute[74337]: DEBUG nova.network.neutron [None req-8539b17e-0bd5-4a83-86dc-a25edd7fc480 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] Updating instance_info_cache with network_info: [{"id": "328722f1-b384-495c-8aea-81780b2d9ca1", "address": "fa:16:3e:28:35:83", "network": {"id": "5f62b1d8-d5d0-4ff9-922b-fc6e72fb640d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-655282105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b85c4f783a4ee7ab67422b49da85ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap328722f1-b3", "ovs_interfaceid": "328722f1-b384-495c-8aea-81780b2d9ca1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:45:33 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-8539b17e-0bd5-4a83-86dc-a25edd7fc480 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Releasing lock "refresh_cache-c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:45:33 user nova-compute[74337]: DEBUG nova.objects.instance [None req-8539b17e-0bd5-4a83-86dc-a25edd7fc480 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lazy-loading 'flavor' on Instance uuid c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:45:33 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:45:33 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:45:33 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:45:33 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '23134323961626437', 'path': '/dev/sde'} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:45:33 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 89e792eb-ad8f-4bb7-adac-315c3415cd6d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23134323961626437', 'path': '/dev/sde'} {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 21:45:33 user nova-compute[74337]: DEBUG nova.compute.manager [req-58362324-9f1b-490f-8a10-b7280e9842d6 req-0f7b111c-d408-499d-a1b4-59dd871b1897 service nova] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] Received event network-vif-unplugged-328722f1-b384-495c-8aea-81780b2d9ca1 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:45:33 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-58362324-9f1b-490f-8a10-b7280e9842d6 req-0f7b111c-d408-499d-a1b4-59dd871b1897 service nova] Acquiring lock "c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:45:33 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-58362324-9f1b-490f-8a10-b7280e9842d6 req-0f7b111c-d408-499d-a1b4-59dd871b1897 service nova] Lock "c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:45:33 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-58362324-9f1b-490f-8a10-b7280e9842d6 req-0f7b111c-d408-499d-a1b4-59dd871b1897 service nova] Lock "c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:45:33 user nova-compute[74337]: DEBUG nova.compute.manager [req-58362324-9f1b-490f-8a10-b7280e9842d6 req-0f7b111c-d408-499d-a1b4-59dd871b1897 service nova] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] No waiting events found dispatching network-vif-unplugged-328722f1-b384-495c-8aea-81780b2d9ca1 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:45:33 user nova-compute[74337]: WARNING nova.compute.manager [req-58362324-9f1b-490f-8a10-b7280e9842d6 req-0f7b111c-d408-499d-a1b4-59dd871b1897 service nova] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] Received unexpected event network-vif-unplugged-328722f1-b384-495c-8aea-81780b2d9ca1 for instance with vm_state rescued and task_state unrescuing.
Oct 23 21:45:33 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:45:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1666272220',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1666272220',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1666272220',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOgrDBH1CvXvIcgB0O0DFBLVjNN8t7kMW+CZkDWjghUBMBIGLgB/sbTKT/JxvB2pvW15F+DwsGGE4rA8tWUBZwr6Ds30gIIu/5Ft3ePzuZluMRXuj1d9BSI79URZ7oNHEw==',key_name='tempest-keypair-615180005',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb567547bd4941fb87435a841c9d17c4',ramdisk_id='',reservation_id='r-bip98ecx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-499971371',owner_user_name='tempest-TestVolumeBootPattern-499971371-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:45:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c3e635e8e5447138a7f2db11695574c',uuid=89e792eb-ad8f-4bb7-adac-315c3415cd6d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c23a4c6d-9fd0-4cd3-afa9-5ccf4520d90e", "address": "fa:16:3e:9e:8d:44", "network": {"id": "5a18e96f-a6eb-4989-9be3-154b54928b03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-507511840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb567547bd4941fb87435a841c9d17c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc23a4c6d-9f", "ovs_interfaceid": "c23a4c6d-9fd0-4cd3-afa9-5ccf4520d90e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 21:45:33 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Converting VIF {"id": "c23a4c6d-9fd0-4cd3-afa9-5ccf4520d90e", "address": "fa:16:3e:9e:8d:44", "network": {"id": "5a18e96f-a6eb-4989-9be3-154b54928b03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-507511840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb567547bd4941fb87435a841c9d17c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc23a4c6d-9f", "ovs_interfaceid": "c23a4c6d-9fd0-4cd3-afa9-5ccf4520d90e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:45:33 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:8d:44,bridge_name='br-int',has_traffic_filtering=True,id=c23a4c6d-9fd0-4cd3-afa9-5ccf4520d90e,network=Network(5a18e96f-a6eb-4989-9be3-154b54928b03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc23a4c6d-9f') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:45:33 user nova-compute[74337]: DEBUG nova.objects.instance [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lazy-loading 'pci_devices' on Instance uuid 89e792eb-ad8f-4bb7-adac-315c3415cd6d {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:45:33 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 89e792eb-ad8f-4bb7-adac-315c3415cd6d] End _get_guest_xml xml=<domain type="kvm">
Oct 23 21:45:33 user nova-compute[74337]:   <uuid>89e792eb-ad8f-4bb7-adac-315c3415cd6d</uuid>
Oct 23 21:45:33 user nova-compute[74337]:   <name>instance-00000019</name>
Oct 23 21:45:33 user nova-compute[74337]:   <memory>524288</memory>
Oct 23 21:45:33 user nova-compute[74337]:   <vcpu>1</vcpu>
Oct 23 21:45:33 user nova-compute[74337]:   <metadata>
Oct 23 21:45:33 user nova-compute[74337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 21:45:33 user nova-compute[74337]:       <nova:package version="0.0.0"/>
Oct 23 21:45:33 user nova-compute[74337]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1666272220</nova:name>
Oct 23 21:45:33 user nova-compute[74337]:       <nova:creationTime>2023-10-23 21:45:32</nova:creationTime>
Oct 23 21:45:33 user nova-compute[74337]:       <nova:flavor name="m1.tiny">
Oct 23 21:45:33 user nova-compute[74337]:         <nova:memory>512</nova:memory>
Oct 23 21:45:33 user nova-compute[74337]:         <nova:disk>1</nova:disk>
Oct 23 21:45:33 user nova-compute[74337]:         <nova:swap>0</nova:swap>
Oct 23 21:45:33 user nova-compute[74337]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 21:45:33 user nova-compute[74337]:         <nova:vcpus>1</nova:vcpus>
Oct 23 21:45:33 user nova-compute[74337]:       </nova:flavor>
Oct 23 21:45:33 user nova-compute[74337]:       <nova:owner>
Oct 23 21:45:33 user nova-compute[74337]:         <nova:user uuid="0c3e635e8e5447138a7f2db11695574c">tempest-TestVolumeBootPattern-499971371-project-member</nova:user>
Oct 23 21:45:33 user nova-compute[74337]:         <nova:project uuid="cb567547bd4941fb87435a841c9d17c4">tempest-TestVolumeBootPattern-499971371</nova:project>
Oct 23 21:45:33 user nova-compute[74337]:       </nova:owner>
Oct 23 21:45:33 user nova-compute[74337]:       <nova:ports>
Oct 23 21:45:33 user nova-compute[74337]:         <nova:port uuid="c23a4c6d-9fd0-4cd3-afa9-5ccf4520d90e">
Oct 23 21:45:33 user nova-compute[74337]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 23 21:45:33 user nova-compute[74337]:         </nova:port>
Oct 23 21:45:33 user nova-compute[74337]:       </nova:ports>
Oct 23 21:45:33 user nova-compute[74337]:     </nova:instance>
Oct 23 21:45:33 user nova-compute[74337]:   </metadata>
Oct 23 21:45:33 user nova-compute[74337]:   <sysinfo type="smbios">
Oct 23 21:45:33 user nova-compute[74337]:     <system>
Oct 23 21:45:33 user nova-compute[74337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 21:45:33 user nova-compute[74337]:       <entry name="product">OpenStack Nova</entry>
Oct 23 21:45:33 user nova-compute[74337]:       <entry name="version">0.0.0</entry>
Oct 23 21:45:33 user nova-compute[74337]:       <entry name="serial">89e792eb-ad8f-4bb7-adac-315c3415cd6d</entry>
Oct 23 21:45:33 user nova-compute[74337]:       <entry name="uuid">89e792eb-ad8f-4bb7-adac-315c3415cd6d</entry>
Oct 23 21:45:33 user nova-compute[74337]:       <entry name="family">Virtual Machine</entry>
Oct 23 21:45:33 user nova-compute[74337]:     </system>
Oct 23 21:45:33 user nova-compute[74337]:   </sysinfo>
Oct 23 21:45:33 user nova-compute[74337]:   <os>
Oct 23 21:45:33 user nova-compute[74337]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 21:45:33 user nova-compute[74337]:     <boot dev="hd"/>
Oct 23 21:45:33 user nova-compute[74337]:     <smbios mode="sysinfo"/>
Oct 23 21:45:33 user nova-compute[74337]:   </os>
Oct 23 21:45:33 user nova-compute[74337]:   <features>
Oct 23 21:45:33 user nova-compute[74337]:     <acpi/>
Oct 23 21:45:33 user nova-compute[74337]:     <apic/>
Oct 23 21:45:33 user nova-compute[74337]:     <vmcoreinfo/>
Oct 23 21:45:33 user nova-compute[74337]:   </features>
Oct 23 21:45:33 user nova-compute[74337]:   <clock offset="utc">
Oct 23 21:45:33 user nova-compute[74337]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 21:45:33 user nova-compute[74337]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 21:45:33 user nova-compute[74337]:     <timer name="hpet" present="no"/>
Oct 23 21:45:33 user nova-compute[74337]:   </clock>
Oct 23 21:45:33 user nova-compute[74337]:   <cpu mode="custom" match="exact">
Oct 23 21:45:33 user nova-compute[74337]:     <model>Nehalem</model>
Oct 23 21:45:33 user nova-compute[74337]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 21:45:33 user nova-compute[74337]:   </cpu>
Oct 23 21:45:33 user nova-compute[74337]:   <devices>
Oct 23 21:45:33 user nova-compute[74337]:     <disk type="block" device="disk">
Oct 23 21:45:33 user nova-compute[74337]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 21:45:33 user nova-compute[74337]:       <source dev="/dev/sde"/>
Oct 23 21:45:33 user nova-compute[74337]:       <target dev="vda" bus="virtio"/>
Oct 23 21:45:33 user nova-compute[74337]:       <serial>8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c</serial>
Oct 23 21:45:33 user nova-compute[74337]:     </disk>
Oct 23 21:45:33 user nova-compute[74337]:     <interface type="ethernet">
Oct 23 21:45:33 user nova-compute[74337]:       <mac address="fa:16:3e:9e:8d:44"/>
Oct 23 21:45:33 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:45:33 user nova-compute[74337]:       <mtu size="1442"/>
Oct 23 21:45:33 user nova-compute[74337]:       <target dev="tapc23a4c6d-9f"/>
Oct 23 21:45:33 user nova-compute[74337]:     </interface>
Oct 23 21:45:33 user nova-compute[74337]:     <serial type="pty">
Oct 23 21:45:33 user nova-compute[74337]:       <log file="/opt/stack/data/nova/instances/89e792eb-ad8f-4bb7-adac-315c3415cd6d/console.log" append="off"/>
Oct 23 21:45:33 user nova-compute[74337]:     </serial>
Oct 23 21:45:33 user nova-compute[74337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 21:45:33 user nova-compute[74337]:     <video>
Oct 23 21:45:33 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:45:33 user nova-compute[74337]:     </video>
Oct 23 21:45:33 user nova-compute[74337]:     <rng model="virtio">
Oct 23 21:45:33 user nova-compute[74337]:       <backend model="random">/dev/urandom</backend>
Oct 23 21:45:33 user nova-compute[74337]:     </rng>
Oct 23 21:45:33 user nova-compute[74337]:     <controller type="usb" index="0" model="none"/>
Oct 23 21:45:33 user nova-compute[74337]:     <memballoon model="virtio">
Oct 23 21:45:33 user nova-compute[74337]:       <stats period="10"/>
Oct 23 21:45:33 user nova-compute[74337]:     </memballoon>
Oct 23 21:45:33 user nova-compute[74337]:   </devices>
Oct 23 21:45:33 user nova-compute[74337]: </domain>
Oct 23 21:45:33 user nova-compute[74337]:  {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 21:45:33 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:45:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1666272220',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1666272220',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1666272220',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOgrDBH1CvXvIcgB0O0DFBLVjNN8t7kMW+CZkDWjghUBMBIGLgB/sbTKT/JxvB2pvW15F+DwsGGE4rA8tWUBZwr6Ds30gIIu/5Ft3ePzuZluMRXuj1d9BSI79URZ7oNHEw==',key_name='tempest-keypair-615180005',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb567547bd4941fb87435a841c9d17c4',ramdisk_id='',reservation_id='r-bip98ecx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-499971371',owner_user_name='tempest-TestVolumeBootPattern-499971371-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:45:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c3e635e8e5447138a7f2db11695574c',uuid=89e792eb-ad8f-4bb7-adac-315c3415cd6d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c23a4c6d-9fd0-4cd3-afa9-5ccf4520d90e", "address": "fa:16:3e:9e:8d:44", "network": {"id": "5a18e96f-a6eb-4989-9be3-154b54928b03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-507511840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb567547bd4941fb87435a841c9d17c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc23a4c6d-9f", "ovs_interfaceid": "c23a4c6d-9fd0-4cd3-afa9-5ccf4520d90e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 21:45:33 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Converting VIF {"id": "c23a4c6d-9fd0-4cd3-afa9-5ccf4520d90e", "address": "fa:16:3e:9e:8d:44", "network": {"id": "5a18e96f-a6eb-4989-9be3-154b54928b03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-507511840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb567547bd4941fb87435a841c9d17c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc23a4c6d-9f", "ovs_interfaceid": "c23a4c6d-9fd0-4cd3-afa9-5ccf4520d90e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:45:33 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:8d:44,bridge_name='br-int',has_traffic_filtering=True,id=c23a4c6d-9fd0-4cd3-afa9-5ccf4520d90e,network=Network(5a18e96f-a6eb-4989-9be3-154b54928b03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc23a4c6d-9f') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:45:33 user nova-compute[74337]: DEBUG os_vif [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:8d:44,bridge_name='br-int',has_traffic_filtering=True,id=c23a4c6d-9fd0-4cd3-afa9-5ccf4520d90e,network=Network(5a18e96f-a6eb-4989-9be3-154b54928b03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc23a4c6d-9f') {{(pid=74337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 21:45:33 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:45:33 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:45:33 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 21:45:33 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:45:33 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5b547323-c70d-591d-96da-68c7b185a41a', '_type': 'linux-noop'}}, row=False) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:45:33 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:45:33 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:45:33 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:45:33 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:45:33 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:45:33 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc23a4c6d-9f, may_exist=True, interface_attrs={}) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:45:33 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc23a4c6d-9f, col_values=(('qos', UUID('dc7db197-9e8e-4ef3-afd2-e8749146b8e2')),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:45:33 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc23a4c6d-9f, col_values=(('external_ids', {'iface-id': 'c23a4c6d-9fd0-4cd3-afa9-5ccf4520d90e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:8d:44', 'vm-uuid': '89e792eb-ad8f-4bb7-adac-315c3415cd6d'}),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:45:33 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:45:33 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:45:33 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:45:33 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:45:33 user nova-compute[74337]: INFO os_vif [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:8d:44,bridge_name='br-int',has_traffic_filtering=True,id=c23a4c6d-9fd0-4cd3-afa9-5ccf4520d90e,network=Network(5a18e96f-a6eb-4989-9be3-154b54928b03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc23a4c6d-9f')
Oct 23 21:45:33 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] No BDM found with device name vda, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 21:45:33 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] No VIF found with MAC fa:16:3e:9e:8d:44, not building metadata {{(pid=74337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 21:45:34 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] Instance destroyed successfully.
Oct 23 21:45:35 user nova-compute[74337]: DEBUG nova.compute.manager [req-6be66858-3a6f-46f7-ba01-d602442100d2 req-28f89074-6dce-4bd5-8dee-bbeffbb310b1 service nova] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] Received event network-vif-plugged-328722f1-b384-495c-8aea-81780b2d9ca1 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:45:35 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-6be66858-3a6f-46f7-ba01-d602442100d2 req-28f89074-6dce-4bd5-8dee-bbeffbb310b1 service nova] Acquiring lock "c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:45:35 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-6be66858-3a6f-46f7-ba01-d602442100d2 req-28f89074-6dce-4bd5-8dee-bbeffbb310b1 service nova] Lock "c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:45:35 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-6be66858-3a6f-46f7-ba01-d602442100d2 req-28f89074-6dce-4bd5-8dee-bbeffbb310b1 service nova] Lock "c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:45:35 user nova-compute[74337]: DEBUG nova.compute.manager [req-6be66858-3a6f-46f7-ba01-d602442100d2 req-28f89074-6dce-4bd5-8dee-bbeffbb310b1 service nova] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] No waiting events found dispatching network-vif-plugged-328722f1-b384-495c-8aea-81780b2d9ca1 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:45:35 user nova-compute[74337]: WARNING nova.compute.manager [req-6be66858-3a6f-46f7-ba01-d602442100d2 req-28f89074-6dce-4bd5-8dee-bbeffbb310b1 service nova] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] Received unexpected event network-vif-plugged-328722f1-b384-495c-8aea-81780b2d9ca1 for instance with vm_state rescued and task_state unrescuing.
Oct 23 21:45:36 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:45:36 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:45:36 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:45:36 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:45:36 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:45:36 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:45:36 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:45:36 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:45:36 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:45:36 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:45:36 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:45:36 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:45:37 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:45:37 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:45:37 user nova-compute[74337]: DEBUG nova.compute.manager [req-ea96bbd4-24e3-43b4-b293-5386dea19c59 req-c7348691-6826-457d-93b1-a3fd22de82cf service nova] [instance: 89e792eb-ad8f-4bb7-adac-315c3415cd6d] Received event network-vif-plugged-c23a4c6d-9fd0-4cd3-afa9-5ccf4520d90e {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:45:37 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ea96bbd4-24e3-43b4-b293-5386dea19c59 req-c7348691-6826-457d-93b1-a3fd22de82cf service nova] Acquiring lock "89e792eb-ad8f-4bb7-adac-315c3415cd6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:45:37 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ea96bbd4-24e3-43b4-b293-5386dea19c59 req-c7348691-6826-457d-93b1-a3fd22de82cf service nova] Lock "89e792eb-ad8f-4bb7-adac-315c3415cd6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:45:37 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ea96bbd4-24e3-43b4-b293-5386dea19c59 req-c7348691-6826-457d-93b1-a3fd22de82cf service nova] Lock "89e792eb-ad8f-4bb7-adac-315c3415cd6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:45:37 user nova-compute[74337]: DEBUG nova.compute.manager [req-ea96bbd4-24e3-43b4-b293-5386dea19c59 req-c7348691-6826-457d-93b1-a3fd22de82cf service nova] [instance: 89e792eb-ad8f-4bb7-adac-315c3415cd6d] No waiting events found dispatching network-vif-plugged-c23a4c6d-9fd0-4cd3-afa9-5ccf4520d90e {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:45:37 user nova-compute[74337]: WARNING nova.compute.manager [req-ea96bbd4-24e3-43b4-b293-5386dea19c59 req-c7348691-6826-457d-93b1-a3fd22de82cf service nova] [instance: 89e792eb-ad8f-4bb7-adac-315c3415cd6d] Received unexpected event network-vif-plugged-c23a4c6d-9fd0-4cd3-afa9-5ccf4520d90e for instance with vm_state building and task_state spawning.
Oct 23 21:45:37 user nova-compute[74337]: DEBUG nova.compute.manager [req-ea96bbd4-24e3-43b4-b293-5386dea19c59 req-c7348691-6826-457d-93b1-a3fd22de82cf service nova] [instance: 89e792eb-ad8f-4bb7-adac-315c3415cd6d] Received event network-vif-plugged-c23a4c6d-9fd0-4cd3-afa9-5ccf4520d90e {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:45:37 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ea96bbd4-24e3-43b4-b293-5386dea19c59 req-c7348691-6826-457d-93b1-a3fd22de82cf service nova] Acquiring lock "89e792eb-ad8f-4bb7-adac-315c3415cd6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:45:37 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ea96bbd4-24e3-43b4-b293-5386dea19c59 req-c7348691-6826-457d-93b1-a3fd22de82cf service nova] Lock "89e792eb-ad8f-4bb7-adac-315c3415cd6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:45:37 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ea96bbd4-24e3-43b4-b293-5386dea19c59 req-c7348691-6826-457d-93b1-a3fd22de82cf service nova] Lock "89e792eb-ad8f-4bb7-adac-315c3415cd6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:45:37 user nova-compute[74337]: DEBUG nova.compute.manager [req-ea96bbd4-24e3-43b4-b293-5386dea19c59 req-c7348691-6826-457d-93b1-a3fd22de82cf service nova] [instance: 89e792eb-ad8f-4bb7-adac-315c3415cd6d] No waiting events found dispatching network-vif-plugged-c23a4c6d-9fd0-4cd3-afa9-5ccf4520d90e {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:45:37 user nova-compute[74337]: WARNING nova.compute.manager [req-ea96bbd4-24e3-43b4-b293-5386dea19c59 req-c7348691-6826-457d-93b1-a3fd22de82cf service nova] [instance: 89e792eb-ad8f-4bb7-adac-315c3415cd6d] Received unexpected event network-vif-plugged-c23a4c6d-9fd0-4cd3-afa9-5ccf4520d90e for instance with vm_state building and task_state spawning.
Oct 23 21:45:37 user nova-compute[74337]: DEBUG nova.compute.manager [req-ea96bbd4-24e3-43b4-b293-5386dea19c59 req-c7348691-6826-457d-93b1-a3fd22de82cf service nova] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] Received event network-vif-plugged-328722f1-b384-495c-8aea-81780b2d9ca1 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:45:37 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ea96bbd4-24e3-43b4-b293-5386dea19c59 req-c7348691-6826-457d-93b1-a3fd22de82cf service nova] Acquiring lock "c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:45:37 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ea96bbd4-24e3-43b4-b293-5386dea19c59 req-c7348691-6826-457d-93b1-a3fd22de82cf service nova] Lock "c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:45:37 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ea96bbd4-24e3-43b4-b293-5386dea19c59 req-c7348691-6826-457d-93b1-a3fd22de82cf service nova] Lock "c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:45:37 user nova-compute[74337]: DEBUG nova.compute.manager [req-ea96bbd4-24e3-43b4-b293-5386dea19c59 req-c7348691-6826-457d-93b1-a3fd22de82cf service nova] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] No waiting events found dispatching network-vif-plugged-328722f1-b384-495c-8aea-81780b2d9ca1 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:45:37 user nova-compute[74337]: WARNING nova.compute.manager [req-ea96bbd4-24e3-43b4-b293-5386dea19c59 req-c7348691-6826-457d-93b1-a3fd22de82cf service nova] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] Received unexpected event network-vif-plugged-328722f1-b384-495c-8aea-81780b2d9ca1 for instance with vm_state rescued and task_state unrescuing.
Oct 23 21:45:37 user nova-compute[74337]: DEBUG nova.compute.manager [req-ea96bbd4-24e3-43b4-b293-5386dea19c59 req-c7348691-6826-457d-93b1-a3fd22de82cf service nova] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] Received event network-vif-plugged-328722f1-b384-495c-8aea-81780b2d9ca1 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:45:37 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ea96bbd4-24e3-43b4-b293-5386dea19c59 req-c7348691-6826-457d-93b1-a3fd22de82cf service nova] Acquiring lock "c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:45:37 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ea96bbd4-24e3-43b4-b293-5386dea19c59 req-c7348691-6826-457d-93b1-a3fd22de82cf service nova] Lock "c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:45:37 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ea96bbd4-24e3-43b4-b293-5386dea19c59 req-c7348691-6826-457d-93b1-a3fd22de82cf service nova] Lock "c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:45:37 user nova-compute[74337]: DEBUG nova.compute.manager [req-ea96bbd4-24e3-43b4-b293-5386dea19c59 req-c7348691-6826-457d-93b1-a3fd22de82cf service nova] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] No waiting events found dispatching network-vif-plugged-328722f1-b384-495c-8aea-81780b2d9ca1 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:45:37 user nova-compute[74337]: WARNING nova.compute.manager [req-ea96bbd4-24e3-43b4-b293-5386dea19c59 req-c7348691-6826-457d-93b1-a3fd22de82cf service nova] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] Received unexpected event network-vif-plugged-328722f1-b384-495c-8aea-81780b2d9ca1 for instance with vm_state rescued and task_state unrescuing.
Oct 23 21:45:38 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:45:38 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:45:39 user nova-compute[74337]: DEBUG nova.compute.manager [None req-8539b17e-0bd5-4a83-86dc-a25edd7fc480 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] Checking state {{(pid=74337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 21:45:39 user nova-compute[74337]: DEBUG nova.compute.manager [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 89e792eb-ad8f-4bb7-adac-315c3415cd6d] Instance event wait completed in 0 seconds for  {{(pid=74337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 21:45:39 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 89e792eb-ad8f-4bb7-adac-315c3415cd6d] Guest created on hypervisor {{(pid=74337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 21:45:39 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: 89e792eb-ad8f-4bb7-adac-315c3415cd6d] Instance spawned successfully.
Oct 23 21:45:39 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 89e792eb-ad8f-4bb7-adac-315c3415cd6d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 21:45:39 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 89e792eb-ad8f-4bb7-adac-315c3415cd6d] Found default for hw_cdrom_bus of ide {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:45:39 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 89e792eb-ad8f-4bb7-adac-315c3415cd6d] Found default for hw_disk_bus of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:45:39 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 89e792eb-ad8f-4bb7-adac-315c3415cd6d] Found default for hw_input_bus of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:45:39 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 89e792eb-ad8f-4bb7-adac-315c3415cd6d] Found default for hw_pointer_model of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:45:39 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 89e792eb-ad8f-4bb7-adac-315c3415cd6d] Found default for hw_video_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:45:39 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 89e792eb-ad8f-4bb7-adac-315c3415cd6d] Found default for hw_vif_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:45:39 user nova-compute[74337]: INFO nova.compute.manager [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 89e792eb-ad8f-4bb7-adac-315c3415cd6d] Took 7.47 seconds to spawn the instance on the hypervisor.
Oct 23 21:45:39 user nova-compute[74337]: DEBUG nova.compute.manager [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 89e792eb-ad8f-4bb7-adac-315c3415cd6d] Checking state {{(pid=74337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 21:45:39 user nova-compute[74337]: INFO nova.compute.manager [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 89e792eb-ad8f-4bb7-adac-315c3415cd6d] Took 26.55 seconds to build instance.
Oct 23 21:45:39 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-c9c01098-a0aa-451d-824a-f5b2cb26c21a tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "89e792eb-ad8f-4bb7-adac-315c3415cd6d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 26.668s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:45:40 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bbe4bc29-a759-454e-9bdf-0802b617f2d8 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Calling os-brick to attach iSCSI Volume {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 21:45:40 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbe4bc29-a759-454e-9bdf-0802b617f2d8 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FWrOaikx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:45:40 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-bbe4bc29-a759-454e-9bdf-0802b617f2d8 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:45:40 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-bbe4bc29-a759-454e-9bdf-0802b617f2d8 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:45:40 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-bbe4bc29-a759-454e-9bdf-0802b617f2d8 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:45:40 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-bbe4bc29-a759-454e-9bdf-0802b617f2d8 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:45:40 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-bbe4bc29-a759-454e-9bdf-0802b617f2d8 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:45:40 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-bbe4bc29-a759-454e-9bdf-0802b617f2d8 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:45:40 user nova-compute[74337]: INFO os_brick.initiator.connectors.iscsi [None req-bbe4bc29-a759-454e-9bdf-0802b617f2d8 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 21:45:40 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c -p 172.16.0.220:3260 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:45:40 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:45:40 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[210deb60-8ffe-4819-8152-cd6b5658866a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:45:40 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbe4bc29-a759-454e-9bdf-0802b617f2d8 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 21:45:40 user nova-compute[74337]:  {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:45:40 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c -p 172.16.0.220:3260 --interface default --op new {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:45:40 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:45:40 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[44f94a69-9388-4371-bd49-540d592629cc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c] added\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:45:40 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbe4bc29-a759-454e-9bdf-0802b617f2d8 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c] added
Oct 23 21:45:40 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:45:40 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:45:40 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:45:40 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[504e1cee-446d-4e4c-ad47-cf000c1e5aff]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:45:40 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbe4bc29-a759-454e-9bdf-0802b617f2d8 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:45:40 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:45:40 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:45:40 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af601de-035e-4e7e-a08d-fc4843c5214e]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:45:40 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbe4bc29-a759-454e-9bdf-0802b617f2d8 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:45:40 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FWrOaikx {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:45:40 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FWrOaikx" returned: 0 in 0.028s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:45:40 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5ebcf0e-673d-4f4c-9f12-98a8953c281d]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:45:40 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbe4bc29-a759-454e-9bdf-0802b617f2d8 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FWrOaikx'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:45:40 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:45:40 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.033s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:45:40 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[385f82d8-da12-48b6-971b-847a25d2a7e9]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:45:40 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbe4bc29-a759-454e-9bdf-0802b617f2d8 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:45:40 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:45:40 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:45:40 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bf1b78f-26d1-4422-9b05-6a4f878180ff]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83240a3d-a866-4ba1-9d61-472c1d1a86f7 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:45:40 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbe4bc29-a759-454e-9bdf-0802b617f2d8 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:45:40 user nova-compute[74337]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac (non-flash)
Oct 23 21:45:40 user nova-compute[74337]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83240a3d-a866-4ba1-9d61-472c1d1a86f7 (non-flash)
Oct 23 21:45:40 user nova-compute[74337]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c (non-flash)
Oct 23 21:45:40 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:45:40 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbe4bc29-a759-454e-9bdf-0802b617f2d8 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:45:40 user nova-compute[74337]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac (non-flash)
Oct 23 21:45:40 user nova-compute[74337]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83240a3d-a866-4ba1-9d61-472c1d1a86f7 (non-flash)
Oct 23 21:45:40 user nova-compute[74337]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c (non-flash)
Oct 23 21:45:40 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:45:40 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c -p 172.16.0.220:3260 --login {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:45:40 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:45:40 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[389145c4-c680-4b98-b67f-6c64973781ee]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:45:40 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbe4bc29-a759-454e-9bdf-0802b617f2d8 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c, portal: 172.16.0.220,3260]
Oct 23 21:45:40 user nova-compute[74337]: Login to [iface: default, target: iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c, portal: 172.16.0.220,3260] successful.
Oct 23 21:45:40 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:45:40 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:45:40 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:45:40 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcd8b00c-8577-4738-89dc-22d0c4320e95]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:45:40 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbe4bc29-a759-454e-9bdf-0802b617f2d8 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:45:40 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:45:40 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:45:40 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c70d36d-47e9-4a2b-ac18-37162226c5c3]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83240a3d-a866-4ba1-9d61-472c1d1a86f7 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:45:40 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbe4bc29-a759-454e-9bdf-0802b617f2d8 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:45:40 user nova-compute[74337]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac (non-flash)
Oct 23 21:45:40 user nova-compute[74337]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83240a3d-a866-4ba1-9d61-472c1d1a86f7 (non-flash)
Oct 23 21:45:40 user nova-compute[74337]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c (non-flash)
Oct 23 21:45:40 user nova-compute[74337]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c (non-flash)
Oct 23 21:45:40 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:45:40 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbe4bc29-a759-454e-9bdf-0802b617f2d8 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:45:40 user nova-compute[74337]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac (non-flash)
Oct 23 21:45:40 user nova-compute[74337]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83240a3d-a866-4ba1-9d61-472c1d1a86f7 (non-flash)
Oct 23 21:45:40 user nova-compute[74337]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c (non-flash)
Oct 23 21:45:40 user nova-compute[74337]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c (non-flash)
Oct 23 21:45:40 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:45:40 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-bbe4bc29-a759-454e-9bdf-0802b617f2d8 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.494s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:45:40 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbe4bc29-a759-454e-9bdf-0802b617f2d8 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Connected to 172.16.0.220:3260 {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 21:45:40 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-bbe4bc29-a759-454e-9bdf-0802b617f2d8 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] HCTL ('37', '-', '-', 0) found on session 27 with lun 0 {{(pid=74337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 21:45:40 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-bbe4bc29-a759-454e-9bdf-0802b617f2d8 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 21:45:40 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:45:40 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.026s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:45:40 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b903e71b-a722-40f7-b9f8-e3013d61be13]: (4, ('- - 0', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:45:40 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-bbe4bc29-a759-454e-9bdf-0802b617f2d8 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Searching for a device in session 27 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 21:45:40 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbe4bc29-a759-454e-9bdf-0802b617f2d8 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FWrOaikx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 21:45:41 user nova-compute[74337]: DEBUG nova.objects.instance [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lazy-loading 'flavor' on Instance uuid 56a4b932-486d-4b8d-9616-99e75592432a {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:45:41 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Acquiring lock "refresh_cache-56a4b932-486d-4b8d-9616-99e75592432a" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:45:41 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Acquired lock "refresh_cache-56a4b932-486d-4b8d-9616-99e75592432a" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:45:41 user nova-compute[74337]: DEBUG nova.network.neutron [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Building network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 21:45:41 user nova-compute[74337]: DEBUG nova.objects.instance [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lazy-loading 'info_cache' on Instance uuid 56a4b932-486d-4b8d-9616-99e75592432a {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:45:41 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-bbe4bc29-a759-454e-9bdf-0802b617f2d8 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.541s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:45:41 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbe4bc29-a759-454e-9bdf-0802b617f2d8 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] <== connect_volume: return (1542ms) {'type': 'block', 'scsi_wwn': '26134333739373734', 'path': '/dev/sdf'} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:45:41 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bbe4bc29-a759-454e-9bdf-0802b617f2d8 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26134333739373734', 'path': '/dev/sdf'} {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 21:45:41 user nova-compute[74337]: DEBUG nova.objects.instance [None req-bbe4bc29-a759-454e-9bdf-0802b617f2d8 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lazy-loading 'flavor' on Instance uuid 195a4056-3254-4558-b2f5-299bcd4af07c {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:45:41 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-bbe4bc29-a759-454e-9bdf-0802b617f2d8 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 21:45:41 user nova-compute[74337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 21:45:41 user nova-compute[74337]:   <source dev="/dev/sdf"/>
Oct 23 21:45:41 user nova-compute[74337]:   <target dev="vdb" bus="virtio"/>
Oct 23 21:45:41 user nova-compute[74337]:   <serial>9a863deb-8b0f-4e44-b7d7-16ace509f43c</serial>
Oct 23 21:45:41 user nova-compute[74337]: </disk>
Oct 23 21:45:41 user nova-compute[74337]:  {{(pid=74337) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 21:45:41 user nova-compute[74337]: DEBUG nova.objects.base [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Object Instance<56a4b932-486d-4b8d-9616-99e75592432a> lazy-loaded attributes: flavor,info_cache {{(pid=74337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 21:45:42 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-bbe4bc29-a759-454e-9bdf-0802b617f2d8 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] No BDM found with device name vda, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 21:45:42 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-bbe4bc29-a759-454e-9bdf-0802b617f2d8 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 21:45:42 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-bbe4bc29-a759-454e-9bdf-0802b617f2d8 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] No VIF found with MAC fa:16:3e:26:a4:b5, not building metadata {{(pid=74337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 21:45:42 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-bbe4bc29-a759-454e-9bdf-0802b617f2d8 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lock "195a4056-3254-4558-b2f5-299bcd4af07c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.270s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:45:42 user nova-compute[74337]: DEBUG nova.network.neutron [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Updating instance_info_cache with network_info: [{"id": "5df71ce2-a116-44b3-856b-c0de0da5dcd6", "address": "fa:16:3e:20:cc:6f", "network": {"id": "fe0a9f00-e17b-4064-96d2-fd1cc848afb2", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1294741219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96dc585a51343db94529e22adbd6ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5df71ce2-a1", "ovs_interfaceid": "5df71ce2-a116-44b3-856b-c0de0da5dcd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:45:42 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Releasing lock "refresh_cache-56a4b932-486d-4b8d-9616-99e75592432a" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:45:42 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Instance destroyed successfully.
Oct 23 21:45:42 user nova-compute[74337]: DEBUG nova.objects.instance [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lazy-loading 'resources' on Instance uuid 56a4b932-486d-4b8d-9616-99e75592432a {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:45:42 user nova-compute[74337]: DEBUG nova.objects.base [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Object Instance<56a4b932-486d-4b8d-9616-99e75592432a> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 21:45:42 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:41:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1348448759',display_name='tempest-AttachVolumeTestJSON-server-1348448759',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1348448759',id=18,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOSyI2UfSbOjGClrd6s5yGjykCHAlq4p3VgQcvKHgSPXIAoK0vvVLu+A6LT9ePnSPyc9urTg/MN9ZHJ02yogPWhYeBoMR8cfZQeMkKqZLPuaXXx5keLozdFismgRTGZYug==',key_name='tempest-keypair-1796008721',keypairs=<?>,launch_index=0,launched_at=2023-10-23T21:41:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='b96dc585a51343db94529e22adbd6ef3',ramdisk_id='',reservation_id='r-ydiij502',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-786463768',owner_user_name='tempest-AttachVolumeTestJSON-786463768-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T21:43:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c82d267bc4d142f8b48c66ffab721618',uuid=56a4b932-486d-4b8d-9616-99e75592432a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "5df71ce2-a116-44b3-856b-c0de0da5dcd6", "address": "fa:16:3e:20:cc:6f", "network": {"id": "fe0a9f00-e17b-4064-96d2-fd1cc848afb2", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1294741219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96dc585a51343db94529e22adbd6ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5df71ce2-a1", "ovs_interfaceid": "5df71ce2-a116-44b3-856b-c0de0da5dcd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 21:45:42 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Converting VIF {"id": "5df71ce2-a116-44b3-856b-c0de0da5dcd6", "address": "fa:16:3e:20:cc:6f", "network": {"id": "fe0a9f00-e17b-4064-96d2-fd1cc848afb2", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1294741219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96dc585a51343db94529e22adbd6ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5df71ce2-a1", "ovs_interfaceid": "5df71ce2-a116-44b3-856b-c0de0da5dcd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:45:42 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:cc:6f,bridge_name='br-int',has_traffic_filtering=True,id=5df71ce2-a116-44b3-856b-c0de0da5dcd6,network=Network(fe0a9f00-e17b-4064-96d2-fd1cc848afb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5df71ce2-a1') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:45:42 user nova-compute[74337]: DEBUG os_vif [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:cc:6f,bridge_name='br-int',has_traffic_filtering=True,id=5df71ce2-a116-44b3-856b-c0de0da5dcd6,network=Network(fe0a9f00-e17b-4064-96d2-fd1cc848afb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5df71ce2-a1') {{(pid=74337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 21:45:42 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:45:42 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5df71ce2-a1, bridge=br-int, if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:45:42 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:45:42 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:45:42 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:45:42 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ead21567-8d63-4cdd-9f00-6b01011fa225) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:45:42 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:45:42 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:45:42 user nova-compute[74337]: INFO os_vif [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:cc:6f,bridge_name='br-int',has_traffic_filtering=True,id=5df71ce2-a116-44b3-856b-c0de0da5dcd6,network=Network(fe0a9f00-e17b-4064-96d2-fd1cc848afb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5df71ce2-a1')
Oct 23 21:45:42 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] calling os-brick to detach iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 21:45:42 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, {'target_iqn': 'iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vUTnNRCq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:45:42 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:45:42 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:45:42 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:45:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:45:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:45:42 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[912fdd38-3d36-437f-9a90-6bd697bff43e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:83240a3d-a866-4ba1-9d61-472c1d1a86f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:45:42 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 21:45:42 user nova-compute[74337]: No targets found.
Oct 23 21:45:42 user nova-compute[74337]: iSNS:
Oct 23 21:45:42 user nova-compute[74337]: No targets found.
Oct 23 21:45:42 user nova-compute[74337]: STATIC:
Oct 23 21:45:42 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4
Oct 23 21:45:42 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:45:42 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:45:42 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c
Oct 23 21:45:42 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:45:42 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:45:42 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac
Oct 23 21:45:42 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:45:42 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:45:42 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c
Oct 23 21:45:42 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:45:42 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:45:42 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:83240a3d-a866-4ba1-9d61-472c1d1a86f7
Oct 23 21:45:42 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:45:42 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:45:42 user nova-compute[74337]: FIRMWARE:
Oct 23 21:45:42 user nova-compute[74337]: No targets found.
Oct 23 21:45:42 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:45:42 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 21:45:42 user nova-compute[74337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 21:45:42 user nova-compute[74337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 21:45:42 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac', 0)] {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 21:45:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:45:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:45:42 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b833486-88ed-426d-b020-f3c644c51c4b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83240a3d-a866-4ba1-9d61-472c1d1a86f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:45:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:45:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:45:42 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1450f48-192e-449b-a47f-2fccc2f0c74b]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83240a3d-a866-4ba1-9d61-472c1d1a86f7 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:45:42 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:45:42 user nova-compute[74337]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac (non-flash)
Oct 23 21:45:42 user nova-compute[74337]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83240a3d-a866-4ba1-9d61-472c1d1a86f7 (non-flash)
Oct 23 21:45:42 user nova-compute[74337]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c (non-flash)
Oct 23 21:45:42 user nova-compute[74337]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c (non-flash)
Oct 23 21:45:42 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:45:42 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:45:42 user nova-compute[74337]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac (non-flash)
Oct 23 21:45:42 user nova-compute[74337]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83240a3d-a866-4ba1-9d61-472c1d1a86f7 (non-flash)
Oct 23 21:45:42 user nova-compute[74337]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c (non-flash)
Oct 23 21:45:42 user nova-compute[74337]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c (non-flash)
Oct 23 21:45:42 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:45:42 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5eec385e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac'): ({'sdb'}, set())}) {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 21:45:42 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Removing single pathed devices sdb {{(pid=74337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 21:45:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:45:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:45:42 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[33696f52-dd2b-48f5-adc8-b36c10fca500]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:45:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:45:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:45:42 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf0341bc-3ecf-4cc0-899c-df98d7501722]: (4, ('ok\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:45:42 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Flushing IO for device /dev/sdb {{(pid=74337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 21:45:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:45:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:45:42 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b648ea2-fdae-48e3-b520-ab47b97fb8b5]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:45:42 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 21:45:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:45:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:45:42 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ff15073-e314-4f01-b366-c1e31000f372]: (4, ('1', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:45:42 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 21:45:42 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] SCSI volumes sdb have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 21:45:42 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac')] {{(pid=74337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 21:45:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:45:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:45:42 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[25875fda-80f0-43b3-804a-0697f7a67dd8]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:45:42 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:45:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac -p 172.16.0.220:3260 --logout {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:45:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:45:42 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c53ce79-18f4-4333-9d44-eaadb25439f9]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:45:42 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac, portal: 172.16.0.220,3260]
Oct 23 21:45:42 user nova-compute[74337]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac, portal: 172.16.0.220,3260] successful.
Oct 23 21:45:42 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:45:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac -p 172.16.0.220:3260 --op delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:45:43 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:45:43 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8465b56-b11d-4893-98da-7227e0d6d7cb]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:45:43 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:45:43 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.358s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:45:43 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] <== disconnect_volume: return (360ms) None {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:45:43 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Disconnected iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 21:45:43 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Start _get_guest_xml network_info=[{"id": "5df71ce2-a116-44b3-856b-c0de0da5dcd6", "address": "fa:16:3e:20:cc:6f", "network": {"id": "fe0a9f00-e17b-4064-96d2-fd1cc848afb2", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1294741219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96dc585a51343db94529e22adbd6ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5df71ce2-a1", "ovs_interfaceid": "5df71ce2-a116-44b3-856b-c0de0da5dcd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=d859d89d-998d-4109-b26a-0d6e28152932,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'image_id': 'd859d89d-998d-4109-b26a-0d6e28152932'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '989c5846-2921-45f4-8c1c-504bb16ccb4e', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vUTnNRCq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '56a4b932-486d-4b8d-9616-99e75592432a', 'attached_at': '', 'detached_at': '', 'volume_id': 'a8e8efe4-f74d-477f-ad38-999c514047ac', 'serial': 'a8e8efe4-f74d-477f-ad38-999c514047ac'}, 'guest_format': None, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 21:45:43 user nova-compute[74337]: DEBUG nova.objects.instance [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lazy-loading 'numa_topology' on Instance uuid 56a4b932-486d-4b8d-9616-99e75592432a {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:45:43 user nova-compute[74337]: DEBUG nova.objects.base [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Object Instance<56a4b932-486d-4b8d-9616-99e75592432a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 21:45:43 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:45:43 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:45:43 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 21:45:43 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] CPU controller missing on host. {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 21:45:43 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 21:45:43 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] CPU controller found on host. {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 21:45:43 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 21:45:43 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T21:29:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=d859d89d-998d-4109-b26a-0d6e28152932,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 21:45:43 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Flavor limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 21:45:43 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Image limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 21:45:43 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Flavor pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 21:45:43 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Image pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 21:45:43 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 21:45:43 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 21:45:43 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 21:45:43 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Got 1 possible topologies {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 21:45:43 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 21:45:43 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 21:45:43 user nova-compute[74337]: DEBUG nova.objects.instance [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lazy-loading 'vcpu_model' on Instance uuid 56a4b932-486d-4b8d-9616-99e75592432a {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:45:43 user nova-compute[74337]: DEBUG nova.objects.base [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Object Instance<56a4b932-486d-4b8d-9616-99e75592432a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 21:45:43 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Calling os-brick to attach iSCSI Volume {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 21:45:43 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vUTnNRCq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:45:43 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:45:43 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:45:43 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:45:43 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:45:43 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:45:43 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:45:43 user nova-compute[74337]: INFO os_brick.initiator.connectors.iscsi [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 21:45:43 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac -p 172.16.0.220:3260 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:45:43 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:45:43 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3dfe5fe-495c-41d5-9def-2485360d33eb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:45:43 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 21:45:43 user nova-compute[74337]:  {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:45:43 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac -p 172.16.0.220:3260 --interface default --op new {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:45:43 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:45:43 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e6caa4-bf05-4a59-a260-99c36b456b4a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac] added\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:45:43 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac] added
Oct 23 21:45:43 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:45:43 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:45:43 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:45:43 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc03b3c9-d8ea-455c-a15c-95c6a33a0baa]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:45:43 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:45:43 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:45:43 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:45:43 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccc66bd6-577c-48cc-8f23-fbe48ab31ad8]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:45:43 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:45:43 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vUTnNRCq {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:45:43 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vUTnNRCq" returned: 0 in 0.024s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:45:43 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e29905-1317-40da-9695-464221563901]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:45:43 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vUTnNRCq'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:45:43 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:45:43 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:45:43 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce4293af-f7ad-47db-abc8-d4310e4445a8]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:45:43 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:45:43 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:45:43 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:45:43 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f9a091-0a5e-4bbe-963a-6e987534d1c4]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83240a3d-a866-4ba1-9d61-472c1d1a86f7 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:45:43 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:45:43 user nova-compute[74337]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83240a3d-a866-4ba1-9d61-472c1d1a86f7 (non-flash)
Oct 23 21:45:43 user nova-compute[74337]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c (non-flash)
Oct 23 21:45:43 user nova-compute[74337]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c (non-flash)
Oct 23 21:45:43 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:45:43 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:45:43 user nova-compute[74337]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83240a3d-a866-4ba1-9d61-472c1d1a86f7 (non-flash)
Oct 23 21:45:43 user nova-compute[74337]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c (non-flash)
Oct 23 21:45:43 user nova-compute[74337]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c (non-flash)
Oct 23 21:45:43 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:45:43 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac -p 172.16.0.220:3260 --login {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:45:43 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:45:43 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a30c54ae-7ffc-4315-9035-71ebb64f571e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:45:43 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac, portal: 172.16.0.220,3260]
Oct 23 21:45:43 user nova-compute[74337]: Login to [iface: default, target: iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac, portal: 172.16.0.220,3260] successful.
Oct 23 21:45:43 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:45:43 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:45:43 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:45:43 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d558420f-28cf-41be-b110-c7ebdd7632b8]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:45:43 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:45:43 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:45:43 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:45:43 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b6d6f71-bf39-4be3-a54a-77e3eea5c3a3]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83240a3d-a866-4ba1-9d61-472c1d1a86f7 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:45:43 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:45:43 user nova-compute[74337]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83240a3d-a866-4ba1-9d61-472c1d1a86f7 (non-flash)
Oct 23 21:45:43 user nova-compute[74337]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c (non-flash)
Oct 23 21:45:43 user nova-compute[74337]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c (non-flash)
Oct 23 21:45:43 user nova-compute[74337]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac (non-flash)
Oct 23 21:45:43 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:45:43 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:45:43 user nova-compute[74337]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83240a3d-a866-4ba1-9d61-472c1d1a86f7 (non-flash)
Oct 23 21:45:43 user nova-compute[74337]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c (non-flash)
Oct 23 21:45:43 user nova-compute[74337]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c (non-flash)
Oct 23 21:45:43 user nova-compute[74337]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac (non-flash)
Oct 23 21:45:43 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:45:43 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.354s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:45:43 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Connected to 172.16.0.220:3260 {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 21:45:43 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] HCTL ('33', '-', '-', 0) found on session 28 with lun 0 {{(pid=74337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 21:45:43 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 21:45:43 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:45:43 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:45:43 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f23185-25f6-4b3a-a3d0-d6cf02d08cc9]: (4, ('- - 0', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:45:43 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Searching for a device in session 28 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 21:45:43 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vUTnNRCq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 21:45:43 user nova-compute[74337]: INFO nova.compute.manager [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Rebuilding instance
Oct 23 21:45:43 user nova-compute[74337]: DEBUG nova.compute.manager [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Checking state {{(pid=74337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 21:45:43 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:45:43 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:45:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:45:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:45:44 user nova-compute[74337]: DEBUG nova.compute.manager [req-14a0451b-e8fe-4c83-89a7-b40122184bb0 req-547817f2-b443-4176-9eab-3598d5ca3aae service nova] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Received event network-vif-unplugged-efec7d56-28cb-4da2-b6f7-6e9777d3377b {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:45:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-14a0451b-e8fe-4c83-89a7-b40122184bb0 req-547817f2-b443-4176-9eab-3598d5ca3aae service nova] Acquiring lock "195a4056-3254-4558-b2f5-299bcd4af07c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:45:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-14a0451b-e8fe-4c83-89a7-b40122184bb0 req-547817f2-b443-4176-9eab-3598d5ca3aae service nova] Lock "195a4056-3254-4558-b2f5-299bcd4af07c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:45:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-14a0451b-e8fe-4c83-89a7-b40122184bb0 req-547817f2-b443-4176-9eab-3598d5ca3aae service nova] Lock "195a4056-3254-4558-b2f5-299bcd4af07c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:45:44 user nova-compute[74337]: DEBUG nova.compute.manager [req-14a0451b-e8fe-4c83-89a7-b40122184bb0 req-547817f2-b443-4176-9eab-3598d5ca3aae service nova] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] No waiting events found dispatching network-vif-unplugged-efec7d56-28cb-4da2-b6f7-6e9777d3377b {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:45:44 user nova-compute[74337]: WARNING nova.compute.manager [req-14a0451b-e8fe-4c83-89a7-b40122184bb0 req-547817f2-b443-4176-9eab-3598d5ca3aae service nova] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Received unexpected event network-vif-unplugged-efec7d56-28cb-4da2-b6f7-6e9777d3377b for instance with vm_state active and task_state rebuilding.
Oct 23 21:45:44 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.404s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:45:44 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] <== connect_volume: return (1406ms) {'type': 'block', 'scsi_wwn': '26535623437663462', 'path': '/dev/sdb'} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:45:44 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26535623437663462', 'path': '/dev/sdb'} {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 21:45:44 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:41:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1348448759',display_name='tempest-AttachVolumeTestJSON-server-1348448759',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1348448759',id=18,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOSyI2UfSbOjGClrd6s5yGjykCHAlq4p3VgQcvKHgSPXIAoK0vvVLu+A6LT9ePnSPyc9urTg/MN9ZHJ02yogPWhYeBoMR8cfZQeMkKqZLPuaXXx5keLozdFismgRTGZYug==',key_name='tempest-keypair-1796008721',keypairs=<?>,launch_index=0,launched_at=2023-10-23T21:41:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='b96dc585a51343db94529e22adbd6ef3',ramdisk_id='',reservation_id='r-ydiij502',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-786463768',owner_user_name='tempest-AttachVolumeTestJSON-786463768-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T21:43:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c82d267bc4d142f8b48c66ffab721618',uuid=56a4b932-486d-4b8d-9616-99e75592432a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "5df71ce2-a116-44b3-856b-c0de0da5dcd6", "address": "fa:16:3e:20:cc:6f", "network": {"id": "fe0a9f00-e17b-4064-96d2-fd1cc848afb2", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1294741219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96dc585a51343db94529e22adbd6ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5df71ce2-a1", "ovs_interfaceid": "5df71ce2-a116-44b3-856b-c0de0da5dcd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 21:45:44 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Converting VIF {"id": "5df71ce2-a116-44b3-856b-c0de0da5dcd6", "address": "fa:16:3e:20:cc:6f", "network": {"id": "fe0a9f00-e17b-4064-96d2-fd1cc848afb2", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1294741219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96dc585a51343db94529e22adbd6ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5df71ce2-a1", "ovs_interfaceid": "5df71ce2-a116-44b3-856b-c0de0da5dcd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:45:44 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:cc:6f,bridge_name='br-int',has_traffic_filtering=True,id=5df71ce2-a116-44b3-856b-c0de0da5dcd6,network=Network(fe0a9f00-e17b-4064-96d2-fd1cc848afb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5df71ce2-a1') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:45:44 user nova-compute[74337]: DEBUG nova.objects.instance [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lazy-loading 'pci_devices' on Instance uuid 56a4b932-486d-4b8d-9616-99e75592432a {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:45:44 user nova-compute[74337]: DEBUG nova.objects.base [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Object Instance<56a4b932-486d-4b8d-9616-99e75592432a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 21:45:44 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] End _get_guest_xml xml=<domain type="kvm">
Oct 23 21:45:44 user nova-compute[74337]:   <uuid>56a4b932-486d-4b8d-9616-99e75592432a</uuid>
Oct 23 21:45:44 user nova-compute[74337]:   <name>instance-00000012</name>
Oct 23 21:45:44 user nova-compute[74337]:   <memory>524288</memory>
Oct 23 21:45:44 user nova-compute[74337]:   <vcpu>1</vcpu>
Oct 23 21:45:44 user nova-compute[74337]:   <metadata>
Oct 23 21:45:44 user nova-compute[74337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 21:45:44 user nova-compute[74337]:       <nova:package version="0.0.0"/>
Oct 23 21:45:44 user nova-compute[74337]:       <nova:name>tempest-AttachVolumeTestJSON-server-1348448759</nova:name>
Oct 23 21:45:44 user nova-compute[74337]:       <nova:creationTime>2023-10-23 21:45:43</nova:creationTime>
Oct 23 21:45:44 user nova-compute[74337]:       <nova:flavor name="m1.tiny">
Oct 23 21:45:44 user nova-compute[74337]:         <nova:memory>512</nova:memory>
Oct 23 21:45:44 user nova-compute[74337]:         <nova:disk>1</nova:disk>
Oct 23 21:45:44 user nova-compute[74337]:         <nova:swap>0</nova:swap>
Oct 23 21:45:44 user nova-compute[74337]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 21:45:44 user nova-compute[74337]:         <nova:vcpus>1</nova:vcpus>
Oct 23 21:45:44 user nova-compute[74337]:       </nova:flavor>
Oct 23 21:45:44 user nova-compute[74337]:       <nova:owner>
Oct 23 21:45:44 user nova-compute[74337]:         <nova:user uuid="c82d267bc4d142f8b48c66ffab721618">tempest-AttachVolumeTestJSON-786463768-project-member</nova:user>
Oct 23 21:45:44 user nova-compute[74337]:         <nova:project uuid="b96dc585a51343db94529e22adbd6ef3">tempest-AttachVolumeTestJSON-786463768</nova:project>
Oct 23 21:45:44 user nova-compute[74337]:       </nova:owner>
Oct 23 21:45:44 user nova-compute[74337]:       <nova:root type="image" uuid="d859d89d-998d-4109-b26a-0d6e28152932"/>
Oct 23 21:45:44 user nova-compute[74337]:       <nova:ports>
Oct 23 21:45:44 user nova-compute[74337]:         <nova:port uuid="5df71ce2-a116-44b3-856b-c0de0da5dcd6">
Oct 23 21:45:44 user nova-compute[74337]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 23 21:45:44 user nova-compute[74337]:         </nova:port>
Oct 23 21:45:44 user nova-compute[74337]:       </nova:ports>
Oct 23 21:45:44 user nova-compute[74337]:     </nova:instance>
Oct 23 21:45:44 user nova-compute[74337]:   </metadata>
Oct 23 21:45:44 user nova-compute[74337]:   <sysinfo type="smbios">
Oct 23 21:45:44 user nova-compute[74337]:     <system>
Oct 23 21:45:44 user nova-compute[74337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 21:45:44 user nova-compute[74337]:       <entry name="product">OpenStack Nova</entry>
Oct 23 21:45:44 user nova-compute[74337]:       <entry name="version">0.0.0</entry>
Oct 23 21:45:44 user nova-compute[74337]:       <entry name="serial">56a4b932-486d-4b8d-9616-99e75592432a</entry>
Oct 23 21:45:44 user nova-compute[74337]:       <entry name="uuid">56a4b932-486d-4b8d-9616-99e75592432a</entry>
Oct 23 21:45:44 user nova-compute[74337]:       <entry name="family">Virtual Machine</entry>
Oct 23 21:45:44 user nova-compute[74337]:     </system>
Oct 23 21:45:44 user nova-compute[74337]:   </sysinfo>
Oct 23 21:45:44 user nova-compute[74337]:   <os>
Oct 23 21:45:44 user nova-compute[74337]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 21:45:44 user nova-compute[74337]:     <boot dev="hd"/>
Oct 23 21:45:44 user nova-compute[74337]:     <smbios mode="sysinfo"/>
Oct 23 21:45:44 user nova-compute[74337]:   </os>
Oct 23 21:45:44 user nova-compute[74337]:   <features>
Oct 23 21:45:44 user nova-compute[74337]:     <acpi/>
Oct 23 21:45:44 user nova-compute[74337]:     <apic/>
Oct 23 21:45:44 user nova-compute[74337]:     <vmcoreinfo/>
Oct 23 21:45:44 user nova-compute[74337]:   </features>
Oct 23 21:45:44 user nova-compute[74337]:   <clock offset="utc">
Oct 23 21:45:44 user nova-compute[74337]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 21:45:44 user nova-compute[74337]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 21:45:44 user nova-compute[74337]:     <timer name="hpet" present="no"/>
Oct 23 21:45:44 user nova-compute[74337]:   </clock>
Oct 23 21:45:44 user nova-compute[74337]:   <cpu mode="custom" match="exact">
Oct 23 21:45:44 user nova-compute[74337]:     <model>Nehalem</model>
Oct 23 21:45:44 user nova-compute[74337]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 21:45:44 user nova-compute[74337]:   </cpu>
Oct 23 21:45:44 user nova-compute[74337]:   <devices>
Oct 23 21:45:44 user nova-compute[74337]:     <disk type="file" device="disk">
Oct 23 21:45:44 user nova-compute[74337]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 21:45:44 user nova-compute[74337]:       <source file="/opt/stack/data/nova/instances/56a4b932-486d-4b8d-9616-99e75592432a/disk"/>
Oct 23 21:45:44 user nova-compute[74337]:       <target dev="vda" bus="virtio"/>
Oct 23 21:45:44 user nova-compute[74337]:     </disk>
Oct 23 21:45:44 user nova-compute[74337]:     <disk type="block" device="disk">
Oct 23 21:45:44 user nova-compute[74337]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 21:45:44 user nova-compute[74337]:       <source dev="/dev/sdb"/>
Oct 23 21:45:44 user nova-compute[74337]:       <target dev="vdb" bus="virtio"/>
Oct 23 21:45:44 user nova-compute[74337]:       <serial>a8e8efe4-f74d-477f-ad38-999c514047ac</serial>
Oct 23 21:45:44 user nova-compute[74337]:     </disk>
Oct 23 21:45:44 user nova-compute[74337]:     <interface type="ethernet">
Oct 23 21:45:44 user nova-compute[74337]:       <mac address="fa:16:3e:20:cc:6f"/>
Oct 23 21:45:44 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:45:44 user nova-compute[74337]:       <mtu size="1442"/>
Oct 23 21:45:44 user nova-compute[74337]:       <target dev="tap5df71ce2-a1"/>
Oct 23 21:45:44 user nova-compute[74337]:     </interface>
Oct 23 21:45:44 user nova-compute[74337]:     <serial type="pty">
Oct 23 21:45:44 user nova-compute[74337]:       <log file="/opt/stack/data/nova/instances/56a4b932-486d-4b8d-9616-99e75592432a/console.log" append="off"/>
Oct 23 21:45:44 user nova-compute[74337]:     </serial>
Oct 23 21:45:44 user nova-compute[74337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 21:45:44 user nova-compute[74337]:     <video>
Oct 23 21:45:44 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:45:44 user nova-compute[74337]:     </video>
Oct 23 21:45:44 user nova-compute[74337]:     <rng model="virtio">
Oct 23 21:45:44 user nova-compute[74337]:       <backend model="random">/dev/urandom</backend>
Oct 23 21:45:44 user nova-compute[74337]:     </rng>
Oct 23 21:45:44 user nova-compute[74337]:     <controller type="usb" index="0" model="none"/>
Oct 23 21:45:44 user nova-compute[74337]:     <memballoon model="virtio">
Oct 23 21:45:44 user nova-compute[74337]:       <stats period="10"/>
Oct 23 21:45:44 user nova-compute[74337]:     </memballoon>
Oct 23 21:45:44 user nova-compute[74337]:   </devices>
Oct 23 21:45:44 user nova-compute[74337]: </domain>
Oct 23 21:45:44 user nova-compute[74337]:  {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 21:45:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56a4b932-486d-4b8d-9616-99e75592432a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:45:44 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Instance destroyed successfully.
Oct 23 21:45:44 user nova-compute[74337]: INFO nova.compute.manager [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Detaching volume 9a863deb-8b0f-4e44-b7d7-16ace509f43c
Oct 23 21:45:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56a4b932-486d-4b8d-9616-99e75592432a/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:45:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56a4b932-486d-4b8d-9616-99e75592432a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:45:44 user nova-compute[74337]: INFO nova.virt.block_device [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Attempting to driver detach volume 9a863deb-8b0f-4e44-b7d7-16ace509f43c from mountpoint /dev/vdb
Oct 23 21:45:44 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Attempting to detach device vdb from instance 195a4056-3254-4558-b2f5-299bcd4af07c from the persistent domain config. {{(pid=74337) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 21:45:44 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 21:45:44 user nova-compute[74337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 21:45:44 user nova-compute[74337]:   <source dev="/dev/sdf"/>
Oct 23 21:45:44 user nova-compute[74337]:   <target dev="vdb" bus="virtio"/>
Oct 23 21:45:44 user nova-compute[74337]:   <serial>9a863deb-8b0f-4e44-b7d7-16ace509f43c</serial>
Oct 23 21:45:44 user nova-compute[74337]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 21:45:44 user nova-compute[74337]: </disk>
Oct 23 21:45:44 user nova-compute[74337]:  {{(pid=74337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 21:45:44 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Successfully detached device vdb from instance 195a4056-3254-4558-b2f5-299bcd4af07c from the persistent domain config.
Oct 23 21:45:44 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] calling os-brick to detach iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 21:45:44 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, {'target_iqn': 'iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FWrOaikx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:45:44 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 23 21:45:44 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:45:44 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:45:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:45:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:45:44 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[18af7904-92c3-42e1-8479-96c33984a4b5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:83240a3d-a866-4ba1-9d61-472c1d1a86f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:45:44 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 21:45:44 user nova-compute[74337]: No targets found.
Oct 23 21:45:44 user nova-compute[74337]: iSNS:
Oct 23 21:45:44 user nova-compute[74337]: No targets found.
Oct 23 21:45:44 user nova-compute[74337]: STATIC:
Oct 23 21:45:44 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4
Oct 23 21:45:44 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:45:44 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:45:44 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c
Oct 23 21:45:44 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:45:44 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:45:44 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac
Oct 23 21:45:44 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:45:44 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:45:44 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c
Oct 23 21:45:44 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:45:44 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:45:44 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:83240a3d-a866-4ba1-9d61-472c1d1a86f7
Oct 23 21:45:44 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:45:44 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:45:44 user nova-compute[74337]: FIRMWARE:
Oct 23 21:45:44 user nova-compute[74337]: No targets found.
Oct 23 21:45:44 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:45:44 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 21:45:44 user nova-compute[74337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 21:45:44 user nova-compute[74337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 21:45:44 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c', 0)] {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 21:45:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:45:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:45:44 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b813c3c2-4bb7-4f0c-b0f3-90d9b3dbf41d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83240a3d-a866-4ba1-9d61-472c1d1a86f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:45:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:45:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56a4b932-486d-4b8d-9616-99e75592432a/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:45:44 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 21:45:44 user nova-compute[74337]: DEBUG nova.objects.instance [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lazy-loading 'trusted_certs' on Instance uuid 56a4b932-486d-4b8d-9616-99e75592432a {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:45:45 user nova-compute[74337]: DEBUG nova.objects.base [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Object Instance<56a4b932-486d-4b8d-9616-99e75592432a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 21:45:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:45:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.127s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:45:45 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b433cff1-6625-4d89-bbc2-0bd910a7b75f]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83240a3d-a866-4ba1-9d61-472c1d1a86f7 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:45:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:45:45 user nova-compute[74337]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83240a3d-a866-4ba1-9d61-472c1d1a86f7 (non-flash)
Oct 23 21:45:45 user nova-compute[74337]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c (non-flash)
Oct 23 21:45:45 user nova-compute[74337]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c (non-flash)
Oct 23 21:45:45 user nova-compute[74337]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac (non-flash)
Oct 23 21:45:45 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:45:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:45:45 user nova-compute[74337]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83240a3d-a866-4ba1-9d61-472c1d1a86f7 (non-flash)
Oct 23 21:45:45 user nova-compute[74337]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c (non-flash)
Oct 23 21:45:45 user nova-compute[74337]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c (non-flash)
Oct 23 21:45:45 user nova-compute[74337]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac (non-flash)
Oct 23 21:45:45 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:45:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5ec86fea70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c'): ({'sdf'}, set())}) {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 21:45:45 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Removing single pathed devices sdf {{(pid=74337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 21:45:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:45:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:45:45 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[81127810-b659-44fe-8dd4-006b351e68d9]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:45:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:45:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:45:45 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c408db0-a592-4e86-bea8-1c930f082e58]: (4, ('ok\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:45:45 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Flushing IO for device /dev/sdf {{(pid=74337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 21:45:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:45:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:45:45 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce2ec28b-5926-4744-bb54-1f970f97c35c]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:45:45 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 21:45:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:45:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.047s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:45:45 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[3afd6779-d019-4643-8d00-32180230ae03]: (4, ('1', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:45:45 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 21:45:45 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] SCSI volumes sdf have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 21:45:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c')] {{(pid=74337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 21:45:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:45:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:45:45 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[2264acab-257f-4c4e-a3e2-39b17d9aff9d]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:45:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:45:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c -p 172.16.0.220:3260 --logout {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:45:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.254s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:45:45 user nova-compute[74337]: DEBUG nova.virt.disk.api [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Checking if we can resize image /opt/stack/data/nova/instances/56a4b932-486d-4b8d-9616-99e75592432a/disk. size=1073741824 {{(pid=74337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 21:45:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56a4b932-486d-4b8d-9616-99e75592432a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:45:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:45:45 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d699b2-9505-455d-bc2a-7c9acd58aed5]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:45:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c, portal: 172.16.0.220,3260]
Oct 23 21:45:45 user nova-compute[74337]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c, portal: 172.16.0.220,3260] successful.
Oct 23 21:45:45 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:45:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c -p 172.16.0.220:3260 --op delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:45:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:45:45 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b95a04b3-3222-4b79-ba8f-fa6a508e4ae3]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:45:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:45:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.486s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:45:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] <== disconnect_volume: return (489ms) None {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:45:45 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Disconnected iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 21:45:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56a4b932-486d-4b8d-9616-99e75592432a/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:45:45 user nova-compute[74337]: DEBUG nova.virt.disk.api [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Cannot resize image /opt/stack/data/nova/instances/56a4b932-486d-4b8d-9616-99e75592432a/disk to a smaller size. {{(pid=74337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 21:45:45 user nova-compute[74337]: DEBUG nova.objects.instance [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lazy-loading 'migration_context' on Instance uuid 56a4b932-486d-4b8d-9616-99e75592432a {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:45:45 user nova-compute[74337]: DEBUG nova.objects.base [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Object Instance<56a4b932-486d-4b8d-9616-99e75592432a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 21:45:45 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:41:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1348448759',display_name='tempest-AttachVolumeTestJSON-server-1348448759',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1348448759',id=18,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOSyI2UfSbOjGClrd6s5yGjykCHAlq4p3VgQcvKHgSPXIAoK0vvVLu+A6LT9ePnSPyc9urTg/MN9ZHJ02yogPWhYeBoMR8cfZQeMkKqZLPuaXXx5keLozdFismgRTGZYug==',key_name='tempest-keypair-1796008721',keypairs=<?>,launch_index=0,launched_at=2023-10-23T21:41:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='b96dc585a51343db94529e22adbd6ef3',ramdisk_id='',reservation_id='r-ydiij502',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-786463768',owner_user_name='tempest-AttachVolumeTestJSON-786463768-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:43:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c82d267bc4d142f8b48c66ffab721618',uuid=56a4b932-486d-4b8d-9616-99e75592432a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "5df71ce2-a116-44b3-856b-c0de0da5dcd6", "address": "fa:16:3e:20:cc:6f", "network": {"id": "fe0a9f00-e17b-4064-96d2-fd1cc848afb2", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1294741219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96dc585a51343db94529e22adbd6ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5df71ce2-a1", "ovs_interfaceid": "5df71ce2-a116-44b3-856b-c0de0da5dcd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 21:45:45 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Converting VIF {"id": "5df71ce2-a116-44b3-856b-c0de0da5dcd6", "address": "fa:16:3e:20:cc:6f", "network": {"id": "fe0a9f00-e17b-4064-96d2-fd1cc848afb2", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1294741219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96dc585a51343db94529e22adbd6ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5df71ce2-a1", "ovs_interfaceid": "5df71ce2-a116-44b3-856b-c0de0da5dcd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:45:45 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:cc:6f,bridge_name='br-int',has_traffic_filtering=True,id=5df71ce2-a116-44b3-856b-c0de0da5dcd6,network=Network(fe0a9f00-e17b-4064-96d2-fd1cc848afb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5df71ce2-a1') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:45:45 user nova-compute[74337]: DEBUG os_vif [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:cc:6f,bridge_name='br-int',has_traffic_filtering=True,id=5df71ce2-a116-44b3-856b-c0de0da5dcd6,network=Network(fe0a9f00-e17b-4064-96d2-fd1cc848afb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5df71ce2-a1') {{(pid=74337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 21:45:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:45:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:45:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 21:45:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:45:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '43a2dca9-239f-5e8e-9bfc-a6775a79bbfb', '_type': 'linux-noop'}}, row=False) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:45:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:45:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:45:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:45:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:45:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5df71ce2-a1, may_exist=True, interface_attrs={}) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:45:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5df71ce2-a1, col_values=(('qos', UUID('22b128d2-04e9-4d75-96df-2a736af5f3b2')),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:45:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5df71ce2-a1, col_values=(('external_ids', {'iface-id': '5df71ce2-a116-44b3-856b-c0de0da5dcd6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:20:cc:6f', 'vm-uuid': '56a4b932-486d-4b8d-9616-99e75592432a'}),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:45:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:45:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:45:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:45:45 user nova-compute[74337]: INFO os_vif [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:cc:6f,bridge_name='br-int',has_traffic_filtering=True,id=5df71ce2-a116-44b3-856b-c0de0da5dcd6,network=Network(fe0a9f00-e17b-4064-96d2-fd1cc848afb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5df71ce2-a1')
Oct 23 21:45:46 user nova-compute[74337]: DEBUG nova.compute.manager [req-f058337c-2928-4b88-9d85-77114c677827 req-bf1ae3d6-629a-4b7d-b36b-926999c95eda service nova] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Received event network-vif-plugged-efec7d56-28cb-4da2-b6f7-6e9777d3377b {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:45:46 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-f058337c-2928-4b88-9d85-77114c677827 req-bf1ae3d6-629a-4b7d-b36b-926999c95eda service nova] Acquiring lock "195a4056-3254-4558-b2f5-299bcd4af07c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:45:46 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-f058337c-2928-4b88-9d85-77114c677827 req-bf1ae3d6-629a-4b7d-b36b-926999c95eda service nova] Lock "195a4056-3254-4558-b2f5-299bcd4af07c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:45:46 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-f058337c-2928-4b88-9d85-77114c677827 req-bf1ae3d6-629a-4b7d-b36b-926999c95eda service nova] Lock "195a4056-3254-4558-b2f5-299bcd4af07c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:45:46 user nova-compute[74337]: DEBUG nova.compute.manager [req-f058337c-2928-4b88-9d85-77114c677827 req-bf1ae3d6-629a-4b7d-b36b-926999c95eda service nova] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] No waiting events found dispatching network-vif-plugged-efec7d56-28cb-4da2-b6f7-6e9777d3377b {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:45:46 user nova-compute[74337]: WARNING nova.compute.manager [req-f058337c-2928-4b88-9d85-77114c677827 req-bf1ae3d6-629a-4b7d-b36b-926999c95eda service nova] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Received unexpected event network-vif-plugged-efec7d56-28cb-4da2-b6f7-6e9777d3377b for instance with vm_state active and task_state rebuilding.
Oct 23 21:45:46 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Instance destroyed successfully.
Oct 23 21:45:46 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:43:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-696848694',display_name='tempest-ServerActionsTestOtherA-server-751708093',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-696848694',id=23,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAWzQm4+V4g91dNEdG8YLkJhCynO3Ap8ILaI8oMN1LNLl54g3kIsrbEh6Mxm9fgmaJnzv3izz6qYqT1bG4NWKyccXk+mb+zPPixuCgYlO6IQfM8pLRdMrw36YsRSiIFnHQ==',key_name='tempest-keypair-1081806285',keypairs=<?>,launch_index=0,launched_at=2023-10-23T21:43:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e1f57e58a9ec4c6384dc0d3ca58eb610',ramdisk_id='',reservation_id='r-8no3m5aa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-100075475',owner_user_name='tempest-ServerActionsTestOtherA-100075475-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:45:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='891ee2e3acc54ed0bc4571f63ff491a0',uuid=195a4056-3254-4558-b2f5-299bcd4af07c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "efec7d56-28cb-4da2-b6f7-6e9777d3377b", "address": "fa:16:3e:26:a4:b5", "network": {"id": "aff1f95f-fda8-4f0f-8d10-7e3d587e4fda", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2048135647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1f57e58a9ec4c6384dc0d3ca58eb610", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefec7d56-28", "ovs_interfaceid": "efec7d56-28cb-4da2-b6f7-6e9777d3377b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 21:45:46 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Converting VIF {"id": "efec7d56-28cb-4da2-b6f7-6e9777d3377b", "address": "fa:16:3e:26:a4:b5", "network": {"id": "aff1f95f-fda8-4f0f-8d10-7e3d587e4fda", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2048135647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1f57e58a9ec4c6384dc0d3ca58eb610", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefec7d56-28", "ovs_interfaceid": "efec7d56-28cb-4da2-b6f7-6e9777d3377b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:45:46 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:26:a4:b5,bridge_name='br-int',has_traffic_filtering=True,id=efec7d56-28cb-4da2-b6f7-6e9777d3377b,network=Network(aff1f95f-fda8-4f0f-8d10-7e3d587e4fda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefec7d56-28') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:45:46 user nova-compute[74337]: DEBUG os_vif [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:a4:b5,bridge_name='br-int',has_traffic_filtering=True,id=efec7d56-28cb-4da2-b6f7-6e9777d3377b,network=Network(aff1f95f-fda8-4f0f-8d10-7e3d587e4fda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefec7d56-28') {{(pid=74337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 21:45:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:45:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapefec7d56-28, bridge=br-int, if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:45:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:45:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:45:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:45:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:45:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=04fd3521-351a-4bf6-9c74-5a437ae16152) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:45:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:45:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:45:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:45:46 user nova-compute[74337]: INFO os_vif [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:a4:b5,bridge_name='br-int',has_traffic_filtering=True,id=efec7d56-28cb-4da2-b6f7-6e9777d3377b,network=Network(aff1f95f-fda8-4f0f-8d10-7e3d587e4fda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefec7d56-28')
Oct 23 21:45:46 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] calling os-brick to detach iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 21:45:46 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, {'target_iqn': 'iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FWrOaikx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:45:46 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 23 21:45:46 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:45:46 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:45:46 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:45:46 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:45:46 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[15fdd299-8964-46c5-9f31-e032c710a9be]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:83240a3d-a866-4ba1-9d61-472c1d1a86f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:45:46 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 21:45:46 user nova-compute[74337]: No targets found.
Oct 23 21:45:46 user nova-compute[74337]: iSNS:
Oct 23 21:45:46 user nova-compute[74337]: No targets found.
Oct 23 21:45:46 user nova-compute[74337]: STATIC:
Oct 23 21:45:46 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4
Oct 23 21:45:46 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:45:46 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:45:46 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac
Oct 23 21:45:46 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:45:46 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:45:46 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c
Oct 23 21:45:46 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:45:46 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:45:46 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:83240a3d-a866-4ba1-9d61-472c1d1a86f7
Oct 23 21:45:46 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:45:46 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:45:46 user nova-compute[74337]: FIRMWARE:
Oct 23 21:45:46 user nova-compute[74337]: No targets found.
Oct 23 21:45:46 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:45:46 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 21:45:46 user nova-compute[74337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 21:45:46 user nova-compute[74337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 21:45:46 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c', 0)] {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 21:45:46 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:45:46 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:45:46 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b9b053a-1247-4261-9947-dbb500cf0ffe]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83240a3d-a866-4ba1-9d61-472c1d1a86f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:45:46 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:45:46 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:45:46 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf170bf8-3bfc-46b9-a70e-533f3b280b5e]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83240a3d-a866-4ba1-9d61-472c1d1a86f7 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:45:46 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:45:46 user nova-compute[74337]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83240a3d-a866-4ba1-9d61-472c1d1a86f7 (non-flash)
Oct 23 21:45:46 user nova-compute[74337]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c (non-flash)
Oct 23 21:45:46 user nova-compute[74337]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac (non-flash)
Oct 23 21:45:46 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:45:46 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:45:46 user nova-compute[74337]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83240a3d-a866-4ba1-9d61-472c1d1a86f7 (non-flash)
Oct 23 21:45:46 user nova-compute[74337]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c (non-flash)
Oct 23 21:45:46 user nova-compute[74337]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac (non-flash)
Oct 23 21:45:46 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:45:46 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5eec752830>, {}) {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 21:45:46 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Disconnecting from: [] {{(pid=74337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 21:45:46 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.073s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:45:46 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] <== disconnect_volume: return (75ms) None {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:45:46 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Disconnected iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 21:45:46 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Deleting instance files /opt/stack/data/nova/instances/195a4056-3254-4558-b2f5-299bcd4af07c_del
Oct 23 21:45:46 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Deletion of /opt/stack/data/nova/instances/195a4056-3254-4558-b2f5-299bcd4af07c_del complete
Oct 23 21:45:46 user nova-compute[74337]: INFO nova.virt.block_device [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Booting with volume 9a863deb-8b0f-4e44-b7d7-16ace509f43c at /dev/vdb
Oct 23 21:45:46 user nova-compute[74337]: DEBUG os_brick.utils [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:45:46 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:45:46 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:45:46 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f12bdd0-93a8-42bd-a914-abe644dc5d21]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f34011b66e40\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:45:46 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:45:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:45:46 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:45:46 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebab51d7-df08-41d4-973c-1cd9641c00f8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:45:46 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:45:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:45:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:45:46 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.029s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:45:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:45:46 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[3641c0c4-e0fe-49ec-b8ab-49e9f478510e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:45:46 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[df42824c-6002-40f2-8e76-50c30cfc00a9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:45:46 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Running cmd (subprocess): nvme version {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:45:46 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] 'nvme version' failed. Not Retrying. {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 21:45:46 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] nvme not present on system {{(pid=74337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 21:45:46 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:45:47 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 21:45:47 user nova-compute[74337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 21:45:47 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad6ab0d-bb14-41cb-99a2-682bf3934aa9]: (4, '') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:45:47 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 21:45:47 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 21:45:47 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] LIGHTOS: no hostnqn found. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 21:45:47 user nova-compute[74337]: DEBUG os_brick.utils [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] <== get_connector_properties: return (171ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f34011b66e40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:45:47 user nova-compute[74337]: DEBUG nova.virt.block_device [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Updating existing volume attachment record: 66167f1d-d5fc-479e-b56a-c3b08440247a {{(pid=74337) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 21:45:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:45:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:45:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:45:48 user nova-compute[74337]: DEBUG nova.compute.manager [req-add6fdec-e471-4d4e-814c-15a120e2079d req-579a6c9d-4709-44f1-b0a8-b85b7fd87c2c service nova] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Received event network-vif-plugged-5df71ce2-a116-44b3-856b-c0de0da5dcd6 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:45:48 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-add6fdec-e471-4d4e-814c-15a120e2079d req-579a6c9d-4709-44f1-b0a8-b85b7fd87c2c service nova] Acquiring lock "56a4b932-486d-4b8d-9616-99e75592432a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:45:48 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-add6fdec-e471-4d4e-814c-15a120e2079d req-579a6c9d-4709-44f1-b0a8-b85b7fd87c2c service nova] Lock "56a4b932-486d-4b8d-9616-99e75592432a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:45:48 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-add6fdec-e471-4d4e-814c-15a120e2079d req-579a6c9d-4709-44f1-b0a8-b85b7fd87c2c service nova] Lock "56a4b932-486d-4b8d-9616-99e75592432a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:45:48 user nova-compute[74337]: DEBUG nova.compute.manager [req-add6fdec-e471-4d4e-814c-15a120e2079d req-579a6c9d-4709-44f1-b0a8-b85b7fd87c2c service nova] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] No waiting events found dispatching network-vif-plugged-5df71ce2-a116-44b3-856b-c0de0da5dcd6 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:45:48 user nova-compute[74337]: WARNING nova.compute.manager [req-add6fdec-e471-4d4e-814c-15a120e2079d req-579a6c9d-4709-44f1-b0a8-b85b7fd87c2c service nova] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Received unexpected event network-vif-plugged-5df71ce2-a116-44b3-856b-c0de0da5dcd6 for instance with vm_state stopped and task_state powering-on.
Oct 23 21:45:48 user nova-compute[74337]: DEBUG nova.compute.manager [req-add6fdec-e471-4d4e-814c-15a120e2079d req-579a6c9d-4709-44f1-b0a8-b85b7fd87c2c service nova] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Received event network-vif-plugged-5df71ce2-a116-44b3-856b-c0de0da5dcd6 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:45:48 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-add6fdec-e471-4d4e-814c-15a120e2079d req-579a6c9d-4709-44f1-b0a8-b85b7fd87c2c service nova] Acquiring lock "56a4b932-486d-4b8d-9616-99e75592432a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:45:48 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-add6fdec-e471-4d4e-814c-15a120e2079d req-579a6c9d-4709-44f1-b0a8-b85b7fd87c2c service nova] Lock "56a4b932-486d-4b8d-9616-99e75592432a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:45:48 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-add6fdec-e471-4d4e-814c-15a120e2079d req-579a6c9d-4709-44f1-b0a8-b85b7fd87c2c service nova] Lock "56a4b932-486d-4b8d-9616-99e75592432a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:45:48 user nova-compute[74337]: DEBUG nova.compute.manager [req-add6fdec-e471-4d4e-814c-15a120e2079d req-579a6c9d-4709-44f1-b0a8-b85b7fd87c2c service nova] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] No waiting events found dispatching network-vif-plugged-5df71ce2-a116-44b3-856b-c0de0da5dcd6 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:45:48 user nova-compute[74337]: WARNING nova.compute.manager [req-add6fdec-e471-4d4e-814c-15a120e2079d req-579a6c9d-4709-44f1-b0a8-b85b7fd87c2c service nova] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Received unexpected event network-vif-plugged-5df71ce2-a116-44b3-856b-c0de0da5dcd6 for instance with vm_state stopped and task_state powering-on.
Oct 23 21:45:48 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:45:49 user nova-compute[74337]: DEBUG nova.compute.manager [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Instance event wait completed in 0 seconds for  {{(pid=74337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 21:45:49 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Instance rebooted successfully.
Oct 23 21:45:49 user nova-compute[74337]: DEBUG nova.compute.manager [None req-8f5606ce-8c56-4442-976d-79d35ad8ea5b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Checking state {{(pid=74337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 21:45:51 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:45:53 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:45:56 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:45:58 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:46:01 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:46:03 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:46:03 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Starting heal instance info cache {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 21:46:03 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Rebuilding the list of instances to heal {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 21:46:03 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:46:03 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "refresh_cache-1189976f-8d02-468d-8fa7-bd5594c5f85a" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:46:03 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquired lock "refresh_cache-1189976f-8d02-468d-8fa7-bd5594c5f85a" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:46:03 user nova-compute[74337]: DEBUG nova.network.neutron [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 1189976f-8d02-468d-8fa7-bd5594c5f85a] Forcefully refreshing network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 21:46:03 user nova-compute[74337]: DEBUG nova.objects.instance [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lazy-loading 'info_cache' on Instance uuid 1189976f-8d02-468d-8fa7-bd5594c5f85a {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:46:04 user nova-compute[74337]: DEBUG nova.network.neutron [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 1189976f-8d02-468d-8fa7-bd5594c5f85a] Updating instance_info_cache with network_info: [{"id": "9c888931-1180-4efd-8ca1-a57252bf8dc5", "address": "fa:16:3e:f9:a2:b8", "network": {"id": "5f62b1d8-d5d0-4ff9-922b-fc6e72fb640d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-655282105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b85c4f783a4ee7ab67422b49da85ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c888931-11", "ovs_interfaceid": "9c888931-1180-4efd-8ca1-a57252bf8dc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:46:04 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Releasing lock "refresh_cache-1189976f-8d02-468d-8fa7-bd5594c5f85a" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:46:04 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 1189976f-8d02-468d-8fa7-bd5594c5f85a] Updated the network info_cache for instance {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 21:46:04 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:46:05 user nova-compute[74337]: DEBUG nova.compute.manager [req-1261942a-9b3d-43aa-b09f-0960a72a6edf req-1bd5ba89-e7fa-4729-8df8-6b0bf5b77320 service nova] [instance: 60bd4497-75ce-4ad2-bef9-303f293244db] Received event network-changed-4bf6b6b9-0602-4d1e-a34d-c46f903a45b0 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:46:05 user nova-compute[74337]: DEBUG nova.compute.manager [req-1261942a-9b3d-43aa-b09f-0960a72a6edf req-1bd5ba89-e7fa-4729-8df8-6b0bf5b77320 service nova] [instance: 60bd4497-75ce-4ad2-bef9-303f293244db] Refreshing instance network info cache due to event network-changed-4bf6b6b9-0602-4d1e-a34d-c46f903a45b0. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 21:46:05 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-1261942a-9b3d-43aa-b09f-0960a72a6edf req-1bd5ba89-e7fa-4729-8df8-6b0bf5b77320 service nova] Acquiring lock "refresh_cache-60bd4497-75ce-4ad2-bef9-303f293244db" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:46:05 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-1261942a-9b3d-43aa-b09f-0960a72a6edf req-1bd5ba89-e7fa-4729-8df8-6b0bf5b77320 service nova] Acquired lock "refresh_cache-60bd4497-75ce-4ad2-bef9-303f293244db" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:46:05 user nova-compute[74337]: DEBUG nova.network.neutron [req-1261942a-9b3d-43aa-b09f-0960a72a6edf req-1bd5ba89-e7fa-4729-8df8-6b0bf5b77320 service nova] [instance: 60bd4497-75ce-4ad2-bef9-303f293244db] Refreshing network info cache for port 4bf6b6b9-0602-4d1e-a34d-c46f903a45b0 {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 21:46:05 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:46:05 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 21:46:05 user nova-compute[74337]: DEBUG nova.network.neutron [req-1261942a-9b3d-43aa-b09f-0960a72a6edf req-1bd5ba89-e7fa-4729-8df8-6b0bf5b77320 service nova] [instance: 60bd4497-75ce-4ad2-bef9-303f293244db] Updated VIF entry in instance network info cache for port 4bf6b6b9-0602-4d1e-a34d-c46f903a45b0. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 21:46:05 user nova-compute[74337]: DEBUG nova.network.neutron [req-1261942a-9b3d-43aa-b09f-0960a72a6edf req-1bd5ba89-e7fa-4729-8df8-6b0bf5b77320 service nova] [instance: 60bd4497-75ce-4ad2-bef9-303f293244db] Updating instance_info_cache with network_info: [{"id": "4bf6b6b9-0602-4d1e-a34d-c46f903a45b0", "address": "fa:16:3e:f2:0a:14", "network": {"id": "787d9979-63ad-4318-b1d7-8ec69c5969fe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1847253864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84a25b3eed8548a5a324e55b28f26252", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bf6b6b9-06", "ovs_interfaceid": "4bf6b6b9-0602-4d1e-a34d-c46f903a45b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:46:05 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-1261942a-9b3d-43aa-b09f-0960a72a6edf req-1bd5ba89-e7fa-4729-8df8-6b0bf5b77320 service nova] Releasing lock "refresh_cache-60bd4497-75ce-4ad2-bef9-303f293244db" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:46:06 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:46:06 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:46:06 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-920b3149-44d4-4a9b-a8cf-56c25e2a14ce tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Acquiring lock "60bd4497-75ce-4ad2-bef9-303f293244db" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:46:06 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-920b3149-44d4-4a9b-a8cf-56c25e2a14ce tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lock "60bd4497-75ce-4ad2-bef9-303f293244db" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:46:06 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-920b3149-44d4-4a9b-a8cf-56c25e2a14ce tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Acquiring lock "60bd4497-75ce-4ad2-bef9-303f293244db-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:46:06 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-920b3149-44d4-4a9b-a8cf-56c25e2a14ce tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lock "60bd4497-75ce-4ad2-bef9-303f293244db-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:46:06 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-920b3149-44d4-4a9b-a8cf-56c25e2a14ce tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lock "60bd4497-75ce-4ad2-bef9-303f293244db-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:46:06 user nova-compute[74337]: INFO nova.compute.manager [None req-920b3149-44d4-4a9b-a8cf-56c25e2a14ce tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 60bd4497-75ce-4ad2-bef9-303f293244db] Terminating instance
Oct 23 21:46:06 user nova-compute[74337]: DEBUG nova.compute.manager [None req-920b3149-44d4-4a9b-a8cf-56c25e2a14ce tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 60bd4497-75ce-4ad2-bef9-303f293244db] Start destroying the instance on the hypervisor. {{(pid=74337) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 21:46:06 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Creating instance directory {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 21:46:06 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Creating image(s)
Oct 23 21:46:06 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Acquiring lock "/opt/stack/data/nova/instances/195a4056-3254-4558-b2f5-299bcd4af07c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:46:06 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lock "/opt/stack/data/nova/instances/195a4056-3254-4558-b2f5-299bcd4af07c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:46:06 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lock "/opt/stack/data/nova/instances/195a4056-3254-4558-b2f5-299bcd4af07c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:46:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:46:06 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:46:06 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:46:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.195s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:46:06 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Acquiring lock "fc7b140751b8c385de81623e40fb09ce09374ab7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:46:06 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lock "fc7b140751b8c385de81623e40fb09ce09374ab7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:46:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:46:06 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:46:06 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:46:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.192s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:46:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7,backing_fmt=raw /opt/stack/data/nova/instances/195a4056-3254-4558-b2f5-299bcd4af07c/disk 1073741824 {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7,backing_fmt=raw /opt/stack/data/nova/instances/195a4056-3254-4558-b2f5-299bcd4af07c/disk 1073741824" returned: 0 in 0.064s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lock "fc7b140751b8c385de81623e40fb09ce09374ab7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.262s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG nova.compute.manager [req-0fa61d13-4d8f-4eed-9e45-be550c706f8e req-a69ba1ac-1eeb-4eaa-a82e-4b2064ebb588 service nova] [instance: 60bd4497-75ce-4ad2-bef9-303f293244db] Received event network-vif-unplugged-4bf6b6b9-0602-4d1e-a34d-c46f903a45b0 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-0fa61d13-4d8f-4eed-9e45-be550c706f8e req-a69ba1ac-1eeb-4eaa-a82e-4b2064ebb588 service nova] Acquiring lock "60bd4497-75ce-4ad2-bef9-303f293244db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-0fa61d13-4d8f-4eed-9e45-be550c706f8e req-a69ba1ac-1eeb-4eaa-a82e-4b2064ebb588 service nova] Lock "60bd4497-75ce-4ad2-bef9-303f293244db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-0fa61d13-4d8f-4eed-9e45-be550c706f8e req-a69ba1ac-1eeb-4eaa-a82e-4b2064ebb588 service nova] Lock "60bd4497-75ce-4ad2-bef9-303f293244db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG nova.compute.manager [req-0fa61d13-4d8f-4eed-9e45-be550c706f8e req-a69ba1ac-1eeb-4eaa-a82e-4b2064ebb588 service nova] [instance: 60bd4497-75ce-4ad2-bef9-303f293244db] No waiting events found dispatching network-vif-unplugged-4bf6b6b9-0602-4d1e-a34d-c46f903a45b0 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG nova.compute.manager [req-0fa61d13-4d8f-4eed-9e45-be550c706f8e req-a69ba1ac-1eeb-4eaa-a82e-4b2064ebb588 service nova] [instance: 60bd4497-75ce-4ad2-bef9-303f293244db] Received event network-vif-unplugged-4bf6b6b9-0602-4d1e-a34d-c46f903a45b0 for instance with task_state deleting. {{(pid=74337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG nova.compute.manager [req-0fa61d13-4d8f-4eed-9e45-be550c706f8e req-a69ba1ac-1eeb-4eaa-a82e-4b2064ebb588 service nova] [instance: 60bd4497-75ce-4ad2-bef9-303f293244db] Received event network-vif-plugged-4bf6b6b9-0602-4d1e-a34d-c46f903a45b0 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-0fa61d13-4d8f-4eed-9e45-be550c706f8e req-a69ba1ac-1eeb-4eaa-a82e-4b2064ebb588 service nova] Acquiring lock "60bd4497-75ce-4ad2-bef9-303f293244db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-0fa61d13-4d8f-4eed-9e45-be550c706f8e req-a69ba1ac-1eeb-4eaa-a82e-4b2064ebb588 service nova] Lock "60bd4497-75ce-4ad2-bef9-303f293244db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-0fa61d13-4d8f-4eed-9e45-be550c706f8e req-a69ba1ac-1eeb-4eaa-a82e-4b2064ebb588 service nova] Lock "60bd4497-75ce-4ad2-bef9-303f293244db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG nova.compute.manager [req-0fa61d13-4d8f-4eed-9e45-be550c706f8e req-a69ba1ac-1eeb-4eaa-a82e-4b2064ebb588 service nova] [instance: 60bd4497-75ce-4ad2-bef9-303f293244db] No waiting events found dispatching network-vif-plugged-4bf6b6b9-0602-4d1e-a34d-c46f903a45b0 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:46:07 user nova-compute[74337]: WARNING nova.compute.manager [req-0fa61d13-4d8f-4eed-9e45-be550c706f8e req-a69ba1ac-1eeb-4eaa-a82e-4b2064ebb588 service nova] [instance: 60bd4497-75ce-4ad2-bef9-303f293244db] Received unexpected event network-vif-plugged-4bf6b6b9-0602-4d1e-a34d-c46f903a45b0 for instance with vm_state active and task_state deleting.
Oct 23 21:46:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.181s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG nova.virt.disk.api [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Checking if we can resize image /opt/stack/data/nova/instances/195a4056-3254-4558-b2f5-299bcd4af07c/disk. size=1073741824 {{(pid=74337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195a4056-3254-4558-b2f5-299bcd4af07c/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:46:07 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: 60bd4497-75ce-4ad2-bef9-303f293244db] Instance destroyed successfully.
Oct 23 21:46:07 user nova-compute[74337]: DEBUG nova.objects.instance [None req-920b3149-44d4-4a9b-a8cf-56c25e2a14ce tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lazy-loading 'resources' on Instance uuid 60bd4497-75ce-4ad2-bef9-303f293244db {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-920b3149-44d4-4a9b-a8cf-56c25e2a14ce tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:44:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1418196360',display_name='tempest-AttachVolumeNegativeTest-server-1418196360',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1418196360',id=24,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMqpTmUjCnPdieLTDPp1y1MCX4lfK3eM9p1yQICqheaqwuZyeQg2hTPtUbygEzENB6PDYMQ7deWPrk2woG/HFz3DenbgRAR+VTDVwqodZBGNM1FB+MR3JrC8fHsKnk7aiA==',key_name='tempest-keypair-1018291788',keypairs=<?>,launch_index=0,launched_at=2023-10-23T21:44:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='84a25b3eed8548a5a324e55b28f26252',ramdisk_id='',reservation_id='r-k2b12u0m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1446109887',owner_user_name='tempest-AttachVolumeNegativeTest-1446109887-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T21:44:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6f6daa6653264905a5498e00f184080c',uuid=60bd4497-75ce-4ad2-bef9-303f293244db,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4bf6b6b9-0602-4d1e-a34d-c46f903a45b0", "address": "fa:16:3e:f2:0a:14", "network": {"id": "787d9979-63ad-4318-b1d7-8ec69c5969fe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1847253864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84a25b3eed8548a5a324e55b28f26252", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bf6b6b9-06", "ovs_interfaceid": "4bf6b6b9-0602-4d1e-a34d-c46f903a45b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-920b3149-44d4-4a9b-a8cf-56c25e2a14ce tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Converting VIF {"id": "4bf6b6b9-0602-4d1e-a34d-c46f903a45b0", "address": "fa:16:3e:f2:0a:14", "network": {"id": "787d9979-63ad-4318-b1d7-8ec69c5969fe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1847253864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84a25b3eed8548a5a324e55b28f26252", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bf6b6b9-06", "ovs_interfaceid": "4bf6b6b9-0602-4d1e-a34d-c46f903a45b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-920b3149-44d4-4a9b-a8cf-56c25e2a14ce tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f2:0a:14,bridge_name='br-int',has_traffic_filtering=True,id=4bf6b6b9-0602-4d1e-a34d-c46f903a45b0,network=Network(787d9979-63ad-4318-b1d7-8ec69c5969fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bf6b6b9-06') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG os_vif [None req-920b3149-44d4-4a9b-a8cf-56c25e2a14ce tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f2:0a:14,bridge_name='br-int',has_traffic_filtering=True,id=4bf6b6b9-0602-4d1e-a34d-c46f903a45b0,network=Network(787d9979-63ad-4318-b1d7-8ec69c5969fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bf6b6b9-06') {{(pid=74337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4bf6b6b9-06, bridge=br-int, if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5737698e-349c-48ea-9b1b-5301f623dc27) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:46:07 user nova-compute[74337]: INFO os_vif [None req-920b3149-44d4-4a9b-a8cf-56c25e2a14ce tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f2:0a:14,bridge_name='br-int',has_traffic_filtering=True,id=4bf6b6b9-0602-4d1e-a34d-c46f903a45b0,network=Network(787d9979-63ad-4318-b1d7-8ec69c5969fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bf6b6b9-06')
Oct 23 21:46:07 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-920b3149-44d4-4a9b-a8cf-56c25e2a14ce tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 60bd4497-75ce-4ad2-bef9-303f293244db] Deleting instance files /opt/stack/data/nova/instances/60bd4497-75ce-4ad2-bef9-303f293244db_del
Oct 23 21:46:07 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-920b3149-44d4-4a9b-a8cf-56c25e2a14ce tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 60bd4497-75ce-4ad2-bef9-303f293244db] Deletion of /opt/stack/data/nova/instances/60bd4497-75ce-4ad2-bef9-303f293244db_del complete
Oct 23 21:46:07 user nova-compute[74337]: INFO nova.compute.manager [None req-920b3149-44d4-4a9b-a8cf-56c25e2a14ce tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 60bd4497-75ce-4ad2-bef9-303f293244db] Took 0.90 seconds to destroy the instance on the hypervisor.
Oct 23 21:46:07 user nova-compute[74337]: DEBUG oslo.service.loopingcall [None req-920b3149-44d4-4a9b-a8cf-56c25e2a14ce tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74337) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG nova.compute.manager [-] [instance: 60bd4497-75ce-4ad2-bef9-303f293244db] Deallocating network for instance {{(pid=74337) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG nova.network.neutron [-] [instance: 60bd4497-75ce-4ad2-bef9-303f293244db] deallocate_for_instance() {{(pid=74337) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195a4056-3254-4558-b2f5-299bcd4af07c/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG nova.virt.disk.api [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Cannot resize image /opt/stack/data/nova/instances/195a4056-3254-4558-b2f5-299bcd4af07c/disk to a smaller size. {{(pid=74337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Created local disks {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Ensure instance console log exists: /opt/stack/data/nova/instances/195a4056-3254-4558-b2f5-299bcd4af07c/console.log {{(pid=74337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Start _get_guest_xml network_info=[{"id": "efec7d56-28cb-4da2-b6f7-6e9777d3377b", "address": "fa:16:3e:26:a4:b5", "network": {"id": "aff1f95f-fda8-4f0f-8d10-7e3d587e4fda", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2048135647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1f57e58a9ec4c6384dc0d3ca58eb610", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefec7d56-28", "ovs_interfaceid": "efec7d56-28cb-4da2-b6f7-6e9777d3377b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T21:29:21Z,direct_url=<?>,disk_format='qcow2',id=d859d89d-998d-4109-b26a-0d6e28152932,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ff43462300764979a6cf688444336a56',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T21:29:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'image_id': 'd859d89d-998d-4109-b26a-0d6e28152932'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '66167f1d-d5fc-479e-b56a-c3b08440247a', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FWrOaikx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '195a4056-3254-4558-b2f5-299bcd4af07c', 'attached_at': '', 'detached_at': '', 'volume_id': '9a863deb-8b0f-4e44-b7d7-16ace509f43c', 'serial': '9a863deb-8b0f-4e44-b7d7-16ace509f43c'}, 'guest_format': None, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 21:46:07 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 23 21:46:07 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 23 21:46:07 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] CPU controller missing on host. {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] CPU controller found on host. {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T21:29:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T21:29:21Z,direct_url=<?>,disk_format='qcow2',id=d859d89d-998d-4109-b26a-0d6e28152932,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ff43462300764979a6cf688444336a56',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T21:29:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Flavor limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Image limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Flavor pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Image pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Got 1 possible topologies {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG nova.objects.instance [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lazy-loading 'vcpu_model' on Instance uuid 195a4056-3254-4558-b2f5-299bcd4af07c {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Calling os-brick to attach iSCSI Volume {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FWrOaikx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:46:07 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 23 21:46:07 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:46:07 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 23 21:46:07 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:46:07 user nova-compute[74337]: INFO os_brick.initiator.connectors.iscsi [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 21:46:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c -p 172.16.0.220:3260 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4eb3c72-983a-41ee-bc44-242f30267159]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 21:46:07 user nova-compute[74337]:  {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c -p 172.16.0.220:3260 --interface default --op new {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c126e5d-641e-4d2e-b88e-00b538bb2174]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c] added\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c] added
Oct 23 21:46:07 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ccc1d4-4c8f-46c8-8393-b712a45c3294]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f9ff73-185e-4453-8341-6d098b681e18]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FWrOaikx {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FWrOaikx" returned: 0 in 0.024s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[423572ef-aacc-4827-aa18-d15c2485d09e]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FWrOaikx'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b1424cd-3ef9-4ebe-8734-ab87ada88119]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce922e59-5b35-408c-b07c-7cae254390c4]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83240a3d-a866-4ba1-9d61-472c1d1a86f7 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:46:07 user nova-compute[74337]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83240a3d-a866-4ba1-9d61-472c1d1a86f7 (non-flash)
Oct 23 21:46:07 user nova-compute[74337]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c (non-flash)
Oct 23 21:46:07 user nova-compute[74337]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac (non-flash)
Oct 23 21:46:07 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:46:07 user nova-compute[74337]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83240a3d-a866-4ba1-9d61-472c1d1a86f7 (non-flash)
Oct 23 21:46:07 user nova-compute[74337]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c (non-flash)
Oct 23 21:46:07 user nova-compute[74337]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac (non-flash)
Oct 23 21:46:07 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c -p 172.16.0.220:3260 --login {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc3d5c1a-bd61-45bd-abb7-1e3f756d1b71]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c, portal: 172.16.0.220,3260]
Oct 23 21:46:07 user nova-compute[74337]: Login to [iface: default, target: iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c, portal: 172.16.0.220,3260] successful.
Oct 23 21:46:07 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[72d5ff4b-0af9-46c6-930c-8e500ff4d4c5]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[241c07d6-b766-4654-b5c1-8c5257ecad91]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83240a3d-a866-4ba1-9d61-472c1d1a86f7 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:46:07 user nova-compute[74337]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83240a3d-a866-4ba1-9d61-472c1d1a86f7 (non-flash)
Oct 23 21:46:07 user nova-compute[74337]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c (non-flash)
Oct 23 21:46:07 user nova-compute[74337]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac (non-flash)
Oct 23 21:46:07 user nova-compute[74337]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c (non-flash)
Oct 23 21:46:07 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:46:07 user nova-compute[74337]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83240a3d-a866-4ba1-9d61-472c1d1a86f7 (non-flash)
Oct 23 21:46:07 user nova-compute[74337]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c (non-flash)
Oct 23 21:46:07 user nova-compute[74337]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac (non-flash)
Oct 23 21:46:07 user nova-compute[74337]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c (non-flash)
Oct 23 21:46:07 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Connected to 172.16.0.220:3260 {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] HCTL ('37', '-', '-', 0) found on session 29 with lun 0 {{(pid=74337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf60cd27-3a66-4f73-acf9-153b326868d4]: (4, ('- - 0', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Searching for a device in session 29 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 21:46:07 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FWrOaikx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 21:46:08 user nova-compute[74337]: DEBUG nova.network.neutron [-] [instance: 60bd4497-75ce-4ad2-bef9-303f293244db] Updating instance_info_cache with network_info: [] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:46:08 user nova-compute[74337]: INFO nova.compute.manager [-] [instance: 60bd4497-75ce-4ad2-bef9-303f293244db] Took 0.81 seconds to deallocate network for instance.
Oct 23 21:46:08 user nova-compute[74337]: DEBUG nova.compute.manager [req-5f73683e-8fcf-4ebb-9ac6-2cea142e8a7d req-6f06811d-cf4e-467f-9f1c-59036bb2f4c4 service nova] [instance: 60bd4497-75ce-4ad2-bef9-303f293244db] Received event network-vif-deleted-4bf6b6b9-0602-4d1e-a34d-c46f903a45b0 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:46:08 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-920b3149-44d4-4a9b-a8cf-56c25e2a14ce tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:46:08 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-920b3149-44d4-4a9b-a8cf-56c25e2a14ce tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:46:08 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:46:08 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:46:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:46:08 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-920b3149-44d4-4a9b-a8cf-56c25e2a14ce tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:46:08 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-920b3149-44d4-4a9b-a8cf-56c25e2a14ce tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:46:08 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-920b3149-44d4-4a9b-a8cf-56c25e2a14ce tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.396s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:46:08 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.186s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:46:08 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:46:08 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Auditing locally available compute resources for user (node: user) {{(pid=74337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 21:46:08 user nova-compute[74337]: INFO nova.scheduler.client.report [None req-920b3149-44d4-4a9b-a8cf-56c25e2a14ce tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Deleted allocations for instance 60bd4497-75ce-4ad2-bef9-303f293244db
Oct 23 21:46:08 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-920b3149-44d4-4a9b-a8cf-56c25e2a14ce tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lock "60bd4497-75ce-4ad2-bef9-303f293244db" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.313s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:46:08 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 21:46:08 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56a4b932-486d-4b8d-9616-99e75592432a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:46:08 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.355s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:46:08 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] <== connect_volume: return (1358ms) {'type': 'block', 'scsi_wwn': '26134333739373734', 'path': '/dev/sdf'} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:46:08 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26134333739373734', 'path': '/dev/sdf'} {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 21:46:08 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-23T21:43:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-696848694',display_name='tempest-ServerActionsTestOtherA-server-751708093',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-696848694',id=23,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAWzQm4+V4g91dNEdG8YLkJhCynO3Ap8ILaI8oMN1LNLl54g3kIsrbEh6Mxm9fgmaJnzv3izz6qYqT1bG4NWKyccXk+mb+zPPixuCgYlO6IQfM8pLRdMrw36YsRSiIFnHQ==',key_name='tempest-keypair-1081806285',keypairs=<?>,launch_index=0,launched_at=2023-10-23T21:43:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e1f57e58a9ec4c6384dc0d3ca58eb610',ramdisk_id='',reservation_id='r-8no3m5aa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-100075475',owner_user_name='tempest-ServerActionsTestOtherA-100075475-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:45:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='891ee2e3acc54ed0bc4571f63ff491a0',uuid=195a4056-3254-4558-b2f5-299bcd4af07c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "efec7d56-28cb-4da2-b6f7-6e9777d3377b", "address": "fa:16:3e:26:a4:b5", "network": {"id": "aff1f95f-fda8-4f0f-8d10-7e3d587e4fda", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2048135647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1f57e58a9ec4c6384dc0d3ca58eb610", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefec7d56-28", "ovs_interfaceid": "efec7d56-28cb-4da2-b6f7-6e9777d3377b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 21:46:08 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Converting VIF {"id": "efec7d56-28cb-4da2-b6f7-6e9777d3377b", "address": "fa:16:3e:26:a4:b5", "network": {"id": "aff1f95f-fda8-4f0f-8d10-7e3d587e4fda", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2048135647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1f57e58a9ec4c6384dc0d3ca58eb610", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefec7d56-28", "ovs_interfaceid": "efec7d56-28cb-4da2-b6f7-6e9777d3377b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:46:08 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:26:a4:b5,bridge_name='br-int',has_traffic_filtering=True,id=efec7d56-28cb-4da2-b6f7-6e9777d3377b,network=Network(aff1f95f-fda8-4f0f-8d10-7e3d587e4fda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefec7d56-28') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:46:08 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] End _get_guest_xml xml=<domain type="kvm">
Oct 23 21:46:08 user nova-compute[74337]:   <uuid>195a4056-3254-4558-b2f5-299bcd4af07c</uuid>
Oct 23 21:46:08 user nova-compute[74337]:   <name>instance-00000017</name>
Oct 23 21:46:08 user nova-compute[74337]:   <memory>524288</memory>
Oct 23 21:46:08 user nova-compute[74337]:   <vcpu>1</vcpu>
Oct 23 21:46:08 user nova-compute[74337]:   <metadata>
Oct 23 21:46:08 user nova-compute[74337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 21:46:08 user nova-compute[74337]:       <nova:package version="0.0.0"/>
Oct 23 21:46:08 user nova-compute[74337]:       <nova:name>tempest-ServerActionsTestOtherA-server-751708093</nova:name>
Oct 23 21:46:08 user nova-compute[74337]:       <nova:creationTime>2023-10-23 21:46:07</nova:creationTime>
Oct 23 21:46:08 user nova-compute[74337]:       <nova:flavor name="m1.tiny">
Oct 23 21:46:08 user nova-compute[74337]:         <nova:memory>512</nova:memory>
Oct 23 21:46:08 user nova-compute[74337]:         <nova:disk>1</nova:disk>
Oct 23 21:46:08 user nova-compute[74337]:         <nova:swap>0</nova:swap>
Oct 23 21:46:08 user nova-compute[74337]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 21:46:08 user nova-compute[74337]:         <nova:vcpus>1</nova:vcpus>
Oct 23 21:46:08 user nova-compute[74337]:       </nova:flavor>
Oct 23 21:46:08 user nova-compute[74337]:       <nova:owner>
Oct 23 21:46:08 user nova-compute[74337]:         <nova:user uuid="891ee2e3acc54ed0bc4571f63ff491a0">tempest-ServerActionsTestOtherA-100075475-project-member</nova:user>
Oct 23 21:46:08 user nova-compute[74337]:         <nova:project uuid="e1f57e58a9ec4c6384dc0d3ca58eb610">tempest-ServerActionsTestOtherA-100075475</nova:project>
Oct 23 21:46:08 user nova-compute[74337]:       </nova:owner>
Oct 23 21:46:08 user nova-compute[74337]:       <nova:root type="image" uuid="d859d89d-998d-4109-b26a-0d6e28152932"/>
Oct 23 21:46:08 user nova-compute[74337]:       <nova:ports>
Oct 23 21:46:08 user nova-compute[74337]:         <nova:port uuid="efec7d56-28cb-4da2-b6f7-6e9777d3377b">
Oct 23 21:46:08 user nova-compute[74337]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 23 21:46:08 user nova-compute[74337]:         </nova:port>
Oct 23 21:46:08 user nova-compute[74337]:       </nova:ports>
Oct 23 21:46:08 user nova-compute[74337]:     </nova:instance>
Oct 23 21:46:08 user nova-compute[74337]:   </metadata>
Oct 23 21:46:08 user nova-compute[74337]:   <sysinfo type="smbios">
Oct 23 21:46:08 user nova-compute[74337]:     <system>
Oct 23 21:46:08 user nova-compute[74337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 21:46:08 user nova-compute[74337]:       <entry name="product">OpenStack Nova</entry>
Oct 23 21:46:08 user nova-compute[74337]:       <entry name="version">0.0.0</entry>
Oct 23 21:46:08 user nova-compute[74337]:       <entry name="serial">195a4056-3254-4558-b2f5-299bcd4af07c</entry>
Oct 23 21:46:08 user nova-compute[74337]:       <entry name="uuid">195a4056-3254-4558-b2f5-299bcd4af07c</entry>
Oct 23 21:46:08 user nova-compute[74337]:       <entry name="family">Virtual Machine</entry>
Oct 23 21:46:08 user nova-compute[74337]:     </system>
Oct 23 21:46:08 user nova-compute[74337]:   </sysinfo>
Oct 23 21:46:08 user nova-compute[74337]:   <os>
Oct 23 21:46:08 user nova-compute[74337]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 21:46:08 user nova-compute[74337]:     <boot dev="hd"/>
Oct 23 21:46:08 user nova-compute[74337]:     <smbios mode="sysinfo"/>
Oct 23 21:46:08 user nova-compute[74337]:   </os>
Oct 23 21:46:08 user nova-compute[74337]:   <features>
Oct 23 21:46:08 user nova-compute[74337]:     <acpi/>
Oct 23 21:46:08 user nova-compute[74337]:     <apic/>
Oct 23 21:46:08 user nova-compute[74337]:     <vmcoreinfo/>
Oct 23 21:46:08 user nova-compute[74337]:   </features>
Oct 23 21:46:08 user nova-compute[74337]:   <clock offset="utc">
Oct 23 21:46:08 user nova-compute[74337]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 21:46:08 user nova-compute[74337]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 21:46:08 user nova-compute[74337]:     <timer name="hpet" present="no"/>
Oct 23 21:46:08 user nova-compute[74337]:   </clock>
Oct 23 21:46:08 user nova-compute[74337]:   <cpu mode="custom" match="exact">
Oct 23 21:46:08 user nova-compute[74337]:     <model>Nehalem</model>
Oct 23 21:46:08 user nova-compute[74337]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 21:46:08 user nova-compute[74337]:   </cpu>
Oct 23 21:46:08 user nova-compute[74337]:   <devices>
Oct 23 21:46:08 user nova-compute[74337]:     <disk type="file" device="disk">
Oct 23 21:46:08 user nova-compute[74337]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 21:46:08 user nova-compute[74337]:       <source file="/opt/stack/data/nova/instances/195a4056-3254-4558-b2f5-299bcd4af07c/disk"/>
Oct 23 21:46:08 user nova-compute[74337]:       <target dev="vda" bus="virtio"/>
Oct 23 21:46:08 user nova-compute[74337]:     </disk>
Oct 23 21:46:08 user nova-compute[74337]:     <disk type="block" device="disk">
Oct 23 21:46:08 user nova-compute[74337]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 21:46:08 user nova-compute[74337]:       <source dev="/dev/sdf"/>
Oct 23 21:46:08 user nova-compute[74337]:       <target dev="vdb" bus="virtio"/>
Oct 23 21:46:08 user nova-compute[74337]:       <serial>9a863deb-8b0f-4e44-b7d7-16ace509f43c</serial>
Oct 23 21:46:08 user nova-compute[74337]:     </disk>
Oct 23 21:46:08 user nova-compute[74337]:     <interface type="ethernet">
Oct 23 21:46:08 user nova-compute[74337]:       <mac address="fa:16:3e:26:a4:b5"/>
Oct 23 21:46:08 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:46:08 user nova-compute[74337]:       <mtu size="1442"/>
Oct 23 21:46:08 user nova-compute[74337]:       <target dev="tapefec7d56-28"/>
Oct 23 21:46:08 user nova-compute[74337]:     </interface>
Oct 23 21:46:08 user nova-compute[74337]:     <serial type="pty">
Oct 23 21:46:08 user nova-compute[74337]:       <log file="/opt/stack/data/nova/instances/195a4056-3254-4558-b2f5-299bcd4af07c/console.log" append="off"/>
Oct 23 21:46:08 user nova-compute[74337]:     </serial>
Oct 23 21:46:08 user nova-compute[74337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 21:46:08 user nova-compute[74337]:     <video>
Oct 23 21:46:08 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:46:08 user nova-compute[74337]:     </video>
Oct 23 21:46:08 user nova-compute[74337]:     <rng model="virtio">
Oct 23 21:46:08 user nova-compute[74337]:       <backend model="random">/dev/urandom</backend>
Oct 23 21:46:08 user nova-compute[74337]:     </rng>
Oct 23 21:46:08 user nova-compute[74337]:     <controller type="usb" index="0" model="none"/>
Oct 23 21:46:08 user nova-compute[74337]:     <memballoon model="virtio">
Oct 23 21:46:08 user nova-compute[74337]:       <stats period="10"/>
Oct 23 21:46:08 user nova-compute[74337]:     </memballoon>
Oct 23 21:46:08 user nova-compute[74337]:   </devices>
Oct 23 21:46:08 user nova-compute[74337]: </domain>
Oct 23 21:46:08 user nova-compute[74337]:  {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 21:46:08 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-23T21:43:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-696848694',display_name='tempest-ServerActionsTestOtherA-server-751708093',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-696848694',id=23,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAWzQm4+V4g91dNEdG8YLkJhCynO3Ap8ILaI8oMN1LNLl54g3kIsrbEh6Mxm9fgmaJnzv3izz6qYqT1bG4NWKyccXk+mb+zPPixuCgYlO6IQfM8pLRdMrw36YsRSiIFnHQ==',key_name='tempest-keypair-1081806285',keypairs=<?>,launch_index=0,launched_at=2023-10-23T21:43:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e1f57e58a9ec4c6384dc0d3ca58eb610',ramdisk_id='',reservation_id='r-8no3m5aa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-100075475',owner_user_name='tempest-ServerActionsTestOtherA-100075475-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:45:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='891ee2e3acc54ed0bc4571f63ff491a0',uuid=195a4056-3254-4558-b2f5-299bcd4af07c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "efec7d56-28cb-4da2-b6f7-6e9777d3377b", "address": "fa:16:3e:26:a4:b5", "network": {"id": "aff1f95f-fda8-4f0f-8d10-7e3d587e4fda", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2048135647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1f57e58a9ec4c6384dc0d3ca58eb610", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefec7d56-28", "ovs_interfaceid": "efec7d56-28cb-4da2-b6f7-6e9777d3377b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 21:46:08 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Converting VIF {"id": "efec7d56-28cb-4da2-b6f7-6e9777d3377b", "address": "fa:16:3e:26:a4:b5", "network": {"id": "aff1f95f-fda8-4f0f-8d10-7e3d587e4fda", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2048135647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1f57e58a9ec4c6384dc0d3ca58eb610", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefec7d56-28", "ovs_interfaceid": "efec7d56-28cb-4da2-b6f7-6e9777d3377b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:46:08 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:26:a4:b5,bridge_name='br-int',has_traffic_filtering=True,id=efec7d56-28cb-4da2-b6f7-6e9777d3377b,network=Network(aff1f95f-fda8-4f0f-8d10-7e3d587e4fda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefec7d56-28') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:46:08 user nova-compute[74337]: DEBUG os_vif [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:a4:b5,bridge_name='br-int',has_traffic_filtering=True,id=efec7d56-28cb-4da2-b6f7-6e9777d3377b,network=Network(aff1f95f-fda8-4f0f-8d10-7e3d587e4fda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefec7d56-28') {{(pid=74337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 21:46:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:46:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:46:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 21:46:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:46:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bc0d3ecb-81f0-5244-9589-dbd71808393f', '_type': 'linux-noop'}}, row=False) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:46:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:46:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:46:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapefec7d56-28, may_exist=True, interface_attrs={}) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:46:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapefec7d56-28, col_values=(('qos', UUID('b6813fd5-4920-4b9d-a79f-71f30f7df8fe')),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:46:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapefec7d56-28, col_values=(('external_ids', {'iface-id': 'efec7d56-28cb-4da2-b6f7-6e9777d3377b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:26:a4:b5', 'vm-uuid': '195a4056-3254-4558-b2f5-299bcd4af07c'}),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:46:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:46:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:46:08 user nova-compute[74337]: INFO os_vif [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:a4:b5,bridge_name='br-int',has_traffic_filtering=True,id=efec7d56-28cb-4da2-b6f7-6e9777d3377b,network=Network(aff1f95f-fda8-4f0f-8d10-7e3d587e4fda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefec7d56-28')
Oct 23 21:46:08 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] No BDM found with device name vda, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 21:46:08 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 21:46:08 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] No VIF found with MAC fa:16:3e:26:a4:b5, not building metadata {{(pid=74337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 21:46:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56a4b932-486d-4b8d-9616-99e75592432a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:46:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56a4b932-486d-4b8d-9616-99e75592432a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:46:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56a4b932-486d-4b8d-9616-99e75592432a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:46:09 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 21:46:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/547c4d4c-e0dd-495a-b83f-98426d0a4a99/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:46:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/547c4d4c-e0dd-495a-b83f-98426d0a4a99/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:46:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/547c4d4c-e0dd-495a-b83f-98426d0a4a99/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:46:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/547c4d4c-e0dd-495a-b83f-98426d0a4a99/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:46:09 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 21:46:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba8d1d0-5fac-4213-9a50-a4e273710b1b/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:46:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba8d1d0-5fac-4213-9a50-a4e273710b1b/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:46:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba8d1d0-5fac-4213-9a50-a4e273710b1b/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:46:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba8d1d0-5fac-4213-9a50-a4e273710b1b/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:46:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01d407b0-a7cf-4222-9f2d-54b99eeeed84/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:46:10 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01d407b0-a7cf-4222-9f2d-54b99eeeed84/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:46:10 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01d407b0-a7cf-4222-9f2d-54b99eeeed84/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:46:10 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:46:10 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01d407b0-a7cf-4222-9f2d-54b99eeeed84/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:46:10 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 21:46:10 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:46:10 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1189976f-8d02-468d-8fa7-bd5594c5f85a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:46:10 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:46:10 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1189976f-8d02-468d-8fa7-bd5594c5f85a/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:46:10 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1189976f-8d02-468d-8fa7-bd5594c5f85a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:46:10 user nova-compute[74337]: DEBUG nova.compute.manager [req-43c8dcb1-1e08-443c-82a1-659f944c7095 req-7d8c1227-c1b4-4d43-bee6-c3a441c59c42 service nova] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Received event network-vif-plugged-efec7d56-28cb-4da2-b6f7-6e9777d3377b {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:46:10 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-43c8dcb1-1e08-443c-82a1-659f944c7095 req-7d8c1227-c1b4-4d43-bee6-c3a441c59c42 service nova] Acquiring lock "195a4056-3254-4558-b2f5-299bcd4af07c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:46:10 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-43c8dcb1-1e08-443c-82a1-659f944c7095 req-7d8c1227-c1b4-4d43-bee6-c3a441c59c42 service nova] Lock "195a4056-3254-4558-b2f5-299bcd4af07c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:46:10 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-43c8dcb1-1e08-443c-82a1-659f944c7095 req-7d8c1227-c1b4-4d43-bee6-c3a441c59c42 service nova] Lock "195a4056-3254-4558-b2f5-299bcd4af07c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:46:10 user nova-compute[74337]: DEBUG nova.compute.manager [req-43c8dcb1-1e08-443c-82a1-659f944c7095 req-7d8c1227-c1b4-4d43-bee6-c3a441c59c42 service nova] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] No waiting events found dispatching network-vif-plugged-efec7d56-28cb-4da2-b6f7-6e9777d3377b {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:46:10 user nova-compute[74337]: WARNING nova.compute.manager [req-43c8dcb1-1e08-443c-82a1-659f944c7095 req-7d8c1227-c1b4-4d43-bee6-c3a441c59c42 service nova] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Received unexpected event network-vif-plugged-efec7d56-28cb-4da2-b6f7-6e9777d3377b for instance with vm_state active and task_state rebuild_spawning.
Oct 23 21:46:10 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:46:10 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:46:10 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1189976f-8d02-468d-8fa7-bd5594c5f85a/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:46:11 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:46:11 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:46:11 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Hypervisor/Node resource view: name=user free_ram=7969MB free_disk=25.363906860351562GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 21:46:11 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:46:11 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:46:11 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 1189976f-8d02-468d-8fa7-bd5594c5f85a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:46:11 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 0ba8d1d0-5fac-4213-9a50-a4e273710b1b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:46:11 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 547c4d4c-e0dd-495a-b83f-98426d0a4a99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:46:11 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 00f757cf-e5dd-476f-81c6-670ed2bf6938 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Oct 23 21:46:11 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 56a4b932-486d-4b8d-9616-99e75592432a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:46:11 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:46:11 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 01d407b0-a7cf-4222-9f2d-54b99eeeed84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:46:11 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 195a4056-3254-4558-b2f5-299bcd4af07c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:46:11 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 89e792eb-ad8f-4bb7-adac-315c3415cd6d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:46:11 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 21:46:11 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 21:46:11 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:46:11 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:46:11 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Compute_service record updated for user:user {{(pid=74337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 21:46:11 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.544s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:46:12 user nova-compute[74337]: DEBUG nova.compute.manager [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Instance event wait completed in 0 seconds for  {{(pid=74337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 21:46:12 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Guest created on hypervisor {{(pid=74337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 21:46:12 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Instance spawned successfully.
Oct 23 21:46:12 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 21:46:12 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Found default for hw_cdrom_bus of ide {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:46:12 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Found default for hw_disk_bus of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:46:12 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Found default for hw_input_bus of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:46:12 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Found default for hw_pointer_model of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:46:12 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Found default for hw_video_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:46:12 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Found default for hw_vif_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:46:12 user nova-compute[74337]: DEBUG nova.compute.manager [req-4e967e97-3afe-4310-8b53-a8cd419238e0 req-7ba75122-33f0-426e-8ecb-a0d2b6aa2a64 service nova] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Received event network-vif-plugged-efec7d56-28cb-4da2-b6f7-6e9777d3377b {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:46:12 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-4e967e97-3afe-4310-8b53-a8cd419238e0 req-7ba75122-33f0-426e-8ecb-a0d2b6aa2a64 service nova] Acquiring lock "195a4056-3254-4558-b2f5-299bcd4af07c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:46:12 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-4e967e97-3afe-4310-8b53-a8cd419238e0 req-7ba75122-33f0-426e-8ecb-a0d2b6aa2a64 service nova] Lock "195a4056-3254-4558-b2f5-299bcd4af07c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:46:12 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-4e967e97-3afe-4310-8b53-a8cd419238e0 req-7ba75122-33f0-426e-8ecb-a0d2b6aa2a64 service nova] Lock "195a4056-3254-4558-b2f5-299bcd4af07c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:46:12 user nova-compute[74337]: DEBUG nova.compute.manager [req-4e967e97-3afe-4310-8b53-a8cd419238e0 req-7ba75122-33f0-426e-8ecb-a0d2b6aa2a64 service nova] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] No waiting events found dispatching network-vif-plugged-efec7d56-28cb-4da2-b6f7-6e9777d3377b {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:46:12 user nova-compute[74337]: WARNING nova.compute.manager [req-4e967e97-3afe-4310-8b53-a8cd419238e0 req-7ba75122-33f0-426e-8ecb-a0d2b6aa2a64 service nova] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Received unexpected event network-vif-plugged-efec7d56-28cb-4da2-b6f7-6e9777d3377b for instance with vm_state active and task_state rebuild_spawning.
Oct 23 21:46:12 user nova-compute[74337]: DEBUG nova.compute.manager [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Checking state {{(pid=74337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 21:46:12 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:46:12 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:46:12 user nova-compute[74337]: DEBUG nova.objects.instance [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74337) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1078}}
Oct 23 21:46:12 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-30e7660d-f7e2-43bc-a14d-8eaa94cfffea tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.081s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:46:13 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:46:13 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:46:14 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:46:14 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:46:15 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:46:18 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:46:18 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:46:23 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:46:28 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:46:28 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:46:33 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:46:33 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:46:38 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:46:38 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:46:43 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:46:43 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:46:48 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:46:48 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:46:48 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 21:46:48 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 21:46:48 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 21:46:48 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:46:53 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:46:53 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:46:53 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 21:46:53 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 21:46:53 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 21:46:53 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:46:57 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:46:58 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-b3210a07-58e8-411f-b978-3c48cb1c00c5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Acquiring lock "01d407b0-a7cf-4222-9f2d-54b99eeeed84" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:46:58 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-b3210a07-58e8-411f-b978-3c48cb1c00c5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lock "01d407b0-a7cf-4222-9f2d-54b99eeeed84" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:46:58 user nova-compute[74337]: INFO nova.compute.manager [None req-b3210a07-58e8-411f-b978-3c48cb1c00c5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 01d407b0-a7cf-4222-9f2d-54b99eeeed84] Detaching volume 83240a3d-a866-4ba1-9d61-472c1d1a86f7
Oct 23 21:46:58 user nova-compute[74337]: INFO nova.virt.block_device [None req-b3210a07-58e8-411f-b978-3c48cb1c00c5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 01d407b0-a7cf-4222-9f2d-54b99eeeed84] Attempting to driver detach volume 83240a3d-a866-4ba1-9d61-472c1d1a86f7 from mountpoint /dev/vdb
Oct 23 21:46:58 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-b3210a07-58e8-411f-b978-3c48cb1c00c5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Attempting to detach device vdb from instance 01d407b0-a7cf-4222-9f2d-54b99eeeed84 from the persistent domain config. {{(pid=74337) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 21:46:58 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-b3210a07-58e8-411f-b978-3c48cb1c00c5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 21:46:58 user nova-compute[74337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 21:46:58 user nova-compute[74337]:   <source dev="/dev/sdd"/>
Oct 23 21:46:58 user nova-compute[74337]:   <target dev="vdb" bus="virtio"/>
Oct 23 21:46:58 user nova-compute[74337]:   <serial>83240a3d-a866-4ba1-9d61-472c1d1a86f7</serial>
Oct 23 21:46:58 user nova-compute[74337]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 21:46:58 user nova-compute[74337]: </disk>
Oct 23 21:46:58 user nova-compute[74337]:  {{(pid=74337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 21:46:58 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-b3210a07-58e8-411f-b978-3c48cb1c00c5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Successfully detached device vdb from instance 01d407b0-a7cf-4222-9f2d-54b99eeeed84 from the persistent domain config.
Oct 23 21:46:58 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-b3210a07-58e8-411f-b978-3c48cb1c00c5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 01d407b0-a7cf-4222-9f2d-54b99eeeed84 from the live domain config. {{(pid=74337) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 21:46:58 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-b3210a07-58e8-411f-b978-3c48cb1c00c5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 21:46:58 user nova-compute[74337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 21:46:58 user nova-compute[74337]:   <source dev="/dev/sdd"/>
Oct 23 21:46:58 user nova-compute[74337]:   <target dev="vdb" bus="virtio"/>
Oct 23 21:46:58 user nova-compute[74337]:   <serial>83240a3d-a866-4ba1-9d61-472c1d1a86f7</serial>
Oct 23 21:46:58 user nova-compute[74337]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 21:46:58 user nova-compute[74337]: </disk>
Oct 23 21:46:58 user nova-compute[74337]:  {{(pid=74337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 21:46:58 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-b3210a07-58e8-411f-b978-3c48cb1c00c5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 01d407b0-a7cf-4222-9f2d-54b99eeeed84 {{(pid=74337) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 21:46:58 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:47:03 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:47:04 user nova-compute[74337]: DEBUG nova.compute.manager [req-9d251669-38b3-4d49-83f5-9fcd033812bb req-991de63c-d904-4244-8c19-1a467ec30ba1 service nova] [instance: 89e792eb-ad8f-4bb7-adac-315c3415cd6d] Received event network-changed-c23a4c6d-9fd0-4cd3-afa9-5ccf4520d90e {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:47:04 user nova-compute[74337]: DEBUG nova.compute.manager [req-9d251669-38b3-4d49-83f5-9fcd033812bb req-991de63c-d904-4244-8c19-1a467ec30ba1 service nova] [instance: 89e792eb-ad8f-4bb7-adac-315c3415cd6d] Refreshing instance network info cache due to event network-changed-c23a4c6d-9fd0-4cd3-afa9-5ccf4520d90e. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 21:47:04 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-9d251669-38b3-4d49-83f5-9fcd033812bb req-991de63c-d904-4244-8c19-1a467ec30ba1 service nova] Acquiring lock "refresh_cache-89e792eb-ad8f-4bb7-adac-315c3415cd6d" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:47:04 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-9d251669-38b3-4d49-83f5-9fcd033812bb req-991de63c-d904-4244-8c19-1a467ec30ba1 service nova] Acquired lock "refresh_cache-89e792eb-ad8f-4bb7-adac-315c3415cd6d" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:47:04 user nova-compute[74337]: DEBUG nova.network.neutron [req-9d251669-38b3-4d49-83f5-9fcd033812bb req-991de63c-d904-4244-8c19-1a467ec30ba1 service nova] [instance: 89e792eb-ad8f-4bb7-adac-315c3415cd6d] Refreshing network info cache for port c23a4c6d-9fd0-4cd3-afa9-5ccf4520d90e {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 21:47:04 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:47:04 user nova-compute[74337]: DEBUG nova.network.neutron [req-9d251669-38b3-4d49-83f5-9fcd033812bb req-991de63c-d904-4244-8c19-1a467ec30ba1 service nova] [instance: 89e792eb-ad8f-4bb7-adac-315c3415cd6d] Updated VIF entry in instance network info cache for port c23a4c6d-9fd0-4cd3-afa9-5ccf4520d90e. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 21:47:04 user nova-compute[74337]: DEBUG nova.network.neutron [req-9d251669-38b3-4d49-83f5-9fcd033812bb req-991de63c-d904-4244-8c19-1a467ec30ba1 service nova] [instance: 89e792eb-ad8f-4bb7-adac-315c3415cd6d] Updating instance_info_cache with network_info: [{"id": "c23a4c6d-9fd0-4cd3-afa9-5ccf4520d90e", "address": "fa:16:3e:9e:8d:44", "network": {"id": "5a18e96f-a6eb-4989-9be3-154b54928b03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-507511840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb567547bd4941fb87435a841c9d17c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc23a4c6d-9f", "ovs_interfaceid": "c23a4c6d-9fd0-4cd3-afa9-5ccf4520d90e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:47:04 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-9d251669-38b3-4d49-83f5-9fcd033812bb req-991de63c-d904-4244-8c19-1a467ec30ba1 service nova] Releasing lock "refresh_cache-89e792eb-ad8f-4bb7-adac-315c3415cd6d" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:47:05 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:47:05 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Starting heal instance info cache {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 21:47:05 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "refresh_cache-0ba8d1d0-5fac-4213-9a50-a4e273710b1b" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:47:05 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquired lock "refresh_cache-0ba8d1d0-5fac-4213-9a50-a4e273710b1b" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:47:05 user nova-compute[74337]: DEBUG nova.network.neutron [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 0ba8d1d0-5fac-4213-9a50-a4e273710b1b] Forcefully refreshing network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 21:47:06 user nova-compute[74337]: DEBUG nova.network.neutron [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 0ba8d1d0-5fac-4213-9a50-a4e273710b1b] Updating instance_info_cache with network_info: [{"id": "c7a03b6c-5d0f-4a54-b615-16c7546eb5f7", "address": "fa:16:3e:b6:7b:d0", "network": {"id": "3d6e3d17-6da2-4ac1-ab9f-b7ed54db79bc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1078020443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83700495146c4b0e8d76491380b5f895", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7a03b6c-5d", "ovs_interfaceid": "c7a03b6c-5d0f-4a54-b615-16c7546eb5f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:47:06 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Releasing lock "refresh_cache-0ba8d1d0-5fac-4213-9a50-a4e273710b1b" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:47:06 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 0ba8d1d0-5fac-4213-9a50-a4e273710b1b] Updated the network info_cache for instance {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 21:47:06 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:47:06 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 21:47:07 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:47:08 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:47:08 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:47:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:47:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:47:10 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:47:10 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:47:10 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:47:10 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:47:10 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Auditing locally available compute resources for user (node: user) {{(pid=74337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 21:47:10 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 21:47:10 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56a4b932-486d-4b8d-9616-99e75592432a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:47:10 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56a4b932-486d-4b8d-9616-99e75592432a/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:47:10 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56a4b932-486d-4b8d-9616-99e75592432a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:47:11 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56a4b932-486d-4b8d-9616-99e75592432a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:47:11 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 21:47:11 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/547c4d4c-e0dd-495a-b83f-98426d0a4a99/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:47:11 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/547c4d4c-e0dd-495a-b83f-98426d0a4a99/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:47:11 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/547c4d4c-e0dd-495a-b83f-98426d0a4a99/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:47:11 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/547c4d4c-e0dd-495a-b83f-98426d0a4a99/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:47:11 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 21:47:11 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba8d1d0-5fac-4213-9a50-a4e273710b1b/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:47:11 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba8d1d0-5fac-4213-9a50-a4e273710b1b/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:47:11 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba8d1d0-5fac-4213-9a50-a4e273710b1b/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:47:11 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba8d1d0-5fac-4213-9a50-a4e273710b1b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:47:11 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01d407b0-a7cf-4222-9f2d-54b99eeeed84/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:47:11 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01d407b0-a7cf-4222-9f2d-54b99eeeed84/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:47:11 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01d407b0-a7cf-4222-9f2d-54b99eeeed84/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:47:12 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01d407b0-a7cf-4222-9f2d-54b99eeeed84/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:47:12 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195a4056-3254-4558-b2f5-299bcd4af07c/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:47:12 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195a4056-3254-4558-b2f5-299bcd4af07c/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:47:12 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195a4056-3254-4558-b2f5-299bcd4af07c/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:47:12 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195a4056-3254-4558-b2f5-299bcd4af07c/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:47:12 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 21:47:12 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1189976f-8d02-468d-8fa7-bd5594c5f85a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:47:12 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1189976f-8d02-468d-8fa7-bd5594c5f85a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:47:12 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1189976f-8d02-468d-8fa7-bd5594c5f85a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:47:12 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1189976f-8d02-468d-8fa7-bd5594c5f85a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:47:13 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:47:13 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:47:13 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Hypervisor/Node resource view: name=user free_ram=7890MB free_disk=25.332786560058594GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 21:47:13 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:47:13 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:47:13 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 1189976f-8d02-468d-8fa7-bd5594c5f85a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:47:13 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 0ba8d1d0-5fac-4213-9a50-a4e273710b1b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:47:13 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 547c4d4c-e0dd-495a-b83f-98426d0a4a99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:47:13 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 00f757cf-e5dd-476f-81c6-670ed2bf6938 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Oct 23 21:47:13 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 56a4b932-486d-4b8d-9616-99e75592432a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:47:13 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:47:13 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 01d407b0-a7cf-4222-9f2d-54b99eeeed84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:47:13 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 195a4056-3254-4558-b2f5-299bcd4af07c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:47:13 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 89e792eb-ad8f-4bb7-adac-315c3415cd6d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:47:13 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 21:47:13 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 21:47:13 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:47:13 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:47:13 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:47:13 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Compute_service record updated for user:user {{(pid=74337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 21:47:13 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.477s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:47:13 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:47:15 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:47:15 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:47:17 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Acquiring lock "4f85754a-aad0-43b7-9a99-65aa567eb114" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:47:17 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "4f85754a-aad0-43b7-9a99-65aa567eb114" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:47:17 user nova-compute[74337]: DEBUG nova.compute.manager [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 4f85754a-aad0-43b7-9a99-65aa567eb114] Starting instance... {{(pid=74337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 21:47:17 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:47:17 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:47:17 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:47:17 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 21:47:17 user nova-compute[74337]: INFO nova.compute.claims [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 4f85754a-aad0-43b7-9a99-65aa567eb114] Claim successful on node user
Oct 23 21:47:17 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:47:17 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:47:18 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.689s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:47:18 user nova-compute[74337]: DEBUG nova.compute.manager [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 4f85754a-aad0-43b7-9a99-65aa567eb114] Start building networks asynchronously for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 21:47:18 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 4f85754a-aad0-43b7-9a99-65aa567eb114] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 21:47:18 user nova-compute[74337]: DEBUG nova.compute.manager [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 4f85754a-aad0-43b7-9a99-65aa567eb114] Allocating IP information in the background. {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 21:47:18 user nova-compute[74337]: DEBUG nova.network.neutron [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 4f85754a-aad0-43b7-9a99-65aa567eb114] allocate_for_instance() {{(pid=74337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 21:47:18 user nova-compute[74337]: DEBUG nova.compute.manager [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 4f85754a-aad0-43b7-9a99-65aa567eb114] Start building block device mappings for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 21:47:18 user nova-compute[74337]: DEBUG nova.policy [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0c3e635e8e5447138a7f2db11695574c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb567547bd4941fb87435a841c9d17c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74337) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 21:47:18 user nova-compute[74337]: INFO nova.virt.block_device [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 4f85754a-aad0-43b7-9a99-65aa567eb114] Booting with volume snapshot e68156c7-83e5-43e7-bb3e-f896e70d9466 at /dev/vda
Oct 23 21:47:18 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-b3210a07-58e8-411f-b978-3c48cb1c00c5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 01d407b0-a7cf-4222-9f2d-54b99eeeed84 is timed out.
Oct 23 21:47:18 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-b3210a07-58e8-411f-b978-3c48cb1c00c5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Successfully detached device vdb from instance 01d407b0-a7cf-4222-9f2d-54b99eeeed84 from the live domain config.
Oct 23 21:47:18 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3210a07-58e8-411f-b978-3c48cb1c00c5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 01d407b0-a7cf-4222-9f2d-54b99eeeed84] calling os-brick to detach iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 21:47:18 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3210a07-58e8-411f-b978-3c48cb1c00c5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, {'target_iqn': 'iqn.2010-10.org.openstack:83240a3d-a866-4ba1-9d61-472c1d1a86f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oMDVAiCz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:47:18 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-b3210a07-58e8-411f-b978-3c48cb1c00c5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:47:18 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-b3210a07-58e8-411f-b978-3c48cb1c00c5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:47:18 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-b3210a07-58e8-411f-b978-3c48cb1c00c5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:47:18 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:47:18 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:47:18 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d34ddcf-9954-45d5-9430-c45aacd7f9bb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:83240a3d-a866-4ba1-9d61-472c1d1a86f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:47:18 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3210a07-58e8-411f-b978-3c48cb1c00c5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 21:47:18 user nova-compute[74337]: No targets found.
Oct 23 21:47:18 user nova-compute[74337]: iSNS:
Oct 23 21:47:18 user nova-compute[74337]: No targets found.
Oct 23 21:47:18 user nova-compute[74337]: STATIC:
Oct 23 21:47:18 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4
Oct 23 21:47:18 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:47:18 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:47:18 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c
Oct 23 21:47:18 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:47:18 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:47:18 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac
Oct 23 21:47:18 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:47:18 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:47:18 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c
Oct 23 21:47:18 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:47:18 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:47:18 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:83240a3d-a866-4ba1-9d61-472c1d1a86f7
Oct 23 21:47:18 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:47:18 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:47:18 user nova-compute[74337]: FIRMWARE:
Oct 23 21:47:18 user nova-compute[74337]: No targets found.
Oct 23 21:47:18 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:47:18 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3210a07-58e8-411f-b978-3c48cb1c00c5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 21:47:18 user nova-compute[74337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 21:47:18 user nova-compute[74337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 21:47:18 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3210a07-58e8-411f-b978-3c48cb1c00c5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83240a3d-a866-4ba1-9d61-472c1d1a86f7', 0)] {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 21:47:18 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:47:18 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:47:18 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a142f706-db59-49d8-b27c-d5fc1db54dfd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83240a3d-a866-4ba1-9d61-472c1d1a86f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:47:18 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:47:18 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:47:18 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb3afb62-f996-4352-a9cc-3c9712b591c9]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83240a3d-a866-4ba1-9d61-472c1d1a86f7 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:47:18 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3210a07-58e8-411f-b978-3c48cb1c00c5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:47:18 user nova-compute[74337]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83240a3d-a866-4ba1-9d61-472c1d1a86f7 (non-flash)
Oct 23 21:47:18 user nova-compute[74337]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c (non-flash)
Oct 23 21:47:18 user nova-compute[74337]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac (non-flash)
Oct 23 21:47:18 user nova-compute[74337]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c (non-flash)
Oct 23 21:47:18 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:47:18 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3210a07-58e8-411f-b978-3c48cb1c00c5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:47:18 user nova-compute[74337]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83240a3d-a866-4ba1-9d61-472c1d1a86f7 (non-flash)
Oct 23 21:47:18 user nova-compute[74337]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c (non-flash)
Oct 23 21:47:18 user nova-compute[74337]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac (non-flash)
Oct 23 21:47:18 user nova-compute[74337]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c (non-flash)
Oct 23 21:47:18 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:47:18 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3210a07-58e8-411f-b978-3c48cb1c00c5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5eec387760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83240a3d-a866-4ba1-9d61-472c1d1a86f7'): ({'sdd'}, set())}) {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 21:47:18 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-b3210a07-58e8-411f-b978-3c48cb1c00c5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Removing single pathed devices sdd {{(pid=74337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 21:47:18 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:47:18 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:47:18 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[717d2688-3ddc-416c-92f4-93415008961d]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:47:18 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:47:18 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.026s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:47:18 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e9e8cf-b4e8-4325-9b63-eced4d93b72a]: (4, ('ok\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:47:18 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-b3210a07-58e8-411f-b978-3c48cb1c00c5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Flushing IO for device /dev/sdd {{(pid=74337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 21:47:18 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:47:18 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:47:18 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[5809e32a-8d56-4109-91b6-007ff3e53f3a]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:47:18 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-b3210a07-58e8-411f-b978-3c48cb1c00c5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 21:47:18 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:47:18 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.051s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:47:18 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[615c1c3c-168b-4607-93f3-e1ab003ec841]: (4, ('1', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:47:18 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-b3210a07-58e8-411f-b978-3c48cb1c00c5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 21:47:18 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-b3210a07-58e8-411f-b978-3c48cb1c00c5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] SCSI volumes sdd have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 21:47:18 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3210a07-58e8-411f-b978-3c48cb1c00c5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83240a3d-a866-4ba1-9d61-472c1d1a86f7')] {{(pid=74337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 21:47:18 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83240a3d-a866-4ba1-9d61-472c1d1a86f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:47:18 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83240a3d-a866-4ba1-9d61-472c1d1a86f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:47:18 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc0e4731-21d8-4755-b5c3-8b8b8758b825]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:47:18 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3210a07-58e8-411f-b978-3c48cb1c00c5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:47:18 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83240a3d-a866-4ba1-9d61-472c1d1a86f7 -p 172.16.0.220:3260 --logout {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:47:18 user nova-compute[74337]: DEBUG nova.network.neutron [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 4f85754a-aad0-43b7-9a99-65aa567eb114] Successfully created port: c1df869f-8a82-4004-9035-372dbfbb1cc6 {{(pid=74337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 21:47:18 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:47:18 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:47:18 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 21:47:18 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 21:47:18 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 21:47:18 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:47:18 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83240a3d-a866-4ba1-9d61-472c1d1a86f7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:47:18 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e92f61a-341c-400e-a237-d4b50a87b14a]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:83240a3d-a866-4ba1-9d61-472c1d1a86f7, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:83240a3d-a866-4ba1-9d61-472c1d1a86f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:47:18 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3210a07-58e8-411f-b978-3c48cb1c00c5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:83240a3d-a866-4ba1-9d61-472c1d1a86f7, portal: 172.16.0.220,3260]
Oct 23 21:47:18 user nova-compute[74337]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:83240a3d-a866-4ba1-9d61-472c1d1a86f7, portal: 172.16.0.220,3260] successful.
Oct 23 21:47:18 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:47:18 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83240a3d-a866-4ba1-9d61-472c1d1a86f7 -p 172.16.0.220:3260 --op delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:47:19 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83240a3d-a866-4ba1-9d61-472c1d1a86f7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:47:19 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[698b71f1-a8d4-45d9-9eca-aee1ebc2808b]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:47:19 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3210a07-58e8-411f-b978-3c48cb1c00c5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:47:19 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-b3210a07-58e8-411f-b978-3c48cb1c00c5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.366s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:47:19 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3210a07-58e8-411f-b978-3c48cb1c00c5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] <== disconnect_volume: return (368ms) None {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:47:19 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3210a07-58e8-411f-b978-3c48cb1c00c5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 01d407b0-a7cf-4222-9f2d-54b99eeeed84] Disconnected iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 21:47:19 user nova-compute[74337]: DEBUG nova.network.neutron [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 4f85754a-aad0-43b7-9a99-65aa567eb114] Successfully updated port: c1df869f-8a82-4004-9035-372dbfbb1cc6 {{(pid=74337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 21:47:19 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Acquiring lock "refresh_cache-4f85754a-aad0-43b7-9a99-65aa567eb114" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:47:19 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Acquired lock "refresh_cache-4f85754a-aad0-43b7-9a99-65aa567eb114" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:47:19 user nova-compute[74337]: DEBUG nova.network.neutron [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 4f85754a-aad0-43b7-9a99-65aa567eb114] Building network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 21:47:19 user nova-compute[74337]: DEBUG nova.compute.manager [req-3c57f744-354b-4d42-b745-0937c861a444 req-26811297-a456-4131-960d-01d74924dbf3 service nova] [instance: 4f85754a-aad0-43b7-9a99-65aa567eb114] Received event network-changed-c1df869f-8a82-4004-9035-372dbfbb1cc6 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:47:19 user nova-compute[74337]: DEBUG nova.compute.manager [req-3c57f744-354b-4d42-b745-0937c861a444 req-26811297-a456-4131-960d-01d74924dbf3 service nova] [instance: 4f85754a-aad0-43b7-9a99-65aa567eb114] Refreshing instance network info cache due to event network-changed-c1df869f-8a82-4004-9035-372dbfbb1cc6. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 21:47:19 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-3c57f744-354b-4d42-b745-0937c861a444 req-26811297-a456-4131-960d-01d74924dbf3 service nova] Acquiring lock "refresh_cache-4f85754a-aad0-43b7-9a99-65aa567eb114" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:47:19 user nova-compute[74337]: DEBUG nova.network.neutron [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 4f85754a-aad0-43b7-9a99-65aa567eb114] Instance cache missing network info. {{(pid=74337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 21:47:19 user nova-compute[74337]: DEBUG nova.objects.instance [None req-b3210a07-58e8-411f-b978-3c48cb1c00c5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lazy-loading 'flavor' on Instance uuid 01d407b0-a7cf-4222-9f2d-54b99eeeed84 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:47:20 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-b3210a07-58e8-411f-b978-3c48cb1c00c5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lock "01d407b0-a7cf-4222-9f2d-54b99eeeed84" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.933s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:47:20 user nova-compute[74337]: DEBUG nova.network.neutron [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 4f85754a-aad0-43b7-9a99-65aa567eb114] Updating instance_info_cache with network_info: [{"id": "c1df869f-8a82-4004-9035-372dbfbb1cc6", "address": "fa:16:3e:8d:53:76", "network": {"id": "5a18e96f-a6eb-4989-9be3-154b54928b03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-507511840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb567547bd4941fb87435a841c9d17c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1df869f-8a", "ovs_interfaceid": "c1df869f-8a82-4004-9035-372dbfbb1cc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:47:20 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Releasing lock "refresh_cache-4f85754a-aad0-43b7-9a99-65aa567eb114" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:47:20 user nova-compute[74337]: DEBUG nova.compute.manager [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 4f85754a-aad0-43b7-9a99-65aa567eb114] Instance network_info: |[{"id": "c1df869f-8a82-4004-9035-372dbfbb1cc6", "address": "fa:16:3e:8d:53:76", "network": {"id": "5a18e96f-a6eb-4989-9be3-154b54928b03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-507511840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb567547bd4941fb87435a841c9d17c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1df869f-8a", "ovs_interfaceid": "c1df869f-8a82-4004-9035-372dbfbb1cc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 21:47:20 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-3c57f744-354b-4d42-b745-0937c861a444 req-26811297-a456-4131-960d-01d74924dbf3 service nova] Acquired lock "refresh_cache-4f85754a-aad0-43b7-9a99-65aa567eb114" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:47:20 user nova-compute[74337]: DEBUG nova.network.neutron [req-3c57f744-354b-4d42-b745-0937c861a444 req-26811297-a456-4131-960d-01d74924dbf3 service nova] [instance: 4f85754a-aad0-43b7-9a99-65aa567eb114] Refreshing network info cache for port c1df869f-8a82-4004-9035-372dbfbb1cc6 {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 21:47:20 user nova-compute[74337]: DEBUG nova.network.neutron [req-3c57f744-354b-4d42-b745-0937c861a444 req-26811297-a456-4131-960d-01d74924dbf3 service nova] [instance: 4f85754a-aad0-43b7-9a99-65aa567eb114] Updated VIF entry in instance network info cache for port c1df869f-8a82-4004-9035-372dbfbb1cc6. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 21:47:20 user nova-compute[74337]: DEBUG nova.network.neutron [req-3c57f744-354b-4d42-b745-0937c861a444 req-26811297-a456-4131-960d-01d74924dbf3 service nova] [instance: 4f85754a-aad0-43b7-9a99-65aa567eb114] Updating instance_info_cache with network_info: [{"id": "c1df869f-8a82-4004-9035-372dbfbb1cc6", "address": "fa:16:3e:8d:53:76", "network": {"id": "5a18e96f-a6eb-4989-9be3-154b54928b03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-507511840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb567547bd4941fb87435a841c9d17c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1df869f-8a", "ovs_interfaceid": "c1df869f-8a82-4004-9035-372dbfbb1cc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:47:20 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-3c57f744-354b-4d42-b745-0937c861a444 req-26811297-a456-4131-960d-01d74924dbf3 service nova] Releasing lock "refresh_cache-4f85754a-aad0-43b7-9a99-65aa567eb114" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:47:23 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:47:23 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:47:24 user nova-compute[74337]: DEBUG os_brick.utils [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:47:24 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:47:24 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:47:24 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[778211bd-0857-47cd-8eab-4ed997ff6408]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f34011b66e40\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:47:24 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:47:24 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:47:24 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b8b68bf-e3a5-40df-8f78-33e7f8b47604]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:47:24 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:47:24 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:47:24 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f0895b4-d003-48c5-9e3b-288db4ddcd27]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:47:24 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[784097ce-7f6d-4652-96e5-6d3894cd9abb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:47:24 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Running cmd (subprocess): nvme version {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:47:24 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] 'nvme version' failed. Not Retrying. {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 21:47:24 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] nvme not present on system {{(pid=74337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 21:47:24 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:47:24 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 21:47:24 user nova-compute[74337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 21:47:24 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[07988649-8470-4377-83e0-ea23bb01bcec]: (4, '') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:47:24 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 21:47:24 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 21:47:24 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] LIGHTOS: no hostnqn found. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 21:47:24 user nova-compute[74337]: DEBUG os_brick.utils [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f34011b66e40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:47:24 user nova-compute[74337]: DEBUG nova.virt.block_device [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 4f85754a-aad0-43b7-9a99-65aa567eb114] Updating existing volume attachment record: 3f5af85d-72f3-4c6e-8772-9617bcf308c1 {{(pid=74337) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 21:47:24 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-a81008b4-884c-482e-9153-00713ca08baa tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Acquiring lock "1e05fd36-ee44-4992-80a9-f95af608b9f5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:47:24 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-a81008b4-884c-482e-9153-00713ca08baa tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lock "1e05fd36-ee44-4992-80a9-f95af608b9f5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:47:24 user nova-compute[74337]: DEBUG nova.compute.manager [None req-a81008b4-884c-482e-9153-00713ca08baa tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: 1e05fd36-ee44-4992-80a9-f95af608b9f5] Starting instance... {{(pid=74337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 21:47:24 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-a81008b4-884c-482e-9153-00713ca08baa tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:47:24 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-a81008b4-884c-482e-9153-00713ca08baa tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:47:24 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-a81008b4-884c-482e-9153-00713ca08baa tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 21:47:24 user nova-compute[74337]: INFO nova.compute.claims [None req-a81008b4-884c-482e-9153-00713ca08baa tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: 1e05fd36-ee44-4992-80a9-f95af608b9f5] Claim successful on node user
Oct 23 21:47:25 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-a81008b4-884c-482e-9153-00713ca08baa tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:47:25 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-a81008b4-884c-482e-9153-00713ca08baa tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:47:25 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-a81008b4-884c-482e-9153-00713ca08baa tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.533s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:47:25 user nova-compute[74337]: DEBUG nova.compute.manager [None req-a81008b4-884c-482e-9153-00713ca08baa tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: 1e05fd36-ee44-4992-80a9-f95af608b9f5] Start building networks asynchronously for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 21:47:25 user nova-compute[74337]: DEBUG nova.compute.manager [None req-a81008b4-884c-482e-9153-00713ca08baa tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: 1e05fd36-ee44-4992-80a9-f95af608b9f5] Allocating IP information in the background. {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 21:47:25 user nova-compute[74337]: DEBUG nova.network.neutron [None req-a81008b4-884c-482e-9153-00713ca08baa tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: 1e05fd36-ee44-4992-80a9-f95af608b9f5] allocate_for_instance() {{(pid=74337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 21:47:25 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-a81008b4-884c-482e-9153-00713ca08baa tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: 1e05fd36-ee44-4992-80a9-f95af608b9f5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 21:47:25 user nova-compute[74337]: DEBUG nova.compute.manager [None req-a81008b4-884c-482e-9153-00713ca08baa tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: 1e05fd36-ee44-4992-80a9-f95af608b9f5] Start building block device mappings for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 21:47:25 user nova-compute[74337]: DEBUG nova.policy [None req-a81008b4-884c-482e-9153-00713ca08baa tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a2e424dd3c684c808de14c2a9c3c1ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b85c4f783a4ee7ab67422b49da85ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74337) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 21:47:25 user nova-compute[74337]: DEBUG nova.compute.manager [None req-a81008b4-884c-482e-9153-00713ca08baa tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: 1e05fd36-ee44-4992-80a9-f95af608b9f5] Start spawning the instance on the hypervisor. {{(pid=74337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 21:47:25 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-a81008b4-884c-482e-9153-00713ca08baa tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: 1e05fd36-ee44-4992-80a9-f95af608b9f5] Creating instance directory {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 21:47:25 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-a81008b4-884c-482e-9153-00713ca08baa tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: 1e05fd36-ee44-4992-80a9-f95af608b9f5] Creating image(s)
Oct 23 21:47:25 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-a81008b4-884c-482e-9153-00713ca08baa tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Acquiring lock "/opt/stack/data/nova/instances/1e05fd36-ee44-4992-80a9-f95af608b9f5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:47:25 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-a81008b4-884c-482e-9153-00713ca08baa tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lock "/opt/stack/data/nova/instances/1e05fd36-ee44-4992-80a9-f95af608b9f5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:47:25 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-a81008b4-884c-482e-9153-00713ca08baa tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lock "/opt/stack/data/nova/instances/1e05fd36-ee44-4992-80a9-f95af608b9f5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:47:25 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-a81008b4-884c-482e-9153-00713ca08baa tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:47:25 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-a81008b4-884c-482e-9153-00713ca08baa tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.190s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:47:25 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-a81008b4-884c-482e-9153-00713ca08baa tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Acquiring lock "fc7b140751b8c385de81623e40fb09ce09374ab7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:47:25 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-a81008b4-884c-482e-9153-00713ca08baa tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lock "fc7b140751b8c385de81623e40fb09ce09374ab7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:47:25 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-a81008b4-884c-482e-9153-00713ca08baa tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:47:25 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-a81008b4-884c-482e-9153-00713ca08baa tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.187s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:47:25 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-a81008b4-884c-482e-9153-00713ca08baa tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7,backing_fmt=raw /opt/stack/data/nova/instances/1e05fd36-ee44-4992-80a9-f95af608b9f5/disk 1073741824 {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:47:25 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-a81008b4-884c-482e-9153-00713ca08baa tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7,backing_fmt=raw /opt/stack/data/nova/instances/1e05fd36-ee44-4992-80a9-f95af608b9f5/disk 1073741824" returned: 0 in 0.052s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:47:25 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-a81008b4-884c-482e-9153-00713ca08baa tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lock "fc7b140751b8c385de81623e40fb09ce09374ab7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:47:25 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-a81008b4-884c-482e-9153-00713ca08baa tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:47:25 user nova-compute[74337]: DEBUG nova.network.neutron [None req-a81008b4-884c-482e-9153-00713ca08baa tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: 1e05fd36-ee44-4992-80a9-f95af608b9f5] Successfully created port: be6c9897-b923-4a1e-813b-ba0b0196ac48 {{(pid=74337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 21:47:26 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-a81008b4-884c-482e-9153-00713ca08baa tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.222s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:47:26 user nova-compute[74337]: DEBUG nova.virt.disk.api [None req-a81008b4-884c-482e-9153-00713ca08baa tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1e05fd36-ee44-4992-80a9-f95af608b9f5/disk. size=1073741824 {{(pid=74337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 21:47:26 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-a81008b4-884c-482e-9153-00713ca08baa tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e05fd36-ee44-4992-80a9-f95af608b9f5/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:47:26 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-a81008b4-884c-482e-9153-00713ca08baa tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e05fd36-ee44-4992-80a9-f95af608b9f5/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:47:26 user nova-compute[74337]: DEBUG nova.virt.disk.api [None req-a81008b4-884c-482e-9153-00713ca08baa tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Cannot resize image /opt/stack/data/nova/instances/1e05fd36-ee44-4992-80a9-f95af608b9f5/disk to a smaller size. {{(pid=74337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 21:47:26 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-a81008b4-884c-482e-9153-00713ca08baa tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: 1e05fd36-ee44-4992-80a9-f95af608b9f5] Created local disks {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 21:47:26 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-a81008b4-884c-482e-9153-00713ca08baa tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: 1e05fd36-ee44-4992-80a9-f95af608b9f5] Ensure instance console log exists: /opt/stack/data/nova/instances/1e05fd36-ee44-4992-80a9-f95af608b9f5/console.log {{(pid=74337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 21:47:26 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-a81008b4-884c-482e-9153-00713ca08baa tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:47:26 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-a81008b4-884c-482e-9153-00713ca08baa tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:47:26 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-a81008b4-884c-482e-9153-00713ca08baa tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:47:26 user nova-compute[74337]: DEBUG nova.network.neutron [None req-a81008b4-884c-482e-9153-00713ca08baa tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: 1e05fd36-ee44-4992-80a9-f95af608b9f5] Successfully updated port: be6c9897-b923-4a1e-813b-ba0b0196ac48 {{(pid=74337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 21:47:26 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-a81008b4-884c-482e-9153-00713ca08baa tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Acquiring lock "refresh_cache-1e05fd36-ee44-4992-80a9-f95af608b9f5" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:47:26 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-a81008b4-884c-482e-9153-00713ca08baa tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Acquired lock "refresh_cache-1e05fd36-ee44-4992-80a9-f95af608b9f5" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:47:26 user nova-compute[74337]: DEBUG nova.network.neutron [None req-a81008b4-884c-482e-9153-00713ca08baa tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: 1e05fd36-ee44-4992-80a9-f95af608b9f5] Building network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 21:47:26 user nova-compute[74337]: DEBUG nova.compute.manager [req-48a953db-56f6-490a-be4f-8a423015d0ea req-2bd01c25-f5fd-4959-b877-3e5afde2f971 service nova] [instance: 1e05fd36-ee44-4992-80a9-f95af608b9f5] Received event network-changed-be6c9897-b923-4a1e-813b-ba0b0196ac48 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:47:26 user nova-compute[74337]: DEBUG nova.compute.manager [req-48a953db-56f6-490a-be4f-8a423015d0ea req-2bd01c25-f5fd-4959-b877-3e5afde2f971 service nova] [instance: 1e05fd36-ee44-4992-80a9-f95af608b9f5] Refreshing instance network info cache due to event network-changed-be6c9897-b923-4a1e-813b-ba0b0196ac48. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 21:47:26 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-48a953db-56f6-490a-be4f-8a423015d0ea req-2bd01c25-f5fd-4959-b877-3e5afde2f971 service nova] Acquiring lock "refresh_cache-1e05fd36-ee44-4992-80a9-f95af608b9f5" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:47:26 user nova-compute[74337]: DEBUG nova.network.neutron [None req-a81008b4-884c-482e-9153-00713ca08baa tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: 1e05fd36-ee44-4992-80a9-f95af608b9f5] Instance cache missing network info. {{(pid=74337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 21:47:26 user nova-compute[74337]: DEBUG nova.network.neutron [None req-a81008b4-884c-482e-9153-00713ca08baa tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: 1e05fd36-ee44-4992-80a9-f95af608b9f5] Updating instance_info_cache with network_info: [{"id": "be6c9897-b923-4a1e-813b-ba0b0196ac48", "address": "fa:16:3e:f0:53:16", "network": {"id": "5f62b1d8-d5d0-4ff9-922b-fc6e72fb640d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-655282105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b85c4f783a4ee7ab67422b49da85ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe6c9897-b9", "ovs_interfaceid": "be6c9897-b923-4a1e-813b-ba0b0196ac48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:47:26 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-a81008b4-884c-482e-9153-00713ca08baa tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Releasing lock "refresh_cache-1e05fd36-ee44-4992-80a9-f95af608b9f5" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:47:26 user nova-compute[74337]: DEBUG nova.compute.manager [None req-a81008b4-884c-482e-9153-00713ca08baa tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: 1e05fd36-ee44-4992-80a9-f95af608b9f5] Instance network_info: |[{"id": "be6c9897-b923-4a1e-813b-ba0b0196ac48", "address": "fa:16:3e:f0:53:16", "network": {"id": "5f62b1d8-d5d0-4ff9-922b-fc6e72fb640d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-655282105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b85c4f783a4ee7ab67422b49da85ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe6c9897-b9", "ovs_interfaceid": "be6c9897-b923-4a1e-813b-ba0b0196ac48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 21:47:26 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-48a953db-56f6-490a-be4f-8a423015d0ea req-2bd01c25-f5fd-4959-b877-3e5afde2f971 service nova] Acquired lock "refresh_cache-1e05fd36-ee44-4992-80a9-f95af608b9f5" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:47:26 user nova-compute[74337]: DEBUG nova.network.neutron [req-48a953db-56f6-490a-be4f-8a423015d0ea req-2bd01c25-f5fd-4959-b877-3e5afde2f971 service nova] [instance: 1e05fd36-ee44-4992-80a9-f95af608b9f5] Refreshing network info cache for port be6c9897-b923-4a1e-813b-ba0b0196ac48 {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 21:47:26 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-a81008b4-884c-482e-9153-00713ca08baa tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: 1e05fd36-ee44-4992-80a9-f95af608b9f5] Start _get_guest_xml network_info=[{"id": "be6c9897-b923-4a1e-813b-ba0b0196ac48", "address": "fa:16:3e:f0:53:16", "network": {"id": "5f62b1d8-d5d0-4ff9-922b-fc6e72fb640d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-655282105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b85c4f783a4ee7ab67422b49da85ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe6c9897-b9", "ovs_interfaceid": "be6c9897-b923-4a1e-813b-ba0b0196ac48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T21:29:21Z,direct_url=<?>,disk_format='qcow2',id=d859d89d-998d-4109-b26a-0d6e28152932,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ff43462300764979a6cf688444336a56',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T21:29:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'image_id': 'd859d89d-998d-4109-b26a-0d6e28152932'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 21:47:26 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-a81008b4-884c-482e-9153-00713ca08baa tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:47:26 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-a81008b4-884c-482e-9153-00713ca08baa tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:47:26 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-a81008b4-884c-482e-9153-00713ca08baa tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 21:47:26 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-a81008b4-884c-482e-9153-00713ca08baa tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] CPU controller missing on host. {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 21:47:26 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-a81008b4-884c-482e-9153-00713ca08baa tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 21:47:26 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-a81008b4-884c-482e-9153-00713ca08baa tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] CPU controller found on host. {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 21:47:26 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-a81008b4-884c-482e-9153-00713ca08baa tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 21:47:26 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-a81008b4-884c-482e-9153-00713ca08baa tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T21:29:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T21:29:21Z,direct_url=<?>,disk_format='qcow2',id=d859d89d-998d-4109-b26a-0d6e28152932,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ff43462300764979a6cf688444336a56',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T21:29:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 21:47:26 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-a81008b4-884c-482e-9153-00713ca08baa tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Flavor limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 21:47:26 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-a81008b4-884c-482e-9153-00713ca08baa tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Image limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 21:47:26 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-a81008b4-884c-482e-9153-00713ca08baa tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Flavor pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 21:47:26 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-a81008b4-884c-482e-9153-00713ca08baa tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Image pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 21:47:26 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-a81008b4-884c-482e-9153-00713ca08baa tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 21:47:26 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-a81008b4-884c-482e-9153-00713ca08baa tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 21:47:26 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-a81008b4-884c-482e-9153-00713ca08baa tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 21:47:26 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-a81008b4-884c-482e-9153-00713ca08baa tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Got 1 possible topologies {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 21:47:26 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-a81008b4-884c-482e-9153-00713ca08baa tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 21:47:26 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-a81008b4-884c-482e-9153-00713ca08baa tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 21:47:27 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-a81008b4-884c-482e-9153-00713ca08baa tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:47:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1172209907',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1172209907',id=27,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83b85c4f783a4ee7ab67422b49da85ca',ramdisk_id='',reservation_id='r-1br5ttde',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1944032280',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:47:25Z,user_data=None,user_id='a2e424dd3c684c808de14c2a9c3c1ed6',uuid=1e05fd36-ee44-4992-80a9-f95af608b9f5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be6c9897-b923-4a1e-813b-ba0b0196ac48", "address": "fa:16:3e:f0:53:16", "network": {"id": "5f62b1d8-d5d0-4ff9-922b-fc6e72fb640d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-655282105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b85c4f783a4ee7ab67422b49da85ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe6c9897-b9", "ovs_interfaceid": "be6c9897-b923-4a1e-813b-ba0b0196ac48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 21:47:27 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-a81008b4-884c-482e-9153-00713ca08baa tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Converting VIF {"id": "be6c9897-b923-4a1e-813b-ba0b0196ac48", "address": "fa:16:3e:f0:53:16", "network": {"id": "5f62b1d8-d5d0-4ff9-922b-fc6e72fb640d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-655282105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b85c4f783a4ee7ab67422b49da85ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe6c9897-b9", "ovs_interfaceid": "be6c9897-b923-4a1e-813b-ba0b0196ac48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:47:27 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-a81008b4-884c-482e-9153-00713ca08baa tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:53:16,bridge_name='br-int',has_traffic_filtering=True,id=be6c9897-b923-4a1e-813b-ba0b0196ac48,network=Network(5f62b1d8-d5d0-4ff9-922b-fc6e72fb640d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe6c9897-b9') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:47:27 user nova-compute[74337]: DEBUG nova.objects.instance [None req-a81008b4-884c-482e-9153-00713ca08baa tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lazy-loading 'pci_devices' on Instance uuid 1e05fd36-ee44-4992-80a9-f95af608b9f5 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:47:27 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-a81008b4-884c-482e-9153-00713ca08baa tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: 1e05fd36-ee44-4992-80a9-f95af608b9f5] End _get_guest_xml xml=<domain type="kvm">
Oct 23 21:47:27 user nova-compute[74337]:   <uuid>1e05fd36-ee44-4992-80a9-f95af608b9f5</uuid>
Oct 23 21:47:27 user nova-compute[74337]:   <name>instance-0000001b</name>
Oct 23 21:47:27 user nova-compute[74337]:   <memory>524288</memory>
Oct 23 21:47:27 user nova-compute[74337]:   <vcpu>1</vcpu>
Oct 23 21:47:27 user nova-compute[74337]:   <metadata>
Oct 23 21:47:27 user nova-compute[74337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 21:47:27 user nova-compute[74337]:       <nova:package version="0.0.0"/>
Oct 23 21:47:27 user nova-compute[74337]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1172209907</nova:name>
Oct 23 21:47:27 user nova-compute[74337]:       <nova:creationTime>2023-10-23 21:47:26</nova:creationTime>
Oct 23 21:47:27 user nova-compute[74337]:       <nova:flavor name="m1.tiny">
Oct 23 21:47:27 user nova-compute[74337]:         <nova:memory>512</nova:memory>
Oct 23 21:47:27 user nova-compute[74337]:         <nova:disk>1</nova:disk>
Oct 23 21:47:27 user nova-compute[74337]:         <nova:swap>0</nova:swap>
Oct 23 21:47:27 user nova-compute[74337]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 21:47:27 user nova-compute[74337]:         <nova:vcpus>1</nova:vcpus>
Oct 23 21:47:27 user nova-compute[74337]:       </nova:flavor>
Oct 23 21:47:27 user nova-compute[74337]:       <nova:owner>
Oct 23 21:47:27 user nova-compute[74337]:         <nova:user uuid="a2e424dd3c684c808de14c2a9c3c1ed6">tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member</nova:user>
Oct 23 21:47:27 user nova-compute[74337]:         <nova:project uuid="83b85c4f783a4ee7ab67422b49da85ca">tempest-ServerBootFromVolumeStableRescueTest-1944032280</nova:project>
Oct 23 21:47:27 user nova-compute[74337]:       </nova:owner>
Oct 23 21:47:27 user nova-compute[74337]:       <nova:root type="image" uuid="d859d89d-998d-4109-b26a-0d6e28152932"/>
Oct 23 21:47:27 user nova-compute[74337]:       <nova:ports>
Oct 23 21:47:27 user nova-compute[74337]:         <nova:port uuid="be6c9897-b923-4a1e-813b-ba0b0196ac48">
Oct 23 21:47:27 user nova-compute[74337]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 23 21:47:27 user nova-compute[74337]:         </nova:port>
Oct 23 21:47:27 user nova-compute[74337]:       </nova:ports>
Oct 23 21:47:27 user nova-compute[74337]:     </nova:instance>
Oct 23 21:47:27 user nova-compute[74337]:   </metadata>
Oct 23 21:47:27 user nova-compute[74337]:   <sysinfo type="smbios">
Oct 23 21:47:27 user nova-compute[74337]:     <system>
Oct 23 21:47:27 user nova-compute[74337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 21:47:27 user nova-compute[74337]:       <entry name="product">OpenStack Nova</entry>
Oct 23 21:47:27 user nova-compute[74337]:       <entry name="version">0.0.0</entry>
Oct 23 21:47:27 user nova-compute[74337]:       <entry name="serial">1e05fd36-ee44-4992-80a9-f95af608b9f5</entry>
Oct 23 21:47:27 user nova-compute[74337]:       <entry name="uuid">1e05fd36-ee44-4992-80a9-f95af608b9f5</entry>
Oct 23 21:47:27 user nova-compute[74337]:       <entry name="family">Virtual Machine</entry>
Oct 23 21:47:27 user nova-compute[74337]:     </system>
Oct 23 21:47:27 user nova-compute[74337]:   </sysinfo>
Oct 23 21:47:27 user nova-compute[74337]:   <os>
Oct 23 21:47:27 user nova-compute[74337]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 21:47:27 user nova-compute[74337]:     <boot dev="hd"/>
Oct 23 21:47:27 user nova-compute[74337]:     <smbios mode="sysinfo"/>
Oct 23 21:47:27 user nova-compute[74337]:   </os>
Oct 23 21:47:27 user nova-compute[74337]:   <features>
Oct 23 21:47:27 user nova-compute[74337]:     <acpi/>
Oct 23 21:47:27 user nova-compute[74337]:     <apic/>
Oct 23 21:47:27 user nova-compute[74337]:     <vmcoreinfo/>
Oct 23 21:47:27 user nova-compute[74337]:   </features>
Oct 23 21:47:27 user nova-compute[74337]:   <clock offset="utc">
Oct 23 21:47:27 user nova-compute[74337]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 21:47:27 user nova-compute[74337]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 21:47:27 user nova-compute[74337]:     <timer name="hpet" present="no"/>
Oct 23 21:47:27 user nova-compute[74337]:   </clock>
Oct 23 21:47:27 user nova-compute[74337]:   <cpu mode="custom" match="exact">
Oct 23 21:47:27 user nova-compute[74337]:     <model>Nehalem</model>
Oct 23 21:47:27 user nova-compute[74337]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 21:47:27 user nova-compute[74337]:   </cpu>
Oct 23 21:47:27 user nova-compute[74337]:   <devices>
Oct 23 21:47:27 user nova-compute[74337]:     <disk type="file" device="disk">
Oct 23 21:47:27 user nova-compute[74337]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 21:47:27 user nova-compute[74337]:       <source file="/opt/stack/data/nova/instances/1e05fd36-ee44-4992-80a9-f95af608b9f5/disk"/>
Oct 23 21:47:27 user nova-compute[74337]:       <target dev="vda" bus="virtio"/>
Oct 23 21:47:27 user nova-compute[74337]:     </disk>
Oct 23 21:47:27 user nova-compute[74337]:     <interface type="ethernet">
Oct 23 21:47:27 user nova-compute[74337]:       <mac address="fa:16:3e:f0:53:16"/>
Oct 23 21:47:27 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:47:27 user nova-compute[74337]:       <mtu size="1442"/>
Oct 23 21:47:27 user nova-compute[74337]:       <target dev="tapbe6c9897-b9"/>
Oct 23 21:47:27 user nova-compute[74337]:     </interface>
Oct 23 21:47:27 user nova-compute[74337]:     <serial type="pty">
Oct 23 21:47:27 user nova-compute[74337]:       <log file="/opt/stack/data/nova/instances/1e05fd36-ee44-4992-80a9-f95af608b9f5/console.log" append="off"/>
Oct 23 21:47:27 user nova-compute[74337]:     </serial>
Oct 23 21:47:27 user nova-compute[74337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 21:47:27 user nova-compute[74337]:     <video>
Oct 23 21:47:27 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:47:27 user nova-compute[74337]:     </video>
Oct 23 21:47:27 user nova-compute[74337]:     <rng model="virtio">
Oct 23 21:47:27 user nova-compute[74337]:       <backend model="random">/dev/urandom</backend>
Oct 23 21:47:27 user nova-compute[74337]:     </rng>
Oct 23 21:47:27 user nova-compute[74337]:     <controller type="usb" index="0" model="none"/>
Oct 23 21:47:27 user nova-compute[74337]:     <memballoon model="virtio">
Oct 23 21:47:27 user nova-compute[74337]:       <stats period="10"/>
Oct 23 21:47:27 user nova-compute[74337]:     </memballoon>
Oct 23 21:47:27 user nova-compute[74337]:   </devices>
Oct 23 21:47:27 user nova-compute[74337]: </domain>
Oct 23 21:47:27 user nova-compute[74337]:  {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 21:47:27 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-a81008b4-884c-482e-9153-00713ca08baa tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:47:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1172209907',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1172209907',id=27,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83b85c4f783a4ee7ab67422b49da85ca',ramdisk_id='',reservation_id='r-1br5ttde',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1944032280',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:47:25Z,user_data=None,user_id='a2e424dd3c684c808de14c2a9c3c1ed6',uuid=1e05fd36-ee44-4992-80a9-f95af608b9f5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be6c9897-b923-4a1e-813b-ba0b0196ac48", "address": "fa:16:3e:f0:53:16", "network": {"id": "5f62b1d8-d5d0-4ff9-922b-fc6e72fb640d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-655282105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b85c4f783a4ee7ab67422b49da85ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe6c9897-b9", "ovs_interfaceid": "be6c9897-b923-4a1e-813b-ba0b0196ac48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 21:47:27 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-a81008b4-884c-482e-9153-00713ca08baa tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Converting VIF {"id": "be6c9897-b923-4a1e-813b-ba0b0196ac48", "address": "fa:16:3e:f0:53:16", "network": {"id": "5f62b1d8-d5d0-4ff9-922b-fc6e72fb640d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-655282105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b85c4f783a4ee7ab67422b49da85ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe6c9897-b9", "ovs_interfaceid": "be6c9897-b923-4a1e-813b-ba0b0196ac48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:47:27 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-a81008b4-884c-482e-9153-00713ca08baa tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:53:16,bridge_name='br-int',has_traffic_filtering=True,id=be6c9897-b923-4a1e-813b-ba0b0196ac48,network=Network(5f62b1d8-d5d0-4ff9-922b-fc6e72fb640d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe6c9897-b9') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:47:27 user nova-compute[74337]: DEBUG os_vif [None req-a81008b4-884c-482e-9153-00713ca08baa tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:53:16,bridge_name='br-int',has_traffic_filtering=True,id=be6c9897-b923-4a1e-813b-ba0b0196ac48,network=Network(5f62b1d8-d5d0-4ff9-922b-fc6e72fb640d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe6c9897-b9') {{(pid=74337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 21:47:27 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:47:27 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:47:27 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 21:47:27 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:47:27 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dcf18e26-1a53-582f-84f4-0d96d649164b', '_type': 'linux-noop'}}, row=False) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:47:27 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:47:27 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:47:27 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:47:27 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbe6c9897-b9, may_exist=True, interface_attrs={}) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:47:27 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbe6c9897-b9, col_values=(('qos', UUID('27dc5791-e815-4a5a-8092-9ddf2e59e66a')),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:47:27 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbe6c9897-b9, col_values=(('external_ids', {'iface-id': 'be6c9897-b923-4a1e-813b-ba0b0196ac48', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f0:53:16', 'vm-uuid': '1e05fd36-ee44-4992-80a9-f95af608b9f5'}),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:47:27 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:47:27 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:47:27 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:47:27 user nova-compute[74337]: INFO os_vif [None req-a81008b4-884c-482e-9153-00713ca08baa tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:53:16,bridge_name='br-int',has_traffic_filtering=True,id=be6c9897-b923-4a1e-813b-ba0b0196ac48,network=Network(5f62b1d8-d5d0-4ff9-922b-fc6e72fb640d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe6c9897-b9')
Oct 23 21:47:27 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-a81008b4-884c-482e-9153-00713ca08baa tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] No BDM found with device name vda, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 21:47:27 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-a81008b4-884c-482e-9153-00713ca08baa tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] No VIF found with MAC fa:16:3e:f0:53:16, not building metadata {{(pid=74337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 21:47:27 user nova-compute[74337]: DEBUG nova.network.neutron [req-48a953db-56f6-490a-be4f-8a423015d0ea req-2bd01c25-f5fd-4959-b877-3e5afde2f971 service nova] [instance: 1e05fd36-ee44-4992-80a9-f95af608b9f5] Updated VIF entry in instance network info cache for port be6c9897-b923-4a1e-813b-ba0b0196ac48. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 21:47:27 user nova-compute[74337]: DEBUG nova.network.neutron [req-48a953db-56f6-490a-be4f-8a423015d0ea req-2bd01c25-f5fd-4959-b877-3e5afde2f971 service nova] [instance: 1e05fd36-ee44-4992-80a9-f95af608b9f5] Updating instance_info_cache with network_info: [{"id": "be6c9897-b923-4a1e-813b-ba0b0196ac48", "address": "fa:16:3e:f0:53:16", "network": {"id": "5f62b1d8-d5d0-4ff9-922b-fc6e72fb640d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-655282105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b85c4f783a4ee7ab67422b49da85ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe6c9897-b9", "ovs_interfaceid": "be6c9897-b923-4a1e-813b-ba0b0196ac48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:47:27 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-48a953db-56f6-490a-be4f-8a423015d0ea req-2bd01c25-f5fd-4959-b877-3e5afde2f971 service nova] Releasing lock "refresh_cache-1e05fd36-ee44-4992-80a9-f95af608b9f5" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:47:28 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:47:28 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:47:28 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:47:28 user nova-compute[74337]: DEBUG nova.compute.manager [req-0adee782-79de-482c-bb10-d13a74dfe89c req-991722e1-ddc1-4219-a743-b3c7afa838a0 service nova] [instance: 1e05fd36-ee44-4992-80a9-f95af608b9f5] Received event network-vif-plugged-be6c9897-b923-4a1e-813b-ba0b0196ac48 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:47:28 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-0adee782-79de-482c-bb10-d13a74dfe89c req-991722e1-ddc1-4219-a743-b3c7afa838a0 service nova] Acquiring lock "1e05fd36-ee44-4992-80a9-f95af608b9f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:47:28 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-0adee782-79de-482c-bb10-d13a74dfe89c req-991722e1-ddc1-4219-a743-b3c7afa838a0 service nova] Lock "1e05fd36-ee44-4992-80a9-f95af608b9f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:47:28 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-0adee782-79de-482c-bb10-d13a74dfe89c req-991722e1-ddc1-4219-a743-b3c7afa838a0 service nova] Lock "1e05fd36-ee44-4992-80a9-f95af608b9f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:47:28 user nova-compute[74337]: DEBUG nova.compute.manager [req-0adee782-79de-482c-bb10-d13a74dfe89c req-991722e1-ddc1-4219-a743-b3c7afa838a0 service nova] [instance: 1e05fd36-ee44-4992-80a9-f95af608b9f5] No waiting events found dispatching network-vif-plugged-be6c9897-b923-4a1e-813b-ba0b0196ac48 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:47:28 user nova-compute[74337]: WARNING nova.compute.manager [req-0adee782-79de-482c-bb10-d13a74dfe89c req-991722e1-ddc1-4219-a743-b3c7afa838a0 service nova] [instance: 1e05fd36-ee44-4992-80a9-f95af608b9f5] Received unexpected event network-vif-plugged-be6c9897-b923-4a1e-813b-ba0b0196ac48 for instance with vm_state building and task_state spawning.
Oct 23 21:47:28 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:47:30 user nova-compute[74337]: DEBUG nova.compute.manager [None req-a81008b4-884c-482e-9153-00713ca08baa tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: 1e05fd36-ee44-4992-80a9-f95af608b9f5] Instance event wait completed in 0 seconds for  {{(pid=74337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 21:47:30 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-a81008b4-884c-482e-9153-00713ca08baa tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: 1e05fd36-ee44-4992-80a9-f95af608b9f5] Guest created on hypervisor {{(pid=74337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 21:47:30 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: 1e05fd36-ee44-4992-80a9-f95af608b9f5] Instance spawned successfully.
Oct 23 21:47:30 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-a81008b4-884c-482e-9153-00713ca08baa tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: 1e05fd36-ee44-4992-80a9-f95af608b9f5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 21:47:30 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-a81008b4-884c-482e-9153-00713ca08baa tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: 1e05fd36-ee44-4992-80a9-f95af608b9f5] Found default for hw_cdrom_bus of ide {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:47:30 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-a81008b4-884c-482e-9153-00713ca08baa tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: 1e05fd36-ee44-4992-80a9-f95af608b9f5] Found default for hw_disk_bus of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:47:30 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-a81008b4-884c-482e-9153-00713ca08baa tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: 1e05fd36-ee44-4992-80a9-f95af608b9f5] Found default for hw_input_bus of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:47:30 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-a81008b4-884c-482e-9153-00713ca08baa tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: 1e05fd36-ee44-4992-80a9-f95af608b9f5] Found default for hw_pointer_model of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:47:30 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-a81008b4-884c-482e-9153-00713ca08baa tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: 1e05fd36-ee44-4992-80a9-f95af608b9f5] Found default for hw_video_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:47:30 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-a81008b4-884c-482e-9153-00713ca08baa tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: 1e05fd36-ee44-4992-80a9-f95af608b9f5] Found default for hw_vif_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:47:30 user nova-compute[74337]: DEBUG nova.compute.manager [req-bfc779c7-7535-43c3-aabf-f0f9e5a4abfa req-531d273d-a191-41c9-8015-6b0ad50338a3 service nova] [instance: 1e05fd36-ee44-4992-80a9-f95af608b9f5] Received event network-vif-plugged-be6c9897-b923-4a1e-813b-ba0b0196ac48 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:47:30 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-bfc779c7-7535-43c3-aabf-f0f9e5a4abfa req-531d273d-a191-41c9-8015-6b0ad50338a3 service nova] Acquiring lock "1e05fd36-ee44-4992-80a9-f95af608b9f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:47:30 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-bfc779c7-7535-43c3-aabf-f0f9e5a4abfa req-531d273d-a191-41c9-8015-6b0ad50338a3 service nova] Lock "1e05fd36-ee44-4992-80a9-f95af608b9f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:47:30 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-bfc779c7-7535-43c3-aabf-f0f9e5a4abfa req-531d273d-a191-41c9-8015-6b0ad50338a3 service nova] Lock "1e05fd36-ee44-4992-80a9-f95af608b9f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:47:30 user nova-compute[74337]: DEBUG nova.compute.manager [req-bfc779c7-7535-43c3-aabf-f0f9e5a4abfa req-531d273d-a191-41c9-8015-6b0ad50338a3 service nova] [instance: 1e05fd36-ee44-4992-80a9-f95af608b9f5] No waiting events found dispatching network-vif-plugged-be6c9897-b923-4a1e-813b-ba0b0196ac48 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:47:30 user nova-compute[74337]: WARNING nova.compute.manager [req-bfc779c7-7535-43c3-aabf-f0f9e5a4abfa req-531d273d-a191-41c9-8015-6b0ad50338a3 service nova] [instance: 1e05fd36-ee44-4992-80a9-f95af608b9f5] Received unexpected event network-vif-plugged-be6c9897-b923-4a1e-813b-ba0b0196ac48 for instance with vm_state building and task_state spawning.
Oct 23 21:47:30 user nova-compute[74337]: INFO nova.compute.manager [None req-a81008b4-884c-482e-9153-00713ca08baa tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: 1e05fd36-ee44-4992-80a9-f95af608b9f5] Took 5.31 seconds to spawn the instance on the hypervisor.
Oct 23 21:47:30 user nova-compute[74337]: DEBUG nova.compute.manager [None req-a81008b4-884c-482e-9153-00713ca08baa tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: 1e05fd36-ee44-4992-80a9-f95af608b9f5] Checking state {{(pid=74337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 21:47:30 user nova-compute[74337]: INFO nova.compute.manager [None req-a81008b4-884c-482e-9153-00713ca08baa tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: 1e05fd36-ee44-4992-80a9-f95af608b9f5] Took 6.23 seconds to build instance.
Oct 23 21:47:30 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-a81008b4-884c-482e-9153-00713ca08baa tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lock "1e05fd36-ee44-4992-80a9-f95af608b9f5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.332s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:47:32 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:47:32 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4927ed26-1abf-4ef5-96a2-1a50d98553c1 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Acquiring lock "56a4b932-486d-4b8d-9616-99e75592432a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:47:32 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4927ed26-1abf-4ef5-96a2-1a50d98553c1 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lock "56a4b932-486d-4b8d-9616-99e75592432a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:47:32 user nova-compute[74337]: INFO nova.compute.manager [None req-4927ed26-1abf-4ef5-96a2-1a50d98553c1 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Detaching volume a8e8efe4-f74d-477f-ad38-999c514047ac
Oct 23 21:47:32 user nova-compute[74337]: INFO nova.virt.block_device [None req-4927ed26-1abf-4ef5-96a2-1a50d98553c1 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Attempting to driver detach volume a8e8efe4-f74d-477f-ad38-999c514047ac from mountpoint /dev/vdb
Oct 23 21:47:32 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-4927ed26-1abf-4ef5-96a2-1a50d98553c1 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Attempting to detach device vdb from instance 56a4b932-486d-4b8d-9616-99e75592432a from the persistent domain config. {{(pid=74337) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 21:47:32 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-4927ed26-1abf-4ef5-96a2-1a50d98553c1 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 21:47:32 user nova-compute[74337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 21:47:32 user nova-compute[74337]:   <source dev="/dev/sdb"/>
Oct 23 21:47:32 user nova-compute[74337]:   <target dev="vdb" bus="virtio"/>
Oct 23 21:47:32 user nova-compute[74337]:   <serial>a8e8efe4-f74d-477f-ad38-999c514047ac</serial>
Oct 23 21:47:32 user nova-compute[74337]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 23 21:47:32 user nova-compute[74337]: </disk>
Oct 23 21:47:32 user nova-compute[74337]:  {{(pid=74337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 21:47:32 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-4927ed26-1abf-4ef5-96a2-1a50d98553c1 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Successfully detached device vdb from instance 56a4b932-486d-4b8d-9616-99e75592432a from the persistent domain config.
Oct 23 21:47:32 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-4927ed26-1abf-4ef5-96a2-1a50d98553c1 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 56a4b932-486d-4b8d-9616-99e75592432a from the live domain config. {{(pid=74337) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 21:47:32 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-4927ed26-1abf-4ef5-96a2-1a50d98553c1 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 21:47:32 user nova-compute[74337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 21:47:32 user nova-compute[74337]:   <source dev="/dev/sdb"/>
Oct 23 21:47:32 user nova-compute[74337]:   <target dev="vdb" bus="virtio"/>
Oct 23 21:47:32 user nova-compute[74337]:   <serial>a8e8efe4-f74d-477f-ad38-999c514047ac</serial>
Oct 23 21:47:32 user nova-compute[74337]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 23 21:47:32 user nova-compute[74337]: </disk>
Oct 23 21:47:32 user nova-compute[74337]:  {{(pid=74337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 21:47:33 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-4927ed26-1abf-4ef5-96a2-1a50d98553c1 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 56a4b932-486d-4b8d-9616-99e75592432a {{(pid=74337) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 21:47:33 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:47:37 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:47:38 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:47:42 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:47:43 user nova-compute[74337]: DEBUG nova.compute.manager [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 4f85754a-aad0-43b7-9a99-65aa567eb114] Start spawning the instance on the hypervisor. {{(pid=74337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 21:47:43 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 4f85754a-aad0-43b7-9a99-65aa567eb114] Creating instance directory {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 21:47:43 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 4f85754a-aad0-43b7-9a99-65aa567eb114] Creating image(s)
Oct 23 21:47:43 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 4f85754a-aad0-43b7-9a99-65aa567eb114] Did not create local disks {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 23 21:47:43 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 4f85754a-aad0-43b7-9a99-65aa567eb114] Ensure instance console log exists: /opt/stack/data/nova/instances/4f85754a-aad0-43b7-9a99-65aa567eb114/console.log {{(pid=74337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 21:47:43 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:47:43 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:47:43 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:47:43 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 4f85754a-aad0-43b7-9a99-65aa567eb114] Start _get_guest_xml network_info=[{"id": "c1df869f-8a82-4004-9035-372dbfbb1cc6", "address": "fa:16:3e:8d:53:76", "network": {"id": "5a18e96f-a6eb-4989-9be3-154b54928b03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-507511840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb567547bd4941fb87435a841c9d17c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1df869f-8a", "ovs_interfaceid": "c1df869f-8a82-4004-9035-372dbfbb1cc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-10-23T21:47:06Z,direct_url=<?>,disk_format='qcow2',id=3fcddae6-b109-464d-93b8-d16b58e780aa,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-2134071187',owner='cb567547bd4941fb87435a841c9d17c4',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-10-23T21:47:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '3f5af85d-72f3-4c6e-8772-9617bcf308c1', 'delete_on_termination': True, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:919614b1-2a3b-4609-8244-3cbf96991585', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fTXvRnuU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4f85754a-aad0-43b7-9a99-65aa567eb114', 'attached_at': '', 'detached_at': '', 'volume_id': '919614b1-2a3b-4609-8244-3cbf96991585', 'serial': '919614b1-2a3b-4609-8244-3cbf96991585'}, 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 21:47:43 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:47:43 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:47:43 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 21:47:43 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] CPU controller missing on host. {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 21:47:43 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 21:47:43 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] CPU controller found on host. {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 21:47:43 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 21:47:43 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T21:29:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-10-23T21:47:06Z,direct_url=<?>,disk_format='qcow2',id=3fcddae6-b109-464d-93b8-d16b58e780aa,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-2134071187',owner='cb567547bd4941fb87435a841c9d17c4',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-10-23T21:47:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 21:47:43 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Flavor limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 21:47:43 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Image limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 21:47:43 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Flavor pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 21:47:43 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Image pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 21:47:43 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 21:47:43 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 21:47:43 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 21:47:43 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Got 1 possible topologies {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 21:47:43 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 21:47:43 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 21:47:43 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 4f85754a-aad0-43b7-9a99-65aa567eb114] Calling os-brick to attach iSCSI Volume {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 21:47:43 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:919614b1-2a3b-4609-8244-3cbf96991585', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fTXvRnuU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:47:43 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:47:43 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:47:43 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:47:43 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:47:43 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:919614b1-2a3b-4609-8244-3cbf96991585" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:47:43 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:919614b1-2a3b-4609-8244-3cbf96991585" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:47:43 user nova-compute[74337]: INFO os_brick.initiator.connectors.iscsi [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 21:47:43 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:919614b1-2a3b-4609-8244-3cbf96991585 -p 172.16.0.220:3260 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:47:43 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:919614b1-2a3b-4609-8244-3cbf96991585 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:47:43 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[39fe5511-fdb0-46aa-b9a5-fcbb03ba3a6d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:47:43 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 21:47:43 user nova-compute[74337]:  {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:47:43 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:919614b1-2a3b-4609-8244-3cbf96991585 -p 172.16.0.220:3260 --interface default --op new {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:47:43 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:919614b1-2a3b-4609-8244-3cbf96991585 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:47:43 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[332e312e-cecb-4427-9faa-123823ad5130]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:919614b1-2a3b-4609-8244-3cbf96991585] added\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:47:43 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:919614b1-2a3b-4609-8244-3cbf96991585] added
Oct 23 21:47:43 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:47:43 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:919614b1-2a3b-4609-8244-3cbf96991585 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:47:43 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:919614b1-2a3b-4609-8244-3cbf96991585 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:47:43 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eabf55d-a7e0-4cb9-a347-9dc2eca5e50c]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:47:43 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:47:43 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:919614b1-2a3b-4609-8244-3cbf96991585 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:47:43 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:919614b1-2a3b-4609-8244-3cbf96991585 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:47:43 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cc49955-673b-4076-9c09-eee11e527a1e]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:47:43 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:47:43 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:919614b1-2a3b-4609-8244-3cbf96991585 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fTXvRnuU {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:47:43 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:919614b1-2a3b-4609-8244-3cbf96991585 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fTXvRnuU" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:47:43 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1dacba8-d5de-4378-9e66-90e03f73e90f]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:47:43 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fTXvRnuU'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:47:43 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:919614b1-2a3b-4609-8244-3cbf96991585 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:47:43 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:919614b1-2a3b-4609-8244-3cbf96991585 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:47:43 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbf42539-3158-43e4-8171-85b044ed54a7]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:47:43 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:47:43 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:47:43 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:47:43 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc09d7a7-6fad-4e9e-b1d3-66e934dadc51]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:47:43 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:47:43 user nova-compute[74337]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c (non-flash)
Oct 23 21:47:43 user nova-compute[74337]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac (non-flash)
Oct 23 21:47:43 user nova-compute[74337]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c (non-flash)
Oct 23 21:47:43 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:47:43 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:47:43 user nova-compute[74337]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c (non-flash)
Oct 23 21:47:43 user nova-compute[74337]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac (non-flash)
Oct 23 21:47:43 user nova-compute[74337]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c (non-flash)
Oct 23 21:47:43 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:47:43 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:919614b1-2a3b-4609-8244-3cbf96991585 -p 172.16.0.220:3260 --login {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:47:43 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:919614b1-2a3b-4609-8244-3cbf96991585 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:47:43 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[040a6185-8bcc-4916-a79f-d109716aa43f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:919614b1-2a3b-4609-8244-3cbf96991585, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:919614b1-2a3b-4609-8244-3cbf96991585, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:47:43 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:919614b1-2a3b-4609-8244-3cbf96991585, portal: 172.16.0.220,3260]
Oct 23 21:47:43 user nova-compute[74337]: Login to [iface: default, target: iqn.2010-10.org.openstack:919614b1-2a3b-4609-8244-3cbf96991585, portal: 172.16.0.220,3260] successful.
Oct 23 21:47:43 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:47:43 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:919614b1-2a3b-4609-8244-3cbf96991585 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:47:43 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:919614b1-2a3b-4609-8244-3cbf96991585 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:47:43 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b2919af-fd60-4c5c-9f8f-8d3851b8a407]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:47:43 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:47:43 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:47:43 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:47:43 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d02388ef-1e3d-4ac7-8cee-0796c0ba9e32]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:919614b1-2a3b-4609-8244-3cbf96991585 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:47:43 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:47:43 user nova-compute[74337]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c (non-flash)
Oct 23 21:47:43 user nova-compute[74337]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac (non-flash)
Oct 23 21:47:43 user nova-compute[74337]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c (non-flash)
Oct 23 21:47:43 user nova-compute[74337]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:919614b1-2a3b-4609-8244-3cbf96991585 (non-flash)
Oct 23 21:47:43 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:47:43 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:47:43 user nova-compute[74337]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c (non-flash)
Oct 23 21:47:43 user nova-compute[74337]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac (non-flash)
Oct 23 21:47:43 user nova-compute[74337]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c (non-flash)
Oct 23 21:47:43 user nova-compute[74337]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:919614b1-2a3b-4609-8244-3cbf96991585 (non-flash)
Oct 23 21:47:43 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:47:43 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:919614b1-2a3b-4609-8244-3cbf96991585" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:47:43 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Connected to 172.16.0.220:3260 {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 21:47:43 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] HCTL ('35', '-', '-', 0) found on session 30 with lun 0 {{(pid=74337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 21:47:43 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 21:47:43 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:47:43 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.025s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:47:43 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[41480365-138f-4707-879e-dbcc8857a3ad]: (4, ('- - 0', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:47:43 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Searching for a device in session 30 and hctl ['35', '*', '*', 0] yield: None {{(pid=74337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 21:47:44 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Searching for a device in session 30 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 21:47:44 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:919614b1-2a3b-4609-8244-3cbf96991585', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fTXvRnuU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 21:47:44 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:47:44 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '26339636365386232', 'path': '/dev/sdd'} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:47:44 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 4f85754a-aad0-43b7-9a99-65aa567eb114] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26339636365386232', 'path': '/dev/sdd'} {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 21:47:44 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:47:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-205710243',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-205710243',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-205710243',id=26,image_ref='3fcddae6-b109-464d-93b8-d16b58e780aa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBi/YBd7ti878hX2YlabNLGa9dYZw+X2OcdeTpMeoIVUh1J+1InlKAnXuEReoq0/cHooWEeOaDHy29G7Mg1uaQJxonjmAdZ9uzrM9fj4ydLIrPU+kVWUBY7LKu5LiRf3YQ==',key_name='tempest-keypair-483140505',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb567547bd4941fb87435a841c9d17c4',ramdisk_id='',reservation_id='r-05srughn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-499971371',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-499971371-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-499971371',owner_user_name='tempest-TestVolumeBootPattern-499971371-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:47:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c3e635e8e5447138a7f2db11695574c',uuid=4f85754a-aad0-43b7-9a99-65aa567eb114,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c1df869f-8a82-4004-9035-372dbfbb1cc6", "address": "fa:16:3e:8d:53:76", "network": {"id": "5a18e96f-a6eb-4989-9be3-154b54928b03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-507511840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb567547bd4941fb87435a841c9d17c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1df869f-8a", "ovs_interfaceid": "c1df869f-8a82-4004-9035-372dbfbb1cc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 21:47:44 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Converting VIF {"id": "c1df869f-8a82-4004-9035-372dbfbb1cc6", "address": "fa:16:3e:8d:53:76", "network": {"id": "5a18e96f-a6eb-4989-9be3-154b54928b03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-507511840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb567547bd4941fb87435a841c9d17c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1df869f-8a", "ovs_interfaceid": "c1df869f-8a82-4004-9035-372dbfbb1cc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:47:44 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:53:76,bridge_name='br-int',has_traffic_filtering=True,id=c1df869f-8a82-4004-9035-372dbfbb1cc6,network=Network(5a18e96f-a6eb-4989-9be3-154b54928b03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1df869f-8a') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:47:44 user nova-compute[74337]: DEBUG nova.objects.instance [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lazy-loading 'pci_devices' on Instance uuid 4f85754a-aad0-43b7-9a99-65aa567eb114 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:47:44 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 4f85754a-aad0-43b7-9a99-65aa567eb114] End _get_guest_xml xml=<domain type="kvm">
Oct 23 21:47:44 user nova-compute[74337]:   <uuid>4f85754a-aad0-43b7-9a99-65aa567eb114</uuid>
Oct 23 21:47:44 user nova-compute[74337]:   <name>instance-0000001a</name>
Oct 23 21:47:44 user nova-compute[74337]:   <memory>524288</memory>
Oct 23 21:47:44 user nova-compute[74337]:   <vcpu>1</vcpu>
Oct 23 21:47:44 user nova-compute[74337]:   <metadata>
Oct 23 21:47:44 user nova-compute[74337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 21:47:44 user nova-compute[74337]:       <nova:package version="0.0.0"/>
Oct 23 21:47:44 user nova-compute[74337]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-205710243</nova:name>
Oct 23 21:47:44 user nova-compute[74337]:       <nova:creationTime>2023-10-23 21:47:43</nova:creationTime>
Oct 23 21:47:44 user nova-compute[74337]:       <nova:flavor name="m1.tiny">
Oct 23 21:47:44 user nova-compute[74337]:         <nova:memory>512</nova:memory>
Oct 23 21:47:44 user nova-compute[74337]:         <nova:disk>1</nova:disk>
Oct 23 21:47:44 user nova-compute[74337]:         <nova:swap>0</nova:swap>
Oct 23 21:47:44 user nova-compute[74337]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 21:47:44 user nova-compute[74337]:         <nova:vcpus>1</nova:vcpus>
Oct 23 21:47:44 user nova-compute[74337]:       </nova:flavor>
Oct 23 21:47:44 user nova-compute[74337]:       <nova:owner>
Oct 23 21:47:44 user nova-compute[74337]:         <nova:user uuid="0c3e635e8e5447138a7f2db11695574c">tempest-TestVolumeBootPattern-499971371-project-member</nova:user>
Oct 23 21:47:44 user nova-compute[74337]:         <nova:project uuid="cb567547bd4941fb87435a841c9d17c4">tempest-TestVolumeBootPattern-499971371</nova:project>
Oct 23 21:47:44 user nova-compute[74337]:       </nova:owner>
Oct 23 21:47:44 user nova-compute[74337]:       <nova:root type="image" uuid="3fcddae6-b109-464d-93b8-d16b58e780aa"/>
Oct 23 21:47:44 user nova-compute[74337]:       <nova:ports>
Oct 23 21:47:44 user nova-compute[74337]:         <nova:port uuid="c1df869f-8a82-4004-9035-372dbfbb1cc6">
Oct 23 21:47:44 user nova-compute[74337]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 23 21:47:44 user nova-compute[74337]:         </nova:port>
Oct 23 21:47:44 user nova-compute[74337]:       </nova:ports>
Oct 23 21:47:44 user nova-compute[74337]:     </nova:instance>
Oct 23 21:47:44 user nova-compute[74337]:   </metadata>
Oct 23 21:47:44 user nova-compute[74337]:   <sysinfo type="smbios">
Oct 23 21:47:44 user nova-compute[74337]:     <system>
Oct 23 21:47:44 user nova-compute[74337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 21:47:44 user nova-compute[74337]:       <entry name="product">OpenStack Nova</entry>
Oct 23 21:47:44 user nova-compute[74337]:       <entry name="version">0.0.0</entry>
Oct 23 21:47:44 user nova-compute[74337]:       <entry name="serial">4f85754a-aad0-43b7-9a99-65aa567eb114</entry>
Oct 23 21:47:44 user nova-compute[74337]:       <entry name="uuid">4f85754a-aad0-43b7-9a99-65aa567eb114</entry>
Oct 23 21:47:44 user nova-compute[74337]:       <entry name="family">Virtual Machine</entry>
Oct 23 21:47:44 user nova-compute[74337]:     </system>
Oct 23 21:47:44 user nova-compute[74337]:   </sysinfo>
Oct 23 21:47:44 user nova-compute[74337]:   <os>
Oct 23 21:47:44 user nova-compute[74337]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 21:47:44 user nova-compute[74337]:     <boot dev="hd"/>
Oct 23 21:47:44 user nova-compute[74337]:     <smbios mode="sysinfo"/>
Oct 23 21:47:44 user nova-compute[74337]:   </os>
Oct 23 21:47:44 user nova-compute[74337]:   <features>
Oct 23 21:47:44 user nova-compute[74337]:     <acpi/>
Oct 23 21:47:44 user nova-compute[74337]:     <apic/>
Oct 23 21:47:44 user nova-compute[74337]:     <vmcoreinfo/>
Oct 23 21:47:44 user nova-compute[74337]:   </features>
Oct 23 21:47:44 user nova-compute[74337]:   <clock offset="utc">
Oct 23 21:47:44 user nova-compute[74337]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 21:47:44 user nova-compute[74337]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 21:47:44 user nova-compute[74337]:     <timer name="hpet" present="no"/>
Oct 23 21:47:44 user nova-compute[74337]:   </clock>
Oct 23 21:47:44 user nova-compute[74337]:   <cpu mode="custom" match="exact">
Oct 23 21:47:44 user nova-compute[74337]:     <model>Nehalem</model>
Oct 23 21:47:44 user nova-compute[74337]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 21:47:44 user nova-compute[74337]:   </cpu>
Oct 23 21:47:44 user nova-compute[74337]:   <devices>
Oct 23 21:47:44 user nova-compute[74337]:     <disk type="block" device="disk">
Oct 23 21:47:44 user nova-compute[74337]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 21:47:44 user nova-compute[74337]:       <source dev="/dev/sdd"/>
Oct 23 21:47:44 user nova-compute[74337]:       <target dev="vda" bus="virtio"/>
Oct 23 21:47:44 user nova-compute[74337]:       <serial>919614b1-2a3b-4609-8244-3cbf96991585</serial>
Oct 23 21:47:44 user nova-compute[74337]:     </disk>
Oct 23 21:47:44 user nova-compute[74337]:     <interface type="ethernet">
Oct 23 21:47:44 user nova-compute[74337]:       <mac address="fa:16:3e:8d:53:76"/>
Oct 23 21:47:44 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:47:44 user nova-compute[74337]:       <mtu size="1442"/>
Oct 23 21:47:44 user nova-compute[74337]:       <target dev="tapc1df869f-8a"/>
Oct 23 21:47:44 user nova-compute[74337]:     </interface>
Oct 23 21:47:44 user nova-compute[74337]:     <serial type="pty">
Oct 23 21:47:44 user nova-compute[74337]:       <log file="/opt/stack/data/nova/instances/4f85754a-aad0-43b7-9a99-65aa567eb114/console.log" append="off"/>
Oct 23 21:47:44 user nova-compute[74337]:     </serial>
Oct 23 21:47:44 user nova-compute[74337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 21:47:44 user nova-compute[74337]:     <video>
Oct 23 21:47:44 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:47:44 user nova-compute[74337]:     </video>
Oct 23 21:47:44 user nova-compute[74337]:     <rng model="virtio">
Oct 23 21:47:44 user nova-compute[74337]:       <backend model="random">/dev/urandom</backend>
Oct 23 21:47:44 user nova-compute[74337]:     </rng>
Oct 23 21:47:44 user nova-compute[74337]:     <controller type="usb" index="0" model="none"/>
Oct 23 21:47:44 user nova-compute[74337]:     <memballoon model="virtio">
Oct 23 21:47:44 user nova-compute[74337]:       <stats period="10"/>
Oct 23 21:47:44 user nova-compute[74337]:     </memballoon>
Oct 23 21:47:44 user nova-compute[74337]:   </devices>
Oct 23 21:47:44 user nova-compute[74337]: </domain>
Oct 23 21:47:44 user nova-compute[74337]:  {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 21:47:44 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:47:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-205710243',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-205710243',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-205710243',id=26,image_ref='3fcddae6-b109-464d-93b8-d16b58e780aa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBi/YBd7ti878hX2YlabNLGa9dYZw+X2OcdeTpMeoIVUh1J+1InlKAnXuEReoq0/cHooWEeOaDHy29G7Mg1uaQJxonjmAdZ9uzrM9fj4ydLIrPU+kVWUBY7LKu5LiRf3YQ==',key_name='tempest-keypair-483140505',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb567547bd4941fb87435a841c9d17c4',ramdisk_id='',reservation_id='r-05srughn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-499971371',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-499971371-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-499971371',owner_user_name='tempest-TestVolumeBootPattern-499971371-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:47:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c3e635e8e5447138a7f2db11695574c',uuid=4f85754a-aad0-43b7-9a99-65aa567eb114,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c1df869f-8a82-4004-9035-372dbfbb1cc6", "address": "fa:16:3e:8d:53:76", "network": {"id": "5a18e96f-a6eb-4989-9be3-154b54928b03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-507511840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb567547bd4941fb87435a841c9d17c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1df869f-8a", "ovs_interfaceid": "c1df869f-8a82-4004-9035-372dbfbb1cc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 21:47:44 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Converting VIF {"id": "c1df869f-8a82-4004-9035-372dbfbb1cc6", "address": "fa:16:3e:8d:53:76", "network": {"id": "5a18e96f-a6eb-4989-9be3-154b54928b03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-507511840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb567547bd4941fb87435a841c9d17c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1df869f-8a", "ovs_interfaceid": "c1df869f-8a82-4004-9035-372dbfbb1cc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:47:44 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:53:76,bridge_name='br-int',has_traffic_filtering=True,id=c1df869f-8a82-4004-9035-372dbfbb1cc6,network=Network(5a18e96f-a6eb-4989-9be3-154b54928b03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1df869f-8a') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:47:44 user nova-compute[74337]: DEBUG os_vif [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:53:76,bridge_name='br-int',has_traffic_filtering=True,id=c1df869f-8a82-4004-9035-372dbfbb1cc6,network=Network(5a18e96f-a6eb-4989-9be3-154b54928b03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1df869f-8a') {{(pid=74337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 21:47:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:47:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:47:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 21:47:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:47:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '36a80159-b4db-59bc-8f41-185e243be46a', '_type': 'linux-noop'}}, row=False) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:47:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:47:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:47:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:47:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc1df869f-8a, may_exist=True, interface_attrs={}) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:47:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc1df869f-8a, col_values=(('qos', UUID('23b92593-d454-4e7d-ae1e-24e4460d36a7')),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:47:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc1df869f-8a, col_values=(('external_ids', {'iface-id': 'c1df869f-8a82-4004-9035-372dbfbb1cc6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8d:53:76', 'vm-uuid': '4f85754a-aad0-43b7-9a99-65aa567eb114'}),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:47:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:47:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:47:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:47:44 user nova-compute[74337]: INFO os_vif [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:53:76,bridge_name='br-int',has_traffic_filtering=True,id=c1df869f-8a82-4004-9035-372dbfbb1cc6,network=Network(5a18e96f-a6eb-4989-9be3-154b54928b03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1df869f-8a')
Oct 23 21:47:44 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] No BDM found with device name vda, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 21:47:44 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] No VIF found with MAC fa:16:3e:8d:53:76, not building metadata {{(pid=74337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 21:47:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:47:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:47:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:47:46 user nova-compute[74337]: DEBUG nova.compute.manager [req-fbf9b09f-40b9-447a-9954-f5d3fbb3ad53 req-34da29e7-2a73-4709-9194-0bf0221d9c63 service nova] [instance: 4f85754a-aad0-43b7-9a99-65aa567eb114] Received event network-vif-plugged-c1df869f-8a82-4004-9035-372dbfbb1cc6 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:47:46 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-fbf9b09f-40b9-447a-9954-f5d3fbb3ad53 req-34da29e7-2a73-4709-9194-0bf0221d9c63 service nova] Acquiring lock "4f85754a-aad0-43b7-9a99-65aa567eb114-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:47:46 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-fbf9b09f-40b9-447a-9954-f5d3fbb3ad53 req-34da29e7-2a73-4709-9194-0bf0221d9c63 service nova] Lock "4f85754a-aad0-43b7-9a99-65aa567eb114-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:47:46 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-fbf9b09f-40b9-447a-9954-f5d3fbb3ad53 req-34da29e7-2a73-4709-9194-0bf0221d9c63 service nova] Lock "4f85754a-aad0-43b7-9a99-65aa567eb114-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:47:46 user nova-compute[74337]: DEBUG nova.compute.manager [req-fbf9b09f-40b9-447a-9954-f5d3fbb3ad53 req-34da29e7-2a73-4709-9194-0bf0221d9c63 service nova] [instance: 4f85754a-aad0-43b7-9a99-65aa567eb114] No waiting events found dispatching network-vif-plugged-c1df869f-8a82-4004-9035-372dbfbb1cc6 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:47:46 user nova-compute[74337]: WARNING nova.compute.manager [req-fbf9b09f-40b9-447a-9954-f5d3fbb3ad53 req-34da29e7-2a73-4709-9194-0bf0221d9c63 service nova] [instance: 4f85754a-aad0-43b7-9a99-65aa567eb114] Received unexpected event network-vif-plugged-c1df869f-8a82-4004-9035-372dbfbb1cc6 for instance with vm_state building and task_state spawning.
Oct 23 21:47:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:47:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:47:48 user nova-compute[74337]: DEBUG nova.compute.manager [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 4f85754a-aad0-43b7-9a99-65aa567eb114] Instance event wait completed in 0 seconds for  {{(pid=74337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 21:47:48 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 4f85754a-aad0-43b7-9a99-65aa567eb114] Guest created on hypervisor {{(pid=74337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 21:47:48 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: 4f85754a-aad0-43b7-9a99-65aa567eb114] Instance spawned successfully.
Oct 23 21:47:48 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 4f85754a-aad0-43b7-9a99-65aa567eb114] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 21:47:48 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 4f85754a-aad0-43b7-9a99-65aa567eb114] Found default for hw_input_bus of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:47:48 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 4f85754a-aad0-43b7-9a99-65aa567eb114] Found default for hw_pointer_model of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:47:48 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-bb2f5247-1fec-472c-bc5b-56cf9e14b63e tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Acquiring lock "01d407b0-a7cf-4222-9f2d-54b99eeeed84" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:47:48 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-bb2f5247-1fec-472c-bc5b-56cf9e14b63e tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lock "01d407b0-a7cf-4222-9f2d-54b99eeeed84" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:47:48 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-bb2f5247-1fec-472c-bc5b-56cf9e14b63e tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Acquiring lock "01d407b0-a7cf-4222-9f2d-54b99eeeed84-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:47:48 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-bb2f5247-1fec-472c-bc5b-56cf9e14b63e tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lock "01d407b0-a7cf-4222-9f2d-54b99eeeed84-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:47:48 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-bb2f5247-1fec-472c-bc5b-56cf9e14b63e tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lock "01d407b0-a7cf-4222-9f2d-54b99eeeed84-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:47:48 user nova-compute[74337]: INFO nova.compute.manager [None req-bb2f5247-1fec-472c-bc5b-56cf9e14b63e tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 01d407b0-a7cf-4222-9f2d-54b99eeeed84] Terminating instance
Oct 23 21:47:48 user nova-compute[74337]: DEBUG nova.compute.manager [None req-bb2f5247-1fec-472c-bc5b-56cf9e14b63e tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 01d407b0-a7cf-4222-9f2d-54b99eeeed84] Start destroying the instance on the hypervisor. {{(pid=74337) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 21:47:48 user nova-compute[74337]: INFO nova.compute.manager [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 4f85754a-aad0-43b7-9a99-65aa567eb114] Took 4.98 seconds to spawn the instance on the hypervisor.
Oct 23 21:47:48 user nova-compute[74337]: DEBUG nova.compute.manager [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 4f85754a-aad0-43b7-9a99-65aa567eb114] Checking state {{(pid=74337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 21:47:48 user nova-compute[74337]: DEBUG nova.compute.manager [req-2c781635-438f-44ac-87db-84fb8cb70edc req-758d94c4-aae6-4ad5-b499-d208ea0e4c48 service nova] [instance: 4f85754a-aad0-43b7-9a99-65aa567eb114] Received event network-vif-plugged-c1df869f-8a82-4004-9035-372dbfbb1cc6 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:47:48 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-2c781635-438f-44ac-87db-84fb8cb70edc req-758d94c4-aae6-4ad5-b499-d208ea0e4c48 service nova] Acquiring lock "4f85754a-aad0-43b7-9a99-65aa567eb114-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:47:48 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-2c781635-438f-44ac-87db-84fb8cb70edc req-758d94c4-aae6-4ad5-b499-d208ea0e4c48 service nova] Lock "4f85754a-aad0-43b7-9a99-65aa567eb114-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:47:48 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-2c781635-438f-44ac-87db-84fb8cb70edc req-758d94c4-aae6-4ad5-b499-d208ea0e4c48 service nova] Lock "4f85754a-aad0-43b7-9a99-65aa567eb114-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:47:48 user nova-compute[74337]: DEBUG nova.compute.manager [req-2c781635-438f-44ac-87db-84fb8cb70edc req-758d94c4-aae6-4ad5-b499-d208ea0e4c48 service nova] [instance: 4f85754a-aad0-43b7-9a99-65aa567eb114] No waiting events found dispatching network-vif-plugged-c1df869f-8a82-4004-9035-372dbfbb1cc6 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:47:48 user nova-compute[74337]: WARNING nova.compute.manager [req-2c781635-438f-44ac-87db-84fb8cb70edc req-758d94c4-aae6-4ad5-b499-d208ea0e4c48 service nova] [instance: 4f85754a-aad0-43b7-9a99-65aa567eb114] Received unexpected event network-vif-plugged-c1df869f-8a82-4004-9035-372dbfbb1cc6 for instance with vm_state building and task_state spawning.
Oct 23 21:47:48 user nova-compute[74337]: INFO nova.compute.manager [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 4f85754a-aad0-43b7-9a99-65aa567eb114] Took 31.11 seconds to build instance.
Oct 23 21:47:48 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:47:48 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:47:48 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-c4b85241-5106-4ffa-8381-07907de0b011 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "4f85754a-aad0-43b7-9a99-65aa567eb114" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 31.239s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:47:48 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:47:48 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:47:49 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: 01d407b0-a7cf-4222-9f2d-54b99eeeed84] Instance destroyed successfully.
Oct 23 21:47:49 user nova-compute[74337]: DEBUG nova.objects.instance [None req-bb2f5247-1fec-472c-bc5b-56cf9e14b63e tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lazy-loading 'resources' on Instance uuid 01d407b0-a7cf-4222-9f2d-54b99eeeed84 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:47:49 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-bb2f5247-1fec-472c-bc5b-56cf9e14b63e tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:41:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1126935027',display_name='tempest-AttachVolumeNegativeTest-server-1126935027',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1126935027',id=21,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDBGw3df6OvFipVH/If42r9GmRritzHhx1HQKG+2Bdhtpbibp3+FRYZcul+/3ufTYP5zHi3D2n1KPMLFIBdDArFfKePpNO0gSfrb3AAPb2csCm6C6X4bN7DbdMjHsfWd6g==',key_name='tempest-keypair-211272591',keypairs=<?>,launch_index=0,launched_at=2023-10-23T21:42:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='84a25b3eed8548a5a324e55b28f26252',ramdisk_id='',reservation_id='r-wio9bm9k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1446109887',owner_user_name='tempest-AttachVolumeNegativeTest-1446109887-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T21:42:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6f6daa6653264905a5498e00f184080c',uuid=01d407b0-a7cf-4222-9f2d-54b99eeeed84,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "720aee52-2c25-49de-bf60-743dea4b66ff", "address": "fa:16:3e:a6:0f:9d", "network": {"id": "787d9979-63ad-4318-b1d7-8ec69c5969fe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1847253864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84a25b3eed8548a5a324e55b28f26252", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap720aee52-2c", "ovs_interfaceid": "720aee52-2c25-49de-bf60-743dea4b66ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 21:47:49 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-bb2f5247-1fec-472c-bc5b-56cf9e14b63e tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Converting VIF {"id": "720aee52-2c25-49de-bf60-743dea4b66ff", "address": "fa:16:3e:a6:0f:9d", "network": {"id": "787d9979-63ad-4318-b1d7-8ec69c5969fe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1847253864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84a25b3eed8548a5a324e55b28f26252", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap720aee52-2c", "ovs_interfaceid": "720aee52-2c25-49de-bf60-743dea4b66ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:47:49 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-bb2f5247-1fec-472c-bc5b-56cf9e14b63e tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a6:0f:9d,bridge_name='br-int',has_traffic_filtering=True,id=720aee52-2c25-49de-bf60-743dea4b66ff,network=Network(787d9979-63ad-4318-b1d7-8ec69c5969fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap720aee52-2c') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:47:49 user nova-compute[74337]: DEBUG os_vif [None req-bb2f5247-1fec-472c-bc5b-56cf9e14b63e tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:0f:9d,bridge_name='br-int',has_traffic_filtering=True,id=720aee52-2c25-49de-bf60-743dea4b66ff,network=Network(787d9979-63ad-4318-b1d7-8ec69c5969fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap720aee52-2c') {{(pid=74337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 21:47:49 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:47:49 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap720aee52-2c, bridge=br-int, if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:47:49 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:47:49 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:47:49 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:47:49 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9501adb0-9359-41b6-a916-afe0d0c24fd9) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:47:49 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:47:49 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:47:49 user nova-compute[74337]: INFO os_vif [None req-bb2f5247-1fec-472c-bc5b-56cf9e14b63e tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:0f:9d,bridge_name='br-int',has_traffic_filtering=True,id=720aee52-2c25-49de-bf60-743dea4b66ff,network=Network(787d9979-63ad-4318-b1d7-8ec69c5969fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap720aee52-2c')
Oct 23 21:47:49 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-bb2f5247-1fec-472c-bc5b-56cf9e14b63e tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 01d407b0-a7cf-4222-9f2d-54b99eeeed84] Deleting instance files /opt/stack/data/nova/instances/01d407b0-a7cf-4222-9f2d-54b99eeeed84_del
Oct 23 21:47:49 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-bb2f5247-1fec-472c-bc5b-56cf9e14b63e tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 01d407b0-a7cf-4222-9f2d-54b99eeeed84] Deletion of /opt/stack/data/nova/instances/01d407b0-a7cf-4222-9f2d-54b99eeeed84_del complete
Oct 23 21:47:49 user nova-compute[74337]: INFO nova.compute.manager [None req-bb2f5247-1fec-472c-bc5b-56cf9e14b63e tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 01d407b0-a7cf-4222-9f2d-54b99eeeed84] Took 0.97 seconds to destroy the instance on the hypervisor.
Oct 23 21:47:49 user nova-compute[74337]: DEBUG oslo.service.loopingcall [None req-bb2f5247-1fec-472c-bc5b-56cf9e14b63e tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74337) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 21:47:49 user nova-compute[74337]: DEBUG nova.compute.manager [-] [instance: 01d407b0-a7cf-4222-9f2d-54b99eeeed84] Deallocating network for instance {{(pid=74337) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 21:47:49 user nova-compute[74337]: DEBUG nova.network.neutron [-] [instance: 01d407b0-a7cf-4222-9f2d-54b99eeeed84] deallocate_for_instance() {{(pid=74337) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 21:47:50 user nova-compute[74337]: DEBUG nova.network.neutron [-] [instance: 01d407b0-a7cf-4222-9f2d-54b99eeeed84] Updating instance_info_cache with network_info: [] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:47:50 user nova-compute[74337]: INFO nova.compute.manager [-] [instance: 01d407b0-a7cf-4222-9f2d-54b99eeeed84] Took 0.70 seconds to deallocate network for instance.
Oct 23 21:47:50 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-bb2f5247-1fec-472c-bc5b-56cf9e14b63e tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:47:50 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-bb2f5247-1fec-472c-bc5b-56cf9e14b63e tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:47:50 user nova-compute[74337]: DEBUG nova.compute.manager [req-88cc6988-b5a9-44a3-9856-1b9993c52b86 req-4ff983a0-3e63-4a8d-8a0e-61fc77f7d736 service nova] [instance: 01d407b0-a7cf-4222-9f2d-54b99eeeed84] Received event network-vif-unplugged-720aee52-2c25-49de-bf60-743dea4b66ff {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:47:50 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-88cc6988-b5a9-44a3-9856-1b9993c52b86 req-4ff983a0-3e63-4a8d-8a0e-61fc77f7d736 service nova] Acquiring lock "01d407b0-a7cf-4222-9f2d-54b99eeeed84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:47:50 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-88cc6988-b5a9-44a3-9856-1b9993c52b86 req-4ff983a0-3e63-4a8d-8a0e-61fc77f7d736 service nova] Lock "01d407b0-a7cf-4222-9f2d-54b99eeeed84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:47:50 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-88cc6988-b5a9-44a3-9856-1b9993c52b86 req-4ff983a0-3e63-4a8d-8a0e-61fc77f7d736 service nova] Lock "01d407b0-a7cf-4222-9f2d-54b99eeeed84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:47:50 user nova-compute[74337]: DEBUG nova.compute.manager [req-88cc6988-b5a9-44a3-9856-1b9993c52b86 req-4ff983a0-3e63-4a8d-8a0e-61fc77f7d736 service nova] [instance: 01d407b0-a7cf-4222-9f2d-54b99eeeed84] No waiting events found dispatching network-vif-unplugged-720aee52-2c25-49de-bf60-743dea4b66ff {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:47:50 user nova-compute[74337]: WARNING nova.compute.manager [req-88cc6988-b5a9-44a3-9856-1b9993c52b86 req-4ff983a0-3e63-4a8d-8a0e-61fc77f7d736 service nova] [instance: 01d407b0-a7cf-4222-9f2d-54b99eeeed84] Received unexpected event network-vif-unplugged-720aee52-2c25-49de-bf60-743dea4b66ff for instance with vm_state deleted and task_state None.
Oct 23 21:47:50 user nova-compute[74337]: DEBUG nova.compute.manager [req-88cc6988-b5a9-44a3-9856-1b9993c52b86 req-4ff983a0-3e63-4a8d-8a0e-61fc77f7d736 service nova] [instance: 01d407b0-a7cf-4222-9f2d-54b99eeeed84] Received event network-vif-plugged-720aee52-2c25-49de-bf60-743dea4b66ff {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:47:50 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-88cc6988-b5a9-44a3-9856-1b9993c52b86 req-4ff983a0-3e63-4a8d-8a0e-61fc77f7d736 service nova] Acquiring lock "01d407b0-a7cf-4222-9f2d-54b99eeeed84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:47:50 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-88cc6988-b5a9-44a3-9856-1b9993c52b86 req-4ff983a0-3e63-4a8d-8a0e-61fc77f7d736 service nova] Lock "01d407b0-a7cf-4222-9f2d-54b99eeeed84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:47:50 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-88cc6988-b5a9-44a3-9856-1b9993c52b86 req-4ff983a0-3e63-4a8d-8a0e-61fc77f7d736 service nova] Lock "01d407b0-a7cf-4222-9f2d-54b99eeeed84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:47:50 user nova-compute[74337]: DEBUG nova.compute.manager [req-88cc6988-b5a9-44a3-9856-1b9993c52b86 req-4ff983a0-3e63-4a8d-8a0e-61fc77f7d736 service nova] [instance: 01d407b0-a7cf-4222-9f2d-54b99eeeed84] No waiting events found dispatching network-vif-plugged-720aee52-2c25-49de-bf60-743dea4b66ff {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:47:50 user nova-compute[74337]: WARNING nova.compute.manager [req-88cc6988-b5a9-44a3-9856-1b9993c52b86 req-4ff983a0-3e63-4a8d-8a0e-61fc77f7d736 service nova] [instance: 01d407b0-a7cf-4222-9f2d-54b99eeeed84] Received unexpected event network-vif-plugged-720aee52-2c25-49de-bf60-743dea4b66ff for instance with vm_state deleted and task_state None.
Oct 23 21:47:50 user nova-compute[74337]: DEBUG nova.compute.manager [req-88cc6988-b5a9-44a3-9856-1b9993c52b86 req-4ff983a0-3e63-4a8d-8a0e-61fc77f7d736 service nova] [instance: 01d407b0-a7cf-4222-9f2d-54b99eeeed84] Received event network-vif-deleted-720aee52-2c25-49de-bf60-743dea4b66ff {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:47:50 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-bb2f5247-1fec-472c-bc5b-56cf9e14b63e tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:47:50 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-bb2f5247-1fec-472c-bc5b-56cf9e14b63e tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:47:50 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-bb2f5247-1fec-472c-bc5b-56cf9e14b63e tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.487s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:47:50 user nova-compute[74337]: INFO nova.scheduler.client.report [None req-bb2f5247-1fec-472c-bc5b-56cf9e14b63e tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Deleted allocations for instance 01d407b0-a7cf-4222-9f2d-54b99eeeed84
Oct 23 21:47:50 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-bb2f5247-1fec-472c-bc5b-56cf9e14b63e tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lock "01d407b0-a7cf-4222-9f2d-54b99eeeed84" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.357s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:47:53 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-4927ed26-1abf-4ef5-96a2-1a50d98553c1 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 56a4b932-486d-4b8d-9616-99e75592432a is timed out.
Oct 23 21:47:53 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-4927ed26-1abf-4ef5-96a2-1a50d98553c1 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Successfully detached device vdb from instance 56a4b932-486d-4b8d-9616-99e75592432a from the live domain config.
Oct 23 21:47:53 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4927ed26-1abf-4ef5-96a2-1a50d98553c1 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] calling os-brick to detach iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 21:47:53 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4927ed26-1abf-4ef5-96a2-1a50d98553c1 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, {'target_iqn': 'iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vUTnNRCq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:47:53 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-4927ed26-1abf-4ef5-96a2-1a50d98553c1 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:47:53 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-4927ed26-1abf-4ef5-96a2-1a50d98553c1 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:47:53 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-4927ed26-1abf-4ef5-96a2-1a50d98553c1 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:47:53 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:47:53 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:47:53 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e09745-2ce2-40d0-8ac7-fbdf93851679]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:919614b1-2a3b-4609-8244-3cbf96991585\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:47:53 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4927ed26-1abf-4ef5-96a2-1a50d98553c1 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 21:47:53 user nova-compute[74337]: No targets found.
Oct 23 21:47:53 user nova-compute[74337]: iSNS:
Oct 23 21:47:53 user nova-compute[74337]: No targets found.
Oct 23 21:47:53 user nova-compute[74337]: STATIC:
Oct 23 21:47:53 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4
Oct 23 21:47:53 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:47:53 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:47:53 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:919614b1-2a3b-4609-8244-3cbf96991585
Oct 23 21:47:53 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:47:53 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:47:53 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c
Oct 23 21:47:53 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:47:53 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:47:53 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac
Oct 23 21:47:53 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:47:53 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:47:53 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c
Oct 23 21:47:53 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:47:53 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:47:53 user nova-compute[74337]: FIRMWARE:
Oct 23 21:47:53 user nova-compute[74337]: No targets found.
Oct 23 21:47:53 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:47:53 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4927ed26-1abf-4ef5-96a2-1a50d98553c1 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 21:47:53 user nova-compute[74337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 21:47:53 user nova-compute[74337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 21:47:53 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4927ed26-1abf-4ef5-96a2-1a50d98553c1 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac', 0)] {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 21:47:53 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:47:53 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:47:53 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb62e7af-291a-4273-951f-5f04bbd55a73]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:919614b1-2a3b-4609-8244-3cbf96991585\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:47:53 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:47:53 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:47:53 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1aab2a3-d91e-4417-b9df-fc3d72f8e2e8]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:919614b1-2a3b-4609-8244-3cbf96991585 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:47:53 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4927ed26-1abf-4ef5-96a2-1a50d98553c1 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:47:53 user nova-compute[74337]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c (non-flash)
Oct 23 21:47:53 user nova-compute[74337]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac (non-flash)
Oct 23 21:47:53 user nova-compute[74337]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c (non-flash)
Oct 23 21:47:53 user nova-compute[74337]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:919614b1-2a3b-4609-8244-3cbf96991585 (non-flash)
Oct 23 21:47:53 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:47:53 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4927ed26-1abf-4ef5-96a2-1a50d98553c1 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:47:53 user nova-compute[74337]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c (non-flash)
Oct 23 21:47:53 user nova-compute[74337]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac (non-flash)
Oct 23 21:47:53 user nova-compute[74337]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c (non-flash)
Oct 23 21:47:53 user nova-compute[74337]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:919614b1-2a3b-4609-8244-3cbf96991585 (non-flash)
Oct 23 21:47:53 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:47:53 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4927ed26-1abf-4ef5-96a2-1a50d98553c1 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5eec3b9ab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac'): ({'sdb'}, set())}) {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 21:47:53 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-4927ed26-1abf-4ef5-96a2-1a50d98553c1 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Removing single pathed devices sdb {{(pid=74337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 21:47:53 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:47:53 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:47:53 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c8e447d-54d8-4210-bf51-b427199e880e]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:47:53 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:47:53 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:47:53 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:47:53 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[870ea623-6381-4c7d-89da-8c4c8c52ab4e]: (4, ('ok\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:47:53 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-4927ed26-1abf-4ef5-96a2-1a50d98553c1 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Flushing IO for device /dev/sdb {{(pid=74337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 21:47:53 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:47:53 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:47:53 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[303371cc-dbf5-4cc6-9f32-e94d6aff8c47]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:47:53 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-4927ed26-1abf-4ef5-96a2-1a50d98553c1 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 21:47:53 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:47:53 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:47:53 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad22673a-7490-4a10-a7be-cad1b44323ce]: (4, ('1', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:47:53 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-4927ed26-1abf-4ef5-96a2-1a50d98553c1 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 21:47:53 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-4927ed26-1abf-4ef5-96a2-1a50d98553c1 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] SCSI volumes sdb have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 21:47:53 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4927ed26-1abf-4ef5-96a2-1a50d98553c1 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac')] {{(pid=74337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 21:47:53 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:47:53 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:47:53 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e2c5f22-2eb5-4c0f-bc02-9321b7c6de14]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:47:53 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4927ed26-1abf-4ef5-96a2-1a50d98553c1 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:47:53 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac -p 172.16.0.220:3260 --logout {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:47:53 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:47:53 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba87e928-a518-4602-8c50-69e88735e86f]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:47:53 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4927ed26-1abf-4ef5-96a2-1a50d98553c1 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac, portal: 172.16.0.220,3260]
Oct 23 21:47:53 user nova-compute[74337]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac, portal: 172.16.0.220,3260] successful.
Oct 23 21:47:53 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:47:53 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac -p 172.16.0.220:3260 --op delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:47:53 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8e8efe4-f74d-477f-ad38-999c514047ac -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:47:53 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d827b950-38b8-4143-8545-b988456bbe62]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:47:53 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4927ed26-1abf-4ef5-96a2-1a50d98553c1 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:47:53 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-4927ed26-1abf-4ef5-96a2-1a50d98553c1 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:47:53 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-4927ed26-1abf-4ef5-96a2-1a50d98553c1 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] <== disconnect_volume: return (327ms) None {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:47:53 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4927ed26-1abf-4ef5-96a2-1a50d98553c1 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Disconnected iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 21:47:54 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:47:54 user nova-compute[74337]: DEBUG nova.objects.instance [None req-4927ed26-1abf-4ef5-96a2-1a50d98553c1 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lazy-loading 'flavor' on Instance uuid 56a4b932-486d-4b8d-9616-99e75592432a {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:47:54 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4927ed26-1abf-4ef5-96a2-1a50d98553c1 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lock "56a4b932-486d-4b8d-9616-99e75592432a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.807s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:47:56 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-7b1f1a96-e05f-453a-99e7-3d2b32f1ccac tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Acquiring lock "56a4b932-486d-4b8d-9616-99e75592432a" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:47:56 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-7b1f1a96-e05f-453a-99e7-3d2b32f1ccac tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lock "56a4b932-486d-4b8d-9616-99e75592432a" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:47:56 user nova-compute[74337]: DEBUG nova.compute.manager [None req-7b1f1a96-e05f-453a-99e7-3d2b32f1ccac tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Checking state {{(pid=74337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 21:47:56 user nova-compute[74337]: DEBUG nova.compute.manager [None req-7b1f1a96-e05f-453a-99e7-3d2b32f1ccac tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74337) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Oct 23 21:47:56 user nova-compute[74337]: DEBUG nova.objects.instance [None req-7b1f1a96-e05f-453a-99e7-3d2b32f1ccac tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lazy-loading 'flavor' on Instance uuid 56a4b932-486d-4b8d-9616-99e75592432a {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:47:56 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:47:56 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:47:56 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:47:56 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:47:56 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:47:56 user nova-compute[74337]: DEBUG nova.compute.manager [req-e8334c0d-48c1-483f-b86b-5bed481ddfb9 req-27968598-6a0b-43d2-b640-d639cac27cea service nova] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Received event network-vif-unplugged-5df71ce2-a116-44b3-856b-c0de0da5dcd6 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:47:56 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-e8334c0d-48c1-483f-b86b-5bed481ddfb9 req-27968598-6a0b-43d2-b640-d639cac27cea service nova] Acquiring lock "56a4b932-486d-4b8d-9616-99e75592432a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:47:56 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-e8334c0d-48c1-483f-b86b-5bed481ddfb9 req-27968598-6a0b-43d2-b640-d639cac27cea service nova] Lock "56a4b932-486d-4b8d-9616-99e75592432a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:47:56 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-e8334c0d-48c1-483f-b86b-5bed481ddfb9 req-27968598-6a0b-43d2-b640-d639cac27cea service nova] Lock "56a4b932-486d-4b8d-9616-99e75592432a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:47:56 user nova-compute[74337]: DEBUG nova.compute.manager [req-e8334c0d-48c1-483f-b86b-5bed481ddfb9 req-27968598-6a0b-43d2-b640-d639cac27cea service nova] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] No waiting events found dispatching network-vif-unplugged-5df71ce2-a116-44b3-856b-c0de0da5dcd6 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:47:56 user nova-compute[74337]: WARNING nova.compute.manager [req-e8334c0d-48c1-483f-b86b-5bed481ddfb9 req-27968598-6a0b-43d2-b640-d639cac27cea service nova] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Received unexpected event network-vif-unplugged-5df71ce2-a116-44b3-856b-c0de0da5dcd6 for instance with vm_state active and task_state powering-off.
Oct 23 21:47:57 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Instance destroyed successfully.
Oct 23 21:47:57 user nova-compute[74337]: DEBUG nova.compute.manager [None req-7b1f1a96-e05f-453a-99e7-3d2b32f1ccac tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Checking state {{(pid=74337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 21:47:57 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-7b1f1a96-e05f-453a-99e7-3d2b32f1ccac tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lock "56a4b932-486d-4b8d-9616-99e75592432a" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.883s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:47:58 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:47:58 user nova-compute[74337]: DEBUG nova.compute.manager [req-dfce2b17-5fca-4c33-a919-7a2158d2d395 req-38ff48ee-0750-4579-a175-fbba3ddf3838 service nova] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Received event network-vif-plugged-5df71ce2-a116-44b3-856b-c0de0da5dcd6 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:47:58 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-dfce2b17-5fca-4c33-a919-7a2158d2d395 req-38ff48ee-0750-4579-a175-fbba3ddf3838 service nova] Acquiring lock "56a4b932-486d-4b8d-9616-99e75592432a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:47:58 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-dfce2b17-5fca-4c33-a919-7a2158d2d395 req-38ff48ee-0750-4579-a175-fbba3ddf3838 service nova] Lock "56a4b932-486d-4b8d-9616-99e75592432a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:47:58 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-dfce2b17-5fca-4c33-a919-7a2158d2d395 req-38ff48ee-0750-4579-a175-fbba3ddf3838 service nova] Lock "56a4b932-486d-4b8d-9616-99e75592432a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:47:58 user nova-compute[74337]: DEBUG nova.compute.manager [req-dfce2b17-5fca-4c33-a919-7a2158d2d395 req-38ff48ee-0750-4579-a175-fbba3ddf3838 service nova] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] No waiting events found dispatching network-vif-plugged-5df71ce2-a116-44b3-856b-c0de0da5dcd6 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:47:58 user nova-compute[74337]: WARNING nova.compute.manager [req-dfce2b17-5fca-4c33-a919-7a2158d2d395 req-38ff48ee-0750-4579-a175-fbba3ddf3838 service nova] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Received unexpected event network-vif-plugged-5df71ce2-a116-44b3-856b-c0de0da5dcd6 for instance with vm_state stopped and task_state None.
Oct 23 21:47:59 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:48:03 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:48:04 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:48:04 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:48:05 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:48:05 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 21:48:07 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:48:07 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Starting heal instance info cache {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 21:48:07 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "refresh_cache-547c4d4c-e0dd-495a-b83f-98426d0a4a99" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:48:07 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquired lock "refresh_cache-547c4d4c-e0dd-495a-b83f-98426d0a4a99" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:48:07 user nova-compute[74337]: DEBUG nova.network.neutron [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 547c4d4c-e0dd-495a-b83f-98426d0a4a99] Forcefully refreshing network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 21:48:08 user nova-compute[74337]: DEBUG nova.network.neutron [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 547c4d4c-e0dd-495a-b83f-98426d0a4a99] Updating instance_info_cache with network_info: [{"id": "2dd20d7f-9490-476a-90ed-e6a1c9085e4d", "address": "fa:16:3e:5f:e1:f7", "network": {"id": "aff1f95f-fda8-4f0f-8d10-7e3d587e4fda", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2048135647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1f57e58a9ec4c6384dc0d3ca58eb610", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd20d7f-94", "ovs_interfaceid": "2dd20d7f-9490-476a-90ed-e6a1c9085e4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:48:08 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Releasing lock "refresh_cache-547c4d4c-e0dd-495a-b83f-98426d0a4a99" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:48:08 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 547c4d4c-e0dd-495a-b83f-98426d0a4a99] Updated the network info_cache for instance {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 21:48:08 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:48:08 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:48:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:48:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:48:11 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:48:11 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:48:11 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:48:11 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:48:11 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Auditing locally available compute resources for user (node: user) {{(pid=74337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 21:48:11 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 21:48:11 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 21:48:11 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56a4b932-486d-4b8d-9616-99e75592432a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:48:11 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56a4b932-486d-4b8d-9616-99e75592432a/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:48:11 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56a4b932-486d-4b8d-9616-99e75592432a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:48:12 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56a4b932-486d-4b8d-9616-99e75592432a/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:48:12 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/547c4d4c-e0dd-495a-b83f-98426d0a4a99/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:48:12 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/547c4d4c-e0dd-495a-b83f-98426d0a4a99/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:48:12 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/547c4d4c-e0dd-495a-b83f-98426d0a4a99/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:48:12 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/547c4d4c-e0dd-495a-b83f-98426d0a4a99/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:48:12 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 21:48:12 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e05fd36-ee44-4992-80a9-f95af608b9f5/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:48:12 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e05fd36-ee44-4992-80a9-f95af608b9f5/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:48:12 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e05fd36-ee44-4992-80a9-f95af608b9f5/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:48:12 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e05fd36-ee44-4992-80a9-f95af608b9f5/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:48:12 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba8d1d0-5fac-4213-9a50-a4e273710b1b/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:48:12 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba8d1d0-5fac-4213-9a50-a4e273710b1b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:48:12 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba8d1d0-5fac-4213-9a50-a4e273710b1b/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:48:13 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba8d1d0-5fac-4213-9a50-a4e273710b1b/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:48:13 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195a4056-3254-4558-b2f5-299bcd4af07c/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:48:13 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195a4056-3254-4558-b2f5-299bcd4af07c/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:48:13 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195a4056-3254-4558-b2f5-299bcd4af07c/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:48:13 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:48:13 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195a4056-3254-4558-b2f5-299bcd4af07c/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:48:13 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 21:48:13 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1189976f-8d02-468d-8fa7-bd5594c5f85a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:48:13 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1189976f-8d02-468d-8fa7-bd5594c5f85a/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:48:13 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1189976f-8d02-468d-8fa7-bd5594c5f85a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:48:13 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1189976f-8d02-468d-8fa7-bd5594c5f85a/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:48:14 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:48:14 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:48:14 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:48:14 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Hypervisor/Node resource view: name=user free_ram=7923MB free_disk=25.327594757080078GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 21:48:14 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:48:14 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:48:14 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 1189976f-8d02-468d-8fa7-bd5594c5f85a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:48:14 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 0ba8d1d0-5fac-4213-9a50-a4e273710b1b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:48:14 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 547c4d4c-e0dd-495a-b83f-98426d0a4a99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:48:14 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 00f757cf-e5dd-476f-81c6-670ed2bf6938 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Oct 23 21:48:14 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 56a4b932-486d-4b8d-9616-99e75592432a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:48:14 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:48:14 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 195a4056-3254-4558-b2f5-299bcd4af07c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:48:14 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 89e792eb-ad8f-4bb7-adac-315c3415cd6d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:48:14 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 4f85754a-aad0-43b7-9a99-65aa567eb114 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:48:14 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 1e05fd36-ee44-4992-80a9-f95af608b9f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:48:14 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 21:48:14 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 21:48:14 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:48:14 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:48:14 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Compute_service record updated for user:user {{(pid=74337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 21:48:14 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.562s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:48:15 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:48:15 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:48:17 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:48:18 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:48:19 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:48:22 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:48:24 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:48:29 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:48:29 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:48:29 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 21:48:29 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 21:48:29 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 21:48:29 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:48:30 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-56bf8555-f63a-486f-b30f-08b4621a7b88 tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] Acquiring lock "31cee1d7-a0f9-4909-b4e4-4513584f9ce2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:48:30 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-56bf8555-f63a-486f-b30f-08b4621a7b88 tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] Lock "31cee1d7-a0f9-4909-b4e4-4513584f9ce2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:48:30 user nova-compute[74337]: DEBUG nova.compute.manager [None req-56bf8555-f63a-486f-b30f-08b4621a7b88 tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] [instance: 31cee1d7-a0f9-4909-b4e4-4513584f9ce2] Starting instance... {{(pid=74337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 21:48:30 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-56bf8555-f63a-486f-b30f-08b4621a7b88 tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:48:30 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-56bf8555-f63a-486f-b30f-08b4621a7b88 tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:48:30 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-56bf8555-f63a-486f-b30f-08b4621a7b88 tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 21:48:30 user nova-compute[74337]: INFO nova.compute.claims [None req-56bf8555-f63a-486f-b30f-08b4621a7b88 tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] [instance: 31cee1d7-a0f9-4909-b4e4-4513584f9ce2] Claim successful on node user
Oct 23 21:48:30 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-56bf8555-f63a-486f-b30f-08b4621a7b88 tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:48:30 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-56bf8555-f63a-486f-b30f-08b4621a7b88 tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:48:30 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-56bf8555-f63a-486f-b30f-08b4621a7b88 tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.424s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:48:30 user nova-compute[74337]: DEBUG nova.compute.manager [None req-56bf8555-f63a-486f-b30f-08b4621a7b88 tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] [instance: 31cee1d7-a0f9-4909-b4e4-4513584f9ce2] Start building networks asynchronously for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 21:48:30 user nova-compute[74337]: DEBUG nova.compute.manager [None req-56bf8555-f63a-486f-b30f-08b4621a7b88 tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] [instance: 31cee1d7-a0f9-4909-b4e4-4513584f9ce2] Allocating IP information in the background. {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 21:48:30 user nova-compute[74337]: DEBUG nova.network.neutron [None req-56bf8555-f63a-486f-b30f-08b4621a7b88 tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] [instance: 31cee1d7-a0f9-4909-b4e4-4513584f9ce2] allocate_for_instance() {{(pid=74337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 21:48:30 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-56bf8555-f63a-486f-b30f-08b4621a7b88 tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] [instance: 31cee1d7-a0f9-4909-b4e4-4513584f9ce2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 21:48:30 user nova-compute[74337]: DEBUG nova.compute.manager [None req-56bf8555-f63a-486f-b30f-08b4621a7b88 tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] [instance: 31cee1d7-a0f9-4909-b4e4-4513584f9ce2] Start building block device mappings for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 21:48:31 user nova-compute[74337]: DEBUG nova.compute.manager [None req-56bf8555-f63a-486f-b30f-08b4621a7b88 tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] [instance: 31cee1d7-a0f9-4909-b4e4-4513584f9ce2] Start spawning the instance on the hypervisor. {{(pid=74337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 21:48:31 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-56bf8555-f63a-486f-b30f-08b4621a7b88 tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] [instance: 31cee1d7-a0f9-4909-b4e4-4513584f9ce2] Creating instance directory {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 21:48:31 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-56bf8555-f63a-486f-b30f-08b4621a7b88 tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] [instance: 31cee1d7-a0f9-4909-b4e4-4513584f9ce2] Creating image(s)
Oct 23 21:48:31 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-56bf8555-f63a-486f-b30f-08b4621a7b88 tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] Acquiring lock "/opt/stack/data/nova/instances/31cee1d7-a0f9-4909-b4e4-4513584f9ce2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:48:31 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-56bf8555-f63a-486f-b30f-08b4621a7b88 tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] Lock "/opt/stack/data/nova/instances/31cee1d7-a0f9-4909-b4e4-4513584f9ce2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:48:31 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-56bf8555-f63a-486f-b30f-08b4621a7b88 tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] Lock "/opt/stack/data/nova/instances/31cee1d7-a0f9-4909-b4e4-4513584f9ce2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:48:31 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-56bf8555-f63a-486f-b30f-08b4621a7b88 tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:48:31 user nova-compute[74337]: DEBUG nova.policy [None req-56bf8555-f63a-486f-b30f-08b4621a7b88 tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '088a31403f0b4113ba310bc9edf33e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be383a166193438fa661aa9142ac6609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74337) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 21:48:31 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-56bf8555-f63a-486f-b30f-08b4621a7b88 tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.182s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:48:31 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-56bf8555-f63a-486f-b30f-08b4621a7b88 tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] Acquiring lock "fc7b140751b8c385de81623e40fb09ce09374ab7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:48:31 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-56bf8555-f63a-486f-b30f-08b4621a7b88 tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] Lock "fc7b140751b8c385de81623e40fb09ce09374ab7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:48:31 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-56bf8555-f63a-486f-b30f-08b4621a7b88 tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:48:31 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-56bf8555-f63a-486f-b30f-08b4621a7b88 tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.172s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:48:31 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-56bf8555-f63a-486f-b30f-08b4621a7b88 tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7,backing_fmt=raw /opt/stack/data/nova/instances/31cee1d7-a0f9-4909-b4e4-4513584f9ce2/disk 1073741824 {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:48:31 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-56bf8555-f63a-486f-b30f-08b4621a7b88 tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7,backing_fmt=raw /opt/stack/data/nova/instances/31cee1d7-a0f9-4909-b4e4-4513584f9ce2/disk 1073741824" returned: 0 in 0.046s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:48:31 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-56bf8555-f63a-486f-b30f-08b4621a7b88 tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] Lock "fc7b140751b8c385de81623e40fb09ce09374ab7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:48:31 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-56bf8555-f63a-486f-b30f-08b4621a7b88 tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:48:31 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-56bf8555-f63a-486f-b30f-08b4621a7b88 tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.175s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:48:31 user nova-compute[74337]: DEBUG nova.virt.disk.api [None req-56bf8555-f63a-486f-b30f-08b4621a7b88 tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] Checking if we can resize image /opt/stack/data/nova/instances/31cee1d7-a0f9-4909-b4e4-4513584f9ce2/disk. size=1073741824 {{(pid=74337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 21:48:31 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-56bf8555-f63a-486f-b30f-08b4621a7b88 tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31cee1d7-a0f9-4909-b4e4-4513584f9ce2/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:48:31 user nova-compute[74337]: DEBUG nova.network.neutron [None req-56bf8555-f63a-486f-b30f-08b4621a7b88 tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] [instance: 31cee1d7-a0f9-4909-b4e4-4513584f9ce2] Successfully created port: 0dab73f8-3c29-4332-8f12-e3989869b1e0 {{(pid=74337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 21:48:31 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-56bf8555-f63a-486f-b30f-08b4621a7b88 tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31cee1d7-a0f9-4909-b4e4-4513584f9ce2/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:48:31 user nova-compute[74337]: DEBUG nova.virt.disk.api [None req-56bf8555-f63a-486f-b30f-08b4621a7b88 tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] Cannot resize image /opt/stack/data/nova/instances/31cee1d7-a0f9-4909-b4e4-4513584f9ce2/disk to a smaller size. {{(pid=74337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 21:48:31 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-56bf8555-f63a-486f-b30f-08b4621a7b88 tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] [instance: 31cee1d7-a0f9-4909-b4e4-4513584f9ce2] Created local disks {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 21:48:31 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-56bf8555-f63a-486f-b30f-08b4621a7b88 tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] [instance: 31cee1d7-a0f9-4909-b4e4-4513584f9ce2] Ensure instance console log exists: /opt/stack/data/nova/instances/31cee1d7-a0f9-4909-b4e4-4513584f9ce2/console.log {{(pid=74337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 21:48:31 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-56bf8555-f63a-486f-b30f-08b4621a7b88 tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:48:31 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-56bf8555-f63a-486f-b30f-08b4621a7b88 tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:48:31 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-56bf8555-f63a-486f-b30f-08b4621a7b88 tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:48:32 user nova-compute[74337]: DEBUG nova.network.neutron [None req-56bf8555-f63a-486f-b30f-08b4621a7b88 tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] [instance: 31cee1d7-a0f9-4909-b4e4-4513584f9ce2] Successfully updated port: 0dab73f8-3c29-4332-8f12-e3989869b1e0 {{(pid=74337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 21:48:32 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-56bf8555-f63a-486f-b30f-08b4621a7b88 tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] Acquiring lock "refresh_cache-31cee1d7-a0f9-4909-b4e4-4513584f9ce2" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:48:32 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-56bf8555-f63a-486f-b30f-08b4621a7b88 tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] Acquired lock "refresh_cache-31cee1d7-a0f9-4909-b4e4-4513584f9ce2" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:48:32 user nova-compute[74337]: DEBUG nova.network.neutron [None req-56bf8555-f63a-486f-b30f-08b4621a7b88 tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] [instance: 31cee1d7-a0f9-4909-b4e4-4513584f9ce2] Building network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 21:48:32 user nova-compute[74337]: DEBUG nova.compute.manager [req-c4ca1ef7-9d2c-45b6-b237-d970ff7cba77 req-8a902bf1-db21-4e81-9a46-23acf5f738bd service nova] [instance: 31cee1d7-a0f9-4909-b4e4-4513584f9ce2] Received event network-changed-0dab73f8-3c29-4332-8f12-e3989869b1e0 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:48:32 user nova-compute[74337]: DEBUG nova.compute.manager [req-c4ca1ef7-9d2c-45b6-b237-d970ff7cba77 req-8a902bf1-db21-4e81-9a46-23acf5f738bd service nova] [instance: 31cee1d7-a0f9-4909-b4e4-4513584f9ce2] Refreshing instance network info cache due to event network-changed-0dab73f8-3c29-4332-8f12-e3989869b1e0. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 21:48:32 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-c4ca1ef7-9d2c-45b6-b237-d970ff7cba77 req-8a902bf1-db21-4e81-9a46-23acf5f738bd service nova] Acquiring lock "refresh_cache-31cee1d7-a0f9-4909-b4e4-4513584f9ce2" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:48:32 user nova-compute[74337]: DEBUG nova.network.neutron [None req-56bf8555-f63a-486f-b30f-08b4621a7b88 tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] [instance: 31cee1d7-a0f9-4909-b4e4-4513584f9ce2] Instance cache missing network info. {{(pid=74337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 21:48:32 user nova-compute[74337]: DEBUG nova.network.neutron [None req-56bf8555-f63a-486f-b30f-08b4621a7b88 tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] [instance: 31cee1d7-a0f9-4909-b4e4-4513584f9ce2] Updating instance_info_cache with network_info: [{"id": "0dab73f8-3c29-4332-8f12-e3989869b1e0", "address": "fa:16:3e:46:b1:40", "network": {"id": "f892179a-1c7a-4ca8-8096-98be26497573", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "ff43462300764979a6cf688444336a56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dab73f8-3c", "ovs_interfaceid": "0dab73f8-3c29-4332-8f12-e3989869b1e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:48:32 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-56bf8555-f63a-486f-b30f-08b4621a7b88 tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] Releasing lock "refresh_cache-31cee1d7-a0f9-4909-b4e4-4513584f9ce2" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:48:32 user nova-compute[74337]: DEBUG nova.compute.manager [None req-56bf8555-f63a-486f-b30f-08b4621a7b88 tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] [instance: 31cee1d7-a0f9-4909-b4e4-4513584f9ce2] Instance network_info: |[{"id": "0dab73f8-3c29-4332-8f12-e3989869b1e0", "address": "fa:16:3e:46:b1:40", "network": {"id": "f892179a-1c7a-4ca8-8096-98be26497573", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "ff43462300764979a6cf688444336a56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dab73f8-3c", "ovs_interfaceid": "0dab73f8-3c29-4332-8f12-e3989869b1e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 21:48:32 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-c4ca1ef7-9d2c-45b6-b237-d970ff7cba77 req-8a902bf1-db21-4e81-9a46-23acf5f738bd service nova] Acquired lock "refresh_cache-31cee1d7-a0f9-4909-b4e4-4513584f9ce2" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:48:32 user nova-compute[74337]: DEBUG nova.network.neutron [req-c4ca1ef7-9d2c-45b6-b237-d970ff7cba77 req-8a902bf1-db21-4e81-9a46-23acf5f738bd service nova] [instance: 31cee1d7-a0f9-4909-b4e4-4513584f9ce2] Refreshing network info cache for port 0dab73f8-3c29-4332-8f12-e3989869b1e0 {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 21:48:32 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-56bf8555-f63a-486f-b30f-08b4621a7b88 tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] [instance: 31cee1d7-a0f9-4909-b4e4-4513584f9ce2] Start _get_guest_xml network_info=[{"id": "0dab73f8-3c29-4332-8f12-e3989869b1e0", "address": "fa:16:3e:46:b1:40", "network": {"id": "f892179a-1c7a-4ca8-8096-98be26497573", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "ff43462300764979a6cf688444336a56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dab73f8-3c", "ovs_interfaceid": "0dab73f8-3c29-4332-8f12-e3989869b1e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T21:29:21Z,direct_url=<?>,disk_format='qcow2',id=d859d89d-998d-4109-b26a-0d6e28152932,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ff43462300764979a6cf688444336a56',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T21:29:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'image_id': 'd859d89d-998d-4109-b26a-0d6e28152932'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 21:48:32 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-56bf8555-f63a-486f-b30f-08b4621a7b88 tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:48:32 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-56bf8555-f63a-486f-b30f-08b4621a7b88 tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:48:32 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-56bf8555-f63a-486f-b30f-08b4621a7b88 tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 21:48:32 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-56bf8555-f63a-486f-b30f-08b4621a7b88 tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] CPU controller missing on host. {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 21:48:32 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-56bf8555-f63a-486f-b30f-08b4621a7b88 tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 21:48:32 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-56bf8555-f63a-486f-b30f-08b4621a7b88 tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] CPU controller found on host. {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 21:48:32 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-56bf8555-f63a-486f-b30f-08b4621a7b88 tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 21:48:32 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-56bf8555-f63a-486f-b30f-08b4621a7b88 tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T21:29:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T21:29:21Z,direct_url=<?>,disk_format='qcow2',id=d859d89d-998d-4109-b26a-0d6e28152932,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ff43462300764979a6cf688444336a56',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T21:29:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 21:48:32 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-56bf8555-f63a-486f-b30f-08b4621a7b88 tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] Flavor limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 21:48:32 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-56bf8555-f63a-486f-b30f-08b4621a7b88 tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] Image limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 21:48:32 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-56bf8555-f63a-486f-b30f-08b4621a7b88 tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] Flavor pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 21:48:32 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-56bf8555-f63a-486f-b30f-08b4621a7b88 tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] Image pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 21:48:32 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-56bf8555-f63a-486f-b30f-08b4621a7b88 tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 21:48:32 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-56bf8555-f63a-486f-b30f-08b4621a7b88 tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 21:48:32 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-56bf8555-f63a-486f-b30f-08b4621a7b88 tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 21:48:32 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-56bf8555-f63a-486f-b30f-08b4621a7b88 tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] Got 1 possible topologies {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 21:48:32 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-56bf8555-f63a-486f-b30f-08b4621a7b88 tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 21:48:32 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-56bf8555-f63a-486f-b30f-08b4621a7b88 tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 21:48:32 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-56bf8555-f63a-486f-b30f-08b4621a7b88 tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:48:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1602505068',display_name='tempest-VolumesNegativeTest-instance-1602505068',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1602505068',id=28,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be383a166193438fa661aa9142ac6609',ramdisk_id='',reservation_id='r-v0szuv0m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1848392112',owner_user_name='tempest-VolumesNegativeTest-1848392112-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:48:31Z,user_data=None,user_id='088a31403f0b4113ba310bc9edf33e04',uuid=31cee1d7-a0f9-4909-b4e4-4513584f9ce2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0dab73f8-3c29-4332-8f12-e3989869b1e0", "address": "fa:16:3e:46:b1:40", "network": {"id": "f892179a-1c7a-4ca8-8096-98be26497573", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "ff43462300764979a6cf688444336a56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dab73f8-3c", "ovs_interfaceid": "0dab73f8-3c29-4332-8f12-e3989869b1e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 21:48:32 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-56bf8555-f63a-486f-b30f-08b4621a7b88 tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] Converting VIF {"id": "0dab73f8-3c29-4332-8f12-e3989869b1e0", "address": "fa:16:3e:46:b1:40", "network": {"id": "f892179a-1c7a-4ca8-8096-98be26497573", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "ff43462300764979a6cf688444336a56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dab73f8-3c", "ovs_interfaceid": "0dab73f8-3c29-4332-8f12-e3989869b1e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:48:32 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-56bf8555-f63a-486f-b30f-08b4621a7b88 tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:b1:40,bridge_name='br-int',has_traffic_filtering=True,id=0dab73f8-3c29-4332-8f12-e3989869b1e0,network=Network(f892179a-1c7a-4ca8-8096-98be26497573),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dab73f8-3c') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:48:32 user nova-compute[74337]: DEBUG nova.objects.instance [None req-56bf8555-f63a-486f-b30f-08b4621a7b88 tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] Lazy-loading 'pci_devices' on Instance uuid 31cee1d7-a0f9-4909-b4e4-4513584f9ce2 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:48:32 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-56bf8555-f63a-486f-b30f-08b4621a7b88 tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] [instance: 31cee1d7-a0f9-4909-b4e4-4513584f9ce2] End _get_guest_xml xml=<domain type="kvm">
Oct 23 21:48:32 user nova-compute[74337]:   <uuid>31cee1d7-a0f9-4909-b4e4-4513584f9ce2</uuid>
Oct 23 21:48:32 user nova-compute[74337]:   <name>instance-0000001c</name>
Oct 23 21:48:32 user nova-compute[74337]:   <memory>524288</memory>
Oct 23 21:48:32 user nova-compute[74337]:   <vcpu>1</vcpu>
Oct 23 21:48:32 user nova-compute[74337]:   <metadata>
Oct 23 21:48:32 user nova-compute[74337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 21:48:32 user nova-compute[74337]:       <nova:package version="0.0.0"/>
Oct 23 21:48:32 user nova-compute[74337]:       <nova:name>tempest-VolumesNegativeTest-instance-1602505068</nova:name>
Oct 23 21:48:32 user nova-compute[74337]:       <nova:creationTime>2023-10-23 21:48:32</nova:creationTime>
Oct 23 21:48:32 user nova-compute[74337]:       <nova:flavor name="m1.tiny">
Oct 23 21:48:32 user nova-compute[74337]:         <nova:memory>512</nova:memory>
Oct 23 21:48:32 user nova-compute[74337]:         <nova:disk>1</nova:disk>
Oct 23 21:48:32 user nova-compute[74337]:         <nova:swap>0</nova:swap>
Oct 23 21:48:32 user nova-compute[74337]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 21:48:32 user nova-compute[74337]:         <nova:vcpus>1</nova:vcpus>
Oct 23 21:48:32 user nova-compute[74337]:       </nova:flavor>
Oct 23 21:48:32 user nova-compute[74337]:       <nova:owner>
Oct 23 21:48:32 user nova-compute[74337]:         <nova:user uuid="088a31403f0b4113ba310bc9edf33e04">tempest-VolumesNegativeTest-1848392112-project-member</nova:user>
Oct 23 21:48:32 user nova-compute[74337]:         <nova:project uuid="be383a166193438fa661aa9142ac6609">tempest-VolumesNegativeTest-1848392112</nova:project>
Oct 23 21:48:32 user nova-compute[74337]:       </nova:owner>
Oct 23 21:48:32 user nova-compute[74337]:       <nova:root type="image" uuid="d859d89d-998d-4109-b26a-0d6e28152932"/>
Oct 23 21:48:32 user nova-compute[74337]:       <nova:ports>
Oct 23 21:48:32 user nova-compute[74337]:         <nova:port uuid="0dab73f8-3c29-4332-8f12-e3989869b1e0">
Oct 23 21:48:32 user nova-compute[74337]:           <nova:ip type="fixed" address="192.168.233.252" ipVersion="4"/>
Oct 23 21:48:32 user nova-compute[74337]:         </nova:port>
Oct 23 21:48:32 user nova-compute[74337]:       </nova:ports>
Oct 23 21:48:32 user nova-compute[74337]:     </nova:instance>
Oct 23 21:48:32 user nova-compute[74337]:   </metadata>
Oct 23 21:48:32 user nova-compute[74337]:   <sysinfo type="smbios">
Oct 23 21:48:32 user nova-compute[74337]:     <system>
Oct 23 21:48:32 user nova-compute[74337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 21:48:32 user nova-compute[74337]:       <entry name="product">OpenStack Nova</entry>
Oct 23 21:48:32 user nova-compute[74337]:       <entry name="version">0.0.0</entry>
Oct 23 21:48:32 user nova-compute[74337]:       <entry name="serial">31cee1d7-a0f9-4909-b4e4-4513584f9ce2</entry>
Oct 23 21:48:32 user nova-compute[74337]:       <entry name="uuid">31cee1d7-a0f9-4909-b4e4-4513584f9ce2</entry>
Oct 23 21:48:32 user nova-compute[74337]:       <entry name="family">Virtual Machine</entry>
Oct 23 21:48:32 user nova-compute[74337]:     </system>
Oct 23 21:48:32 user nova-compute[74337]:   </sysinfo>
Oct 23 21:48:32 user nova-compute[74337]:   <os>
Oct 23 21:48:32 user nova-compute[74337]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 21:48:32 user nova-compute[74337]:     <boot dev="hd"/>
Oct 23 21:48:32 user nova-compute[74337]:     <smbios mode="sysinfo"/>
Oct 23 21:48:32 user nova-compute[74337]:   </os>
Oct 23 21:48:32 user nova-compute[74337]:   <features>
Oct 23 21:48:32 user nova-compute[74337]:     <acpi/>
Oct 23 21:48:32 user nova-compute[74337]:     <apic/>
Oct 23 21:48:32 user nova-compute[74337]:     <vmcoreinfo/>
Oct 23 21:48:32 user nova-compute[74337]:   </features>
Oct 23 21:48:32 user nova-compute[74337]:   <clock offset="utc">
Oct 23 21:48:32 user nova-compute[74337]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 21:48:32 user nova-compute[74337]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 21:48:32 user nova-compute[74337]:     <timer name="hpet" present="no"/>
Oct 23 21:48:32 user nova-compute[74337]:   </clock>
Oct 23 21:48:32 user nova-compute[74337]:   <cpu mode="custom" match="exact">
Oct 23 21:48:32 user nova-compute[74337]:     <model>Nehalem</model>
Oct 23 21:48:32 user nova-compute[74337]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 21:48:32 user nova-compute[74337]:   </cpu>
Oct 23 21:48:32 user nova-compute[74337]:   <devices>
Oct 23 21:48:32 user nova-compute[74337]:     <disk type="file" device="disk">
Oct 23 21:48:32 user nova-compute[74337]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 21:48:32 user nova-compute[74337]:       <source file="/opt/stack/data/nova/instances/31cee1d7-a0f9-4909-b4e4-4513584f9ce2/disk"/>
Oct 23 21:48:32 user nova-compute[74337]:       <target dev="vda" bus="virtio"/>
Oct 23 21:48:32 user nova-compute[74337]:     </disk>
Oct 23 21:48:32 user nova-compute[74337]:     <interface type="ethernet">
Oct 23 21:48:32 user nova-compute[74337]:       <mac address="fa:16:3e:46:b1:40"/>
Oct 23 21:48:32 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:48:32 user nova-compute[74337]:       <mtu size="1442"/>
Oct 23 21:48:32 user nova-compute[74337]:       <target dev="tap0dab73f8-3c"/>
Oct 23 21:48:32 user nova-compute[74337]:     </interface>
Oct 23 21:48:32 user nova-compute[74337]:     <serial type="pty">
Oct 23 21:48:32 user nova-compute[74337]:       <log file="/opt/stack/data/nova/instances/31cee1d7-a0f9-4909-b4e4-4513584f9ce2/console.log" append="off"/>
Oct 23 21:48:32 user nova-compute[74337]:     </serial>
Oct 23 21:48:32 user nova-compute[74337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 21:48:32 user nova-compute[74337]:     <video>
Oct 23 21:48:32 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:48:32 user nova-compute[74337]:     </video>
Oct 23 21:48:32 user nova-compute[74337]:     <rng model="virtio">
Oct 23 21:48:32 user nova-compute[74337]:       <backend model="random">/dev/urandom</backend>
Oct 23 21:48:32 user nova-compute[74337]:     </rng>
Oct 23 21:48:32 user nova-compute[74337]:     <controller type="usb" index="0" model="none"/>
Oct 23 21:48:32 user nova-compute[74337]:     <memballoon model="virtio">
Oct 23 21:48:32 user nova-compute[74337]:       <stats period="10"/>
Oct 23 21:48:32 user nova-compute[74337]:     </memballoon>
Oct 23 21:48:32 user nova-compute[74337]:   </devices>
Oct 23 21:48:32 user nova-compute[74337]: </domain>
Oct 23 21:48:32 user nova-compute[74337]:  {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 21:48:32 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-56bf8555-f63a-486f-b30f-08b4621a7b88 tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:48:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1602505068',display_name='tempest-VolumesNegativeTest-instance-1602505068',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1602505068',id=28,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be383a166193438fa661aa9142ac6609',ramdisk_id='',reservation_id='r-v0szuv0m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1848392112',owner_user_name='tempest-VolumesNegativeTest-1848392112-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:48:31Z,user_data=None,user_id='088a31403f0b4113ba310bc9edf33e04',uuid=31cee1d7-a0f9-4909-b4e4-4513584f9ce2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0dab73f8-3c29-4332-8f12-e3989869b1e0", "address": "fa:16:3e:46:b1:40", "network": {"id": "f892179a-1c7a-4ca8-8096-98be26497573", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "ff43462300764979a6cf688444336a56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dab73f8-3c", "ovs_interfaceid": "0dab73f8-3c29-4332-8f12-e3989869b1e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 21:48:32 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-56bf8555-f63a-486f-b30f-08b4621a7b88 tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] Converting VIF {"id": "0dab73f8-3c29-4332-8f12-e3989869b1e0", "address": "fa:16:3e:46:b1:40", "network": {"id": "f892179a-1c7a-4ca8-8096-98be26497573", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "ff43462300764979a6cf688444336a56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dab73f8-3c", "ovs_interfaceid": "0dab73f8-3c29-4332-8f12-e3989869b1e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:48:32 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-56bf8555-f63a-486f-b30f-08b4621a7b88 tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:b1:40,bridge_name='br-int',has_traffic_filtering=True,id=0dab73f8-3c29-4332-8f12-e3989869b1e0,network=Network(f892179a-1c7a-4ca8-8096-98be26497573),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dab73f8-3c') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:48:32 user nova-compute[74337]: DEBUG os_vif [None req-56bf8555-f63a-486f-b30f-08b4621a7b88 tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:b1:40,bridge_name='br-int',has_traffic_filtering=True,id=0dab73f8-3c29-4332-8f12-e3989869b1e0,network=Network(f892179a-1c7a-4ca8-8096-98be26497573),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dab73f8-3c') {{(pid=74337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 21:48:32 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:48:32 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:48:32 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 21:48:32 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:48:32 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9e5e0301-e419-5bcc-86aa-0e63a8725f93', '_type': 'linux-noop'}}, row=False) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:48:32 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:48:32 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:48:32 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:48:32 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:48:32 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0dab73f8-3c, may_exist=True, interface_attrs={}) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:48:32 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0dab73f8-3c, col_values=(('qos', UUID('bea03696-6767-48ee-9e07-4c767bbb3706')),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:48:32 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0dab73f8-3c, col_values=(('external_ids', {'iface-id': '0dab73f8-3c29-4332-8f12-e3989869b1e0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:46:b1:40', 'vm-uuid': '31cee1d7-a0f9-4909-b4e4-4513584f9ce2'}),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:48:32 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:48:32 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:48:32 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:48:32 user nova-compute[74337]: INFO os_vif [None req-56bf8555-f63a-486f-b30f-08b4621a7b88 tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:b1:40,bridge_name='br-int',has_traffic_filtering=True,id=0dab73f8-3c29-4332-8f12-e3989869b1e0,network=Network(f892179a-1c7a-4ca8-8096-98be26497573),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dab73f8-3c')
Oct 23 21:48:32 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-56bf8555-f63a-486f-b30f-08b4621a7b88 tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] No BDM found with device name vda, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 21:48:32 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-56bf8555-f63a-486f-b30f-08b4621a7b88 tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] No VIF found with MAC fa:16:3e:46:b1:40, not building metadata {{(pid=74337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 21:48:33 user nova-compute[74337]: DEBUG nova.network.neutron [req-c4ca1ef7-9d2c-45b6-b237-d970ff7cba77 req-8a902bf1-db21-4e81-9a46-23acf5f738bd service nova] [instance: 31cee1d7-a0f9-4909-b4e4-4513584f9ce2] Updated VIF entry in instance network info cache for port 0dab73f8-3c29-4332-8f12-e3989869b1e0. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 21:48:33 user nova-compute[74337]: DEBUG nova.network.neutron [req-c4ca1ef7-9d2c-45b6-b237-d970ff7cba77 req-8a902bf1-db21-4e81-9a46-23acf5f738bd service nova] [instance: 31cee1d7-a0f9-4909-b4e4-4513584f9ce2] Updating instance_info_cache with network_info: [{"id": "0dab73f8-3c29-4332-8f12-e3989869b1e0", "address": "fa:16:3e:46:b1:40", "network": {"id": "f892179a-1c7a-4ca8-8096-98be26497573", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "ff43462300764979a6cf688444336a56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dab73f8-3c", "ovs_interfaceid": "0dab73f8-3c29-4332-8f12-e3989869b1e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:48:33 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-c4ca1ef7-9d2c-45b6-b237-d970ff7cba77 req-8a902bf1-db21-4e81-9a46-23acf5f738bd service nova] Releasing lock "refresh_cache-31cee1d7-a0f9-4909-b4e4-4513584f9ce2" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:48:34 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:48:34 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:48:34 user nova-compute[74337]: DEBUG nova.compute.manager [req-3ac2ccc3-4dce-4da1-8680-e291928fc13a req-6799c058-1579-4fab-b049-1668ed963f10 service nova] [instance: 31cee1d7-a0f9-4909-b4e4-4513584f9ce2] Received event network-vif-plugged-0dab73f8-3c29-4332-8f12-e3989869b1e0 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:48:34 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-3ac2ccc3-4dce-4da1-8680-e291928fc13a req-6799c058-1579-4fab-b049-1668ed963f10 service nova] Acquiring lock "31cee1d7-a0f9-4909-b4e4-4513584f9ce2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:48:34 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-3ac2ccc3-4dce-4da1-8680-e291928fc13a req-6799c058-1579-4fab-b049-1668ed963f10 service nova] Lock "31cee1d7-a0f9-4909-b4e4-4513584f9ce2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:48:34 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-3ac2ccc3-4dce-4da1-8680-e291928fc13a req-6799c058-1579-4fab-b049-1668ed963f10 service nova] Lock "31cee1d7-a0f9-4909-b4e4-4513584f9ce2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:48:34 user nova-compute[74337]: DEBUG nova.compute.manager [req-3ac2ccc3-4dce-4da1-8680-e291928fc13a req-6799c058-1579-4fab-b049-1668ed963f10 service nova] [instance: 31cee1d7-a0f9-4909-b4e4-4513584f9ce2] No waiting events found dispatching network-vif-plugged-0dab73f8-3c29-4332-8f12-e3989869b1e0 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:48:34 user nova-compute[74337]: WARNING nova.compute.manager [req-3ac2ccc3-4dce-4da1-8680-e291928fc13a req-6799c058-1579-4fab-b049-1668ed963f10 service nova] [instance: 31cee1d7-a0f9-4909-b4e4-4513584f9ce2] Received unexpected event network-vif-plugged-0dab73f8-3c29-4332-8f12-e3989869b1e0 for instance with vm_state building and task_state spawning.
Oct 23 21:48:34 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:48:34 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:48:34 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:48:34 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:48:35 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-0c3a146b-4c85-4664-98d5-60e24f6b1cc3 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Acquiring lock "195a4056-3254-4558-b2f5-299bcd4af07c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:48:35 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-0c3a146b-4c85-4664-98d5-60e24f6b1cc3 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lock "195a4056-3254-4558-b2f5-299bcd4af07c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:48:35 user nova-compute[74337]: INFO nova.compute.manager [None req-0c3a146b-4c85-4664-98d5-60e24f6b1cc3 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Detaching volume 9a863deb-8b0f-4e44-b7d7-16ace509f43c
Oct 23 21:48:35 user nova-compute[74337]: INFO nova.virt.block_device [None req-0c3a146b-4c85-4664-98d5-60e24f6b1cc3 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Attempting to driver detach volume 9a863deb-8b0f-4e44-b7d7-16ace509f43c from mountpoint /dev/vdb
Oct 23 21:48:35 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-0c3a146b-4c85-4664-98d5-60e24f6b1cc3 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Attempting to detach device vdb from instance 195a4056-3254-4558-b2f5-299bcd4af07c from the persistent domain config. {{(pid=74337) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 21:48:35 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-0c3a146b-4c85-4664-98d5-60e24f6b1cc3 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 21:48:35 user nova-compute[74337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 21:48:35 user nova-compute[74337]:   <source dev="/dev/sdf"/>
Oct 23 21:48:35 user nova-compute[74337]:   <target dev="vdb" bus="virtio"/>
Oct 23 21:48:35 user nova-compute[74337]:   <serial>9a863deb-8b0f-4e44-b7d7-16ace509f43c</serial>
Oct 23 21:48:35 user nova-compute[74337]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 23 21:48:35 user nova-compute[74337]: </disk>
Oct 23 21:48:35 user nova-compute[74337]:  {{(pid=74337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 21:48:35 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-0c3a146b-4c85-4664-98d5-60e24f6b1cc3 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Successfully detached device vdb from instance 195a4056-3254-4558-b2f5-299bcd4af07c from the persistent domain config.
Oct 23 21:48:35 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-0c3a146b-4c85-4664-98d5-60e24f6b1cc3 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 195a4056-3254-4558-b2f5-299bcd4af07c from the live domain config. {{(pid=74337) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 21:48:35 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-0c3a146b-4c85-4664-98d5-60e24f6b1cc3 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 21:48:35 user nova-compute[74337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 21:48:35 user nova-compute[74337]:   <source dev="/dev/sdf"/>
Oct 23 21:48:35 user nova-compute[74337]:   <target dev="vdb" bus="virtio"/>
Oct 23 21:48:35 user nova-compute[74337]:   <serial>9a863deb-8b0f-4e44-b7d7-16ace509f43c</serial>
Oct 23 21:48:35 user nova-compute[74337]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 23 21:48:35 user nova-compute[74337]: </disk>
Oct 23 21:48:35 user nova-compute[74337]:  {{(pid=74337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 21:48:36 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-0c3a146b-4c85-4664-98d5-60e24f6b1cc3 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 195a4056-3254-4558-b2f5-299bcd4af07c {{(pid=74337) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 21:48:36 user nova-compute[74337]: DEBUG nova.compute.manager [None req-56bf8555-f63a-486f-b30f-08b4621a7b88 tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] [instance: 31cee1d7-a0f9-4909-b4e4-4513584f9ce2] Instance event wait completed in 0 seconds for  {{(pid=74337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 21:48:36 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-56bf8555-f63a-486f-b30f-08b4621a7b88 tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] [instance: 31cee1d7-a0f9-4909-b4e4-4513584f9ce2] Guest created on hypervisor {{(pid=74337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 21:48:36 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: 31cee1d7-a0f9-4909-b4e4-4513584f9ce2] Instance spawned successfully.
Oct 23 21:48:36 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-56bf8555-f63a-486f-b30f-08b4621a7b88 tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] [instance: 31cee1d7-a0f9-4909-b4e4-4513584f9ce2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 21:48:36 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-56bf8555-f63a-486f-b30f-08b4621a7b88 tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] [instance: 31cee1d7-a0f9-4909-b4e4-4513584f9ce2] Found default for hw_cdrom_bus of ide {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:48:36 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-56bf8555-f63a-486f-b30f-08b4621a7b88 tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] [instance: 31cee1d7-a0f9-4909-b4e4-4513584f9ce2] Found default for hw_disk_bus of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:48:36 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-56bf8555-f63a-486f-b30f-08b4621a7b88 tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] [instance: 31cee1d7-a0f9-4909-b4e4-4513584f9ce2] Found default for hw_input_bus of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:48:36 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-56bf8555-f63a-486f-b30f-08b4621a7b88 tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] [instance: 31cee1d7-a0f9-4909-b4e4-4513584f9ce2] Found default for hw_pointer_model of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:48:36 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-56bf8555-f63a-486f-b30f-08b4621a7b88 tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] [instance: 31cee1d7-a0f9-4909-b4e4-4513584f9ce2] Found default for hw_video_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:48:36 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-56bf8555-f63a-486f-b30f-08b4621a7b88 tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] [instance: 31cee1d7-a0f9-4909-b4e4-4513584f9ce2] Found default for hw_vif_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:48:36 user nova-compute[74337]: INFO nova.compute.manager [None req-56bf8555-f63a-486f-b30f-08b4621a7b88 tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] [instance: 31cee1d7-a0f9-4909-b4e4-4513584f9ce2] Took 5.40 seconds to spawn the instance on the hypervisor.
Oct 23 21:48:36 user nova-compute[74337]: DEBUG nova.compute.manager [None req-56bf8555-f63a-486f-b30f-08b4621a7b88 tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] [instance: 31cee1d7-a0f9-4909-b4e4-4513584f9ce2] Checking state {{(pid=74337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 21:48:36 user nova-compute[74337]: DEBUG nova.compute.manager [req-93721e01-3fa1-46d2-b32b-57a351bac5c1 req-9b97ada8-f080-474d-9374-53361e487800 service nova] [instance: 31cee1d7-a0f9-4909-b4e4-4513584f9ce2] Received event network-vif-plugged-0dab73f8-3c29-4332-8f12-e3989869b1e0 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:48:36 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-93721e01-3fa1-46d2-b32b-57a351bac5c1 req-9b97ada8-f080-474d-9374-53361e487800 service nova] Acquiring lock "31cee1d7-a0f9-4909-b4e4-4513584f9ce2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:48:36 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-93721e01-3fa1-46d2-b32b-57a351bac5c1 req-9b97ada8-f080-474d-9374-53361e487800 service nova] Lock "31cee1d7-a0f9-4909-b4e4-4513584f9ce2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:48:36 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-93721e01-3fa1-46d2-b32b-57a351bac5c1 req-9b97ada8-f080-474d-9374-53361e487800 service nova] Lock "31cee1d7-a0f9-4909-b4e4-4513584f9ce2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:48:36 user nova-compute[74337]: DEBUG nova.compute.manager [req-93721e01-3fa1-46d2-b32b-57a351bac5c1 req-9b97ada8-f080-474d-9374-53361e487800 service nova] [instance: 31cee1d7-a0f9-4909-b4e4-4513584f9ce2] No waiting events found dispatching network-vif-plugged-0dab73f8-3c29-4332-8f12-e3989869b1e0 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:48:36 user nova-compute[74337]: WARNING nova.compute.manager [req-93721e01-3fa1-46d2-b32b-57a351bac5c1 req-9b97ada8-f080-474d-9374-53361e487800 service nova] [instance: 31cee1d7-a0f9-4909-b4e4-4513584f9ce2] Received unexpected event network-vif-plugged-0dab73f8-3c29-4332-8f12-e3989869b1e0 for instance with vm_state building and task_state spawning.
Oct 23 21:48:36 user nova-compute[74337]: INFO nova.compute.manager [None req-56bf8555-f63a-486f-b30f-08b4621a7b88 tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] [instance: 31cee1d7-a0f9-4909-b4e4-4513584f9ce2] Took 6.16 seconds to build instance.
Oct 23 21:48:36 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-56bf8555-f63a-486f-b30f-08b4621a7b88 tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] Lock "31cee1d7-a0f9-4909-b4e4-4513584f9ce2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.296s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:48:37 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:48:38 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:48:42 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-27224297-5d72-49be-9ad6-f82dbaf7c37b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Acquiring lock "9ecb4d1d-d6a1-403a-af40-3a1a10688b5c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:48:42 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-27224297-5d72-49be-9ad6-f82dbaf7c37b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lock "9ecb4d1d-d6a1-403a-af40-3a1a10688b5c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:48:42 user nova-compute[74337]: DEBUG nova.compute.manager [None req-27224297-5d72-49be-9ad6-f82dbaf7c37b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 9ecb4d1d-d6a1-403a-af40-3a1a10688b5c] Starting instance... {{(pid=74337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 21:48:42 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-27224297-5d72-49be-9ad6-f82dbaf7c37b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:48:42 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-27224297-5d72-49be-9ad6-f82dbaf7c37b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:48:42 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-27224297-5d72-49be-9ad6-f82dbaf7c37b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 21:48:42 user nova-compute[74337]: INFO nova.compute.claims [None req-27224297-5d72-49be-9ad6-f82dbaf7c37b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 9ecb4d1d-d6a1-403a-af40-3a1a10688b5c] Claim successful on node user
Oct 23 21:48:42 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:48:42 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-27224297-5d72-49be-9ad6-f82dbaf7c37b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:48:42 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-27224297-5d72-49be-9ad6-f82dbaf7c37b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:48:42 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-27224297-5d72-49be-9ad6-f82dbaf7c37b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.464s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:48:42 user nova-compute[74337]: DEBUG nova.compute.manager [None req-27224297-5d72-49be-9ad6-f82dbaf7c37b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 9ecb4d1d-d6a1-403a-af40-3a1a10688b5c] Start building networks asynchronously for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 21:48:43 user nova-compute[74337]: DEBUG nova.compute.manager [None req-27224297-5d72-49be-9ad6-f82dbaf7c37b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 9ecb4d1d-d6a1-403a-af40-3a1a10688b5c] Allocating IP information in the background. {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 21:48:43 user nova-compute[74337]: DEBUG nova.network.neutron [None req-27224297-5d72-49be-9ad6-f82dbaf7c37b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 9ecb4d1d-d6a1-403a-af40-3a1a10688b5c] allocate_for_instance() {{(pid=74337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 21:48:43 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-27224297-5d72-49be-9ad6-f82dbaf7c37b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 9ecb4d1d-d6a1-403a-af40-3a1a10688b5c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 21:48:43 user nova-compute[74337]: DEBUG nova.compute.manager [None req-27224297-5d72-49be-9ad6-f82dbaf7c37b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 9ecb4d1d-d6a1-403a-af40-3a1a10688b5c] Start building block device mappings for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 21:48:43 user nova-compute[74337]: DEBUG nova.compute.manager [None req-27224297-5d72-49be-9ad6-f82dbaf7c37b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 9ecb4d1d-d6a1-403a-af40-3a1a10688b5c] Start spawning the instance on the hypervisor. {{(pid=74337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 21:48:43 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-27224297-5d72-49be-9ad6-f82dbaf7c37b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 9ecb4d1d-d6a1-403a-af40-3a1a10688b5c] Creating instance directory {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 21:48:43 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-27224297-5d72-49be-9ad6-f82dbaf7c37b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 9ecb4d1d-d6a1-403a-af40-3a1a10688b5c] Creating image(s)
Oct 23 21:48:43 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-27224297-5d72-49be-9ad6-f82dbaf7c37b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Acquiring lock "/opt/stack/data/nova/instances/9ecb4d1d-d6a1-403a-af40-3a1a10688b5c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:48:43 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-27224297-5d72-49be-9ad6-f82dbaf7c37b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lock "/opt/stack/data/nova/instances/9ecb4d1d-d6a1-403a-af40-3a1a10688b5c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:48:43 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-27224297-5d72-49be-9ad6-f82dbaf7c37b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lock "/opt/stack/data/nova/instances/9ecb4d1d-d6a1-403a-af40-3a1a10688b5c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:48:43 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-27224297-5d72-49be-9ad6-f82dbaf7c37b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:48:43 user nova-compute[74337]: DEBUG nova.policy [None req-27224297-5d72-49be-9ad6-f82dbaf7c37b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6f6daa6653264905a5498e00f184080c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a25b3eed8548a5a324e55b28f26252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74337) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 21:48:43 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-27224297-5d72-49be-9ad6-f82dbaf7c37b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.188s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:48:43 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-27224297-5d72-49be-9ad6-f82dbaf7c37b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Acquiring lock "fc7b140751b8c385de81623e40fb09ce09374ab7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:48:43 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-27224297-5d72-49be-9ad6-f82dbaf7c37b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lock "fc7b140751b8c385de81623e40fb09ce09374ab7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:48:43 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-27224297-5d72-49be-9ad6-f82dbaf7c37b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:48:43 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-27224297-5d72-49be-9ad6-f82dbaf7c37b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.188s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:48:43 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-27224297-5d72-49be-9ad6-f82dbaf7c37b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7,backing_fmt=raw /opt/stack/data/nova/instances/9ecb4d1d-d6a1-403a-af40-3a1a10688b5c/disk 1073741824 {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:48:43 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-27224297-5d72-49be-9ad6-f82dbaf7c37b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7,backing_fmt=raw /opt/stack/data/nova/instances/9ecb4d1d-d6a1-403a-af40-3a1a10688b5c/disk 1073741824" returned: 0 in 0.048s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:48:43 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-27224297-5d72-49be-9ad6-f82dbaf7c37b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lock "fc7b140751b8c385de81623e40fb09ce09374ab7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:48:43 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-27224297-5d72-49be-9ad6-f82dbaf7c37b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:48:43 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-27224297-5d72-49be-9ad6-f82dbaf7c37b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.185s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:48:43 user nova-compute[74337]: DEBUG nova.virt.disk.api [None req-27224297-5d72-49be-9ad6-f82dbaf7c37b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9ecb4d1d-d6a1-403a-af40-3a1a10688b5c/disk. size=1073741824 {{(pid=74337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 21:48:43 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-27224297-5d72-49be-9ad6-f82dbaf7c37b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ecb4d1d-d6a1-403a-af40-3a1a10688b5c/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:48:43 user nova-compute[74337]: DEBUG nova.network.neutron [None req-27224297-5d72-49be-9ad6-f82dbaf7c37b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 9ecb4d1d-d6a1-403a-af40-3a1a10688b5c] Successfully created port: 0b036b4e-3790-465a-b3d6-40d387634064 {{(pid=74337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 21:48:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-27224297-5d72-49be-9ad6-f82dbaf7c37b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ecb4d1d-d6a1-403a-af40-3a1a10688b5c/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:48:44 user nova-compute[74337]: DEBUG nova.virt.disk.api [None req-27224297-5d72-49be-9ad6-f82dbaf7c37b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Cannot resize image /opt/stack/data/nova/instances/9ecb4d1d-d6a1-403a-af40-3a1a10688b5c/disk to a smaller size. {{(pid=74337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 21:48:44 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-27224297-5d72-49be-9ad6-f82dbaf7c37b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 9ecb4d1d-d6a1-403a-af40-3a1a10688b5c] Created local disks {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 21:48:44 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-27224297-5d72-49be-9ad6-f82dbaf7c37b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 9ecb4d1d-d6a1-403a-af40-3a1a10688b5c] Ensure instance console log exists: /opt/stack/data/nova/instances/9ecb4d1d-d6a1-403a-af40-3a1a10688b5c/console.log {{(pid=74337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 21:48:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-27224297-5d72-49be-9ad6-f82dbaf7c37b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:48:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-27224297-5d72-49be-9ad6-f82dbaf7c37b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:48:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-27224297-5d72-49be-9ad6-f82dbaf7c37b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:48:44 user nova-compute[74337]: DEBUG nova.network.neutron [None req-27224297-5d72-49be-9ad6-f82dbaf7c37b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 9ecb4d1d-d6a1-403a-af40-3a1a10688b5c] Successfully updated port: 0b036b4e-3790-465a-b3d6-40d387634064 {{(pid=74337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 21:48:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-27224297-5d72-49be-9ad6-f82dbaf7c37b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Acquiring lock "refresh_cache-9ecb4d1d-d6a1-403a-af40-3a1a10688b5c" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:48:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-27224297-5d72-49be-9ad6-f82dbaf7c37b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Acquired lock "refresh_cache-9ecb4d1d-d6a1-403a-af40-3a1a10688b5c" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:48:44 user nova-compute[74337]: DEBUG nova.network.neutron [None req-27224297-5d72-49be-9ad6-f82dbaf7c37b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 9ecb4d1d-d6a1-403a-af40-3a1a10688b5c] Building network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 21:48:44 user nova-compute[74337]: DEBUG nova.compute.manager [req-a39b5fd8-9c4e-4425-ad2c-1d574903aadd req-fd7a5286-cb89-492a-b220-bf34b898c772 service nova] [instance: 9ecb4d1d-d6a1-403a-af40-3a1a10688b5c] Received event network-changed-0b036b4e-3790-465a-b3d6-40d387634064 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:48:44 user nova-compute[74337]: DEBUG nova.compute.manager [req-a39b5fd8-9c4e-4425-ad2c-1d574903aadd req-fd7a5286-cb89-492a-b220-bf34b898c772 service nova] [instance: 9ecb4d1d-d6a1-403a-af40-3a1a10688b5c] Refreshing instance network info cache due to event network-changed-0b036b4e-3790-465a-b3d6-40d387634064. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 21:48:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-a39b5fd8-9c4e-4425-ad2c-1d574903aadd req-fd7a5286-cb89-492a-b220-bf34b898c772 service nova] Acquiring lock "refresh_cache-9ecb4d1d-d6a1-403a-af40-3a1a10688b5c" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:48:44 user nova-compute[74337]: DEBUG nova.network.neutron [None req-27224297-5d72-49be-9ad6-f82dbaf7c37b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 9ecb4d1d-d6a1-403a-af40-3a1a10688b5c] Instance cache missing network info. {{(pid=74337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 21:48:45 user nova-compute[74337]: DEBUG nova.network.neutron [None req-27224297-5d72-49be-9ad6-f82dbaf7c37b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 9ecb4d1d-d6a1-403a-af40-3a1a10688b5c] Updating instance_info_cache with network_info: [{"id": "0b036b4e-3790-465a-b3d6-40d387634064", "address": "fa:16:3e:af:78:38", "network": {"id": "787d9979-63ad-4318-b1d7-8ec69c5969fe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1847253864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84a25b3eed8548a5a324e55b28f26252", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b036b4e-37", "ovs_interfaceid": "0b036b4e-3790-465a-b3d6-40d387634064", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:48:45 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-27224297-5d72-49be-9ad6-f82dbaf7c37b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Releasing lock "refresh_cache-9ecb4d1d-d6a1-403a-af40-3a1a10688b5c" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:48:45 user nova-compute[74337]: DEBUG nova.compute.manager [None req-27224297-5d72-49be-9ad6-f82dbaf7c37b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 9ecb4d1d-d6a1-403a-af40-3a1a10688b5c] Instance network_info: |[{"id": "0b036b4e-3790-465a-b3d6-40d387634064", "address": "fa:16:3e:af:78:38", "network": {"id": "787d9979-63ad-4318-b1d7-8ec69c5969fe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1847253864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84a25b3eed8548a5a324e55b28f26252", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b036b4e-37", "ovs_interfaceid": "0b036b4e-3790-465a-b3d6-40d387634064", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 21:48:45 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-a39b5fd8-9c4e-4425-ad2c-1d574903aadd req-fd7a5286-cb89-492a-b220-bf34b898c772 service nova] Acquired lock "refresh_cache-9ecb4d1d-d6a1-403a-af40-3a1a10688b5c" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:48:45 user nova-compute[74337]: DEBUG nova.network.neutron [req-a39b5fd8-9c4e-4425-ad2c-1d574903aadd req-fd7a5286-cb89-492a-b220-bf34b898c772 service nova] [instance: 9ecb4d1d-d6a1-403a-af40-3a1a10688b5c] Refreshing network info cache for port 0b036b4e-3790-465a-b3d6-40d387634064 {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 21:48:45 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-27224297-5d72-49be-9ad6-f82dbaf7c37b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 9ecb4d1d-d6a1-403a-af40-3a1a10688b5c] Start _get_guest_xml network_info=[{"id": "0b036b4e-3790-465a-b3d6-40d387634064", "address": "fa:16:3e:af:78:38", "network": {"id": "787d9979-63ad-4318-b1d7-8ec69c5969fe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1847253864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84a25b3eed8548a5a324e55b28f26252", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b036b4e-37", "ovs_interfaceid": "0b036b4e-3790-465a-b3d6-40d387634064", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T21:29:21Z,direct_url=<?>,disk_format='qcow2',id=d859d89d-998d-4109-b26a-0d6e28152932,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ff43462300764979a6cf688444336a56',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T21:29:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'image_id': 'd859d89d-998d-4109-b26a-0d6e28152932'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 21:48:45 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-27224297-5d72-49be-9ad6-f82dbaf7c37b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:48:45 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-27224297-5d72-49be-9ad6-f82dbaf7c37b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:48:45 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-27224297-5d72-49be-9ad6-f82dbaf7c37b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 21:48:45 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-27224297-5d72-49be-9ad6-f82dbaf7c37b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] CPU controller missing on host. {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 21:48:45 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-27224297-5d72-49be-9ad6-f82dbaf7c37b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 21:48:45 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-27224297-5d72-49be-9ad6-f82dbaf7c37b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] CPU controller found on host. {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 21:48:45 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-27224297-5d72-49be-9ad6-f82dbaf7c37b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 21:48:45 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-27224297-5d72-49be-9ad6-f82dbaf7c37b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T21:29:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T21:29:21Z,direct_url=<?>,disk_format='qcow2',id=d859d89d-998d-4109-b26a-0d6e28152932,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ff43462300764979a6cf688444336a56',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T21:29:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 21:48:45 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-27224297-5d72-49be-9ad6-f82dbaf7c37b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Flavor limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 21:48:45 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-27224297-5d72-49be-9ad6-f82dbaf7c37b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Image limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 21:48:45 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-27224297-5d72-49be-9ad6-f82dbaf7c37b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Flavor pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 21:48:45 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-27224297-5d72-49be-9ad6-f82dbaf7c37b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Image pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 21:48:45 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-27224297-5d72-49be-9ad6-f82dbaf7c37b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 21:48:45 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-27224297-5d72-49be-9ad6-f82dbaf7c37b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 21:48:45 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-27224297-5d72-49be-9ad6-f82dbaf7c37b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 21:48:45 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-27224297-5d72-49be-9ad6-f82dbaf7c37b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Got 1 possible topologies {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 21:48:45 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-27224297-5d72-49be-9ad6-f82dbaf7c37b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 21:48:45 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-27224297-5d72-49be-9ad6-f82dbaf7c37b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 21:48:45 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-27224297-5d72-49be-9ad6-f82dbaf7c37b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:48:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1465979970',display_name='tempest-AttachVolumeNegativeTest-server-1465979970',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1465979970',id=29,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHkRHDxdgC4rE9wN83paWYuhrmDQBAmmwptx/vQkTTVEwzxum33a2oKjtLzXkrOGyxT9xY9987b1fIMS47R8IwHzBo7ErSISoaCEPMqWnLGEBxpZqnfD4cv0s5kcjNtytg==',key_name='tempest-keypair-1598956670',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='84a25b3eed8548a5a324e55b28f26252',ramdisk_id='',reservation_id='r-pac0j3em',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1446109887',owner_user_name='tempest-AttachVolumeNegativeTest-1446109887-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:48:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6f6daa6653264905a5498e00f184080c',uuid=9ecb4d1d-d6a1-403a-af40-3a1a10688b5c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0b036b4e-3790-465a-b3d6-40d387634064", "address": "fa:16:3e:af:78:38", "network": {"id": "787d9979-63ad-4318-b1d7-8ec69c5969fe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1847253864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84a25b3eed8548a5a324e55b28f26252", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b036b4e-37", "ovs_interfaceid": "0b036b4e-3790-465a-b3d6-40d387634064", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 21:48:45 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-27224297-5d72-49be-9ad6-f82dbaf7c37b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Converting VIF {"id": "0b036b4e-3790-465a-b3d6-40d387634064", "address": "fa:16:3e:af:78:38", "network": {"id": "787d9979-63ad-4318-b1d7-8ec69c5969fe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1847253864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84a25b3eed8548a5a324e55b28f26252", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b036b4e-37", "ovs_interfaceid": "0b036b4e-3790-465a-b3d6-40d387634064", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:48:45 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-27224297-5d72-49be-9ad6-f82dbaf7c37b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:78:38,bridge_name='br-int',has_traffic_filtering=True,id=0b036b4e-3790-465a-b3d6-40d387634064,network=Network(787d9979-63ad-4318-b1d7-8ec69c5969fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b036b4e-37') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:48:45 user nova-compute[74337]: DEBUG nova.objects.instance [None req-27224297-5d72-49be-9ad6-f82dbaf7c37b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lazy-loading 'pci_devices' on Instance uuid 9ecb4d1d-d6a1-403a-af40-3a1a10688b5c {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:48:45 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-27224297-5d72-49be-9ad6-f82dbaf7c37b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 9ecb4d1d-d6a1-403a-af40-3a1a10688b5c] End _get_guest_xml xml=<domain type="kvm">
Oct 23 21:48:45 user nova-compute[74337]:   <uuid>9ecb4d1d-d6a1-403a-af40-3a1a10688b5c</uuid>
Oct 23 21:48:45 user nova-compute[74337]:   <name>instance-0000001d</name>
Oct 23 21:48:45 user nova-compute[74337]:   <memory>524288</memory>
Oct 23 21:48:45 user nova-compute[74337]:   <vcpu>1</vcpu>
Oct 23 21:48:45 user nova-compute[74337]:   <metadata>
Oct 23 21:48:45 user nova-compute[74337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 21:48:45 user nova-compute[74337]:       <nova:package version="0.0.0"/>
Oct 23 21:48:45 user nova-compute[74337]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1465979970</nova:name>
Oct 23 21:48:45 user nova-compute[74337]:       <nova:creationTime>2023-10-23 21:48:45</nova:creationTime>
Oct 23 21:48:45 user nova-compute[74337]:       <nova:flavor name="m1.tiny">
Oct 23 21:48:45 user nova-compute[74337]:         <nova:memory>512</nova:memory>
Oct 23 21:48:45 user nova-compute[74337]:         <nova:disk>1</nova:disk>
Oct 23 21:48:45 user nova-compute[74337]:         <nova:swap>0</nova:swap>
Oct 23 21:48:45 user nova-compute[74337]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 21:48:45 user nova-compute[74337]:         <nova:vcpus>1</nova:vcpus>
Oct 23 21:48:45 user nova-compute[74337]:       </nova:flavor>
Oct 23 21:48:45 user nova-compute[74337]:       <nova:owner>
Oct 23 21:48:45 user nova-compute[74337]:         <nova:user uuid="6f6daa6653264905a5498e00f184080c">tempest-AttachVolumeNegativeTest-1446109887-project-member</nova:user>
Oct 23 21:48:45 user nova-compute[74337]:         <nova:project uuid="84a25b3eed8548a5a324e55b28f26252">tempest-AttachVolumeNegativeTest-1446109887</nova:project>
Oct 23 21:48:45 user nova-compute[74337]:       </nova:owner>
Oct 23 21:48:45 user nova-compute[74337]:       <nova:root type="image" uuid="d859d89d-998d-4109-b26a-0d6e28152932"/>
Oct 23 21:48:45 user nova-compute[74337]:       <nova:ports>
Oct 23 21:48:45 user nova-compute[74337]:         <nova:port uuid="0b036b4e-3790-465a-b3d6-40d387634064">
Oct 23 21:48:45 user nova-compute[74337]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 23 21:48:45 user nova-compute[74337]:         </nova:port>
Oct 23 21:48:45 user nova-compute[74337]:       </nova:ports>
Oct 23 21:48:45 user nova-compute[74337]:     </nova:instance>
Oct 23 21:48:45 user nova-compute[74337]:   </metadata>
Oct 23 21:48:45 user nova-compute[74337]:   <sysinfo type="smbios">
Oct 23 21:48:45 user nova-compute[74337]:     <system>
Oct 23 21:48:45 user nova-compute[74337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 21:48:45 user nova-compute[74337]:       <entry name="product">OpenStack Nova</entry>
Oct 23 21:48:45 user nova-compute[74337]:       <entry name="version">0.0.0</entry>
Oct 23 21:48:45 user nova-compute[74337]:       <entry name="serial">9ecb4d1d-d6a1-403a-af40-3a1a10688b5c</entry>
Oct 23 21:48:45 user nova-compute[74337]:       <entry name="uuid">9ecb4d1d-d6a1-403a-af40-3a1a10688b5c</entry>
Oct 23 21:48:45 user nova-compute[74337]:       <entry name="family">Virtual Machine</entry>
Oct 23 21:48:45 user nova-compute[74337]:     </system>
Oct 23 21:48:45 user nova-compute[74337]:   </sysinfo>
Oct 23 21:48:45 user nova-compute[74337]:   <os>
Oct 23 21:48:45 user nova-compute[74337]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 21:48:45 user nova-compute[74337]:     <boot dev="hd"/>
Oct 23 21:48:45 user nova-compute[74337]:     <smbios mode="sysinfo"/>
Oct 23 21:48:45 user nova-compute[74337]:   </os>
Oct 23 21:48:45 user nova-compute[74337]:   <features>
Oct 23 21:48:45 user nova-compute[74337]:     <acpi/>
Oct 23 21:48:45 user nova-compute[74337]:     <apic/>
Oct 23 21:48:45 user nova-compute[74337]:     <vmcoreinfo/>
Oct 23 21:48:45 user nova-compute[74337]:   </features>
Oct 23 21:48:45 user nova-compute[74337]:   <clock offset="utc">
Oct 23 21:48:45 user nova-compute[74337]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 21:48:45 user nova-compute[74337]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 21:48:45 user nova-compute[74337]:     <timer name="hpet" present="no"/>
Oct 23 21:48:45 user nova-compute[74337]:   </clock>
Oct 23 21:48:45 user nova-compute[74337]:   <cpu mode="custom" match="exact">
Oct 23 21:48:45 user nova-compute[74337]:     <model>Nehalem</model>
Oct 23 21:48:45 user nova-compute[74337]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 21:48:45 user nova-compute[74337]:   </cpu>
Oct 23 21:48:45 user nova-compute[74337]:   <devices>
Oct 23 21:48:45 user nova-compute[74337]:     <disk type="file" device="disk">
Oct 23 21:48:45 user nova-compute[74337]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 21:48:45 user nova-compute[74337]:       <source file="/opt/stack/data/nova/instances/9ecb4d1d-d6a1-403a-af40-3a1a10688b5c/disk"/>
Oct 23 21:48:45 user nova-compute[74337]:       <target dev="vda" bus="virtio"/>
Oct 23 21:48:45 user nova-compute[74337]:     </disk>
Oct 23 21:48:45 user nova-compute[74337]:     <interface type="ethernet">
Oct 23 21:48:45 user nova-compute[74337]:       <mac address="fa:16:3e:af:78:38"/>
Oct 23 21:48:45 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:48:45 user nova-compute[74337]:       <mtu size="1442"/>
Oct 23 21:48:45 user nova-compute[74337]:       <target dev="tap0b036b4e-37"/>
Oct 23 21:48:45 user nova-compute[74337]:     </interface>
Oct 23 21:48:45 user nova-compute[74337]:     <serial type="pty">
Oct 23 21:48:45 user nova-compute[74337]:       <log file="/opt/stack/data/nova/instances/9ecb4d1d-d6a1-403a-af40-3a1a10688b5c/console.log" append="off"/>
Oct 23 21:48:45 user nova-compute[74337]:     </serial>
Oct 23 21:48:45 user nova-compute[74337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 21:48:45 user nova-compute[74337]:     <video>
Oct 23 21:48:45 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:48:45 user nova-compute[74337]:     </video>
Oct 23 21:48:45 user nova-compute[74337]:     <rng model="virtio">
Oct 23 21:48:45 user nova-compute[74337]:       <backend model="random">/dev/urandom</backend>
Oct 23 21:48:45 user nova-compute[74337]:     </rng>
Oct 23 21:48:45 user nova-compute[74337]:     <controller type="usb" index="0" model="none"/>
Oct 23 21:48:45 user nova-compute[74337]:     <memballoon model="virtio">
Oct 23 21:48:45 user nova-compute[74337]:       <stats period="10"/>
Oct 23 21:48:45 user nova-compute[74337]:     </memballoon>
Oct 23 21:48:45 user nova-compute[74337]:   </devices>
Oct 23 21:48:45 user nova-compute[74337]: </domain>
Oct 23 21:48:45 user nova-compute[74337]:  {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 21:48:45 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-27224297-5d72-49be-9ad6-f82dbaf7c37b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:48:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1465979970',display_name='tempest-AttachVolumeNegativeTest-server-1465979970',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1465979970',id=29,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHkRHDxdgC4rE9wN83paWYuhrmDQBAmmwptx/vQkTTVEwzxum33a2oKjtLzXkrOGyxT9xY9987b1fIMS47R8IwHzBo7ErSISoaCEPMqWnLGEBxpZqnfD4cv0s5kcjNtytg==',key_name='tempest-keypair-1598956670',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='84a25b3eed8548a5a324e55b28f26252',ramdisk_id='',reservation_id='r-pac0j3em',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1446109887',owner_user_name='tempest-AttachVolumeNegativeTest-1446109887-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:48:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6f6daa6653264905a5498e00f184080c',uuid=9ecb4d1d-d6a1-403a-af40-3a1a10688b5c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0b036b4e-3790-465a-b3d6-40d387634064", "address": "fa:16:3e:af:78:38", "network": {"id": "787d9979-63ad-4318-b1d7-8ec69c5969fe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1847253864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84a25b3eed8548a5a324e55b28f26252", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b036b4e-37", "ovs_interfaceid": "0b036b4e-3790-465a-b3d6-40d387634064", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 21:48:45 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-27224297-5d72-49be-9ad6-f82dbaf7c37b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Converting VIF {"id": "0b036b4e-3790-465a-b3d6-40d387634064", "address": "fa:16:3e:af:78:38", "network": {"id": "787d9979-63ad-4318-b1d7-8ec69c5969fe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1847253864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84a25b3eed8548a5a324e55b28f26252", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b036b4e-37", "ovs_interfaceid": "0b036b4e-3790-465a-b3d6-40d387634064", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:48:45 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-27224297-5d72-49be-9ad6-f82dbaf7c37b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:78:38,bridge_name='br-int',has_traffic_filtering=True,id=0b036b4e-3790-465a-b3d6-40d387634064,network=Network(787d9979-63ad-4318-b1d7-8ec69c5969fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b036b4e-37') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:48:45 user nova-compute[74337]: DEBUG os_vif [None req-27224297-5d72-49be-9ad6-f82dbaf7c37b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:78:38,bridge_name='br-int',has_traffic_filtering=True,id=0b036b4e-3790-465a-b3d6-40d387634064,network=Network(787d9979-63ad-4318-b1d7-8ec69c5969fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b036b4e-37') {{(pid=74337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 21:48:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:48:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:48:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 21:48:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:48:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bea70b73-3d19-5d1d-961c-568ad1680773', '_type': 'linux-noop'}}, row=False) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:48:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:48:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:48:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:48:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:48:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0b036b4e-37, may_exist=True, interface_attrs={}) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:48:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0b036b4e-37, col_values=(('qos', UUID('2c5bb895-4c4b-4f75-adfc-7c775d6e2765')),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:48:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0b036b4e-37, col_values=(('external_ids', {'iface-id': '0b036b4e-3790-465a-b3d6-40d387634064', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:af:78:38', 'vm-uuid': '9ecb4d1d-d6a1-403a-af40-3a1a10688b5c'}),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:48:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:48:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:48:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:48:45 user nova-compute[74337]: INFO os_vif [None req-27224297-5d72-49be-9ad6-f82dbaf7c37b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:78:38,bridge_name='br-int',has_traffic_filtering=True,id=0b036b4e-3790-465a-b3d6-40d387634064,network=Network(787d9979-63ad-4318-b1d7-8ec69c5969fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b036b4e-37')
Oct 23 21:48:45 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-27224297-5d72-49be-9ad6-f82dbaf7c37b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] No BDM found with device name vda, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 21:48:45 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-27224297-5d72-49be-9ad6-f82dbaf7c37b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] No VIF found with MAC fa:16:3e:af:78:38, not building metadata {{(pid=74337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 21:48:45 user nova-compute[74337]: DEBUG nova.network.neutron [req-a39b5fd8-9c4e-4425-ad2c-1d574903aadd req-fd7a5286-cb89-492a-b220-bf34b898c772 service nova] [instance: 9ecb4d1d-d6a1-403a-af40-3a1a10688b5c] Updated VIF entry in instance network info cache for port 0b036b4e-3790-465a-b3d6-40d387634064. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 21:48:45 user nova-compute[74337]: DEBUG nova.network.neutron [req-a39b5fd8-9c4e-4425-ad2c-1d574903aadd req-fd7a5286-cb89-492a-b220-bf34b898c772 service nova] [instance: 9ecb4d1d-d6a1-403a-af40-3a1a10688b5c] Updating instance_info_cache with network_info: [{"id": "0b036b4e-3790-465a-b3d6-40d387634064", "address": "fa:16:3e:af:78:38", "network": {"id": "787d9979-63ad-4318-b1d7-8ec69c5969fe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1847253864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84a25b3eed8548a5a324e55b28f26252", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b036b4e-37", "ovs_interfaceid": "0b036b4e-3790-465a-b3d6-40d387634064", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:48:45 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-a39b5fd8-9c4e-4425-ad2c-1d574903aadd req-fd7a5286-cb89-492a-b220-bf34b898c772 service nova] Releasing lock "refresh_cache-9ecb4d1d-d6a1-403a-af40-3a1a10688b5c" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:48:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:48:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:48:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:48:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:48:46 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-2f2dfff1-6f7d-4668-9b6e-27856e073f09 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Acquiring lock "0ba8d1d0-5fac-4213-9a50-a4e273710b1b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:48:46 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-2f2dfff1-6f7d-4668-9b6e-27856e073f09 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Lock "0ba8d1d0-5fac-4213-9a50-a4e273710b1b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:48:46 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-2f2dfff1-6f7d-4668-9b6e-27856e073f09 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Acquiring lock "0ba8d1d0-5fac-4213-9a50-a4e273710b1b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:48:46 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-2f2dfff1-6f7d-4668-9b6e-27856e073f09 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Lock "0ba8d1d0-5fac-4213-9a50-a4e273710b1b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:48:46 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-2f2dfff1-6f7d-4668-9b6e-27856e073f09 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Lock "0ba8d1d0-5fac-4213-9a50-a4e273710b1b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:48:46 user nova-compute[74337]: INFO nova.compute.manager [None req-2f2dfff1-6f7d-4668-9b6e-27856e073f09 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] [instance: 0ba8d1d0-5fac-4213-9a50-a4e273710b1b] Terminating instance
Oct 23 21:48:46 user nova-compute[74337]: DEBUG nova.compute.manager [None req-2f2dfff1-6f7d-4668-9b6e-27856e073f09 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] [instance: 0ba8d1d0-5fac-4213-9a50-a4e273710b1b] Start destroying the instance on the hypervisor. {{(pid=74337) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 21:48:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:48:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:48:47 user nova-compute[74337]: DEBUG nova.compute.manager [req-8de9c69b-1001-4084-b02f-42382962f3d1 req-e2ee5987-1ea2-4057-b866-221b578fcc74 service nova] [instance: 9ecb4d1d-d6a1-403a-af40-3a1a10688b5c] Received event network-vif-plugged-0b036b4e-3790-465a-b3d6-40d387634064 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:48:47 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-8de9c69b-1001-4084-b02f-42382962f3d1 req-e2ee5987-1ea2-4057-b866-221b578fcc74 service nova] Acquiring lock "9ecb4d1d-d6a1-403a-af40-3a1a10688b5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:48:47 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-8de9c69b-1001-4084-b02f-42382962f3d1 req-e2ee5987-1ea2-4057-b866-221b578fcc74 service nova] Lock "9ecb4d1d-d6a1-403a-af40-3a1a10688b5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:48:47 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-8de9c69b-1001-4084-b02f-42382962f3d1 req-e2ee5987-1ea2-4057-b866-221b578fcc74 service nova] Lock "9ecb4d1d-d6a1-403a-af40-3a1a10688b5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:48:47 user nova-compute[74337]: DEBUG nova.compute.manager [req-8de9c69b-1001-4084-b02f-42382962f3d1 req-e2ee5987-1ea2-4057-b866-221b578fcc74 service nova] [instance: 9ecb4d1d-d6a1-403a-af40-3a1a10688b5c] No waiting events found dispatching network-vif-plugged-0b036b4e-3790-465a-b3d6-40d387634064 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:48:47 user nova-compute[74337]: WARNING nova.compute.manager [req-8de9c69b-1001-4084-b02f-42382962f3d1 req-e2ee5987-1ea2-4057-b866-221b578fcc74 service nova] [instance: 9ecb4d1d-d6a1-403a-af40-3a1a10688b5c] Received unexpected event network-vif-plugged-0b036b4e-3790-465a-b3d6-40d387634064 for instance with vm_state building and task_state spawning.
Oct 23 21:48:47 user nova-compute[74337]: DEBUG nova.compute.manager [req-ff25197d-6a04-4dbd-a5c1-483e4f768258 req-d0736195-842f-44fb-b017-325a0b307f66 service nova] [instance: 0ba8d1d0-5fac-4213-9a50-a4e273710b1b] Received event network-vif-unplugged-c7a03b6c-5d0f-4a54-b615-16c7546eb5f7 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:48:47 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ff25197d-6a04-4dbd-a5c1-483e4f768258 req-d0736195-842f-44fb-b017-325a0b307f66 service nova] Acquiring lock "0ba8d1d0-5fac-4213-9a50-a4e273710b1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:48:47 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ff25197d-6a04-4dbd-a5c1-483e4f768258 req-d0736195-842f-44fb-b017-325a0b307f66 service nova] Lock "0ba8d1d0-5fac-4213-9a50-a4e273710b1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:48:47 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ff25197d-6a04-4dbd-a5c1-483e4f768258 req-d0736195-842f-44fb-b017-325a0b307f66 service nova] Lock "0ba8d1d0-5fac-4213-9a50-a4e273710b1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:48:47 user nova-compute[74337]: DEBUG nova.compute.manager [req-ff25197d-6a04-4dbd-a5c1-483e4f768258 req-d0736195-842f-44fb-b017-325a0b307f66 service nova] [instance: 0ba8d1d0-5fac-4213-9a50-a4e273710b1b] No waiting events found dispatching network-vif-unplugged-c7a03b6c-5d0f-4a54-b615-16c7546eb5f7 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:48:47 user nova-compute[74337]: DEBUG nova.compute.manager [req-ff25197d-6a04-4dbd-a5c1-483e4f768258 req-d0736195-842f-44fb-b017-325a0b307f66 service nova] [instance: 0ba8d1d0-5fac-4213-9a50-a4e273710b1b] Received event network-vif-unplugged-c7a03b6c-5d0f-4a54-b615-16c7546eb5f7 for instance with task_state deleting. {{(pid=74337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 21:48:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:48:47 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: 0ba8d1d0-5fac-4213-9a50-a4e273710b1b] Instance destroyed successfully.
Oct 23 21:48:47 user nova-compute[74337]: DEBUG nova.objects.instance [None req-2f2dfff1-6f7d-4668-9b6e-27856e073f09 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Lazy-loading 'resources' on Instance uuid 0ba8d1d0-5fac-4213-9a50-a4e273710b1b {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:48:47 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-2f2dfff1-6f7d-4668-9b6e-27856e073f09 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:39:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1579661659',display_name='tempest-ServersNegativeTestJSON-server-1579661659',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1579661659',id=16,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-23T21:39:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='83700495146c4b0e8d76491380b5f895',ramdisk_id='',reservation_id='r-irbp4xpm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-2018044743',owner_user_name='tempest-ServersNegativeTestJSON-2018044743-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T21:39:54Z,user_data=None,user_id='c11f9fb1ab7c411fa9069976c4419bbf',uuid=0ba8d1d0-5fac-4213-9a50-a4e273710b1b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c7a03b6c-5d0f-4a54-b615-16c7546eb5f7", "address": "fa:16:3e:b6:7b:d0", "network": {"id": "3d6e3d17-6da2-4ac1-ab9f-b7ed54db79bc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1078020443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83700495146c4b0e8d76491380b5f895", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7a03b6c-5d", "ovs_interfaceid": "c7a03b6c-5d0f-4a54-b615-16c7546eb5f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 21:48:47 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-2f2dfff1-6f7d-4668-9b6e-27856e073f09 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Converting VIF {"id": "c7a03b6c-5d0f-4a54-b615-16c7546eb5f7", "address": "fa:16:3e:b6:7b:d0", "network": {"id": "3d6e3d17-6da2-4ac1-ab9f-b7ed54db79bc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1078020443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83700495146c4b0e8d76491380b5f895", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7a03b6c-5d", "ovs_interfaceid": "c7a03b6c-5d0f-4a54-b615-16c7546eb5f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:48:47 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-2f2dfff1-6f7d-4668-9b6e-27856e073f09 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b6:7b:d0,bridge_name='br-int',has_traffic_filtering=True,id=c7a03b6c-5d0f-4a54-b615-16c7546eb5f7,network=Network(3d6e3d17-6da2-4ac1-ab9f-b7ed54db79bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7a03b6c-5d') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:48:47 user nova-compute[74337]: DEBUG os_vif [None req-2f2dfff1-6f7d-4668-9b6e-27856e073f09 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:7b:d0,bridge_name='br-int',has_traffic_filtering=True,id=c7a03b6c-5d0f-4a54-b615-16c7546eb5f7,network=Network(3d6e3d17-6da2-4ac1-ab9f-b7ed54db79bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7a03b6c-5d') {{(pid=74337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 21:48:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:48:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:48:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc7a03b6c-5d, bridge=br-int, if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:48:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:48:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:48:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:48:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:48:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:48:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:48:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a8f1eddb-992d-4df8-8202-02b212933855) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:48:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:48:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:48:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:48:47 user nova-compute[74337]: INFO os_vif [None req-2f2dfff1-6f7d-4668-9b6e-27856e073f09 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:7b:d0,bridge_name='br-int',has_traffic_filtering=True,id=c7a03b6c-5d0f-4a54-b615-16c7546eb5f7,network=Network(3d6e3d17-6da2-4ac1-ab9f-b7ed54db79bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7a03b6c-5d')
Oct 23 21:48:47 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-2f2dfff1-6f7d-4668-9b6e-27856e073f09 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] [instance: 0ba8d1d0-5fac-4213-9a50-a4e273710b1b] Deleting instance files /opt/stack/data/nova/instances/0ba8d1d0-5fac-4213-9a50-a4e273710b1b_del
Oct 23 21:48:47 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-2f2dfff1-6f7d-4668-9b6e-27856e073f09 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] [instance: 0ba8d1d0-5fac-4213-9a50-a4e273710b1b] Deletion of /opt/stack/data/nova/instances/0ba8d1d0-5fac-4213-9a50-a4e273710b1b_del complete
Oct 23 21:48:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:48:47 user nova-compute[74337]: INFO nova.compute.manager [None req-2f2dfff1-6f7d-4668-9b6e-27856e073f09 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] [instance: 0ba8d1d0-5fac-4213-9a50-a4e273710b1b] Took 0.95 seconds to destroy the instance on the hypervisor.
Oct 23 21:48:47 user nova-compute[74337]: DEBUG oslo.service.loopingcall [None req-2f2dfff1-6f7d-4668-9b6e-27856e073f09 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74337) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 21:48:47 user nova-compute[74337]: DEBUG nova.compute.manager [-] [instance: 0ba8d1d0-5fac-4213-9a50-a4e273710b1b] Deallocating network for instance {{(pid=74337) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 21:48:47 user nova-compute[74337]: DEBUG nova.network.neutron [-] [instance: 0ba8d1d0-5fac-4213-9a50-a4e273710b1b] deallocate_for_instance() {{(pid=74337) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 21:48:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:48:48 user nova-compute[74337]: DEBUG nova.network.neutron [-] [instance: 0ba8d1d0-5fac-4213-9a50-a4e273710b1b] Updating instance_info_cache with network_info: [] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:48:48 user nova-compute[74337]: INFO nova.compute.manager [-] [instance: 0ba8d1d0-5fac-4213-9a50-a4e273710b1b] Took 0.46 seconds to deallocate network for instance.
Oct 23 21:48:48 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-2f2dfff1-6f7d-4668-9b6e-27856e073f09 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:48:48 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-2f2dfff1-6f7d-4668-9b6e-27856e073f09 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:48:48 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:48:48 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-2f2dfff1-6f7d-4668-9b6e-27856e073f09 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:48:48 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-2f2dfff1-6f7d-4668-9b6e-27856e073f09 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:48:48 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-2f2dfff1-6f7d-4668-9b6e-27856e073f09 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.356s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:48:48 user nova-compute[74337]: INFO nova.scheduler.client.report [None req-2f2dfff1-6f7d-4668-9b6e-27856e073f09 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Deleted allocations for instance 0ba8d1d0-5fac-4213-9a50-a4e273710b1b
Oct 23 21:48:48 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-2f2dfff1-6f7d-4668-9b6e-27856e073f09 tempest-ServersNegativeTestJSON-2018044743 tempest-ServersNegativeTestJSON-2018044743-project-member] Lock "0ba8d1d0-5fac-4213-9a50-a4e273710b1b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.947s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:48:48 user nova-compute[74337]: DEBUG nova.compute.manager [None req-27224297-5d72-49be-9ad6-f82dbaf7c37b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 9ecb4d1d-d6a1-403a-af40-3a1a10688b5c] Instance event wait completed in 0 seconds for  {{(pid=74337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 21:48:48 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-27224297-5d72-49be-9ad6-f82dbaf7c37b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 9ecb4d1d-d6a1-403a-af40-3a1a10688b5c] Guest created on hypervisor {{(pid=74337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 21:48:48 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: 9ecb4d1d-d6a1-403a-af40-3a1a10688b5c] Instance spawned successfully.
Oct 23 21:48:48 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-27224297-5d72-49be-9ad6-f82dbaf7c37b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 9ecb4d1d-d6a1-403a-af40-3a1a10688b5c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 21:48:48 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-27224297-5d72-49be-9ad6-f82dbaf7c37b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 9ecb4d1d-d6a1-403a-af40-3a1a10688b5c] Found default for hw_cdrom_bus of ide {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:48:48 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-27224297-5d72-49be-9ad6-f82dbaf7c37b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 9ecb4d1d-d6a1-403a-af40-3a1a10688b5c] Found default for hw_disk_bus of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:48:48 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-27224297-5d72-49be-9ad6-f82dbaf7c37b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 9ecb4d1d-d6a1-403a-af40-3a1a10688b5c] Found default for hw_input_bus of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:48:48 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-27224297-5d72-49be-9ad6-f82dbaf7c37b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 9ecb4d1d-d6a1-403a-af40-3a1a10688b5c] Found default for hw_pointer_model of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:48:48 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-27224297-5d72-49be-9ad6-f82dbaf7c37b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 9ecb4d1d-d6a1-403a-af40-3a1a10688b5c] Found default for hw_video_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:48:48 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-27224297-5d72-49be-9ad6-f82dbaf7c37b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 9ecb4d1d-d6a1-403a-af40-3a1a10688b5c] Found default for hw_vif_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:48:48 user nova-compute[74337]: INFO nova.compute.manager [None req-27224297-5d72-49be-9ad6-f82dbaf7c37b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 9ecb4d1d-d6a1-403a-af40-3a1a10688b5c] Took 5.74 seconds to spawn the instance on the hypervisor.
Oct 23 21:48:48 user nova-compute[74337]: DEBUG nova.compute.manager [None req-27224297-5d72-49be-9ad6-f82dbaf7c37b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 9ecb4d1d-d6a1-403a-af40-3a1a10688b5c] Checking state {{(pid=74337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 21:48:49 user nova-compute[74337]: INFO nova.compute.manager [None req-27224297-5d72-49be-9ad6-f82dbaf7c37b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 9ecb4d1d-d6a1-403a-af40-3a1a10688b5c] Took 6.55 seconds to build instance.
Oct 23 21:48:49 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-27224297-5d72-49be-9ad6-f82dbaf7c37b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lock "9ecb4d1d-d6a1-403a-af40-3a1a10688b5c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.651s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:48:49 user nova-compute[74337]: DEBUG nova.compute.manager [req-1c051da5-d3ee-4ac7-820f-8c7a0d2380ce req-bca148cd-fee2-4eee-9795-b207ca588e1c service nova] [instance: 9ecb4d1d-d6a1-403a-af40-3a1a10688b5c] Received event network-vif-plugged-0b036b4e-3790-465a-b3d6-40d387634064 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:48:49 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-1c051da5-d3ee-4ac7-820f-8c7a0d2380ce req-bca148cd-fee2-4eee-9795-b207ca588e1c service nova] Acquiring lock "9ecb4d1d-d6a1-403a-af40-3a1a10688b5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:48:49 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-1c051da5-d3ee-4ac7-820f-8c7a0d2380ce req-bca148cd-fee2-4eee-9795-b207ca588e1c service nova] Lock "9ecb4d1d-d6a1-403a-af40-3a1a10688b5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:48:49 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-1c051da5-d3ee-4ac7-820f-8c7a0d2380ce req-bca148cd-fee2-4eee-9795-b207ca588e1c service nova] Lock "9ecb4d1d-d6a1-403a-af40-3a1a10688b5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:48:49 user nova-compute[74337]: DEBUG nova.compute.manager [req-1c051da5-d3ee-4ac7-820f-8c7a0d2380ce req-bca148cd-fee2-4eee-9795-b207ca588e1c service nova] [instance: 9ecb4d1d-d6a1-403a-af40-3a1a10688b5c] No waiting events found dispatching network-vif-plugged-0b036b4e-3790-465a-b3d6-40d387634064 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:48:49 user nova-compute[74337]: WARNING nova.compute.manager [req-1c051da5-d3ee-4ac7-820f-8c7a0d2380ce req-bca148cd-fee2-4eee-9795-b207ca588e1c service nova] [instance: 9ecb4d1d-d6a1-403a-af40-3a1a10688b5c] Received unexpected event network-vif-plugged-0b036b4e-3790-465a-b3d6-40d387634064 for instance with vm_state active and task_state None.
Oct 23 21:48:49 user nova-compute[74337]: DEBUG nova.compute.manager [req-44b36e3b-10e8-49e1-99a2-dd71c10b2b07 req-4a174092-3aea-450a-bfc2-b4d1264d83c0 service nova] [instance: 0ba8d1d0-5fac-4213-9a50-a4e273710b1b] Received event network-vif-plugged-c7a03b6c-5d0f-4a54-b615-16c7546eb5f7 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:48:49 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-44b36e3b-10e8-49e1-99a2-dd71c10b2b07 req-4a174092-3aea-450a-bfc2-b4d1264d83c0 service nova] Acquiring lock "0ba8d1d0-5fac-4213-9a50-a4e273710b1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:48:49 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-44b36e3b-10e8-49e1-99a2-dd71c10b2b07 req-4a174092-3aea-450a-bfc2-b4d1264d83c0 service nova] Lock "0ba8d1d0-5fac-4213-9a50-a4e273710b1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:48:49 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-44b36e3b-10e8-49e1-99a2-dd71c10b2b07 req-4a174092-3aea-450a-bfc2-b4d1264d83c0 service nova] Lock "0ba8d1d0-5fac-4213-9a50-a4e273710b1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:48:49 user nova-compute[74337]: DEBUG nova.compute.manager [req-44b36e3b-10e8-49e1-99a2-dd71c10b2b07 req-4a174092-3aea-450a-bfc2-b4d1264d83c0 service nova] [instance: 0ba8d1d0-5fac-4213-9a50-a4e273710b1b] No waiting events found dispatching network-vif-plugged-c7a03b6c-5d0f-4a54-b615-16c7546eb5f7 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:48:49 user nova-compute[74337]: WARNING nova.compute.manager [req-44b36e3b-10e8-49e1-99a2-dd71c10b2b07 req-4a174092-3aea-450a-bfc2-b4d1264d83c0 service nova] [instance: 0ba8d1d0-5fac-4213-9a50-a4e273710b1b] Received unexpected event network-vif-plugged-c7a03b6c-5d0f-4a54-b615-16c7546eb5f7 for instance with vm_state deleted and task_state None.
Oct 23 21:48:49 user nova-compute[74337]: DEBUG nova.compute.manager [req-44b36e3b-10e8-49e1-99a2-dd71c10b2b07 req-4a174092-3aea-450a-bfc2-b4d1264d83c0 service nova] [instance: 0ba8d1d0-5fac-4213-9a50-a4e273710b1b] Received event network-vif-deleted-c7a03b6c-5d0f-4a54-b615-16c7546eb5f7 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:48:52 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:48:53 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:48:56 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-0c3a146b-4c85-4664-98d5-60e24f6b1cc3 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 195a4056-3254-4558-b2f5-299bcd4af07c is timed out.
Oct 23 21:48:56 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-0c3a146b-4c85-4664-98d5-60e24f6b1cc3 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Successfully detached device vdb from instance 195a4056-3254-4558-b2f5-299bcd4af07c from the live domain config.
Oct 23 21:48:56 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c3a146b-4c85-4664-98d5-60e24f6b1cc3 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] calling os-brick to detach iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 21:48:56 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3a146b-4c85-4664-98d5-60e24f6b1cc3 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, {'target_iqn': 'iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FWrOaikx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:48:56 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-0c3a146b-4c85-4664-98d5-60e24f6b1cc3 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:48:56 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-0c3a146b-4c85-4664-98d5-60e24f6b1cc3 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:48:56 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-0c3a146b-4c85-4664-98d5-60e24f6b1cc3 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:48:56 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:48:56 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:48:56 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d2dd74-cd88-4cfe-87f8-dd3737f99fa2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:919614b1-2a3b-4609-8244-3cbf96991585\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:48:56 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3a146b-4c85-4664-98d5-60e24f6b1cc3 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 21:48:56 user nova-compute[74337]: No targets found.
Oct 23 21:48:56 user nova-compute[74337]: iSNS:
Oct 23 21:48:56 user nova-compute[74337]: No targets found.
Oct 23 21:48:56 user nova-compute[74337]: STATIC:
Oct 23 21:48:56 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4
Oct 23 21:48:56 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:48:56 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:48:56 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:919614b1-2a3b-4609-8244-3cbf96991585
Oct 23 21:48:56 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:48:56 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:48:56 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c
Oct 23 21:48:56 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:48:56 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:48:56 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c
Oct 23 21:48:56 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:48:56 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:48:56 user nova-compute[74337]: FIRMWARE:
Oct 23 21:48:56 user nova-compute[74337]: No targets found.
Oct 23 21:48:56 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:48:56 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3a146b-4c85-4664-98d5-60e24f6b1cc3 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 21:48:56 user nova-compute[74337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 21:48:56 user nova-compute[74337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 21:48:56 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3a146b-4c85-4664-98d5-60e24f6b1cc3 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c', 0)] {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 21:48:56 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:48:56 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:48:56 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[db0a9962-bf2e-4609-9d1d-a9504b4cec30]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:919614b1-2a3b-4609-8244-3cbf96991585\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:48:56 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:48:56 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:48:56 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[395d95a3-286c-4852-a72f-873fe05a8d17]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:919614b1-2a3b-4609-8244-3cbf96991585 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:48:56 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3a146b-4c85-4664-98d5-60e24f6b1cc3 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:48:56 user nova-compute[74337]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c (non-flash)
Oct 23 21:48:56 user nova-compute[74337]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c (non-flash)
Oct 23 21:48:56 user nova-compute[74337]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:919614b1-2a3b-4609-8244-3cbf96991585 (non-flash)
Oct 23 21:48:56 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:48:56 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3a146b-4c85-4664-98d5-60e24f6b1cc3 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:48:56 user nova-compute[74337]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c (non-flash)
Oct 23 21:48:56 user nova-compute[74337]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c (non-flash)
Oct 23 21:48:56 user nova-compute[74337]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:919614b1-2a3b-4609-8244-3cbf96991585 (non-flash)
Oct 23 21:48:56 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:48:56 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3a146b-4c85-4664-98d5-60e24f6b1cc3 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5ef457f2e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c'): ({'sdf'}, set())}) {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 21:48:56 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-0c3a146b-4c85-4664-98d5-60e24f6b1cc3 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Removing single pathed devices sdf {{(pid=74337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 21:48:56 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:48:56 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:48:56 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc8c3c4-31ee-4d22-92db-227c1728cb5f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:48:56 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:48:56 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:48:56 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e104502-bc2c-45c6-be99-925e1b4d7978]: (4, ('ok\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:48:56 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-0c3a146b-4c85-4664-98d5-60e24f6b1cc3 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Flushing IO for device /dev/sdf {{(pid=74337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 21:48:56 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:48:56 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:48:56 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2e5fb9d-d756-4199-9dd9-3a0f9d8efa79]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:48:56 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-0c3a146b-4c85-4664-98d5-60e24f6b1cc3 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 21:48:56 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:48:56 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.043s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:48:56 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d297848d-cff5-4ec6-87f9-9fbac9b4ccfa]: (4, ('1', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:48:56 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-0c3a146b-4c85-4664-98d5-60e24f6b1cc3 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 21:48:56 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-0c3a146b-4c85-4664-98d5-60e24f6b1cc3 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] SCSI volumes sdf have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 21:48:56 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3a146b-4c85-4664-98d5-60e24f6b1cc3 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c')] {{(pid=74337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 21:48:56 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:48:56 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:48:56 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[40c2aca0-2c0d-4d17-8707-97e46c0768c9]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:48:56 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3a146b-4c85-4664-98d5-60e24f6b1cc3 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:48:56 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c -p 172.16.0.220:3260 --logout {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:48:56 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:48:56 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0988a27-af29-4021-a2de-f5036f85edbf]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:48:56 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3a146b-4c85-4664-98d5-60e24f6b1cc3 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c, portal: 172.16.0.220,3260]
Oct 23 21:48:56 user nova-compute[74337]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c, portal: 172.16.0.220,3260] successful.
Oct 23 21:48:56 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:48:56 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c -p 172.16.0.220:3260 --op delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:48:56 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a863deb-8b0f-4e44-b7d7-16ace509f43c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:48:56 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a6e9a8b-8190-49bb-a312-0de075b0a675]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:48:56 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3a146b-4c85-4664-98d5-60e24f6b1cc3 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:48:56 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-0c3a146b-4c85-4664-98d5-60e24f6b1cc3 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:48:56 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3a146b-4c85-4664-98d5-60e24f6b1cc3 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] <== disconnect_volume: return (319ms) None {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:48:56 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c3a146b-4c85-4664-98d5-60e24f6b1cc3 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Disconnected iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 21:48:57 user nova-compute[74337]: DEBUG nova.objects.instance [None req-0c3a146b-4c85-4664-98d5-60e24f6b1cc3 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lazy-loading 'flavor' on Instance uuid 195a4056-3254-4558-b2f5-299bcd4af07c {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:48:57 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-0c3a146b-4c85-4664-98d5-60e24f6b1cc3 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lock "195a4056-3254-4558-b2f5-299bcd4af07c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.098s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:48:57 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:48:58 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:49:00 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:49:02 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:49:03 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:49:06 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:49:07 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:49:07 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 21:49:07 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:49:08 user nova-compute[74337]: DEBUG nova.compute.manager [req-198ab759-3d95-4444-b9e8-82a80f86eb1f req-534253a2-bfe7-4a70-b055-68e0960a31b6 service nova] [instance: 4f85754a-aad0-43b7-9a99-65aa567eb114] Received event network-changed-c1df869f-8a82-4004-9035-372dbfbb1cc6 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:49:08 user nova-compute[74337]: DEBUG nova.compute.manager [req-198ab759-3d95-4444-b9e8-82a80f86eb1f req-534253a2-bfe7-4a70-b055-68e0960a31b6 service nova] [instance: 4f85754a-aad0-43b7-9a99-65aa567eb114] Refreshing instance network info cache due to event network-changed-c1df869f-8a82-4004-9035-372dbfbb1cc6. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 21:49:08 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-198ab759-3d95-4444-b9e8-82a80f86eb1f req-534253a2-bfe7-4a70-b055-68e0960a31b6 service nova] Acquiring lock "refresh_cache-4f85754a-aad0-43b7-9a99-65aa567eb114" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:49:08 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-198ab759-3d95-4444-b9e8-82a80f86eb1f req-534253a2-bfe7-4a70-b055-68e0960a31b6 service nova] Acquired lock "refresh_cache-4f85754a-aad0-43b7-9a99-65aa567eb114" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:49:08 user nova-compute[74337]: DEBUG nova.network.neutron [req-198ab759-3d95-4444-b9e8-82a80f86eb1f req-534253a2-bfe7-4a70-b055-68e0960a31b6 service nova] [instance: 4f85754a-aad0-43b7-9a99-65aa567eb114] Refreshing network info cache for port c1df869f-8a82-4004-9035-372dbfbb1cc6 {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 21:49:08 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:49:08 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:49:08 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Starting heal instance info cache {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 21:49:08 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "refresh_cache-56a4b932-486d-4b8d-9616-99e75592432a" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:49:08 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquired lock "refresh_cache-56a4b932-486d-4b8d-9616-99e75592432a" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:49:08 user nova-compute[74337]: DEBUG nova.network.neutron [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Forcefully refreshing network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 21:49:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:49:08 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-2a3079b7-d4a3-47a6-8958-94b057984ac4 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Acquiring lock "4f85754a-aad0-43b7-9a99-65aa567eb114" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:49:08 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-2a3079b7-d4a3-47a6-8958-94b057984ac4 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "4f85754a-aad0-43b7-9a99-65aa567eb114" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:49:08 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-2a3079b7-d4a3-47a6-8958-94b057984ac4 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Acquiring lock "4f85754a-aad0-43b7-9a99-65aa567eb114-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:49:08 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-2a3079b7-d4a3-47a6-8958-94b057984ac4 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "4f85754a-aad0-43b7-9a99-65aa567eb114-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:49:08 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-2a3079b7-d4a3-47a6-8958-94b057984ac4 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "4f85754a-aad0-43b7-9a99-65aa567eb114-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:49:08 user nova-compute[74337]: INFO nova.compute.manager [None req-2a3079b7-d4a3-47a6-8958-94b057984ac4 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 4f85754a-aad0-43b7-9a99-65aa567eb114] Terminating instance
Oct 23 21:49:08 user nova-compute[74337]: DEBUG nova.compute.manager [None req-2a3079b7-d4a3-47a6-8958-94b057984ac4 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 4f85754a-aad0-43b7-9a99-65aa567eb114] Start destroying the instance on the hypervisor. {{(pid=74337) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 21:49:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:49:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:49:09 user nova-compute[74337]: DEBUG nova.network.neutron [req-198ab759-3d95-4444-b9e8-82a80f86eb1f req-534253a2-bfe7-4a70-b055-68e0960a31b6 service nova] [instance: 4f85754a-aad0-43b7-9a99-65aa567eb114] Updated VIF entry in instance network info cache for port c1df869f-8a82-4004-9035-372dbfbb1cc6. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 21:49:09 user nova-compute[74337]: DEBUG nova.network.neutron [req-198ab759-3d95-4444-b9e8-82a80f86eb1f req-534253a2-bfe7-4a70-b055-68e0960a31b6 service nova] [instance: 4f85754a-aad0-43b7-9a99-65aa567eb114] Updating instance_info_cache with network_info: [{"id": "c1df869f-8a82-4004-9035-372dbfbb1cc6", "address": "fa:16:3e:8d:53:76", "network": {"id": "5a18e96f-a6eb-4989-9be3-154b54928b03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-507511840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb567547bd4941fb87435a841c9d17c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1df869f-8a", "ovs_interfaceid": "c1df869f-8a82-4004-9035-372dbfbb1cc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:49:09 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-198ab759-3d95-4444-b9e8-82a80f86eb1f req-534253a2-bfe7-4a70-b055-68e0960a31b6 service nova] Releasing lock "refresh_cache-4f85754a-aad0-43b7-9a99-65aa567eb114" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:49:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:49:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:49:09 user nova-compute[74337]: DEBUG nova.compute.manager [req-9a73ab3a-95e5-4e7b-a263-83b96c3c14bd req-ec6d6111-619a-4e49-b1aa-a0bec57520e1 service nova] [instance: 4f85754a-aad0-43b7-9a99-65aa567eb114] Received event network-vif-unplugged-c1df869f-8a82-4004-9035-372dbfbb1cc6 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:49:09 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-9a73ab3a-95e5-4e7b-a263-83b96c3c14bd req-ec6d6111-619a-4e49-b1aa-a0bec57520e1 service nova] Acquiring lock "4f85754a-aad0-43b7-9a99-65aa567eb114-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:49:09 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-9a73ab3a-95e5-4e7b-a263-83b96c3c14bd req-ec6d6111-619a-4e49-b1aa-a0bec57520e1 service nova] Lock "4f85754a-aad0-43b7-9a99-65aa567eb114-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:49:09 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-9a73ab3a-95e5-4e7b-a263-83b96c3c14bd req-ec6d6111-619a-4e49-b1aa-a0bec57520e1 service nova] Lock "4f85754a-aad0-43b7-9a99-65aa567eb114-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:49:09 user nova-compute[74337]: DEBUG nova.compute.manager [req-9a73ab3a-95e5-4e7b-a263-83b96c3c14bd req-ec6d6111-619a-4e49-b1aa-a0bec57520e1 service nova] [instance: 4f85754a-aad0-43b7-9a99-65aa567eb114] No waiting events found dispatching network-vif-unplugged-c1df869f-8a82-4004-9035-372dbfbb1cc6 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:49:09 user nova-compute[74337]: DEBUG nova.compute.manager [req-9a73ab3a-95e5-4e7b-a263-83b96c3c14bd req-ec6d6111-619a-4e49-b1aa-a0bec57520e1 service nova] [instance: 4f85754a-aad0-43b7-9a99-65aa567eb114] Received event network-vif-unplugged-c1df869f-8a82-4004-9035-372dbfbb1cc6 for instance with task_state deleting. {{(pid=74337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 21:49:09 user nova-compute[74337]: DEBUG nova.network.neutron [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Updating instance_info_cache with network_info: [{"id": "5df71ce2-a116-44b3-856b-c0de0da5dcd6", "address": "fa:16:3e:20:cc:6f", "network": {"id": "fe0a9f00-e17b-4064-96d2-fd1cc848afb2", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1294741219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96dc585a51343db94529e22adbd6ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5df71ce2-a1", "ovs_interfaceid": "5df71ce2-a116-44b3-856b-c0de0da5dcd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:49:09 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Releasing lock "refresh_cache-56a4b932-486d-4b8d-9616-99e75592432a" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:49:09 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Updated the network info_cache for instance {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 21:49:09 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:49:09 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:49:09 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: 4f85754a-aad0-43b7-9a99-65aa567eb114] Instance destroyed successfully.
Oct 23 21:49:09 user nova-compute[74337]: DEBUG nova.objects.instance [None req-2a3079b7-d4a3-47a6-8958-94b057984ac4 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lazy-loading 'resources' on Instance uuid 4f85754a-aad0-43b7-9a99-65aa567eb114 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:49:09 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-2a3079b7-d4a3-47a6-8958-94b057984ac4 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:47:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-205710243',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-205710243',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-205710243',id=26,image_ref='3fcddae6-b109-464d-93b8-d16b58e780aa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBi/YBd7ti878hX2YlabNLGa9dYZw+X2OcdeTpMeoIVUh1J+1InlKAnXuEReoq0/cHooWEeOaDHy29G7Mg1uaQJxonjmAdZ9uzrM9fj4ydLIrPU+kVWUBY7LKu5LiRf3YQ==',key_name='tempest-keypair-483140505',keypairs=<?>,launch_index=0,launched_at=2023-10-23T21:47:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cb567547bd4941fb87435a841c9d17c4',ramdisk_id='',reservation_id='r-05srughn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-499971371',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-499971371-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-499971371',owner_user_name='tempest-TestVolumeBootPattern-499971371-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T21:47:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c3e635e8e5447138a7f2db11695574c',uuid=4f85754a-aad0-43b7-9a99-65aa567eb114,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c1df869f-8a82-4004-9035-372dbfbb1cc6", "address": "fa:16:3e:8d:53:76", "network": {"id": "5a18e96f-a6eb-4989-9be3-154b54928b03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-507511840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb567547bd4941fb87435a841c9d17c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1df869f-8a", "ovs_interfaceid": "c1df869f-8a82-4004-9035-372dbfbb1cc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 21:49:09 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-2a3079b7-d4a3-47a6-8958-94b057984ac4 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Converting VIF {"id": "c1df869f-8a82-4004-9035-372dbfbb1cc6", "address": "fa:16:3e:8d:53:76", "network": {"id": "5a18e96f-a6eb-4989-9be3-154b54928b03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-507511840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb567547bd4941fb87435a841c9d17c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1df869f-8a", "ovs_interfaceid": "c1df869f-8a82-4004-9035-372dbfbb1cc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:49:09 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-2a3079b7-d4a3-47a6-8958-94b057984ac4 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:53:76,bridge_name='br-int',has_traffic_filtering=True,id=c1df869f-8a82-4004-9035-372dbfbb1cc6,network=Network(5a18e96f-a6eb-4989-9be3-154b54928b03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1df869f-8a') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:49:09 user nova-compute[74337]: DEBUG os_vif [None req-2a3079b7-d4a3-47a6-8958-94b057984ac4 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:53:76,bridge_name='br-int',has_traffic_filtering=True,id=c1df869f-8a82-4004-9035-372dbfbb1cc6,network=Network(5a18e96f-a6eb-4989-9be3-154b54928b03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1df869f-8a') {{(pid=74337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 21:49:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:49:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc1df869f-8a, bridge=br-int, if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:49:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:49:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:49:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:49:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:49:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=23b92593-d454-4e7d-ae1e-24e4460d36a7) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:49:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:49:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:49:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:49:09 user nova-compute[74337]: INFO os_vif [None req-2a3079b7-d4a3-47a6-8958-94b057984ac4 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:53:76,bridge_name='br-int',has_traffic_filtering=True,id=c1df869f-8a82-4004-9035-372dbfbb1cc6,network=Network(5a18e96f-a6eb-4989-9be3-154b54928b03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1df869f-8a')
Oct 23 21:49:09 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a3079b7-d4a3-47a6-8958-94b057984ac4 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 4f85754a-aad0-43b7-9a99-65aa567eb114] calling os-brick to detach iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 21:49:09 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3079b7-d4a3-47a6-8958-94b057984ac4 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, {'target_iqn': 'iqn.2010-10.org.openstack:919614b1-2a3b-4609-8244-3cbf96991585', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fTXvRnuU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:49:09 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-2a3079b7-d4a3-47a6-8958-94b057984ac4 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:49:09 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-2a3079b7-d4a3-47a6-8958-94b057984ac4 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:49:09 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-2a3079b7-d4a3-47a6-8958-94b057984ac4 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:49:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:49:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:49:09 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[126ede92-86b8-4a75-9a31-38736f7a3d08]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:919614b1-2a3b-4609-8244-3cbf96991585\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:49:09 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3079b7-d4a3-47a6-8958-94b057984ac4 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 21:49:09 user nova-compute[74337]: No targets found.
Oct 23 21:49:09 user nova-compute[74337]: iSNS:
Oct 23 21:49:09 user nova-compute[74337]: No targets found.
Oct 23 21:49:09 user nova-compute[74337]: STATIC:
Oct 23 21:49:09 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4
Oct 23 21:49:09 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:49:09 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:49:09 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:919614b1-2a3b-4609-8244-3cbf96991585
Oct 23 21:49:09 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:49:09 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:49:09 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c
Oct 23 21:49:09 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:49:09 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:49:09 user nova-compute[74337]: FIRMWARE:
Oct 23 21:49:09 user nova-compute[74337]: No targets found.
Oct 23 21:49:09 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:49:09 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3079b7-d4a3-47a6-8958-94b057984ac4 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 21:49:09 user nova-compute[74337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 21:49:09 user nova-compute[74337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 21:49:09 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3079b7-d4a3-47a6-8958-94b057984ac4 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:919614b1-2a3b-4609-8244-3cbf96991585', 0)] {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 21:49:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:49:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:49:09 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[024a9aeb-bcd5-417c-8ae6-96e53855d3ee]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:919614b1-2a3b-4609-8244-3cbf96991585\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:49:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:49:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:49:09 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[069e899a-8e8c-4755-8ed7-0bd036709d04]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:919614b1-2a3b-4609-8244-3cbf96991585 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:49:09 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3079b7-d4a3-47a6-8958-94b057984ac4 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:49:09 user nova-compute[74337]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c (non-flash)
Oct 23 21:49:09 user nova-compute[74337]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:919614b1-2a3b-4609-8244-3cbf96991585 (non-flash)
Oct 23 21:49:09 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:49:09 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3079b7-d4a3-47a6-8958-94b057984ac4 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:49:09 user nova-compute[74337]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c (non-flash)
Oct 23 21:49:09 user nova-compute[74337]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:919614b1-2a3b-4609-8244-3cbf96991585 (non-flash)
Oct 23 21:49:09 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:49:09 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3079b7-d4a3-47a6-8958-94b057984ac4 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5ef457ea70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:919614b1-2a3b-4609-8244-3cbf96991585'): ({'sdd'}, set())}) {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 21:49:09 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-2a3079b7-d4a3-47a6-8958-94b057984ac4 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Removing single pathed devices sdd {{(pid=74337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 21:49:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:49:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:49:09 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d399f781-ba4e-4f9d-adbc-990a1e2e9554]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:49:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:49:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:49:09 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[da388d40-ee5b-4410-8043-1c0b53ab8ad6]: (4, ('ok\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:49:09 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-2a3079b7-d4a3-47a6-8958-94b057984ac4 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Flushing IO for device /dev/sdd {{(pid=74337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 21:49:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:49:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:49:09 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c97fd95-ebaf-4c16-a019-b676d044764b]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:49:09 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-2a3079b7-d4a3-47a6-8958-94b057984ac4 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 21:49:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:49:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.052s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:49:09 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa108c4-d290-4d30-8737-ea3b716a0f8a]: (4, ('1', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:49:09 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-2a3079b7-d4a3-47a6-8958-94b057984ac4 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 21:49:09 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-2a3079b7-d4a3-47a6-8958-94b057984ac4 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] SCSI volumes sdd have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 21:49:09 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3079b7-d4a3-47a6-8958-94b057984ac4 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:919614b1-2a3b-4609-8244-3cbf96991585')] {{(pid=74337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 21:49:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:919614b1-2a3b-4609-8244-3cbf96991585 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:49:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:919614b1-2a3b-4609-8244-3cbf96991585 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:49:09 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c360a272-9450-4e76-9040-62bef5af51dd]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:49:09 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3079b7-d4a3-47a6-8958-94b057984ac4 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:49:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:919614b1-2a3b-4609-8244-3cbf96991585 -p 172.16.0.220:3260 --logout {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:49:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:919614b1-2a3b-4609-8244-3cbf96991585 -p 172.16.0.220:3260 --logout" returned: 0 in 0.044s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:49:09 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0de2cf5-8f2b-4f83-a81b-d960ed21efdc]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:919614b1-2a3b-4609-8244-3cbf96991585, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:919614b1-2a3b-4609-8244-3cbf96991585, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:49:09 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3079b7-d4a3-47a6-8958-94b057984ac4 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:919614b1-2a3b-4609-8244-3cbf96991585, portal: 172.16.0.220,3260]
Oct 23 21:49:09 user nova-compute[74337]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:919614b1-2a3b-4609-8244-3cbf96991585, portal: 172.16.0.220,3260] successful.
Oct 23 21:49:09 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:49:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:919614b1-2a3b-4609-8244-3cbf96991585 -p 172.16.0.220:3260 --op delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:49:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:919614b1-2a3b-4609-8244-3cbf96991585 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:49:09 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[0faa4671-6174-41ad-895e-aa35b68e3961]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:49:09 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3079b7-d4a3-47a6-8958-94b057984ac4 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:49:09 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-2a3079b7-d4a3-47a6-8958-94b057984ac4 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:49:09 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a3079b7-d4a3-47a6-8958-94b057984ac4 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] <== disconnect_volume: return (306ms) None {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:49:09 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a3079b7-d4a3-47a6-8958-94b057984ac4 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 4f85754a-aad0-43b7-9a99-65aa567eb114] Disconnected iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 21:49:09 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-2a3079b7-d4a3-47a6-8958-94b057984ac4 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 4f85754a-aad0-43b7-9a99-65aa567eb114] Deleting instance files /opt/stack/data/nova/instances/4f85754a-aad0-43b7-9a99-65aa567eb114_del
Oct 23 21:49:09 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-2a3079b7-d4a3-47a6-8958-94b057984ac4 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 4f85754a-aad0-43b7-9a99-65aa567eb114] Deletion of /opt/stack/data/nova/instances/4f85754a-aad0-43b7-9a99-65aa567eb114_del complete
Oct 23 21:49:10 user nova-compute[74337]: INFO nova.compute.manager [None req-2a3079b7-d4a3-47a6-8958-94b057984ac4 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 4f85754a-aad0-43b7-9a99-65aa567eb114] Took 1.18 seconds to destroy the instance on the hypervisor.
Oct 23 21:49:10 user nova-compute[74337]: DEBUG oslo.service.loopingcall [None req-2a3079b7-d4a3-47a6-8958-94b057984ac4 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74337) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 21:49:10 user nova-compute[74337]: DEBUG nova.compute.manager [-] [instance: 4f85754a-aad0-43b7-9a99-65aa567eb114] Deallocating network for instance {{(pid=74337) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 21:49:10 user nova-compute[74337]: DEBUG nova.network.neutron [-] [instance: 4f85754a-aad0-43b7-9a99-65aa567eb114] deallocate_for_instance() {{(pid=74337) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 21:49:10 user nova-compute[74337]: DEBUG nova.network.neutron [-] [instance: 4f85754a-aad0-43b7-9a99-65aa567eb114] Updating instance_info_cache with network_info: [] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:49:10 user nova-compute[74337]: INFO nova.compute.manager [-] [instance: 4f85754a-aad0-43b7-9a99-65aa567eb114] Took 0.81 seconds to deallocate network for instance.
Oct 23 21:49:11 user nova-compute[74337]: DEBUG nova.compute.manager [req-0a132572-019b-493d-8389-cab571e431ee req-43f9cbe4-7043-46e9-b305-f824dee27411 service nova] [instance: 4f85754a-aad0-43b7-9a99-65aa567eb114] Received event network-vif-plugged-c1df869f-8a82-4004-9035-372dbfbb1cc6 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:49:11 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-0a132572-019b-493d-8389-cab571e431ee req-43f9cbe4-7043-46e9-b305-f824dee27411 service nova] Acquiring lock "4f85754a-aad0-43b7-9a99-65aa567eb114-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:49:11 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-0a132572-019b-493d-8389-cab571e431ee req-43f9cbe4-7043-46e9-b305-f824dee27411 service nova] Lock "4f85754a-aad0-43b7-9a99-65aa567eb114-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:49:11 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-0a132572-019b-493d-8389-cab571e431ee req-43f9cbe4-7043-46e9-b305-f824dee27411 service nova] Lock "4f85754a-aad0-43b7-9a99-65aa567eb114-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:49:11 user nova-compute[74337]: DEBUG nova.compute.manager [req-0a132572-019b-493d-8389-cab571e431ee req-43f9cbe4-7043-46e9-b305-f824dee27411 service nova] [instance: 4f85754a-aad0-43b7-9a99-65aa567eb114] No waiting events found dispatching network-vif-plugged-c1df869f-8a82-4004-9035-372dbfbb1cc6 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:49:11 user nova-compute[74337]: WARNING nova.compute.manager [req-0a132572-019b-493d-8389-cab571e431ee req-43f9cbe4-7043-46e9-b305-f824dee27411 service nova] [instance: 4f85754a-aad0-43b7-9a99-65aa567eb114] Received unexpected event network-vif-plugged-c1df869f-8a82-4004-9035-372dbfbb1cc6 for instance with vm_state active and task_state deleting.
Oct 23 21:49:11 user nova-compute[74337]: DEBUG nova.compute.manager [req-0a132572-019b-493d-8389-cab571e431ee req-43f9cbe4-7043-46e9-b305-f824dee27411 service nova] [instance: 4f85754a-aad0-43b7-9a99-65aa567eb114] Received event network-vif-deleted-c1df869f-8a82-4004-9035-372dbfbb1cc6 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:49:11 user nova-compute[74337]: INFO nova.compute.manager [None req-2a3079b7-d4a3-47a6-8958-94b057984ac4 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 4f85754a-aad0-43b7-9a99-65aa567eb114] Took 0.81 seconds to detach 1 volumes for instance.
Oct 23 21:49:11 user nova-compute[74337]: DEBUG nova.compute.manager [None req-2a3079b7-d4a3-47a6-8958-94b057984ac4 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 4f85754a-aad0-43b7-9a99-65aa567eb114] Deleting volume: 919614b1-2a3b-4609-8244-3cbf96991585 {{(pid=74337) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 23 21:49:11 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-2a3079b7-d4a3-47a6-8958-94b057984ac4 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:49:11 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-2a3079b7-d4a3-47a6-8958-94b057984ac4 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:49:11 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-2a3079b7-d4a3-47a6-8958-94b057984ac4 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Refreshing inventories for resource provider dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 23 21:49:11 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-2a3079b7-d4a3-47a6-8958-94b057984ac4 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Updating ProviderTree inventory for provider dfcf3942-a432-4293-945b-14b86f57d794 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 23 21:49:11 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-2a3079b7-d4a3-47a6-8958-94b057984ac4 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Updating inventory in ProviderTree for provider dfcf3942-a432-4293-945b-14b86f57d794 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 23 21:49:11 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-2a3079b7-d4a3-47a6-8958-94b057984ac4 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Refreshing aggregate associations for resource provider dfcf3942-a432-4293-945b-14b86f57d794, aggregates: None {{(pid=74337) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 23 21:49:12 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-2a3079b7-d4a3-47a6-8958-94b057984ac4 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Refreshing trait associations for resource provider dfcf3942-a432-4293-945b-14b86f57d794, traits: COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE2,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE42,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_EXTEND,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_TRUSTED_CERTS {{(pid=74337) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 23 21:49:12 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-2a3079b7-d4a3-47a6-8958-94b057984ac4 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:49:12 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-2a3079b7-d4a3-47a6-8958-94b057984ac4 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:49:12 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-2a3079b7-d4a3-47a6-8958-94b057984ac4 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.632s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:49:12 user nova-compute[74337]: INFO nova.scheduler.client.report [None req-2a3079b7-d4a3-47a6-8958-94b057984ac4 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Deleted allocations for instance 4f85754a-aad0-43b7-9a99-65aa567eb114
Oct 23 21:49:12 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:49:12 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-2a3079b7-d4a3-47a6-8958-94b057984ac4 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "4f85754a-aad0-43b7-9a99-65aa567eb114" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.670s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:49:13 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:49:13 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:49:13 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:49:13 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:49:13 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:49:13 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Auditing locally available compute resources for user (node: user) {{(pid=74337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 21:49:13 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 21:49:13 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56a4b932-486d-4b8d-9616-99e75592432a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:49:13 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:49:13 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56a4b932-486d-4b8d-9616-99e75592432a/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:49:13 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56a4b932-486d-4b8d-9616-99e75592432a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:49:13 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56a4b932-486d-4b8d-9616-99e75592432a/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:49:14 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/547c4d4c-e0dd-495a-b83f-98426d0a4a99/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:49:14 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/547c4d4c-e0dd-495a-b83f-98426d0a4a99/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:49:14 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/547c4d4c-e0dd-495a-b83f-98426d0a4a99/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:49:14 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/547c4d4c-e0dd-495a-b83f-98426d0a4a99/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:49:14 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 21:49:14 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e05fd36-ee44-4992-80a9-f95af608b9f5/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:49:14 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e05fd36-ee44-4992-80a9-f95af608b9f5/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:49:14 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e05fd36-ee44-4992-80a9-f95af608b9f5/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:49:14 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:49:14 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e05fd36-ee44-4992-80a9-f95af608b9f5/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:49:14 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31cee1d7-a0f9-4909-b4e4-4513584f9ce2/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:49:14 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31cee1d7-a0f9-4909-b4e4-4513584f9ce2/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:49:14 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31cee1d7-a0f9-4909-b4e4-4513584f9ce2/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:49:15 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31cee1d7-a0f9-4909-b4e4-4513584f9ce2/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:49:15 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195a4056-3254-4558-b2f5-299bcd4af07c/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:49:15 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195a4056-3254-4558-b2f5-299bcd4af07c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:49:15 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195a4056-3254-4558-b2f5-299bcd4af07c/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:49:15 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/195a4056-3254-4558-b2f5-299bcd4af07c/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:49:15 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ecb4d1d-d6a1-403a-af40-3a1a10688b5c/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:49:15 user nova-compute[74337]: DEBUG nova.compute.manager [None req-ac9abd2b-bc04-4d6f-afc0-2a4c9f183b06 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: 1e05fd36-ee44-4992-80a9-f95af608b9f5] Checking state {{(pid=74337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 21:49:15 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ecb4d1d-d6a1-403a-af40-3a1a10688b5c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:49:15 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ecb4d1d-d6a1-403a-af40-3a1a10688b5c/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:49:15 user nova-compute[74337]: INFO nova.compute.manager [None req-ac9abd2b-bc04-4d6f-afc0-2a4c9f183b06 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: 1e05fd36-ee44-4992-80a9-f95af608b9f5] instance snapshotting
Oct 23 21:49:15 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-ac9abd2b-bc04-4d6f-afc0-2a4c9f183b06 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: 1e05fd36-ee44-4992-80a9-f95af608b9f5] Beginning live snapshot process
Oct 23 21:49:15 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ecb4d1d-d6a1-403a-af40-3a1a10688b5c/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:49:15 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1189976f-8d02-468d-8fa7-bd5594c5f85a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:49:16 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-ac9abd2b-bc04-4d6f-afc0-2a4c9f183b06 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e05fd36-ee44-4992-80a9-f95af608b9f5/disk --force-share --output=json -f qcow2 {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:49:16 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1189976f-8d02-468d-8fa7-bd5594c5f85a/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:49:16 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1189976f-8d02-468d-8fa7-bd5594c5f85a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:49:16 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-ac9abd2b-bc04-4d6f-afc0-2a4c9f183b06 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e05fd36-ee44-4992-80a9-f95af608b9f5/disk --force-share --output=json -f qcow2" returned: 0 in 0.176s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:49:16 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-ac9abd2b-bc04-4d6f-afc0-2a4c9f183b06 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e05fd36-ee44-4992-80a9-f95af608b9f5/disk --force-share --output=json -f qcow2 {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:49:16 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1189976f-8d02-468d-8fa7-bd5594c5f85a/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:49:16 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-ac9abd2b-bc04-4d6f-afc0-2a4c9f183b06 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e05fd36-ee44-4992-80a9-f95af608b9f5/disk --force-share --output=json -f qcow2" returned: 0 in 0.492s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:49:16 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-ac9abd2b-bc04-4d6f-afc0-2a4c9f183b06 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:49:16 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:49:16 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:49:16 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Hypervisor/Node resource view: name=user free_ram=7884MB free_disk=25.288028717041016GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 21:49:16 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:49:16 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:49:16 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 1189976f-8d02-468d-8fa7-bd5594c5f85a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:49:16 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 547c4d4c-e0dd-495a-b83f-98426d0a4a99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:49:16 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-ac9abd2b-bc04-4d6f-afc0-2a4c9f183b06 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.169s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:49:16 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-ac9abd2b-bc04-4d6f-afc0-2a4c9f183b06 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpxz4vv6j8/eef4c14e48d14671839430d69b1668f1.delta 1073741824 {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:49:16 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 00f757cf-e5dd-476f-81c6-670ed2bf6938 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Oct 23 21:49:16 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 56a4b932-486d-4b8d-9616-99e75592432a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:49:16 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:49:16 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 195a4056-3254-4558-b2f5-299bcd4af07c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:49:16 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 89e792eb-ad8f-4bb7-adac-315c3415cd6d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:49:16 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 1e05fd36-ee44-4992-80a9-f95af608b9f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:49:16 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 31cee1d7-a0f9-4909-b4e4-4513584f9ce2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:49:16 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 9ecb4d1d-d6a1-403a-af40-3a1a10688b5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:49:16 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 21:49:16 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 21:49:16 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-ac9abd2b-bc04-4d6f-afc0-2a4c9f183b06 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpxz4vv6j8/eef4c14e48d14671839430d69b1668f1.delta 1073741824" returned: 0 in 0.054s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:49:16 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-ac9abd2b-bc04-4d6f-afc0-2a4c9f183b06 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: 1e05fd36-ee44-4992-80a9-f95af608b9f5] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 23 21:49:17 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:49:17 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:49:17 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Compute_service record updated for user:user {{(pid=74337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 21:49:17 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.478s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:49:17 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-ac9abd2b-bc04-4d6f-afc0-2a4c9f183b06 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74337) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 21:49:18 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-ac9abd2b-bc04-4d6f-afc0-2a4c9f183b06 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74337) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 21:49:18 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-ac9abd2b-bc04-4d6f-afc0-2a4c9f183b06 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: 1e05fd36-ee44-4992-80a9-f95af608b9f5] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 23 21:49:18 user nova-compute[74337]: DEBUG nova.privsep.utils [None req-ac9abd2b-bc04-4d6f-afc0-2a4c9f183b06 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74337) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 23 21:49:18 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-ac9abd2b-bc04-4d6f-afc0-2a4c9f183b06 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpxz4vv6j8/eef4c14e48d14671839430d69b1668f1.delta /opt/stack/data/nova/instances/snapshots/tmpxz4vv6j8/eef4c14e48d14671839430d69b1668f1 {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:49:18 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:49:18 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-ac9abd2b-bc04-4d6f-afc0-2a4c9f183b06 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpxz4vv6j8/eef4c14e48d14671839430d69b1668f1.delta /opt/stack/data/nova/instances/snapshots/tmpxz4vv6j8/eef4c14e48d14671839430d69b1668f1" returned: 0 in 0.444s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:49:18 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-ac9abd2b-bc04-4d6f-afc0-2a4c9f183b06 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: 1e05fd36-ee44-4992-80a9-f95af608b9f5] Snapshot extracted, beginning image upload
Oct 23 21:49:19 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:49:21 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-ac9abd2b-bc04-4d6f-afc0-2a4c9f183b06 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: 1e05fd36-ee44-4992-80a9-f95af608b9f5] Snapshot image upload complete
Oct 23 21:49:21 user nova-compute[74337]: INFO nova.compute.manager [None req-ac9abd2b-bc04-4d6f-afc0-2a4c9f183b06 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: 1e05fd36-ee44-4992-80a9-f95af608b9f5] Took 5.37 seconds to snapshot the instance on the hypervisor.
Oct 23 21:49:21 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:49:21 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:49:21 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Cleaning up deleted instances {{(pid=74337) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 23 21:49:21 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] There are 0 instances to clean {{(pid=74337) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 23 21:49:23 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:49:23 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74337) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 23 21:49:24 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:49:25 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-f4de8a96-003a-4be2-9f4e-29ac14210f11 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Acquiring lock "195a4056-3254-4558-b2f5-299bcd4af07c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:49:25 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-f4de8a96-003a-4be2-9f4e-29ac14210f11 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lock "195a4056-3254-4558-b2f5-299bcd4af07c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:49:25 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-f4de8a96-003a-4be2-9f4e-29ac14210f11 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Acquiring lock "195a4056-3254-4558-b2f5-299bcd4af07c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:49:25 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-f4de8a96-003a-4be2-9f4e-29ac14210f11 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lock "195a4056-3254-4558-b2f5-299bcd4af07c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:49:25 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-f4de8a96-003a-4be2-9f4e-29ac14210f11 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lock "195a4056-3254-4558-b2f5-299bcd4af07c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:49:25 user nova-compute[74337]: INFO nova.compute.manager [None req-f4de8a96-003a-4be2-9f4e-29ac14210f11 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Terminating instance
Oct 23 21:49:25 user nova-compute[74337]: DEBUG nova.compute.manager [None req-f4de8a96-003a-4be2-9f4e-29ac14210f11 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Start destroying the instance on the hypervisor. {{(pid=74337) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 21:49:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:49:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:49:26 user nova-compute[74337]: DEBUG nova.compute.manager [req-3fe6e497-b0cc-4519-8bcf-559da10637da req-c5f1d97b-d1e0-4f13-93c4-bcc935c1580a service nova] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Received event network-vif-unplugged-efec7d56-28cb-4da2-b6f7-6e9777d3377b {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:49:26 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-3fe6e497-b0cc-4519-8bcf-559da10637da req-c5f1d97b-d1e0-4f13-93c4-bcc935c1580a service nova] Acquiring lock "195a4056-3254-4558-b2f5-299bcd4af07c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:49:26 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-3fe6e497-b0cc-4519-8bcf-559da10637da req-c5f1d97b-d1e0-4f13-93c4-bcc935c1580a service nova] Lock "195a4056-3254-4558-b2f5-299bcd4af07c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:49:26 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-3fe6e497-b0cc-4519-8bcf-559da10637da req-c5f1d97b-d1e0-4f13-93c4-bcc935c1580a service nova] Lock "195a4056-3254-4558-b2f5-299bcd4af07c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:49:26 user nova-compute[74337]: DEBUG nova.compute.manager [req-3fe6e497-b0cc-4519-8bcf-559da10637da req-c5f1d97b-d1e0-4f13-93c4-bcc935c1580a service nova] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] No waiting events found dispatching network-vif-unplugged-efec7d56-28cb-4da2-b6f7-6e9777d3377b {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:49:26 user nova-compute[74337]: DEBUG nova.compute.manager [req-3fe6e497-b0cc-4519-8bcf-559da10637da req-c5f1d97b-d1e0-4f13-93c4-bcc935c1580a service nova] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Received event network-vif-unplugged-efec7d56-28cb-4da2-b6f7-6e9777d3377b for instance with task_state deleting. {{(pid=74337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 21:49:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:49:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:49:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:49:26 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Instance destroyed successfully.
Oct 23 21:49:26 user nova-compute[74337]: DEBUG nova.objects.instance [None req-f4de8a96-003a-4be2-9f4e-29ac14210f11 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lazy-loading 'resources' on Instance uuid 195a4056-3254-4558-b2f5-299bcd4af07c {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:49:26 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-f4de8a96-003a-4be2-9f4e-29ac14210f11 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-23T21:43:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-696848694',display_name='tempest-ServerActionsTestOtherA-server-751708093',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-696848694',id=23,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAWzQm4+V4g91dNEdG8YLkJhCynO3Ap8ILaI8oMN1LNLl54g3kIsrbEh6Mxm9fgmaJnzv3izz6qYqT1bG4NWKyccXk+mb+zPPixuCgYlO6IQfM8pLRdMrw36YsRSiIFnHQ==',key_name='tempest-keypair-1081806285',keypairs=<?>,launch_index=0,launched_at=2023-10-23T21:46:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e1f57e58a9ec4c6384dc0d3ca58eb610',ramdisk_id='',reservation_id='r-8no3m5aa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-100075475',owner_user_name='tempest-ServerActionsTestOtherA-100075475-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T21:46:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='891ee2e3acc54ed0bc4571f63ff491a0',uuid=195a4056-3254-4558-b2f5-299bcd4af07c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "efec7d56-28cb-4da2-b6f7-6e9777d3377b", "address": "fa:16:3e:26:a4:b5", "network": {"id": "aff1f95f-fda8-4f0f-8d10-7e3d587e4fda", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2048135647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1f57e58a9ec4c6384dc0d3ca58eb610", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefec7d56-28", "ovs_interfaceid": "efec7d56-28cb-4da2-b6f7-6e9777d3377b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 21:49:26 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-f4de8a96-003a-4be2-9f4e-29ac14210f11 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Converting VIF {"id": "efec7d56-28cb-4da2-b6f7-6e9777d3377b", "address": "fa:16:3e:26:a4:b5", "network": {"id": "aff1f95f-fda8-4f0f-8d10-7e3d587e4fda", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2048135647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1f57e58a9ec4c6384dc0d3ca58eb610", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefec7d56-28", "ovs_interfaceid": "efec7d56-28cb-4da2-b6f7-6e9777d3377b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:49:26 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-f4de8a96-003a-4be2-9f4e-29ac14210f11 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:26:a4:b5,bridge_name='br-int',has_traffic_filtering=True,id=efec7d56-28cb-4da2-b6f7-6e9777d3377b,network=Network(aff1f95f-fda8-4f0f-8d10-7e3d587e4fda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefec7d56-28') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:49:26 user nova-compute[74337]: DEBUG os_vif [None req-f4de8a96-003a-4be2-9f4e-29ac14210f11 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:a4:b5,bridge_name='br-int',has_traffic_filtering=True,id=efec7d56-28cb-4da2-b6f7-6e9777d3377b,network=Network(aff1f95f-fda8-4f0f-8d10-7e3d587e4fda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefec7d56-28') {{(pid=74337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 21:49:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:49:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapefec7d56-28, bridge=br-int, if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:49:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:49:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:49:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:49:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:49:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b6813fd5-4920-4b9d-a79f-71f30f7df8fe) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:49:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:49:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:49:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:49:26 user nova-compute[74337]: INFO os_vif [None req-f4de8a96-003a-4be2-9f4e-29ac14210f11 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:a4:b5,bridge_name='br-int',has_traffic_filtering=True,id=efec7d56-28cb-4da2-b6f7-6e9777d3377b,network=Network(aff1f95f-fda8-4f0f-8d10-7e3d587e4fda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefec7d56-28')
Oct 23 21:49:26 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-f4de8a96-003a-4be2-9f4e-29ac14210f11 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Deleting instance files /opt/stack/data/nova/instances/195a4056-3254-4558-b2f5-299bcd4af07c_del
Oct 23 21:49:26 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-f4de8a96-003a-4be2-9f4e-29ac14210f11 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Deletion of /opt/stack/data/nova/instances/195a4056-3254-4558-b2f5-299bcd4af07c_del complete
Oct 23 21:49:26 user nova-compute[74337]: INFO nova.compute.manager [None req-f4de8a96-003a-4be2-9f4e-29ac14210f11 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Took 0.89 seconds to destroy the instance on the hypervisor.
Oct 23 21:49:26 user nova-compute[74337]: DEBUG oslo.service.loopingcall [None req-f4de8a96-003a-4be2-9f4e-29ac14210f11 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74337) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 21:49:26 user nova-compute[74337]: DEBUG nova.compute.manager [-] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Deallocating network for instance {{(pid=74337) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 21:49:26 user nova-compute[74337]: DEBUG nova.network.neutron [-] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] deallocate_for_instance() {{(pid=74337) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 21:49:27 user nova-compute[74337]: DEBUG nova.network.neutron [-] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Updating instance_info_cache with network_info: [] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:49:27 user nova-compute[74337]: INFO nova.compute.manager [-] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Took 0.84 seconds to deallocate network for instance.
Oct 23 21:49:27 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-f4de8a96-003a-4be2-9f4e-29ac14210f11 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:49:27 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-f4de8a96-003a-4be2-9f4e-29ac14210f11 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:49:27 user nova-compute[74337]: DEBUG nova.compute.manager [req-d138886b-458f-407a-af6e-6efd5605ffe5 req-dd304c90-5864-4162-957a-6b4c0d2479d2 service nova] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Received event network-vif-deleted-efec7d56-28cb-4da2-b6f7-6e9777d3377b {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:49:27 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-f4de8a96-003a-4be2-9f4e-29ac14210f11 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:49:28 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-f4de8a96-003a-4be2-9f4e-29ac14210f11 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:49:28 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-f4de8a96-003a-4be2-9f4e-29ac14210f11 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.305s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:49:28 user nova-compute[74337]: INFO nova.scheduler.client.report [None req-f4de8a96-003a-4be2-9f4e-29ac14210f11 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Deleted allocations for instance 195a4056-3254-4558-b2f5-299bcd4af07c
Oct 23 21:49:28 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-f4de8a96-003a-4be2-9f4e-29ac14210f11 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lock "195a4056-3254-4558-b2f5-299bcd4af07c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.210s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:49:28 user nova-compute[74337]: DEBUG nova.compute.manager [req-2f7b6eca-5115-4283-b1b9-8eb339673abc req-3838ddfe-02d2-4be4-9f02-7cdc6a8e2285 service nova] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Received event network-vif-plugged-efec7d56-28cb-4da2-b6f7-6e9777d3377b {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:49:28 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-2f7b6eca-5115-4283-b1b9-8eb339673abc req-3838ddfe-02d2-4be4-9f02-7cdc6a8e2285 service nova] Acquiring lock "195a4056-3254-4558-b2f5-299bcd4af07c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:49:28 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-2f7b6eca-5115-4283-b1b9-8eb339673abc req-3838ddfe-02d2-4be4-9f02-7cdc6a8e2285 service nova] Lock "195a4056-3254-4558-b2f5-299bcd4af07c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:49:28 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-2f7b6eca-5115-4283-b1b9-8eb339673abc req-3838ddfe-02d2-4be4-9f02-7cdc6a8e2285 service nova] Lock "195a4056-3254-4558-b2f5-299bcd4af07c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:49:28 user nova-compute[74337]: DEBUG nova.compute.manager [req-2f7b6eca-5115-4283-b1b9-8eb339673abc req-3838ddfe-02d2-4be4-9f02-7cdc6a8e2285 service nova] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] No waiting events found dispatching network-vif-plugged-efec7d56-28cb-4da2-b6f7-6e9777d3377b {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:49:28 user nova-compute[74337]: WARNING nova.compute.manager [req-2f7b6eca-5115-4283-b1b9-8eb339673abc req-3838ddfe-02d2-4be4-9f02-7cdc6a8e2285 service nova] [instance: 195a4056-3254-4558-b2f5-299bcd4af07c] Received unexpected event network-vif-plugged-efec7d56-28cb-4da2-b6f7-6e9777d3377b for instance with vm_state deleted and task_state None.
Oct 23 21:49:31 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:49:36 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:49:40 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:49:41 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:49:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:49:47 user nova-compute[74337]: DEBUG nova.objects.instance [None req-be80f140-6711-422c-8dc0-507c8a4d3447 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lazy-loading 'flavor' on Instance uuid 56a4b932-486d-4b8d-9616-99e75592432a {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:49:47 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-be80f140-6711-422c-8dc0-507c8a4d3447 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Acquiring lock "refresh_cache-56a4b932-486d-4b8d-9616-99e75592432a" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:49:47 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-be80f140-6711-422c-8dc0-507c8a4d3447 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Acquired lock "refresh_cache-56a4b932-486d-4b8d-9616-99e75592432a" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:49:47 user nova-compute[74337]: DEBUG nova.network.neutron [None req-be80f140-6711-422c-8dc0-507c8a4d3447 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Building network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 21:49:47 user nova-compute[74337]: DEBUG nova.objects.instance [None req-be80f140-6711-422c-8dc0-507c8a4d3447 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lazy-loading 'info_cache' on Instance uuid 56a4b932-486d-4b8d-9616-99e75592432a {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:49:47 user nova-compute[74337]: DEBUG nova.objects.base [None req-be80f140-6711-422c-8dc0-507c8a4d3447 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Object Instance<56a4b932-486d-4b8d-9616-99e75592432a> lazy-loaded attributes: flavor,info_cache {{(pid=74337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 21:49:47 user nova-compute[74337]: DEBUG nova.network.neutron [None req-be80f140-6711-422c-8dc0-507c8a4d3447 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Updating instance_info_cache with network_info: [{"id": "5df71ce2-a116-44b3-856b-c0de0da5dcd6", "address": "fa:16:3e:20:cc:6f", "network": {"id": "fe0a9f00-e17b-4064-96d2-fd1cc848afb2", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1294741219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96dc585a51343db94529e22adbd6ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5df71ce2-a1", "ovs_interfaceid": "5df71ce2-a116-44b3-856b-c0de0da5dcd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:49:47 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-be80f140-6711-422c-8dc0-507c8a4d3447 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Releasing lock "refresh_cache-56a4b932-486d-4b8d-9616-99e75592432a" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:49:48 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Instance destroyed successfully.
Oct 23 21:49:48 user nova-compute[74337]: DEBUG nova.objects.instance [None req-be80f140-6711-422c-8dc0-507c8a4d3447 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lazy-loading 'resources' on Instance uuid 56a4b932-486d-4b8d-9616-99e75592432a {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:49:48 user nova-compute[74337]: DEBUG nova.objects.base [None req-be80f140-6711-422c-8dc0-507c8a4d3447 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Object Instance<56a4b932-486d-4b8d-9616-99e75592432a> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 21:49:48 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-be80f140-6711-422c-8dc0-507c8a4d3447 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:41:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1348448759',display_name='tempest-AttachVolumeTestJSON-server-1348448759',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1348448759',id=18,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOSyI2UfSbOjGClrd6s5yGjykCHAlq4p3VgQcvKHgSPXIAoK0vvVLu+A6LT9ePnSPyc9urTg/MN9ZHJ02yogPWhYeBoMR8cfZQeMkKqZLPuaXXx5keLozdFismgRTGZYug==',key_name='tempest-keypair-1796008721',keypairs=<?>,launch_index=0,launched_at=2023-10-23T21:41:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='b96dc585a51343db94529e22adbd6ef3',ramdisk_id='',reservation_id='r-ydiij502',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-786463768',owner_user_name='tempest-AttachVolumeTestJSON-786463768-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T21:47:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c82d267bc4d142f8b48c66ffab721618',uuid=56a4b932-486d-4b8d-9616-99e75592432a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "5df71ce2-a116-44b3-856b-c0de0da5dcd6", "address": "fa:16:3e:20:cc:6f", "network": {"id": "fe0a9f00-e17b-4064-96d2-fd1cc848afb2", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1294741219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96dc585a51343db94529e22adbd6ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5df71ce2-a1", "ovs_interfaceid": "5df71ce2-a116-44b3-856b-c0de0da5dcd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 21:49:48 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-be80f140-6711-422c-8dc0-507c8a4d3447 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Converting VIF {"id": "5df71ce2-a116-44b3-856b-c0de0da5dcd6", "address": "fa:16:3e:20:cc:6f", "network": {"id": "fe0a9f00-e17b-4064-96d2-fd1cc848afb2", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1294741219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96dc585a51343db94529e22adbd6ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5df71ce2-a1", "ovs_interfaceid": "5df71ce2-a116-44b3-856b-c0de0da5dcd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:49:48 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-be80f140-6711-422c-8dc0-507c8a4d3447 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:cc:6f,bridge_name='br-int',has_traffic_filtering=True,id=5df71ce2-a116-44b3-856b-c0de0da5dcd6,network=Network(fe0a9f00-e17b-4064-96d2-fd1cc848afb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5df71ce2-a1') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:49:48 user nova-compute[74337]: DEBUG os_vif [None req-be80f140-6711-422c-8dc0-507c8a4d3447 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:cc:6f,bridge_name='br-int',has_traffic_filtering=True,id=5df71ce2-a116-44b3-856b-c0de0da5dcd6,network=Network(fe0a9f00-e17b-4064-96d2-fd1cc848afb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5df71ce2-a1') {{(pid=74337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 21:49:48 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:49:48 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5df71ce2-a1, bridge=br-int, if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:49:48 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:49:48 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:49:48 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:49:48 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=22b128d2-04e9-4d75-96df-2a736af5f3b2) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:49:48 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:49:48 user nova-compute[74337]: INFO os_vif [None req-be80f140-6711-422c-8dc0-507c8a4d3447 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:cc:6f,bridge_name='br-int',has_traffic_filtering=True,id=5df71ce2-a116-44b3-856b-c0de0da5dcd6,network=Network(fe0a9f00-e17b-4064-96d2-fd1cc848afb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5df71ce2-a1')
Oct 23 21:49:48 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-be80f140-6711-422c-8dc0-507c8a4d3447 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Start _get_guest_xml network_info=[{"id": "5df71ce2-a116-44b3-856b-c0de0da5dcd6", "address": "fa:16:3e:20:cc:6f", "network": {"id": "fe0a9f00-e17b-4064-96d2-fd1cc848afb2", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1294741219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96dc585a51343db94529e22adbd6ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5df71ce2-a1", "ovs_interfaceid": "5df71ce2-a116-44b3-856b-c0de0da5dcd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=d859d89d-998d-4109-b26a-0d6e28152932,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'image_id': 'd859d89d-998d-4109-b26a-0d6e28152932'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 21:49:48 user nova-compute[74337]: DEBUG nova.objects.instance [None req-be80f140-6711-422c-8dc0-507c8a4d3447 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lazy-loading 'numa_topology' on Instance uuid 56a4b932-486d-4b8d-9616-99e75592432a {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:49:48 user nova-compute[74337]: DEBUG nova.objects.base [None req-be80f140-6711-422c-8dc0-507c8a4d3447 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Object Instance<56a4b932-486d-4b8d-9616-99e75592432a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 21:49:48 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-be80f140-6711-422c-8dc0-507c8a4d3447 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:49:48 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-be80f140-6711-422c-8dc0-507c8a4d3447 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:49:48 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-be80f140-6711-422c-8dc0-507c8a4d3447 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 21:49:48 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-be80f140-6711-422c-8dc0-507c8a4d3447 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] CPU controller missing on host. {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 21:49:48 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-be80f140-6711-422c-8dc0-507c8a4d3447 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 21:49:48 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-be80f140-6711-422c-8dc0-507c8a4d3447 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] CPU controller found on host. {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 21:49:48 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-be80f140-6711-422c-8dc0-507c8a4d3447 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 21:49:48 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-be80f140-6711-422c-8dc0-507c8a4d3447 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T21:29:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=d859d89d-998d-4109-b26a-0d6e28152932,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 21:49:48 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-be80f140-6711-422c-8dc0-507c8a4d3447 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Flavor limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 21:49:48 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-be80f140-6711-422c-8dc0-507c8a4d3447 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Image limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 21:49:48 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-be80f140-6711-422c-8dc0-507c8a4d3447 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Flavor pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 21:49:48 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-be80f140-6711-422c-8dc0-507c8a4d3447 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Image pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 21:49:48 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-be80f140-6711-422c-8dc0-507c8a4d3447 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 21:49:48 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-be80f140-6711-422c-8dc0-507c8a4d3447 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 21:49:48 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-be80f140-6711-422c-8dc0-507c8a4d3447 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 21:49:48 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-be80f140-6711-422c-8dc0-507c8a4d3447 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Got 1 possible topologies {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 21:49:48 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-be80f140-6711-422c-8dc0-507c8a4d3447 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 21:49:48 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-be80f140-6711-422c-8dc0-507c8a4d3447 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 21:49:48 user nova-compute[74337]: DEBUG nova.objects.instance [None req-be80f140-6711-422c-8dc0-507c8a4d3447 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lazy-loading 'vcpu_model' on Instance uuid 56a4b932-486d-4b8d-9616-99e75592432a {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:49:48 user nova-compute[74337]: DEBUG nova.objects.base [None req-be80f140-6711-422c-8dc0-507c8a4d3447 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Object Instance<56a4b932-486d-4b8d-9616-99e75592432a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 21:49:48 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-be80f140-6711-422c-8dc0-507c8a4d3447 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:41:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1348448759',display_name='tempest-AttachVolumeTestJSON-server-1348448759',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1348448759',id=18,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOSyI2UfSbOjGClrd6s5yGjykCHAlq4p3VgQcvKHgSPXIAoK0vvVLu+A6LT9ePnSPyc9urTg/MN9ZHJ02yogPWhYeBoMR8cfZQeMkKqZLPuaXXx5keLozdFismgRTGZYug==',key_name='tempest-keypair-1796008721',keypairs=<?>,launch_index=0,launched_at=2023-10-23T21:41:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='b96dc585a51343db94529e22adbd6ef3',ramdisk_id='',reservation_id='r-ydiij502',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-786463768',owner_user_name='tempest-AttachVolumeTestJSON-786463768-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T21:47:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c82d267bc4d142f8b48c66ffab721618',uuid=56a4b932-486d-4b8d-9616-99e75592432a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "5df71ce2-a116-44b3-856b-c0de0da5dcd6", "address": "fa:16:3e:20:cc:6f", "network": {"id": "fe0a9f00-e17b-4064-96d2-fd1cc848afb2", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1294741219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96dc585a51343db94529e22adbd6ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5df71ce2-a1", "ovs_interfaceid": "5df71ce2-a116-44b3-856b-c0de0da5dcd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 21:49:48 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-be80f140-6711-422c-8dc0-507c8a4d3447 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Converting VIF {"id": "5df71ce2-a116-44b3-856b-c0de0da5dcd6", "address": "fa:16:3e:20:cc:6f", "network": {"id": "fe0a9f00-e17b-4064-96d2-fd1cc848afb2", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1294741219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96dc585a51343db94529e22adbd6ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5df71ce2-a1", "ovs_interfaceid": "5df71ce2-a116-44b3-856b-c0de0da5dcd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:49:48 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-be80f140-6711-422c-8dc0-507c8a4d3447 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:cc:6f,bridge_name='br-int',has_traffic_filtering=True,id=5df71ce2-a116-44b3-856b-c0de0da5dcd6,network=Network(fe0a9f00-e17b-4064-96d2-fd1cc848afb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5df71ce2-a1') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:49:48 user nova-compute[74337]: DEBUG nova.objects.instance [None req-be80f140-6711-422c-8dc0-507c8a4d3447 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lazy-loading 'pci_devices' on Instance uuid 56a4b932-486d-4b8d-9616-99e75592432a {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:49:48 user nova-compute[74337]: DEBUG nova.objects.base [None req-be80f140-6711-422c-8dc0-507c8a4d3447 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Object Instance<56a4b932-486d-4b8d-9616-99e75592432a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 21:49:48 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-be80f140-6711-422c-8dc0-507c8a4d3447 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] End _get_guest_xml xml=<domain type="kvm">
Oct 23 21:49:48 user nova-compute[74337]:   <uuid>56a4b932-486d-4b8d-9616-99e75592432a</uuid>
Oct 23 21:49:48 user nova-compute[74337]:   <name>instance-00000012</name>
Oct 23 21:49:48 user nova-compute[74337]:   <memory>524288</memory>
Oct 23 21:49:48 user nova-compute[74337]:   <vcpu>1</vcpu>
Oct 23 21:49:48 user nova-compute[74337]:   <metadata>
Oct 23 21:49:48 user nova-compute[74337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 21:49:48 user nova-compute[74337]:       <nova:package version="0.0.0"/>
Oct 23 21:49:48 user nova-compute[74337]:       <nova:name>tempest-AttachVolumeTestJSON-server-1348448759</nova:name>
Oct 23 21:49:48 user nova-compute[74337]:       <nova:creationTime>2023-10-23 21:49:48</nova:creationTime>
Oct 23 21:49:48 user nova-compute[74337]:       <nova:flavor name="m1.tiny">
Oct 23 21:49:48 user nova-compute[74337]:         <nova:memory>512</nova:memory>
Oct 23 21:49:48 user nova-compute[74337]:         <nova:disk>1</nova:disk>
Oct 23 21:49:48 user nova-compute[74337]:         <nova:swap>0</nova:swap>
Oct 23 21:49:48 user nova-compute[74337]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 21:49:48 user nova-compute[74337]:         <nova:vcpus>1</nova:vcpus>
Oct 23 21:49:48 user nova-compute[74337]:       </nova:flavor>
Oct 23 21:49:48 user nova-compute[74337]:       <nova:owner>
Oct 23 21:49:48 user nova-compute[74337]:         <nova:user uuid="c82d267bc4d142f8b48c66ffab721618">tempest-AttachVolumeTestJSON-786463768-project-member</nova:user>
Oct 23 21:49:48 user nova-compute[74337]:         <nova:project uuid="b96dc585a51343db94529e22adbd6ef3">tempest-AttachVolumeTestJSON-786463768</nova:project>
Oct 23 21:49:48 user nova-compute[74337]:       </nova:owner>
Oct 23 21:49:48 user nova-compute[74337]:       <nova:root type="image" uuid="d859d89d-998d-4109-b26a-0d6e28152932"/>
Oct 23 21:49:48 user nova-compute[74337]:       <nova:ports>
Oct 23 21:49:48 user nova-compute[74337]:         <nova:port uuid="5df71ce2-a116-44b3-856b-c0de0da5dcd6">
Oct 23 21:49:48 user nova-compute[74337]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 23 21:49:48 user nova-compute[74337]:         </nova:port>
Oct 23 21:49:48 user nova-compute[74337]:       </nova:ports>
Oct 23 21:49:48 user nova-compute[74337]:     </nova:instance>
Oct 23 21:49:48 user nova-compute[74337]:   </metadata>
Oct 23 21:49:48 user nova-compute[74337]:   <sysinfo type="smbios">
Oct 23 21:49:48 user nova-compute[74337]:     <system>
Oct 23 21:49:48 user nova-compute[74337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 21:49:48 user nova-compute[74337]:       <entry name="product">OpenStack Nova</entry>
Oct 23 21:49:48 user nova-compute[74337]:       <entry name="version">0.0.0</entry>
Oct 23 21:49:48 user nova-compute[74337]:       <entry name="serial">56a4b932-486d-4b8d-9616-99e75592432a</entry>
Oct 23 21:49:48 user nova-compute[74337]:       <entry name="uuid">56a4b932-486d-4b8d-9616-99e75592432a</entry>
Oct 23 21:49:48 user nova-compute[74337]:       <entry name="family">Virtual Machine</entry>
Oct 23 21:49:48 user nova-compute[74337]:     </system>
Oct 23 21:49:48 user nova-compute[74337]:   </sysinfo>
Oct 23 21:49:48 user nova-compute[74337]:   <os>
Oct 23 21:49:48 user nova-compute[74337]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 21:49:48 user nova-compute[74337]:     <boot dev="hd"/>
Oct 23 21:49:48 user nova-compute[74337]:     <smbios mode="sysinfo"/>
Oct 23 21:49:48 user nova-compute[74337]:   </os>
Oct 23 21:49:48 user nova-compute[74337]:   <features>
Oct 23 21:49:48 user nova-compute[74337]:     <acpi/>
Oct 23 21:49:48 user nova-compute[74337]:     <apic/>
Oct 23 21:49:48 user nova-compute[74337]:     <vmcoreinfo/>
Oct 23 21:49:48 user nova-compute[74337]:   </features>
Oct 23 21:49:48 user nova-compute[74337]:   <clock offset="utc">
Oct 23 21:49:48 user nova-compute[74337]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 21:49:48 user nova-compute[74337]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 21:49:48 user nova-compute[74337]:     <timer name="hpet" present="no"/>
Oct 23 21:49:48 user nova-compute[74337]:   </clock>
Oct 23 21:49:48 user nova-compute[74337]:   <cpu mode="custom" match="exact">
Oct 23 21:49:48 user nova-compute[74337]:     <model>Nehalem</model>
Oct 23 21:49:48 user nova-compute[74337]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 21:49:48 user nova-compute[74337]:   </cpu>
Oct 23 21:49:48 user nova-compute[74337]:   <devices>
Oct 23 21:49:48 user nova-compute[74337]:     <disk type="file" device="disk">
Oct 23 21:49:48 user nova-compute[74337]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 21:49:48 user nova-compute[74337]:       <source file="/opt/stack/data/nova/instances/56a4b932-486d-4b8d-9616-99e75592432a/disk"/>
Oct 23 21:49:48 user nova-compute[74337]:       <target dev="vda" bus="virtio"/>
Oct 23 21:49:48 user nova-compute[74337]:     </disk>
Oct 23 21:49:48 user nova-compute[74337]:     <interface type="ethernet">
Oct 23 21:49:48 user nova-compute[74337]:       <mac address="fa:16:3e:20:cc:6f"/>
Oct 23 21:49:48 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:49:48 user nova-compute[74337]:       <mtu size="1442"/>
Oct 23 21:49:48 user nova-compute[74337]:       <target dev="tap5df71ce2-a1"/>
Oct 23 21:49:48 user nova-compute[74337]:     </interface>
Oct 23 21:49:48 user nova-compute[74337]:     <serial type="pty">
Oct 23 21:49:48 user nova-compute[74337]:       <log file="/opt/stack/data/nova/instances/56a4b932-486d-4b8d-9616-99e75592432a/console.log" append="off"/>
Oct 23 21:49:48 user nova-compute[74337]:     </serial>
Oct 23 21:49:48 user nova-compute[74337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 21:49:48 user nova-compute[74337]:     <video>
Oct 23 21:49:48 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:49:48 user nova-compute[74337]:     </video>
Oct 23 21:49:48 user nova-compute[74337]:     <rng model="virtio">
Oct 23 21:49:48 user nova-compute[74337]:       <backend model="random">/dev/urandom</backend>
Oct 23 21:49:48 user nova-compute[74337]:     </rng>
Oct 23 21:49:48 user nova-compute[74337]:     <controller type="usb" index="0" model="none"/>
Oct 23 21:49:48 user nova-compute[74337]:     <memballoon model="virtio">
Oct 23 21:49:48 user nova-compute[74337]:       <stats period="10"/>
Oct 23 21:49:48 user nova-compute[74337]:     </memballoon>
Oct 23 21:49:48 user nova-compute[74337]:   </devices>
Oct 23 21:49:48 user nova-compute[74337]: </domain>
Oct 23 21:49:48 user nova-compute[74337]:  {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 21:49:48 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-be80f140-6711-422c-8dc0-507c8a4d3447 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56a4b932-486d-4b8d-9616-99e75592432a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:49:48 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-be80f140-6711-422c-8dc0-507c8a4d3447 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56a4b932-486d-4b8d-9616-99e75592432a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:49:48 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-be80f140-6711-422c-8dc0-507c8a4d3447 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56a4b932-486d-4b8d-9616-99e75592432a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:49:48 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-be80f140-6711-422c-8dc0-507c8a4d3447 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56a4b932-486d-4b8d-9616-99e75592432a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:49:48 user nova-compute[74337]: DEBUG nova.objects.instance [None req-be80f140-6711-422c-8dc0-507c8a4d3447 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lazy-loading 'trusted_certs' on Instance uuid 56a4b932-486d-4b8d-9616-99e75592432a {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:49:48 user nova-compute[74337]: DEBUG nova.objects.base [None req-be80f140-6711-422c-8dc0-507c8a4d3447 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Object Instance<56a4b932-486d-4b8d-9616-99e75592432a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 21:49:48 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-be80f140-6711-422c-8dc0-507c8a4d3447 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:49:48 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-be80f140-6711-422c-8dc0-507c8a4d3447 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.177s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:49:48 user nova-compute[74337]: DEBUG nova.virt.disk.api [None req-be80f140-6711-422c-8dc0-507c8a4d3447 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Checking if we can resize image /opt/stack/data/nova/instances/56a4b932-486d-4b8d-9616-99e75592432a/disk. size=1073741824 {{(pid=74337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 21:49:48 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-be80f140-6711-422c-8dc0-507c8a4d3447 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56a4b932-486d-4b8d-9616-99e75592432a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:49:48 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-be80f140-6711-422c-8dc0-507c8a4d3447 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56a4b932-486d-4b8d-9616-99e75592432a/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:49:48 user nova-compute[74337]: DEBUG nova.virt.disk.api [None req-be80f140-6711-422c-8dc0-507c8a4d3447 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Cannot resize image /opt/stack/data/nova/instances/56a4b932-486d-4b8d-9616-99e75592432a/disk to a smaller size. {{(pid=74337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 21:49:48 user nova-compute[74337]: DEBUG nova.objects.instance [None req-be80f140-6711-422c-8dc0-507c8a4d3447 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lazy-loading 'migration_context' on Instance uuid 56a4b932-486d-4b8d-9616-99e75592432a {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:49:48 user nova-compute[74337]: DEBUG nova.objects.base [None req-be80f140-6711-422c-8dc0-507c8a4d3447 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Object Instance<56a4b932-486d-4b8d-9616-99e75592432a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 21:49:48 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-be80f140-6711-422c-8dc0-507c8a4d3447 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:41:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1348448759',display_name='tempest-AttachVolumeTestJSON-server-1348448759',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1348448759',id=18,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOSyI2UfSbOjGClrd6s5yGjykCHAlq4p3VgQcvKHgSPXIAoK0vvVLu+A6LT9ePnSPyc9urTg/MN9ZHJ02yogPWhYeBoMR8cfZQeMkKqZLPuaXXx5keLozdFismgRTGZYug==',key_name='tempest-keypair-1796008721',keypairs=<?>,launch_index=0,launched_at=2023-10-23T21:41:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='b96dc585a51343db94529e22adbd6ef3',ramdisk_id='',reservation_id='r-ydiij502',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-786463768',owner_user_name='tempest-AttachVolumeTestJSON-786463768-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:47:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c82d267bc4d142f8b48c66ffab721618',uuid=56a4b932-486d-4b8d-9616-99e75592432a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "5df71ce2-a116-44b3-856b-c0de0da5dcd6", "address": "fa:16:3e:20:cc:6f", "network": {"id": "fe0a9f00-e17b-4064-96d2-fd1cc848afb2", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1294741219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96dc585a51343db94529e22adbd6ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5df71ce2-a1", "ovs_interfaceid": "5df71ce2-a116-44b3-856b-c0de0da5dcd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 21:49:48 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-be80f140-6711-422c-8dc0-507c8a4d3447 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Converting VIF {"id": "5df71ce2-a116-44b3-856b-c0de0da5dcd6", "address": "fa:16:3e:20:cc:6f", "network": {"id": "fe0a9f00-e17b-4064-96d2-fd1cc848afb2", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1294741219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96dc585a51343db94529e22adbd6ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5df71ce2-a1", "ovs_interfaceid": "5df71ce2-a116-44b3-856b-c0de0da5dcd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:49:48 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-be80f140-6711-422c-8dc0-507c8a4d3447 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:cc:6f,bridge_name='br-int',has_traffic_filtering=True,id=5df71ce2-a116-44b3-856b-c0de0da5dcd6,network=Network(fe0a9f00-e17b-4064-96d2-fd1cc848afb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5df71ce2-a1') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:49:48 user nova-compute[74337]: DEBUG os_vif [None req-be80f140-6711-422c-8dc0-507c8a4d3447 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:cc:6f,bridge_name='br-int',has_traffic_filtering=True,id=5df71ce2-a116-44b3-856b-c0de0da5dcd6,network=Network(fe0a9f00-e17b-4064-96d2-fd1cc848afb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5df71ce2-a1') {{(pid=74337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 21:49:48 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:49:48 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:49:48 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 21:49:48 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:49:48 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '43a2dca9-239f-5e8e-9bfc-a6775a79bbfb', '_type': 'linux-noop'}}, row=False) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:49:48 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:49:48 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:49:48 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:49:48 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5df71ce2-a1, may_exist=True, interface_attrs={}) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:49:48 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5df71ce2-a1, col_values=(('qos', UUID('4e697609-c4c5-4fdc-988b-f066e0bc8d50')),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:49:48 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5df71ce2-a1, col_values=(('external_ids', {'iface-id': '5df71ce2-a116-44b3-856b-c0de0da5dcd6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:20:cc:6f', 'vm-uuid': '56a4b932-486d-4b8d-9616-99e75592432a'}),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:49:48 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:49:48 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:49:48 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:49:48 user nova-compute[74337]: INFO os_vif [None req-be80f140-6711-422c-8dc0-507c8a4d3447 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:cc:6f,bridge_name='br-int',has_traffic_filtering=True,id=5df71ce2-a116-44b3-856b-c0de0da5dcd6,network=Network(fe0a9f00-e17b-4064-96d2-fd1cc848afb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5df71ce2-a1')
Oct 23 21:49:50 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:49:50 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:49:50 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:49:50 user nova-compute[74337]: DEBUG nova.compute.manager [req-6a725af9-4c42-4243-9a78-1fe34c891480 req-e91feb3a-1ce9-4e23-ac59-ee16acf3ee78 service nova] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Received event network-vif-plugged-5df71ce2-a116-44b3-856b-c0de0da5dcd6 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:49:50 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-6a725af9-4c42-4243-9a78-1fe34c891480 req-e91feb3a-1ce9-4e23-ac59-ee16acf3ee78 service nova] Acquiring lock "56a4b932-486d-4b8d-9616-99e75592432a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:49:50 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-6a725af9-4c42-4243-9a78-1fe34c891480 req-e91feb3a-1ce9-4e23-ac59-ee16acf3ee78 service nova] Lock "56a4b932-486d-4b8d-9616-99e75592432a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:49:50 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-6a725af9-4c42-4243-9a78-1fe34c891480 req-e91feb3a-1ce9-4e23-ac59-ee16acf3ee78 service nova] Lock "56a4b932-486d-4b8d-9616-99e75592432a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:49:50 user nova-compute[74337]: DEBUG nova.compute.manager [req-6a725af9-4c42-4243-9a78-1fe34c891480 req-e91feb3a-1ce9-4e23-ac59-ee16acf3ee78 service nova] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] No waiting events found dispatching network-vif-plugged-5df71ce2-a116-44b3-856b-c0de0da5dcd6 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:49:50 user nova-compute[74337]: WARNING nova.compute.manager [req-6a725af9-4c42-4243-9a78-1fe34c891480 req-e91feb3a-1ce9-4e23-ac59-ee16acf3ee78 service nova] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Received unexpected event network-vif-plugged-5df71ce2-a116-44b3-856b-c0de0da5dcd6 for instance with vm_state stopped and task_state powering-on.
Oct 23 21:49:50 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:49:50 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:49:50 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:49:52 user nova-compute[74337]: DEBUG nova.compute.manager [req-984e85a9-0962-4913-85d8-a85a083df98d req-9807e43b-1151-4888-a70c-2ab5fb5ae979 service nova] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Received event network-vif-plugged-5df71ce2-a116-44b3-856b-c0de0da5dcd6 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:49:52 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-984e85a9-0962-4913-85d8-a85a083df98d req-9807e43b-1151-4888-a70c-2ab5fb5ae979 service nova] Acquiring lock "56a4b932-486d-4b8d-9616-99e75592432a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:49:52 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-984e85a9-0962-4913-85d8-a85a083df98d req-9807e43b-1151-4888-a70c-2ab5fb5ae979 service nova] Lock "56a4b932-486d-4b8d-9616-99e75592432a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:49:52 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-984e85a9-0962-4913-85d8-a85a083df98d req-9807e43b-1151-4888-a70c-2ab5fb5ae979 service nova] Lock "56a4b932-486d-4b8d-9616-99e75592432a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:49:52 user nova-compute[74337]: DEBUG nova.compute.manager [req-984e85a9-0962-4913-85d8-a85a083df98d req-9807e43b-1151-4888-a70c-2ab5fb5ae979 service nova] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] No waiting events found dispatching network-vif-plugged-5df71ce2-a116-44b3-856b-c0de0da5dcd6 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:49:52 user nova-compute[74337]: WARNING nova.compute.manager [req-984e85a9-0962-4913-85d8-a85a083df98d req-9807e43b-1151-4888-a70c-2ab5fb5ae979 service nova] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Received unexpected event network-vif-plugged-5df71ce2-a116-44b3-856b-c0de0da5dcd6 for instance with vm_state stopped and task_state powering-on.
Oct 23 21:49:52 user nova-compute[74337]: DEBUG nova.compute.manager [None req-be80f140-6711-422c-8dc0-507c8a4d3447 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Instance event wait completed in 0 seconds for  {{(pid=74337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 21:49:52 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Instance rebooted successfully.
Oct 23 21:49:52 user nova-compute[74337]: DEBUG nova.compute.manager [None req-be80f140-6711-422c-8dc0-507c8a4d3447 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Checking state {{(pid=74337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 21:49:53 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:49:53 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:49:58 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:50:03 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:50:03 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:50:03 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 21:50:03 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 21:50:03 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 21:50:03 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:50:07 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:50:07 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:50:07 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 21:50:07 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:50:07 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Triggering sync for uuid 1189976f-8d02-468d-8fa7-bd5594c5f85a {{(pid=74337) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 23 21:50:07 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Triggering sync for uuid 547c4d4c-e0dd-495a-b83f-98426d0a4a99 {{(pid=74337) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 23 21:50:07 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Triggering sync for uuid 56a4b932-486d-4b8d-9616-99e75592432a {{(pid=74337) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 23 21:50:07 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Triggering sync for uuid c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d {{(pid=74337) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 23 21:50:07 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Triggering sync for uuid 89e792eb-ad8f-4bb7-adac-315c3415cd6d {{(pid=74337) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 23 21:50:07 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Triggering sync for uuid 1e05fd36-ee44-4992-80a9-f95af608b9f5 {{(pid=74337) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 23 21:50:07 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Triggering sync for uuid 31cee1d7-a0f9-4909-b4e4-4513584f9ce2 {{(pid=74337) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 23 21:50:07 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Triggering sync for uuid 9ecb4d1d-d6a1-403a-af40-3a1a10688b5c {{(pid=74337) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 23 21:50:07 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "1189976f-8d02-468d-8fa7-bd5594c5f85a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:50:07 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "1189976f-8d02-468d-8fa7-bd5594c5f85a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:50:07 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "547c4d4c-e0dd-495a-b83f-98426d0a4a99" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:50:07 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "547c4d4c-e0dd-495a-b83f-98426d0a4a99" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:50:07 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "56a4b932-486d-4b8d-9616-99e75592432a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:50:07 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "56a4b932-486d-4b8d-9616-99e75592432a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:50:07 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:50:07 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:50:07 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "89e792eb-ad8f-4bb7-adac-315c3415cd6d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:50:07 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "89e792eb-ad8f-4bb7-adac-315c3415cd6d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:50:07 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "1e05fd36-ee44-4992-80a9-f95af608b9f5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:50:07 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "1e05fd36-ee44-4992-80a9-f95af608b9f5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:50:07 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "31cee1d7-a0f9-4909-b4e4-4513584f9ce2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:50:07 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "31cee1d7-a0f9-4909-b4e4-4513584f9ce2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:50:07 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "9ecb4d1d-d6a1-403a-af40-3a1a10688b5c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:50:07 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "9ecb4d1d-d6a1-403a-af40-3a1a10688b5c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:50:07 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "547c4d4c-e0dd-495a-b83f-98426d0a4a99" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.047s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:50:07 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "56a4b932-486d-4b8d-9616-99e75592432a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.048s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:50:07 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "1189976f-8d02-468d-8fa7-bd5594c5f85a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.051s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:50:07 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "1e05fd36-ee44-4992-80a9-f95af608b9f5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.055s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:50:07 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.058s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:50:07 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "89e792eb-ad8f-4bb7-adac-315c3415cd6d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.060s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:50:07 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "9ecb4d1d-d6a1-403a-af40-3a1a10688b5c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.065s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:50:07 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "31cee1d7-a0f9-4909-b4e4-4513584f9ce2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.067s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:50:08 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:50:08 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:50:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:50:08 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-16912d25-bf18-47a2-816c-bf343b5379ea tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Acquiring lock "89e792eb-ad8f-4bb7-adac-315c3415cd6d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:50:08 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-16912d25-bf18-47a2-816c-bf343b5379ea tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "89e792eb-ad8f-4bb7-adac-315c3415cd6d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:50:08 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-16912d25-bf18-47a2-816c-bf343b5379ea tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Acquiring lock "89e792eb-ad8f-4bb7-adac-315c3415cd6d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:50:08 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-16912d25-bf18-47a2-816c-bf343b5379ea tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "89e792eb-ad8f-4bb7-adac-315c3415cd6d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:50:08 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-16912d25-bf18-47a2-816c-bf343b5379ea tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "89e792eb-ad8f-4bb7-adac-315c3415cd6d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:50:08 user nova-compute[74337]: INFO nova.compute.manager [None req-16912d25-bf18-47a2-816c-bf343b5379ea tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 89e792eb-ad8f-4bb7-adac-315c3415cd6d] Terminating instance
Oct 23 21:50:08 user nova-compute[74337]: DEBUG nova.compute.manager [None req-16912d25-bf18-47a2-816c-bf343b5379ea tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 89e792eb-ad8f-4bb7-adac-315c3415cd6d] Start destroying the instance on the hypervisor. {{(pid=74337) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 21:50:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:50:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:50:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:50:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:50:08 user nova-compute[74337]: DEBUG nova.compute.manager [req-50a4c8e7-e2f3-42d4-8665-8ebb1c772f2f req-29938f3b-43e2-4e5a-822d-6fd547fff7bc service nova] [instance: 89e792eb-ad8f-4bb7-adac-315c3415cd6d] Received event network-vif-unplugged-c23a4c6d-9fd0-4cd3-afa9-5ccf4520d90e {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:50:08 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-50a4c8e7-e2f3-42d4-8665-8ebb1c772f2f req-29938f3b-43e2-4e5a-822d-6fd547fff7bc service nova] Acquiring lock "89e792eb-ad8f-4bb7-adac-315c3415cd6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:50:08 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-50a4c8e7-e2f3-42d4-8665-8ebb1c772f2f req-29938f3b-43e2-4e5a-822d-6fd547fff7bc service nova] Lock "89e792eb-ad8f-4bb7-adac-315c3415cd6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:50:08 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-50a4c8e7-e2f3-42d4-8665-8ebb1c772f2f req-29938f3b-43e2-4e5a-822d-6fd547fff7bc service nova] Lock "89e792eb-ad8f-4bb7-adac-315c3415cd6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:50:08 user nova-compute[74337]: DEBUG nova.compute.manager [req-50a4c8e7-e2f3-42d4-8665-8ebb1c772f2f req-29938f3b-43e2-4e5a-822d-6fd547fff7bc service nova] [instance: 89e792eb-ad8f-4bb7-adac-315c3415cd6d] No waiting events found dispatching network-vif-unplugged-c23a4c6d-9fd0-4cd3-afa9-5ccf4520d90e {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:50:08 user nova-compute[74337]: DEBUG nova.compute.manager [req-50a4c8e7-e2f3-42d4-8665-8ebb1c772f2f req-29938f3b-43e2-4e5a-822d-6fd547fff7bc service nova] [instance: 89e792eb-ad8f-4bb7-adac-315c3415cd6d] Received event network-vif-unplugged-c23a4c6d-9fd0-4cd3-afa9-5ccf4520d90e for instance with task_state deleting. {{(pid=74337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 21:50:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:50:09 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: 89e792eb-ad8f-4bb7-adac-315c3415cd6d] Instance destroyed successfully.
Oct 23 21:50:09 user nova-compute[74337]: DEBUG nova.objects.instance [None req-16912d25-bf18-47a2-816c-bf343b5379ea tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lazy-loading 'resources' on Instance uuid 89e792eb-ad8f-4bb7-adac-315c3415cd6d {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:50:09 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-16912d25-bf18-47a2-816c-bf343b5379ea tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:45:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1666272220',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1666272220',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1666272220',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOgrDBH1CvXvIcgB0O0DFBLVjNN8t7kMW+CZkDWjghUBMBIGLgB/sbTKT/JxvB2pvW15F+DwsGGE4rA8tWUBZwr6Ds30gIIu/5Ft3ePzuZluMRXuj1d9BSI79URZ7oNHEw==',key_name='tempest-keypair-615180005',keypairs=<?>,launch_index=0,launched_at=2023-10-23T21:45:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cb567547bd4941fb87435a841c9d17c4',ramdisk_id='',reservation_id='r-bip98ecx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-499971371',owner_user_name='tempest-TestVolumeBootPattern-499971371-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T21:45:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c3e635e8e5447138a7f2db11695574c',uuid=89e792eb-ad8f-4bb7-adac-315c3415cd6d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c23a4c6d-9fd0-4cd3-afa9-5ccf4520d90e", "address": "fa:16:3e:9e:8d:44", "network": {"id": "5a18e96f-a6eb-4989-9be3-154b54928b03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-507511840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb567547bd4941fb87435a841c9d17c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc23a4c6d-9f", "ovs_interfaceid": "c23a4c6d-9fd0-4cd3-afa9-5ccf4520d90e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 21:50:09 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-16912d25-bf18-47a2-816c-bf343b5379ea tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Converting VIF {"id": "c23a4c6d-9fd0-4cd3-afa9-5ccf4520d90e", "address": "fa:16:3e:9e:8d:44", "network": {"id": "5a18e96f-a6eb-4989-9be3-154b54928b03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-507511840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb567547bd4941fb87435a841c9d17c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc23a4c6d-9f", "ovs_interfaceid": "c23a4c6d-9fd0-4cd3-afa9-5ccf4520d90e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:50:09 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-16912d25-bf18-47a2-816c-bf343b5379ea tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9e:8d:44,bridge_name='br-int',has_traffic_filtering=True,id=c23a4c6d-9fd0-4cd3-afa9-5ccf4520d90e,network=Network(5a18e96f-a6eb-4989-9be3-154b54928b03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc23a4c6d-9f') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:50:09 user nova-compute[74337]: DEBUG os_vif [None req-16912d25-bf18-47a2-816c-bf343b5379ea tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:8d:44,bridge_name='br-int',has_traffic_filtering=True,id=c23a4c6d-9fd0-4cd3-afa9-5ccf4520d90e,network=Network(5a18e96f-a6eb-4989-9be3-154b54928b03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc23a4c6d-9f') {{(pid=74337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 21:50:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:50:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc23a4c6d-9f, bridge=br-int, if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:50:09 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:50:09 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Starting heal instance info cache {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 21:50:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:50:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:50:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:50:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dc7db197-9e8e-4ef3-afd2-e8749146b8e2) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:50:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:50:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:50:09 user nova-compute[74337]: INFO os_vif [None req-16912d25-bf18-47a2-816c-bf343b5379ea tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:8d:44,bridge_name='br-int',has_traffic_filtering=True,id=c23a4c6d-9fd0-4cd3-afa9-5ccf4520d90e,network=Network(5a18e96f-a6eb-4989-9be3-154b54928b03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc23a4c6d-9f')
Oct 23 21:50:09 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16912d25-bf18-47a2-816c-bf343b5379ea tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 89e792eb-ad8f-4bb7-adac-315c3415cd6d] calling os-brick to detach iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 21:50:09 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-16912d25-bf18-47a2-816c-bf343b5379ea tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, {'target_iqn': 'iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bQqHTWFg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:50:09 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-16912d25-bf18-47a2-816c-bf343b5379ea tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:50:09 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-16912d25-bf18-47a2-816c-bf343b5379ea tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:50:09 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-16912d25-bf18-47a2-816c-bf343b5379ea tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:50:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:50:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:50:09 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7f40194-e7bb-4183-b99e-d5803c95b7b0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:50:09 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-16912d25-bf18-47a2-816c-bf343b5379ea tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 21:50:09 user nova-compute[74337]: No targets found.
Oct 23 21:50:09 user nova-compute[74337]: iSNS:
Oct 23 21:50:09 user nova-compute[74337]: No targets found.
Oct 23 21:50:09 user nova-compute[74337]: STATIC:
Oct 23 21:50:09 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4
Oct 23 21:50:09 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:50:09 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:50:09 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c
Oct 23 21:50:09 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:50:09 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:50:09 user nova-compute[74337]: FIRMWARE:
Oct 23 21:50:09 user nova-compute[74337]: No targets found.
Oct 23 21:50:09 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:50:09 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-16912d25-bf18-47a2-816c-bf343b5379ea tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 21:50:09 user nova-compute[74337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 21:50:09 user nova-compute[74337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 21:50:09 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-16912d25-bf18-47a2-816c-bf343b5379ea tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c', 0)] {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 21:50:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:50:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:50:09 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[400ebc7b-9d6e-4014-9cfb-1e2e3b6c8129]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:50:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:50:09 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "refresh_cache-c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:50:09 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquired lock "refresh_cache-c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:50:09 user nova-compute[74337]: DEBUG nova.network.neutron [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] Forcefully refreshing network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 21:50:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:50:09 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a865bc-ba66-4775-801f-51227b987592]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:50:09 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-16912d25-bf18-47a2-816c-bf343b5379ea tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:50:09 user nova-compute[74337]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c (non-flash)
Oct 23 21:50:09 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:50:09 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-16912d25-bf18-47a2-816c-bf343b5379ea tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:50:09 user nova-compute[74337]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c (non-flash)
Oct 23 21:50:09 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:50:09 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-16912d25-bf18-47a2-816c-bf343b5379ea tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5ef589bbe0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c'): ({'sde'}, set())}) {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 21:50:09 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-16912d25-bf18-47a2-816c-bf343b5379ea tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Removing single pathed devices sde {{(pid=74337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 21:50:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:50:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:50:09 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[2082cc48-9ac1-47ec-9543-0d494d8a373a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:50:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:50:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:50:09 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f2f8bb9-b243-4097-8cb9-3c6d4fa3b774]: (4, ('ok\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:50:09 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-16912d25-bf18-47a2-816c-bf343b5379ea tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Flushing IO for device /dev/sde {{(pid=74337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 21:50:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:50:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:50:09 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b86dfb5-5312-4016-ad9f-cadb96530a84]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:50:09 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-16912d25-bf18-47a2-816c-bf343b5379ea tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 21:50:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:50:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.046s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:50:09 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3bb05e7-d81d-4676-8f73-ccddcb9c3654]: (4, ('1', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:50:09 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-16912d25-bf18-47a2-816c-bf343b5379ea tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 21:50:09 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-16912d25-bf18-47a2-816c-bf343b5379ea tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] SCSI volumes sde have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 21:50:09 user nova-compute[74337]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_14b69b63', '/dev/disk/by-id/scsi-1SCST_BIO14b69b63-1429abd7367c6d15', '/dev/disk/by-id/scsi-23134323961626437') {{(pid=85566) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 23 21:50:09 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6171e335-60e0-479a-a270-93739bbbc18c]: (4, None) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:50:09 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-16912d25-bf18-47a2-816c-bf343b5379ea tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c')] {{(pid=74337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 21:50:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:50:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:50:09 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[61345f0a-b67a-4a6b-bbc8-67e2e696d9ca]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:50:09 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-16912d25-bf18-47a2-816c-bf343b5379ea tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:50:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c -p 172.16.0.220:3260 --logout {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:50:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:50:09 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[17400ebe-a46b-415d-9267-f0d619a95ecb]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:50:09 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-16912d25-bf18-47a2-816c-bf343b5379ea tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c, portal: 172.16.0.220,3260]
Oct 23 21:50:09 user nova-compute[74337]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c, portal: 172.16.0.220,3260] successful.
Oct 23 21:50:09 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:50:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c -p 172.16.0.220:3260 --op delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:50:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:50:09 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff2da6e-be99-4745-857b-797965bf7db5]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:50:09 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-16912d25-bf18-47a2-816c-bf343b5379ea tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:50:09 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-16912d25-bf18-47a2-816c-bf343b5379ea tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:50:09 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-16912d25-bf18-47a2-816c-bf343b5379ea tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] <== disconnect_volume: return (330ms) None {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:50:09 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16912d25-bf18-47a2-816c-bf343b5379ea tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 89e792eb-ad8f-4bb7-adac-315c3415cd6d] Disconnected iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 21:50:09 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-16912d25-bf18-47a2-816c-bf343b5379ea tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 89e792eb-ad8f-4bb7-adac-315c3415cd6d] Deleting instance files /opt/stack/data/nova/instances/89e792eb-ad8f-4bb7-adac-315c3415cd6d_del
Oct 23 21:50:09 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-16912d25-bf18-47a2-816c-bf343b5379ea tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 89e792eb-ad8f-4bb7-adac-315c3415cd6d] Deletion of /opt/stack/data/nova/instances/89e792eb-ad8f-4bb7-adac-315c3415cd6d_del complete
Oct 23 21:50:09 user nova-compute[74337]: INFO nova.compute.manager [None req-16912d25-bf18-47a2-816c-bf343b5379ea tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 89e792eb-ad8f-4bb7-adac-315c3415cd6d] Took 1.20 seconds to destroy the instance on the hypervisor.
Oct 23 21:50:09 user nova-compute[74337]: DEBUG oslo.service.loopingcall [None req-16912d25-bf18-47a2-816c-bf343b5379ea tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74337) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 21:50:09 user nova-compute[74337]: DEBUG nova.compute.manager [-] [instance: 89e792eb-ad8f-4bb7-adac-315c3415cd6d] Deallocating network for instance {{(pid=74337) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 21:50:09 user nova-compute[74337]: DEBUG nova.network.neutron [-] [instance: 89e792eb-ad8f-4bb7-adac-315c3415cd6d] deallocate_for_instance() {{(pid=74337) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 21:50:10 user nova-compute[74337]: DEBUG nova.network.neutron [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] Updating instance_info_cache with network_info: [{"id": "328722f1-b384-495c-8aea-81780b2d9ca1", "address": "fa:16:3e:28:35:83", "network": {"id": "5f62b1d8-d5d0-4ff9-922b-fc6e72fb640d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-655282105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b85c4f783a4ee7ab67422b49da85ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap328722f1-b3", "ovs_interfaceid": "328722f1-b384-495c-8aea-81780b2d9ca1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:50:10 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Releasing lock "refresh_cache-c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:50:10 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] Updated the network info_cache for instance {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 21:50:10 user nova-compute[74337]: DEBUG nova.network.neutron [-] [instance: 89e792eb-ad8f-4bb7-adac-315c3415cd6d] Updating instance_info_cache with network_info: [] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:50:10 user nova-compute[74337]: INFO nova.compute.manager [-] [instance: 89e792eb-ad8f-4bb7-adac-315c3415cd6d] Took 0.76 seconds to deallocate network for instance.
Oct 23 21:50:10 user nova-compute[74337]: DEBUG nova.compute.manager [req-42c36863-b988-4008-ad18-7937a5b3b7b9 req-b80b1fd1-2cba-49f8-819b-7ba66ca3f3df service nova] [instance: 89e792eb-ad8f-4bb7-adac-315c3415cd6d] Received event network-vif-deleted-c23a4c6d-9fd0-4cd3-afa9-5ccf4520d90e {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:50:11 user nova-compute[74337]: DEBUG nova.compute.manager [req-f6419090-8997-42a0-b24f-8ace55f1c8f3 req-0f1d9684-ce6f-4f15-aac8-aa5fc00cec62 service nova] [instance: 89e792eb-ad8f-4bb7-adac-315c3415cd6d] Received event network-vif-plugged-c23a4c6d-9fd0-4cd3-afa9-5ccf4520d90e {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:50:11 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-f6419090-8997-42a0-b24f-8ace55f1c8f3 req-0f1d9684-ce6f-4f15-aac8-aa5fc00cec62 service nova] Acquiring lock "89e792eb-ad8f-4bb7-adac-315c3415cd6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:50:11 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-f6419090-8997-42a0-b24f-8ace55f1c8f3 req-0f1d9684-ce6f-4f15-aac8-aa5fc00cec62 service nova] Lock "89e792eb-ad8f-4bb7-adac-315c3415cd6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:50:11 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-f6419090-8997-42a0-b24f-8ace55f1c8f3 req-0f1d9684-ce6f-4f15-aac8-aa5fc00cec62 service nova] Lock "89e792eb-ad8f-4bb7-adac-315c3415cd6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:50:11 user nova-compute[74337]: DEBUG nova.compute.manager [req-f6419090-8997-42a0-b24f-8ace55f1c8f3 req-0f1d9684-ce6f-4f15-aac8-aa5fc00cec62 service nova] [instance: 89e792eb-ad8f-4bb7-adac-315c3415cd6d] No waiting events found dispatching network-vif-plugged-c23a4c6d-9fd0-4cd3-afa9-5ccf4520d90e {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:50:11 user nova-compute[74337]: WARNING nova.compute.manager [req-f6419090-8997-42a0-b24f-8ace55f1c8f3 req-0f1d9684-ce6f-4f15-aac8-aa5fc00cec62 service nova] [instance: 89e792eb-ad8f-4bb7-adac-315c3415cd6d] Received unexpected event network-vif-plugged-c23a4c6d-9fd0-4cd3-afa9-5ccf4520d90e for instance with vm_state active and task_state deleting.
Oct 23 21:50:11 user nova-compute[74337]: INFO nova.compute.manager [None req-16912d25-bf18-47a2-816c-bf343b5379ea tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 89e792eb-ad8f-4bb7-adac-315c3415cd6d] Took 0.90 seconds to detach 1 volumes for instance.
Oct 23 21:50:11 user nova-compute[74337]: DEBUG nova.compute.manager [None req-16912d25-bf18-47a2-816c-bf343b5379ea tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 89e792eb-ad8f-4bb7-adac-315c3415cd6d] Deleting volume: 8e0566f2-fd0c-40fe-b7b8-500c5d23cb8c {{(pid=74337) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 23 21:50:11 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-16912d25-bf18-47a2-816c-bf343b5379ea tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:50:11 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-16912d25-bf18-47a2-816c-bf343b5379ea tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:50:11 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-16912d25-bf18-47a2-816c-bf343b5379ea tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:50:11 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-16912d25-bf18-47a2-816c-bf343b5379ea tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:50:11 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-16912d25-bf18-47a2-816c-bf343b5379ea tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.320s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:50:12 user nova-compute[74337]: INFO nova.scheduler.client.report [None req-16912d25-bf18-47a2-816c-bf343b5379ea tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Deleted allocations for instance 89e792eb-ad8f-4bb7-adac-315c3415cd6d
Oct 23 21:50:12 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-16912d25-bf18-47a2-816c-bf343b5379ea tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "89e792eb-ad8f-4bb7-adac-315c3415cd6d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.418s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:50:13 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:50:14 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:50:14 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:50:14 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:50:15 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:50:15 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:50:15 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:50:15 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:50:15 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Auditing locally available compute resources for user (node: user) {{(pid=74337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 21:50:15 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 21:50:15 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56a4b932-486d-4b8d-9616-99e75592432a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:50:15 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56a4b932-486d-4b8d-9616-99e75592432a/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:50:15 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56a4b932-486d-4b8d-9616-99e75592432a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:50:15 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56a4b932-486d-4b8d-9616-99e75592432a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:50:15 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/547c4d4c-e0dd-495a-b83f-98426d0a4a99/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:50:16 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/547c4d4c-e0dd-495a-b83f-98426d0a4a99/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:50:16 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/547c4d4c-e0dd-495a-b83f-98426d0a4a99/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:50:16 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/547c4d4c-e0dd-495a-b83f-98426d0a4a99/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:50:16 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e05fd36-ee44-4992-80a9-f95af608b9f5/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:50:16 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e05fd36-ee44-4992-80a9-f95af608b9f5/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:50:16 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e05fd36-ee44-4992-80a9-f95af608b9f5/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:50:16 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e05fd36-ee44-4992-80a9-f95af608b9f5/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:50:16 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31cee1d7-a0f9-4909-b4e4-4513584f9ce2/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:50:16 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31cee1d7-a0f9-4909-b4e4-4513584f9ce2/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:50:16 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31cee1d7-a0f9-4909-b4e4-4513584f9ce2/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:50:17 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31cee1d7-a0f9-4909-b4e4-4513584f9ce2/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:50:17 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ecb4d1d-d6a1-403a-af40-3a1a10688b5c/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:50:17 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ecb4d1d-d6a1-403a-af40-3a1a10688b5c/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:50:17 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ecb4d1d-d6a1-403a-af40-3a1a10688b5c/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:50:17 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ecb4d1d-d6a1-403a-af40-3a1a10688b5c/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:50:17 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1189976f-8d02-468d-8fa7-bd5594c5f85a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:50:17 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1189976f-8d02-468d-8fa7-bd5594c5f85a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:50:17 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1189976f-8d02-468d-8fa7-bd5594c5f85a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:50:17 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1189976f-8d02-468d-8fa7-bd5594c5f85a/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:50:18 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:50:18 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:50:18 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Hypervisor/Node resource view: name=user free_ram=8060MB free_disk=25.263580322265625GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 21:50:18 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:50:18 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:50:18 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 1189976f-8d02-468d-8fa7-bd5594c5f85a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:50:18 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 547c4d4c-e0dd-495a-b83f-98426d0a4a99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:50:18 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 00f757cf-e5dd-476f-81c6-670ed2bf6938 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Oct 23 21:50:18 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 56a4b932-486d-4b8d-9616-99e75592432a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:50:18 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:50:18 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 1e05fd36-ee44-4992-80a9-f95af608b9f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:50:18 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 31cee1d7-a0f9-4909-b4e4-4513584f9ce2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:50:18 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 9ecb4d1d-d6a1-403a-af40-3a1a10688b5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:50:18 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 21:50:18 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 21:50:18 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:50:18 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:50:18 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:50:18 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Compute_service record updated for user:user {{(pid=74337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 21:50:18 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.467s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:50:19 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:50:20 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-f0ec9dfb-6f88-4120-adf5-4c2a6e041e3b tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] Acquiring lock "31cee1d7-a0f9-4909-b4e4-4513584f9ce2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:50:20 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-f0ec9dfb-6f88-4120-adf5-4c2a6e041e3b tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] Lock "31cee1d7-a0f9-4909-b4e4-4513584f9ce2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:50:20 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-f0ec9dfb-6f88-4120-adf5-4c2a6e041e3b tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] Acquiring lock "31cee1d7-a0f9-4909-b4e4-4513584f9ce2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:50:20 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-f0ec9dfb-6f88-4120-adf5-4c2a6e041e3b tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] Lock "31cee1d7-a0f9-4909-b4e4-4513584f9ce2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:50:20 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-f0ec9dfb-6f88-4120-adf5-4c2a6e041e3b tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] Lock "31cee1d7-a0f9-4909-b4e4-4513584f9ce2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:50:20 user nova-compute[74337]: INFO nova.compute.manager [None req-f0ec9dfb-6f88-4120-adf5-4c2a6e041e3b tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] [instance: 31cee1d7-a0f9-4909-b4e4-4513584f9ce2] Terminating instance
Oct 23 21:50:20 user nova-compute[74337]: DEBUG nova.compute.manager [None req-f0ec9dfb-6f88-4120-adf5-4c2a6e041e3b tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] [instance: 31cee1d7-a0f9-4909-b4e4-4513584f9ce2] Start destroying the instance on the hypervisor. {{(pid=74337) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 21:50:20 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:50:20 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:50:20 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:50:20 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:50:20 user nova-compute[74337]: DEBUG nova.compute.manager [req-9125604e-ab7c-4453-a2f9-76793815041c req-c9ca97a7-7f0a-4d52-b20b-46bfe510ecc8 service nova] [instance: 31cee1d7-a0f9-4909-b4e4-4513584f9ce2] Received event network-vif-unplugged-0dab73f8-3c29-4332-8f12-e3989869b1e0 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:50:20 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-9125604e-ab7c-4453-a2f9-76793815041c req-c9ca97a7-7f0a-4d52-b20b-46bfe510ecc8 service nova] Acquiring lock "31cee1d7-a0f9-4909-b4e4-4513584f9ce2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:50:20 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-9125604e-ab7c-4453-a2f9-76793815041c req-c9ca97a7-7f0a-4d52-b20b-46bfe510ecc8 service nova] Lock "31cee1d7-a0f9-4909-b4e4-4513584f9ce2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:50:20 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-9125604e-ab7c-4453-a2f9-76793815041c req-c9ca97a7-7f0a-4d52-b20b-46bfe510ecc8 service nova] Lock "31cee1d7-a0f9-4909-b4e4-4513584f9ce2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:50:20 user nova-compute[74337]: DEBUG nova.compute.manager [req-9125604e-ab7c-4453-a2f9-76793815041c req-c9ca97a7-7f0a-4d52-b20b-46bfe510ecc8 service nova] [instance: 31cee1d7-a0f9-4909-b4e4-4513584f9ce2] No waiting events found dispatching network-vif-unplugged-0dab73f8-3c29-4332-8f12-e3989869b1e0 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:50:20 user nova-compute[74337]: DEBUG nova.compute.manager [req-9125604e-ab7c-4453-a2f9-76793815041c req-c9ca97a7-7f0a-4d52-b20b-46bfe510ecc8 service nova] [instance: 31cee1d7-a0f9-4909-b4e4-4513584f9ce2] Received event network-vif-unplugged-0dab73f8-3c29-4332-8f12-e3989869b1e0 for instance with task_state deleting. {{(pid=74337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 21:50:20 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:50:20 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:50:21 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: 31cee1d7-a0f9-4909-b4e4-4513584f9ce2] Instance destroyed successfully.
Oct 23 21:50:21 user nova-compute[74337]: DEBUG nova.objects.instance [None req-f0ec9dfb-6f88-4120-adf5-4c2a6e041e3b tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] Lazy-loading 'resources' on Instance uuid 31cee1d7-a0f9-4909-b4e4-4513584f9ce2 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:50:21 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-f0ec9dfb-6f88-4120-adf5-4c2a6e041e3b tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:48:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1602505068',display_name='tempest-VolumesNegativeTest-instance-1602505068',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1602505068',id=28,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-23T21:48:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='be383a166193438fa661aa9142ac6609',ramdisk_id='',reservation_id='r-v0szuv0m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1848392112',owner_user_name='tempest-VolumesNegativeTest-1848392112-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T21:48:37Z,user_data=None,user_id='088a31403f0b4113ba310bc9edf33e04',uuid=31cee1d7-a0f9-4909-b4e4-4513584f9ce2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0dab73f8-3c29-4332-8f12-e3989869b1e0", "address": "fa:16:3e:46:b1:40", "network": {"id": "f892179a-1c7a-4ca8-8096-98be26497573", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "ff43462300764979a6cf688444336a56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dab73f8-3c", "ovs_interfaceid": "0dab73f8-3c29-4332-8f12-e3989869b1e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 21:50:21 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-f0ec9dfb-6f88-4120-adf5-4c2a6e041e3b tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] Converting VIF {"id": "0dab73f8-3c29-4332-8f12-e3989869b1e0", "address": "fa:16:3e:46:b1:40", "network": {"id": "f892179a-1c7a-4ca8-8096-98be26497573", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "ff43462300764979a6cf688444336a56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dab73f8-3c", "ovs_interfaceid": "0dab73f8-3c29-4332-8f12-e3989869b1e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:50:21 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-f0ec9dfb-6f88-4120-adf5-4c2a6e041e3b tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:b1:40,bridge_name='br-int',has_traffic_filtering=True,id=0dab73f8-3c29-4332-8f12-e3989869b1e0,network=Network(f892179a-1c7a-4ca8-8096-98be26497573),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dab73f8-3c') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:50:21 user nova-compute[74337]: DEBUG os_vif [None req-f0ec9dfb-6f88-4120-adf5-4c2a6e041e3b tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:b1:40,bridge_name='br-int',has_traffic_filtering=True,id=0dab73f8-3c29-4332-8f12-e3989869b1e0,network=Network(f892179a-1c7a-4ca8-8096-98be26497573),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dab73f8-3c') {{(pid=74337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 21:50:21 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:50:21 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0dab73f8-3c, bridge=br-int, if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:50:21 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:50:21 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:50:21 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:50:21 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bea03696-6767-48ee-9e07-4c767bbb3706) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:50:21 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:50:21 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:50:21 user nova-compute[74337]: INFO os_vif [None req-f0ec9dfb-6f88-4120-adf5-4c2a6e041e3b tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:b1:40,bridge_name='br-int',has_traffic_filtering=True,id=0dab73f8-3c29-4332-8f12-e3989869b1e0,network=Network(f892179a-1c7a-4ca8-8096-98be26497573),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dab73f8-3c')
Oct 23 21:50:21 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-f0ec9dfb-6f88-4120-adf5-4c2a6e041e3b tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] [instance: 31cee1d7-a0f9-4909-b4e4-4513584f9ce2] Deleting instance files /opt/stack/data/nova/instances/31cee1d7-a0f9-4909-b4e4-4513584f9ce2_del
Oct 23 21:50:21 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-f0ec9dfb-6f88-4120-adf5-4c2a6e041e3b tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] [instance: 31cee1d7-a0f9-4909-b4e4-4513584f9ce2] Deletion of /opt/stack/data/nova/instances/31cee1d7-a0f9-4909-b4e4-4513584f9ce2_del complete
Oct 23 21:50:21 user nova-compute[74337]: INFO nova.compute.manager [None req-f0ec9dfb-6f88-4120-adf5-4c2a6e041e3b tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] [instance: 31cee1d7-a0f9-4909-b4e4-4513584f9ce2] Took 0.67 seconds to destroy the instance on the hypervisor.
Oct 23 21:50:21 user nova-compute[74337]: DEBUG oslo.service.loopingcall [None req-f0ec9dfb-6f88-4120-adf5-4c2a6e041e3b tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74337) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 21:50:21 user nova-compute[74337]: DEBUG nova.compute.manager [-] [instance: 31cee1d7-a0f9-4909-b4e4-4513584f9ce2] Deallocating network for instance {{(pid=74337) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 21:50:21 user nova-compute[74337]: DEBUG nova.network.neutron [-] [instance: 31cee1d7-a0f9-4909-b4e4-4513584f9ce2] deallocate_for_instance() {{(pid=74337) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 21:50:21 user nova-compute[74337]: DEBUG nova.network.neutron [-] [instance: 31cee1d7-a0f9-4909-b4e4-4513584f9ce2] Updating instance_info_cache with network_info: [] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:50:21 user nova-compute[74337]: INFO nova.compute.manager [-] [instance: 31cee1d7-a0f9-4909-b4e4-4513584f9ce2] Took 0.49 seconds to deallocate network for instance.
Oct 23 21:50:21 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-f0ec9dfb-6f88-4120-adf5-4c2a6e041e3b tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:50:21 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-f0ec9dfb-6f88-4120-adf5-4c2a6e041e3b tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:50:21 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-f0ec9dfb-6f88-4120-adf5-4c2a6e041e3b tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:50:21 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-f0ec9dfb-6f88-4120-adf5-4c2a6e041e3b tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:50:21 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-f0ec9dfb-6f88-4120-adf5-4c2a6e041e3b tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.313s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:50:21 user nova-compute[74337]: INFO nova.scheduler.client.report [None req-f0ec9dfb-6f88-4120-adf5-4c2a6e041e3b tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] Deleted allocations for instance 31cee1d7-a0f9-4909-b4e4-4513584f9ce2
Oct 23 21:50:22 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-f0ec9dfb-6f88-4120-adf5-4c2a6e041e3b tempest-VolumesNegativeTest-1848392112 tempest-VolumesNegativeTest-1848392112-project-member] Lock "31cee1d7-a0f9-4909-b4e4-4513584f9ce2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.670s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:50:22 user nova-compute[74337]: DEBUG nova.compute.manager [req-9e57d108-1b7c-4278-ac86-d5bbdbfd3ad4 req-c7b24184-527a-41f6-b46d-1188e6090c9f service nova] [instance: 31cee1d7-a0f9-4909-b4e4-4513584f9ce2] Received event network-vif-plugged-0dab73f8-3c29-4332-8f12-e3989869b1e0 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:50:22 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-9e57d108-1b7c-4278-ac86-d5bbdbfd3ad4 req-c7b24184-527a-41f6-b46d-1188e6090c9f service nova] Acquiring lock "31cee1d7-a0f9-4909-b4e4-4513584f9ce2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:50:22 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-9e57d108-1b7c-4278-ac86-d5bbdbfd3ad4 req-c7b24184-527a-41f6-b46d-1188e6090c9f service nova] Lock "31cee1d7-a0f9-4909-b4e4-4513584f9ce2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:50:22 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-9e57d108-1b7c-4278-ac86-d5bbdbfd3ad4 req-c7b24184-527a-41f6-b46d-1188e6090c9f service nova] Lock "31cee1d7-a0f9-4909-b4e4-4513584f9ce2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:50:22 user nova-compute[74337]: DEBUG nova.compute.manager [req-9e57d108-1b7c-4278-ac86-d5bbdbfd3ad4 req-c7b24184-527a-41f6-b46d-1188e6090c9f service nova] [instance: 31cee1d7-a0f9-4909-b4e4-4513584f9ce2] No waiting events found dispatching network-vif-plugged-0dab73f8-3c29-4332-8f12-e3989869b1e0 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:50:22 user nova-compute[74337]: WARNING nova.compute.manager [req-9e57d108-1b7c-4278-ac86-d5bbdbfd3ad4 req-c7b24184-527a-41f6-b46d-1188e6090c9f service nova] [instance: 31cee1d7-a0f9-4909-b4e4-4513584f9ce2] Received unexpected event network-vif-plugged-0dab73f8-3c29-4332-8f12-e3989869b1e0 for instance with vm_state deleted and task_state None.
Oct 23 21:50:22 user nova-compute[74337]: DEBUG nova.compute.manager [req-9e57d108-1b7c-4278-ac86-d5bbdbfd3ad4 req-c7b24184-527a-41f6-b46d-1188e6090c9f service nova] [instance: 31cee1d7-a0f9-4909-b4e4-4513584f9ce2] Received event network-vif-deleted-0dab73f8-3c29-4332-8f12-e3989869b1e0 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:50:22 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:50:23 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Acquiring lock "bf53e0fc-71d1-48fa-b0b4-ed3400a21c38" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:50:23 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lock "bf53e0fc-71d1-48fa-b0b4-ed3400a21c38" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:50:23 user nova-compute[74337]: DEBUG nova.compute.manager [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] Starting instance... {{(pid=74337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 21:50:23 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:50:23 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:50:23 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 21:50:23 user nova-compute[74337]: INFO nova.compute.claims [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] Claim successful on node user
Oct 23 21:50:23 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:50:23 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:50:23 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:50:23 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.355s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:50:23 user nova-compute[74337]: DEBUG nova.compute.manager [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] Start building networks asynchronously for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 21:50:24 user nova-compute[74337]: DEBUG nova.compute.manager [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] Allocating IP information in the background. {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 21:50:24 user nova-compute[74337]: DEBUG nova.network.neutron [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] allocate_for_instance() {{(pid=74337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 21:50:24 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 21:50:24 user nova-compute[74337]: DEBUG nova.compute.manager [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] Start building block device mappings for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 21:50:24 user nova-compute[74337]: DEBUG nova.policy [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a2e424dd3c684c808de14c2a9c3c1ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b85c4f783a4ee7ab67422b49da85ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74337) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 21:50:24 user nova-compute[74337]: INFO nova.virt.block_device [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] Booting with volume-backed-image d859d89d-998d-4109-b26a-0d6e28152932 at /dev/vda
Oct 23 21:50:24 user nova-compute[74337]: DEBUG nova.network.neutron [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] Successfully created port: d8fa8fea-2adc-42e9-9d0c-cbcbfe43db80 {{(pid=74337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 21:50:25 user nova-compute[74337]: DEBUG nova.network.neutron [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] Successfully updated port: d8fa8fea-2adc-42e9-9d0c-cbcbfe43db80 {{(pid=74337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 21:50:25 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Acquiring lock "refresh_cache-bf53e0fc-71d1-48fa-b0b4-ed3400a21c38" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:50:25 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Acquired lock "refresh_cache-bf53e0fc-71d1-48fa-b0b4-ed3400a21c38" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:50:25 user nova-compute[74337]: DEBUG nova.network.neutron [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] Building network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 21:50:25 user nova-compute[74337]: DEBUG nova.compute.manager [req-8d65439f-0b60-4578-a044-3d375c252652 req-42c96238-fb96-4efb-afec-57a15b3e8030 service nova] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] Received event network-changed-d8fa8fea-2adc-42e9-9d0c-cbcbfe43db80 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:50:25 user nova-compute[74337]: DEBUG nova.compute.manager [req-8d65439f-0b60-4578-a044-3d375c252652 req-42c96238-fb96-4efb-afec-57a15b3e8030 service nova] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] Refreshing instance network info cache due to event network-changed-d8fa8fea-2adc-42e9-9d0c-cbcbfe43db80. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 21:50:25 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-8d65439f-0b60-4578-a044-3d375c252652 req-42c96238-fb96-4efb-afec-57a15b3e8030 service nova] Acquiring lock "refresh_cache-bf53e0fc-71d1-48fa-b0b4-ed3400a21c38" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:50:25 user nova-compute[74337]: DEBUG nova.network.neutron [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] Instance cache missing network info. {{(pid=74337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 21:50:25 user nova-compute[74337]: DEBUG nova.network.neutron [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] Updating instance_info_cache with network_info: [{"id": "d8fa8fea-2adc-42e9-9d0c-cbcbfe43db80", "address": "fa:16:3e:0f:95:9c", "network": {"id": "5f62b1d8-d5d0-4ff9-922b-fc6e72fb640d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-655282105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b85c4f783a4ee7ab67422b49da85ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8fa8fea-2a", "ovs_interfaceid": "d8fa8fea-2adc-42e9-9d0c-cbcbfe43db80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:50:25 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Releasing lock "refresh_cache-bf53e0fc-71d1-48fa-b0b4-ed3400a21c38" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:50:25 user nova-compute[74337]: DEBUG nova.compute.manager [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] Instance network_info: |[{"id": "d8fa8fea-2adc-42e9-9d0c-cbcbfe43db80", "address": "fa:16:3e:0f:95:9c", "network": {"id": "5f62b1d8-d5d0-4ff9-922b-fc6e72fb640d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-655282105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b85c4f783a4ee7ab67422b49da85ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8fa8fea-2a", "ovs_interfaceid": "d8fa8fea-2adc-42e9-9d0c-cbcbfe43db80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 21:50:25 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-8d65439f-0b60-4578-a044-3d375c252652 req-42c96238-fb96-4efb-afec-57a15b3e8030 service nova] Acquired lock "refresh_cache-bf53e0fc-71d1-48fa-b0b4-ed3400a21c38" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:50:25 user nova-compute[74337]: DEBUG nova.network.neutron [req-8d65439f-0b60-4578-a044-3d375c252652 req-42c96238-fb96-4efb-afec-57a15b3e8030 service nova] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] Refreshing network info cache for port d8fa8fea-2adc-42e9-9d0c-cbcbfe43db80 {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 21:50:26 user nova-compute[74337]: DEBUG nova.network.neutron [req-8d65439f-0b60-4578-a044-3d375c252652 req-42c96238-fb96-4efb-afec-57a15b3e8030 service nova] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] Updated VIF entry in instance network info cache for port d8fa8fea-2adc-42e9-9d0c-cbcbfe43db80. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 21:50:26 user nova-compute[74337]: DEBUG nova.network.neutron [req-8d65439f-0b60-4578-a044-3d375c252652 req-42c96238-fb96-4efb-afec-57a15b3e8030 service nova] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] Updating instance_info_cache with network_info: [{"id": "d8fa8fea-2adc-42e9-9d0c-cbcbfe43db80", "address": "fa:16:3e:0f:95:9c", "network": {"id": "5f62b1d8-d5d0-4ff9-922b-fc6e72fb640d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-655282105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b85c4f783a4ee7ab67422b49da85ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8fa8fea-2a", "ovs_interfaceid": "d8fa8fea-2adc-42e9-9d0c-cbcbfe43db80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:50:26 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-8d65439f-0b60-4578-a044-3d375c252652 req-42c96238-fb96-4efb-afec-57a15b3e8030 service nova] Releasing lock "refresh_cache-bf53e0fc-71d1-48fa-b0b4-ed3400a21c38" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:50:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:50:31 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:50:33 user nova-compute[74337]: DEBUG nova.compute.manager [req-c630b8fe-4391-4e69-b9f7-0545fdd5522e req-69d4681d-b723-48da-bd0a-9509559cdb13 service nova] [instance: 9ecb4d1d-d6a1-403a-af40-3a1a10688b5c] Received event network-changed-0b036b4e-3790-465a-b3d6-40d387634064 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:50:33 user nova-compute[74337]: DEBUG nova.compute.manager [req-c630b8fe-4391-4e69-b9f7-0545fdd5522e req-69d4681d-b723-48da-bd0a-9509559cdb13 service nova] [instance: 9ecb4d1d-d6a1-403a-af40-3a1a10688b5c] Refreshing instance network info cache due to event network-changed-0b036b4e-3790-465a-b3d6-40d387634064. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 21:50:33 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-c630b8fe-4391-4e69-b9f7-0545fdd5522e req-69d4681d-b723-48da-bd0a-9509559cdb13 service nova] Acquiring lock "refresh_cache-9ecb4d1d-d6a1-403a-af40-3a1a10688b5c" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:50:33 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-c630b8fe-4391-4e69-b9f7-0545fdd5522e req-69d4681d-b723-48da-bd0a-9509559cdb13 service nova] Acquired lock "refresh_cache-9ecb4d1d-d6a1-403a-af40-3a1a10688b5c" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:50:33 user nova-compute[74337]: DEBUG nova.network.neutron [req-c630b8fe-4391-4e69-b9f7-0545fdd5522e req-69d4681d-b723-48da-bd0a-9509559cdb13 service nova] [instance: 9ecb4d1d-d6a1-403a-af40-3a1a10688b5c] Refreshing network info cache for port 0b036b4e-3790-465a-b3d6-40d387634064 {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 21:50:33 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:50:33 user nova-compute[74337]: DEBUG nova.network.neutron [req-c630b8fe-4391-4e69-b9f7-0545fdd5522e req-69d4681d-b723-48da-bd0a-9509559cdb13 service nova] [instance: 9ecb4d1d-d6a1-403a-af40-3a1a10688b5c] Updated VIF entry in instance network info cache for port 0b036b4e-3790-465a-b3d6-40d387634064. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 21:50:33 user nova-compute[74337]: DEBUG nova.network.neutron [req-c630b8fe-4391-4e69-b9f7-0545fdd5522e req-69d4681d-b723-48da-bd0a-9509559cdb13 service nova] [instance: 9ecb4d1d-d6a1-403a-af40-3a1a10688b5c] Updating instance_info_cache with network_info: [{"id": "0b036b4e-3790-465a-b3d6-40d387634064", "address": "fa:16:3e:af:78:38", "network": {"id": "787d9979-63ad-4318-b1d7-8ec69c5969fe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1847253864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84a25b3eed8548a5a324e55b28f26252", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b036b4e-37", "ovs_interfaceid": "0b036b4e-3790-465a-b3d6-40d387634064", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:50:34 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-c630b8fe-4391-4e69-b9f7-0545fdd5522e req-69d4681d-b723-48da-bd0a-9509559cdb13 service nova] Releasing lock "refresh_cache-9ecb4d1d-d6a1-403a-af40-3a1a10688b5c" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:50:36 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:50:38 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:50:39 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-8a5c5822-ee70-43f2-a856-e9aa5e0050d3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Acquiring lock "9ecb4d1d-d6a1-403a-af40-3a1a10688b5c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:50:39 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-8a5c5822-ee70-43f2-a856-e9aa5e0050d3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lock "9ecb4d1d-d6a1-403a-af40-3a1a10688b5c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:50:39 user nova-compute[74337]: DEBUG nova.objects.instance [None req-8a5c5822-ee70-43f2-a856-e9aa5e0050d3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lazy-loading 'flavor' on Instance uuid 9ecb4d1d-d6a1-403a-af40-3a1a10688b5c {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:50:39 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-8a5c5822-ee70-43f2-a856-e9aa5e0050d3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lock "9ecb4d1d-d6a1-403a-af40-3a1a10688b5c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:50:39 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-8a5c5822-ee70-43f2-a856-e9aa5e0050d3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Acquiring lock "9ecb4d1d-d6a1-403a-af40-3a1a10688b5c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:50:39 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-8a5c5822-ee70-43f2-a856-e9aa5e0050d3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lock "9ecb4d1d-d6a1-403a-af40-3a1a10688b5c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:50:39 user nova-compute[74337]: INFO nova.compute.manager [None req-8a5c5822-ee70-43f2-a856-e9aa5e0050d3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 9ecb4d1d-d6a1-403a-af40-3a1a10688b5c] Attaching volume 8d983176-92da-468f-ba7e-71d1060ba742 to /dev/vdb
Oct 23 21:50:39 user nova-compute[74337]: DEBUG os_brick.utils [None req-8a5c5822-ee70-43f2-a856-e9aa5e0050d3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:50:39 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:50:39 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:50:39 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[54a33b9d-90fc-413f-bf4b-b2157b373091]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f34011b66e40\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:50:39 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:50:39 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:50:39 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba2b7fd2-2baa-4045-9b14-969c4c7390e3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:50:39 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:50:39 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:50:39 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e1022fd-3d17-433e-9617-8e8610dcea7f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:50:39 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[190442b7-3d0d-4ed9-9b05-a8626594816c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:50:39 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-8a5c5822-ee70-43f2-a856-e9aa5e0050d3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Running cmd (subprocess): nvme version {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:50:39 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-8a5c5822-ee70-43f2-a856-e9aa5e0050d3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] 'nvme version' failed. Not Retrying. {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 21:50:39 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8a5c5822-ee70-43f2-a856-e9aa5e0050d3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] nvme not present on system {{(pid=74337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 21:50:39 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:50:39 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 21:50:39 user nova-compute[74337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 21:50:39 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[7854df79-6202-429d-bd29-86edc609f076]: (4, '') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:50:39 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-8a5c5822-ee70-43f2-a856-e9aa5e0050d3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 21:50:39 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-8a5c5822-ee70-43f2-a856-e9aa5e0050d3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 21:50:39 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-8a5c5822-ee70-43f2-a856-e9aa5e0050d3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] LIGHTOS: no hostnqn found. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 21:50:39 user nova-compute[74337]: DEBUG os_brick.utils [None req-8a5c5822-ee70-43f2-a856-e9aa5e0050d3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f34011b66e40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:50:39 user nova-compute[74337]: DEBUG nova.virt.block_device [None req-8a5c5822-ee70-43f2-a856-e9aa5e0050d3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 9ecb4d1d-d6a1-403a-af40-3a1a10688b5c] Updating existing volume attachment record: 1b209dea-f507-4042-991e-4aa3986f08ad {{(pid=74337) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 21:50:39 user nova-compute[74337]: DEBUG os_brick.utils [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:50:39 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:50:39 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:50:39 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[823182f1-4a1a-4ee1-9f6b-51846141c3b3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f34011b66e40\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:50:39 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:50:39 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:50:39 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf8249f6-ca0e-434a-aa59-329fa9ec9646]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:50:39 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:50:39 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:50:39 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f7dadf1-e695-44db-a55b-7f9863bc1197]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:50:39 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d614f389-c953-425d-a296-8994a32d4747]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:50:39 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Running cmd (subprocess): nvme version {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:50:40 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] 'nvme version' failed. Not Retrying. {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 21:50:40 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] nvme not present on system {{(pid=74337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 21:50:40 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:50:40 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 21:50:40 user nova-compute[74337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 21:50:40 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[16d89987-4d2b-47ea-a5dc-9a709f23f0b8]: (4, '') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:50:40 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 21:50:40 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 21:50:40 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] LIGHTOS: no hostnqn found. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 21:50:40 user nova-compute[74337]: DEBUG os_brick.utils [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f34011b66e40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:50:40 user nova-compute[74337]: DEBUG nova.virt.block_device [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] Updating existing volume attachment record: 1565ac17-c757-4247-978d-c1bf84ee5e6d {{(pid=74337) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 21:50:41 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:50:43 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:50:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:50:48 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:50:51 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:50:56 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:50:57 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a5c5822-ee70-43f2-a856-e9aa5e0050d3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 9ecb4d1d-d6a1-403a-af40-3a1a10688b5c] Calling os-brick to attach iSCSI Volume {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 21:50:57 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5c5822-ee70-43f2-a856-e9aa5e0050d3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8d983176-92da-468f-ba7e-71d1060ba742', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'okuWLZIf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:50:57 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-8a5c5822-ee70-43f2-a856-e9aa5e0050d3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:50:57 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-8a5c5822-ee70-43f2-a856-e9aa5e0050d3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:50:57 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-8a5c5822-ee70-43f2-a856-e9aa5e0050d3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:50:57 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-8a5c5822-ee70-43f2-a856-e9aa5e0050d3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:50:57 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-8a5c5822-ee70-43f2-a856-e9aa5e0050d3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d983176-92da-468f-ba7e-71d1060ba742" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:50:57 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-8a5c5822-ee70-43f2-a856-e9aa5e0050d3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d983176-92da-468f-ba7e-71d1060ba742" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:50:57 user nova-compute[74337]: INFO os_brick.initiator.connectors.iscsi [None req-8a5c5822-ee70-43f2-a856-e9aa5e0050d3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 21:50:57 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d983176-92da-468f-ba7e-71d1060ba742 -p 172.16.0.220:3260 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:50:57 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d983176-92da-468f-ba7e-71d1060ba742 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:50:57 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[296e6379-9ebe-4fc5-9f24-8cb87c43b33b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:50:57 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5c5822-ee70-43f2-a856-e9aa5e0050d3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 21:50:57 user nova-compute[74337]:  {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:50:57 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d983176-92da-468f-ba7e-71d1060ba742 -p 172.16.0.220:3260 --interface default --op new {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:50:57 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d983176-92da-468f-ba7e-71d1060ba742 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:50:57 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[921a6549-9e1d-4bf6-9998-f8ad7a5dff22]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8d983176-92da-468f-ba7e-71d1060ba742] added\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:50:57 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5c5822-ee70-43f2-a856-e9aa5e0050d3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8d983176-92da-468f-ba7e-71d1060ba742] added
Oct 23 21:50:57 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:50:57 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d983176-92da-468f-ba7e-71d1060ba742 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:50:57 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d983176-92da-468f-ba7e-71d1060ba742 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:50:57 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ad7eac-d9a8-4d71-a5b4-062188a62d99]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:50:57 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5c5822-ee70-43f2-a856-e9aa5e0050d3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:50:57 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d983176-92da-468f-ba7e-71d1060ba742 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:50:57 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d983176-92da-468f-ba7e-71d1060ba742 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:50:57 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[36937d7c-ddc2-40e1-985b-83c1c81fc945]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:50:57 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5c5822-ee70-43f2-a856-e9aa5e0050d3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:50:57 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d983176-92da-468f-ba7e-71d1060ba742 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v okuWLZIf {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:50:57 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d983176-92da-468f-ba7e-71d1060ba742 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v okuWLZIf" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:50:57 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb780d4-c2af-4dee-b981-b758d0ecd681]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:50:57 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5c5822-ee70-43f2-a856-e9aa5e0050d3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'okuWLZIf'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:50:57 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d983176-92da-468f-ba7e-71d1060ba742 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:50:57 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d983176-92da-468f-ba7e-71d1060ba742 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:50:57 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[99eee54c-a2f3-4a32-aa9c-4a0c96b779af]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:50:57 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5c5822-ee70-43f2-a856-e9aa5e0050d3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:50:57 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:50:57 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:50:57 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[87774749-1bc3-425d-9edc-d9b43d45c4eb]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:50:57 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5c5822-ee70-43f2-a856-e9aa5e0050d3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:50:57 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:50:57 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5c5822-ee70-43f2-a856-e9aa5e0050d3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:50:57 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:50:57 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d983176-92da-468f-ba7e-71d1060ba742 -p 172.16.0.220:3260 --login {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:50:57 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d983176-92da-468f-ba7e-71d1060ba742 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:50:57 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5a50e44-d510-4f6b-a7e5-cc89135f4ed0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8d983176-92da-468f-ba7e-71d1060ba742, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8d983176-92da-468f-ba7e-71d1060ba742, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:50:57 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5c5822-ee70-43f2-a856-e9aa5e0050d3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8d983176-92da-468f-ba7e-71d1060ba742, portal: 172.16.0.220,3260]
Oct 23 21:50:57 user nova-compute[74337]: Login to [iface: default, target: iqn.2010-10.org.openstack:8d983176-92da-468f-ba7e-71d1060ba742, portal: 172.16.0.220,3260] successful.
Oct 23 21:50:57 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:50:57 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d983176-92da-468f-ba7e-71d1060ba742 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:50:57 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d983176-92da-468f-ba7e-71d1060ba742 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:50:57 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[946e0380-a4a3-42d3-b79b-48aa01eb0e09]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:50:57 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5c5822-ee70-43f2-a856-e9aa5e0050d3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:50:57 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:50:57 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:50:57 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f0c2286-0344-4792-995b-e0c5be48135a]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d983176-92da-468f-ba7e-71d1060ba742 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:50:57 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5c5822-ee70-43f2-a856-e9aa5e0050d3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:50:57 user nova-compute[74337]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d983176-92da-468f-ba7e-71d1060ba742 (non-flash)
Oct 23 21:50:57 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:50:57 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5c5822-ee70-43f2-a856-e9aa5e0050d3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:50:57 user nova-compute[74337]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d983176-92da-468f-ba7e-71d1060ba742 (non-flash)
Oct 23 21:50:57 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:50:57 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-8a5c5822-ee70-43f2-a856-e9aa5e0050d3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d983176-92da-468f-ba7e-71d1060ba742" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:50:57 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5c5822-ee70-43f2-a856-e9aa5e0050d3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Connected to 172.16.0.220:3260 {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 21:50:57 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-8a5c5822-ee70-43f2-a856-e9aa5e0050d3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] HCTL ('33', '-', '-', 0) found on session 31 with lun 0 {{(pid=74337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 21:50:57 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-8a5c5822-ee70-43f2-a856-e9aa5e0050d3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 21:50:57 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:50:57 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:50:57 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[280df6b2-93dd-490c-9f6c-5559ca9bd2dc]: (4, ('- - 0', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:50:57 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-8a5c5822-ee70-43f2-a856-e9aa5e0050d3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Searching for a device in session 31 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 21:50:57 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5c5822-ee70-43f2-a856-e9aa5e0050d3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8d983176-92da-468f-ba7e-71d1060ba742', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'okuWLZIf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 21:50:57 user nova-compute[74337]: DEBUG nova.compute.manager [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] Start spawning the instance on the hypervisor. {{(pid=74337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 21:50:57 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] Creating instance directory {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 21:50:57 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] Creating image(s)
Oct 23 21:50:57 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] Did not create local disks {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 23 21:50:57 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] Ensure instance console log exists: /opt/stack/data/nova/instances/bf53e0fc-71d1-48fa-b0b4-ed3400a21c38/console.log {{(pid=74337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 21:50:57 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:50:57 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:50:57 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:50:57 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] Start _get_guest_xml network_info=[{"id": "d8fa8fea-2adc-42e9-9d0c-cbcbfe43db80", "address": "fa:16:3e:0f:95:9c", "network": {"id": "5f62b1d8-d5d0-4ff9-922b-fc6e72fb640d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-655282105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b85c4f783a4ee7ab67422b49da85ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8fa8fea-2a", "ovs_interfaceid": "d8fa8fea-2adc-42e9-9d0c-cbcbfe43db80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T21:29:21Z,direct_url=<?>,disk_format='qcow2',id=d859d89d-998d-4109-b26a-0d6e28152932,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ff43462300764979a6cf688444336a56',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T21:29:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '1565ac17-c757-4247-978d-c1bf84ee5e6d', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PKTulDvj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'bf53e0fc-71d1-48fa-b0b4-ed3400a21c38', 'attached_at': '', 'detached_at': '', 'volume_id': 'c55c1f59-3672-4335-8c85-014b490d8b83', 'serial': 'c55c1f59-3672-4335-8c85-014b490d8b83'}, 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 21:50:57 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:50:57 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:50:57 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 21:50:57 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] CPU controller missing on host. {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 21:50:57 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 21:50:57 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] CPU controller found on host. {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 21:50:57 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 21:50:57 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T21:29:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T21:29:21Z,direct_url=<?>,disk_format='qcow2',id=d859d89d-998d-4109-b26a-0d6e28152932,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ff43462300764979a6cf688444336a56',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T21:29:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 21:50:57 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Flavor limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 21:50:57 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Image limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 21:50:57 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Flavor pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 21:50:57 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Image pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 21:50:57 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 21:50:57 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 21:50:57 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 21:50:57 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Got 1 possible topologies {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 21:50:57 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 21:50:57 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 21:50:57 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] Calling os-brick to attach iSCSI Volume {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 21:50:57 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PKTulDvj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:50:57 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:50:57 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:50:58 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-8a5c5822-ee70-43f2-a856-e9aa5e0050d3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:50:58 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5c5822-ee70-43f2-a856-e9aa5e0050d3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '23631636166383435', 'path': '/dev/sdb'} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:50:58 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a5c5822-ee70-43f2-a856-e9aa5e0050d3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 9ecb4d1d-d6a1-403a-af40-3a1a10688b5c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23631636166383435', 'path': '/dev/sdb'} {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 21:50:58 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.765s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:50:58 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:50:58 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:50:58 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:50:58 user nova-compute[74337]: INFO os_brick.initiator.connectors.iscsi [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 21:50:58 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 -p 172.16.0.220:3260 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:50:58 user nova-compute[74337]: DEBUG nova.objects.instance [None req-8a5c5822-ee70-43f2-a856-e9aa5e0050d3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lazy-loading 'flavor' on Instance uuid 9ecb4d1d-d6a1-403a-af40-3a1a10688b5c {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:50:58 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:50:58 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b98d9ac3-bfab-4414-8e60-6f9388201ad7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:50:58 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 21:50:58 user nova-compute[74337]:  {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:50:58 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 -p 172.16.0.220:3260 --interface default --op new {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:50:58 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-8a5c5822-ee70-43f2-a856-e9aa5e0050d3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 21:50:58 user nova-compute[74337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 21:50:58 user nova-compute[74337]:   <source dev="/dev/sdb"/>
Oct 23 21:50:58 user nova-compute[74337]:   <target dev="vdb" bus="virtio"/>
Oct 23 21:50:58 user nova-compute[74337]:   <serial>8d983176-92da-468f-ba7e-71d1060ba742</serial>
Oct 23 21:50:58 user nova-compute[74337]: </disk>
Oct 23 21:50:58 user nova-compute[74337]:  {{(pid=74337) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 21:50:58 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:50:58 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[745444b5-8b8f-4634-acbc-c9bff05fed23]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83] added\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:50:58 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83] added
Oct 23 21:50:58 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:50:58 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:50:58 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:50:58 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b60a90b-41ad-4bc5-98fe-a68e3bc84779]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:50:58 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:50:58 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:50:58 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:50:58 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d384f693-298b-447a-b710-288343d7e7b9]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:50:58 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:50:58 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PKTulDvj {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:50:58 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PKTulDvj" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:50:58 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eff24e3-5b79-4475-a8ce-77de12b0fb48]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:50:58 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PKTulDvj'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:50:58 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:50:58 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:50:58 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ad84ce-e0c6-4a4a-ae48-b5cab1278fe3]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:50:58 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:50:58 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:50:58 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:50:58 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[3028de7a-4b7e-4579-8f91-ac8eeba003d8]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d983176-92da-468f-ba7e-71d1060ba742 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:50:58 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:50:58 user nova-compute[74337]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d983176-92da-468f-ba7e-71d1060ba742 (non-flash)
Oct 23 21:50:58 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:50:58 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:50:58 user nova-compute[74337]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d983176-92da-468f-ba7e-71d1060ba742 (non-flash)
Oct 23 21:50:58 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:50:58 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 -p 172.16.0.220:3260 --login {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:50:58 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:50:58 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b47fc1b-2f69-4506-8d5e-145bdff59d8f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:50:58 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83, portal: 172.16.0.220,3260]
Oct 23 21:50:58 user nova-compute[74337]: Login to [iface: default, target: iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83, portal: 172.16.0.220,3260] successful.
Oct 23 21:50:58 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:50:58 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:50:58 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:50:58 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c91482f6-d68d-4e11-8185-b5c18fe02a09]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:50:58 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:50:58 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:50:58 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:50:58 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[4028f7ba-ef58-4248-bf8d-fa905834ffd4]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d983176-92da-468f-ba7e-71d1060ba742 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:50:58 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:50:58 user nova-compute[74337]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d983176-92da-468f-ba7e-71d1060ba742 (non-flash)
Oct 23 21:50:58 user nova-compute[74337]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 (non-flash)
Oct 23 21:50:58 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:50:58 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:50:58 user nova-compute[74337]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d983176-92da-468f-ba7e-71d1060ba742 (non-flash)
Oct 23 21:50:58 user nova-compute[74337]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 (non-flash)
Oct 23 21:50:58 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:50:58 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:50:58 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Connected to 172.16.0.220:3260 {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 21:50:58 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] HCTL ('35', '-', '-', 0) found on session 32 with lun 0 {{(pid=74337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 21:50:58 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 21:50:58 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:50:58 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:50:58 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e329fe91-f826-4141-aec2-e6969ab3b523]: (4, ('- - 0', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:50:58 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Searching for a device in session 32 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 21:50:58 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PKTulDvj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 21:50:58 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-8a5c5822-ee70-43f2-a856-e9aa5e0050d3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] No BDM found with device name vda, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 21:50:58 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-8a5c5822-ee70-43f2-a856-e9aa5e0050d3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 21:50:58 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-8a5c5822-ee70-43f2-a856-e9aa5e0050d3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] No VIF found with MAC fa:16:3e:af:78:38, not building metadata {{(pid=74337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 21:50:58 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-8a5c5822-ee70-43f2-a856-e9aa5e0050d3 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lock "9ecb4d1d-d6a1-403a-af40-3a1a10688b5c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.434s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:50:59 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:50:59 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:50:59 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] <== connect_volume: return (2059ms) {'type': 'block', 'scsi_wwn': '23438373365306662', 'path': '/dev/sdd'} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:50:59 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23438373365306662', 'path': '/dev/sdd'} {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 21:50:59 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:50:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1154963022',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1154963022',id=30,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83b85c4f783a4ee7ab67422b49da85ca',ramdisk_id='',reservation_id='r-tp3clp60',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1944032280',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:50:24Z,user_data=None,user_id='a2e424dd3c684c808de14c2a9c3c1ed6',uuid=bf53e0fc-71d1-48fa-b0b4-ed3400a21c38,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d8fa8fea-2adc-42e9-9d0c-cbcbfe43db80", "address": "fa:16:3e:0f:95:9c", "network": {"id": "5f62b1d8-d5d0-4ff9-922b-fc6e72fb640d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-655282105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b85c4f783a4ee7ab67422b49da85ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8fa8fea-2a", "ovs_interfaceid": "d8fa8fea-2adc-42e9-9d0c-cbcbfe43db80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 21:50:59 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Converting VIF {"id": "d8fa8fea-2adc-42e9-9d0c-cbcbfe43db80", "address": "fa:16:3e:0f:95:9c", "network": {"id": "5f62b1d8-d5d0-4ff9-922b-fc6e72fb640d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-655282105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b85c4f783a4ee7ab67422b49da85ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8fa8fea-2a", "ovs_interfaceid": "d8fa8fea-2adc-42e9-9d0c-cbcbfe43db80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:50:59 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:95:9c,bridge_name='br-int',has_traffic_filtering=True,id=d8fa8fea-2adc-42e9-9d0c-cbcbfe43db80,network=Network(5f62b1d8-d5d0-4ff9-922b-fc6e72fb640d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8fa8fea-2a') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:50:59 user nova-compute[74337]: DEBUG nova.objects.instance [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lazy-loading 'pci_devices' on Instance uuid bf53e0fc-71d1-48fa-b0b4-ed3400a21c38 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:50:59 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] End _get_guest_xml xml=<domain type="kvm">
Oct 23 21:50:59 user nova-compute[74337]:   <uuid>bf53e0fc-71d1-48fa-b0b4-ed3400a21c38</uuid>
Oct 23 21:50:59 user nova-compute[74337]:   <name>instance-0000001e</name>
Oct 23 21:50:59 user nova-compute[74337]:   <memory>524288</memory>
Oct 23 21:50:59 user nova-compute[74337]:   <vcpu>1</vcpu>
Oct 23 21:50:59 user nova-compute[74337]:   <metadata>
Oct 23 21:50:59 user nova-compute[74337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 21:50:59 user nova-compute[74337]:       <nova:package version="0.0.0"/>
Oct 23 21:50:59 user nova-compute[74337]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1154963022</nova:name>
Oct 23 21:50:59 user nova-compute[74337]:       <nova:creationTime>2023-10-23 21:50:57</nova:creationTime>
Oct 23 21:50:59 user nova-compute[74337]:       <nova:flavor name="m1.tiny">
Oct 23 21:50:59 user nova-compute[74337]:         <nova:memory>512</nova:memory>
Oct 23 21:50:59 user nova-compute[74337]:         <nova:disk>1</nova:disk>
Oct 23 21:50:59 user nova-compute[74337]:         <nova:swap>0</nova:swap>
Oct 23 21:50:59 user nova-compute[74337]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 21:50:59 user nova-compute[74337]:         <nova:vcpus>1</nova:vcpus>
Oct 23 21:50:59 user nova-compute[74337]:       </nova:flavor>
Oct 23 21:50:59 user nova-compute[74337]:       <nova:owner>
Oct 23 21:50:59 user nova-compute[74337]:         <nova:user uuid="a2e424dd3c684c808de14c2a9c3c1ed6">tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member</nova:user>
Oct 23 21:50:59 user nova-compute[74337]:         <nova:project uuid="83b85c4f783a4ee7ab67422b49da85ca">tempest-ServerBootFromVolumeStableRescueTest-1944032280</nova:project>
Oct 23 21:50:59 user nova-compute[74337]:       </nova:owner>
Oct 23 21:50:59 user nova-compute[74337]:       <nova:root type="image" uuid="d859d89d-998d-4109-b26a-0d6e28152932"/>
Oct 23 21:50:59 user nova-compute[74337]:       <nova:ports>
Oct 23 21:50:59 user nova-compute[74337]:         <nova:port uuid="d8fa8fea-2adc-42e9-9d0c-cbcbfe43db80">
Oct 23 21:50:59 user nova-compute[74337]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 23 21:50:59 user nova-compute[74337]:         </nova:port>
Oct 23 21:50:59 user nova-compute[74337]:       </nova:ports>
Oct 23 21:50:59 user nova-compute[74337]:     </nova:instance>
Oct 23 21:50:59 user nova-compute[74337]:   </metadata>
Oct 23 21:50:59 user nova-compute[74337]:   <sysinfo type="smbios">
Oct 23 21:50:59 user nova-compute[74337]:     <system>
Oct 23 21:50:59 user nova-compute[74337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 21:50:59 user nova-compute[74337]:       <entry name="product">OpenStack Nova</entry>
Oct 23 21:50:59 user nova-compute[74337]:       <entry name="version">0.0.0</entry>
Oct 23 21:50:59 user nova-compute[74337]:       <entry name="serial">bf53e0fc-71d1-48fa-b0b4-ed3400a21c38</entry>
Oct 23 21:50:59 user nova-compute[74337]:       <entry name="uuid">bf53e0fc-71d1-48fa-b0b4-ed3400a21c38</entry>
Oct 23 21:50:59 user nova-compute[74337]:       <entry name="family">Virtual Machine</entry>
Oct 23 21:50:59 user nova-compute[74337]:     </system>
Oct 23 21:50:59 user nova-compute[74337]:   </sysinfo>
Oct 23 21:50:59 user nova-compute[74337]:   <os>
Oct 23 21:50:59 user nova-compute[74337]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 21:50:59 user nova-compute[74337]:     <boot dev="hd"/>
Oct 23 21:50:59 user nova-compute[74337]:     <smbios mode="sysinfo"/>
Oct 23 21:50:59 user nova-compute[74337]:   </os>
Oct 23 21:50:59 user nova-compute[74337]:   <features>
Oct 23 21:50:59 user nova-compute[74337]:     <acpi/>
Oct 23 21:50:59 user nova-compute[74337]:     <apic/>
Oct 23 21:50:59 user nova-compute[74337]:     <vmcoreinfo/>
Oct 23 21:50:59 user nova-compute[74337]:   </features>
Oct 23 21:50:59 user nova-compute[74337]:   <clock offset="utc">
Oct 23 21:50:59 user nova-compute[74337]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 21:50:59 user nova-compute[74337]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 21:50:59 user nova-compute[74337]:     <timer name="hpet" present="no"/>
Oct 23 21:50:59 user nova-compute[74337]:   </clock>
Oct 23 21:50:59 user nova-compute[74337]:   <cpu mode="custom" match="exact">
Oct 23 21:50:59 user nova-compute[74337]:     <model>Nehalem</model>
Oct 23 21:50:59 user nova-compute[74337]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 21:50:59 user nova-compute[74337]:   </cpu>
Oct 23 21:50:59 user nova-compute[74337]:   <devices>
Oct 23 21:50:59 user nova-compute[74337]:     <disk type="block" device="disk">
Oct 23 21:50:59 user nova-compute[74337]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 21:50:59 user nova-compute[74337]:       <source dev="/dev/sdd"/>
Oct 23 21:50:59 user nova-compute[74337]:       <target dev="vda" bus="virtio"/>
Oct 23 21:50:59 user nova-compute[74337]:       <serial>c55c1f59-3672-4335-8c85-014b490d8b83</serial>
Oct 23 21:50:59 user nova-compute[74337]:     </disk>
Oct 23 21:50:59 user nova-compute[74337]:     <interface type="ethernet">
Oct 23 21:50:59 user nova-compute[74337]:       <mac address="fa:16:3e:0f:95:9c"/>
Oct 23 21:50:59 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:50:59 user nova-compute[74337]:       <mtu size="1442"/>
Oct 23 21:50:59 user nova-compute[74337]:       <target dev="tapd8fa8fea-2a"/>
Oct 23 21:50:59 user nova-compute[74337]:     </interface>
Oct 23 21:50:59 user nova-compute[74337]:     <serial type="pty">
Oct 23 21:50:59 user nova-compute[74337]:       <log file="/opt/stack/data/nova/instances/bf53e0fc-71d1-48fa-b0b4-ed3400a21c38/console.log" append="off"/>
Oct 23 21:50:59 user nova-compute[74337]:     </serial>
Oct 23 21:50:59 user nova-compute[74337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 21:50:59 user nova-compute[74337]:     <video>
Oct 23 21:50:59 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:50:59 user nova-compute[74337]:     </video>
Oct 23 21:50:59 user nova-compute[74337]:     <rng model="virtio">
Oct 23 21:50:59 user nova-compute[74337]:       <backend model="random">/dev/urandom</backend>
Oct 23 21:50:59 user nova-compute[74337]:     </rng>
Oct 23 21:50:59 user nova-compute[74337]:     <controller type="usb" index="0" model="none"/>
Oct 23 21:50:59 user nova-compute[74337]:     <memballoon model="virtio">
Oct 23 21:50:59 user nova-compute[74337]:       <stats period="10"/>
Oct 23 21:50:59 user nova-compute[74337]:     </memballoon>
Oct 23 21:50:59 user nova-compute[74337]:   </devices>
Oct 23 21:50:59 user nova-compute[74337]: </domain>
Oct 23 21:50:59 user nova-compute[74337]:  {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 21:50:59 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:50:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1154963022',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1154963022',id=30,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83b85c4f783a4ee7ab67422b49da85ca',ramdisk_id='',reservation_id='r-tp3clp60',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1944032280',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:50:24Z,user_data=None,user_id='a2e424dd3c684c808de14c2a9c3c1ed6',uuid=bf53e0fc-71d1-48fa-b0b4-ed3400a21c38,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d8fa8fea-2adc-42e9-9d0c-cbcbfe43db80", "address": "fa:16:3e:0f:95:9c", "network": {"id": "5f62b1d8-d5d0-4ff9-922b-fc6e72fb640d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-655282105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b85c4f783a4ee7ab67422b49da85ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8fa8fea-2a", "ovs_interfaceid": "d8fa8fea-2adc-42e9-9d0c-cbcbfe43db80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 21:50:59 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Converting VIF {"id": "d8fa8fea-2adc-42e9-9d0c-cbcbfe43db80", "address": "fa:16:3e:0f:95:9c", "network": {"id": "5f62b1d8-d5d0-4ff9-922b-fc6e72fb640d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-655282105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b85c4f783a4ee7ab67422b49da85ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8fa8fea-2a", "ovs_interfaceid": "d8fa8fea-2adc-42e9-9d0c-cbcbfe43db80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:50:59 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:95:9c,bridge_name='br-int',has_traffic_filtering=True,id=d8fa8fea-2adc-42e9-9d0c-cbcbfe43db80,network=Network(5f62b1d8-d5d0-4ff9-922b-fc6e72fb640d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8fa8fea-2a') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:50:59 user nova-compute[74337]: DEBUG os_vif [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:95:9c,bridge_name='br-int',has_traffic_filtering=True,id=d8fa8fea-2adc-42e9-9d0c-cbcbfe43db80,network=Network(5f62b1d8-d5d0-4ff9-922b-fc6e72fb640d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8fa8fea-2a') {{(pid=74337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 21:50:59 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:50:59 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:50:59 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 21:50:59 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:50:59 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f43dea8f-718f-5f2d-ab95-5ccb93da2dff', '_type': 'linux-noop'}}, row=False) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:50:59 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:50:59 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:50:59 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:50:59 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd8fa8fea-2a, may_exist=True, interface_attrs={}) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:50:59 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd8fa8fea-2a, col_values=(('qos', UUID('de69da94-7614-46d8-b64c-886fd4c4821f')),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:50:59 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd8fa8fea-2a, col_values=(('external_ids', {'iface-id': 'd8fa8fea-2adc-42e9-9d0c-cbcbfe43db80', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0f:95:9c', 'vm-uuid': 'bf53e0fc-71d1-48fa-b0b4-ed3400a21c38'}),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:50:59 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:50:59 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:50:59 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:50:59 user nova-compute[74337]: INFO os_vif [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:95:9c,bridge_name='br-int',has_traffic_filtering=True,id=d8fa8fea-2adc-42e9-9d0c-cbcbfe43db80,network=Network(5f62b1d8-d5d0-4ff9-922b-fc6e72fb640d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8fa8fea-2a')
Oct 23 21:50:59 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] No BDM found with device name vda, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 21:50:59 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] No VIF found with MAC fa:16:3e:0f:95:9c, not building metadata {{(pid=74337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 21:51:00 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-1909388a-0723-435a-a622-338c8d060cb1 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Acquiring lock "9ecb4d1d-d6a1-403a-af40-3a1a10688b5c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:51:00 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-1909388a-0723-435a-a622-338c8d060cb1 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lock "9ecb4d1d-d6a1-403a-af40-3a1a10688b5c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:51:00 user nova-compute[74337]: INFO nova.compute.manager [None req-1909388a-0723-435a-a622-338c8d060cb1 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 9ecb4d1d-d6a1-403a-af40-3a1a10688b5c] Detaching volume 8d983176-92da-468f-ba7e-71d1060ba742
Oct 23 21:51:00 user nova-compute[74337]: INFO nova.virt.block_device [None req-1909388a-0723-435a-a622-338c8d060cb1 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 9ecb4d1d-d6a1-403a-af40-3a1a10688b5c] Attempting to driver detach volume 8d983176-92da-468f-ba7e-71d1060ba742 from mountpoint /dev/vdb
Oct 23 21:51:00 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-1909388a-0723-435a-a622-338c8d060cb1 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Attempting to detach device vdb from instance 9ecb4d1d-d6a1-403a-af40-3a1a10688b5c from the persistent domain config. {{(pid=74337) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 21:51:00 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-1909388a-0723-435a-a622-338c8d060cb1 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 21:51:00 user nova-compute[74337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 21:51:00 user nova-compute[74337]:   <source dev="/dev/sdb"/>
Oct 23 21:51:00 user nova-compute[74337]:   <target dev="vdb" bus="virtio"/>
Oct 23 21:51:00 user nova-compute[74337]:   <serial>8d983176-92da-468f-ba7e-71d1060ba742</serial>
Oct 23 21:51:00 user nova-compute[74337]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 21:51:00 user nova-compute[74337]: </disk>
Oct 23 21:51:00 user nova-compute[74337]:  {{(pid=74337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 21:51:00 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-1909388a-0723-435a-a622-338c8d060cb1 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Successfully detached device vdb from instance 9ecb4d1d-d6a1-403a-af40-3a1a10688b5c from the persistent domain config.
Oct 23 21:51:00 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-1909388a-0723-435a-a622-338c8d060cb1 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9ecb4d1d-d6a1-403a-af40-3a1a10688b5c from the live domain config. {{(pid=74337) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 21:51:00 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-1909388a-0723-435a-a622-338c8d060cb1 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 21:51:00 user nova-compute[74337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 21:51:00 user nova-compute[74337]:   <source dev="/dev/sdb"/>
Oct 23 21:51:00 user nova-compute[74337]:   <target dev="vdb" bus="virtio"/>
Oct 23 21:51:00 user nova-compute[74337]:   <serial>8d983176-92da-468f-ba7e-71d1060ba742</serial>
Oct 23 21:51:00 user nova-compute[74337]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 21:51:00 user nova-compute[74337]: </disk>
Oct 23 21:51:00 user nova-compute[74337]:  {{(pid=74337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 21:51:01 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-1909388a-0723-435a-a622-338c8d060cb1 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9ecb4d1d-d6a1-403a-af40-3a1a10688b5c {{(pid=74337) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 21:51:01 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:51:01 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:51:01 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:51:01 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:51:01 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:51:01 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:51:01 user nova-compute[74337]: DEBUG nova.compute.manager [req-b6d2a2b4-20f8-4706-b924-d8481ab37582 req-ac921fc3-3647-4b62-ad10-e99140d52d2b service nova] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] Received event network-vif-plugged-d8fa8fea-2adc-42e9-9d0c-cbcbfe43db80 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:51:01 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-b6d2a2b4-20f8-4706-b924-d8481ab37582 req-ac921fc3-3647-4b62-ad10-e99140d52d2b service nova] Acquiring lock "bf53e0fc-71d1-48fa-b0b4-ed3400a21c38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:51:01 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-b6d2a2b4-20f8-4706-b924-d8481ab37582 req-ac921fc3-3647-4b62-ad10-e99140d52d2b service nova] Lock "bf53e0fc-71d1-48fa-b0b4-ed3400a21c38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:51:01 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-b6d2a2b4-20f8-4706-b924-d8481ab37582 req-ac921fc3-3647-4b62-ad10-e99140d52d2b service nova] Lock "bf53e0fc-71d1-48fa-b0b4-ed3400a21c38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:51:01 user nova-compute[74337]: DEBUG nova.compute.manager [req-b6d2a2b4-20f8-4706-b924-d8481ab37582 req-ac921fc3-3647-4b62-ad10-e99140d52d2b service nova] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] No waiting events found dispatching network-vif-plugged-d8fa8fea-2adc-42e9-9d0c-cbcbfe43db80 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:51:01 user nova-compute[74337]: WARNING nova.compute.manager [req-b6d2a2b4-20f8-4706-b924-d8481ab37582 req-ac921fc3-3647-4b62-ad10-e99140d52d2b service nova] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] Received unexpected event network-vif-plugged-d8fa8fea-2adc-42e9-9d0c-cbcbfe43db80 for instance with vm_state building and task_state spawning.
Oct 23 21:51:03 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:51:03 user nova-compute[74337]: DEBUG nova.compute.manager [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] Instance event wait completed in 0 seconds for  {{(pid=74337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 21:51:03 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] Guest created on hypervisor {{(pid=74337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 21:51:03 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] Instance spawned successfully.
Oct 23 21:51:03 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 21:51:03 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] Found default for hw_cdrom_bus of ide {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:51:03 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] Found default for hw_disk_bus of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:51:03 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] Found default for hw_input_bus of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:51:03 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] Found default for hw_pointer_model of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:51:03 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] Found default for hw_video_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:51:03 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] Found default for hw_vif_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:51:03 user nova-compute[74337]: INFO nova.compute.manager [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] Took 6.32 seconds to spawn the instance on the hypervisor.
Oct 23 21:51:03 user nova-compute[74337]: DEBUG nova.compute.manager [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] Checking state {{(pid=74337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 21:51:03 user nova-compute[74337]: INFO nova.compute.manager [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] Took 40.38 seconds to build instance.
Oct 23 21:51:03 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-57fe4357-36ee-4fd8-98f7-3a8680334c58 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lock "bf53e0fc-71d1-48fa-b0b4-ed3400a21c38" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 40.481s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:51:04 user nova-compute[74337]: DEBUG nova.compute.manager [req-842a89f9-fd70-4f1f-beaf-a4d16e0b42e1 req-94df30c8-9771-4821-b730-84e7ec13a68c service nova] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] Received event network-vif-plugged-d8fa8fea-2adc-42e9-9d0c-cbcbfe43db80 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:51:04 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-842a89f9-fd70-4f1f-beaf-a4d16e0b42e1 req-94df30c8-9771-4821-b730-84e7ec13a68c service nova] Acquiring lock "bf53e0fc-71d1-48fa-b0b4-ed3400a21c38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:51:04 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-842a89f9-fd70-4f1f-beaf-a4d16e0b42e1 req-94df30c8-9771-4821-b730-84e7ec13a68c service nova] Lock "bf53e0fc-71d1-48fa-b0b4-ed3400a21c38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:51:04 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-842a89f9-fd70-4f1f-beaf-a4d16e0b42e1 req-94df30c8-9771-4821-b730-84e7ec13a68c service nova] Lock "bf53e0fc-71d1-48fa-b0b4-ed3400a21c38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:51:04 user nova-compute[74337]: DEBUG nova.compute.manager [req-842a89f9-fd70-4f1f-beaf-a4d16e0b42e1 req-94df30c8-9771-4821-b730-84e7ec13a68c service nova] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] No waiting events found dispatching network-vif-plugged-d8fa8fea-2adc-42e9-9d0c-cbcbfe43db80 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:51:04 user nova-compute[74337]: WARNING nova.compute.manager [req-842a89f9-fd70-4f1f-beaf-a4d16e0b42e1 req-94df30c8-9771-4821-b730-84e7ec13a68c service nova] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] Received unexpected event network-vif-plugged-d8fa8fea-2adc-42e9-9d0c-cbcbfe43db80 for instance with vm_state active and task_state None.
Oct 23 21:51:04 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:51:07 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:51:07 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 21:51:08 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:51:08 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:51:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:51:09 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:51:09 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:51:09 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Starting heal instance info cache {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 21:51:09 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Didn't find any instances for network info cache update. {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 23 21:51:09 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:51:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:51:14 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:51:14 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:51:14 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:51:17 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:51:17 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:51:17 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:51:17 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:51:17 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Auditing locally available compute resources for user (node: user) {{(pid=74337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 21:51:17 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 21:51:17 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56a4b932-486d-4b8d-9616-99e75592432a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:51:17 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56a4b932-486d-4b8d-9616-99e75592432a/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:51:17 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56a4b932-486d-4b8d-9616-99e75592432a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:51:18 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56a4b932-486d-4b8d-9616-99e75592432a/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:51:18 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/547c4d4c-e0dd-495a-b83f-98426d0a4a99/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:51:18 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/547c4d4c-e0dd-495a-b83f-98426d0a4a99/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:51:18 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/547c4d4c-e0dd-495a-b83f-98426d0a4a99/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:51:18 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/547c4d4c-e0dd-495a-b83f-98426d0a4a99/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:51:18 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 21:51:18 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e05fd36-ee44-4992-80a9-f95af608b9f5/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:51:18 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:51:18 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e05fd36-ee44-4992-80a9-f95af608b9f5/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:51:18 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e05fd36-ee44-4992-80a9-f95af608b9f5/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:51:18 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e05fd36-ee44-4992-80a9-f95af608b9f5/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:51:18 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ecb4d1d-d6a1-403a-af40-3a1a10688b5c/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:51:19 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ecb4d1d-d6a1-403a-af40-3a1a10688b5c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:51:19 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ecb4d1d-d6a1-403a-af40-3a1a10688b5c/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:51:19 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ecb4d1d-d6a1-403a-af40-3a1a10688b5c/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:51:19 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1189976f-8d02-468d-8fa7-bd5594c5f85a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:51:19 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1189976f-8d02-468d-8fa7-bd5594c5f85a/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:51:19 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1189976f-8d02-468d-8fa7-bd5594c5f85a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:51:19 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1189976f-8d02-468d-8fa7-bd5594c5f85a/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:51:20 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:51:20 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Acquiring lock "0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:51:20 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:51:20 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:51:20 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:51:20 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Hypervisor/Node resource view: name=user free_ram=8163MB free_disk=25.27898406982422GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 21:51:20 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:51:20 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:51:20 user nova-compute[74337]: DEBUG nova.compute.manager [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b] Starting instance... {{(pid=74337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 21:51:20 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:51:20 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 1189976f-8d02-468d-8fa7-bd5594c5f85a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:51:20 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 547c4d4c-e0dd-495a-b83f-98426d0a4a99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:51:20 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 00f757cf-e5dd-476f-81c6-670ed2bf6938 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Oct 23 21:51:20 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 56a4b932-486d-4b8d-9616-99e75592432a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:51:20 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:51:20 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 1e05fd36-ee44-4992-80a9-f95af608b9f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:51:20 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 9ecb4d1d-d6a1-403a-af40-3a1a10688b5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:51:20 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance bf53e0fc-71d1-48fa-b0b4-ed3400a21c38 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:51:20 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Oct 23 21:51:20 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 21:51:20 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 21:51:20 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:51:21 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:51:21 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Compute_service record updated for user:user {{(pid=74337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 21:51:21 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.514s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:51:21 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.395s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:51:21 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 21:51:21 user nova-compute[74337]: INFO nova.compute.claims [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b] Claim successful on node user
Oct 23 21:51:21 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-1909388a-0723-435a-a622-338c8d060cb1 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9ecb4d1d-d6a1-403a-af40-3a1a10688b5c is timed out.
Oct 23 21:51:21 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-1909388a-0723-435a-a622-338c8d060cb1 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Successfully detached device vdb from instance 9ecb4d1d-d6a1-403a-af40-3a1a10688b5c from the live domain config.
Oct 23 21:51:21 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1909388a-0723-435a-a622-338c8d060cb1 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 9ecb4d1d-d6a1-403a-af40-3a1a10688b5c] calling os-brick to detach iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 21:51:21 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-1909388a-0723-435a-a622-338c8d060cb1 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, {'target_iqn': 'iqn.2010-10.org.openstack:8d983176-92da-468f-ba7e-71d1060ba742', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'okuWLZIf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:51:21 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-1909388a-0723-435a-a622-338c8d060cb1 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:51:21 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-1909388a-0723-435a-a622-338c8d060cb1 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:51:21 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-1909388a-0723-435a-a622-338c8d060cb1 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:51:21 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:51:21 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:51:21 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe95363a-a264-43f8-b087-e7d61f01ff1f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8d983176-92da-468f-ba7e-71d1060ba742\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:51:21 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-1909388a-0723-435a-a622-338c8d060cb1 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 21:51:21 user nova-compute[74337]: No targets found.
Oct 23 21:51:21 user nova-compute[74337]: iSNS:
Oct 23 21:51:21 user nova-compute[74337]: No targets found.
Oct 23 21:51:21 user nova-compute[74337]: STATIC:
Oct 23 21:51:21 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83
Oct 23 21:51:21 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:51:21 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:51:21 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:8d983176-92da-468f-ba7e-71d1060ba742
Oct 23 21:51:21 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:51:21 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:51:21 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4
Oct 23 21:51:21 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:51:21 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:51:21 user nova-compute[74337]: FIRMWARE:
Oct 23 21:51:21 user nova-compute[74337]: No targets found.
Oct 23 21:51:21 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:51:21 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-1909388a-0723-435a-a622-338c8d060cb1 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 21:51:21 user nova-compute[74337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 21:51:21 user nova-compute[74337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 21:51:21 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-1909388a-0723-435a-a622-338c8d060cb1 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d983176-92da-468f-ba7e-71d1060ba742', 0)] {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 21:51:21 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:51:21 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:51:21 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e9628ec-fe1d-4544-a1bf-eedc64456724]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d983176-92da-468f-ba7e-71d1060ba742\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:51:21 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:51:21 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:51:21 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a09d1794-3dda-4621-8554-a873638b696a]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d983176-92da-468f-ba7e-71d1060ba742 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:51:21 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-1909388a-0723-435a-a622-338c8d060cb1 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:51:21 user nova-compute[74337]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d983176-92da-468f-ba7e-71d1060ba742 (non-flash)
Oct 23 21:51:21 user nova-compute[74337]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 (non-flash)
Oct 23 21:51:21 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:51:21 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-1909388a-0723-435a-a622-338c8d060cb1 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:51:21 user nova-compute[74337]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d983176-92da-468f-ba7e-71d1060ba742 (non-flash)
Oct 23 21:51:21 user nova-compute[74337]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 (non-flash)
Oct 23 21:51:21 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:51:21 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-1909388a-0723-435a-a622-338c8d060cb1 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5ef428acb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d983176-92da-468f-ba7e-71d1060ba742'): ({'sdb'}, set())}) {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 21:51:21 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-1909388a-0723-435a-a622-338c8d060cb1 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Removing single pathed devices sdb {{(pid=74337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 21:51:21 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:51:21 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:51:21 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c566092-9069-4e90-872f-fce5c5661c0c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:51:21 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:51:21 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.026s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:51:21 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b809212a-32ba-4a2f-af35-efd2409f6f76]: (4, ('ok\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:51:21 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-1909388a-0723-435a-a622-338c8d060cb1 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Flushing IO for device /dev/sdb {{(pid=74337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 21:51:21 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:51:21 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:51:21 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b995b94-92e1-426e-a861-6567af8378a5]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:51:21 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-1909388a-0723-435a-a622-338c8d060cb1 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 21:51:21 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:51:21 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:51:21 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:51:21 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.034s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:51:21 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[52186e74-5667-4b1d-a1a5-2410539d9f44]: (4, ('1', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:51:21 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-1909388a-0723-435a-a622-338c8d060cb1 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 21:51:21 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-1909388a-0723-435a-a622-338c8d060cb1 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] SCSI volumes sdb have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 21:51:21 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-1909388a-0723-435a-a622-338c8d060cb1 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d983176-92da-468f-ba7e-71d1060ba742')] {{(pid=74337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 21:51:21 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d983176-92da-468f-ba7e-71d1060ba742 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:51:21 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.426s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:51:21 user nova-compute[74337]: DEBUG nova.compute.manager [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b] Start building networks asynchronously for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 21:51:21 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d983176-92da-468f-ba7e-71d1060ba742 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:51:21 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[9772f75c-0122-4964-aa37-eebb93360ad6]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:51:21 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-1909388a-0723-435a-a622-338c8d060cb1 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:51:21 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d983176-92da-468f-ba7e-71d1060ba742 -p 172.16.0.220:3260 --logout {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:51:21 user nova-compute[74337]: DEBUG nova.compute.manager [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b] Allocating IP information in the background. {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 21:51:21 user nova-compute[74337]: DEBUG nova.network.neutron [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b] allocate_for_instance() {{(pid=74337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 21:51:21 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d983176-92da-468f-ba7e-71d1060ba742 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:51:21 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[2935482a-dc92-456a-96bb-0b583921ff71]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:8d983176-92da-468f-ba7e-71d1060ba742, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:8d983176-92da-468f-ba7e-71d1060ba742, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:51:21 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-1909388a-0723-435a-a622-338c8d060cb1 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:8d983176-92da-468f-ba7e-71d1060ba742, portal: 172.16.0.220,3260]
Oct 23 21:51:21 user nova-compute[74337]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:8d983176-92da-468f-ba7e-71d1060ba742, portal: 172.16.0.220,3260] successful.
Oct 23 21:51:21 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:51:21 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d983176-92da-468f-ba7e-71d1060ba742 -p 172.16.0.220:3260 --op delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:51:21 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 21:51:21 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d983176-92da-468f-ba7e-71d1060ba742 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:51:21 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3487287-0664-48ef-ae1e-0e00ab3c420d]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:51:21 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-1909388a-0723-435a-a622-338c8d060cb1 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:51:21 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-1909388a-0723-435a-a622-338c8d060cb1 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:51:21 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-1909388a-0723-435a-a622-338c8d060cb1 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] <== disconnect_volume: return (337ms) None {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:51:21 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1909388a-0723-435a-a622-338c8d060cb1 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 9ecb4d1d-d6a1-403a-af40-3a1a10688b5c] Disconnected iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 21:51:21 user nova-compute[74337]: DEBUG nova.compute.manager [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b] Start building block device mappings for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 21:51:21 user nova-compute[74337]: DEBUG nova.policy [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0c3e635e8e5447138a7f2db11695574c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb567547bd4941fb87435a841c9d17c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74337) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 21:51:21 user nova-compute[74337]: INFO nova.virt.block_device [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b] Booting with volume b016c715-febf-41d9-bc8f-2ffbf5bf3048 at /dev/vda
Oct 23 21:51:21 user nova-compute[74337]: DEBUG os_brick.utils [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:51:21 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:51:21 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:51:21 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[73818e57-dc96-40cf-af47-9542392ffa2d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f34011b66e40\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:51:21 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:51:21 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:51:21 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a46a2f80-4061-4368-bd16-a589ba0d1364]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:51:21 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:51:21 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:51:21 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[9098227b-5ef1-4e83-9e4c-1f9bf4e179ae]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:51:21 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c610b7f4-e5fa-428c-982d-aebc29ae5346]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:51:21 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Running cmd (subprocess): nvme version {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:51:21 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] 'nvme version' failed. Not Retrying. {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 21:51:21 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] nvme not present on system {{(pid=74337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 21:51:21 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:51:21 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 21:51:21 user nova-compute[74337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 21:51:21 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a52e30fb-5565-48cf-ae8c-6913a7635e37]: (4, '') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:51:21 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 21:51:21 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 21:51:21 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] LIGHTOS: no hostnqn found. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 21:51:21 user nova-compute[74337]: DEBUG os_brick.utils [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f34011b66e40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:51:21 user nova-compute[74337]: DEBUG nova.virt.block_device [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b] Updating existing volume attachment record: ea6e0ba9-ff07-42a9-9f70-603aedaacfd4 {{(pid=74337) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 21:51:22 user nova-compute[74337]: DEBUG nova.network.neutron [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b] Successfully created port: e15964dc-04e9-4b21-947c-2de7ed87e0ba {{(pid=74337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 21:51:22 user nova-compute[74337]: DEBUG nova.objects.instance [None req-1909388a-0723-435a-a622-338c8d060cb1 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lazy-loading 'flavor' on Instance uuid 9ecb4d1d-d6a1-403a-af40-3a1a10688b5c {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:51:22 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-1909388a-0723-435a-a622-338c8d060cb1 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lock "9ecb4d1d-d6a1-403a-af40-3a1a10688b5c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.319s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:51:23 user nova-compute[74337]: DEBUG nova.network.neutron [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b] Successfully updated port: e15964dc-04e9-4b21-947c-2de7ed87e0ba {{(pid=74337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 21:51:23 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Acquiring lock "refresh_cache-0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:51:23 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Acquired lock "refresh_cache-0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:51:23 user nova-compute[74337]: DEBUG nova.network.neutron [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b] Building network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 21:51:23 user nova-compute[74337]: DEBUG nova.compute.manager [req-0dc54e5f-a9f5-460e-87c0-5f9e3f0df19f req-bf1a40f3-a1f9-484b-8375-766d8b4a2bee service nova] [instance: 0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b] Received event network-changed-e15964dc-04e9-4b21-947c-2de7ed87e0ba {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:51:23 user nova-compute[74337]: DEBUG nova.compute.manager [req-0dc54e5f-a9f5-460e-87c0-5f9e3f0df19f req-bf1a40f3-a1f9-484b-8375-766d8b4a2bee service nova] [instance: 0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b] Refreshing instance network info cache due to event network-changed-e15964dc-04e9-4b21-947c-2de7ed87e0ba. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 21:51:23 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-0dc54e5f-a9f5-460e-87c0-5f9e3f0df19f req-bf1a40f3-a1f9-484b-8375-766d8b4a2bee service nova] Acquiring lock "refresh_cache-0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:51:23 user nova-compute[74337]: DEBUG nova.network.neutron [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b] Instance cache missing network info. {{(pid=74337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 21:51:23 user nova-compute[74337]: DEBUG nova.network.neutron [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b] Updating instance_info_cache with network_info: [{"id": "e15964dc-04e9-4b21-947c-2de7ed87e0ba", "address": "fa:16:3e:72:6e:20", "network": {"id": "5a18e96f-a6eb-4989-9be3-154b54928b03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-507511840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb567547bd4941fb87435a841c9d17c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape15964dc-04", "ovs_interfaceid": "e15964dc-04e9-4b21-947c-2de7ed87e0ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:51:23 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Releasing lock "refresh_cache-0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:51:23 user nova-compute[74337]: DEBUG nova.compute.manager [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b] Instance network_info: |[{"id": "e15964dc-04e9-4b21-947c-2de7ed87e0ba", "address": "fa:16:3e:72:6e:20", "network": {"id": "5a18e96f-a6eb-4989-9be3-154b54928b03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-507511840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb567547bd4941fb87435a841c9d17c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape15964dc-04", "ovs_interfaceid": "e15964dc-04e9-4b21-947c-2de7ed87e0ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 21:51:23 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-0dc54e5f-a9f5-460e-87c0-5f9e3f0df19f req-bf1a40f3-a1f9-484b-8375-766d8b4a2bee service nova] Acquired lock "refresh_cache-0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:51:23 user nova-compute[74337]: DEBUG nova.network.neutron [req-0dc54e5f-a9f5-460e-87c0-5f9e3f0df19f req-bf1a40f3-a1f9-484b-8375-766d8b4a2bee service nova] [instance: 0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b] Refreshing network info cache for port e15964dc-04e9-4b21-947c-2de7ed87e0ba {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 21:51:23 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:51:23 user nova-compute[74337]: DEBUG nova.network.neutron [req-0dc54e5f-a9f5-460e-87c0-5f9e3f0df19f req-bf1a40f3-a1f9-484b-8375-766d8b4a2bee service nova] [instance: 0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b] Updated VIF entry in instance network info cache for port e15964dc-04e9-4b21-947c-2de7ed87e0ba. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 21:51:23 user nova-compute[74337]: DEBUG nova.network.neutron [req-0dc54e5f-a9f5-460e-87c0-5f9e3f0df19f req-bf1a40f3-a1f9-484b-8375-766d8b4a2bee service nova] [instance: 0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b] Updating instance_info_cache with network_info: [{"id": "e15964dc-04e9-4b21-947c-2de7ed87e0ba", "address": "fa:16:3e:72:6e:20", "network": {"id": "5a18e96f-a6eb-4989-9be3-154b54928b03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-507511840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb567547bd4941fb87435a841c9d17c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape15964dc-04", "ovs_interfaceid": "e15964dc-04e9-4b21-947c-2de7ed87e0ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:51:23 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-0dc54e5f-a9f5-460e-87c0-5f9e3f0df19f req-bf1a40f3-a1f9-484b-8375-766d8b4a2bee service nova] Releasing lock "refresh_cache-0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:51:24 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:51:25 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:51:28 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:51:30 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:51:33 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Acquiring lock "86f56afb-77e6-4378-b441-5cf507a0fbe7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:51:33 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lock "86f56afb-77e6-4378-b441-5cf507a0fbe7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:51:33 user nova-compute[74337]: DEBUG nova.compute.manager [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Starting instance... {{(pid=74337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 21:51:33 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:51:33 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:51:33 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 21:51:33 user nova-compute[74337]: INFO nova.compute.claims [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Claim successful on node user
Oct 23 21:51:33 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:51:34 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:51:34 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:51:34 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.426s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:51:34 user nova-compute[74337]: DEBUG nova.compute.manager [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Start building networks asynchronously for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 21:51:34 user nova-compute[74337]: DEBUG nova.compute.manager [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Allocating IP information in the background. {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 21:51:34 user nova-compute[74337]: DEBUG nova.network.neutron [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] allocate_for_instance() {{(pid=74337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 21:51:34 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 21:51:34 user nova-compute[74337]: DEBUG nova.compute.manager [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Start building block device mappings for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 21:51:34 user nova-compute[74337]: DEBUG nova.policy [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '891ee2e3acc54ed0bc4571f63ff491a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f57e58a9ec4c6384dc0d3ca58eb610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74337) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 21:51:34 user nova-compute[74337]: INFO nova.virt.block_device [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Booting with volume ec6df319-3945-4eda-a0b9-7c351eaf4398 at /dev/vda
Oct 23 21:51:34 user nova-compute[74337]: DEBUG os_brick.utils [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:51:34 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:51:34 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:51:34 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c6f68e-850a-4e64-8fc0-086e49d2455f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f34011b66e40\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:51:34 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:51:34 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:51:34 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a9a45f-d08d-4df3-b565-6ceebcaba555]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:51:34 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:51:34 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:51:34 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d98931c-dd0c-4625-bb25-344300aa9176]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:51:34 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1be3616-cdc4-4ed2-b002-aaef6224de08]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:51:34 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Running cmd (subprocess): nvme version {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:51:34 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] 'nvme version' failed. Not Retrying. {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 21:51:34 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] nvme not present on system {{(pid=74337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 21:51:34 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:51:34 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 21:51:34 user nova-compute[74337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 21:51:34 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f87b646-daa6-4c7a-b823-02cf4e2ea978]: (4, '') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:51:34 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 21:51:34 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 21:51:34 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] LIGHTOS: no hostnqn found. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 21:51:34 user nova-compute[74337]: DEBUG os_brick.utils [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f34011b66e40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:51:34 user nova-compute[74337]: DEBUG nova.virt.block_device [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Updating existing volume attachment record: aa914e66-31bd-4d4f-9c53-ad2eca86b949 {{(pid=74337) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 21:51:34 user nova-compute[74337]: DEBUG nova.network.neutron [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Successfully created port: 148d28e8-2783-44a9-a08e-c648f0aa9489 {{(pid=74337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 21:51:35 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:51:35 user nova-compute[74337]: DEBUG nova.network.neutron [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Successfully updated port: 148d28e8-2783-44a9-a08e-c648f0aa9489 {{(pid=74337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 21:51:35 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Acquiring lock "refresh_cache-86f56afb-77e6-4378-b441-5cf507a0fbe7" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:51:35 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Acquired lock "refresh_cache-86f56afb-77e6-4378-b441-5cf507a0fbe7" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:51:35 user nova-compute[74337]: DEBUG nova.network.neutron [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Building network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 21:51:35 user nova-compute[74337]: DEBUG nova.compute.manager [req-7d604333-388b-48c8-b724-81df726e69e1 req-5ea96a41-7e2e-4cc8-bd0d-382424c61aae service nova] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Received event network-changed-148d28e8-2783-44a9-a08e-c648f0aa9489 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:51:35 user nova-compute[74337]: DEBUG nova.compute.manager [req-7d604333-388b-48c8-b724-81df726e69e1 req-5ea96a41-7e2e-4cc8-bd0d-382424c61aae service nova] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Refreshing instance network info cache due to event network-changed-148d28e8-2783-44a9-a08e-c648f0aa9489. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 21:51:35 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-7d604333-388b-48c8-b724-81df726e69e1 req-5ea96a41-7e2e-4cc8-bd0d-382424c61aae service nova] Acquiring lock "refresh_cache-86f56afb-77e6-4378-b441-5cf507a0fbe7" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:51:35 user nova-compute[74337]: DEBUG nova.network.neutron [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Instance cache missing network info. {{(pid=74337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 21:51:36 user nova-compute[74337]: DEBUG nova.network.neutron [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Updating instance_info_cache with network_info: [{"id": "148d28e8-2783-44a9-a08e-c648f0aa9489", "address": "fa:16:3e:47:98:97", "network": {"id": "aff1f95f-fda8-4f0f-8d10-7e3d587e4fda", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2048135647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1f57e58a9ec4c6384dc0d3ca58eb610", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap148d28e8-27", "ovs_interfaceid": "148d28e8-2783-44a9-a08e-c648f0aa9489", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:51:36 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Releasing lock "refresh_cache-86f56afb-77e6-4378-b441-5cf507a0fbe7" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:51:36 user nova-compute[74337]: DEBUG nova.compute.manager [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Instance network_info: |[{"id": "148d28e8-2783-44a9-a08e-c648f0aa9489", "address": "fa:16:3e:47:98:97", "network": {"id": "aff1f95f-fda8-4f0f-8d10-7e3d587e4fda", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2048135647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1f57e58a9ec4c6384dc0d3ca58eb610", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap148d28e8-27", "ovs_interfaceid": "148d28e8-2783-44a9-a08e-c648f0aa9489", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 21:51:36 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-7d604333-388b-48c8-b724-81df726e69e1 req-5ea96a41-7e2e-4cc8-bd0d-382424c61aae service nova] Acquired lock "refresh_cache-86f56afb-77e6-4378-b441-5cf507a0fbe7" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:51:36 user nova-compute[74337]: DEBUG nova.network.neutron [req-7d604333-388b-48c8-b724-81df726e69e1 req-5ea96a41-7e2e-4cc8-bd0d-382424c61aae service nova] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Refreshing network info cache for port 148d28e8-2783-44a9-a08e-c648f0aa9489 {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 21:51:36 user nova-compute[74337]: DEBUG nova.network.neutron [req-7d604333-388b-48c8-b724-81df726e69e1 req-5ea96a41-7e2e-4cc8-bd0d-382424c61aae service nova] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Updated VIF entry in instance network info cache for port 148d28e8-2783-44a9-a08e-c648f0aa9489. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 21:51:36 user nova-compute[74337]: DEBUG nova.network.neutron [req-7d604333-388b-48c8-b724-81df726e69e1 req-5ea96a41-7e2e-4cc8-bd0d-382424c61aae service nova] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Updating instance_info_cache with network_info: [{"id": "148d28e8-2783-44a9-a08e-c648f0aa9489", "address": "fa:16:3e:47:98:97", "network": {"id": "aff1f95f-fda8-4f0f-8d10-7e3d587e4fda", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2048135647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1f57e58a9ec4c6384dc0d3ca58eb610", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap148d28e8-27", "ovs_interfaceid": "148d28e8-2783-44a9-a08e-c648f0aa9489", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:51:36 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-7d604333-388b-48c8-b724-81df726e69e1 req-5ea96a41-7e2e-4cc8-bd0d-382424c61aae service nova] Releasing lock "refresh_cache-86f56afb-77e6-4378-b441-5cf507a0fbe7" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:51:38 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:51:39 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-8caf848f-eb3c-4fae-a477-b5fb5aff81eb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Acquiring lock "56a4b932-486d-4b8d-9616-99e75592432a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:51:39 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-8caf848f-eb3c-4fae-a477-b5fb5aff81eb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lock "56a4b932-486d-4b8d-9616-99e75592432a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:51:39 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-8caf848f-eb3c-4fae-a477-b5fb5aff81eb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Acquiring lock "56a4b932-486d-4b8d-9616-99e75592432a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:51:39 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-8caf848f-eb3c-4fae-a477-b5fb5aff81eb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lock "56a4b932-486d-4b8d-9616-99e75592432a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:51:39 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-8caf848f-eb3c-4fae-a477-b5fb5aff81eb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lock "56a4b932-486d-4b8d-9616-99e75592432a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:51:39 user nova-compute[74337]: INFO nova.compute.manager [None req-8caf848f-eb3c-4fae-a477-b5fb5aff81eb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Terminating instance
Oct 23 21:51:39 user nova-compute[74337]: DEBUG nova.compute.manager [None req-8caf848f-eb3c-4fae-a477-b5fb5aff81eb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Start destroying the instance on the hypervisor. {{(pid=74337) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 21:51:39 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:51:39 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:51:39 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:51:39 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:51:39 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:51:39 user nova-compute[74337]: DEBUG nova.compute.manager [req-b399ae1d-f647-456b-b44c-8a966b4f48d5 req-1c3c9047-89f6-4840-9801-84acb29f0bf5 service nova] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Received event network-vif-unplugged-5df71ce2-a116-44b3-856b-c0de0da5dcd6 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:51:39 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-b399ae1d-f647-456b-b44c-8a966b4f48d5 req-1c3c9047-89f6-4840-9801-84acb29f0bf5 service nova] Acquiring lock "56a4b932-486d-4b8d-9616-99e75592432a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:51:39 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-b399ae1d-f647-456b-b44c-8a966b4f48d5 req-1c3c9047-89f6-4840-9801-84acb29f0bf5 service nova] Lock "56a4b932-486d-4b8d-9616-99e75592432a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:51:39 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-b399ae1d-f647-456b-b44c-8a966b4f48d5 req-1c3c9047-89f6-4840-9801-84acb29f0bf5 service nova] Lock "56a4b932-486d-4b8d-9616-99e75592432a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:51:39 user nova-compute[74337]: DEBUG nova.compute.manager [req-b399ae1d-f647-456b-b44c-8a966b4f48d5 req-1c3c9047-89f6-4840-9801-84acb29f0bf5 service nova] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] No waiting events found dispatching network-vif-unplugged-5df71ce2-a116-44b3-856b-c0de0da5dcd6 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:51:39 user nova-compute[74337]: DEBUG nova.compute.manager [req-b399ae1d-f647-456b-b44c-8a966b4f48d5 req-1c3c9047-89f6-4840-9801-84acb29f0bf5 service nova] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Received event network-vif-unplugged-5df71ce2-a116-44b3-856b-c0de0da5dcd6 for instance with task_state deleting. {{(pid=74337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 21:51:39 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Instance destroyed successfully.
Oct 23 21:51:39 user nova-compute[74337]: DEBUG nova.objects.instance [None req-8caf848f-eb3c-4fae-a477-b5fb5aff81eb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lazy-loading 'resources' on Instance uuid 56a4b932-486d-4b8d-9616-99e75592432a {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:51:39 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-8caf848f-eb3c-4fae-a477-b5fb5aff81eb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:41:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1348448759',display_name='tempest-AttachVolumeTestJSON-server-1348448759',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1348448759',id=18,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOSyI2UfSbOjGClrd6s5yGjykCHAlq4p3VgQcvKHgSPXIAoK0vvVLu+A6LT9ePnSPyc9urTg/MN9ZHJ02yogPWhYeBoMR8cfZQeMkKqZLPuaXXx5keLozdFismgRTGZYug==',key_name='tempest-keypair-1796008721',keypairs=<?>,launch_index=0,launched_at=2023-10-23T21:41:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b96dc585a51343db94529e22adbd6ef3',ramdisk_id='',reservation_id='r-ydiij502',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-786463768',owner_user_name='tempest-AttachVolumeTestJSON-786463768-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T21:49:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c82d267bc4d142f8b48c66ffab721618',uuid=56a4b932-486d-4b8d-9616-99e75592432a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5df71ce2-a116-44b3-856b-c0de0da5dcd6", "address": "fa:16:3e:20:cc:6f", "network": {"id": "fe0a9f00-e17b-4064-96d2-fd1cc848afb2", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1294741219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96dc585a51343db94529e22adbd6ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5df71ce2-a1", "ovs_interfaceid": "5df71ce2-a116-44b3-856b-c0de0da5dcd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 21:51:39 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-8caf848f-eb3c-4fae-a477-b5fb5aff81eb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Converting VIF {"id": "5df71ce2-a116-44b3-856b-c0de0da5dcd6", "address": "fa:16:3e:20:cc:6f", "network": {"id": "fe0a9f00-e17b-4064-96d2-fd1cc848afb2", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1294741219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96dc585a51343db94529e22adbd6ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5df71ce2-a1", "ovs_interfaceid": "5df71ce2-a116-44b3-856b-c0de0da5dcd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:51:39 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-8caf848f-eb3c-4fae-a477-b5fb5aff81eb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:cc:6f,bridge_name='br-int',has_traffic_filtering=True,id=5df71ce2-a116-44b3-856b-c0de0da5dcd6,network=Network(fe0a9f00-e17b-4064-96d2-fd1cc848afb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5df71ce2-a1') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:51:39 user nova-compute[74337]: DEBUG os_vif [None req-8caf848f-eb3c-4fae-a477-b5fb5aff81eb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:cc:6f,bridge_name='br-int',has_traffic_filtering=True,id=5df71ce2-a116-44b3-856b-c0de0da5dcd6,network=Network(fe0a9f00-e17b-4064-96d2-fd1cc848afb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5df71ce2-a1') {{(pid=74337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 21:51:39 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:51:39 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5df71ce2-a1, bridge=br-int, if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:51:39 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:51:39 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:51:39 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:51:39 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4e697609-c4c5-4fdc-988b-f066e0bc8d50) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:51:39 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:51:39 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:51:39 user nova-compute[74337]: INFO os_vif [None req-8caf848f-eb3c-4fae-a477-b5fb5aff81eb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:cc:6f,bridge_name='br-int',has_traffic_filtering=True,id=5df71ce2-a116-44b3-856b-c0de0da5dcd6,network=Network(fe0a9f00-e17b-4064-96d2-fd1cc848afb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5df71ce2-a1')
Oct 23 21:51:39 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-8caf848f-eb3c-4fae-a477-b5fb5aff81eb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Deleting instance files /opt/stack/data/nova/instances/56a4b932-486d-4b8d-9616-99e75592432a_del
Oct 23 21:51:39 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-8caf848f-eb3c-4fae-a477-b5fb5aff81eb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Deletion of /opt/stack/data/nova/instances/56a4b932-486d-4b8d-9616-99e75592432a_del complete
Oct 23 21:51:40 user nova-compute[74337]: INFO nova.compute.manager [None req-8caf848f-eb3c-4fae-a477-b5fb5aff81eb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Took 0.90 seconds to destroy the instance on the hypervisor.
Oct 23 21:51:40 user nova-compute[74337]: DEBUG oslo.service.loopingcall [None req-8caf848f-eb3c-4fae-a477-b5fb5aff81eb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74337) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 21:51:40 user nova-compute[74337]: DEBUG nova.compute.manager [-] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Deallocating network for instance {{(pid=74337) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 21:51:40 user nova-compute[74337]: DEBUG nova.network.neutron [-] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] deallocate_for_instance() {{(pid=74337) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 21:51:40 user nova-compute[74337]: DEBUG nova.network.neutron [-] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Updating instance_info_cache with network_info: [] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:51:40 user nova-compute[74337]: INFO nova.compute.manager [-] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Took 0.86 seconds to deallocate network for instance.
Oct 23 21:51:40 user nova-compute[74337]: DEBUG nova.compute.manager [req-098f77a9-df80-4112-bcd4-170cfed27be1 req-01229e45-9109-4711-948a-22129997148a service nova] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Received event network-vif-deleted-5df71ce2-a116-44b3-856b-c0de0da5dcd6 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:51:40 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-8caf848f-eb3c-4fae-a477-b5fb5aff81eb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:51:40 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-8caf848f-eb3c-4fae-a477-b5fb5aff81eb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:51:41 user nova-compute[74337]: DEBUG nova.compute.manager [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b] Start spawning the instance on the hypervisor. {{(pid=74337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 21:51:41 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b] Creating instance directory {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 21:51:41 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b] Creating image(s)
Oct 23 21:51:41 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b] Did not create local disks {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 23 21:51:41 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b] Ensure instance console log exists: /opt/stack/data/nova/instances/0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b/console.log {{(pid=74337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 21:51:41 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:51:41 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:51:41 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:51:41 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b] Start _get_guest_xml network_info=[{"id": "e15964dc-04e9-4b21-947c-2de7ed87e0ba", "address": "fa:16:3e:72:6e:20", "network": {"id": "5a18e96f-a6eb-4989-9be3-154b54928b03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-507511840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb567547bd4941fb87435a841c9d17c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape15964dc-04", "ovs_interfaceid": "e15964dc-04e9-4b21-947c-2de7ed87e0ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'ea6e0ba9-ff07-42a9-9f70-603aedaacfd4', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MQuLsncZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b', 'attached_at': '', 'detached_at': '', 'volume_id': 'b016c715-febf-41d9-bc8f-2ffbf5bf3048', 'serial': 'b016c715-febf-41d9-bc8f-2ffbf5bf3048'}, 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 21:51:41 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:51:41 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:51:41 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 21:51:41 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] CPU controller missing on host. {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 21:51:41 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 21:51:41 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] CPU controller found on host. {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 21:51:41 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 21:51:41 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T21:29:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 21:51:41 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Flavor limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 21:51:41 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Image limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 21:51:41 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Flavor pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 21:51:41 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Image pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 21:51:41 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 21:51:41 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 21:51:41 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 21:51:41 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Got 1 possible topologies {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 21:51:41 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 21:51:41 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 21:51:41 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b] Calling os-brick to attach iSCSI Volume {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 21:51:41 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MQuLsncZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:51:41 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:51:41 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:51:41 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:51:41 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:51:41 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:51:41 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:51:41 user nova-compute[74337]: INFO os_brick.initiator.connectors.iscsi [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 21:51:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 -p 172.16.0.220:3260 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:51:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:51:41 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[77174ef8-3980-4e9f-acda-91cc0daa642c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:51:41 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 21:51:41 user nova-compute[74337]:  {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:51:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 -p 172.16.0.220:3260 --interface default --op new {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:51:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:51:41 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[578ddef4-f6cd-4ae8-9378-b857a3fe4dad]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048] added\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:51:41 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048] added
Oct 23 21:51:41 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:51:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:51:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.155s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:51:41 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[3796f27e-3096-477f-95fd-ff76cea8b840]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:51:41 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:51:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:51:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:51:41 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b81f1516-211c-49ea-8c54-59aafa690ee1]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:51:41 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:51:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MQuLsncZ {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:51:41 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-8caf848f-eb3c-4fae-a477-b5fb5aff81eb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:51:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MQuLsncZ" returned: 0 in 0.026s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:51:41 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d08545c-72a0-4b32-a1b7-853a8a1ad940]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:51:41 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MQuLsncZ'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:51:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:51:41 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-8caf848f-eb3c-4fae-a477-b5fb5aff81eb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:51:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:51:41 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ba1a31-ce46-4b3f-af0e-4d89c58ddcee]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:51:41 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:51:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:51:41 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-8caf848f-eb3c-4fae-a477-b5fb5aff81eb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.604s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:51:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:51:41 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[42d61ccc-2110-4a3a-969a-a56a3a7404df]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:51:41 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:51:41 user nova-compute[74337]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 (non-flash)
Oct 23 21:51:41 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:51:41 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:51:41 user nova-compute[74337]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 (non-flash)
Oct 23 21:51:41 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:51:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 -p 172.16.0.220:3260 --login {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:51:41 user nova-compute[74337]: INFO nova.scheduler.client.report [None req-8caf848f-eb3c-4fae-a477-b5fb5aff81eb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Deleted allocations for instance 56a4b932-486d-4b8d-9616-99e75592432a
Oct 23 21:51:41 user nova-compute[74337]: DEBUG nova.compute.manager [req-dcb9cbba-f809-4a23-8dee-43f7ab8a7f72 req-4bb2043d-985b-4696-baec-772d4f9a362f service nova] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Received event network-vif-plugged-5df71ce2-a116-44b3-856b-c0de0da5dcd6 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:51:41 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-dcb9cbba-f809-4a23-8dee-43f7ab8a7f72 req-4bb2043d-985b-4696-baec-772d4f9a362f service nova] Acquiring lock "56a4b932-486d-4b8d-9616-99e75592432a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:51:41 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-dcb9cbba-f809-4a23-8dee-43f7ab8a7f72 req-4bb2043d-985b-4696-baec-772d4f9a362f service nova] Lock "56a4b932-486d-4b8d-9616-99e75592432a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:51:41 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-dcb9cbba-f809-4a23-8dee-43f7ab8a7f72 req-4bb2043d-985b-4696-baec-772d4f9a362f service nova] Lock "56a4b932-486d-4b8d-9616-99e75592432a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:51:41 user nova-compute[74337]: DEBUG nova.compute.manager [req-dcb9cbba-f809-4a23-8dee-43f7ab8a7f72 req-4bb2043d-985b-4696-baec-772d4f9a362f service nova] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] No waiting events found dispatching network-vif-plugged-5df71ce2-a116-44b3-856b-c0de0da5dcd6 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:51:41 user nova-compute[74337]: WARNING nova.compute.manager [req-dcb9cbba-f809-4a23-8dee-43f7ab8a7f72 req-4bb2043d-985b-4696-baec-772d4f9a362f service nova] [instance: 56a4b932-486d-4b8d-9616-99e75592432a] Received unexpected event network-vif-plugged-5df71ce2-a116-44b3-856b-c0de0da5dcd6 for instance with vm_state deleted and task_state None.
Oct 23 21:51:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:51:41 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[44c090a1-7826-4043-aa44-0a54e877ba57]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:51:41 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048, portal: 172.16.0.220,3260]
Oct 23 21:51:41 user nova-compute[74337]: Login to [iface: default, target: iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048, portal: 172.16.0.220,3260] successful.
Oct 23 21:51:41 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:51:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:51:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:51:41 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6adb48e0-a7d8-4eb3-bef5-8963b7b610ed]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:51:41 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:51:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:51:41 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-8caf848f-eb3c-4fae-a477-b5fb5aff81eb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lock "56a4b932-486d-4b8d-9616-99e75592432a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.636s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:51:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:51:41 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf1bfe7-78f0-48c9-b6e4-400d0406f5b7]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:51:41 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:51:41 user nova-compute[74337]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 (non-flash)
Oct 23 21:51:41 user nova-compute[74337]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 (non-flash)
Oct 23 21:51:41 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:51:41 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:51:41 user nova-compute[74337]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 (non-flash)
Oct 23 21:51:41 user nova-compute[74337]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 (non-flash)
Oct 23 21:51:41 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:51:41 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.492s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:51:41 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Connected to 172.16.0.220:3260 {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 21:51:41 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] HCTL ('33', '-', '-', 0) found on session 33 with lun 0 {{(pid=74337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 21:51:41 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 21:51:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:51:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:51:41 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e6118d1-c70b-4552-b6d0-d767e2548ffb]: (4, ('- - 0', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:51:41 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Searching for a device in session 33 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 21:51:41 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MQuLsncZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 21:51:42 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.535s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:51:42 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] <== connect_volume: return (1537ms) {'type': 'block', 'scsi_wwn': '23662306635653666', 'path': '/dev/sdb'} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:51:42 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23662306635653666', 'path': '/dev/sdb'} {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 21:51:42 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:51:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2118733817',display_name='tempest-TestVolumeBootPattern-server-2118733817',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2118733817',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF9NMFNWTU3BVoh69lm2h364CNXP9OO2Sq0+VU67LFY2Y7YP31lo2g7Nqc/sdO6ndxwSu3pXMChCzpRUGVair3TDlV76zriaKktCrpgsBnYg9q7WYnK8Iuk7Ag22Kj7gAw==',key_name='tempest-TestVolumeBootPattern-1223802412',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb567547bd4941fb87435a841c9d17c4',ramdisk_id='',reservation_id='r-0g9813je',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-499971371',owner_user_name='tempest-TestVolumeBootPattern-499971371-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:51:22Z,user_data=None,user_id='0c3e635e8e5447138a7f2db11695574c',uuid=0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e15964dc-04e9-4b21-947c-2de7ed87e0ba", "address": "fa:16:3e:72:6e:20", "network": {"id": "5a18e96f-a6eb-4989-9be3-154b54928b03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-507511840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb567547bd4941fb87435a841c9d17c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape15964dc-04", "ovs_interfaceid": "e15964dc-04e9-4b21-947c-2de7ed87e0ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 21:51:42 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Converting VIF {"id": "e15964dc-04e9-4b21-947c-2de7ed87e0ba", "address": "fa:16:3e:72:6e:20", "network": {"id": "5a18e96f-a6eb-4989-9be3-154b54928b03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-507511840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb567547bd4941fb87435a841c9d17c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape15964dc-04", "ovs_interfaceid": "e15964dc-04e9-4b21-947c-2de7ed87e0ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:51:42 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:6e:20,bridge_name='br-int',has_traffic_filtering=True,id=e15964dc-04e9-4b21-947c-2de7ed87e0ba,network=Network(5a18e96f-a6eb-4989-9be3-154b54928b03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape15964dc-04') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:51:42 user nova-compute[74337]: DEBUG nova.objects.instance [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lazy-loading 'pci_devices' on Instance uuid 0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:51:42 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b] End _get_guest_xml xml=<domain type="kvm">
Oct 23 21:51:42 user nova-compute[74337]:   <uuid>0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b</uuid>
Oct 23 21:51:42 user nova-compute[74337]:   <name>instance-0000001f</name>
Oct 23 21:51:42 user nova-compute[74337]:   <memory>524288</memory>
Oct 23 21:51:42 user nova-compute[74337]:   <vcpu>1</vcpu>
Oct 23 21:51:42 user nova-compute[74337]:   <metadata>
Oct 23 21:51:42 user nova-compute[74337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 21:51:42 user nova-compute[74337]:       <nova:package version="0.0.0"/>
Oct 23 21:51:42 user nova-compute[74337]:       <nova:name>tempest-TestVolumeBootPattern-server-2118733817</nova:name>
Oct 23 21:51:42 user nova-compute[74337]:       <nova:creationTime>2023-10-23 21:51:41</nova:creationTime>
Oct 23 21:51:42 user nova-compute[74337]:       <nova:flavor name="m1.tiny">
Oct 23 21:51:42 user nova-compute[74337]:         <nova:memory>512</nova:memory>
Oct 23 21:51:42 user nova-compute[74337]:         <nova:disk>1</nova:disk>
Oct 23 21:51:42 user nova-compute[74337]:         <nova:swap>0</nova:swap>
Oct 23 21:51:42 user nova-compute[74337]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 21:51:42 user nova-compute[74337]:         <nova:vcpus>1</nova:vcpus>
Oct 23 21:51:42 user nova-compute[74337]:       </nova:flavor>
Oct 23 21:51:42 user nova-compute[74337]:       <nova:owner>
Oct 23 21:51:42 user nova-compute[74337]:         <nova:user uuid="0c3e635e8e5447138a7f2db11695574c">tempest-TestVolumeBootPattern-499971371-project-member</nova:user>
Oct 23 21:51:42 user nova-compute[74337]:         <nova:project uuid="cb567547bd4941fb87435a841c9d17c4">tempest-TestVolumeBootPattern-499971371</nova:project>
Oct 23 21:51:42 user nova-compute[74337]:       </nova:owner>
Oct 23 21:51:42 user nova-compute[74337]:       <nova:ports>
Oct 23 21:51:42 user nova-compute[74337]:         <nova:port uuid="e15964dc-04e9-4b21-947c-2de7ed87e0ba">
Oct 23 21:51:42 user nova-compute[74337]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 23 21:51:42 user nova-compute[74337]:         </nova:port>
Oct 23 21:51:42 user nova-compute[74337]:       </nova:ports>
Oct 23 21:51:42 user nova-compute[74337]:     </nova:instance>
Oct 23 21:51:42 user nova-compute[74337]:   </metadata>
Oct 23 21:51:42 user nova-compute[74337]:   <sysinfo type="smbios">
Oct 23 21:51:42 user nova-compute[74337]:     <system>
Oct 23 21:51:42 user nova-compute[74337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 21:51:42 user nova-compute[74337]:       <entry name="product">OpenStack Nova</entry>
Oct 23 21:51:42 user nova-compute[74337]:       <entry name="version">0.0.0</entry>
Oct 23 21:51:42 user nova-compute[74337]:       <entry name="serial">0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b</entry>
Oct 23 21:51:42 user nova-compute[74337]:       <entry name="uuid">0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b</entry>
Oct 23 21:51:42 user nova-compute[74337]:       <entry name="family">Virtual Machine</entry>
Oct 23 21:51:42 user nova-compute[74337]:     </system>
Oct 23 21:51:42 user nova-compute[74337]:   </sysinfo>
Oct 23 21:51:42 user nova-compute[74337]:   <os>
Oct 23 21:51:42 user nova-compute[74337]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 21:51:42 user nova-compute[74337]:     <boot dev="hd"/>
Oct 23 21:51:42 user nova-compute[74337]:     <smbios mode="sysinfo"/>
Oct 23 21:51:42 user nova-compute[74337]:   </os>
Oct 23 21:51:42 user nova-compute[74337]:   <features>
Oct 23 21:51:42 user nova-compute[74337]:     <acpi/>
Oct 23 21:51:42 user nova-compute[74337]:     <apic/>
Oct 23 21:51:42 user nova-compute[74337]:     <vmcoreinfo/>
Oct 23 21:51:42 user nova-compute[74337]:   </features>
Oct 23 21:51:42 user nova-compute[74337]:   <clock offset="utc">
Oct 23 21:51:42 user nova-compute[74337]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 21:51:42 user nova-compute[74337]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 21:51:42 user nova-compute[74337]:     <timer name="hpet" present="no"/>
Oct 23 21:51:42 user nova-compute[74337]:   </clock>
Oct 23 21:51:42 user nova-compute[74337]:   <cpu mode="custom" match="exact">
Oct 23 21:51:42 user nova-compute[74337]:     <model>Nehalem</model>
Oct 23 21:51:42 user nova-compute[74337]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 21:51:42 user nova-compute[74337]:   </cpu>
Oct 23 21:51:42 user nova-compute[74337]:   <devices>
Oct 23 21:51:42 user nova-compute[74337]:     <disk type="block" device="disk">
Oct 23 21:51:42 user nova-compute[74337]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 21:51:42 user nova-compute[74337]:       <source dev="/dev/sdb"/>
Oct 23 21:51:42 user nova-compute[74337]:       <target dev="vda" bus="virtio"/>
Oct 23 21:51:42 user nova-compute[74337]:       <serial>b016c715-febf-41d9-bc8f-2ffbf5bf3048</serial>
Oct 23 21:51:42 user nova-compute[74337]:     </disk>
Oct 23 21:51:42 user nova-compute[74337]:     <interface type="ethernet">
Oct 23 21:51:42 user nova-compute[74337]:       <mac address="fa:16:3e:72:6e:20"/>
Oct 23 21:51:42 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:51:42 user nova-compute[74337]:       <mtu size="1442"/>
Oct 23 21:51:42 user nova-compute[74337]:       <target dev="tape15964dc-04"/>
Oct 23 21:51:42 user nova-compute[74337]:     </interface>
Oct 23 21:51:42 user nova-compute[74337]:     <serial type="pty">
Oct 23 21:51:42 user nova-compute[74337]:       <log file="/opt/stack/data/nova/instances/0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b/console.log" append="off"/>
Oct 23 21:51:42 user nova-compute[74337]:     </serial>
Oct 23 21:51:42 user nova-compute[74337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 21:51:42 user nova-compute[74337]:     <video>
Oct 23 21:51:42 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:51:42 user nova-compute[74337]:     </video>
Oct 23 21:51:42 user nova-compute[74337]:     <rng model="virtio">
Oct 23 21:51:42 user nova-compute[74337]:       <backend model="random">/dev/urandom</backend>
Oct 23 21:51:42 user nova-compute[74337]:     </rng>
Oct 23 21:51:42 user nova-compute[74337]:     <controller type="usb" index="0" model="none"/>
Oct 23 21:51:42 user nova-compute[74337]:     <memballoon model="virtio">
Oct 23 21:51:42 user nova-compute[74337]:       <stats period="10"/>
Oct 23 21:51:42 user nova-compute[74337]:     </memballoon>
Oct 23 21:51:42 user nova-compute[74337]:   </devices>
Oct 23 21:51:42 user nova-compute[74337]: </domain>
Oct 23 21:51:42 user nova-compute[74337]:  {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 21:51:42 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:51:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2118733817',display_name='tempest-TestVolumeBootPattern-server-2118733817',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2118733817',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF9NMFNWTU3BVoh69lm2h364CNXP9OO2Sq0+VU67LFY2Y7YP31lo2g7Nqc/sdO6ndxwSu3pXMChCzpRUGVair3TDlV76zriaKktCrpgsBnYg9q7WYnK8Iuk7Ag22Kj7gAw==',key_name='tempest-TestVolumeBootPattern-1223802412',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb567547bd4941fb87435a841c9d17c4',ramdisk_id='',reservation_id='r-0g9813je',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-499971371',owner_user_name='tempest-TestVolumeBootPattern-499971371-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:51:22Z,user_data=None,user_id='0c3e635e8e5447138a7f2db11695574c',uuid=0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e15964dc-04e9-4b21-947c-2de7ed87e0ba", "address": "fa:16:3e:72:6e:20", "network": {"id": "5a18e96f-a6eb-4989-9be3-154b54928b03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-507511840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb567547bd4941fb87435a841c9d17c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape15964dc-04", "ovs_interfaceid": "e15964dc-04e9-4b21-947c-2de7ed87e0ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 21:51:42 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Converting VIF {"id": "e15964dc-04e9-4b21-947c-2de7ed87e0ba", "address": "fa:16:3e:72:6e:20", "network": {"id": "5a18e96f-a6eb-4989-9be3-154b54928b03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-507511840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb567547bd4941fb87435a841c9d17c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape15964dc-04", "ovs_interfaceid": "e15964dc-04e9-4b21-947c-2de7ed87e0ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:51:42 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:6e:20,bridge_name='br-int',has_traffic_filtering=True,id=e15964dc-04e9-4b21-947c-2de7ed87e0ba,network=Network(5a18e96f-a6eb-4989-9be3-154b54928b03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape15964dc-04') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:51:42 user nova-compute[74337]: DEBUG os_vif [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:6e:20,bridge_name='br-int',has_traffic_filtering=True,id=e15964dc-04e9-4b21-947c-2de7ed87e0ba,network=Network(5a18e96f-a6eb-4989-9be3-154b54928b03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape15964dc-04') {{(pid=74337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 21:51:42 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:51:42 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:51:42 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 21:51:42 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:51:42 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8a7e49ed-67dd-5b83-b676-502eebc3df74', '_type': 'linux-noop'}}, row=False) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:51:42 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:51:42 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:51:42 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:51:42 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape15964dc-04, may_exist=True, interface_attrs={}) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:51:42 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape15964dc-04, col_values=(('qos', UUID('25e5560a-b8c0-44e8-9ae7-95a91c75e677')),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:51:42 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape15964dc-04, col_values=(('external_ids', {'iface-id': 'e15964dc-04e9-4b21-947c-2de7ed87e0ba', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:72:6e:20', 'vm-uuid': '0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b'}),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:51:42 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:51:42 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:51:42 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:51:42 user nova-compute[74337]: INFO os_vif [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:6e:20,bridge_name='br-int',has_traffic_filtering=True,id=e15964dc-04e9-4b21-947c-2de7ed87e0ba,network=Network(5a18e96f-a6eb-4989-9be3-154b54928b03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape15964dc-04')
Oct 23 21:51:42 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] No BDM found with device name vda, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 21:51:42 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] No VIF found with MAC fa:16:3e:72:6e:20, not building metadata {{(pid=74337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 21:51:43 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:51:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:51:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:51:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:51:44 user nova-compute[74337]: DEBUG nova.compute.manager [req-83693aae-08d4-4d76-87f6-d97ac9c7bbc9 req-b4047a0d-f9a1-4929-aa08-fe162ae0647e service nova] [instance: 0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b] Received event network-vif-plugged-e15964dc-04e9-4b21-947c-2de7ed87e0ba {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:51:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-83693aae-08d4-4d76-87f6-d97ac9c7bbc9 req-b4047a0d-f9a1-4929-aa08-fe162ae0647e service nova] Acquiring lock "0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:51:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-83693aae-08d4-4d76-87f6-d97ac9c7bbc9 req-b4047a0d-f9a1-4929-aa08-fe162ae0647e service nova] Lock "0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:51:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-83693aae-08d4-4d76-87f6-d97ac9c7bbc9 req-b4047a0d-f9a1-4929-aa08-fe162ae0647e service nova] Lock "0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:51:44 user nova-compute[74337]: DEBUG nova.compute.manager [req-83693aae-08d4-4d76-87f6-d97ac9c7bbc9 req-b4047a0d-f9a1-4929-aa08-fe162ae0647e service nova] [instance: 0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b] No waiting events found dispatching network-vif-plugged-e15964dc-04e9-4b21-947c-2de7ed87e0ba {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:51:44 user nova-compute[74337]: WARNING nova.compute.manager [req-83693aae-08d4-4d76-87f6-d97ac9c7bbc9 req-b4047a0d-f9a1-4929-aa08-fe162ae0647e service nova] [instance: 0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b] Received unexpected event network-vif-plugged-e15964dc-04e9-4b21-947c-2de7ed87e0ba for instance with vm_state building and task_state spawning.
Oct 23 21:51:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:51:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:51:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:51:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:51:46 user nova-compute[74337]: DEBUG nova.compute.manager [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b] Instance event wait completed in 0 seconds for  {{(pid=74337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 21:51:46 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b] Guest created on hypervisor {{(pid=74337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 21:51:46 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: 0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b] Instance spawned successfully.
Oct 23 21:51:46 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 21:51:46 user nova-compute[74337]: DEBUG nova.compute.manager [req-9f0c8b54-e26b-4458-836b-0d4026e3559d req-2044f730-740b-4521-b1fb-06aaf9ed8707 service nova] [instance: 0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b] Received event network-vif-plugged-e15964dc-04e9-4b21-947c-2de7ed87e0ba {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:51:46 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-9f0c8b54-e26b-4458-836b-0d4026e3559d req-2044f730-740b-4521-b1fb-06aaf9ed8707 service nova] Acquiring lock "0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:51:46 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-9f0c8b54-e26b-4458-836b-0d4026e3559d req-2044f730-740b-4521-b1fb-06aaf9ed8707 service nova] Lock "0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:51:46 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-9f0c8b54-e26b-4458-836b-0d4026e3559d req-2044f730-740b-4521-b1fb-06aaf9ed8707 service nova] Lock "0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:51:46 user nova-compute[74337]: DEBUG nova.compute.manager [req-9f0c8b54-e26b-4458-836b-0d4026e3559d req-2044f730-740b-4521-b1fb-06aaf9ed8707 service nova] [instance: 0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b] No waiting events found dispatching network-vif-plugged-e15964dc-04e9-4b21-947c-2de7ed87e0ba {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:51:46 user nova-compute[74337]: WARNING nova.compute.manager [req-9f0c8b54-e26b-4458-836b-0d4026e3559d req-2044f730-740b-4521-b1fb-06aaf9ed8707 service nova] [instance: 0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b] Received unexpected event network-vif-plugged-e15964dc-04e9-4b21-947c-2de7ed87e0ba for instance with vm_state building and task_state spawning.
Oct 23 21:51:46 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b] Found default for hw_cdrom_bus of ide {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:51:46 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b] Found default for hw_disk_bus of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:51:46 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b] Found default for hw_input_bus of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:51:46 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b] Found default for hw_pointer_model of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:51:46 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b] Found default for hw_video_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:51:46 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b] Found default for hw_vif_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:51:46 user nova-compute[74337]: INFO nova.compute.manager [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b] Took 5.63 seconds to spawn the instance on the hypervisor.
Oct 23 21:51:46 user nova-compute[74337]: DEBUG nova.compute.manager [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b] Checking state {{(pid=74337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 21:51:46 user nova-compute[74337]: INFO nova.compute.manager [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b] Took 26.24 seconds to build instance.
Oct 23 21:51:46 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-290a4b7d-0f33-4876-acae-71f86a497004 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 26.357s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:51:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:51:48 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:51:50 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-964a8f3a-f2ff-4ceb-8b31-ae704fa4849b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Acquiring lock "9ecb4d1d-d6a1-403a-af40-3a1a10688b5c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:51:50 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-964a8f3a-f2ff-4ceb-8b31-ae704fa4849b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lock "9ecb4d1d-d6a1-403a-af40-3a1a10688b5c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:51:50 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-964a8f3a-f2ff-4ceb-8b31-ae704fa4849b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Acquiring lock "9ecb4d1d-d6a1-403a-af40-3a1a10688b5c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:51:50 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-964a8f3a-f2ff-4ceb-8b31-ae704fa4849b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lock "9ecb4d1d-d6a1-403a-af40-3a1a10688b5c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:51:50 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-964a8f3a-f2ff-4ceb-8b31-ae704fa4849b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lock "9ecb4d1d-d6a1-403a-af40-3a1a10688b5c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:51:50 user nova-compute[74337]: INFO nova.compute.manager [None req-964a8f3a-f2ff-4ceb-8b31-ae704fa4849b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 9ecb4d1d-d6a1-403a-af40-3a1a10688b5c] Terminating instance
Oct 23 21:51:50 user nova-compute[74337]: DEBUG nova.compute.manager [None req-964a8f3a-f2ff-4ceb-8b31-ae704fa4849b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 9ecb4d1d-d6a1-403a-af40-3a1a10688b5c] Start destroying the instance on the hypervisor. {{(pid=74337) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 21:51:50 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:51:51 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:51:51 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:51:51 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:51:51 user nova-compute[74337]: DEBUG nova.compute.manager [req-adc2e593-e154-4d01-bf96-422a8b4fb47b req-47a965e9-ed60-4535-96da-3433bca5efc6 service nova] [instance: 9ecb4d1d-d6a1-403a-af40-3a1a10688b5c] Received event network-vif-unplugged-0b036b4e-3790-465a-b3d6-40d387634064 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:51:51 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-adc2e593-e154-4d01-bf96-422a8b4fb47b req-47a965e9-ed60-4535-96da-3433bca5efc6 service nova] Acquiring lock "9ecb4d1d-d6a1-403a-af40-3a1a10688b5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:51:51 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-adc2e593-e154-4d01-bf96-422a8b4fb47b req-47a965e9-ed60-4535-96da-3433bca5efc6 service nova] Lock "9ecb4d1d-d6a1-403a-af40-3a1a10688b5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:51:51 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-adc2e593-e154-4d01-bf96-422a8b4fb47b req-47a965e9-ed60-4535-96da-3433bca5efc6 service nova] Lock "9ecb4d1d-d6a1-403a-af40-3a1a10688b5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:51:51 user nova-compute[74337]: DEBUG nova.compute.manager [req-adc2e593-e154-4d01-bf96-422a8b4fb47b req-47a965e9-ed60-4535-96da-3433bca5efc6 service nova] [instance: 9ecb4d1d-d6a1-403a-af40-3a1a10688b5c] No waiting events found dispatching network-vif-unplugged-0b036b4e-3790-465a-b3d6-40d387634064 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:51:51 user nova-compute[74337]: DEBUG nova.compute.manager [req-adc2e593-e154-4d01-bf96-422a8b4fb47b req-47a965e9-ed60-4535-96da-3433bca5efc6 service nova] [instance: 9ecb4d1d-d6a1-403a-af40-3a1a10688b5c] Received event network-vif-unplugged-0b036b4e-3790-465a-b3d6-40d387634064 for instance with task_state deleting. {{(pid=74337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 21:51:51 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: 9ecb4d1d-d6a1-403a-af40-3a1a10688b5c] Instance destroyed successfully.
Oct 23 21:51:51 user nova-compute[74337]: DEBUG nova.objects.instance [None req-964a8f3a-f2ff-4ceb-8b31-ae704fa4849b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lazy-loading 'resources' on Instance uuid 9ecb4d1d-d6a1-403a-af40-3a1a10688b5c {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:51:51 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-964a8f3a-f2ff-4ceb-8b31-ae704fa4849b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:48:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1465979970',display_name='tempest-AttachVolumeNegativeTest-server-1465979970',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1465979970',id=29,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHkRHDxdgC4rE9wN83paWYuhrmDQBAmmwptx/vQkTTVEwzxum33a2oKjtLzXkrOGyxT9xY9987b1fIMS47R8IwHzBo7ErSISoaCEPMqWnLGEBxpZqnfD4cv0s5kcjNtytg==',key_name='tempest-keypair-1598956670',keypairs=<?>,launch_index=0,launched_at=2023-10-23T21:48:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='84a25b3eed8548a5a324e55b28f26252',ramdisk_id='',reservation_id='r-pac0j3em',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1446109887',owner_user_name='tempest-AttachVolumeNegativeTest-1446109887-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T21:48:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6f6daa6653264905a5498e00f184080c',uuid=9ecb4d1d-d6a1-403a-af40-3a1a10688b5c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0b036b4e-3790-465a-b3d6-40d387634064", "address": "fa:16:3e:af:78:38", "network": {"id": "787d9979-63ad-4318-b1d7-8ec69c5969fe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1847253864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84a25b3eed8548a5a324e55b28f26252", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b036b4e-37", "ovs_interfaceid": "0b036b4e-3790-465a-b3d6-40d387634064", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 21:51:51 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-964a8f3a-f2ff-4ceb-8b31-ae704fa4849b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Converting VIF {"id": "0b036b4e-3790-465a-b3d6-40d387634064", "address": "fa:16:3e:af:78:38", "network": {"id": "787d9979-63ad-4318-b1d7-8ec69c5969fe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1847253864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84a25b3eed8548a5a324e55b28f26252", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b036b4e-37", "ovs_interfaceid": "0b036b4e-3790-465a-b3d6-40d387634064", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:51:51 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-964a8f3a-f2ff-4ceb-8b31-ae704fa4849b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:af:78:38,bridge_name='br-int',has_traffic_filtering=True,id=0b036b4e-3790-465a-b3d6-40d387634064,network=Network(787d9979-63ad-4318-b1d7-8ec69c5969fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b036b4e-37') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:51:51 user nova-compute[74337]: DEBUG os_vif [None req-964a8f3a-f2ff-4ceb-8b31-ae704fa4849b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:78:38,bridge_name='br-int',has_traffic_filtering=True,id=0b036b4e-3790-465a-b3d6-40d387634064,network=Network(787d9979-63ad-4318-b1d7-8ec69c5969fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b036b4e-37') {{(pid=74337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 21:51:51 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:51:51 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0b036b4e-37, bridge=br-int, if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:51:51 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:51:51 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:51:51 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:51:51 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2c5bb895-4c4b-4f75-adfc-7c775d6e2765) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:51:51 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:51:51 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:51:51 user nova-compute[74337]: INFO os_vif [None req-964a8f3a-f2ff-4ceb-8b31-ae704fa4849b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:78:38,bridge_name='br-int',has_traffic_filtering=True,id=0b036b4e-3790-465a-b3d6-40d387634064,network=Network(787d9979-63ad-4318-b1d7-8ec69c5969fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b036b4e-37')
Oct 23 21:51:51 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-964a8f3a-f2ff-4ceb-8b31-ae704fa4849b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 9ecb4d1d-d6a1-403a-af40-3a1a10688b5c] Deleting instance files /opt/stack/data/nova/instances/9ecb4d1d-d6a1-403a-af40-3a1a10688b5c_del
Oct 23 21:51:51 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-964a8f3a-f2ff-4ceb-8b31-ae704fa4849b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 9ecb4d1d-d6a1-403a-af40-3a1a10688b5c] Deletion of /opt/stack/data/nova/instances/9ecb4d1d-d6a1-403a-af40-3a1a10688b5c_del complete
Oct 23 21:51:51 user nova-compute[74337]: INFO nova.compute.manager [None req-964a8f3a-f2ff-4ceb-8b31-ae704fa4849b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 9ecb4d1d-d6a1-403a-af40-3a1a10688b5c] Took 1.13 seconds to destroy the instance on the hypervisor.
Oct 23 21:51:51 user nova-compute[74337]: DEBUG oslo.service.loopingcall [None req-964a8f3a-f2ff-4ceb-8b31-ae704fa4849b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74337) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 21:51:51 user nova-compute[74337]: DEBUG nova.compute.manager [-] [instance: 9ecb4d1d-d6a1-403a-af40-3a1a10688b5c] Deallocating network for instance {{(pid=74337) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 21:51:51 user nova-compute[74337]: DEBUG nova.network.neutron [-] [instance: 9ecb4d1d-d6a1-403a-af40-3a1a10688b5c] deallocate_for_instance() {{(pid=74337) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 21:51:52 user nova-compute[74337]: DEBUG nova.network.neutron [-] [instance: 9ecb4d1d-d6a1-403a-af40-3a1a10688b5c] Updating instance_info_cache with network_info: [] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:51:52 user nova-compute[74337]: INFO nova.compute.manager [-] [instance: 9ecb4d1d-d6a1-403a-af40-3a1a10688b5c] Took 0.91 seconds to deallocate network for instance.
Oct 23 21:51:52 user nova-compute[74337]: DEBUG nova.compute.manager [req-6732283d-d010-4664-8241-f88887dde180 req-a168b50c-7bcc-40c5-8681-0f51e20f85b3 service nova] [instance: 9ecb4d1d-d6a1-403a-af40-3a1a10688b5c] Received event network-vif-deleted-0b036b4e-3790-465a-b3d6-40d387634064 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:51:52 user nova-compute[74337]: INFO nova.compute.manager [req-6732283d-d010-4664-8241-f88887dde180 req-a168b50c-7bcc-40c5-8681-0f51e20f85b3 service nova] [instance: 9ecb4d1d-d6a1-403a-af40-3a1a10688b5c] Neutron deleted interface 0b036b4e-3790-465a-b3d6-40d387634064; detaching it from the instance and deleting it from the info cache
Oct 23 21:51:52 user nova-compute[74337]: DEBUG nova.network.neutron [req-6732283d-d010-4664-8241-f88887dde180 req-a168b50c-7bcc-40c5-8681-0f51e20f85b3 service nova] [instance: 9ecb4d1d-d6a1-403a-af40-3a1a10688b5c] Updating instance_info_cache with network_info: [] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:51:52 user nova-compute[74337]: DEBUG nova.compute.manager [req-6732283d-d010-4664-8241-f88887dde180 req-a168b50c-7bcc-40c5-8681-0f51e20f85b3 service nova] [instance: 9ecb4d1d-d6a1-403a-af40-3a1a10688b5c] Detach interface failed, port_id=0b036b4e-3790-465a-b3d6-40d387634064, reason: Instance 9ecb4d1d-d6a1-403a-af40-3a1a10688b5c could not be found. {{(pid=74337) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 23 21:51:52 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-964a8f3a-f2ff-4ceb-8b31-ae704fa4849b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:51:52 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-964a8f3a-f2ff-4ceb-8b31-ae704fa4849b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:51:53 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-964a8f3a-f2ff-4ceb-8b31-ae704fa4849b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:51:53 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-964a8f3a-f2ff-4ceb-8b31-ae704fa4849b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:51:53 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-964a8f3a-f2ff-4ceb-8b31-ae704fa4849b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.337s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:51:53 user nova-compute[74337]: DEBUG nova.compute.manager [req-e10585dc-1c9f-4d34-9640-61d5124792ac req-90de39f0-8197-4d74-8ed3-a44094c78074 service nova] [instance: 9ecb4d1d-d6a1-403a-af40-3a1a10688b5c] Received event network-vif-plugged-0b036b4e-3790-465a-b3d6-40d387634064 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:51:53 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-e10585dc-1c9f-4d34-9640-61d5124792ac req-90de39f0-8197-4d74-8ed3-a44094c78074 service nova] Acquiring lock "9ecb4d1d-d6a1-403a-af40-3a1a10688b5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:51:53 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-e10585dc-1c9f-4d34-9640-61d5124792ac req-90de39f0-8197-4d74-8ed3-a44094c78074 service nova] Lock "9ecb4d1d-d6a1-403a-af40-3a1a10688b5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:51:53 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-e10585dc-1c9f-4d34-9640-61d5124792ac req-90de39f0-8197-4d74-8ed3-a44094c78074 service nova] Lock "9ecb4d1d-d6a1-403a-af40-3a1a10688b5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:51:53 user nova-compute[74337]: DEBUG nova.compute.manager [req-e10585dc-1c9f-4d34-9640-61d5124792ac req-90de39f0-8197-4d74-8ed3-a44094c78074 service nova] [instance: 9ecb4d1d-d6a1-403a-af40-3a1a10688b5c] No waiting events found dispatching network-vif-plugged-0b036b4e-3790-465a-b3d6-40d387634064 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:51:53 user nova-compute[74337]: WARNING nova.compute.manager [req-e10585dc-1c9f-4d34-9640-61d5124792ac req-90de39f0-8197-4d74-8ed3-a44094c78074 service nova] [instance: 9ecb4d1d-d6a1-403a-af40-3a1a10688b5c] Received unexpected event network-vif-plugged-0b036b4e-3790-465a-b3d6-40d387634064 for instance with vm_state deleted and task_state None.
Oct 23 21:51:53 user nova-compute[74337]: INFO nova.scheduler.client.report [None req-964a8f3a-f2ff-4ceb-8b31-ae704fa4849b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Deleted allocations for instance 9ecb4d1d-d6a1-403a-af40-3a1a10688b5c
Oct 23 21:51:53 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-964a8f3a-f2ff-4ceb-8b31-ae704fa4849b tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lock "9ecb4d1d-d6a1-403a-af40-3a1a10688b5c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.583s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:51:53 user nova-compute[74337]: DEBUG nova.compute.manager [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Start spawning the instance on the hypervisor. {{(pid=74337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 21:51:53 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Creating instance directory {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 21:51:53 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Creating image(s)
Oct 23 21:51:53 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Did not create local disks {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 23 21:51:53 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Ensure instance console log exists: /opt/stack/data/nova/instances/86f56afb-77e6-4378-b441-5cf507a0fbe7/console.log {{(pid=74337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 21:51:53 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:51:53 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:51:53 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:51:53 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Start _get_guest_xml network_info=[{"id": "148d28e8-2783-44a9-a08e-c648f0aa9489", "address": "fa:16:3e:47:98:97", "network": {"id": "aff1f95f-fda8-4f0f-8d10-7e3d587e4fda", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2048135647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1f57e58a9ec4c6384dc0d3ca58eb610", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap148d28e8-27", "ovs_interfaceid": "148d28e8-2783-44a9-a08e-c648f0aa9489", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'aa914e66-31bd-4d4f-9c53-ad2eca86b949', 'delete_on_termination': True, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HKWwxeEB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '86f56afb-77e6-4378-b441-5cf507a0fbe7', 'attached_at': '', 'detached_at': '', 'volume_id': 'ec6df319-3945-4eda-a0b9-7c351eaf4398', 'serial': 'ec6df319-3945-4eda-a0b9-7c351eaf4398'}, 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 21:51:53 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:51:53 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:51:53 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 21:51:53 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] CPU controller missing on host. {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 21:51:53 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 21:51:53 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] CPU controller found on host. {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 21:51:53 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 21:51:53 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T21:29:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 21:51:53 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Flavor limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 21:51:53 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Image limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 21:51:53 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Flavor pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 21:51:53 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Image pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 21:51:53 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 21:51:53 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 21:51:53 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 21:51:53 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Got 1 possible topologies {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 21:51:53 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 21:51:53 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 21:51:54 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Calling os-brick to attach iSCSI Volume {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 21:51:54 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HKWwxeEB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:51:54 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:51:54 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:51:54 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:51:54 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:51:54 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:51:54 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:51:54 user nova-compute[74337]: INFO os_brick.initiator.connectors.iscsi [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 21:51:54 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 -p 172.16.0.220:3260 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:51:54 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:51:54 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fde70f2-80ae-485c-a548-bc71b04aaa4b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:51:54 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 21:51:54 user nova-compute[74337]:  {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:51:54 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 -p 172.16.0.220:3260 --interface default --op new {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:51:54 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:51:54 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c999979-14fb-4657-b85b-234c056fc600]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398] added\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:51:54 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398] added
Oct 23 21:51:54 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:51:54 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:51:54 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:51:54 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c2b1fae-2e33-4307-af72-50e61f333815]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:51:54 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:51:54 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:51:54 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:51:54 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[26b66248-6fa7-449f-880f-877decf35bf5]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:51:54 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:51:54 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HKWwxeEB {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:51:54 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HKWwxeEB" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:51:54 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7792639-65f2-4b29-b6a1-0e544e28aa56]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:51:54 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HKWwxeEB'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:51:54 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:51:54 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:51:54 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d820c44-6f02-49af-9fed-8733b1dff574]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:51:54 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:51:54 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:51:54 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:51:54 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[136b6c3e-a2d7-4111-a26f-5cd00bab206a]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:51:54 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:51:54 user nova-compute[74337]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 (non-flash)
Oct 23 21:51:54 user nova-compute[74337]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 (non-flash)
Oct 23 21:51:54 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:51:54 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:51:54 user nova-compute[74337]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 (non-flash)
Oct 23 21:51:54 user nova-compute[74337]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 (non-flash)
Oct 23 21:51:54 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:51:54 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 -p 172.16.0.220:3260 --login {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:51:54 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:51:54 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d26677-58f7-4448-b964-d93692fa72d2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:51:54 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398, portal: 172.16.0.220,3260]
Oct 23 21:51:54 user nova-compute[74337]: Login to [iface: default, target: iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398, portal: 172.16.0.220,3260] successful.
Oct 23 21:51:54 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:51:54 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:51:54 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:51:54 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[853ae15e-456b-4a71-a310-5b1d3f0959ad]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:51:54 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:51:54 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:51:54 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:51:54 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5c89f07-da9e-42e8-a986-eb61e0004fab]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:51:54 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:51:54 user nova-compute[74337]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 (non-flash)
Oct 23 21:51:54 user nova-compute[74337]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 (non-flash)
Oct 23 21:51:54 user nova-compute[74337]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 (non-flash)
Oct 23 21:51:54 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:51:54 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:51:54 user nova-compute[74337]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 (non-flash)
Oct 23 21:51:54 user nova-compute[74337]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 (non-flash)
Oct 23 21:51:54 user nova-compute[74337]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 (non-flash)
Oct 23 21:51:54 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:51:54 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:51:54 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Connected to 172.16.0.220:3260 {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 21:51:54 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] HCTL ('36', '-', '-', 0) found on session 34 with lun 0 {{(pid=74337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 21:51:54 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 21:51:54 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:51:54 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:51:54 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[56d2f768-f769-4463-9b23-e08311893c8a]: (4, ('- - 0', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:51:54 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Searching for a device in session 34 and hctl ['36', '*', '*', 0] yield: None {{(pid=74337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 21:51:55 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Searching for a device in session 34 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 21:51:55 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HKWwxeEB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 21:51:55 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.343s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:51:55 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] <== connect_volume: return (1344ms) {'type': 'block', 'scsi_wwn': '23231356561613565', 'path': '/dev/sde'} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:51:55 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23231356561613565', 'path': '/dev/sde'} {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 21:51:55 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:51:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1798504573',display_name='tempest-ServerActionsTestOtherA-server-1798504573',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1798504573',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAUefvW5MXCf+ATdQvlG858gIBXPDNbf7wcgIdNA8u/7ry6R/jyuWYoMofLLf6tWmqavGvJQy7SZOewcrGrMe1Wf24ACMK0qGJkM0S6nAXe5EBQ2zvJtr8dUyXZnBDdU6w==',key_name='tempest-keypair-1448030867',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e1f57e58a9ec4c6384dc0d3ca58eb610',ramdisk_id='',reservation_id='r-lyxkco2l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-100075475',owner_user_name='tempest-ServerActionsTestOtherA-100075475-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:51:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='891ee2e3acc54ed0bc4571f63ff491a0',uuid=86f56afb-77e6-4378-b441-5cf507a0fbe7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "148d28e8-2783-44a9-a08e-c648f0aa9489", "address": "fa:16:3e:47:98:97", "network": {"id": "aff1f95f-fda8-4f0f-8d10-7e3d587e4fda", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2048135647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1f57e58a9ec4c6384dc0d3ca58eb610", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap148d28e8-27", "ovs_interfaceid": "148d28e8-2783-44a9-a08e-c648f0aa9489", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 21:51:55 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Converting VIF {"id": "148d28e8-2783-44a9-a08e-c648f0aa9489", "address": "fa:16:3e:47:98:97", "network": {"id": "aff1f95f-fda8-4f0f-8d10-7e3d587e4fda", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2048135647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1f57e58a9ec4c6384dc0d3ca58eb610", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap148d28e8-27", "ovs_interfaceid": "148d28e8-2783-44a9-a08e-c648f0aa9489", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:51:55 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:98:97,bridge_name='br-int',has_traffic_filtering=True,id=148d28e8-2783-44a9-a08e-c648f0aa9489,network=Network(aff1f95f-fda8-4f0f-8d10-7e3d587e4fda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap148d28e8-27') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:51:55 user nova-compute[74337]: DEBUG nova.objects.instance [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lazy-loading 'pci_devices' on Instance uuid 86f56afb-77e6-4378-b441-5cf507a0fbe7 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:51:55 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] End _get_guest_xml xml=<domain type="kvm">
Oct 23 21:51:55 user nova-compute[74337]:   <uuid>86f56afb-77e6-4378-b441-5cf507a0fbe7</uuid>
Oct 23 21:51:55 user nova-compute[74337]:   <name>instance-00000020</name>
Oct 23 21:51:55 user nova-compute[74337]:   <memory>524288</memory>
Oct 23 21:51:55 user nova-compute[74337]:   <vcpu>1</vcpu>
Oct 23 21:51:55 user nova-compute[74337]:   <metadata>
Oct 23 21:51:55 user nova-compute[74337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 21:51:55 user nova-compute[74337]:       <nova:package version="0.0.0"/>
Oct 23 21:51:55 user nova-compute[74337]:       <nova:name>tempest-ServerActionsTestOtherA-server-1798504573</nova:name>
Oct 23 21:51:55 user nova-compute[74337]:       <nova:creationTime>2023-10-23 21:51:53</nova:creationTime>
Oct 23 21:51:55 user nova-compute[74337]:       <nova:flavor name="m1.tiny">
Oct 23 21:51:55 user nova-compute[74337]:         <nova:memory>512</nova:memory>
Oct 23 21:51:55 user nova-compute[74337]:         <nova:disk>1</nova:disk>
Oct 23 21:51:55 user nova-compute[74337]:         <nova:swap>0</nova:swap>
Oct 23 21:51:55 user nova-compute[74337]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 21:51:55 user nova-compute[74337]:         <nova:vcpus>1</nova:vcpus>
Oct 23 21:51:55 user nova-compute[74337]:       </nova:flavor>
Oct 23 21:51:55 user nova-compute[74337]:       <nova:owner>
Oct 23 21:51:55 user nova-compute[74337]:         <nova:user uuid="891ee2e3acc54ed0bc4571f63ff491a0">tempest-ServerActionsTestOtherA-100075475-project-member</nova:user>
Oct 23 21:51:55 user nova-compute[74337]:         <nova:project uuid="e1f57e58a9ec4c6384dc0d3ca58eb610">tempest-ServerActionsTestOtherA-100075475</nova:project>
Oct 23 21:51:55 user nova-compute[74337]:       </nova:owner>
Oct 23 21:51:55 user nova-compute[74337]:       <nova:ports>
Oct 23 21:51:55 user nova-compute[74337]:         <nova:port uuid="148d28e8-2783-44a9-a08e-c648f0aa9489">
Oct 23 21:51:55 user nova-compute[74337]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 23 21:51:55 user nova-compute[74337]:         </nova:port>
Oct 23 21:51:55 user nova-compute[74337]:       </nova:ports>
Oct 23 21:51:55 user nova-compute[74337]:     </nova:instance>
Oct 23 21:51:55 user nova-compute[74337]:   </metadata>
Oct 23 21:51:55 user nova-compute[74337]:   <sysinfo type="smbios">
Oct 23 21:51:55 user nova-compute[74337]:     <system>
Oct 23 21:51:55 user nova-compute[74337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 21:51:55 user nova-compute[74337]:       <entry name="product">OpenStack Nova</entry>
Oct 23 21:51:55 user nova-compute[74337]:       <entry name="version">0.0.0</entry>
Oct 23 21:51:55 user nova-compute[74337]:       <entry name="serial">86f56afb-77e6-4378-b441-5cf507a0fbe7</entry>
Oct 23 21:51:55 user nova-compute[74337]:       <entry name="uuid">86f56afb-77e6-4378-b441-5cf507a0fbe7</entry>
Oct 23 21:51:55 user nova-compute[74337]:       <entry name="family">Virtual Machine</entry>
Oct 23 21:51:55 user nova-compute[74337]:     </system>
Oct 23 21:51:55 user nova-compute[74337]:   </sysinfo>
Oct 23 21:51:55 user nova-compute[74337]:   <os>
Oct 23 21:51:55 user nova-compute[74337]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 21:51:55 user nova-compute[74337]:     <boot dev="hd"/>
Oct 23 21:51:55 user nova-compute[74337]:     <smbios mode="sysinfo"/>
Oct 23 21:51:55 user nova-compute[74337]:   </os>
Oct 23 21:51:55 user nova-compute[74337]:   <features>
Oct 23 21:51:55 user nova-compute[74337]:     <acpi/>
Oct 23 21:51:55 user nova-compute[74337]:     <apic/>
Oct 23 21:51:55 user nova-compute[74337]:     <vmcoreinfo/>
Oct 23 21:51:55 user nova-compute[74337]:   </features>
Oct 23 21:51:55 user nova-compute[74337]:   <clock offset="utc">
Oct 23 21:51:55 user nova-compute[74337]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 21:51:55 user nova-compute[74337]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 21:51:55 user nova-compute[74337]:     <timer name="hpet" present="no"/>
Oct 23 21:51:55 user nova-compute[74337]:   </clock>
Oct 23 21:51:55 user nova-compute[74337]:   <cpu mode="custom" match="exact">
Oct 23 21:51:55 user nova-compute[74337]:     <model>Nehalem</model>
Oct 23 21:51:55 user nova-compute[74337]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 21:51:55 user nova-compute[74337]:   </cpu>
Oct 23 21:51:55 user nova-compute[74337]:   <devices>
Oct 23 21:51:55 user nova-compute[74337]:     <disk type="block" device="disk">
Oct 23 21:51:55 user nova-compute[74337]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 21:51:55 user nova-compute[74337]:       <source dev="/dev/sde"/>
Oct 23 21:51:55 user nova-compute[74337]:       <target dev="vda" bus="virtio"/>
Oct 23 21:51:55 user nova-compute[74337]:       <serial>ec6df319-3945-4eda-a0b9-7c351eaf4398</serial>
Oct 23 21:51:55 user nova-compute[74337]:     </disk>
Oct 23 21:51:55 user nova-compute[74337]:     <interface type="ethernet">
Oct 23 21:51:55 user nova-compute[74337]:       <mac address="fa:16:3e:47:98:97"/>
Oct 23 21:51:55 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:51:55 user nova-compute[74337]:       <mtu size="1442"/>
Oct 23 21:51:55 user nova-compute[74337]:       <target dev="tap148d28e8-27"/>
Oct 23 21:51:55 user nova-compute[74337]:     </interface>
Oct 23 21:51:55 user nova-compute[74337]:     <serial type="pty">
Oct 23 21:51:55 user nova-compute[74337]:       <log file="/opt/stack/data/nova/instances/86f56afb-77e6-4378-b441-5cf507a0fbe7/console.log" append="off"/>
Oct 23 21:51:55 user nova-compute[74337]:     </serial>
Oct 23 21:51:55 user nova-compute[74337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 21:51:55 user nova-compute[74337]:     <video>
Oct 23 21:51:55 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:51:55 user nova-compute[74337]:     </video>
Oct 23 21:51:55 user nova-compute[74337]:     <rng model="virtio">
Oct 23 21:51:55 user nova-compute[74337]:       <backend model="random">/dev/urandom</backend>
Oct 23 21:51:55 user nova-compute[74337]:     </rng>
Oct 23 21:51:55 user nova-compute[74337]:     <controller type="usb" index="0" model="none"/>
Oct 23 21:51:55 user nova-compute[74337]:     <memballoon model="virtio">
Oct 23 21:51:55 user nova-compute[74337]:       <stats period="10"/>
Oct 23 21:51:55 user nova-compute[74337]:     </memballoon>
Oct 23 21:51:55 user nova-compute[74337]:   </devices>
Oct 23 21:51:55 user nova-compute[74337]: </domain>
Oct 23 21:51:55 user nova-compute[74337]:  {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 21:51:55 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:51:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1798504573',display_name='tempest-ServerActionsTestOtherA-server-1798504573',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1798504573',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAUefvW5MXCf+ATdQvlG858gIBXPDNbf7wcgIdNA8u/7ry6R/jyuWYoMofLLf6tWmqavGvJQy7SZOewcrGrMe1Wf24ACMK0qGJkM0S6nAXe5EBQ2zvJtr8dUyXZnBDdU6w==',key_name='tempest-keypair-1448030867',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e1f57e58a9ec4c6384dc0d3ca58eb610',ramdisk_id='',reservation_id='r-lyxkco2l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-100075475',owner_user_name='tempest-ServerActionsTestOtherA-100075475-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:51:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='891ee2e3acc54ed0bc4571f63ff491a0',uuid=86f56afb-77e6-4378-b441-5cf507a0fbe7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "148d28e8-2783-44a9-a08e-c648f0aa9489", "address": "fa:16:3e:47:98:97", "network": {"id": "aff1f95f-fda8-4f0f-8d10-7e3d587e4fda", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2048135647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1f57e58a9ec4c6384dc0d3ca58eb610", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap148d28e8-27", "ovs_interfaceid": "148d28e8-2783-44a9-a08e-c648f0aa9489", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 21:51:55 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Converting VIF {"id": "148d28e8-2783-44a9-a08e-c648f0aa9489", "address": "fa:16:3e:47:98:97", "network": {"id": "aff1f95f-fda8-4f0f-8d10-7e3d587e4fda", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2048135647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1f57e58a9ec4c6384dc0d3ca58eb610", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap148d28e8-27", "ovs_interfaceid": "148d28e8-2783-44a9-a08e-c648f0aa9489", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:51:55 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:98:97,bridge_name='br-int',has_traffic_filtering=True,id=148d28e8-2783-44a9-a08e-c648f0aa9489,network=Network(aff1f95f-fda8-4f0f-8d10-7e3d587e4fda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap148d28e8-27') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:51:55 user nova-compute[74337]: DEBUG os_vif [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:98:97,bridge_name='br-int',has_traffic_filtering=True,id=148d28e8-2783-44a9-a08e-c648f0aa9489,network=Network(aff1f95f-fda8-4f0f-8d10-7e3d587e4fda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap148d28e8-27') {{(pid=74337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 21:51:55 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:51:55 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:51:55 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 21:51:55 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:51:55 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bc8192d2-f52b-58b2-b39c-24c5d302286b', '_type': 'linux-noop'}}, row=False) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:51:55 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:51:55 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:51:55 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:51:55 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap148d28e8-27, may_exist=True, interface_attrs={}) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:51:55 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap148d28e8-27, col_values=(('qos', UUID('04ad18d7-c287-4f5c-8acf-f75a9cd802da')),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:51:55 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap148d28e8-27, col_values=(('external_ids', {'iface-id': '148d28e8-2783-44a9-a08e-c648f0aa9489', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:47:98:97', 'vm-uuid': '86f56afb-77e6-4378-b441-5cf507a0fbe7'}),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:51:55 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:51:55 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:51:55 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:51:55 user nova-compute[74337]: INFO os_vif [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:98:97,bridge_name='br-int',has_traffic_filtering=True,id=148d28e8-2783-44a9-a08e-c648f0aa9489,network=Network(aff1f95f-fda8-4f0f-8d10-7e3d587e4fda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap148d28e8-27')
Oct 23 21:51:55 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] No BDM found with device name vda, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 21:51:55 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] No VIF found with MAC fa:16:3e:47:98:97, not building metadata {{(pid=74337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 21:51:56 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:51:56 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:51:56 user nova-compute[74337]: DEBUG nova.compute.manager [req-bf984157-5c96-431c-bb76-89d96d534c3b req-e73de74b-3530-4cfb-9cbf-d78f0351748c service nova] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Received event network-vif-plugged-148d28e8-2783-44a9-a08e-c648f0aa9489 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:51:56 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-bf984157-5c96-431c-bb76-89d96d534c3b req-e73de74b-3530-4cfb-9cbf-d78f0351748c service nova] Acquiring lock "86f56afb-77e6-4378-b441-5cf507a0fbe7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:51:56 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-bf984157-5c96-431c-bb76-89d96d534c3b req-e73de74b-3530-4cfb-9cbf-d78f0351748c service nova] Lock "86f56afb-77e6-4378-b441-5cf507a0fbe7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:51:56 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-bf984157-5c96-431c-bb76-89d96d534c3b req-e73de74b-3530-4cfb-9cbf-d78f0351748c service nova] Lock "86f56afb-77e6-4378-b441-5cf507a0fbe7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:51:56 user nova-compute[74337]: DEBUG nova.compute.manager [req-bf984157-5c96-431c-bb76-89d96d534c3b req-e73de74b-3530-4cfb-9cbf-d78f0351748c service nova] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] No waiting events found dispatching network-vif-plugged-148d28e8-2783-44a9-a08e-c648f0aa9489 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:51:56 user nova-compute[74337]: WARNING nova.compute.manager [req-bf984157-5c96-431c-bb76-89d96d534c3b req-e73de74b-3530-4cfb-9cbf-d78f0351748c service nova] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Received unexpected event network-vif-plugged-148d28e8-2783-44a9-a08e-c648f0aa9489 for instance with vm_state building and task_state spawning.
Oct 23 21:51:57 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:51:57 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:51:58 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:51:58 user nova-compute[74337]: DEBUG nova.compute.manager [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Instance event wait completed in 0 seconds for  {{(pid=74337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 21:51:58 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Guest created on hypervisor {{(pid=74337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 21:51:59 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Instance spawned successfully.
Oct 23 21:51:59 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 21:51:59 user nova-compute[74337]: DEBUG nova.compute.manager [req-28500cbb-cebf-4d5a-9deb-b402d2d33ed2 req-0f2e3c20-08f5-40d5-a751-322bc87a9aef service nova] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Received event network-vif-plugged-148d28e8-2783-44a9-a08e-c648f0aa9489 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:51:59 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-28500cbb-cebf-4d5a-9deb-b402d2d33ed2 req-0f2e3c20-08f5-40d5-a751-322bc87a9aef service nova] Acquiring lock "86f56afb-77e6-4378-b441-5cf507a0fbe7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:51:59 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-28500cbb-cebf-4d5a-9deb-b402d2d33ed2 req-0f2e3c20-08f5-40d5-a751-322bc87a9aef service nova] Lock "86f56afb-77e6-4378-b441-5cf507a0fbe7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:51:59 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-28500cbb-cebf-4d5a-9deb-b402d2d33ed2 req-0f2e3c20-08f5-40d5-a751-322bc87a9aef service nova] Lock "86f56afb-77e6-4378-b441-5cf507a0fbe7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:51:59 user nova-compute[74337]: DEBUG nova.compute.manager [req-28500cbb-cebf-4d5a-9deb-b402d2d33ed2 req-0f2e3c20-08f5-40d5-a751-322bc87a9aef service nova] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] No waiting events found dispatching network-vif-plugged-148d28e8-2783-44a9-a08e-c648f0aa9489 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:51:59 user nova-compute[74337]: WARNING nova.compute.manager [req-28500cbb-cebf-4d5a-9deb-b402d2d33ed2 req-0f2e3c20-08f5-40d5-a751-322bc87a9aef service nova] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Received unexpected event network-vif-plugged-148d28e8-2783-44a9-a08e-c648f0aa9489 for instance with vm_state building and task_state spawning.
Oct 23 21:51:59 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Found default for hw_cdrom_bus of ide {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:51:59 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Found default for hw_disk_bus of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:51:59 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Found default for hw_input_bus of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:51:59 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Found default for hw_pointer_model of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:51:59 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Found default for hw_video_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:51:59 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Found default for hw_vif_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:51:59 user nova-compute[74337]: INFO nova.compute.manager [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Took 5.21 seconds to spawn the instance on the hypervisor.
Oct 23 21:51:59 user nova-compute[74337]: DEBUG nova.compute.manager [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Checking state {{(pid=74337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 21:51:59 user nova-compute[74337]: INFO nova.compute.manager [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Took 25.59 seconds to build instance.
Oct 23 21:51:59 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-2a76f1fb-f577-46d5-9a8a-763c77444ffa tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lock "86f56afb-77e6-4378-b441-5cf507a0fbe7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.714s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:52:00 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:52:03 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:52:05 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:52:08 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:52:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:52:09 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:52:09 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Starting heal instance info cache {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 21:52:09 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Rebuilding the list of instances to heal {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 21:52:09 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "refresh_cache-1189976f-8d02-468d-8fa7-bd5594c5f85a" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:52:09 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquired lock "refresh_cache-1189976f-8d02-468d-8fa7-bd5594c5f85a" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:52:09 user nova-compute[74337]: DEBUG nova.network.neutron [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 1189976f-8d02-468d-8fa7-bd5594c5f85a] Forcefully refreshing network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 21:52:09 user nova-compute[74337]: DEBUG nova.objects.instance [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lazy-loading 'info_cache' on Instance uuid 1189976f-8d02-468d-8fa7-bd5594c5f85a {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:52:10 user nova-compute[74337]: DEBUG nova.network.neutron [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 1189976f-8d02-468d-8fa7-bd5594c5f85a] Updating instance_info_cache with network_info: [{"id": "9c888931-1180-4efd-8ca1-a57252bf8dc5", "address": "fa:16:3e:f9:a2:b8", "network": {"id": "5f62b1d8-d5d0-4ff9-922b-fc6e72fb640d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-655282105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b85c4f783a4ee7ab67422b49da85ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c888931-11", "ovs_interfaceid": "9c888931-1180-4efd-8ca1-a57252bf8dc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:52:10 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Releasing lock "refresh_cache-1189976f-8d02-468d-8fa7-bd5594c5f85a" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:52:10 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 1189976f-8d02-468d-8fa7-bd5594c5f85a] Updated the network info_cache for instance {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 21:52:10 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:52:10 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:52:10 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:52:10 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 21:52:10 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:52:13 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:52:14 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:52:14 user nova-compute[74337]: INFO nova.compute.manager [None req-f7ed97dc-f866-4a81-97db-f875dd2c631a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] Rescuing
Oct 23 21:52:14 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-f7ed97dc-f866-4a81-97db-f875dd2c631a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Acquiring lock "refresh_cache-bf53e0fc-71d1-48fa-b0b4-ed3400a21c38" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:52:14 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-f7ed97dc-f866-4a81-97db-f875dd2c631a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Acquired lock "refresh_cache-bf53e0fc-71d1-48fa-b0b4-ed3400a21c38" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:52:14 user nova-compute[74337]: DEBUG nova.network.neutron [None req-f7ed97dc-f866-4a81-97db-f875dd2c631a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] Building network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 21:52:14 user nova-compute[74337]: DEBUG nova.network.neutron [None req-f7ed97dc-f866-4a81-97db-f875dd2c631a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] Updating instance_info_cache with network_info: [{"id": "d8fa8fea-2adc-42e9-9d0c-cbcbfe43db80", "address": "fa:16:3e:0f:95:9c", "network": {"id": "5f62b1d8-d5d0-4ff9-922b-fc6e72fb640d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-655282105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b85c4f783a4ee7ab67422b49da85ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8fa8fea-2a", "ovs_interfaceid": "d8fa8fea-2adc-42e9-9d0c-cbcbfe43db80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:52:14 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-f7ed97dc-f866-4a81-97db-f875dd2c631a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Releasing lock "refresh_cache-bf53e0fc-71d1-48fa-b0b4-ed3400a21c38" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:52:15 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:52:15 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:52:15 user nova-compute[74337]: DEBUG nova.compute.manager [req-5b5d0a94-d386-43c6-a27b-550a13f1fe89 req-6f3fe45c-2a63-4cc8-ae8b-3a8d89efe547 service nova] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] Received event network-vif-unplugged-d8fa8fea-2adc-42e9-9d0c-cbcbfe43db80 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:52:15 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-5b5d0a94-d386-43c6-a27b-550a13f1fe89 req-6f3fe45c-2a63-4cc8-ae8b-3a8d89efe547 service nova] Acquiring lock "bf53e0fc-71d1-48fa-b0b4-ed3400a21c38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:52:15 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-5b5d0a94-d386-43c6-a27b-550a13f1fe89 req-6f3fe45c-2a63-4cc8-ae8b-3a8d89efe547 service nova] Lock "bf53e0fc-71d1-48fa-b0b4-ed3400a21c38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:52:15 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-5b5d0a94-d386-43c6-a27b-550a13f1fe89 req-6f3fe45c-2a63-4cc8-ae8b-3a8d89efe547 service nova] Lock "bf53e0fc-71d1-48fa-b0b4-ed3400a21c38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:52:15 user nova-compute[74337]: DEBUG nova.compute.manager [req-5b5d0a94-d386-43c6-a27b-550a13f1fe89 req-6f3fe45c-2a63-4cc8-ae8b-3a8d89efe547 service nova] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] No waiting events found dispatching network-vif-unplugged-d8fa8fea-2adc-42e9-9d0c-cbcbfe43db80 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:52:15 user nova-compute[74337]: WARNING nova.compute.manager [req-5b5d0a94-d386-43c6-a27b-550a13f1fe89 req-6f3fe45c-2a63-4cc8-ae8b-3a8d89efe547 service nova] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] Received unexpected event network-vif-unplugged-d8fa8fea-2adc-42e9-9d0c-cbcbfe43db80 for instance with vm_state active and task_state rescuing.
Oct 23 21:52:15 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:52:15 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:52:15 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:52:15 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:52:15 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] Instance destroyed successfully.
Oct 23 21:52:15 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-f7ed97dc-f866-4a81-97db-f875dd2c631a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] Attempting a stable device rescue
Oct 23 21:52:15 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-f7ed97dc-f866-4a81-97db-f875dd2c631a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74337) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 23 21:52:15 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-f7ed97dc-f866-4a81-97db-f875dd2c631a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] Instance directory exists: not creating {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 23 21:52:15 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-f7ed97dc-f866-4a81-97db-f875dd2c631a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] Creating image(s)
Oct 23 21:52:15 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-f7ed97dc-f866-4a81-97db-f875dd2c631a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Acquiring lock "/opt/stack/data/nova/instances/bf53e0fc-71d1-48fa-b0b4-ed3400a21c38/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:52:15 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-f7ed97dc-f866-4a81-97db-f875dd2c631a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lock "/opt/stack/data/nova/instances/bf53e0fc-71d1-48fa-b0b4-ed3400a21c38/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:52:15 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-f7ed97dc-f866-4a81-97db-f875dd2c631a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lock "/opt/stack/data/nova/instances/bf53e0fc-71d1-48fa-b0b4-ed3400a21c38/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:52:15 user nova-compute[74337]: DEBUG nova.objects.instance [None req-f7ed97dc-f866-4a81-97db-f875dd2c631a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lazy-loading 'trusted_certs' on Instance uuid bf53e0fc-71d1-48fa-b0b4-ed3400a21c38 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:52:15 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-f7ed97dc-f866-4a81-97db-f875dd2c631a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Acquiring lock "4df1f4d694a04a22836d8ad5e5885ca56403f198" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:52:15 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-f7ed97dc-f866-4a81-97db-f875dd2c631a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lock "4df1f4d694a04a22836d8ad5e5885ca56403f198" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:52:17 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-f7ed97dc-f866-4a81-97db-f875dd2c631a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4df1f4d694a04a22836d8ad5e5885ca56403f198.part --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:52:17 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:52:17 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-f7ed97dc-f866-4a81-97db-f875dd2c631a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4df1f4d694a04a22836d8ad5e5885ca56403f198.part --force-share --output=json" returned: 0 in 0.190s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:52:17 user nova-compute[74337]: DEBUG nova.virt.images [None req-f7ed97dc-f866-4a81-97db-f875dd2c631a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] e4e00d2b-55e9-41c4-bcdb-f248987500ef was qcow2, converting to raw {{(pid=74337) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 23 21:52:17 user nova-compute[74337]: DEBUG nova.privsep.utils [None req-f7ed97dc-f866-4a81-97db-f875dd2c631a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74337) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 23 21:52:17 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-f7ed97dc-f866-4a81-97db-f875dd2c631a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4df1f4d694a04a22836d8ad5e5885ca56403f198.part /opt/stack/data/nova/instances/_base/4df1f4d694a04a22836d8ad5e5885ca56403f198.converted {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:52:17 user nova-compute[74337]: DEBUG nova.compute.manager [req-7408ea58-38bb-4cf8-ba7d-fbe56030ce95 req-50b03955-51b6-493e-abe6-7991e6bfc3f0 service nova] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] Received event network-vif-plugged-d8fa8fea-2adc-42e9-9d0c-cbcbfe43db80 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:52:17 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-7408ea58-38bb-4cf8-ba7d-fbe56030ce95 req-50b03955-51b6-493e-abe6-7991e6bfc3f0 service nova] Acquiring lock "bf53e0fc-71d1-48fa-b0b4-ed3400a21c38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:52:17 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-7408ea58-38bb-4cf8-ba7d-fbe56030ce95 req-50b03955-51b6-493e-abe6-7991e6bfc3f0 service nova] Lock "bf53e0fc-71d1-48fa-b0b4-ed3400a21c38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:52:17 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-7408ea58-38bb-4cf8-ba7d-fbe56030ce95 req-50b03955-51b6-493e-abe6-7991e6bfc3f0 service nova] Lock "bf53e0fc-71d1-48fa-b0b4-ed3400a21c38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:52:17 user nova-compute[74337]: DEBUG nova.compute.manager [req-7408ea58-38bb-4cf8-ba7d-fbe56030ce95 req-50b03955-51b6-493e-abe6-7991e6bfc3f0 service nova] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] No waiting events found dispatching network-vif-plugged-d8fa8fea-2adc-42e9-9d0c-cbcbfe43db80 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:52:17 user nova-compute[74337]: WARNING nova.compute.manager [req-7408ea58-38bb-4cf8-ba7d-fbe56030ce95 req-50b03955-51b6-493e-abe6-7991e6bfc3f0 service nova] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] Received unexpected event network-vif-plugged-d8fa8fea-2adc-42e9-9d0c-cbcbfe43db80 for instance with vm_state active and task_state rescuing.
Oct 23 21:52:17 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-f7ed97dc-f866-4a81-97db-f875dd2c631a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4df1f4d694a04a22836d8ad5e5885ca56403f198.part /opt/stack/data/nova/instances/_base/4df1f4d694a04a22836d8ad5e5885ca56403f198.converted" returned: 0 in 0.447s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:52:17 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-f7ed97dc-f866-4a81-97db-f875dd2c631a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4df1f4d694a04a22836d8ad5e5885ca56403f198.converted --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:52:17 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-f7ed97dc-f866-4a81-97db-f875dd2c631a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4df1f4d694a04a22836d8ad5e5885ca56403f198.converted --force-share --output=json" returned: 0 in 0.188s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:52:17 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-f7ed97dc-f866-4a81-97db-f875dd2c631a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lock "4df1f4d694a04a22836d8ad5e5885ca56403f198" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.006s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:52:17 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-f7ed97dc-f866-4a81-97db-f875dd2c631a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Acquiring lock "4df1f4d694a04a22836d8ad5e5885ca56403f198" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:52:17 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-f7ed97dc-f866-4a81-97db-f875dd2c631a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lock "4df1f4d694a04a22836d8ad5e5885ca56403f198" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:52:17 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-f7ed97dc-f866-4a81-97db-f875dd2c631a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4df1f4d694a04a22836d8ad5e5885ca56403f198 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:52:18 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-f7ed97dc-f866-4a81-97db-f875dd2c631a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4df1f4d694a04a22836d8ad5e5885ca56403f198 --force-share --output=json" returned: 0 in 0.174s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:52:18 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-f7ed97dc-f866-4a81-97db-f875dd2c631a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4df1f4d694a04a22836d8ad5e5885ca56403f198,backing_fmt=raw /opt/stack/data/nova/instances/bf53e0fc-71d1-48fa-b0b4-ed3400a21c38/disk.rescue {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:52:18 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-f7ed97dc-f866-4a81-97db-f875dd2c631a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4df1f4d694a04a22836d8ad5e5885ca56403f198,backing_fmt=raw /opt/stack/data/nova/instances/bf53e0fc-71d1-48fa-b0b4-ed3400a21c38/disk.rescue" returned: 0 in 0.052s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:52:18 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-f7ed97dc-f866-4a81-97db-f875dd2c631a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lock "4df1f4d694a04a22836d8ad5e5885ca56403f198" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:52:18 user nova-compute[74337]: DEBUG nova.objects.instance [None req-f7ed97dc-f866-4a81-97db-f875dd2c631a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lazy-loading 'migration_context' on Instance uuid bf53e0fc-71d1-48fa-b0b4-ed3400a21c38 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:52:18 user nova-compute[74337]: DEBUG nova.objects.base [None req-f7ed97dc-f866-4a81-97db-f875dd2c631a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Object Instance<bf53e0fc-71d1-48fa-b0b4-ed3400a21c38> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 21:52:18 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-f7ed97dc-f866-4a81-97db-f875dd2c631a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] Created local disks {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 21:52:18 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-f7ed97dc-f866-4a81-97db-f875dd2c631a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] Start _get_guest_xml network_info=[{"id": "d8fa8fea-2adc-42e9-9d0c-cbcbfe43db80", "address": "fa:16:3e:0f:95:9c", "network": {"id": "5f62b1d8-d5d0-4ff9-922b-fc6e72fb640d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-655282105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-655282105-network", "vif_mac": "fa:16:3e:0f:95:9c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b85c4f783a4ee7ab67422b49da85ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8fa8fea-2a", "ovs_interfaceid": "d8fa8fea-2adc-42e9-9d0c-cbcbfe43db80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T21:29:21Z,direct_url=<?>,disk_format='qcow2',id=d859d89d-998d-4109-b26a-0d6e28152932,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ff43462300764979a6cf688444336a56',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T21:29:22Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'e4e00d2b-55e9-41c4-bcdb-f248987500ef', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '1565ac17-c757-4247-978d-c1bf84ee5e6d', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PKTulDvj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': 'bf53e0fc-71d1-48fa-b0b4-ed3400a21c38', 'attached_at': '', 'detached_at': '', 'volume_id': 'c55c1f59-3672-4335-8c85-014b490d8b83', 'serial': 'c55c1f59-3672-4335-8c85-014b490d8b83'}, 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 21:52:18 user nova-compute[74337]: DEBUG nova.objects.instance [None req-f7ed97dc-f866-4a81-97db-f875dd2c631a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lazy-loading 'resources' on Instance uuid bf53e0fc-71d1-48fa-b0b4-ed3400a21c38 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:52:18 user nova-compute[74337]: DEBUG nova.objects.base [None req-f7ed97dc-f866-4a81-97db-f875dd2c631a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Object Instance<bf53e0fc-71d1-48fa-b0b4-ed3400a21c38> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 21:52:18 user nova-compute[74337]: DEBUG nova.objects.instance [None req-f7ed97dc-f866-4a81-97db-f875dd2c631a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lazy-loading 'numa_topology' on Instance uuid bf53e0fc-71d1-48fa-b0b4-ed3400a21c38 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:52:18 user nova-compute[74337]: DEBUG nova.objects.base [None req-f7ed97dc-f866-4a81-97db-f875dd2c631a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Object Instance<bf53e0fc-71d1-48fa-b0b4-ed3400a21c38> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 21:52:18 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-f7ed97dc-f866-4a81-97db-f875dd2c631a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:52:18 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-f7ed97dc-f866-4a81-97db-f875dd2c631a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:52:18 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-f7ed97dc-f866-4a81-97db-f875dd2c631a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 21:52:18 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-f7ed97dc-f866-4a81-97db-f875dd2c631a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] CPU controller missing on host. {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 21:52:18 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-f7ed97dc-f866-4a81-97db-f875dd2c631a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 21:52:18 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-f7ed97dc-f866-4a81-97db-f875dd2c631a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] CPU controller found on host. {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 21:52:18 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-f7ed97dc-f866-4a81-97db-f875dd2c631a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 21:52:18 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-f7ed97dc-f866-4a81-97db-f875dd2c631a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T21:29:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T21:29:21Z,direct_url=<?>,disk_format='qcow2',id=d859d89d-998d-4109-b26a-0d6e28152932,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ff43462300764979a6cf688444336a56',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T21:29:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 21:52:18 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-f7ed97dc-f866-4a81-97db-f875dd2c631a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Flavor limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 21:52:18 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-f7ed97dc-f866-4a81-97db-f875dd2c631a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Image limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 21:52:18 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-f7ed97dc-f866-4a81-97db-f875dd2c631a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Flavor pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 21:52:18 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-f7ed97dc-f866-4a81-97db-f875dd2c631a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Image pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 21:52:18 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-f7ed97dc-f866-4a81-97db-f875dd2c631a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 21:52:18 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-f7ed97dc-f866-4a81-97db-f875dd2c631a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 21:52:18 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-f7ed97dc-f866-4a81-97db-f875dd2c631a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 21:52:18 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-f7ed97dc-f866-4a81-97db-f875dd2c631a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Got 1 possible topologies {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 21:52:18 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-f7ed97dc-f866-4a81-97db-f875dd2c631a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 21:52:18 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-f7ed97dc-f866-4a81-97db-f875dd2c631a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 21:52:18 user nova-compute[74337]: DEBUG nova.objects.instance [None req-f7ed97dc-f866-4a81-97db-f875dd2c631a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lazy-loading 'vcpu_model' on Instance uuid bf53e0fc-71d1-48fa-b0b4-ed3400a21c38 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:52:18 user nova-compute[74337]: DEBUG nova.objects.base [None req-f7ed97dc-f866-4a81-97db-f875dd2c631a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Object Instance<bf53e0fc-71d1-48fa-b0b4-ed3400a21c38> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 21:52:18 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7ed97dc-f866-4a81-97db-f875dd2c631a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] Calling os-brick to attach iSCSI Volume {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 21:52:18 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ed97dc-f866-4a81-97db-f875dd2c631a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PKTulDvj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:52:18 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-f7ed97dc-f866-4a81-97db-f875dd2c631a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:52:18 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-f7ed97dc-f866-4a81-97db-f875dd2c631a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:52:18 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-f7ed97dc-f866-4a81-97db-f875dd2c631a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:52:18 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-f7ed97dc-f866-4a81-97db-f875dd2c631a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:52:18 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-f7ed97dc-f866-4a81-97db-f875dd2c631a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:52:18 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-f7ed97dc-f866-4a81-97db-f875dd2c631a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:52:18 user nova-compute[74337]: INFO os_brick.initiator.connectors.iscsi [None req-f7ed97dc-f866-4a81-97db-f875dd2c631a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 21:52:18 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 -p 172.16.0.220:3260 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:52:18 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 -p 172.16.0.220:3260" returned: 0 in 0.023s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:52:18 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d614ba-df24-48cc-a6b2-a00069014819]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = PKTulDvj\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:52:18 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ed97dc-f866-4a81-97db-f875dd2c631a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Oct 23 21:52:18 user nova-compute[74337]: node.name = iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83
Oct 23 21:52:18 user nova-compute[74337]: node.tpgt = -1
Oct 23 21:52:18 user nova-compute[74337]: node.startup = automatic
Oct 23 21:52:18 user nova-compute[74337]: node.leading_login = No
Oct 23 21:52:18 user nova-compute[74337]: iface.iscsi_ifacename = default
Oct 23 21:52:18 user nova-compute[74337]: iface.net_ifacename = <empty>
Oct 23 21:52:18 user nova-compute[74337]: iface.ipaddress = <empty>
Oct 23 21:52:18 user nova-compute[74337]: iface.prefix_len = 0
Oct 23 21:52:18 user nova-compute[74337]: iface.hwaddress = <empty>
Oct 23 21:52:18 user nova-compute[74337]: iface.transport_name = tcp
Oct 23 21:52:18 user nova-compute[74337]: iface.initiatorname = <empty>
Oct 23 21:52:18 user nova-compute[74337]: iface.state = <empty>
Oct 23 21:52:18 user nova-compute[74337]: iface.vlan_id = 0
Oct 23 21:52:18 user nova-compute[74337]: iface.vlan_priority = 0
Oct 23 21:52:18 user nova-compute[74337]: iface.vlan_state = <empty>
Oct 23 21:52:18 user nova-compute[74337]: iface.iface_num = 0
Oct 23 21:52:18 user nova-compute[74337]: iface.mtu = 0
Oct 23 21:52:18 user nova-compute[74337]: iface.port = 0
Oct 23 21:52:18 user nova-compute[74337]: iface.bootproto = <empty>
Oct 23 21:52:18 user nova-compute[74337]: iface.subnet_mask = <empty>
Oct 23 21:52:18 user nova-compute[74337]: iface.gateway = <empty>
Oct 23 21:52:18 user nova-compute[74337]: iface.dhcp_alt_client_id_state = <empty>
Oct 23 21:52:18 user nova-compute[74337]: iface.dhcp_alt_client_id = <empty>
Oct 23 21:52:18 user nova-compute[74337]: iface.dhcp_dns = <empty>
Oct 23 21:52:18 user nova-compute[74337]: iface.dhcp_learn_iqn = <empty>
Oct 23 21:52:18 user nova-compute[74337]: iface.dhcp_req_vendor_id_state = <empty>
Oct 23 21:52:18 user nova-compute[74337]: iface.dhcp_vendor_id_state = <empty>
Oct 23 21:52:18 user nova-compute[74337]: iface.dhcp_vendor_id = <empty>
Oct 23 21:52:18 user nova-compute[74337]: iface.dhcp_slp_da = <empty>
Oct 23 21:52:18 user nova-compute[74337]: iface.fragmentation = <empty>
Oct 23 21:52:18 user nova-compute[74337]: iface.gratuitous_arp = <empty>
Oct 23 21:52:18 user nova-compute[74337]: iface.incoming_forwarding = <empty>
Oct 23 21:52:18 user nova-compute[74337]: iface.tos_state = <empty>
Oct 23 21:52:18 user nova-compute[74337]: iface.tos = 0
Oct 23 21:52:18 user nova-compute[74337]: iface.ttl = 0
Oct 23 21:52:18 user nova-compute[74337]: iface.delayed_ack = <empty>
Oct 23 21:52:18 user nova-compute[74337]: iface.tcp_nagle = <empty>
Oct 23 21:52:18 user nova-compute[74337]: iface.tcp_wsf_state = <empty>
Oct 23 21:52:18 user nova-compute[74337]: iface.tcp_wsf = 0
Oct 23 21:52:18 user nova-compute[74337]: iface.tcp_timer_scale = 0
Oct 23 21:52:18 user nova-compute[74337]: iface.tcp_timestamp = <empty>
Oct 23 21:52:18 user nova-compute[74337]: iface.redirect = <empty>
Oct 23 21:52:18 user nova-compute[74337]: iface.def_task_mgmt_timeout = 0
Oct 23 21:52:18 user nova-compute[74337]: iface.header_digest = <empty>
Oct 23 21:52:18 user nova-compute[74337]: iface.data_digest = <empty>
Oct 23 21:52:18 user nova-compute[74337]: iface.immediate_data = <empty>
Oct 23 21:52:18 user nova-compute[74337]: iface.initial_r2t = <empty>
Oct 23 21:52:18 user nova-compute[74337]: iface.data_seq_inorder = <empty>
Oct 23 21:52:18 user nova-compute[74337]: iface.data_pdu_inorder = <empty>
Oct 23 21:52:18 user nova-compute[74337]: iface.erl = 0
Oct 23 21:52:18 user nova-compute[74337]: iface.max_receive_data_len = 0
Oct 23 21:52:18 user nova-compute[74337]: iface.first_burst_len = 0
Oct 23 21:52:18 user nova-compute[74337]: iface.max_outstanding_r2t = 0
Oct 23 21:52:18 user nova-compute[74337]: iface.max_burst_len = 0
Oct 23 21:52:18 user nova-compute[74337]: iface.chap_auth = <empty>
Oct 23 21:52:18 user nova-compute[74337]: iface.bidi_chap = <empty>
Oct 23 21:52:18 user nova-compute[74337]: iface.strict_login_compliance = <empty>
Oct 23 21:52:18 user nova-compute[74337]: iface.discovery_auth = <empty>
Oct 23 21:52:18 user nova-compute[74337]: iface.discovery_logout = <empty>
Oct 23 21:52:18 user nova-compute[74337]: node.discovery_address = <empty>
Oct 23 21:52:18 user nova-compute[74337]: node.discovery_port = 0
Oct 23 21:52:18 user nova-compute[74337]: node.discovery_type = static
Oct 23 21:52:18 user nova-compute[74337]: node.session.initial_cmdsn = 0
Oct 23 21:52:18 user nova-compute[74337]: node.session.initial_login_retry_max = 8
Oct 23 21:52:18 user nova-compute[74337]: node.session.xmit_thread_priority = -20
Oct 23 21:52:18 user nova-compute[74337]: node.session.cmds_max = 128
Oct 23 21:52:18 user nova-compute[74337]: node.session.queue_depth = 32
Oct 23 21:52:18 user nova-compute[74337]: node.session.nr_sessions = 1
Oct 23 21:52:18 user nova-compute[74337]: node.session.auth.authmethod = CHAP
Oct 23 21:52:18 user nova-compute[74337]: node.session.auth.username = PKTulDvj
Oct 23 21:52:18 user nova-compute[74337]: node.session.auth.password = ***
Oct 23 21:52:18 user nova-compute[74337]: node.session.auth.username_in = <empty>
Oct 23 21:52:18 user nova-compute[74337]: node.session.auth.password_in = <empty>
Oct 23 21:52:18 user nova-compute[74337]: node.session.auth.chap_algs = MD5
Oct 23 21:52:18 user nova-compute[74337]: node.session.timeo.replacement_timeout = 120
Oct 23 21:52:18 user nova-compute[74337]: node.session.err_timeo.abort_timeout = 15
Oct 23 21:52:18 user nova-compute[74337]: node.session.err_timeo.lu_reset_timeout = 30
Oct 23 21:52:18 user nova-compute[74337]: node.session.err_timeo.tgt_reset_timeout = 30
Oct 23 21:52:18 user nova-compute[74337]: node.session.err_timeo.host_reset_timeout = 60
Oct 23 21:52:18 user nova-compute[74337]: node.session.iscsi.FastAbort = Yes
Oct 23 21:52:18 user nova-compute[74337]: node.session.iscsi.InitialR2T = No
Oct 23 21:52:18 user nova-compute[74337]: node.session.iscsi.ImmediateData = Yes
Oct 23 21:52:18 user nova-compute[74337]: node.session.iscsi.FirstBurstLength = 262144
Oct 23 21:52:18 user nova-compute[74337]: node.session.iscsi.MaxBurstLength = 16776192
Oct 23 21:52:18 user nova-compute[74337]: node.session.iscsi.DefaultTime2Retain = 0
Oct 23 21:52:18 user nova-compute[74337]: node.session.iscsi.DefaultTime2Wait = 2
Oct 23 21:52:18 user nova-compute[74337]: node.session.iscsi.MaxConnections = 1
Oct 23 21:52:18 user nova-compute[74337]: node.session.iscsi.MaxOutstandingR2T = 1
Oct 23 21:52:18 user nova-compute[74337]: node.session.iscsi.ERL = 0
Oct 23 21:52:18 user nova-compute[74337]: node.session.scan = manual
Oct 23 21:52:18 user nova-compute[74337]: node.session.reopen_max = 0
Oct 23 21:52:18 user nova-compute[74337]: node.conn[0].address = 172.16.0.220
Oct 23 21:52:18 user nova-compute[74337]: node.conn[0].port = 3260
Oct 23 21:52:18 user nova-compute[74337]: node.conn[0].startup = manual
Oct 23 21:52:18 user nova-compute[74337]: node.conn[0].tcp.window_size = 524288
Oct 23 21:52:18 user nova-compute[74337]: node.conn[0].tcp.type_of_service = 0
Oct 23 21:52:18 user nova-compute[74337]: node.conn[0].timeo.logout_timeout = 15
Oct 23 21:52:18 user nova-compute[74337]: node.conn[0].timeo.login_timeout = 15
Oct 23 21:52:18 user nova-compute[74337]: node.conn[0].timeo.auth_timeout = 45
Oct 23 21:52:18 user nova-compute[74337]: node.conn[0].timeo.noop_out_interval = 5
Oct 23 21:52:18 user nova-compute[74337]: node.conn[0].timeo.noop_out_timeout = 5
Oct 23 21:52:18 user nova-compute[74337]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Oct 23 21:52:18 user nova-compute[74337]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Oct 23 21:52:18 user nova-compute[74337]: node.conn[0].iscsi.HeaderDigest = None
Oct 23 21:52:18 user nova-compute[74337]: node.conn[0].iscsi.DataDigest = None
Oct 23 21:52:18 user nova-compute[74337]: node.conn[0].iscsi.IFMarker = No
Oct 23 21:52:18 user nova-compute[74337]: node.conn[0].iscsi.OFMarker = No
Oct 23 21:52:18 user nova-compute[74337]: # END RECORD
Oct 23 21:52:18 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:52:18 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:52:18 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:52:18 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[18759f91-3cf8-4d00-a5da-fdb235a7db92]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:52:18 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ed97dc-f866-4a81-97db-f875dd2c631a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:52:18 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:52:18 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:52:18 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d1b2ea0-db0f-4d0f-9bb2-6286772d9c52]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:52:18 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ed97dc-f866-4a81-97db-f875dd2c631a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:52:18 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PKTulDvj {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:52:18 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PKTulDvj" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:52:18 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a3db27e-f582-451d-b6ad-47aaa774cc68]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:52:18 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ed97dc-f866-4a81-97db-f875dd2c631a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PKTulDvj'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:52:18 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:52:18 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:52:18 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d931c896-6fe3-42f6-abf5-86b84cb0571e]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:52:18 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ed97dc-f866-4a81-97db-f875dd2c631a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:52:18 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:52:18 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:52:18 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ec3ce4-f284-4e27-a319-de9e024614ba]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:52:18 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ed97dc-f866-4a81-97db-f875dd2c631a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:52:18 user nova-compute[74337]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 (non-flash)
Oct 23 21:52:18 user nova-compute[74337]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 (non-flash)
Oct 23 21:52:18 user nova-compute[74337]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 (non-flash)
Oct 23 21:52:18 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:52:18 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ed97dc-f866-4a81-97db-f875dd2c631a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:52:18 user nova-compute[74337]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 (non-flash)
Oct 23 21:52:18 user nova-compute[74337]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 (non-flash)
Oct 23 21:52:18 user nova-compute[74337]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 (non-flash)
Oct 23 21:52:18 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:52:18 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-f7ed97dc-f866-4a81-97db-f875dd2c631a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.153s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:52:18 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ed97dc-f866-4a81-97db-f875dd2c631a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Connected to 172.16.0.220:3260 {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 21:52:18 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-f7ed97dc-f866-4a81-97db-f875dd2c631a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] HCTL ('35', '0', '0', 0) found on session 32 with lun 0 {{(pid=74337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 21:52:18 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-f7ed97dc-f866-4a81-97db-f875dd2c631a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=74337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 21:52:18 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:52:18 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.014s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:52:18 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e6e18fb-93b9-4b2a-857f-76ce6bebc792]: (4, ('0 0 0', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:52:18 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-f7ed97dc-f866-4a81-97db-f875dd2c631a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Searching for a device in session 32 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=74337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 21:52:18 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ed97dc-f866-4a81-97db-f875dd2c631a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PKTulDvj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 21:52:18 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-f7ed97dc-f866-4a81-97db-f875dd2c631a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.268s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:52:18 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ed97dc-f866-4a81-97db-f875dd2c631a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] <== connect_volume: return (270ms) {'type': 'block', 'scsi_wwn': '23438373365306662', 'path': '/dev/sdd'} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:52:18 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7ed97dc-f866-4a81-97db-f875dd2c631a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23438373365306662', 'path': '/dev/sdd'} {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 21:52:18 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-f7ed97dc-f866-4a81-97db-f875dd2c631a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:50:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1154963022',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1154963022',id=30,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-23T21:51:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='83b85c4f783a4ee7ab67422b49da85ca',ramdisk_id='',reservation_id='r-tp3clp60',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1944032280',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:51:04Z,user_data=None,user_id='a2e424dd3c684c808de14c2a9c3c1ed6',uuid=bf53e0fc-71d1-48fa-b0b4-ed3400a21c38,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d8fa8fea-2adc-42e9-9d0c-cbcbfe43db80", "address": "fa:16:3e:0f:95:9c", "network": {"id": "5f62b1d8-d5d0-4ff9-922b-fc6e72fb640d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-655282105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-655282105-network", "vif_mac": "fa:16:3e:0f:95:9c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b85c4f783a4ee7ab67422b49da85ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8fa8fea-2a", "ovs_interfaceid": "d8fa8fea-2adc-42e9-9d0c-cbcbfe43db80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 21:52:18 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-f7ed97dc-f866-4a81-97db-f875dd2c631a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Converting VIF {"id": "d8fa8fea-2adc-42e9-9d0c-cbcbfe43db80", "address": "fa:16:3e:0f:95:9c", "network": {"id": "5f62b1d8-d5d0-4ff9-922b-fc6e72fb640d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-655282105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-655282105-network", "vif_mac": "fa:16:3e:0f:95:9c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b85c4f783a4ee7ab67422b49da85ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8fa8fea-2a", "ovs_interfaceid": "d8fa8fea-2adc-42e9-9d0c-cbcbfe43db80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:52:18 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-f7ed97dc-f866-4a81-97db-f875dd2c631a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0f:95:9c,bridge_name='br-int',has_traffic_filtering=True,id=d8fa8fea-2adc-42e9-9d0c-cbcbfe43db80,network=Network(5f62b1d8-d5d0-4ff9-922b-fc6e72fb640d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8fa8fea-2a') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:52:18 user nova-compute[74337]: DEBUG nova.objects.instance [None req-f7ed97dc-f866-4a81-97db-f875dd2c631a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lazy-loading 'pci_devices' on Instance uuid bf53e0fc-71d1-48fa-b0b4-ed3400a21c38 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:52:18 user nova-compute[74337]: DEBUG nova.objects.base [None req-f7ed97dc-f866-4a81-97db-f875dd2c631a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Object Instance<bf53e0fc-71d1-48fa-b0b4-ed3400a21c38> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 21:52:18 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-f7ed97dc-f866-4a81-97db-f875dd2c631a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] End _get_guest_xml xml=<domain type="kvm">
Oct 23 21:52:18 user nova-compute[74337]:   <uuid>bf53e0fc-71d1-48fa-b0b4-ed3400a21c38</uuid>
Oct 23 21:52:18 user nova-compute[74337]:   <name>instance-0000001e</name>
Oct 23 21:52:18 user nova-compute[74337]:   <memory>524288</memory>
Oct 23 21:52:18 user nova-compute[74337]:   <vcpu>1</vcpu>
Oct 23 21:52:18 user nova-compute[74337]:   <metadata>
Oct 23 21:52:18 user nova-compute[74337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 21:52:18 user nova-compute[74337]:       <nova:package version="0.0.0"/>
Oct 23 21:52:18 user nova-compute[74337]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1154963022</nova:name>
Oct 23 21:52:18 user nova-compute[74337]:       <nova:creationTime>2023-10-23 21:52:18</nova:creationTime>
Oct 23 21:52:18 user nova-compute[74337]:       <nova:flavor name="m1.tiny">
Oct 23 21:52:18 user nova-compute[74337]:         <nova:memory>512</nova:memory>
Oct 23 21:52:18 user nova-compute[74337]:         <nova:disk>1</nova:disk>
Oct 23 21:52:18 user nova-compute[74337]:         <nova:swap>0</nova:swap>
Oct 23 21:52:18 user nova-compute[74337]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 21:52:18 user nova-compute[74337]:         <nova:vcpus>1</nova:vcpus>
Oct 23 21:52:18 user nova-compute[74337]:       </nova:flavor>
Oct 23 21:52:18 user nova-compute[74337]:       <nova:owner>
Oct 23 21:52:18 user nova-compute[74337]:         <nova:user uuid="a2e424dd3c684c808de14c2a9c3c1ed6">tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member</nova:user>
Oct 23 21:52:18 user nova-compute[74337]:         <nova:project uuid="83b85c4f783a4ee7ab67422b49da85ca">tempest-ServerBootFromVolumeStableRescueTest-1944032280</nova:project>
Oct 23 21:52:18 user nova-compute[74337]:       </nova:owner>
Oct 23 21:52:18 user nova-compute[74337]:       <nova:root type="image" uuid="d859d89d-998d-4109-b26a-0d6e28152932"/>
Oct 23 21:52:18 user nova-compute[74337]:       <nova:ports>
Oct 23 21:52:18 user nova-compute[74337]:         <nova:port uuid="d8fa8fea-2adc-42e9-9d0c-cbcbfe43db80">
Oct 23 21:52:18 user nova-compute[74337]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 23 21:52:18 user nova-compute[74337]:         </nova:port>
Oct 23 21:52:18 user nova-compute[74337]:       </nova:ports>
Oct 23 21:52:18 user nova-compute[74337]:     </nova:instance>
Oct 23 21:52:18 user nova-compute[74337]:   </metadata>
Oct 23 21:52:18 user nova-compute[74337]:   <sysinfo type="smbios">
Oct 23 21:52:18 user nova-compute[74337]:     <system>
Oct 23 21:52:18 user nova-compute[74337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 21:52:18 user nova-compute[74337]:       <entry name="product">OpenStack Nova</entry>
Oct 23 21:52:18 user nova-compute[74337]:       <entry name="version">0.0.0</entry>
Oct 23 21:52:18 user nova-compute[74337]:       <entry name="serial">bf53e0fc-71d1-48fa-b0b4-ed3400a21c38</entry>
Oct 23 21:52:18 user nova-compute[74337]:       <entry name="uuid">bf53e0fc-71d1-48fa-b0b4-ed3400a21c38</entry>
Oct 23 21:52:18 user nova-compute[74337]:       <entry name="family">Virtual Machine</entry>
Oct 23 21:52:18 user nova-compute[74337]:     </system>
Oct 23 21:52:18 user nova-compute[74337]:   </sysinfo>
Oct 23 21:52:18 user nova-compute[74337]:   <os>
Oct 23 21:52:18 user nova-compute[74337]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 21:52:18 user nova-compute[74337]:     <smbios mode="sysinfo"/>
Oct 23 21:52:18 user nova-compute[74337]:   </os>
Oct 23 21:52:18 user nova-compute[74337]:   <features>
Oct 23 21:52:18 user nova-compute[74337]:     <acpi/>
Oct 23 21:52:18 user nova-compute[74337]:     <apic/>
Oct 23 21:52:18 user nova-compute[74337]:     <vmcoreinfo/>
Oct 23 21:52:18 user nova-compute[74337]:   </features>
Oct 23 21:52:18 user nova-compute[74337]:   <clock offset="utc">
Oct 23 21:52:18 user nova-compute[74337]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 21:52:18 user nova-compute[74337]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 21:52:18 user nova-compute[74337]:     <timer name="hpet" present="no"/>
Oct 23 21:52:18 user nova-compute[74337]:   </clock>
Oct 23 21:52:18 user nova-compute[74337]:   <cpu mode="custom" match="exact">
Oct 23 21:52:18 user nova-compute[74337]:     <model>Nehalem</model>
Oct 23 21:52:18 user nova-compute[74337]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 21:52:18 user nova-compute[74337]:   </cpu>
Oct 23 21:52:18 user nova-compute[74337]:   <devices>
Oct 23 21:52:18 user nova-compute[74337]:     <disk type="block" device="disk">
Oct 23 21:52:18 user nova-compute[74337]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 21:52:18 user nova-compute[74337]:       <source dev="/dev/sdd"/>
Oct 23 21:52:18 user nova-compute[74337]:       <target dev="vda" bus="virtio"/>
Oct 23 21:52:18 user nova-compute[74337]:       <serial>c55c1f59-3672-4335-8c85-014b490d8b83</serial>
Oct 23 21:52:18 user nova-compute[74337]:     </disk>
Oct 23 21:52:18 user nova-compute[74337]:     <disk type="file" device="disk">
Oct 23 21:52:18 user nova-compute[74337]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 21:52:18 user nova-compute[74337]:       <source file="/opt/stack/data/nova/instances/bf53e0fc-71d1-48fa-b0b4-ed3400a21c38/disk.rescue"/>
Oct 23 21:52:18 user nova-compute[74337]:       <target dev="vdb" bus="virtio"/>
Oct 23 21:52:18 user nova-compute[74337]:       <boot order="1"/>
Oct 23 21:52:18 user nova-compute[74337]:     </disk>
Oct 23 21:52:18 user nova-compute[74337]:     <interface type="ethernet">
Oct 23 21:52:18 user nova-compute[74337]:       <mac address="fa:16:3e:0f:95:9c"/>
Oct 23 21:52:18 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:52:18 user nova-compute[74337]:       <mtu size="1442"/>
Oct 23 21:52:18 user nova-compute[74337]:       <target dev="tapd8fa8fea-2a"/>
Oct 23 21:52:18 user nova-compute[74337]:     </interface>
Oct 23 21:52:18 user nova-compute[74337]:     <serial type="pty">
Oct 23 21:52:18 user nova-compute[74337]:       <log file="/opt/stack/data/nova/instances/bf53e0fc-71d1-48fa-b0b4-ed3400a21c38/console.log" append="off"/>
Oct 23 21:52:18 user nova-compute[74337]:     </serial>
Oct 23 21:52:18 user nova-compute[74337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 21:52:18 user nova-compute[74337]:     <video>
Oct 23 21:52:18 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:52:18 user nova-compute[74337]:     </video>
Oct 23 21:52:18 user nova-compute[74337]:     <rng model="virtio">
Oct 23 21:52:18 user nova-compute[74337]:       <backend model="random">/dev/urandom</backend>
Oct 23 21:52:18 user nova-compute[74337]:     </rng>
Oct 23 21:52:18 user nova-compute[74337]:     <controller type="usb" index="0" model="none"/>
Oct 23 21:52:18 user nova-compute[74337]:     <memballoon model="virtio">
Oct 23 21:52:18 user nova-compute[74337]:       <stats period="10"/>
Oct 23 21:52:18 user nova-compute[74337]:     </memballoon>
Oct 23 21:52:18 user nova-compute[74337]:   </devices>
Oct 23 21:52:18 user nova-compute[74337]: </domain>
Oct 23 21:52:18 user nova-compute[74337]:  {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 21:52:18 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] Instance destroyed successfully.
Oct 23 21:52:18 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-f7ed97dc-f866-4a81-97db-f875dd2c631a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] No BDM found with device name vda, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 21:52:18 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-f7ed97dc-f866-4a81-97db-f875dd2c631a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 21:52:18 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-f7ed97dc-f866-4a81-97db-f875dd2c631a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] No VIF found with MAC fa:16:3e:0f:95:9c, not building metadata {{(pid=74337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 21:52:18 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:52:19 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:52:19 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:52:19 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:52:19 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:52:19 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Auditing locally available compute resources for user (node: user) {{(pid=74337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 21:52:19 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:52:19 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:52:20 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:52:20 user nova-compute[74337]: DEBUG nova.compute.manager [req-287d4701-859e-4fdd-be27-1acd3f4b1536 req-c85b93ff-16f1-4b37-aa73-a14277d1c228 service nova] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] Received event network-vif-plugged-d8fa8fea-2adc-42e9-9d0c-cbcbfe43db80 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:52:20 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-287d4701-859e-4fdd-be27-1acd3f4b1536 req-c85b93ff-16f1-4b37-aa73-a14277d1c228 service nova] Acquiring lock "bf53e0fc-71d1-48fa-b0b4-ed3400a21c38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:52:20 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-287d4701-859e-4fdd-be27-1acd3f4b1536 req-c85b93ff-16f1-4b37-aa73-a14277d1c228 service nova] Lock "bf53e0fc-71d1-48fa-b0b4-ed3400a21c38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:52:20 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-287d4701-859e-4fdd-be27-1acd3f4b1536 req-c85b93ff-16f1-4b37-aa73-a14277d1c228 service nova] Lock "bf53e0fc-71d1-48fa-b0b4-ed3400a21c38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:52:20 user nova-compute[74337]: DEBUG nova.compute.manager [req-287d4701-859e-4fdd-be27-1acd3f4b1536 req-c85b93ff-16f1-4b37-aa73-a14277d1c228 service nova] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] No waiting events found dispatching network-vif-plugged-d8fa8fea-2adc-42e9-9d0c-cbcbfe43db80 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:52:20 user nova-compute[74337]: WARNING nova.compute.manager [req-287d4701-859e-4fdd-be27-1acd3f4b1536 req-c85b93ff-16f1-4b37-aa73-a14277d1c228 service nova] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] Received unexpected event network-vif-plugged-d8fa8fea-2adc-42e9-9d0c-cbcbfe43db80 for instance with vm_state active and task_state rescuing.
Oct 23 21:52:20 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:52:20 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:52:22 user nova-compute[74337]: DEBUG nova.compute.manager [req-fad700f1-1c6d-48b8-add9-b99d77d45e55 req-d11a9740-20f3-4ada-955e-d7d0b13fbd57 service nova] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] Received event network-vif-plugged-d8fa8fea-2adc-42e9-9d0c-cbcbfe43db80 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:52:22 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-fad700f1-1c6d-48b8-add9-b99d77d45e55 req-d11a9740-20f3-4ada-955e-d7d0b13fbd57 service nova] Acquiring lock "bf53e0fc-71d1-48fa-b0b4-ed3400a21c38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:52:22 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-fad700f1-1c6d-48b8-add9-b99d77d45e55 req-d11a9740-20f3-4ada-955e-d7d0b13fbd57 service nova] Lock "bf53e0fc-71d1-48fa-b0b4-ed3400a21c38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:52:22 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-fad700f1-1c6d-48b8-add9-b99d77d45e55 req-d11a9740-20f3-4ada-955e-d7d0b13fbd57 service nova] Lock "bf53e0fc-71d1-48fa-b0b4-ed3400a21c38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:52:22 user nova-compute[74337]: DEBUG nova.compute.manager [req-fad700f1-1c6d-48b8-add9-b99d77d45e55 req-d11a9740-20f3-4ada-955e-d7d0b13fbd57 service nova] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] No waiting events found dispatching network-vif-plugged-d8fa8fea-2adc-42e9-9d0c-cbcbfe43db80 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:52:22 user nova-compute[74337]: WARNING nova.compute.manager [req-fad700f1-1c6d-48b8-add9-b99d77d45e55 req-d11a9740-20f3-4ada-955e-d7d0b13fbd57 service nova] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] Received unexpected event network-vif-plugged-d8fa8fea-2adc-42e9-9d0c-cbcbfe43db80 for instance with vm_state active and task_state rescuing.
Oct 23 21:52:22 user nova-compute[74337]: DEBUG nova.compute.manager [None req-f7ed97dc-f866-4a81-97db-f875dd2c631a tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] Checking state {{(pid=74337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 21:52:22 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 21:52:22 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/547c4d4c-e0dd-495a-b83f-98426d0a4a99/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:52:22 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/547c4d4c-e0dd-495a-b83f-98426d0a4a99/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:52:22 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/547c4d4c-e0dd-495a-b83f-98426d0a4a99/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:52:22 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/547c4d4c-e0dd-495a-b83f-98426d0a4a99/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:52:22 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 21:52:22 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf53e0fc-71d1-48fa-b0b4-ed3400a21c38/disk.rescue --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:52:23 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf53e0fc-71d1-48fa-b0b4-ed3400a21c38/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:52:23 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf53e0fc-71d1-48fa-b0b4-ed3400a21c38/disk.rescue --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:52:23 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf53e0fc-71d1-48fa-b0b4-ed3400a21c38/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:52:23 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e05fd36-ee44-4992-80a9-f95af608b9f5/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:52:23 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e05fd36-ee44-4992-80a9-f95af608b9f5/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:52:23 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e05fd36-ee44-4992-80a9-f95af608b9f5/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:52:23 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:52:23 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e05fd36-ee44-4992-80a9-f95af608b9f5/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:52:23 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 21:52:23 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 21:52:23 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1189976f-8d02-468d-8fa7-bd5594c5f85a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:52:23 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1189976f-8d02-468d-8fa7-bd5594c5f85a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:52:23 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1189976f-8d02-468d-8fa7-bd5594c5f85a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:52:24 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1189976f-8d02-468d-8fa7-bd5594c5f85a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:52:24 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:52:24 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:52:24 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Hypervisor/Node resource view: name=user free_ram=8005MB free_disk=25.227825164794922GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 21:52:24 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:52:24 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:52:24 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 1189976f-8d02-468d-8fa7-bd5594c5f85a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:52:24 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 547c4d4c-e0dd-495a-b83f-98426d0a4a99 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:52:24 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 00f757cf-e5dd-476f-81c6-670ed2bf6938 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Oct 23 21:52:24 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:52:24 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 1e05fd36-ee44-4992-80a9-f95af608b9f5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:52:24 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance bf53e0fc-71d1-48fa-b0b4-ed3400a21c38 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:52:24 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:52:24 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 86f56afb-77e6-4378-b441-5cf507a0fbe7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:52:24 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 21:52:24 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 21:52:25 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:52:25 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:52:25 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Compute_service record updated for user:user {{(pid=74337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 21:52:25 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.494s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:52:25 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:52:28 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:52:28 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:52:30 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:52:32 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4d6e4e49-fc5b-4a23-9e46-0fe57476a1cb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Acquiring lock "e326a14c-61d7-4dca-b55f-db0f3ab0d14e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:52:32 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4d6e4e49-fc5b-4a23-9e46-0fe57476a1cb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lock "e326a14c-61d7-4dca-b55f-db0f3ab0d14e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:52:32 user nova-compute[74337]: DEBUG nova.compute.manager [None req-4d6e4e49-fc5b-4a23-9e46-0fe57476a1cb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: e326a14c-61d7-4dca-b55f-db0f3ab0d14e] Starting instance... {{(pid=74337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 21:52:33 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4d6e4e49-fc5b-4a23-9e46-0fe57476a1cb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:52:33 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4d6e4e49-fc5b-4a23-9e46-0fe57476a1cb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:52:33 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-4d6e4e49-fc5b-4a23-9e46-0fe57476a1cb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 21:52:33 user nova-compute[74337]: INFO nova.compute.claims [None req-4d6e4e49-fc5b-4a23-9e46-0fe57476a1cb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: e326a14c-61d7-4dca-b55f-db0f3ab0d14e] Claim successful on node user
Oct 23 21:52:33 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-4d6e4e49-fc5b-4a23-9e46-0fe57476a1cb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:52:33 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-4d6e4e49-fc5b-4a23-9e46-0fe57476a1cb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:52:33 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4d6e4e49-fc5b-4a23-9e46-0fe57476a1cb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.545s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:52:33 user nova-compute[74337]: DEBUG nova.compute.manager [None req-4d6e4e49-fc5b-4a23-9e46-0fe57476a1cb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: e326a14c-61d7-4dca-b55f-db0f3ab0d14e] Start building networks asynchronously for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 21:52:33 user nova-compute[74337]: DEBUG nova.compute.manager [None req-4d6e4e49-fc5b-4a23-9e46-0fe57476a1cb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: e326a14c-61d7-4dca-b55f-db0f3ab0d14e] Allocating IP information in the background. {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 21:52:33 user nova-compute[74337]: DEBUG nova.network.neutron [None req-4d6e4e49-fc5b-4a23-9e46-0fe57476a1cb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: e326a14c-61d7-4dca-b55f-db0f3ab0d14e] allocate_for_instance() {{(pid=74337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 21:52:33 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-4d6e4e49-fc5b-4a23-9e46-0fe57476a1cb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: e326a14c-61d7-4dca-b55f-db0f3ab0d14e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 21:52:33 user nova-compute[74337]: DEBUG nova.compute.manager [None req-4d6e4e49-fc5b-4a23-9e46-0fe57476a1cb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: e326a14c-61d7-4dca-b55f-db0f3ab0d14e] Start building block device mappings for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 21:52:33 user nova-compute[74337]: DEBUG nova.policy [None req-4d6e4e49-fc5b-4a23-9e46-0fe57476a1cb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c82d267bc4d142f8b48c66ffab721618', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96dc585a51343db94529e22adbd6ef3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74337) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 21:52:33 user nova-compute[74337]: DEBUG nova.compute.manager [None req-4d6e4e49-fc5b-4a23-9e46-0fe57476a1cb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: e326a14c-61d7-4dca-b55f-db0f3ab0d14e] Start spawning the instance on the hypervisor. {{(pid=74337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 21:52:33 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-4d6e4e49-fc5b-4a23-9e46-0fe57476a1cb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: e326a14c-61d7-4dca-b55f-db0f3ab0d14e] Creating instance directory {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 21:52:33 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-4d6e4e49-fc5b-4a23-9e46-0fe57476a1cb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: e326a14c-61d7-4dca-b55f-db0f3ab0d14e] Creating image(s)
Oct 23 21:52:33 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4d6e4e49-fc5b-4a23-9e46-0fe57476a1cb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Acquiring lock "/opt/stack/data/nova/instances/e326a14c-61d7-4dca-b55f-db0f3ab0d14e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:52:33 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4d6e4e49-fc5b-4a23-9e46-0fe57476a1cb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lock "/opt/stack/data/nova/instances/e326a14c-61d7-4dca-b55f-db0f3ab0d14e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:52:33 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4d6e4e49-fc5b-4a23-9e46-0fe57476a1cb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lock "/opt/stack/data/nova/instances/e326a14c-61d7-4dca-b55f-db0f3ab0d14e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.018s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:52:33 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-4d6e4e49-fc5b-4a23-9e46-0fe57476a1cb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:52:34 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-4d6e4e49-fc5b-4a23-9e46-0fe57476a1cb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.187s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:52:34 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4d6e4e49-fc5b-4a23-9e46-0fe57476a1cb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Acquiring lock "fc7b140751b8c385de81623e40fb09ce09374ab7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:52:34 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4d6e4e49-fc5b-4a23-9e46-0fe57476a1cb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lock "fc7b140751b8c385de81623e40fb09ce09374ab7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:52:34 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-4d6e4e49-fc5b-4a23-9e46-0fe57476a1cb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:52:34 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-4d6e4e49-fc5b-4a23-9e46-0fe57476a1cb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.180s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:52:34 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-4d6e4e49-fc5b-4a23-9e46-0fe57476a1cb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7,backing_fmt=raw /opt/stack/data/nova/instances/e326a14c-61d7-4dca-b55f-db0f3ab0d14e/disk 1073741824 {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:52:34 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-4d6e4e49-fc5b-4a23-9e46-0fe57476a1cb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7,backing_fmt=raw /opt/stack/data/nova/instances/e326a14c-61d7-4dca-b55f-db0f3ab0d14e/disk 1073741824" returned: 0 in 0.050s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:52:34 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4d6e4e49-fc5b-4a23-9e46-0fe57476a1cb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lock "fc7b140751b8c385de81623e40fb09ce09374ab7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:52:34 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-4d6e4e49-fc5b-4a23-9e46-0fe57476a1cb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:52:34 user nova-compute[74337]: DEBUG nova.network.neutron [None req-4d6e4e49-fc5b-4a23-9e46-0fe57476a1cb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: e326a14c-61d7-4dca-b55f-db0f3ab0d14e] Successfully created port: 790838d0-4783-4446-84a9-2932fe826a36 {{(pid=74337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 21:52:34 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-4d6e4e49-fc5b-4a23-9e46-0fe57476a1cb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.198s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:52:34 user nova-compute[74337]: DEBUG nova.virt.disk.api [None req-4d6e4e49-fc5b-4a23-9e46-0fe57476a1cb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e326a14c-61d7-4dca-b55f-db0f3ab0d14e/disk. size=1073741824 {{(pid=74337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 21:52:34 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-4d6e4e49-fc5b-4a23-9e46-0fe57476a1cb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e326a14c-61d7-4dca-b55f-db0f3ab0d14e/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:52:34 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-4d6e4e49-fc5b-4a23-9e46-0fe57476a1cb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e326a14c-61d7-4dca-b55f-db0f3ab0d14e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:52:34 user nova-compute[74337]: DEBUG nova.virt.disk.api [None req-4d6e4e49-fc5b-4a23-9e46-0fe57476a1cb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Cannot resize image /opt/stack/data/nova/instances/e326a14c-61d7-4dca-b55f-db0f3ab0d14e/disk to a smaller size. {{(pid=74337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 21:52:34 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-4d6e4e49-fc5b-4a23-9e46-0fe57476a1cb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: e326a14c-61d7-4dca-b55f-db0f3ab0d14e] Created local disks {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 21:52:34 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-4d6e4e49-fc5b-4a23-9e46-0fe57476a1cb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: e326a14c-61d7-4dca-b55f-db0f3ab0d14e] Ensure instance console log exists: /opt/stack/data/nova/instances/e326a14c-61d7-4dca-b55f-db0f3ab0d14e/console.log {{(pid=74337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 21:52:34 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4d6e4e49-fc5b-4a23-9e46-0fe57476a1cb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:52:34 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4d6e4e49-fc5b-4a23-9e46-0fe57476a1cb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:52:34 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4d6e4e49-fc5b-4a23-9e46-0fe57476a1cb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:52:35 user nova-compute[74337]: DEBUG nova.network.neutron [None req-4d6e4e49-fc5b-4a23-9e46-0fe57476a1cb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: e326a14c-61d7-4dca-b55f-db0f3ab0d14e] Successfully updated port: 790838d0-4783-4446-84a9-2932fe826a36 {{(pid=74337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 21:52:35 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4d6e4e49-fc5b-4a23-9e46-0fe57476a1cb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Acquiring lock "refresh_cache-e326a14c-61d7-4dca-b55f-db0f3ab0d14e" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:52:35 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4d6e4e49-fc5b-4a23-9e46-0fe57476a1cb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Acquired lock "refresh_cache-e326a14c-61d7-4dca-b55f-db0f3ab0d14e" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:52:35 user nova-compute[74337]: DEBUG nova.network.neutron [None req-4d6e4e49-fc5b-4a23-9e46-0fe57476a1cb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: e326a14c-61d7-4dca-b55f-db0f3ab0d14e] Building network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 21:52:35 user nova-compute[74337]: DEBUG nova.compute.manager [req-b8632f8d-1fbc-4ade-aaa1-4c47e461d8f4 req-99ccee4b-cb3b-481a-bd4b-efc61e518cc8 service nova] [instance: e326a14c-61d7-4dca-b55f-db0f3ab0d14e] Received event network-changed-790838d0-4783-4446-84a9-2932fe826a36 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:52:35 user nova-compute[74337]: DEBUG nova.compute.manager [req-b8632f8d-1fbc-4ade-aaa1-4c47e461d8f4 req-99ccee4b-cb3b-481a-bd4b-efc61e518cc8 service nova] [instance: e326a14c-61d7-4dca-b55f-db0f3ab0d14e] Refreshing instance network info cache due to event network-changed-790838d0-4783-4446-84a9-2932fe826a36. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 21:52:35 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-b8632f8d-1fbc-4ade-aaa1-4c47e461d8f4 req-99ccee4b-cb3b-481a-bd4b-efc61e518cc8 service nova] Acquiring lock "refresh_cache-e326a14c-61d7-4dca-b55f-db0f3ab0d14e" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:52:35 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:52:35 user nova-compute[74337]: DEBUG nova.network.neutron [None req-4d6e4e49-fc5b-4a23-9e46-0fe57476a1cb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: e326a14c-61d7-4dca-b55f-db0f3ab0d14e] Instance cache missing network info. {{(pid=74337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 21:52:35 user nova-compute[74337]: DEBUG nova.network.neutron [None req-4d6e4e49-fc5b-4a23-9e46-0fe57476a1cb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: e326a14c-61d7-4dca-b55f-db0f3ab0d14e] Updating instance_info_cache with network_info: [{"id": "790838d0-4783-4446-84a9-2932fe826a36", "address": "fa:16:3e:99:b7:b3", "network": {"id": "fe0a9f00-e17b-4064-96d2-fd1cc848afb2", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1294741219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96dc585a51343db94529e22adbd6ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap790838d0-47", "ovs_interfaceid": "790838d0-4783-4446-84a9-2932fe826a36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:52:35 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4d6e4e49-fc5b-4a23-9e46-0fe57476a1cb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Releasing lock "refresh_cache-e326a14c-61d7-4dca-b55f-db0f3ab0d14e" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:52:35 user nova-compute[74337]: DEBUG nova.compute.manager [None req-4d6e4e49-fc5b-4a23-9e46-0fe57476a1cb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: e326a14c-61d7-4dca-b55f-db0f3ab0d14e] Instance network_info: |[{"id": "790838d0-4783-4446-84a9-2932fe826a36", "address": "fa:16:3e:99:b7:b3", "network": {"id": "fe0a9f00-e17b-4064-96d2-fd1cc848afb2", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1294741219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96dc585a51343db94529e22adbd6ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap790838d0-47", "ovs_interfaceid": "790838d0-4783-4446-84a9-2932fe826a36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 21:52:35 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-b8632f8d-1fbc-4ade-aaa1-4c47e461d8f4 req-99ccee4b-cb3b-481a-bd4b-efc61e518cc8 service nova] Acquired lock "refresh_cache-e326a14c-61d7-4dca-b55f-db0f3ab0d14e" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:52:35 user nova-compute[74337]: DEBUG nova.network.neutron [req-b8632f8d-1fbc-4ade-aaa1-4c47e461d8f4 req-99ccee4b-cb3b-481a-bd4b-efc61e518cc8 service nova] [instance: e326a14c-61d7-4dca-b55f-db0f3ab0d14e] Refreshing network info cache for port 790838d0-4783-4446-84a9-2932fe826a36 {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 21:52:35 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-4d6e4e49-fc5b-4a23-9e46-0fe57476a1cb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: e326a14c-61d7-4dca-b55f-db0f3ab0d14e] Start _get_guest_xml network_info=[{"id": "790838d0-4783-4446-84a9-2932fe826a36", "address": "fa:16:3e:99:b7:b3", "network": {"id": "fe0a9f00-e17b-4064-96d2-fd1cc848afb2", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1294741219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96dc585a51343db94529e22adbd6ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap790838d0-47", "ovs_interfaceid": "790838d0-4783-4446-84a9-2932fe826a36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T21:29:21Z,direct_url=<?>,disk_format='qcow2',id=d859d89d-998d-4109-b26a-0d6e28152932,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ff43462300764979a6cf688444336a56',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T21:29:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'image_id': 'd859d89d-998d-4109-b26a-0d6e28152932'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 21:52:35 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-4d6e4e49-fc5b-4a23-9e46-0fe57476a1cb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:52:35 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-4d6e4e49-fc5b-4a23-9e46-0fe57476a1cb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:52:35 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-4d6e4e49-fc5b-4a23-9e46-0fe57476a1cb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 21:52:35 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-4d6e4e49-fc5b-4a23-9e46-0fe57476a1cb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] CPU controller missing on host. {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 21:52:35 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-4d6e4e49-fc5b-4a23-9e46-0fe57476a1cb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 21:52:35 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-4d6e4e49-fc5b-4a23-9e46-0fe57476a1cb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] CPU controller found on host. {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 21:52:35 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-4d6e4e49-fc5b-4a23-9e46-0fe57476a1cb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 21:52:35 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-4d6e4e49-fc5b-4a23-9e46-0fe57476a1cb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T21:29:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T21:29:21Z,direct_url=<?>,disk_format='qcow2',id=d859d89d-998d-4109-b26a-0d6e28152932,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ff43462300764979a6cf688444336a56',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T21:29:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 21:52:35 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-4d6e4e49-fc5b-4a23-9e46-0fe57476a1cb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Flavor limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 21:52:35 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-4d6e4e49-fc5b-4a23-9e46-0fe57476a1cb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Image limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 21:52:35 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-4d6e4e49-fc5b-4a23-9e46-0fe57476a1cb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Flavor pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 21:52:35 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-4d6e4e49-fc5b-4a23-9e46-0fe57476a1cb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Image pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 21:52:35 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-4d6e4e49-fc5b-4a23-9e46-0fe57476a1cb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 21:52:35 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-4d6e4e49-fc5b-4a23-9e46-0fe57476a1cb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 21:52:35 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-4d6e4e49-fc5b-4a23-9e46-0fe57476a1cb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 21:52:35 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-4d6e4e49-fc5b-4a23-9e46-0fe57476a1cb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Got 1 possible topologies {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 21:52:35 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-4d6e4e49-fc5b-4a23-9e46-0fe57476a1cb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 21:52:35 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-4d6e4e49-fc5b-4a23-9e46-0fe57476a1cb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 21:52:35 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-4d6e4e49-fc5b-4a23-9e46-0fe57476a1cb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:52:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-883589621',display_name='tempest-AttachVolumeTestJSON-server-883589621',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-883589621',id=33,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMXiawn/xXLlNXuals9N80SKTPgilbzx8zrm5REUNwdQeLjTRNZtsfMfVN4o9Kl0PK5yeLRqeG4cHL1COX1nhO6WdGVYSwhLFqkXML72p3hCeKlcOjllsZNPOU9LYZyljQ==',key_name='tempest-keypair-200987838',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b96dc585a51343db94529e22adbd6ef3',ramdisk_id='',reservation_id='r-mzg5qo4n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-786463768',owner_user_name='tempest-AttachVolumeTestJSON-786463768-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:52:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c82d267bc4d142f8b48c66ffab721618',uuid=e326a14c-61d7-4dca-b55f-db0f3ab0d14e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "790838d0-4783-4446-84a9-2932fe826a36", "address": "fa:16:3e:99:b7:b3", "network": {"id": "fe0a9f00-e17b-4064-96d2-fd1cc848afb2", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1294741219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96dc585a51343db94529e22adbd6ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap790838d0-47", "ovs_interfaceid": "790838d0-4783-4446-84a9-2932fe826a36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 21:52:35 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-4d6e4e49-fc5b-4a23-9e46-0fe57476a1cb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Converting VIF {"id": "790838d0-4783-4446-84a9-2932fe826a36", "address": "fa:16:3e:99:b7:b3", "network": {"id": "fe0a9f00-e17b-4064-96d2-fd1cc848afb2", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1294741219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96dc585a51343db94529e22adbd6ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap790838d0-47", "ovs_interfaceid": "790838d0-4783-4446-84a9-2932fe826a36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:52:35 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-4d6e4e49-fc5b-4a23-9e46-0fe57476a1cb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:b7:b3,bridge_name='br-int',has_traffic_filtering=True,id=790838d0-4783-4446-84a9-2932fe826a36,network=Network(fe0a9f00-e17b-4064-96d2-fd1cc848afb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap790838d0-47') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:52:35 user nova-compute[74337]: DEBUG nova.objects.instance [None req-4d6e4e49-fc5b-4a23-9e46-0fe57476a1cb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lazy-loading 'pci_devices' on Instance uuid e326a14c-61d7-4dca-b55f-db0f3ab0d14e {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:52:35 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-4d6e4e49-fc5b-4a23-9e46-0fe57476a1cb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: e326a14c-61d7-4dca-b55f-db0f3ab0d14e] End _get_guest_xml xml=<domain type="kvm">
Oct 23 21:52:35 user nova-compute[74337]:   <uuid>e326a14c-61d7-4dca-b55f-db0f3ab0d14e</uuid>
Oct 23 21:52:35 user nova-compute[74337]:   <name>instance-00000021</name>
Oct 23 21:52:35 user nova-compute[74337]:   <memory>524288</memory>
Oct 23 21:52:35 user nova-compute[74337]:   <vcpu>1</vcpu>
Oct 23 21:52:35 user nova-compute[74337]:   <metadata>
Oct 23 21:52:35 user nova-compute[74337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 21:52:35 user nova-compute[74337]:       <nova:package version="0.0.0"/>
Oct 23 21:52:35 user nova-compute[74337]:       <nova:name>tempest-AttachVolumeTestJSON-server-883589621</nova:name>
Oct 23 21:52:35 user nova-compute[74337]:       <nova:creationTime>2023-10-23 21:52:35</nova:creationTime>
Oct 23 21:52:35 user nova-compute[74337]:       <nova:flavor name="m1.tiny">
Oct 23 21:52:35 user nova-compute[74337]:         <nova:memory>512</nova:memory>
Oct 23 21:52:35 user nova-compute[74337]:         <nova:disk>1</nova:disk>
Oct 23 21:52:35 user nova-compute[74337]:         <nova:swap>0</nova:swap>
Oct 23 21:52:35 user nova-compute[74337]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 21:52:35 user nova-compute[74337]:         <nova:vcpus>1</nova:vcpus>
Oct 23 21:52:35 user nova-compute[74337]:       </nova:flavor>
Oct 23 21:52:35 user nova-compute[74337]:       <nova:owner>
Oct 23 21:52:35 user nova-compute[74337]:         <nova:user uuid="c82d267bc4d142f8b48c66ffab721618">tempest-AttachVolumeTestJSON-786463768-project-member</nova:user>
Oct 23 21:52:35 user nova-compute[74337]:         <nova:project uuid="b96dc585a51343db94529e22adbd6ef3">tempest-AttachVolumeTestJSON-786463768</nova:project>
Oct 23 21:52:35 user nova-compute[74337]:       </nova:owner>
Oct 23 21:52:35 user nova-compute[74337]:       <nova:root type="image" uuid="d859d89d-998d-4109-b26a-0d6e28152932"/>
Oct 23 21:52:35 user nova-compute[74337]:       <nova:ports>
Oct 23 21:52:35 user nova-compute[74337]:         <nova:port uuid="790838d0-4783-4446-84a9-2932fe826a36">
Oct 23 21:52:35 user nova-compute[74337]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 23 21:52:35 user nova-compute[74337]:         </nova:port>
Oct 23 21:52:35 user nova-compute[74337]:       </nova:ports>
Oct 23 21:52:35 user nova-compute[74337]:     </nova:instance>
Oct 23 21:52:35 user nova-compute[74337]:   </metadata>
Oct 23 21:52:35 user nova-compute[74337]:   <sysinfo type="smbios">
Oct 23 21:52:35 user nova-compute[74337]:     <system>
Oct 23 21:52:35 user nova-compute[74337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 21:52:35 user nova-compute[74337]:       <entry name="product">OpenStack Nova</entry>
Oct 23 21:52:35 user nova-compute[74337]:       <entry name="version">0.0.0</entry>
Oct 23 21:52:35 user nova-compute[74337]:       <entry name="serial">e326a14c-61d7-4dca-b55f-db0f3ab0d14e</entry>
Oct 23 21:52:35 user nova-compute[74337]:       <entry name="uuid">e326a14c-61d7-4dca-b55f-db0f3ab0d14e</entry>
Oct 23 21:52:35 user nova-compute[74337]:       <entry name="family">Virtual Machine</entry>
Oct 23 21:52:35 user nova-compute[74337]:     </system>
Oct 23 21:52:35 user nova-compute[74337]:   </sysinfo>
Oct 23 21:52:35 user nova-compute[74337]:   <os>
Oct 23 21:52:35 user nova-compute[74337]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 21:52:35 user nova-compute[74337]:     <boot dev="hd"/>
Oct 23 21:52:35 user nova-compute[74337]:     <smbios mode="sysinfo"/>
Oct 23 21:52:35 user nova-compute[74337]:   </os>
Oct 23 21:52:35 user nova-compute[74337]:   <features>
Oct 23 21:52:35 user nova-compute[74337]:     <acpi/>
Oct 23 21:52:35 user nova-compute[74337]:     <apic/>
Oct 23 21:52:35 user nova-compute[74337]:     <vmcoreinfo/>
Oct 23 21:52:35 user nova-compute[74337]:   </features>
Oct 23 21:52:35 user nova-compute[74337]:   <clock offset="utc">
Oct 23 21:52:35 user nova-compute[74337]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 21:52:35 user nova-compute[74337]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 21:52:35 user nova-compute[74337]:     <timer name="hpet" present="no"/>
Oct 23 21:52:35 user nova-compute[74337]:   </clock>
Oct 23 21:52:35 user nova-compute[74337]:   <cpu mode="custom" match="exact">
Oct 23 21:52:35 user nova-compute[74337]:     <model>Nehalem</model>
Oct 23 21:52:35 user nova-compute[74337]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 21:52:35 user nova-compute[74337]:   </cpu>
Oct 23 21:52:35 user nova-compute[74337]:   <devices>
Oct 23 21:52:35 user nova-compute[74337]:     <disk type="file" device="disk">
Oct 23 21:52:35 user nova-compute[74337]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 21:52:35 user nova-compute[74337]:       <source file="/opt/stack/data/nova/instances/e326a14c-61d7-4dca-b55f-db0f3ab0d14e/disk"/>
Oct 23 21:52:35 user nova-compute[74337]:       <target dev="vda" bus="virtio"/>
Oct 23 21:52:35 user nova-compute[74337]:     </disk>
Oct 23 21:52:35 user nova-compute[74337]:     <interface type="ethernet">
Oct 23 21:52:35 user nova-compute[74337]:       <mac address="fa:16:3e:99:b7:b3"/>
Oct 23 21:52:35 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:52:35 user nova-compute[74337]:       <mtu size="1442"/>
Oct 23 21:52:35 user nova-compute[74337]:       <target dev="tap790838d0-47"/>
Oct 23 21:52:35 user nova-compute[74337]:     </interface>
Oct 23 21:52:35 user nova-compute[74337]:     <serial type="pty">
Oct 23 21:52:35 user nova-compute[74337]:       <log file="/opt/stack/data/nova/instances/e326a14c-61d7-4dca-b55f-db0f3ab0d14e/console.log" append="off"/>
Oct 23 21:52:35 user nova-compute[74337]:     </serial>
Oct 23 21:52:35 user nova-compute[74337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 21:52:35 user nova-compute[74337]:     <video>
Oct 23 21:52:35 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:52:35 user nova-compute[74337]:     </video>
Oct 23 21:52:35 user nova-compute[74337]:     <rng model="virtio">
Oct 23 21:52:35 user nova-compute[74337]:       <backend model="random">/dev/urandom</backend>
Oct 23 21:52:35 user nova-compute[74337]:     </rng>
Oct 23 21:52:35 user nova-compute[74337]:     <controller type="usb" index="0" model="none"/>
Oct 23 21:52:35 user nova-compute[74337]:     <memballoon model="virtio">
Oct 23 21:52:35 user nova-compute[74337]:       <stats period="10"/>
Oct 23 21:52:35 user nova-compute[74337]:     </memballoon>
Oct 23 21:52:35 user nova-compute[74337]:   </devices>
Oct 23 21:52:35 user nova-compute[74337]: </domain>
Oct 23 21:52:35 user nova-compute[74337]:  {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 21:52:35 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-4d6e4e49-fc5b-4a23-9e46-0fe57476a1cb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:52:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-883589621',display_name='tempest-AttachVolumeTestJSON-server-883589621',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-883589621',id=33,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMXiawn/xXLlNXuals9N80SKTPgilbzx8zrm5REUNwdQeLjTRNZtsfMfVN4o9Kl0PK5yeLRqeG4cHL1COX1nhO6WdGVYSwhLFqkXML72p3hCeKlcOjllsZNPOU9LYZyljQ==',key_name='tempest-keypair-200987838',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b96dc585a51343db94529e22adbd6ef3',ramdisk_id='',reservation_id='r-mzg5qo4n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-786463768',owner_user_name='tempest-AttachVolumeTestJSON-786463768-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:52:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c82d267bc4d142f8b48c66ffab721618',uuid=e326a14c-61d7-4dca-b55f-db0f3ab0d14e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "790838d0-4783-4446-84a9-2932fe826a36", "address": "fa:16:3e:99:b7:b3", "network": {"id": "fe0a9f00-e17b-4064-96d2-fd1cc848afb2", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1294741219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96dc585a51343db94529e22adbd6ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap790838d0-47", "ovs_interfaceid": "790838d0-4783-4446-84a9-2932fe826a36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 21:52:35 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-4d6e4e49-fc5b-4a23-9e46-0fe57476a1cb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Converting VIF {"id": "790838d0-4783-4446-84a9-2932fe826a36", "address": "fa:16:3e:99:b7:b3", "network": {"id": "fe0a9f00-e17b-4064-96d2-fd1cc848afb2", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1294741219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96dc585a51343db94529e22adbd6ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap790838d0-47", "ovs_interfaceid": "790838d0-4783-4446-84a9-2932fe826a36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:52:35 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-4d6e4e49-fc5b-4a23-9e46-0fe57476a1cb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:b7:b3,bridge_name='br-int',has_traffic_filtering=True,id=790838d0-4783-4446-84a9-2932fe826a36,network=Network(fe0a9f00-e17b-4064-96d2-fd1cc848afb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap790838d0-47') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:52:35 user nova-compute[74337]: DEBUG os_vif [None req-4d6e4e49-fc5b-4a23-9e46-0fe57476a1cb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:b7:b3,bridge_name='br-int',has_traffic_filtering=True,id=790838d0-4783-4446-84a9-2932fe826a36,network=Network(fe0a9f00-e17b-4064-96d2-fd1cc848afb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap790838d0-47') {{(pid=74337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 21:52:35 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:52:35 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:52:35 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 21:52:35 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:52:35 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6ba5116d-70f9-5897-9d08-0df3c46719a8', '_type': 'linux-noop'}}, row=False) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:52:35 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:52:35 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:52:35 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:52:35 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap790838d0-47, may_exist=True, interface_attrs={}) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:52:35 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap790838d0-47, col_values=(('qos', UUID('eece98a7-46c7-429c-9fa7-9e7a52c10fc3')),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:52:35 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap790838d0-47, col_values=(('external_ids', {'iface-id': '790838d0-4783-4446-84a9-2932fe826a36', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:99:b7:b3', 'vm-uuid': 'e326a14c-61d7-4dca-b55f-db0f3ab0d14e'}),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:52:35 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:52:35 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:52:35 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:52:35 user nova-compute[74337]: INFO os_vif [None req-4d6e4e49-fc5b-4a23-9e46-0fe57476a1cb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:b7:b3,bridge_name='br-int',has_traffic_filtering=True,id=790838d0-4783-4446-84a9-2932fe826a36,network=Network(fe0a9f00-e17b-4064-96d2-fd1cc848afb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap790838d0-47')
Oct 23 21:52:35 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-4d6e4e49-fc5b-4a23-9e46-0fe57476a1cb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] No BDM found with device name vda, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 21:52:35 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-4d6e4e49-fc5b-4a23-9e46-0fe57476a1cb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] No VIF found with MAC fa:16:3e:99:b7:b3, not building metadata {{(pid=74337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 21:52:36 user nova-compute[74337]: DEBUG nova.network.neutron [req-b8632f8d-1fbc-4ade-aaa1-4c47e461d8f4 req-99ccee4b-cb3b-481a-bd4b-efc61e518cc8 service nova] [instance: e326a14c-61d7-4dca-b55f-db0f3ab0d14e] Updated VIF entry in instance network info cache for port 790838d0-4783-4446-84a9-2932fe826a36. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 21:52:36 user nova-compute[74337]: DEBUG nova.network.neutron [req-b8632f8d-1fbc-4ade-aaa1-4c47e461d8f4 req-99ccee4b-cb3b-481a-bd4b-efc61e518cc8 service nova] [instance: e326a14c-61d7-4dca-b55f-db0f3ab0d14e] Updating instance_info_cache with network_info: [{"id": "790838d0-4783-4446-84a9-2932fe826a36", "address": "fa:16:3e:99:b7:b3", "network": {"id": "fe0a9f00-e17b-4064-96d2-fd1cc848afb2", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1294741219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96dc585a51343db94529e22adbd6ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap790838d0-47", "ovs_interfaceid": "790838d0-4783-4446-84a9-2932fe826a36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:52:36 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-b8632f8d-1fbc-4ade-aaa1-4c47e461d8f4 req-99ccee4b-cb3b-481a-bd4b-efc61e518cc8 service nova] Releasing lock "refresh_cache-e326a14c-61d7-4dca-b55f-db0f3ab0d14e" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:52:37 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:52:37 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:52:37 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:52:37 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:52:37 user nova-compute[74337]: DEBUG nova.compute.manager [req-46ce332a-39d3-4914-9b5a-337e5eaf6034 req-1ca6d9cc-d9d9-4270-932d-d006b2023a00 service nova] [instance: e326a14c-61d7-4dca-b55f-db0f3ab0d14e] Received event network-vif-plugged-790838d0-4783-4446-84a9-2932fe826a36 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:52:37 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-46ce332a-39d3-4914-9b5a-337e5eaf6034 req-1ca6d9cc-d9d9-4270-932d-d006b2023a00 service nova] Acquiring lock "e326a14c-61d7-4dca-b55f-db0f3ab0d14e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:52:37 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-46ce332a-39d3-4914-9b5a-337e5eaf6034 req-1ca6d9cc-d9d9-4270-932d-d006b2023a00 service nova] Lock "e326a14c-61d7-4dca-b55f-db0f3ab0d14e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:52:37 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-46ce332a-39d3-4914-9b5a-337e5eaf6034 req-1ca6d9cc-d9d9-4270-932d-d006b2023a00 service nova] Lock "e326a14c-61d7-4dca-b55f-db0f3ab0d14e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:52:37 user nova-compute[74337]: DEBUG nova.compute.manager [req-46ce332a-39d3-4914-9b5a-337e5eaf6034 req-1ca6d9cc-d9d9-4270-932d-d006b2023a00 service nova] [instance: e326a14c-61d7-4dca-b55f-db0f3ab0d14e] No waiting events found dispatching network-vif-plugged-790838d0-4783-4446-84a9-2932fe826a36 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:52:37 user nova-compute[74337]: WARNING nova.compute.manager [req-46ce332a-39d3-4914-9b5a-337e5eaf6034 req-1ca6d9cc-d9d9-4270-932d-d006b2023a00 service nova] [instance: e326a14c-61d7-4dca-b55f-db0f3ab0d14e] Received unexpected event network-vif-plugged-790838d0-4783-4446-84a9-2932fe826a36 for instance with vm_state building and task_state spawning.
Oct 23 21:52:37 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:52:37 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:52:37 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:52:38 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:52:39 user nova-compute[74337]: DEBUG nova.compute.manager [req-a90971a9-22ba-4077-a68c-a4884201aa8a req-61d7a50a-f62c-4039-a8da-e08669d84f95 service nova] [instance: e326a14c-61d7-4dca-b55f-db0f3ab0d14e] Received event network-vif-plugged-790838d0-4783-4446-84a9-2932fe826a36 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:52:39 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-a90971a9-22ba-4077-a68c-a4884201aa8a req-61d7a50a-f62c-4039-a8da-e08669d84f95 service nova] Acquiring lock "e326a14c-61d7-4dca-b55f-db0f3ab0d14e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:52:39 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-a90971a9-22ba-4077-a68c-a4884201aa8a req-61d7a50a-f62c-4039-a8da-e08669d84f95 service nova] Lock "e326a14c-61d7-4dca-b55f-db0f3ab0d14e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:52:39 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-a90971a9-22ba-4077-a68c-a4884201aa8a req-61d7a50a-f62c-4039-a8da-e08669d84f95 service nova] Lock "e326a14c-61d7-4dca-b55f-db0f3ab0d14e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:52:39 user nova-compute[74337]: DEBUG nova.compute.manager [req-a90971a9-22ba-4077-a68c-a4884201aa8a req-61d7a50a-f62c-4039-a8da-e08669d84f95 service nova] [instance: e326a14c-61d7-4dca-b55f-db0f3ab0d14e] No waiting events found dispatching network-vif-plugged-790838d0-4783-4446-84a9-2932fe826a36 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:52:39 user nova-compute[74337]: WARNING nova.compute.manager [req-a90971a9-22ba-4077-a68c-a4884201aa8a req-61d7a50a-f62c-4039-a8da-e08669d84f95 service nova] [instance: e326a14c-61d7-4dca-b55f-db0f3ab0d14e] Received unexpected event network-vif-plugged-790838d0-4783-4446-84a9-2932fe826a36 for instance with vm_state building and task_state spawning.
Oct 23 21:52:39 user nova-compute[74337]: DEBUG nova.compute.manager [None req-4d6e4e49-fc5b-4a23-9e46-0fe57476a1cb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: e326a14c-61d7-4dca-b55f-db0f3ab0d14e] Instance event wait completed in 0 seconds for  {{(pid=74337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 21:52:39 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-4d6e4e49-fc5b-4a23-9e46-0fe57476a1cb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: e326a14c-61d7-4dca-b55f-db0f3ab0d14e] Guest created on hypervisor {{(pid=74337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 21:52:39 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: e326a14c-61d7-4dca-b55f-db0f3ab0d14e] Instance spawned successfully.
Oct 23 21:52:39 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-4d6e4e49-fc5b-4a23-9e46-0fe57476a1cb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: e326a14c-61d7-4dca-b55f-db0f3ab0d14e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 21:52:39 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-4d6e4e49-fc5b-4a23-9e46-0fe57476a1cb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: e326a14c-61d7-4dca-b55f-db0f3ab0d14e] Found default for hw_cdrom_bus of ide {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:52:39 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-4d6e4e49-fc5b-4a23-9e46-0fe57476a1cb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: e326a14c-61d7-4dca-b55f-db0f3ab0d14e] Found default for hw_disk_bus of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:52:39 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-4d6e4e49-fc5b-4a23-9e46-0fe57476a1cb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: e326a14c-61d7-4dca-b55f-db0f3ab0d14e] Found default for hw_input_bus of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:52:39 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-4d6e4e49-fc5b-4a23-9e46-0fe57476a1cb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: e326a14c-61d7-4dca-b55f-db0f3ab0d14e] Found default for hw_pointer_model of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:52:39 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-4d6e4e49-fc5b-4a23-9e46-0fe57476a1cb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: e326a14c-61d7-4dca-b55f-db0f3ab0d14e] Found default for hw_video_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:52:39 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-4d6e4e49-fc5b-4a23-9e46-0fe57476a1cb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: e326a14c-61d7-4dca-b55f-db0f3ab0d14e] Found default for hw_vif_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:52:39 user nova-compute[74337]: INFO nova.compute.manager [None req-4d6e4e49-fc5b-4a23-9e46-0fe57476a1cb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: e326a14c-61d7-4dca-b55f-db0f3ab0d14e] Took 5.88 seconds to spawn the instance on the hypervisor.
Oct 23 21:52:39 user nova-compute[74337]: DEBUG nova.compute.manager [None req-4d6e4e49-fc5b-4a23-9e46-0fe57476a1cb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: e326a14c-61d7-4dca-b55f-db0f3ab0d14e] Checking state {{(pid=74337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 21:52:39 user nova-compute[74337]: INFO nova.compute.manager [None req-4d6e4e49-fc5b-4a23-9e46-0fe57476a1cb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: e326a14c-61d7-4dca-b55f-db0f3ab0d14e] Took 6.76 seconds to build instance.
Oct 23 21:52:39 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4d6e4e49-fc5b-4a23-9e46-0fe57476a1cb tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lock "e326a14c-61d7-4dca-b55f-db0f3ab0d14e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.859s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:52:40 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:52:43 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:52:45 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-edb6a182-a2aa-4783-a73f-5117d2be3cb5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Acquiring lock "86b0f8cc-bfec-42f2-b8cf-29f0603e3169" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:52:45 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-edb6a182-a2aa-4783-a73f-5117d2be3cb5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lock "86b0f8cc-bfec-42f2-b8cf-29f0603e3169" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:52:45 user nova-compute[74337]: DEBUG nova.compute.manager [None req-edb6a182-a2aa-4783-a73f-5117d2be3cb5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 86b0f8cc-bfec-42f2-b8cf-29f0603e3169] Starting instance... {{(pid=74337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 21:52:45 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-edb6a182-a2aa-4783-a73f-5117d2be3cb5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:52:45 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-edb6a182-a2aa-4783-a73f-5117d2be3cb5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:52:45 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-edb6a182-a2aa-4783-a73f-5117d2be3cb5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 21:52:45 user nova-compute[74337]: INFO nova.compute.claims [None req-edb6a182-a2aa-4783-a73f-5117d2be3cb5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 86b0f8cc-bfec-42f2-b8cf-29f0603e3169] Claim successful on node user
Oct 23 21:52:45 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-edb6a182-a2aa-4783-a73f-5117d2be3cb5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:52:45 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-edb6a182-a2aa-4783-a73f-5117d2be3cb5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:52:45 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-edb6a182-a2aa-4783-a73f-5117d2be3cb5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.440s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:52:45 user nova-compute[74337]: DEBUG nova.compute.manager [None req-edb6a182-a2aa-4783-a73f-5117d2be3cb5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 86b0f8cc-bfec-42f2-b8cf-29f0603e3169] Start building networks asynchronously for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 21:52:45 user nova-compute[74337]: DEBUG nova.compute.manager [None req-edb6a182-a2aa-4783-a73f-5117d2be3cb5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 86b0f8cc-bfec-42f2-b8cf-29f0603e3169] Allocating IP information in the background. {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 21:52:45 user nova-compute[74337]: DEBUG nova.network.neutron [None req-edb6a182-a2aa-4783-a73f-5117d2be3cb5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 86b0f8cc-bfec-42f2-b8cf-29f0603e3169] allocate_for_instance() {{(pid=74337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 21:52:45 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-edb6a182-a2aa-4783-a73f-5117d2be3cb5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 86b0f8cc-bfec-42f2-b8cf-29f0603e3169] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 21:52:45 user nova-compute[74337]: DEBUG nova.compute.manager [None req-edb6a182-a2aa-4783-a73f-5117d2be3cb5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 86b0f8cc-bfec-42f2-b8cf-29f0603e3169] Start building block device mappings for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 21:52:45 user nova-compute[74337]: DEBUG nova.policy [None req-edb6a182-a2aa-4783-a73f-5117d2be3cb5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6f6daa6653264905a5498e00f184080c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a25b3eed8548a5a324e55b28f26252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74337) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 21:52:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:52:45 user nova-compute[74337]: DEBUG nova.compute.manager [None req-edb6a182-a2aa-4783-a73f-5117d2be3cb5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 86b0f8cc-bfec-42f2-b8cf-29f0603e3169] Start spawning the instance on the hypervisor. {{(pid=74337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 21:52:45 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-edb6a182-a2aa-4783-a73f-5117d2be3cb5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 86b0f8cc-bfec-42f2-b8cf-29f0603e3169] Creating instance directory {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 21:52:45 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-edb6a182-a2aa-4783-a73f-5117d2be3cb5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 86b0f8cc-bfec-42f2-b8cf-29f0603e3169] Creating image(s)
Oct 23 21:52:45 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-edb6a182-a2aa-4783-a73f-5117d2be3cb5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Acquiring lock "/opt/stack/data/nova/instances/86b0f8cc-bfec-42f2-b8cf-29f0603e3169/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:52:45 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-edb6a182-a2aa-4783-a73f-5117d2be3cb5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lock "/opt/stack/data/nova/instances/86b0f8cc-bfec-42f2-b8cf-29f0603e3169/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:52:45 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-edb6a182-a2aa-4783-a73f-5117d2be3cb5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lock "/opt/stack/data/nova/instances/86b0f8cc-bfec-42f2-b8cf-29f0603e3169/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:52:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-edb6a182-a2aa-4783-a73f-5117d2be3cb5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:52:46 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-edb6a182-a2aa-4783-a73f-5117d2be3cb5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.211s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:52:46 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-edb6a182-a2aa-4783-a73f-5117d2be3cb5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Acquiring lock "fc7b140751b8c385de81623e40fb09ce09374ab7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:52:46 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-edb6a182-a2aa-4783-a73f-5117d2be3cb5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lock "fc7b140751b8c385de81623e40fb09ce09374ab7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:52:46 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-edb6a182-a2aa-4783-a73f-5117d2be3cb5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:52:46 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-edb6a182-a2aa-4783-a73f-5117d2be3cb5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.179s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:52:46 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-edb6a182-a2aa-4783-a73f-5117d2be3cb5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7,backing_fmt=raw /opt/stack/data/nova/instances/86b0f8cc-bfec-42f2-b8cf-29f0603e3169/disk 1073741824 {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:52:46 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-edb6a182-a2aa-4783-a73f-5117d2be3cb5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7,backing_fmt=raw /opt/stack/data/nova/instances/86b0f8cc-bfec-42f2-b8cf-29f0603e3169/disk 1073741824" returned: 0 in 0.051s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:52:46 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-edb6a182-a2aa-4783-a73f-5117d2be3cb5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lock "fc7b140751b8c385de81623e40fb09ce09374ab7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:52:46 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-edb6a182-a2aa-4783-a73f-5117d2be3cb5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:52:46 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-edb6a182-a2aa-4783-a73f-5117d2be3cb5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.194s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:52:46 user nova-compute[74337]: DEBUG nova.virt.disk.api [None req-edb6a182-a2aa-4783-a73f-5117d2be3cb5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Checking if we can resize image /opt/stack/data/nova/instances/86b0f8cc-bfec-42f2-b8cf-29f0603e3169/disk. size=1073741824 {{(pid=74337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 21:52:46 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-edb6a182-a2aa-4783-a73f-5117d2be3cb5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b0f8cc-bfec-42f2-b8cf-29f0603e3169/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:52:46 user nova-compute[74337]: DEBUG nova.network.neutron [None req-edb6a182-a2aa-4783-a73f-5117d2be3cb5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 86b0f8cc-bfec-42f2-b8cf-29f0603e3169] Successfully created port: 6a452d69-92a5-408b-a63e-c9a1d8501656 {{(pid=74337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 21:52:46 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-edb6a182-a2aa-4783-a73f-5117d2be3cb5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b0f8cc-bfec-42f2-b8cf-29f0603e3169/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:52:46 user nova-compute[74337]: DEBUG nova.virt.disk.api [None req-edb6a182-a2aa-4783-a73f-5117d2be3cb5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Cannot resize image /opt/stack/data/nova/instances/86b0f8cc-bfec-42f2-b8cf-29f0603e3169/disk to a smaller size. {{(pid=74337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 21:52:46 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-edb6a182-a2aa-4783-a73f-5117d2be3cb5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 86b0f8cc-bfec-42f2-b8cf-29f0603e3169] Created local disks {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 21:52:46 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-edb6a182-a2aa-4783-a73f-5117d2be3cb5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 86b0f8cc-bfec-42f2-b8cf-29f0603e3169] Ensure instance console log exists: /opt/stack/data/nova/instances/86b0f8cc-bfec-42f2-b8cf-29f0603e3169/console.log {{(pid=74337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 21:52:46 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-edb6a182-a2aa-4783-a73f-5117d2be3cb5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:52:46 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-edb6a182-a2aa-4783-a73f-5117d2be3cb5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:52:46 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-edb6a182-a2aa-4783-a73f-5117d2be3cb5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:52:47 user nova-compute[74337]: DEBUG nova.network.neutron [None req-edb6a182-a2aa-4783-a73f-5117d2be3cb5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 86b0f8cc-bfec-42f2-b8cf-29f0603e3169] Successfully updated port: 6a452d69-92a5-408b-a63e-c9a1d8501656 {{(pid=74337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 21:52:47 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-edb6a182-a2aa-4783-a73f-5117d2be3cb5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Acquiring lock "refresh_cache-86b0f8cc-bfec-42f2-b8cf-29f0603e3169" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:52:47 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-edb6a182-a2aa-4783-a73f-5117d2be3cb5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Acquired lock "refresh_cache-86b0f8cc-bfec-42f2-b8cf-29f0603e3169" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:52:47 user nova-compute[74337]: DEBUG nova.network.neutron [None req-edb6a182-a2aa-4783-a73f-5117d2be3cb5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 86b0f8cc-bfec-42f2-b8cf-29f0603e3169] Building network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 21:52:47 user nova-compute[74337]: DEBUG nova.compute.manager [req-dc69fafb-ca5a-46d1-91fa-743b0aa26fe7 req-d2fdf881-35f3-4523-aeb8-c09e8de52b1d service nova] [instance: 86b0f8cc-bfec-42f2-b8cf-29f0603e3169] Received event network-changed-6a452d69-92a5-408b-a63e-c9a1d8501656 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:52:47 user nova-compute[74337]: DEBUG nova.compute.manager [req-dc69fafb-ca5a-46d1-91fa-743b0aa26fe7 req-d2fdf881-35f3-4523-aeb8-c09e8de52b1d service nova] [instance: 86b0f8cc-bfec-42f2-b8cf-29f0603e3169] Refreshing instance network info cache due to event network-changed-6a452d69-92a5-408b-a63e-c9a1d8501656. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 21:52:47 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-dc69fafb-ca5a-46d1-91fa-743b0aa26fe7 req-d2fdf881-35f3-4523-aeb8-c09e8de52b1d service nova] Acquiring lock "refresh_cache-86b0f8cc-bfec-42f2-b8cf-29f0603e3169" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:52:47 user nova-compute[74337]: DEBUG nova.network.neutron [None req-edb6a182-a2aa-4783-a73f-5117d2be3cb5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 86b0f8cc-bfec-42f2-b8cf-29f0603e3169] Instance cache missing network info. {{(pid=74337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 21:52:47 user nova-compute[74337]: DEBUG nova.network.neutron [None req-edb6a182-a2aa-4783-a73f-5117d2be3cb5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 86b0f8cc-bfec-42f2-b8cf-29f0603e3169] Updating instance_info_cache with network_info: [{"id": "6a452d69-92a5-408b-a63e-c9a1d8501656", "address": "fa:16:3e:bf:09:19", "network": {"id": "787d9979-63ad-4318-b1d7-8ec69c5969fe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1847253864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84a25b3eed8548a5a324e55b28f26252", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a452d69-92", "ovs_interfaceid": "6a452d69-92a5-408b-a63e-c9a1d8501656", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:52:47 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-edb6a182-a2aa-4783-a73f-5117d2be3cb5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Releasing lock "refresh_cache-86b0f8cc-bfec-42f2-b8cf-29f0603e3169" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:52:47 user nova-compute[74337]: DEBUG nova.compute.manager [None req-edb6a182-a2aa-4783-a73f-5117d2be3cb5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 86b0f8cc-bfec-42f2-b8cf-29f0603e3169] Instance network_info: |[{"id": "6a452d69-92a5-408b-a63e-c9a1d8501656", "address": "fa:16:3e:bf:09:19", "network": {"id": "787d9979-63ad-4318-b1d7-8ec69c5969fe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1847253864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84a25b3eed8548a5a324e55b28f26252", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a452d69-92", "ovs_interfaceid": "6a452d69-92a5-408b-a63e-c9a1d8501656", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 21:52:47 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-dc69fafb-ca5a-46d1-91fa-743b0aa26fe7 req-d2fdf881-35f3-4523-aeb8-c09e8de52b1d service nova] Acquired lock "refresh_cache-86b0f8cc-bfec-42f2-b8cf-29f0603e3169" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:52:47 user nova-compute[74337]: DEBUG nova.network.neutron [req-dc69fafb-ca5a-46d1-91fa-743b0aa26fe7 req-d2fdf881-35f3-4523-aeb8-c09e8de52b1d service nova] [instance: 86b0f8cc-bfec-42f2-b8cf-29f0603e3169] Refreshing network info cache for port 6a452d69-92a5-408b-a63e-c9a1d8501656 {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 21:52:47 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-edb6a182-a2aa-4783-a73f-5117d2be3cb5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 86b0f8cc-bfec-42f2-b8cf-29f0603e3169] Start _get_guest_xml network_info=[{"id": "6a452d69-92a5-408b-a63e-c9a1d8501656", "address": "fa:16:3e:bf:09:19", "network": {"id": "787d9979-63ad-4318-b1d7-8ec69c5969fe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1847253864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84a25b3eed8548a5a324e55b28f26252", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a452d69-92", "ovs_interfaceid": "6a452d69-92a5-408b-a63e-c9a1d8501656", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T21:29:21Z,direct_url=<?>,disk_format='qcow2',id=d859d89d-998d-4109-b26a-0d6e28152932,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ff43462300764979a6cf688444336a56',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T21:29:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'image_id': 'd859d89d-998d-4109-b26a-0d6e28152932'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 21:52:47 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-edb6a182-a2aa-4783-a73f-5117d2be3cb5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:52:47 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-edb6a182-a2aa-4783-a73f-5117d2be3cb5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:52:47 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-edb6a182-a2aa-4783-a73f-5117d2be3cb5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 21:52:47 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-edb6a182-a2aa-4783-a73f-5117d2be3cb5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] CPU controller missing on host. {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 21:52:47 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-edb6a182-a2aa-4783-a73f-5117d2be3cb5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 21:52:47 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-edb6a182-a2aa-4783-a73f-5117d2be3cb5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] CPU controller found on host. {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 21:52:47 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-edb6a182-a2aa-4783-a73f-5117d2be3cb5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 21:52:47 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-edb6a182-a2aa-4783-a73f-5117d2be3cb5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T21:29:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T21:29:21Z,direct_url=<?>,disk_format='qcow2',id=d859d89d-998d-4109-b26a-0d6e28152932,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ff43462300764979a6cf688444336a56',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T21:29:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 21:52:47 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-edb6a182-a2aa-4783-a73f-5117d2be3cb5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Flavor limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 21:52:47 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-edb6a182-a2aa-4783-a73f-5117d2be3cb5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Image limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 21:52:47 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-edb6a182-a2aa-4783-a73f-5117d2be3cb5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Flavor pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 21:52:47 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-edb6a182-a2aa-4783-a73f-5117d2be3cb5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Image pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 21:52:47 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-edb6a182-a2aa-4783-a73f-5117d2be3cb5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 21:52:47 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-edb6a182-a2aa-4783-a73f-5117d2be3cb5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 21:52:47 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-edb6a182-a2aa-4783-a73f-5117d2be3cb5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 21:52:47 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-edb6a182-a2aa-4783-a73f-5117d2be3cb5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Got 1 possible topologies {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 21:52:47 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-edb6a182-a2aa-4783-a73f-5117d2be3cb5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 21:52:47 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-edb6a182-a2aa-4783-a73f-5117d2be3cb5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 21:52:47 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-edb6a182-a2aa-4783-a73f-5117d2be3cb5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:52:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1857992921',display_name='tempest-AttachVolumeNegativeTest-server-1857992921',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1857992921',id=34,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPk7BXXviQFk5M/2s3TeGeWZY/1ACAKpZBqvVMSbxL1/53JpQUgv7qrx/p22+KxK95XhL7hD8F2ndAxHcNa8fTJNItqcCjR3czlGUcmVpDTFiEMMCKefX/a82Ei4joAJhg==',key_name='tempest-keypair-1021732166',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='84a25b3eed8548a5a324e55b28f26252',ramdisk_id='',reservation_id='r-ic4s47yq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1446109887',owner_user_name='tempest-AttachVolumeNegativeTest-1446109887-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:52:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6f6daa6653264905a5498e00f184080c',uuid=86b0f8cc-bfec-42f2-b8cf-29f0603e3169,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a452d69-92a5-408b-a63e-c9a1d8501656", "address": "fa:16:3e:bf:09:19", "network": {"id": "787d9979-63ad-4318-b1d7-8ec69c5969fe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1847253864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84a25b3eed8548a5a324e55b28f26252", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a452d69-92", "ovs_interfaceid": "6a452d69-92a5-408b-a63e-c9a1d8501656", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 21:52:47 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-edb6a182-a2aa-4783-a73f-5117d2be3cb5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Converting VIF {"id": "6a452d69-92a5-408b-a63e-c9a1d8501656", "address": "fa:16:3e:bf:09:19", "network": {"id": "787d9979-63ad-4318-b1d7-8ec69c5969fe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1847253864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84a25b3eed8548a5a324e55b28f26252", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a452d69-92", "ovs_interfaceid": "6a452d69-92a5-408b-a63e-c9a1d8501656", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:52:47 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-edb6a182-a2aa-4783-a73f-5117d2be3cb5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:09:19,bridge_name='br-int',has_traffic_filtering=True,id=6a452d69-92a5-408b-a63e-c9a1d8501656,network=Network(787d9979-63ad-4318-b1d7-8ec69c5969fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a452d69-92') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:52:47 user nova-compute[74337]: DEBUG nova.objects.instance [None req-edb6a182-a2aa-4783-a73f-5117d2be3cb5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lazy-loading 'pci_devices' on Instance uuid 86b0f8cc-bfec-42f2-b8cf-29f0603e3169 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:52:47 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-edb6a182-a2aa-4783-a73f-5117d2be3cb5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 86b0f8cc-bfec-42f2-b8cf-29f0603e3169] End _get_guest_xml xml=<domain type="kvm">
Oct 23 21:52:47 user nova-compute[74337]:   <uuid>86b0f8cc-bfec-42f2-b8cf-29f0603e3169</uuid>
Oct 23 21:52:47 user nova-compute[74337]:   <name>instance-00000022</name>
Oct 23 21:52:47 user nova-compute[74337]:   <memory>524288</memory>
Oct 23 21:52:47 user nova-compute[74337]:   <vcpu>1</vcpu>
Oct 23 21:52:47 user nova-compute[74337]:   <metadata>
Oct 23 21:52:47 user nova-compute[74337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 21:52:47 user nova-compute[74337]:       <nova:package version="0.0.0"/>
Oct 23 21:52:47 user nova-compute[74337]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1857992921</nova:name>
Oct 23 21:52:47 user nova-compute[74337]:       <nova:creationTime>2023-10-23 21:52:47</nova:creationTime>
Oct 23 21:52:47 user nova-compute[74337]:       <nova:flavor name="m1.tiny">
Oct 23 21:52:47 user nova-compute[74337]:         <nova:memory>512</nova:memory>
Oct 23 21:52:47 user nova-compute[74337]:         <nova:disk>1</nova:disk>
Oct 23 21:52:47 user nova-compute[74337]:         <nova:swap>0</nova:swap>
Oct 23 21:52:47 user nova-compute[74337]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 21:52:47 user nova-compute[74337]:         <nova:vcpus>1</nova:vcpus>
Oct 23 21:52:47 user nova-compute[74337]:       </nova:flavor>
Oct 23 21:52:47 user nova-compute[74337]:       <nova:owner>
Oct 23 21:52:47 user nova-compute[74337]:         <nova:user uuid="6f6daa6653264905a5498e00f184080c">tempest-AttachVolumeNegativeTest-1446109887-project-member</nova:user>
Oct 23 21:52:47 user nova-compute[74337]:         <nova:project uuid="84a25b3eed8548a5a324e55b28f26252">tempest-AttachVolumeNegativeTest-1446109887</nova:project>
Oct 23 21:52:47 user nova-compute[74337]:       </nova:owner>
Oct 23 21:52:47 user nova-compute[74337]:       <nova:root type="image" uuid="d859d89d-998d-4109-b26a-0d6e28152932"/>
Oct 23 21:52:47 user nova-compute[74337]:       <nova:ports>
Oct 23 21:52:47 user nova-compute[74337]:         <nova:port uuid="6a452d69-92a5-408b-a63e-c9a1d8501656">
Oct 23 21:52:47 user nova-compute[74337]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 23 21:52:47 user nova-compute[74337]:         </nova:port>
Oct 23 21:52:47 user nova-compute[74337]:       </nova:ports>
Oct 23 21:52:47 user nova-compute[74337]:     </nova:instance>
Oct 23 21:52:47 user nova-compute[74337]:   </metadata>
Oct 23 21:52:47 user nova-compute[74337]:   <sysinfo type="smbios">
Oct 23 21:52:47 user nova-compute[74337]:     <system>
Oct 23 21:52:47 user nova-compute[74337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 21:52:47 user nova-compute[74337]:       <entry name="product">OpenStack Nova</entry>
Oct 23 21:52:47 user nova-compute[74337]:       <entry name="version">0.0.0</entry>
Oct 23 21:52:47 user nova-compute[74337]:       <entry name="serial">86b0f8cc-bfec-42f2-b8cf-29f0603e3169</entry>
Oct 23 21:52:47 user nova-compute[74337]:       <entry name="uuid">86b0f8cc-bfec-42f2-b8cf-29f0603e3169</entry>
Oct 23 21:52:47 user nova-compute[74337]:       <entry name="family">Virtual Machine</entry>
Oct 23 21:52:47 user nova-compute[74337]:     </system>
Oct 23 21:52:47 user nova-compute[74337]:   </sysinfo>
Oct 23 21:52:47 user nova-compute[74337]:   <os>
Oct 23 21:52:47 user nova-compute[74337]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 21:52:47 user nova-compute[74337]:     <boot dev="hd"/>
Oct 23 21:52:47 user nova-compute[74337]:     <smbios mode="sysinfo"/>
Oct 23 21:52:47 user nova-compute[74337]:   </os>
Oct 23 21:52:47 user nova-compute[74337]:   <features>
Oct 23 21:52:47 user nova-compute[74337]:     <acpi/>
Oct 23 21:52:47 user nova-compute[74337]:     <apic/>
Oct 23 21:52:47 user nova-compute[74337]:     <vmcoreinfo/>
Oct 23 21:52:47 user nova-compute[74337]:   </features>
Oct 23 21:52:47 user nova-compute[74337]:   <clock offset="utc">
Oct 23 21:52:47 user nova-compute[74337]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 21:52:47 user nova-compute[74337]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 21:52:47 user nova-compute[74337]:     <timer name="hpet" present="no"/>
Oct 23 21:52:47 user nova-compute[74337]:   </clock>
Oct 23 21:52:47 user nova-compute[74337]:   <cpu mode="custom" match="exact">
Oct 23 21:52:47 user nova-compute[74337]:     <model>Nehalem</model>
Oct 23 21:52:47 user nova-compute[74337]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 21:52:47 user nova-compute[74337]:   </cpu>
Oct 23 21:52:47 user nova-compute[74337]:   <devices>
Oct 23 21:52:47 user nova-compute[74337]:     <disk type="file" device="disk">
Oct 23 21:52:47 user nova-compute[74337]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 21:52:47 user nova-compute[74337]:       <source file="/opt/stack/data/nova/instances/86b0f8cc-bfec-42f2-b8cf-29f0603e3169/disk"/>
Oct 23 21:52:47 user nova-compute[74337]:       <target dev="vda" bus="virtio"/>
Oct 23 21:52:47 user nova-compute[74337]:     </disk>
Oct 23 21:52:47 user nova-compute[74337]:     <interface type="ethernet">
Oct 23 21:52:47 user nova-compute[74337]:       <mac address="fa:16:3e:bf:09:19"/>
Oct 23 21:52:47 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:52:47 user nova-compute[74337]:       <mtu size="1442"/>
Oct 23 21:52:47 user nova-compute[74337]:       <target dev="tap6a452d69-92"/>
Oct 23 21:52:47 user nova-compute[74337]:     </interface>
Oct 23 21:52:47 user nova-compute[74337]:     <serial type="pty">
Oct 23 21:52:47 user nova-compute[74337]:       <log file="/opt/stack/data/nova/instances/86b0f8cc-bfec-42f2-b8cf-29f0603e3169/console.log" append="off"/>
Oct 23 21:52:47 user nova-compute[74337]:     </serial>
Oct 23 21:52:47 user nova-compute[74337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 21:52:47 user nova-compute[74337]:     <video>
Oct 23 21:52:47 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:52:47 user nova-compute[74337]:     </video>
Oct 23 21:52:47 user nova-compute[74337]:     <rng model="virtio">
Oct 23 21:52:47 user nova-compute[74337]:       <backend model="random">/dev/urandom</backend>
Oct 23 21:52:47 user nova-compute[74337]:     </rng>
Oct 23 21:52:47 user nova-compute[74337]:     <controller type="usb" index="0" model="none"/>
Oct 23 21:52:47 user nova-compute[74337]:     <memballoon model="virtio">
Oct 23 21:52:47 user nova-compute[74337]:       <stats period="10"/>
Oct 23 21:52:47 user nova-compute[74337]:     </memballoon>
Oct 23 21:52:47 user nova-compute[74337]:   </devices>
Oct 23 21:52:47 user nova-compute[74337]: </domain>
Oct 23 21:52:47 user nova-compute[74337]:  {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 21:52:47 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-edb6a182-a2aa-4783-a73f-5117d2be3cb5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:52:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1857992921',display_name='tempest-AttachVolumeNegativeTest-server-1857992921',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1857992921',id=34,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPk7BXXviQFk5M/2s3TeGeWZY/1ACAKpZBqvVMSbxL1/53JpQUgv7qrx/p22+KxK95XhL7hD8F2ndAxHcNa8fTJNItqcCjR3czlGUcmVpDTFiEMMCKefX/a82Ei4joAJhg==',key_name='tempest-keypair-1021732166',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='84a25b3eed8548a5a324e55b28f26252',ramdisk_id='',reservation_id='r-ic4s47yq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1446109887',owner_user_name='tempest-AttachVolumeNegativeTest-1446109887-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:52:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6f6daa6653264905a5498e00f184080c',uuid=86b0f8cc-bfec-42f2-b8cf-29f0603e3169,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a452d69-92a5-408b-a63e-c9a1d8501656", "address": "fa:16:3e:bf:09:19", "network": {"id": "787d9979-63ad-4318-b1d7-8ec69c5969fe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1847253864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84a25b3eed8548a5a324e55b28f26252", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a452d69-92", "ovs_interfaceid": "6a452d69-92a5-408b-a63e-c9a1d8501656", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 21:52:47 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-edb6a182-a2aa-4783-a73f-5117d2be3cb5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Converting VIF {"id": "6a452d69-92a5-408b-a63e-c9a1d8501656", "address": "fa:16:3e:bf:09:19", "network": {"id": "787d9979-63ad-4318-b1d7-8ec69c5969fe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1847253864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84a25b3eed8548a5a324e55b28f26252", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a452d69-92", "ovs_interfaceid": "6a452d69-92a5-408b-a63e-c9a1d8501656", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:52:47 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-edb6a182-a2aa-4783-a73f-5117d2be3cb5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:09:19,bridge_name='br-int',has_traffic_filtering=True,id=6a452d69-92a5-408b-a63e-c9a1d8501656,network=Network(787d9979-63ad-4318-b1d7-8ec69c5969fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a452d69-92') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:52:47 user nova-compute[74337]: DEBUG os_vif [None req-edb6a182-a2aa-4783-a73f-5117d2be3cb5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:09:19,bridge_name='br-int',has_traffic_filtering=True,id=6a452d69-92a5-408b-a63e-c9a1d8501656,network=Network(787d9979-63ad-4318-b1d7-8ec69c5969fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a452d69-92') {{(pid=74337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 21:52:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:52:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:52:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 21:52:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:52:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c5af4d79-da10-509d-8566-70ea95fbd010', '_type': 'linux-noop'}}, row=False) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:52:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:52:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:52:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:52:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6a452d69-92, may_exist=True, interface_attrs={}) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:52:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6a452d69-92, col_values=(('qos', UUID('27f78bee-8622-498d-8908-adbcb32df789')),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:52:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6a452d69-92, col_values=(('external_ids', {'iface-id': '6a452d69-92a5-408b-a63e-c9a1d8501656', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bf:09:19', 'vm-uuid': '86b0f8cc-bfec-42f2-b8cf-29f0603e3169'}),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:52:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:52:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:52:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:52:47 user nova-compute[74337]: INFO os_vif [None req-edb6a182-a2aa-4783-a73f-5117d2be3cb5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:09:19,bridge_name='br-int',has_traffic_filtering=True,id=6a452d69-92a5-408b-a63e-c9a1d8501656,network=Network(787d9979-63ad-4318-b1d7-8ec69c5969fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a452d69-92')
Oct 23 21:52:47 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-edb6a182-a2aa-4783-a73f-5117d2be3cb5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] No BDM found with device name vda, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 21:52:47 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-edb6a182-a2aa-4783-a73f-5117d2be3cb5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] No VIF found with MAC fa:16:3e:bf:09:19, not building metadata {{(pid=74337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 21:52:47 user nova-compute[74337]: DEBUG nova.network.neutron [req-dc69fafb-ca5a-46d1-91fa-743b0aa26fe7 req-d2fdf881-35f3-4523-aeb8-c09e8de52b1d service nova] [instance: 86b0f8cc-bfec-42f2-b8cf-29f0603e3169] Updated VIF entry in instance network info cache for port 6a452d69-92a5-408b-a63e-c9a1d8501656. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 21:52:47 user nova-compute[74337]: DEBUG nova.network.neutron [req-dc69fafb-ca5a-46d1-91fa-743b0aa26fe7 req-d2fdf881-35f3-4523-aeb8-c09e8de52b1d service nova] [instance: 86b0f8cc-bfec-42f2-b8cf-29f0603e3169] Updating instance_info_cache with network_info: [{"id": "6a452d69-92a5-408b-a63e-c9a1d8501656", "address": "fa:16:3e:bf:09:19", "network": {"id": "787d9979-63ad-4318-b1d7-8ec69c5969fe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1847253864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84a25b3eed8548a5a324e55b28f26252", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a452d69-92", "ovs_interfaceid": "6a452d69-92a5-408b-a63e-c9a1d8501656", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:52:47 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-dc69fafb-ca5a-46d1-91fa-743b0aa26fe7 req-d2fdf881-35f3-4523-aeb8-c09e8de52b1d service nova] Releasing lock "refresh_cache-86b0f8cc-bfec-42f2-b8cf-29f0603e3169" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:52:48 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:52:49 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:52:49 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:52:49 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:52:49 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:52:49 user nova-compute[74337]: DEBUG nova.compute.manager [req-71d41e95-2bf3-4ae8-9242-837e63389b60 req-2528fb03-70cf-4afe-a258-0b0898ca6dd9 service nova] [instance: 86b0f8cc-bfec-42f2-b8cf-29f0603e3169] Received event network-vif-plugged-6a452d69-92a5-408b-a63e-c9a1d8501656 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:52:49 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-71d41e95-2bf3-4ae8-9242-837e63389b60 req-2528fb03-70cf-4afe-a258-0b0898ca6dd9 service nova] Acquiring lock "86b0f8cc-bfec-42f2-b8cf-29f0603e3169-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:52:49 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-71d41e95-2bf3-4ae8-9242-837e63389b60 req-2528fb03-70cf-4afe-a258-0b0898ca6dd9 service nova] Lock "86b0f8cc-bfec-42f2-b8cf-29f0603e3169-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:52:49 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-71d41e95-2bf3-4ae8-9242-837e63389b60 req-2528fb03-70cf-4afe-a258-0b0898ca6dd9 service nova] Lock "86b0f8cc-bfec-42f2-b8cf-29f0603e3169-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:52:49 user nova-compute[74337]: DEBUG nova.compute.manager [req-71d41e95-2bf3-4ae8-9242-837e63389b60 req-2528fb03-70cf-4afe-a258-0b0898ca6dd9 service nova] [instance: 86b0f8cc-bfec-42f2-b8cf-29f0603e3169] No waiting events found dispatching network-vif-plugged-6a452d69-92a5-408b-a63e-c9a1d8501656 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:52:49 user nova-compute[74337]: WARNING nova.compute.manager [req-71d41e95-2bf3-4ae8-9242-837e63389b60 req-2528fb03-70cf-4afe-a258-0b0898ca6dd9 service nova] [instance: 86b0f8cc-bfec-42f2-b8cf-29f0603e3169] Received unexpected event network-vif-plugged-6a452d69-92a5-408b-a63e-c9a1d8501656 for instance with vm_state building and task_state spawning.
Oct 23 21:52:50 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:52:50 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:52:50 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:52:51 user nova-compute[74337]: DEBUG nova.compute.manager [None req-edb6a182-a2aa-4783-a73f-5117d2be3cb5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 86b0f8cc-bfec-42f2-b8cf-29f0603e3169] Instance event wait completed in 0 seconds for  {{(pid=74337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 21:52:51 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-edb6a182-a2aa-4783-a73f-5117d2be3cb5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 86b0f8cc-bfec-42f2-b8cf-29f0603e3169] Guest created on hypervisor {{(pid=74337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 21:52:51 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: 86b0f8cc-bfec-42f2-b8cf-29f0603e3169] Instance spawned successfully.
Oct 23 21:52:51 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-edb6a182-a2aa-4783-a73f-5117d2be3cb5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 86b0f8cc-bfec-42f2-b8cf-29f0603e3169] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 21:52:51 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-edb6a182-a2aa-4783-a73f-5117d2be3cb5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 86b0f8cc-bfec-42f2-b8cf-29f0603e3169] Found default for hw_cdrom_bus of ide {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:52:51 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-edb6a182-a2aa-4783-a73f-5117d2be3cb5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 86b0f8cc-bfec-42f2-b8cf-29f0603e3169] Found default for hw_disk_bus of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:52:51 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-edb6a182-a2aa-4783-a73f-5117d2be3cb5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 86b0f8cc-bfec-42f2-b8cf-29f0603e3169] Found default for hw_input_bus of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:52:51 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-edb6a182-a2aa-4783-a73f-5117d2be3cb5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 86b0f8cc-bfec-42f2-b8cf-29f0603e3169] Found default for hw_pointer_model of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:52:51 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-edb6a182-a2aa-4783-a73f-5117d2be3cb5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 86b0f8cc-bfec-42f2-b8cf-29f0603e3169] Found default for hw_video_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:52:51 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-edb6a182-a2aa-4783-a73f-5117d2be3cb5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 86b0f8cc-bfec-42f2-b8cf-29f0603e3169] Found default for hw_vif_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:52:51 user nova-compute[74337]: DEBUG nova.compute.manager [req-7fa3981e-ac40-4049-bf1f-9edb64eb6b95 req-add49f11-8f3b-45f9-a4b0-8a5c730f2fcf service nova] [instance: 86b0f8cc-bfec-42f2-b8cf-29f0603e3169] Received event network-vif-plugged-6a452d69-92a5-408b-a63e-c9a1d8501656 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:52:51 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-7fa3981e-ac40-4049-bf1f-9edb64eb6b95 req-add49f11-8f3b-45f9-a4b0-8a5c730f2fcf service nova] Acquiring lock "86b0f8cc-bfec-42f2-b8cf-29f0603e3169-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:52:51 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-7fa3981e-ac40-4049-bf1f-9edb64eb6b95 req-add49f11-8f3b-45f9-a4b0-8a5c730f2fcf service nova] Lock "86b0f8cc-bfec-42f2-b8cf-29f0603e3169-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:52:51 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-7fa3981e-ac40-4049-bf1f-9edb64eb6b95 req-add49f11-8f3b-45f9-a4b0-8a5c730f2fcf service nova] Lock "86b0f8cc-bfec-42f2-b8cf-29f0603e3169-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:52:51 user nova-compute[74337]: DEBUG nova.compute.manager [req-7fa3981e-ac40-4049-bf1f-9edb64eb6b95 req-add49f11-8f3b-45f9-a4b0-8a5c730f2fcf service nova] [instance: 86b0f8cc-bfec-42f2-b8cf-29f0603e3169] No waiting events found dispatching network-vif-plugged-6a452d69-92a5-408b-a63e-c9a1d8501656 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:52:51 user nova-compute[74337]: WARNING nova.compute.manager [req-7fa3981e-ac40-4049-bf1f-9edb64eb6b95 req-add49f11-8f3b-45f9-a4b0-8a5c730f2fcf service nova] [instance: 86b0f8cc-bfec-42f2-b8cf-29f0603e3169] Received unexpected event network-vif-plugged-6a452d69-92a5-408b-a63e-c9a1d8501656 for instance with vm_state building and task_state spawning.
Oct 23 21:52:51 user nova-compute[74337]: INFO nova.compute.manager [None req-edb6a182-a2aa-4783-a73f-5117d2be3cb5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 86b0f8cc-bfec-42f2-b8cf-29f0603e3169] Took 5.93 seconds to spawn the instance on the hypervisor.
Oct 23 21:52:51 user nova-compute[74337]: DEBUG nova.compute.manager [None req-edb6a182-a2aa-4783-a73f-5117d2be3cb5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 86b0f8cc-bfec-42f2-b8cf-29f0603e3169] Checking state {{(pid=74337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 21:52:51 user nova-compute[74337]: INFO nova.compute.manager [None req-edb6a182-a2aa-4783-a73f-5117d2be3cb5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 86b0f8cc-bfec-42f2-b8cf-29f0603e3169] Took 6.77 seconds to build instance.
Oct 23 21:52:51 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-edb6a182-a2aa-4783-a73f-5117d2be3cb5 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lock "86b0f8cc-bfec-42f2-b8cf-29f0603e3169" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.877s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:52:52 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:52:53 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:52:56 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:52:57 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:52:58 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:52:58 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:53:02 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:53:02 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:53:03 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:53:04 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:53:07 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:53:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:53:08 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Acquiring lock "d5d9d286-4837-4168-a4fe-1bc09e372654" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:53:08 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Lock "d5d9d286-4837-4168-a4fe-1bc09e372654" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:53:08 user nova-compute[74337]: DEBUG nova.compute.manager [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] Starting instance... {{(pid=74337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 21:53:08 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:53:08 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:53:09 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 21:53:09 user nova-compute[74337]: INFO nova.compute.claims [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] Claim successful on node user
Oct 23 21:53:09 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:53:09 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:53:09 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.413s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:53:09 user nova-compute[74337]: DEBUG nova.compute.manager [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] Start building networks asynchronously for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 21:53:09 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:53:09 user nova-compute[74337]: DEBUG nova.compute.manager [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] Allocating IP information in the background. {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 21:53:09 user nova-compute[74337]: DEBUG nova.network.neutron [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] allocate_for_instance() {{(pid=74337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 21:53:09 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 21:53:09 user nova-compute[74337]: DEBUG nova.compute.manager [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] Start building block device mappings for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 21:53:09 user nova-compute[74337]: DEBUG nova.compute.manager [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] Start spawning the instance on the hypervisor. {{(pid=74337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 21:53:09 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] Creating instance directory {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 21:53:09 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] Creating image(s)
Oct 23 21:53:09 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Acquiring lock "/opt/stack/data/nova/instances/d5d9d286-4837-4168-a4fe-1bc09e372654/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:53:09 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Lock "/opt/stack/data/nova/instances/d5d9d286-4837-4168-a4fe-1bc09e372654/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:53:09 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Lock "/opt/stack/data/nova/instances/d5d9d286-4837-4168-a4fe-1bc09e372654/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:53:09 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Acquiring lock "746adc44036d2a3e69d18431dbb1bdef949c3377" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:53:09 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Lock "746adc44036d2a3e69d18431dbb1bdef949c3377" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:53:09 user nova-compute[74337]: DEBUG nova.policy [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5a20c05457014209a86f285fcc9dd506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965415a9973d4714aa49a64d34b232a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74337) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 21:53:10 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/746adc44036d2a3e69d18431dbb1bdef949c3377.part --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:53:10 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:53:10 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:53:10 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 21:53:10 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/746adc44036d2a3e69d18431dbb1bdef949c3377.part --force-share --output=json" returned: 0 in 0.212s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:53:10 user nova-compute[74337]: DEBUG nova.virt.images [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] c9f5f8ff-7674-48c5-a008-032e4795ab33 was qcow2, converting to raw {{(pid=74337) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 23 21:53:10 user nova-compute[74337]: DEBUG nova.privsep.utils [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74337) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 23 21:53:10 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/746adc44036d2a3e69d18431dbb1bdef949c3377.part /opt/stack/data/nova/instances/_base/746adc44036d2a3e69d18431dbb1bdef949c3377.converted {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:53:11 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/746adc44036d2a3e69d18431dbb1bdef949c3377.part /opt/stack/data/nova/instances/_base/746adc44036d2a3e69d18431dbb1bdef949c3377.converted" returned: 0 in 0.414s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:53:11 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/746adc44036d2a3e69d18431dbb1bdef949c3377.converted --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:53:11 user nova-compute[74337]: DEBUG nova.network.neutron [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] Successfully created port: 16ee3173-b704-43aa-9c44-ffa4d4d82fc4 {{(pid=74337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 21:53:11 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/746adc44036d2a3e69d18431dbb1bdef949c3377.converted --force-share --output=json" returned: 0 in 0.196s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:53:11 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Lock "746adc44036d2a3e69d18431dbb1bdef949c3377" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.721s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:53:11 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/746adc44036d2a3e69d18431dbb1bdef949c3377 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:53:11 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:53:11 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:53:11 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Starting heal instance info cache {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 21:53:11 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/746adc44036d2a3e69d18431dbb1bdef949c3377 --force-share --output=json" returned: 0 in 0.188s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:53:11 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Acquiring lock "746adc44036d2a3e69d18431dbb1bdef949c3377" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:53:11 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Lock "746adc44036d2a3e69d18431dbb1bdef949c3377" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:53:11 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/746adc44036d2a3e69d18431dbb1bdef949c3377 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:53:11 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "refresh_cache-547c4d4c-e0dd-495a-b83f-98426d0a4a99" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:53:11 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquired lock "refresh_cache-547c4d4c-e0dd-495a-b83f-98426d0a4a99" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:53:11 user nova-compute[74337]: DEBUG nova.network.neutron [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 547c4d4c-e0dd-495a-b83f-98426d0a4a99] Forcefully refreshing network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 21:53:11 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/746adc44036d2a3e69d18431dbb1bdef949c3377 --force-share --output=json" returned: 0 in 0.205s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:53:11 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/746adc44036d2a3e69d18431dbb1bdef949c3377,backing_fmt=raw /opt/stack/data/nova/instances/d5d9d286-4837-4168-a4fe-1bc09e372654/disk 1073741824 {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:53:11 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/746adc44036d2a3e69d18431dbb1bdef949c3377,backing_fmt=raw /opt/stack/data/nova/instances/d5d9d286-4837-4168-a4fe-1bc09e372654/disk 1073741824" returned: 0 in 0.057s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:53:11 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Lock "746adc44036d2a3e69d18431dbb1bdef949c3377" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:53:11 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/746adc44036d2a3e69d18431dbb1bdef949c3377 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:53:12 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/746adc44036d2a3e69d18431dbb1bdef949c3377 --force-share --output=json" returned: 0 in 0.181s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:53:12 user nova-compute[74337]: DEBUG nova.virt.disk.api [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d5d9d286-4837-4168-a4fe-1bc09e372654/disk. size=1073741824 {{(pid=74337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 21:53:12 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5d9d286-4837-4168-a4fe-1bc09e372654/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:53:12 user nova-compute[74337]: DEBUG nova.compute.manager [req-27d5810f-4a5f-4de4-8ac1-4329e90b5de2 req-9ca06400-af11-400b-b251-c7792f293571 service nova] [instance: 0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b] Received event network-changed-e15964dc-04e9-4b21-947c-2de7ed87e0ba {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:53:12 user nova-compute[74337]: DEBUG nova.compute.manager [req-27d5810f-4a5f-4de4-8ac1-4329e90b5de2 req-9ca06400-af11-400b-b251-c7792f293571 service nova] [instance: 0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b] Refreshing instance network info cache due to event network-changed-e15964dc-04e9-4b21-947c-2de7ed87e0ba. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 21:53:12 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-27d5810f-4a5f-4de4-8ac1-4329e90b5de2 req-9ca06400-af11-400b-b251-c7792f293571 service nova] Acquiring lock "refresh_cache-0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:53:12 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-27d5810f-4a5f-4de4-8ac1-4329e90b5de2 req-9ca06400-af11-400b-b251-c7792f293571 service nova] Acquired lock "refresh_cache-0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:53:12 user nova-compute[74337]: DEBUG nova.network.neutron [req-27d5810f-4a5f-4de4-8ac1-4329e90b5de2 req-9ca06400-af11-400b-b251-c7792f293571 service nova] [instance: 0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b] Refreshing network info cache for port e15964dc-04e9-4b21-947c-2de7ed87e0ba {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 21:53:12 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5d9d286-4837-4168-a4fe-1bc09e372654/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:53:12 user nova-compute[74337]: DEBUG nova.virt.disk.api [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Cannot resize image /opt/stack/data/nova/instances/d5d9d286-4837-4168-a4fe-1bc09e372654/disk to a smaller size. {{(pid=74337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 21:53:12 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] Created local disks {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 21:53:12 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] Ensure instance console log exists: /opt/stack/data/nova/instances/d5d9d286-4837-4168-a4fe-1bc09e372654/console.log {{(pid=74337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 21:53:12 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:53:12 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:53:12 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:53:12 user nova-compute[74337]: DEBUG nova.network.neutron [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 547c4d4c-e0dd-495a-b83f-98426d0a4a99] Updating instance_info_cache with network_info: [{"id": "2dd20d7f-9490-476a-90ed-e6a1c9085e4d", "address": "fa:16:3e:5f:e1:f7", "network": {"id": "aff1f95f-fda8-4f0f-8d10-7e3d587e4fda", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2048135647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1f57e58a9ec4c6384dc0d3ca58eb610", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd20d7f-94", "ovs_interfaceid": "2dd20d7f-9490-476a-90ed-e6a1c9085e4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:53:12 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Releasing lock "refresh_cache-547c4d4c-e0dd-495a-b83f-98426d0a4a99" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:53:12 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 547c4d4c-e0dd-495a-b83f-98426d0a4a99] Updated the network info_cache for instance {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 21:53:12 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:53:12 user nova-compute[74337]: DEBUG nova.network.neutron [req-27d5810f-4a5f-4de4-8ac1-4329e90b5de2 req-9ca06400-af11-400b-b251-c7792f293571 service nova] [instance: 0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b] Updated VIF entry in instance network info cache for port e15964dc-04e9-4b21-947c-2de7ed87e0ba. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 21:53:12 user nova-compute[74337]: DEBUG nova.network.neutron [req-27d5810f-4a5f-4de4-8ac1-4329e90b5de2 req-9ca06400-af11-400b-b251-c7792f293571 service nova] [instance: 0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b] Updating instance_info_cache with network_info: [{"id": "e15964dc-04e9-4b21-947c-2de7ed87e0ba", "address": "fa:16:3e:72:6e:20", "network": {"id": "5a18e96f-a6eb-4989-9be3-154b54928b03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-507511840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb567547bd4941fb87435a841c9d17c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape15964dc-04", "ovs_interfaceid": "e15964dc-04e9-4b21-947c-2de7ed87e0ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:53:12 user nova-compute[74337]: DEBUG nova.network.neutron [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] Successfully updated port: 16ee3173-b704-43aa-9c44-ffa4d4d82fc4 {{(pid=74337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 21:53:12 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Acquiring lock "refresh_cache-d5d9d286-4837-4168-a4fe-1bc09e372654" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:53:12 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Acquired lock "refresh_cache-d5d9d286-4837-4168-a4fe-1bc09e372654" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:53:12 user nova-compute[74337]: DEBUG nova.network.neutron [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] Building network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 21:53:12 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-27d5810f-4a5f-4de4-8ac1-4329e90b5de2 req-9ca06400-af11-400b-b251-c7792f293571 service nova] Releasing lock "refresh_cache-0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:53:12 user nova-compute[74337]: DEBUG nova.compute.manager [req-1baf75ab-5611-4ba1-94b9-9d30699affdd req-da318639-12ce-4990-b09d-20bd8ccf7ed2 service nova] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] Received event network-changed-16ee3173-b704-43aa-9c44-ffa4d4d82fc4 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:53:12 user nova-compute[74337]: DEBUG nova.compute.manager [req-1baf75ab-5611-4ba1-94b9-9d30699affdd req-da318639-12ce-4990-b09d-20bd8ccf7ed2 service nova] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] Refreshing instance network info cache due to event network-changed-16ee3173-b704-43aa-9c44-ffa4d4d82fc4. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 21:53:12 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-1baf75ab-5611-4ba1-94b9-9d30699affdd req-da318639-12ce-4990-b09d-20bd8ccf7ed2 service nova] Acquiring lock "refresh_cache-d5d9d286-4837-4168-a4fe-1bc09e372654" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:53:12 user nova-compute[74337]: DEBUG nova.network.neutron [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] Instance cache missing network info. {{(pid=74337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 21:53:12 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-96e151a9-a9d6-4014-9300-5666708dfb23 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Acquiring lock "0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:53:12 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-96e151a9-a9d6-4014-9300-5666708dfb23 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:53:12 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-96e151a9-a9d6-4014-9300-5666708dfb23 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Acquiring lock "0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:53:12 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-96e151a9-a9d6-4014-9300-5666708dfb23 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:53:12 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-96e151a9-a9d6-4014-9300-5666708dfb23 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:53:12 user nova-compute[74337]: INFO nova.compute.manager [None req-96e151a9-a9d6-4014-9300-5666708dfb23 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b] Terminating instance
Oct 23 21:53:12 user nova-compute[74337]: DEBUG nova.compute.manager [None req-96e151a9-a9d6-4014-9300-5666708dfb23 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b] Start destroying the instance on the hypervisor. {{(pid=74337) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 21:53:12 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:53:12 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:53:12 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:53:12 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:53:12 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:53:12 user nova-compute[74337]: DEBUG nova.network.neutron [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] Updating instance_info_cache with network_info: [{"id": "16ee3173-b704-43aa-9c44-ffa4d4d82fc4", "address": "fa:16:3e:be:e5:9b", "network": {"id": "0b1d82b0-acba-470e-aede-1c57a85a8ed3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1250228933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "965415a9973d4714aa49a64d34b232a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16ee3173-b7", "ovs_interfaceid": "16ee3173-b704-43aa-9c44-ffa4d4d82fc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:53:13 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Releasing lock "refresh_cache-d5d9d286-4837-4168-a4fe-1bc09e372654" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:53:13 user nova-compute[74337]: DEBUG nova.compute.manager [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] Instance network_info: |[{"id": "16ee3173-b704-43aa-9c44-ffa4d4d82fc4", "address": "fa:16:3e:be:e5:9b", "network": {"id": "0b1d82b0-acba-470e-aede-1c57a85a8ed3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1250228933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "965415a9973d4714aa49a64d34b232a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16ee3173-b7", "ovs_interfaceid": "16ee3173-b704-43aa-9c44-ffa4d4d82fc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 21:53:13 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-1baf75ab-5611-4ba1-94b9-9d30699affdd req-da318639-12ce-4990-b09d-20bd8ccf7ed2 service nova] Acquired lock "refresh_cache-d5d9d286-4837-4168-a4fe-1bc09e372654" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:53:13 user nova-compute[74337]: DEBUG nova.network.neutron [req-1baf75ab-5611-4ba1-94b9-9d30699affdd req-da318639-12ce-4990-b09d-20bd8ccf7ed2 service nova] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] Refreshing network info cache for port 16ee3173-b704-43aa-9c44-ffa4d4d82fc4 {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 21:53:13 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] Start _get_guest_xml network_info=[{"id": "16ee3173-b704-43aa-9c44-ffa4d4d82fc4", "address": "fa:16:3e:be:e5:9b", "network": {"id": "0b1d82b0-acba-470e-aede-1c57a85a8ed3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1250228933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "965415a9973d4714aa49a64d34b232a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16ee3173-b7", "ovs_interfaceid": "16ee3173-b704-43aa-9c44-ffa4d4d82fc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T21:53:06Z,direct_url=<?>,disk_format='qcow2',id=c9f5f8ff-7674-48c5-a008-032e4795ab33,min_disk=0,min_ram=0,name='tempest-scenario-img--1574970817',owner='965415a9973d4714aa49a64d34b232a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T21:53:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'image_id': 'c9f5f8ff-7674-48c5-a008-032e4795ab33'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 21:53:13 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:53:13 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:53:13 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 21:53:13 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] CPU controller missing on host. {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 21:53:13 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 21:53:13 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] CPU controller found on host. {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 21:53:13 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 21:53:13 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T21:29:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T21:53:06Z,direct_url=<?>,disk_format='qcow2',id=c9f5f8ff-7674-48c5-a008-032e4795ab33,min_disk=0,min_ram=0,name='tempest-scenario-img--1574970817',owner='965415a9973d4714aa49a64d34b232a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T21:53:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 21:53:13 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Flavor limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 21:53:13 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Image limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 21:53:13 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Flavor pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 21:53:13 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Image pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 21:53:13 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 21:53:13 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 21:53:13 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 21:53:13 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Got 1 possible topologies {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 21:53:13 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 21:53:13 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 21:53:13 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:53:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-748752527',display_name='tempest-TestMinimumBasicScenario-server-748752527',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-748752527',id=35,image_ref='c9f5f8ff-7674-48c5-a008-032e4795ab33',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIfLpXwFvySixQSBbn4nLlq9zjEg9GhMniy/7jo41PUhYLOeqBGONhSCnyTqv8kIiaxawNifBQnT0i1aAI0ZeKsMK+jJ6PrQUPzAQJ9WenGIpnoBC3sKUguIOqv2XtAxmQ==',key_name='tempest-TestMinimumBasicScenario-1876165380',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='965415a9973d4714aa49a64d34b232a6',ramdisk_id='',reservation_id='r-0zsuhsbg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c9f5f8ff-7674-48c5-a008-032e4795ab33',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-295529967',owner_user_name='tempest-TestMinimumBasicScenario-295529967-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:53:10Z,user_data=None,user_id='5a20c05457014209a86f285fcc9dd506',uuid=d5d9d286-4837-4168-a4fe-1bc09e372654,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "16ee3173-b704-43aa-9c44-ffa4d4d82fc4", "address": "fa:16:3e:be:e5:9b", "network": {"id": "0b1d82b0-acba-470e-aede-1c57a85a8ed3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1250228933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "965415a9973d4714aa49a64d34b232a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16ee3173-b7", "ovs_interfaceid": "16ee3173-b704-43aa-9c44-ffa4d4d82fc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 21:53:13 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Converting VIF {"id": "16ee3173-b704-43aa-9c44-ffa4d4d82fc4", "address": "fa:16:3e:be:e5:9b", "network": {"id": "0b1d82b0-acba-470e-aede-1c57a85a8ed3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1250228933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "965415a9973d4714aa49a64d34b232a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16ee3173-b7", "ovs_interfaceid": "16ee3173-b704-43aa-9c44-ffa4d4d82fc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:53:13 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:e5:9b,bridge_name='br-int',has_traffic_filtering=True,id=16ee3173-b704-43aa-9c44-ffa4d4d82fc4,network=Network(0b1d82b0-acba-470e-aede-1c57a85a8ed3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16ee3173-b7') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:53:13 user nova-compute[74337]: DEBUG nova.objects.instance [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Lazy-loading 'pci_devices' on Instance uuid d5d9d286-4837-4168-a4fe-1bc09e372654 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:53:13 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] End _get_guest_xml xml=<domain type="kvm">
Oct 23 21:53:13 user nova-compute[74337]:   <uuid>d5d9d286-4837-4168-a4fe-1bc09e372654</uuid>
Oct 23 21:53:13 user nova-compute[74337]:   <name>instance-00000023</name>
Oct 23 21:53:13 user nova-compute[74337]:   <memory>524288</memory>
Oct 23 21:53:13 user nova-compute[74337]:   <vcpu>1</vcpu>
Oct 23 21:53:13 user nova-compute[74337]:   <metadata>
Oct 23 21:53:13 user nova-compute[74337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 21:53:13 user nova-compute[74337]:       <nova:package version="0.0.0"/>
Oct 23 21:53:13 user nova-compute[74337]:       <nova:name>tempest-TestMinimumBasicScenario-server-748752527</nova:name>
Oct 23 21:53:13 user nova-compute[74337]:       <nova:creationTime>2023-10-23 21:53:13</nova:creationTime>
Oct 23 21:53:13 user nova-compute[74337]:       <nova:flavor name="m1.tiny">
Oct 23 21:53:13 user nova-compute[74337]:         <nova:memory>512</nova:memory>
Oct 23 21:53:13 user nova-compute[74337]:         <nova:disk>1</nova:disk>
Oct 23 21:53:13 user nova-compute[74337]:         <nova:swap>0</nova:swap>
Oct 23 21:53:13 user nova-compute[74337]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 21:53:13 user nova-compute[74337]:         <nova:vcpus>1</nova:vcpus>
Oct 23 21:53:13 user nova-compute[74337]:       </nova:flavor>
Oct 23 21:53:13 user nova-compute[74337]:       <nova:owner>
Oct 23 21:53:13 user nova-compute[74337]:         <nova:user uuid="5a20c05457014209a86f285fcc9dd506">tempest-TestMinimumBasicScenario-295529967-project-member</nova:user>
Oct 23 21:53:13 user nova-compute[74337]:         <nova:project uuid="965415a9973d4714aa49a64d34b232a6">tempest-TestMinimumBasicScenario-295529967</nova:project>
Oct 23 21:53:13 user nova-compute[74337]:       </nova:owner>
Oct 23 21:53:13 user nova-compute[74337]:       <nova:root type="image" uuid="c9f5f8ff-7674-48c5-a008-032e4795ab33"/>
Oct 23 21:53:13 user nova-compute[74337]:       <nova:ports>
Oct 23 21:53:13 user nova-compute[74337]:         <nova:port uuid="16ee3173-b704-43aa-9c44-ffa4d4d82fc4">
Oct 23 21:53:13 user nova-compute[74337]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 23 21:53:13 user nova-compute[74337]:         </nova:port>
Oct 23 21:53:13 user nova-compute[74337]:       </nova:ports>
Oct 23 21:53:13 user nova-compute[74337]:     </nova:instance>
Oct 23 21:53:13 user nova-compute[74337]:   </metadata>
Oct 23 21:53:13 user nova-compute[74337]:   <sysinfo type="smbios">
Oct 23 21:53:13 user nova-compute[74337]:     <system>
Oct 23 21:53:13 user nova-compute[74337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 21:53:13 user nova-compute[74337]:       <entry name="product">OpenStack Nova</entry>
Oct 23 21:53:13 user nova-compute[74337]:       <entry name="version">0.0.0</entry>
Oct 23 21:53:13 user nova-compute[74337]:       <entry name="serial">d5d9d286-4837-4168-a4fe-1bc09e372654</entry>
Oct 23 21:53:13 user nova-compute[74337]:       <entry name="uuid">d5d9d286-4837-4168-a4fe-1bc09e372654</entry>
Oct 23 21:53:13 user nova-compute[74337]:       <entry name="family">Virtual Machine</entry>
Oct 23 21:53:13 user nova-compute[74337]:     </system>
Oct 23 21:53:13 user nova-compute[74337]:   </sysinfo>
Oct 23 21:53:13 user nova-compute[74337]:   <os>
Oct 23 21:53:13 user nova-compute[74337]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 21:53:13 user nova-compute[74337]:     <boot dev="hd"/>
Oct 23 21:53:13 user nova-compute[74337]:     <smbios mode="sysinfo"/>
Oct 23 21:53:13 user nova-compute[74337]:   </os>
Oct 23 21:53:13 user nova-compute[74337]:   <features>
Oct 23 21:53:13 user nova-compute[74337]:     <acpi/>
Oct 23 21:53:13 user nova-compute[74337]:     <apic/>
Oct 23 21:53:13 user nova-compute[74337]:     <vmcoreinfo/>
Oct 23 21:53:13 user nova-compute[74337]:   </features>
Oct 23 21:53:13 user nova-compute[74337]:   <clock offset="utc">
Oct 23 21:53:13 user nova-compute[74337]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 21:53:13 user nova-compute[74337]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 21:53:13 user nova-compute[74337]:     <timer name="hpet" present="no"/>
Oct 23 21:53:13 user nova-compute[74337]:   </clock>
Oct 23 21:53:13 user nova-compute[74337]:   <cpu mode="custom" match="exact">
Oct 23 21:53:13 user nova-compute[74337]:     <model>Nehalem</model>
Oct 23 21:53:13 user nova-compute[74337]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 21:53:13 user nova-compute[74337]:   </cpu>
Oct 23 21:53:13 user nova-compute[74337]:   <devices>
Oct 23 21:53:13 user nova-compute[74337]:     <disk type="file" device="disk">
Oct 23 21:53:13 user nova-compute[74337]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 21:53:13 user nova-compute[74337]:       <source file="/opt/stack/data/nova/instances/d5d9d286-4837-4168-a4fe-1bc09e372654/disk"/>
Oct 23 21:53:13 user nova-compute[74337]:       <target dev="vda" bus="virtio"/>
Oct 23 21:53:13 user nova-compute[74337]:     </disk>
Oct 23 21:53:13 user nova-compute[74337]:     <interface type="ethernet">
Oct 23 21:53:13 user nova-compute[74337]:       <mac address="fa:16:3e:be:e5:9b"/>
Oct 23 21:53:13 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:53:13 user nova-compute[74337]:       <mtu size="1442"/>
Oct 23 21:53:13 user nova-compute[74337]:       <target dev="tap16ee3173-b7"/>
Oct 23 21:53:13 user nova-compute[74337]:     </interface>
Oct 23 21:53:13 user nova-compute[74337]:     <serial type="pty">
Oct 23 21:53:13 user nova-compute[74337]:       <log file="/opt/stack/data/nova/instances/d5d9d286-4837-4168-a4fe-1bc09e372654/console.log" append="off"/>
Oct 23 21:53:13 user nova-compute[74337]:     </serial>
Oct 23 21:53:13 user nova-compute[74337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 21:53:13 user nova-compute[74337]:     <video>
Oct 23 21:53:13 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:53:13 user nova-compute[74337]:     </video>
Oct 23 21:53:13 user nova-compute[74337]:     <rng model="virtio">
Oct 23 21:53:13 user nova-compute[74337]:       <backend model="random">/dev/urandom</backend>
Oct 23 21:53:13 user nova-compute[74337]:     </rng>
Oct 23 21:53:13 user nova-compute[74337]:     <controller type="usb" index="0" model="none"/>
Oct 23 21:53:13 user nova-compute[74337]:     <memballoon model="virtio">
Oct 23 21:53:13 user nova-compute[74337]:       <stats period="10"/>
Oct 23 21:53:13 user nova-compute[74337]:     </memballoon>
Oct 23 21:53:13 user nova-compute[74337]:   </devices>
Oct 23 21:53:13 user nova-compute[74337]: </domain>
Oct 23 21:53:13 user nova-compute[74337]:  {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 21:53:13 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:53:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-748752527',display_name='tempest-TestMinimumBasicScenario-server-748752527',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-748752527',id=35,image_ref='c9f5f8ff-7674-48c5-a008-032e4795ab33',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIfLpXwFvySixQSBbn4nLlq9zjEg9GhMniy/7jo41PUhYLOeqBGONhSCnyTqv8kIiaxawNifBQnT0i1aAI0ZeKsMK+jJ6PrQUPzAQJ9WenGIpnoBC3sKUguIOqv2XtAxmQ==',key_name='tempest-TestMinimumBasicScenario-1876165380',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='965415a9973d4714aa49a64d34b232a6',ramdisk_id='',reservation_id='r-0zsuhsbg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c9f5f8ff-7674-48c5-a008-032e4795ab33',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-295529967',owner_user_name='tempest-TestMinimumBasicScenario-295529967-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:53:10Z,user_data=None,user_id='5a20c05457014209a86f285fcc9dd506',uuid=d5d9d286-4837-4168-a4fe-1bc09e372654,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "16ee3173-b704-43aa-9c44-ffa4d4d82fc4", "address": "fa:16:3e:be:e5:9b", "network": {"id": "0b1d82b0-acba-470e-aede-1c57a85a8ed3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1250228933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "965415a9973d4714aa49a64d34b232a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16ee3173-b7", "ovs_interfaceid": "16ee3173-b704-43aa-9c44-ffa4d4d82fc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 21:53:13 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Converting VIF {"id": "16ee3173-b704-43aa-9c44-ffa4d4d82fc4", "address": "fa:16:3e:be:e5:9b", "network": {"id": "0b1d82b0-acba-470e-aede-1c57a85a8ed3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1250228933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "965415a9973d4714aa49a64d34b232a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16ee3173-b7", "ovs_interfaceid": "16ee3173-b704-43aa-9c44-ffa4d4d82fc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:53:13 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:e5:9b,bridge_name='br-int',has_traffic_filtering=True,id=16ee3173-b704-43aa-9c44-ffa4d4d82fc4,network=Network(0b1d82b0-acba-470e-aede-1c57a85a8ed3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16ee3173-b7') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:53:13 user nova-compute[74337]: DEBUG os_vif [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:e5:9b,bridge_name='br-int',has_traffic_filtering=True,id=16ee3173-b704-43aa-9c44-ffa4d4d82fc4,network=Network(0b1d82b0-acba-470e-aede-1c57a85a8ed3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16ee3173-b7') {{(pid=74337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 21:53:13 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:53:13 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:53:13 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 21:53:13 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:53:13 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '76681141-86b8-5622-82d6-ffcd2ff32ebb', '_type': 'linux-noop'}}, row=False) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:53:13 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:53:13 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:53:13 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:53:13 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:53:13 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap16ee3173-b7, may_exist=True, interface_attrs={}) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:53:13 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap16ee3173-b7, col_values=(('qos', UUID('3de5bc72-c65d-4766-8127-f41e91783908')),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:53:13 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap16ee3173-b7, col_values=(('external_ids', {'iface-id': '16ee3173-b704-43aa-9c44-ffa4d4d82fc4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:be:e5:9b', 'vm-uuid': 'd5d9d286-4837-4168-a4fe-1bc09e372654'}),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:53:13 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:53:13 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:53:13 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:53:13 user nova-compute[74337]: INFO os_vif [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:e5:9b,bridge_name='br-int',has_traffic_filtering=True,id=16ee3173-b704-43aa-9c44-ffa4d4d82fc4,network=Network(0b1d82b0-acba-470e-aede-1c57a85a8ed3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16ee3173-b7')
Oct 23 21:53:13 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] No BDM found with device name vda, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 21:53:13 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] No VIF found with MAC fa:16:3e:be:e5:9b, not building metadata {{(pid=74337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 21:53:13 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:53:13 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:53:13 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:53:13 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:53:13 user nova-compute[74337]: DEBUG nova.network.neutron [req-1baf75ab-5611-4ba1-94b9-9d30699affdd req-da318639-12ce-4990-b09d-20bd8ccf7ed2 service nova] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] Updated VIF entry in instance network info cache for port 16ee3173-b704-43aa-9c44-ffa4d4d82fc4. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 21:53:13 user nova-compute[74337]: DEBUG nova.network.neutron [req-1baf75ab-5611-4ba1-94b9-9d30699affdd req-da318639-12ce-4990-b09d-20bd8ccf7ed2 service nova] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] Updating instance_info_cache with network_info: [{"id": "16ee3173-b704-43aa-9c44-ffa4d4d82fc4", "address": "fa:16:3e:be:e5:9b", "network": {"id": "0b1d82b0-acba-470e-aede-1c57a85a8ed3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1250228933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "965415a9973d4714aa49a64d34b232a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16ee3173-b7", "ovs_interfaceid": "16ee3173-b704-43aa-9c44-ffa4d4d82fc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:53:13 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-1baf75ab-5611-4ba1-94b9-9d30699affdd req-da318639-12ce-4990-b09d-20bd8ccf7ed2 service nova] Releasing lock "refresh_cache-d5d9d286-4837-4168-a4fe-1bc09e372654" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:53:13 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:53:13 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: 0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b] Instance destroyed successfully.
Oct 23 21:53:13 user nova-compute[74337]: DEBUG nova.objects.instance [None req-96e151a9-a9d6-4014-9300-5666708dfb23 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lazy-loading 'resources' on Instance uuid 0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:53:13 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-96e151a9-a9d6-4014-9300-5666708dfb23 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:51:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2118733817',display_name='tempest-TestVolumeBootPattern-server-2118733817',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2118733817',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF9NMFNWTU3BVoh69lm2h364CNXP9OO2Sq0+VU67LFY2Y7YP31lo2g7Nqc/sdO6ndxwSu3pXMChCzpRUGVair3TDlV76zriaKktCrpgsBnYg9q7WYnK8Iuk7Ag22Kj7gAw==',key_name='tempest-TestVolumeBootPattern-1223802412',keypairs=<?>,launch_index=0,launched_at=2023-10-23T21:51:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cb567547bd4941fb87435a841c9d17c4',ramdisk_id='',reservation_id='r-0g9813je',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-499971371',owner_user_name='tempest-TestVolumeBootPattern-499971371-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T21:51:47Z,user_data=None,user_id='0c3e635e8e5447138a7f2db11695574c',uuid=0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e15964dc-04e9-4b21-947c-2de7ed87e0ba", "address": "fa:16:3e:72:6e:20", "network": {"id": "5a18e96f-a6eb-4989-9be3-154b54928b03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-507511840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb567547bd4941fb87435a841c9d17c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape15964dc-04", "ovs_interfaceid": "e15964dc-04e9-4b21-947c-2de7ed87e0ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 21:53:13 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-96e151a9-a9d6-4014-9300-5666708dfb23 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Converting VIF {"id": "e15964dc-04e9-4b21-947c-2de7ed87e0ba", "address": "fa:16:3e:72:6e:20", "network": {"id": "5a18e96f-a6eb-4989-9be3-154b54928b03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-507511840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb567547bd4941fb87435a841c9d17c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape15964dc-04", "ovs_interfaceid": "e15964dc-04e9-4b21-947c-2de7ed87e0ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:53:13 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-96e151a9-a9d6-4014-9300-5666708dfb23 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:72:6e:20,bridge_name='br-int',has_traffic_filtering=True,id=e15964dc-04e9-4b21-947c-2de7ed87e0ba,network=Network(5a18e96f-a6eb-4989-9be3-154b54928b03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape15964dc-04') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:53:13 user nova-compute[74337]: DEBUG os_vif [None req-96e151a9-a9d6-4014-9300-5666708dfb23 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:72:6e:20,bridge_name='br-int',has_traffic_filtering=True,id=e15964dc-04e9-4b21-947c-2de7ed87e0ba,network=Network(5a18e96f-a6eb-4989-9be3-154b54928b03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape15964dc-04') {{(pid=74337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 21:53:13 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:53:13 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape15964dc-04, bridge=br-int, if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:53:13 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:53:13 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:53:13 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:53:13 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:53:13 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=25e5560a-b8c0-44e8-9ae7-95a91c75e677) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:53:13 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:53:13 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:53:13 user nova-compute[74337]: INFO os_vif [None req-96e151a9-a9d6-4014-9300-5666708dfb23 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:72:6e:20,bridge_name='br-int',has_traffic_filtering=True,id=e15964dc-04e9-4b21-947c-2de7ed87e0ba,network=Network(5a18e96f-a6eb-4989-9be3-154b54928b03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape15964dc-04')
Oct 23 21:53:13 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96e151a9-a9d6-4014-9300-5666708dfb23 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b] calling os-brick to detach iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 21:53:13 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-96e151a9-a9d6-4014-9300-5666708dfb23 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, {'target_iqn': 'iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MQuLsncZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:53:13 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-96e151a9-a9d6-4014-9300-5666708dfb23 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:53:13 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-96e151a9-a9d6-4014-9300-5666708dfb23 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:53:13 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-96e151a9-a9d6-4014-9300-5666708dfb23 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:53:13 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:53:13 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:53:13 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b25d485-0818-4aa4-8cd3-995a33d184dc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:53:13 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-96e151a9-a9d6-4014-9300-5666708dfb23 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 21:53:13 user nova-compute[74337]: No targets found.
Oct 23 21:53:13 user nova-compute[74337]: iSNS:
Oct 23 21:53:13 user nova-compute[74337]: No targets found.
Oct 23 21:53:13 user nova-compute[74337]: STATIC:
Oct 23 21:53:13 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83
Oct 23 21:53:13 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:53:13 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:53:13 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4
Oct 23 21:53:13 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:53:13 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:53:13 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398
Oct 23 21:53:13 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:53:13 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:53:13 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048
Oct 23 21:53:13 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:53:13 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:53:13 user nova-compute[74337]: FIRMWARE:
Oct 23 21:53:13 user nova-compute[74337]: No targets found.
Oct 23 21:53:13 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:53:13 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-96e151a9-a9d6-4014-9300-5666708dfb23 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 21:53:13 user nova-compute[74337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 21:53:13 user nova-compute[74337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 21:53:13 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-96e151a9-a9d6-4014-9300-5666708dfb23 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048', 0)] {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 21:53:13 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:53:13 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:53:13 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[4363adbd-91ae-4b13-ae10-c3ae65e7748f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:53:13 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:53:13 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:53:13 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[8878c88a-0ea8-4d7a-b41e-81770428122a]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:53:13 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-96e151a9-a9d6-4014-9300-5666708dfb23 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:53:13 user nova-compute[74337]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 (non-flash)
Oct 23 21:53:13 user nova-compute[74337]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 (non-flash)
Oct 23 21:53:13 user nova-compute[74337]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 (non-flash)
Oct 23 21:53:13 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:53:13 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-96e151a9-a9d6-4014-9300-5666708dfb23 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:53:13 user nova-compute[74337]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 (non-flash)
Oct 23 21:53:13 user nova-compute[74337]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 (non-flash)
Oct 23 21:53:13 user nova-compute[74337]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 (non-flash)
Oct 23 21:53:13 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:53:13 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-96e151a9-a9d6-4014-9300-5666708dfb23 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5eec1bbac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048'): ({'sdb'}, set())}) {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 21:53:13 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-96e151a9-a9d6-4014-9300-5666708dfb23 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Removing single pathed devices sdb {{(pid=74337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 21:53:13 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:53:13 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:53:13 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb9f56ae-bd64-473a-8ec3-4f7e6f5c5f18]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:53:13 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:53:13 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:53:13 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[7329303f-44c3-4b29-8d76-40fa406fafcb]: (4, ('ok\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:53:13 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-96e151a9-a9d6-4014-9300-5666708dfb23 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Flushing IO for device /dev/sdb {{(pid=74337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 21:53:13 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:53:13 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:53:13 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[397b5f75-3422-4602-abb2-2484272f934a]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:53:13 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-96e151a9-a9d6-4014-9300-5666708dfb23 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 21:53:13 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:53:14 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:53:14 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d03c446-c57d-4fa9-b58c-869f6647ba88]: (4, ('1', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:53:14 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-96e151a9-a9d6-4014-9300-5666708dfb23 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 21:53:14 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-96e151a9-a9d6-4014-9300-5666708dfb23 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] SCSI volumes sdb have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 21:53:14 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-96e151a9-a9d6-4014-9300-5666708dfb23 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048')] {{(pid=74337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 21:53:14 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:53:14 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:53:14 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[567f1b51-40f1-4f0d-91a3-7fc465954999]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:53:14 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-96e151a9-a9d6-4014-9300-5666708dfb23 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:53:14 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 -p 172.16.0.220:3260 --logout {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:53:14 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:53:14 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:53:14 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:53:14 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:53:14 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:53:14 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff46d7a-065d-4972-873c-578a784bd139]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:53:14 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-96e151a9-a9d6-4014-9300-5666708dfb23 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048, portal: 172.16.0.220,3260]
Oct 23 21:53:14 user nova-compute[74337]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048, portal: 172.16.0.220,3260] successful.
Oct 23 21:53:14 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:53:14 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 -p 172.16.0.220:3260 --op delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:53:14 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:53:14 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:53:14 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f053ed6-991e-4700-8b45-d502570ee20c]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:53:14 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-96e151a9-a9d6-4014-9300-5666708dfb23 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:53:14 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-96e151a9-a9d6-4014-9300-5666708dfb23 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:53:14 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-96e151a9-a9d6-4014-9300-5666708dfb23 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] <== disconnect_volume: return (354ms) None {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:53:14 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96e151a9-a9d6-4014-9300-5666708dfb23 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b] Disconnected iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 21:53:14 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-96e151a9-a9d6-4014-9300-5666708dfb23 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b] Deleting instance files /opt/stack/data/nova/instances/0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b_del
Oct 23 21:53:14 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-96e151a9-a9d6-4014-9300-5666708dfb23 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b] Deletion of /opt/stack/data/nova/instances/0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b_del complete
Oct 23 21:53:14 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:53:14 user nova-compute[74337]: INFO nova.compute.manager [None req-96e151a9-a9d6-4014-9300-5666708dfb23 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b] Took 1.58 seconds to destroy the instance on the hypervisor.
Oct 23 21:53:14 user nova-compute[74337]: DEBUG oslo.service.loopingcall [None req-96e151a9-a9d6-4014-9300-5666708dfb23 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74337) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 21:53:14 user nova-compute[74337]: DEBUG nova.compute.manager [-] [instance: 0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b] Deallocating network for instance {{(pid=74337) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 21:53:14 user nova-compute[74337]: DEBUG nova.network.neutron [-] [instance: 0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b] deallocate_for_instance() {{(pid=74337) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 21:53:14 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:53:14 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:53:14 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:53:14 user nova-compute[74337]: DEBUG nova.compute.manager [req-847e4c15-bc64-4106-b412-fc13c806f6b9 req-d17f2b9f-f760-4fe0-8c5f-5c433526a4b3 service nova] [instance: 0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b] Received event network-vif-unplugged-e15964dc-04e9-4b21-947c-2de7ed87e0ba {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:53:14 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-847e4c15-bc64-4106-b412-fc13c806f6b9 req-d17f2b9f-f760-4fe0-8c5f-5c433526a4b3 service nova] Acquiring lock "0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:53:14 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-847e4c15-bc64-4106-b412-fc13c806f6b9 req-d17f2b9f-f760-4fe0-8c5f-5c433526a4b3 service nova] Lock "0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:53:14 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-847e4c15-bc64-4106-b412-fc13c806f6b9 req-d17f2b9f-f760-4fe0-8c5f-5c433526a4b3 service nova] Lock "0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:53:14 user nova-compute[74337]: DEBUG nova.compute.manager [req-847e4c15-bc64-4106-b412-fc13c806f6b9 req-d17f2b9f-f760-4fe0-8c5f-5c433526a4b3 service nova] [instance: 0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b] No waiting events found dispatching network-vif-unplugged-e15964dc-04e9-4b21-947c-2de7ed87e0ba {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:53:14 user nova-compute[74337]: DEBUG nova.compute.manager [req-847e4c15-bc64-4106-b412-fc13c806f6b9 req-d17f2b9f-f760-4fe0-8c5f-5c433526a4b3 service nova] [instance: 0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b] Received event network-vif-unplugged-e15964dc-04e9-4b21-947c-2de7ed87e0ba for instance with task_state deleting. {{(pid=74337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 21:53:14 user nova-compute[74337]: DEBUG nova.compute.manager [req-847e4c15-bc64-4106-b412-fc13c806f6b9 req-d17f2b9f-f760-4fe0-8c5f-5c433526a4b3 service nova] [instance: 0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b] Received event network-vif-plugged-e15964dc-04e9-4b21-947c-2de7ed87e0ba {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:53:14 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-847e4c15-bc64-4106-b412-fc13c806f6b9 req-d17f2b9f-f760-4fe0-8c5f-5c433526a4b3 service nova] Acquiring lock "0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:53:14 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-847e4c15-bc64-4106-b412-fc13c806f6b9 req-d17f2b9f-f760-4fe0-8c5f-5c433526a4b3 service nova] Lock "0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:53:14 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-847e4c15-bc64-4106-b412-fc13c806f6b9 req-d17f2b9f-f760-4fe0-8c5f-5c433526a4b3 service nova] Lock "0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:53:14 user nova-compute[74337]: DEBUG nova.compute.manager [req-847e4c15-bc64-4106-b412-fc13c806f6b9 req-d17f2b9f-f760-4fe0-8c5f-5c433526a4b3 service nova] [instance: 0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b] No waiting events found dispatching network-vif-plugged-e15964dc-04e9-4b21-947c-2de7ed87e0ba {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:53:14 user nova-compute[74337]: WARNING nova.compute.manager [req-847e4c15-bc64-4106-b412-fc13c806f6b9 req-d17f2b9f-f760-4fe0-8c5f-5c433526a4b3 service nova] [instance: 0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b] Received unexpected event network-vif-plugged-e15964dc-04e9-4b21-947c-2de7ed87e0ba for instance with vm_state active and task_state deleting.
Oct 23 21:53:14 user nova-compute[74337]: DEBUG nova.compute.manager [req-847e4c15-bc64-4106-b412-fc13c806f6b9 req-d17f2b9f-f760-4fe0-8c5f-5c433526a4b3 service nova] [instance: 0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b] Received event network-vif-plugged-e15964dc-04e9-4b21-947c-2de7ed87e0ba {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:53:14 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-847e4c15-bc64-4106-b412-fc13c806f6b9 req-d17f2b9f-f760-4fe0-8c5f-5c433526a4b3 service nova] Acquiring lock "0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:53:14 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-847e4c15-bc64-4106-b412-fc13c806f6b9 req-d17f2b9f-f760-4fe0-8c5f-5c433526a4b3 service nova] Lock "0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:53:14 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-847e4c15-bc64-4106-b412-fc13c806f6b9 req-d17f2b9f-f760-4fe0-8c5f-5c433526a4b3 service nova] Lock "0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:53:14 user nova-compute[74337]: DEBUG nova.compute.manager [req-847e4c15-bc64-4106-b412-fc13c806f6b9 req-d17f2b9f-f760-4fe0-8c5f-5c433526a4b3 service nova] [instance: 0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b] No waiting events found dispatching network-vif-plugged-e15964dc-04e9-4b21-947c-2de7ed87e0ba {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:53:14 user nova-compute[74337]: WARNING nova.compute.manager [req-847e4c15-bc64-4106-b412-fc13c806f6b9 req-d17f2b9f-f760-4fe0-8c5f-5c433526a4b3 service nova] [instance: 0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b] Received unexpected event network-vif-plugged-e15964dc-04e9-4b21-947c-2de7ed87e0ba for instance with vm_state active and task_state deleting.
Oct 23 21:53:14 user nova-compute[74337]: DEBUG nova.compute.manager [req-847e4c15-bc64-4106-b412-fc13c806f6b9 req-d17f2b9f-f760-4fe0-8c5f-5c433526a4b3 service nova] [instance: 0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b] Received event network-vif-plugged-e15964dc-04e9-4b21-947c-2de7ed87e0ba {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:53:14 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-847e4c15-bc64-4106-b412-fc13c806f6b9 req-d17f2b9f-f760-4fe0-8c5f-5c433526a4b3 service nova] Acquiring lock "0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:53:14 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-847e4c15-bc64-4106-b412-fc13c806f6b9 req-d17f2b9f-f760-4fe0-8c5f-5c433526a4b3 service nova] Lock "0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:53:14 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-847e4c15-bc64-4106-b412-fc13c806f6b9 req-d17f2b9f-f760-4fe0-8c5f-5c433526a4b3 service nova] Lock "0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:53:14 user nova-compute[74337]: DEBUG nova.compute.manager [req-847e4c15-bc64-4106-b412-fc13c806f6b9 req-d17f2b9f-f760-4fe0-8c5f-5c433526a4b3 service nova] [instance: 0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b] No waiting events found dispatching network-vif-plugged-e15964dc-04e9-4b21-947c-2de7ed87e0ba {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:53:14 user nova-compute[74337]: WARNING nova.compute.manager [req-847e4c15-bc64-4106-b412-fc13c806f6b9 req-d17f2b9f-f760-4fe0-8c5f-5c433526a4b3 service nova] [instance: 0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b] Received unexpected event network-vif-plugged-e15964dc-04e9-4b21-947c-2de7ed87e0ba for instance with vm_state active and task_state deleting.
Oct 23 21:53:14 user nova-compute[74337]: DEBUG nova.compute.manager [req-847e4c15-bc64-4106-b412-fc13c806f6b9 req-d17f2b9f-f760-4fe0-8c5f-5c433526a4b3 service nova] [instance: 0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b] Received event network-vif-unplugged-e15964dc-04e9-4b21-947c-2de7ed87e0ba {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:53:14 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-847e4c15-bc64-4106-b412-fc13c806f6b9 req-d17f2b9f-f760-4fe0-8c5f-5c433526a4b3 service nova] Acquiring lock "0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:53:14 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-847e4c15-bc64-4106-b412-fc13c806f6b9 req-d17f2b9f-f760-4fe0-8c5f-5c433526a4b3 service nova] Lock "0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:53:14 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-847e4c15-bc64-4106-b412-fc13c806f6b9 req-d17f2b9f-f760-4fe0-8c5f-5c433526a4b3 service nova] Lock "0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:53:14 user nova-compute[74337]: DEBUG nova.compute.manager [req-847e4c15-bc64-4106-b412-fc13c806f6b9 req-d17f2b9f-f760-4fe0-8c5f-5c433526a4b3 service nova] [instance: 0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b] No waiting events found dispatching network-vif-unplugged-e15964dc-04e9-4b21-947c-2de7ed87e0ba {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:53:14 user nova-compute[74337]: DEBUG nova.compute.manager [req-847e4c15-bc64-4106-b412-fc13c806f6b9 req-d17f2b9f-f760-4fe0-8c5f-5c433526a4b3 service nova] [instance: 0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b] Received event network-vif-unplugged-e15964dc-04e9-4b21-947c-2de7ed87e0ba for instance with task_state deleting. {{(pid=74337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 21:53:14 user nova-compute[74337]: DEBUG nova.compute.manager [req-847e4c15-bc64-4106-b412-fc13c806f6b9 req-d17f2b9f-f760-4fe0-8c5f-5c433526a4b3 service nova] [instance: 0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b] Received event network-vif-plugged-e15964dc-04e9-4b21-947c-2de7ed87e0ba {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:53:14 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-847e4c15-bc64-4106-b412-fc13c806f6b9 req-d17f2b9f-f760-4fe0-8c5f-5c433526a4b3 service nova] Acquiring lock "0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:53:14 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-847e4c15-bc64-4106-b412-fc13c806f6b9 req-d17f2b9f-f760-4fe0-8c5f-5c433526a4b3 service nova] Lock "0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:53:14 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-847e4c15-bc64-4106-b412-fc13c806f6b9 req-d17f2b9f-f760-4fe0-8c5f-5c433526a4b3 service nova] Lock "0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:53:14 user nova-compute[74337]: DEBUG nova.compute.manager [req-847e4c15-bc64-4106-b412-fc13c806f6b9 req-d17f2b9f-f760-4fe0-8c5f-5c433526a4b3 service nova] [instance: 0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b] No waiting events found dispatching network-vif-plugged-e15964dc-04e9-4b21-947c-2de7ed87e0ba {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:53:14 user nova-compute[74337]: WARNING nova.compute.manager [req-847e4c15-bc64-4106-b412-fc13c806f6b9 req-d17f2b9f-f760-4fe0-8c5f-5c433526a4b3 service nova] [instance: 0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b] Received unexpected event network-vif-plugged-e15964dc-04e9-4b21-947c-2de7ed87e0ba for instance with vm_state active and task_state deleting.
Oct 23 21:53:15 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:53:15 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:53:15 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:53:15 user nova-compute[74337]: DEBUG nova.network.neutron [-] [instance: 0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b] Updating instance_info_cache with network_info: [] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:53:15 user nova-compute[74337]: INFO nova.compute.manager [-] [instance: 0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b] Took 1.50 seconds to deallocate network for instance.
Oct 23 21:53:16 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:53:16 user nova-compute[74337]: INFO nova.compute.manager [None req-96e151a9-a9d6-4014-9300-5666708dfb23 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b] Took 1.04 seconds to detach 1 volumes for instance.
Oct 23 21:53:16 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-96e151a9-a9d6-4014-9300-5666708dfb23 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:53:16 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-96e151a9-a9d6-4014-9300-5666708dfb23 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:53:16 user nova-compute[74337]: DEBUG nova.compute.manager [req-00b14c7b-6100-4e50-b51a-276b7ff29b50 req-5a886cf6-1240-4a71-b2aa-34631d9dea27 service nova] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] Received event network-vif-plugged-16ee3173-b704-43aa-9c44-ffa4d4d82fc4 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:53:16 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-00b14c7b-6100-4e50-b51a-276b7ff29b50 req-5a886cf6-1240-4a71-b2aa-34631d9dea27 service nova] Acquiring lock "d5d9d286-4837-4168-a4fe-1bc09e372654-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:53:16 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-00b14c7b-6100-4e50-b51a-276b7ff29b50 req-5a886cf6-1240-4a71-b2aa-34631d9dea27 service nova] Lock "d5d9d286-4837-4168-a4fe-1bc09e372654-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:53:16 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-00b14c7b-6100-4e50-b51a-276b7ff29b50 req-5a886cf6-1240-4a71-b2aa-34631d9dea27 service nova] Lock "d5d9d286-4837-4168-a4fe-1bc09e372654-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:53:16 user nova-compute[74337]: DEBUG nova.compute.manager [req-00b14c7b-6100-4e50-b51a-276b7ff29b50 req-5a886cf6-1240-4a71-b2aa-34631d9dea27 service nova] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] No waiting events found dispatching network-vif-plugged-16ee3173-b704-43aa-9c44-ffa4d4d82fc4 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:53:16 user nova-compute[74337]: WARNING nova.compute.manager [req-00b14c7b-6100-4e50-b51a-276b7ff29b50 req-5a886cf6-1240-4a71-b2aa-34631d9dea27 service nova] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] Received unexpected event network-vif-plugged-16ee3173-b704-43aa-9c44-ffa4d4d82fc4 for instance with vm_state building and task_state spawning.
Oct 23 21:53:16 user nova-compute[74337]: DEBUG nova.compute.manager [req-00b14c7b-6100-4e50-b51a-276b7ff29b50 req-5a886cf6-1240-4a71-b2aa-34631d9dea27 service nova] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] Received event network-vif-plugged-16ee3173-b704-43aa-9c44-ffa4d4d82fc4 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:53:16 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-00b14c7b-6100-4e50-b51a-276b7ff29b50 req-5a886cf6-1240-4a71-b2aa-34631d9dea27 service nova] Acquiring lock "d5d9d286-4837-4168-a4fe-1bc09e372654-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:53:17 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-00b14c7b-6100-4e50-b51a-276b7ff29b50 req-5a886cf6-1240-4a71-b2aa-34631d9dea27 service nova] Lock "d5d9d286-4837-4168-a4fe-1bc09e372654-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:53:17 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-00b14c7b-6100-4e50-b51a-276b7ff29b50 req-5a886cf6-1240-4a71-b2aa-34631d9dea27 service nova] Lock "d5d9d286-4837-4168-a4fe-1bc09e372654-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:53:17 user nova-compute[74337]: DEBUG nova.compute.manager [req-00b14c7b-6100-4e50-b51a-276b7ff29b50 req-5a886cf6-1240-4a71-b2aa-34631d9dea27 service nova] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] No waiting events found dispatching network-vif-plugged-16ee3173-b704-43aa-9c44-ffa4d4d82fc4 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:53:17 user nova-compute[74337]: WARNING nova.compute.manager [req-00b14c7b-6100-4e50-b51a-276b7ff29b50 req-5a886cf6-1240-4a71-b2aa-34631d9dea27 service nova] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] Received unexpected event network-vif-plugged-16ee3173-b704-43aa-9c44-ffa4d4d82fc4 for instance with vm_state building and task_state spawning.
Oct 23 21:53:17 user nova-compute[74337]: DEBUG nova.compute.manager [req-00b14c7b-6100-4e50-b51a-276b7ff29b50 req-5a886cf6-1240-4a71-b2aa-34631d9dea27 service nova] [instance: 0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b] Received event network-vif-deleted-e15964dc-04e9-4b21-947c-2de7ed87e0ba {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:53:17 user nova-compute[74337]: DEBUG nova.compute.manager [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] Instance event wait completed in 0 seconds for  {{(pid=74337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 21:53:17 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] Guest created on hypervisor {{(pid=74337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 21:53:17 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] Instance spawned successfully.
Oct 23 21:53:17 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 21:53:17 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] Found default for hw_cdrom_bus of ide {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:53:17 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] Found default for hw_disk_bus of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:53:17 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] Found default for hw_input_bus of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:53:17 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] Found default for hw_pointer_model of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:53:17 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] Found default for hw_video_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:53:17 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] Found default for hw_vif_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:53:17 user nova-compute[74337]: INFO nova.compute.manager [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] Took 7.51 seconds to spawn the instance on the hypervisor.
Oct 23 21:53:17 user nova-compute[74337]: DEBUG nova.compute.manager [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] Checking state {{(pid=74337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 21:53:17 user nova-compute[74337]: INFO nova.compute.manager [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] Took 8.26 seconds to build instance.
Oct 23 21:53:17 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-96e151a9-a9d6-4014-9300-5666708dfb23 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:53:17 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-b3c0971b-657b-4efd-b12b-a4bbab096952 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Lock "d5d9d286-4837-4168-a4fe-1bc09e372654" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.353s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:53:17 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-96e151a9-a9d6-4014-9300-5666708dfb23 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:53:17 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-96e151a9-a9d6-4014-9300-5666708dfb23 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.445s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:53:17 user nova-compute[74337]: INFO nova.scheduler.client.report [None req-96e151a9-a9d6-4014-9300-5666708dfb23 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Deleted allocations for instance 0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b
Oct 23 21:53:17 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-96e151a9-a9d6-4014-9300-5666708dfb23 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "0f51d4fa-0caf-4a64-be4a-b2f8a1d98f2b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.958s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:53:18 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:53:18 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:53:18 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:53:19 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:53:19 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:53:19 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:53:19 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:53:19 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Auditing locally available compute resources for user (node: user) {{(pid=74337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 21:53:19 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 21:53:19 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5d9d286-4837-4168-a4fe-1bc09e372654/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:53:19 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5d9d286-4837-4168-a4fe-1bc09e372654/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:53:19 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5d9d286-4837-4168-a4fe-1bc09e372654/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:53:20 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5d9d286-4837-4168-a4fe-1bc09e372654/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:53:20 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/547c4d4c-e0dd-495a-b83f-98426d0a4a99/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:53:20 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/547c4d4c-e0dd-495a-b83f-98426d0a4a99/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:53:20 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/547c4d4c-e0dd-495a-b83f-98426d0a4a99/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:53:20 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/547c4d4c-e0dd-495a-b83f-98426d0a4a99/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:53:20 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 21:53:20 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf53e0fc-71d1-48fa-b0b4-ed3400a21c38/disk.rescue --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:53:20 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf53e0fc-71d1-48fa-b0b4-ed3400a21c38/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:53:20 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf53e0fc-71d1-48fa-b0b4-ed3400a21c38/disk.rescue --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:53:20 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf53e0fc-71d1-48fa-b0b4-ed3400a21c38/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:53:20 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e05fd36-ee44-4992-80a9-f95af608b9f5/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:53:21 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e05fd36-ee44-4992-80a9-f95af608b9f5/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:53:21 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e05fd36-ee44-4992-80a9-f95af608b9f5/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:53:21 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e05fd36-ee44-4992-80a9-f95af608b9f5/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:53:21 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b0f8cc-bfec-42f2-b8cf-29f0603e3169/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:53:21 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b0f8cc-bfec-42f2-b8cf-29f0603e3169/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:53:21 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b0f8cc-bfec-42f2-b8cf-29f0603e3169/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:53:21 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b0f8cc-bfec-42f2-b8cf-29f0603e3169/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:53:21 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e326a14c-61d7-4dca-b55f-db0f3ab0d14e/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:53:21 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e326a14c-61d7-4dca-b55f-db0f3ab0d14e/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:53:21 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e326a14c-61d7-4dca-b55f-db0f3ab0d14e/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:53:21 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e326a14c-61d7-4dca-b55f-db0f3ab0d14e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:53:21 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 21:53:21 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1189976f-8d02-468d-8fa7-bd5594c5f85a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:53:22 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1189976f-8d02-468d-8fa7-bd5594c5f85a/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:53:22 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1189976f-8d02-468d-8fa7-bd5594c5f85a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:53:22 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1189976f-8d02-468d-8fa7-bd5594c5f85a/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:53:22 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:53:22 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:53:22 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Hypervisor/Node resource view: name=user free_ram=7803MB free_disk=25.10302734375GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 21:53:22 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:53:22 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:53:23 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 1189976f-8d02-468d-8fa7-bd5594c5f85a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:53:23 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 547c4d4c-e0dd-495a-b83f-98426d0a4a99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:53:23 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 00f757cf-e5dd-476f-81c6-670ed2bf6938 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Oct 23 21:53:23 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:53:23 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 1e05fd36-ee44-4992-80a9-f95af608b9f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:53:23 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance bf53e0fc-71d1-48fa-b0b4-ed3400a21c38 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:53:23 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 86f56afb-77e6-4378-b441-5cf507a0fbe7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:53:23 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance e326a14c-61d7-4dca-b55f-db0f3ab0d14e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:53:23 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 86b0f8cc-bfec-42f2-b8cf-29f0603e3169 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:53:23 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance d5d9d286-4837-4168-a4fe-1bc09e372654 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:53:23 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 21:53:23 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 21:53:23 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:53:23 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:53:23 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Compute_service record updated for user:user {{(pid=74337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 21:53:23 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.495s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:53:23 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:53:23 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:53:24 user nova-compute[74337]: DEBUG nova.compute.manager [req-0ae78009-c4e6-4f6b-a9d7-8f3f31fa6bee req-a0d41680-c6f3-4e05-8c7b-127d80a51ff8 service nova] [instance: 547c4d4c-e0dd-495a-b83f-98426d0a4a99] Received event network-changed-2dd20d7f-9490-476a-90ed-e6a1c9085e4d {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:53:24 user nova-compute[74337]: DEBUG nova.compute.manager [req-0ae78009-c4e6-4f6b-a9d7-8f3f31fa6bee req-a0d41680-c6f3-4e05-8c7b-127d80a51ff8 service nova] [instance: 547c4d4c-e0dd-495a-b83f-98426d0a4a99] Refreshing instance network info cache due to event network-changed-2dd20d7f-9490-476a-90ed-e6a1c9085e4d. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 21:53:24 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-0ae78009-c4e6-4f6b-a9d7-8f3f31fa6bee req-a0d41680-c6f3-4e05-8c7b-127d80a51ff8 service nova] Acquiring lock "refresh_cache-547c4d4c-e0dd-495a-b83f-98426d0a4a99" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:53:24 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-0ae78009-c4e6-4f6b-a9d7-8f3f31fa6bee req-a0d41680-c6f3-4e05-8c7b-127d80a51ff8 service nova] Acquired lock "refresh_cache-547c4d4c-e0dd-495a-b83f-98426d0a4a99" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:53:24 user nova-compute[74337]: DEBUG nova.network.neutron [req-0ae78009-c4e6-4f6b-a9d7-8f3f31fa6bee req-a0d41680-c6f3-4e05-8c7b-127d80a51ff8 service nova] [instance: 547c4d4c-e0dd-495a-b83f-98426d0a4a99] Refreshing network info cache for port 2dd20d7f-9490-476a-90ed-e6a1c9085e4d {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 21:53:25 user nova-compute[74337]: DEBUG nova.network.neutron [req-0ae78009-c4e6-4f6b-a9d7-8f3f31fa6bee req-a0d41680-c6f3-4e05-8c7b-127d80a51ff8 service nova] [instance: 547c4d4c-e0dd-495a-b83f-98426d0a4a99] Updated VIF entry in instance network info cache for port 2dd20d7f-9490-476a-90ed-e6a1c9085e4d. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 21:53:25 user nova-compute[74337]: DEBUG nova.network.neutron [req-0ae78009-c4e6-4f6b-a9d7-8f3f31fa6bee req-a0d41680-c6f3-4e05-8c7b-127d80a51ff8 service nova] [instance: 547c4d4c-e0dd-495a-b83f-98426d0a4a99] Updating instance_info_cache with network_info: [{"id": "2dd20d7f-9490-476a-90ed-e6a1c9085e4d", "address": "fa:16:3e:5f:e1:f7", "network": {"id": "aff1f95f-fda8-4f0f-8d10-7e3d587e4fda", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2048135647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1f57e58a9ec4c6384dc0d3ca58eb610", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd20d7f-94", "ovs_interfaceid": "2dd20d7f-9490-476a-90ed-e6a1c9085e4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:53:25 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-0ae78009-c4e6-4f6b-a9d7-8f3f31fa6bee req-a0d41680-c6f3-4e05-8c7b-127d80a51ff8 service nova] Releasing lock "refresh_cache-547c4d4c-e0dd-495a-b83f-98426d0a4a99" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:53:26 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:53:26 user nova-compute[74337]: DEBUG nova.compute.manager [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Stashing vm_state: active {{(pid=74337) _prep_resize /opt/stack/nova/nova/compute/manager.py:5614}}
Oct 23 21:53:26 user nova-compute[74337]: DEBUG nova.compute.manager [req-1c295b2f-72be-4e60-9e3c-1fa468c0bf93 req-01327c41-eb4b-4eda-95cb-24ff877b0b82 service nova] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Received event network-changed-148d28e8-2783-44a9-a08e-c648f0aa9489 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:53:26 user nova-compute[74337]: DEBUG nova.compute.manager [req-1c295b2f-72be-4e60-9e3c-1fa468c0bf93 req-01327c41-eb4b-4eda-95cb-24ff877b0b82 service nova] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Refreshing instance network info cache due to event network-changed-148d28e8-2783-44a9-a08e-c648f0aa9489. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 21:53:26 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-1c295b2f-72be-4e60-9e3c-1fa468c0bf93 req-01327c41-eb4b-4eda-95cb-24ff877b0b82 service nova] Acquiring lock "refresh_cache-86f56afb-77e6-4378-b441-5cf507a0fbe7" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:53:26 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-1c295b2f-72be-4e60-9e3c-1fa468c0bf93 req-01327c41-eb4b-4eda-95cb-24ff877b0b82 service nova] Acquired lock "refresh_cache-86f56afb-77e6-4378-b441-5cf507a0fbe7" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:53:26 user nova-compute[74337]: DEBUG nova.network.neutron [req-1c295b2f-72be-4e60-9e3c-1fa468c0bf93 req-01327c41-eb4b-4eda-95cb-24ff877b0b82 service nova] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Refreshing network info cache for port 148d28e8-2783-44a9-a08e-c648f0aa9489 {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 21:53:26 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:53:26 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:53:26 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 21:53:26 user nova-compute[74337]: INFO nova.compute.claims [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Claim successful on node user
Oct 23 21:53:26 user nova-compute[74337]: INFO nova.compute.resource_tracker [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Updating resource usage from migration f4c67630-bc3f-4bc4-b842-4143f24df22e
Oct 23 21:53:27 user nova-compute[74337]: DEBUG nova.network.neutron [req-1c295b2f-72be-4e60-9e3c-1fa468c0bf93 req-01327c41-eb4b-4eda-95cb-24ff877b0b82 service nova] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Updated VIF entry in instance network info cache for port 148d28e8-2783-44a9-a08e-c648f0aa9489. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 21:53:27 user nova-compute[74337]: DEBUG nova.network.neutron [req-1c295b2f-72be-4e60-9e3c-1fa468c0bf93 req-01327c41-eb4b-4eda-95cb-24ff877b0b82 service nova] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Updating instance_info_cache with network_info: [{"id": "148d28e8-2783-44a9-a08e-c648f0aa9489", "address": "fa:16:3e:47:98:97", "network": {"id": "aff1f95f-fda8-4f0f-8d10-7e3d587e4fda", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2048135647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1f57e58a9ec4c6384dc0d3ca58eb610", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap148d28e8-27", "ovs_interfaceid": "148d28e8-2783-44a9-a08e-c648f0aa9489", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:53:27 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-1c295b2f-72be-4e60-9e3c-1fa468c0bf93 req-01327c41-eb4b-4eda-95cb-24ff877b0b82 service nova] Releasing lock "refresh_cache-86f56afb-77e6-4378-b441-5cf507a0fbe7" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:53:27 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:53:27 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:53:27 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.490s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:53:27 user nova-compute[74337]: INFO nova.compute.manager [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Migrating
Oct 23 21:53:27 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Acquiring lock "refresh_cache-86f56afb-77e6-4378-b441-5cf507a0fbe7" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:53:27 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Acquired lock "refresh_cache-86f56afb-77e6-4378-b441-5cf507a0fbe7" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:53:27 user nova-compute[74337]: DEBUG nova.network.neutron [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Building network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 21:53:27 user nova-compute[74337]: DEBUG nova.network.neutron [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Updating instance_info_cache with network_info: [{"id": "148d28e8-2783-44a9-a08e-c648f0aa9489", "address": "fa:16:3e:47:98:97", "network": {"id": "aff1f95f-fda8-4f0f-8d10-7e3d587e4fda", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2048135647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1f57e58a9ec4c6384dc0d3ca58eb610", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap148d28e8-27", "ovs_interfaceid": "148d28e8-2783-44a9-a08e-c648f0aa9489", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:53:27 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Releasing lock "refresh_cache-86f56afb-77e6-4378-b441-5cf507a0fbe7" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:53:27 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Starting migrate_disk_and_power_off {{(pid=74337) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Oct 23 21:53:28 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:53:28 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:53:28 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:53:28 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:53:28 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:53:28 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Instance destroyed successfully.
Oct 23 21:53:28 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:51:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1798504573',display_name='tempest-ServerActionsTestOtherA-server-1798504573',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1798504573',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAUefvW5MXCf+ATdQvlG858gIBXPDNbf7wcgIdNA8u/7ry6R/jyuWYoMofLLf6tWmqavGvJQy7SZOewcrGrMe1Wf24ACMK0qGJkM0S6nAXe5EBQ2zvJtr8dUyXZnBDdU6w==',key_name='tempest-keypair-1448030867',keypairs=<?>,launch_index=0,launched_at=2023-10-23T21:51:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e1f57e58a9ec4c6384dc0d3ca58eb610',ramdisk_id='',reservation_id='r-lyxkco2l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-100075475',owner_user_name='tempest-ServerActionsTestOtherA-100075475-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:53:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='891ee2e3acc54ed0bc4571f63ff491a0',uuid=86f56afb-77e6-4378-b441-5cf507a0fbe7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "148d28e8-2783-44a9-a08e-c648f0aa9489", "address": "fa:16:3e:47:98:97", "network": {"id": "aff1f95f-fda8-4f0f-8d10-7e3d587e4fda", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2048135647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2048135647-network", "vif_mac": "fa:16:3e:47:98:97"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1f57e58a9ec4c6384dc0d3ca58eb610", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap148d28e8-27", "ovs_interfaceid": "148d28e8-2783-44a9-a08e-c648f0aa9489", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 21:53:28 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Converting VIF {"id": "148d28e8-2783-44a9-a08e-c648f0aa9489", "address": "fa:16:3e:47:98:97", "network": {"id": "aff1f95f-fda8-4f0f-8d10-7e3d587e4fda", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2048135647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2048135647-network", "vif_mac": "fa:16:3e:47:98:97"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1f57e58a9ec4c6384dc0d3ca58eb610", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap148d28e8-27", "ovs_interfaceid": "148d28e8-2783-44a9-a08e-c648f0aa9489", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:53:28 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:47:98:97,bridge_name='br-int',has_traffic_filtering=True,id=148d28e8-2783-44a9-a08e-c648f0aa9489,network=Network(aff1f95f-fda8-4f0f-8d10-7e3d587e4fda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap148d28e8-27') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:53:28 user nova-compute[74337]: DEBUG os_vif [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:98:97,bridge_name='br-int',has_traffic_filtering=True,id=148d28e8-2783-44a9-a08e-c648f0aa9489,network=Network(aff1f95f-fda8-4f0f-8d10-7e3d587e4fda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap148d28e8-27') {{(pid=74337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 21:53:28 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:53:28 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap148d28e8-27, bridge=br-int, if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:53:28 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:53:28 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:53:28 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:53:28 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=04ad18d7-c287-4f5c-8acf-f75a9cd802da) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:53:28 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:53:28 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:53:28 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:53:28 user nova-compute[74337]: INFO os_vif [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:98:97,bridge_name='br-int',has_traffic_filtering=True,id=148d28e8-2783-44a9-a08e-c648f0aa9489,network=Network(aff1f95f-fda8-4f0f-8d10-7e3d587e4fda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap148d28e8-27')
Oct 23 21:53:28 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] calling os-brick to detach iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 21:53:28 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, {'target_iqn': 'iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HKWwxeEB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:53:28 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:53:28 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:53:28 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:53:28 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:53:28 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:53:28 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b241cc20-13da-427b-8ef6-bc3b8fba29a9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:53:28 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 21:53:28 user nova-compute[74337]: No targets found.
Oct 23 21:53:28 user nova-compute[74337]: iSNS:
Oct 23 21:53:28 user nova-compute[74337]: No targets found.
Oct 23 21:53:28 user nova-compute[74337]: STATIC:
Oct 23 21:53:28 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83
Oct 23 21:53:28 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:53:28 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:53:28 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4
Oct 23 21:53:28 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:53:28 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:53:28 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398
Oct 23 21:53:28 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:53:28 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:53:28 user nova-compute[74337]: FIRMWARE:
Oct 23 21:53:28 user nova-compute[74337]: No targets found.
Oct 23 21:53:28 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:53:28 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 21:53:28 user nova-compute[74337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 21:53:28 user nova-compute[74337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 21:53:28 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398', 0)] {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 21:53:28 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:53:28 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:53:28 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a67da45-0f7e-46cf-b40b-a154f8b44a73]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:53:28 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:53:28 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:53:28 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc4c0a77-fda5-42cf-a2bc-8820134d5d1e]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:53:28 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:53:28 user nova-compute[74337]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 (non-flash)
Oct 23 21:53:28 user nova-compute[74337]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 (non-flash)
Oct 23 21:53:28 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:53:28 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:53:28 user nova-compute[74337]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 (non-flash)
Oct 23 21:53:28 user nova-compute[74337]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 (non-flash)
Oct 23 21:53:28 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:53:28 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5eec385360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398'): ({'sde'}, set())}) {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 21:53:28 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Removing single pathed devices sde {{(pid=74337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 21:53:28 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:53:28 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:53:28 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a16fd1ce-65fc-416d-9921-ad88f9414f03]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:53:28 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:53:28 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:53:28 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[123b3cb3-5536-4dc4-974c-044635dcf838]: (4, ('ok\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:53:28 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Flushing IO for device /dev/sde {{(pid=74337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 21:53:28 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:53:28 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:53:28 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[45494a0e-d21b-4841-93df-d781fecdadce]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:53:28 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 21:53:28 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:53:28 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:53:28 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.055s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:53:28 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[68eedffd-f68e-46f7-bb0c-285c7d1102eb]: (4, ('1', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:53:28 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 21:53:28 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] SCSI volumes sde have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 21:53:28 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398')] {{(pid=74337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 21:53:28 user nova-compute[74337]: DEBUG nova.compute.manager [req-99e849ce-ab23-4e7f-ad27-11b936a19265 req-e5fb990a-6fac-4e87-83b2-aca3906739d2 service nova] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Received event network-vif-unplugged-148d28e8-2783-44a9-a08e-c648f0aa9489 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:53:28 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-99e849ce-ab23-4e7f-ad27-11b936a19265 req-e5fb990a-6fac-4e87-83b2-aca3906739d2 service nova] Acquiring lock "86f56afb-77e6-4378-b441-5cf507a0fbe7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:53:28 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-99e849ce-ab23-4e7f-ad27-11b936a19265 req-e5fb990a-6fac-4e87-83b2-aca3906739d2 service nova] Lock "86f56afb-77e6-4378-b441-5cf507a0fbe7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:53:28 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-99e849ce-ab23-4e7f-ad27-11b936a19265 req-e5fb990a-6fac-4e87-83b2-aca3906739d2 service nova] Lock "86f56afb-77e6-4378-b441-5cf507a0fbe7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:53:28 user nova-compute[74337]: DEBUG nova.compute.manager [req-99e849ce-ab23-4e7f-ad27-11b936a19265 req-e5fb990a-6fac-4e87-83b2-aca3906739d2 service nova] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] No waiting events found dispatching network-vif-unplugged-148d28e8-2783-44a9-a08e-c648f0aa9489 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:53:28 user nova-compute[74337]: WARNING nova.compute.manager [req-99e849ce-ab23-4e7f-ad27-11b936a19265 req-e5fb990a-6fac-4e87-83b2-aca3906739d2 service nova] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Received unexpected event network-vif-unplugged-148d28e8-2783-44a9-a08e-c648f0aa9489 for instance with vm_state active and task_state resize_migrating.
Oct 23 21:53:28 user nova-compute[74337]: DEBUG nova.compute.manager [req-99e849ce-ab23-4e7f-ad27-11b936a19265 req-e5fb990a-6fac-4e87-83b2-aca3906739d2 service nova] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Received event network-vif-plugged-148d28e8-2783-44a9-a08e-c648f0aa9489 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:53:28 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-99e849ce-ab23-4e7f-ad27-11b936a19265 req-e5fb990a-6fac-4e87-83b2-aca3906739d2 service nova] Acquiring lock "86f56afb-77e6-4378-b441-5cf507a0fbe7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:53:28 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-99e849ce-ab23-4e7f-ad27-11b936a19265 req-e5fb990a-6fac-4e87-83b2-aca3906739d2 service nova] Lock "86f56afb-77e6-4378-b441-5cf507a0fbe7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:53:28 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-99e849ce-ab23-4e7f-ad27-11b936a19265 req-e5fb990a-6fac-4e87-83b2-aca3906739d2 service nova] Lock "86f56afb-77e6-4378-b441-5cf507a0fbe7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:53:28 user nova-compute[74337]: DEBUG nova.compute.manager [req-99e849ce-ab23-4e7f-ad27-11b936a19265 req-e5fb990a-6fac-4e87-83b2-aca3906739d2 service nova] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] No waiting events found dispatching network-vif-plugged-148d28e8-2783-44a9-a08e-c648f0aa9489 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:53:28 user nova-compute[74337]: WARNING nova.compute.manager [req-99e849ce-ab23-4e7f-ad27-11b936a19265 req-e5fb990a-6fac-4e87-83b2-aca3906739d2 service nova] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Received unexpected event network-vif-plugged-148d28e8-2783-44a9-a08e-c648f0aa9489 for instance with vm_state active and task_state resize_migrating.
Oct 23 21:53:28 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:53:28 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:53:28 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b22696f6-c219-4306-a4a9-4296ba8e97fb]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:53:28 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:53:28 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 -p 172.16.0.220:3260 --logout {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:53:28 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:53:28 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d094741c-5ee6-4c77-9586-0f5c983e18a3]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:53:28 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398, portal: 172.16.0.220,3260]
Oct 23 21:53:28 user nova-compute[74337]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398, portal: 172.16.0.220,3260] successful.
Oct 23 21:53:28 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:53:28 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 -p 172.16.0.220:3260 --op delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:53:28 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:53:28 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf4c3989-e305-438e-b863-d851ecf3098b]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:53:28 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:53:28 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:53:28 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] <== disconnect_volume: return (338ms) None {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:53:28 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Disconnected iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 21:53:28 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] skipping disk /dev/sde (vda) as it is a volume {{(pid=74337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 21:53:30 user nova-compute[74337]: DEBUG nova.network.neutron [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Port 148d28e8-2783-44a9-a08e-c648f0aa9489 binding to destination host user is already ACTIVE {{(pid=74337) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Oct 23 21:53:30 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Acquiring lock "86f56afb-77e6-4378-b441-5cf507a0fbe7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:53:30 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lock "86f56afb-77e6-4378-b441-5cf507a0fbe7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:53:30 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lock "86f56afb-77e6-4378-b441-5cf507a0fbe7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:53:30 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Acquiring lock "refresh_cache-86f56afb-77e6-4378-b441-5cf507a0fbe7" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:53:30 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Acquired lock "refresh_cache-86f56afb-77e6-4378-b441-5cf507a0fbe7" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:53:30 user nova-compute[74337]: DEBUG nova.network.neutron [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Building network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 21:53:30 user nova-compute[74337]: DEBUG nova.network.neutron [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Updating instance_info_cache with network_info: [{"id": "148d28e8-2783-44a9-a08e-c648f0aa9489", "address": "fa:16:3e:47:98:97", "network": {"id": "aff1f95f-fda8-4f0f-8d10-7e3d587e4fda", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2048135647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1f57e58a9ec4c6384dc0d3ca58eb610", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap148d28e8-27", "ovs_interfaceid": "148d28e8-2783-44a9-a08e-c648f0aa9489", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:53:30 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Releasing lock "refresh_cache-86f56afb-77e6-4378-b441-5cf507a0fbe7" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:53:30 user nova-compute[74337]: DEBUG os_brick.utils [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:53:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:53:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:53:30 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d80bb8-723d-4759-8488-c662ac48eb05]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f34011b66e40\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:53:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:53:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:53:30 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddcd5dfb-877b-47e9-8f1f-de46dbc526f7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:53:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:53:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:53:30 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[789b541a-5839-4088-ad61-d4bb1436871c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:53:30 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b92dc9e7-7c3e-4654-b4c3-bfa2809dc3a6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:53:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Running cmd (subprocess): nvme version {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:53:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] 'nvme version' failed. Not Retrying. {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 21:53:30 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] nvme not present on system {{(pid=74337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 21:53:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:53:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 21:53:30 user nova-compute[74337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 21:53:30 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[833d2c33-b278-47a2-9fdb-fd11d49890e0]: (4, '') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:53:30 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 21:53:30 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 21:53:30 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] LIGHTOS: no hostnqn found. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 21:53:30 user nova-compute[74337]: DEBUG os_brick.utils [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f34011b66e40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:53:33 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:53:33 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:53:38 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:53:38 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:53:43 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:53:43 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:53:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:53:48 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:53:48 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Starting finish_migration {{(pid=74337) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Oct 23 21:53:48 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Instance directory exists: not creating {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 23 21:53:48 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Creating image(s)
Oct 23 21:53:48 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Did not create local disks {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 23 21:53:48 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Ensure instance console log exists: /opt/stack/data/nova/instances/86f56afb-77e6-4378-b441-5cf507a0fbe7/console.log {{(pid=74337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 21:53:48 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:53:48 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:53:48 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:53:48 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Start _get_guest_xml network_info=[{"id": "148d28e8-2783-44a9-a08e-c648f0aa9489", "address": "fa:16:3e:47:98:97", "network": {"id": "aff1f95f-fda8-4f0f-8d10-7e3d587e4fda", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2048135647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2048135647-network", "vif_mac": "fa:16:3e:47:98:97"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1f57e58a9ec4c6384dc0d3ca58eb610", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap148d28e8-27", "ovs_interfaceid": "148d28e8-2783-44a9-a08e-c648f0aa9489", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '6dd08741-1f83-4e59-846e-f07f7e3feda0', 'delete_on_termination': True, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HKWwxeEB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '86f56afb-77e6-4378-b441-5cf507a0fbe7', 'attached_at': '2023-10-23T21:53:48.000000', 'detached_at': '', 'volume_id': 'ec6df319-3945-4eda-a0b9-7c351eaf4398', 'serial': 'ec6df319-3945-4eda-a0b9-7c351eaf4398'}, 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 21:53:48 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:53:48 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:53:48 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 21:53:48 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] CPU controller missing on host. {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 21:53:48 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 21:53:48 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] CPU controller found on host. {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 21:53:48 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 21:53:48 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T21:29:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 21:53:48 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Flavor limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 21:53:48 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Image limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 21:53:48 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Flavor pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 21:53:48 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Image pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 21:53:48 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 21:53:48 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 21:53:48 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 21:53:48 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Got 1 possible topologies {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 21:53:48 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 21:53:48 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 21:53:48 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Calling os-brick to attach iSCSI Volume {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 21:53:48 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HKWwxeEB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:53:48 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:53:48 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:53:48 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:53:48 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:53:48 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:53:48 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:53:48 user nova-compute[74337]: INFO os_brick.initiator.connectors.iscsi [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 21:53:48 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 -p 172.16.0.220:3260 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:53:48 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:53:48 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:53:48 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6ce087a-8ed7-43b7-93b0-b6a082af43be]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:53:48 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 21:53:48 user nova-compute[74337]:  {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:53:48 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 -p 172.16.0.220:3260 --interface default --op new {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:53:48 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:53:48 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c369790b-d836-4c1b-863e-481682dcf66b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398] added\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:53:48 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398] added
Oct 23 21:53:48 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:53:48 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:53:48 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:53:48 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a6d655-80f6-4073-9db7-5cd470451578]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:53:48 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:53:48 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:53:48 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:53:48 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[83f3193c-30a4-46f2-8697-7332804f97c7]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:53:48 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:53:48 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HKWwxeEB {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:53:48 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HKWwxeEB" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:53:48 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c87227ab-1ef3-442f-8ced-cf717fb39277]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:53:48 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HKWwxeEB'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:53:48 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:53:48 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:53:48 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac005ce5-4889-487c-aa28-7026e3c6d451]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:53:48 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:53:48 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:53:48 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:53:48 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca25896f-569e-4dde-ba8f-ae9433cef15c]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:53:48 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:53:48 user nova-compute[74337]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 (non-flash)
Oct 23 21:53:48 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:53:48 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:53:48 user nova-compute[74337]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 (non-flash)
Oct 23 21:53:48 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:53:48 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 -p 172.16.0.220:3260 --login {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:53:48 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:53:48 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c93069-95db-42b4-9fe0-ebc684251673]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:53:48 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398, portal: 172.16.0.220,3260]
Oct 23 21:53:48 user nova-compute[74337]: Login to [iface: default, target: iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398, portal: 172.16.0.220,3260] successful.
Oct 23 21:53:48 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:53:48 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:53:48 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:53:48 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:53:48 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[62fe0b9f-3a45-4d97-a7c8-e7147ebbcdc6]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:53:48 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:53:48 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:53:48 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:53:48 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6628bf88-ac63-4584-a781-f697f199556e]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:53:48 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:53:48 user nova-compute[74337]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 (non-flash)
Oct 23 21:53:48 user nova-compute[74337]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 (non-flash)
Oct 23 21:53:48 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:53:48 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:53:48 user nova-compute[74337]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 (non-flash)
Oct 23 21:53:48 user nova-compute[74337]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 (non-flash)
Oct 23 21:53:48 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:53:48 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:53:48 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Connected to 172.16.0.220:3260 {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 21:53:48 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] HCTL ('33', '-', '-', 0) found on session 35 with lun 0 {{(pid=74337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 21:53:48 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 21:53:48 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:53:48 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:53:48 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad5e3fa5-d30b-4fd7-9e45-0b410fdbbe6f]: (4, ('- - 0', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:53:48 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Searching for a device in session 35 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 21:53:48 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HKWwxeEB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 21:53:49 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:53:49 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '23231356561613565', 'path': '/dev/sdb'} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:53:49 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23231356561613565', 'path': '/dev/sdb'} {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 21:53:49 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:51:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1798504573',display_name='tempest-ServerActionsTestOtherA-server-1798504573',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1798504573',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAUefvW5MXCf+ATdQvlG858gIBXPDNbf7wcgIdNA8u/7ry6R/jyuWYoMofLLf6tWmqavGvJQy7SZOewcrGrMe1Wf24ACMK0qGJkM0S6nAXe5EBQ2zvJtr8dUyXZnBDdU6w==',key_name='tempest-keypair-1448030867',keypairs=<?>,launch_index=0,launched_at=2023-10-23T21:51:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e1f57e58a9ec4c6384dc0d3ca58eb610',ramdisk_id='',reservation_id='r-lyxkco2l',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-100075475',owner_user_name='tempest-ServerActionsTestOtherA-100075475-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:53:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='891ee2e3acc54ed0bc4571f63ff491a0',uuid=86f56afb-77e6-4378-b441-5cf507a0fbe7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "148d28e8-2783-44a9-a08e-c648f0aa9489", "address": "fa:16:3e:47:98:97", "network": {"id": "aff1f95f-fda8-4f0f-8d10-7e3d587e4fda", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2048135647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2048135647-network", "vif_mac": "fa:16:3e:47:98:97"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1f57e58a9ec4c6384dc0d3ca58eb610", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap148d28e8-27", "ovs_interfaceid": "148d28e8-2783-44a9-a08e-c648f0aa9489", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 21:53:49 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Converting VIF {"id": "148d28e8-2783-44a9-a08e-c648f0aa9489", "address": "fa:16:3e:47:98:97", "network": {"id": "aff1f95f-fda8-4f0f-8d10-7e3d587e4fda", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2048135647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2048135647-network", "vif_mac": "fa:16:3e:47:98:97"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1f57e58a9ec4c6384dc0d3ca58eb610", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap148d28e8-27", "ovs_interfaceid": "148d28e8-2783-44a9-a08e-c648f0aa9489", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:53:49 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:98:97,bridge_name='br-int',has_traffic_filtering=True,id=148d28e8-2783-44a9-a08e-c648f0aa9489,network=Network(aff1f95f-fda8-4f0f-8d10-7e3d587e4fda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap148d28e8-27') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:53:49 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] End _get_guest_xml xml=<domain type="kvm">
Oct 23 21:53:49 user nova-compute[74337]:   <uuid>86f56afb-77e6-4378-b441-5cf507a0fbe7</uuid>
Oct 23 21:53:49 user nova-compute[74337]:   <name>instance-00000020</name>
Oct 23 21:53:49 user nova-compute[74337]:   <memory>2097152</memory>
Oct 23 21:53:49 user nova-compute[74337]:   <vcpu>1</vcpu>
Oct 23 21:53:49 user nova-compute[74337]:   <metadata>
Oct 23 21:53:49 user nova-compute[74337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 21:53:49 user nova-compute[74337]:       <nova:package version="0.0.0"/>
Oct 23 21:53:49 user nova-compute[74337]:       <nova:name>tempest-ServerActionsTestOtherA-server-1798504573</nova:name>
Oct 23 21:53:49 user nova-compute[74337]:       <nova:creationTime>2023-10-23 21:53:48</nova:creationTime>
Oct 23 21:53:49 user nova-compute[74337]:       <nova:flavor name="m1.small">
Oct 23 21:53:49 user nova-compute[74337]:         <nova:memory>2048</nova:memory>
Oct 23 21:53:49 user nova-compute[74337]:         <nova:disk>20</nova:disk>
Oct 23 21:53:49 user nova-compute[74337]:         <nova:swap>0</nova:swap>
Oct 23 21:53:49 user nova-compute[74337]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 21:53:49 user nova-compute[74337]:         <nova:vcpus>1</nova:vcpus>
Oct 23 21:53:49 user nova-compute[74337]:       </nova:flavor>
Oct 23 21:53:49 user nova-compute[74337]:       <nova:owner>
Oct 23 21:53:49 user nova-compute[74337]:         <nova:user uuid="891ee2e3acc54ed0bc4571f63ff491a0">tempest-ServerActionsTestOtherA-100075475-project-member</nova:user>
Oct 23 21:53:49 user nova-compute[74337]:         <nova:project uuid="e1f57e58a9ec4c6384dc0d3ca58eb610">tempest-ServerActionsTestOtherA-100075475</nova:project>
Oct 23 21:53:49 user nova-compute[74337]:       </nova:owner>
Oct 23 21:53:49 user nova-compute[74337]:       <nova:ports>
Oct 23 21:53:49 user nova-compute[74337]:         <nova:port uuid="148d28e8-2783-44a9-a08e-c648f0aa9489">
Oct 23 21:53:49 user nova-compute[74337]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 23 21:53:49 user nova-compute[74337]:         </nova:port>
Oct 23 21:53:49 user nova-compute[74337]:       </nova:ports>
Oct 23 21:53:49 user nova-compute[74337]:     </nova:instance>
Oct 23 21:53:49 user nova-compute[74337]:   </metadata>
Oct 23 21:53:49 user nova-compute[74337]:   <sysinfo type="smbios">
Oct 23 21:53:49 user nova-compute[74337]:     <system>
Oct 23 21:53:49 user nova-compute[74337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 21:53:49 user nova-compute[74337]:       <entry name="product">OpenStack Nova</entry>
Oct 23 21:53:49 user nova-compute[74337]:       <entry name="version">0.0.0</entry>
Oct 23 21:53:49 user nova-compute[74337]:       <entry name="serial">86f56afb-77e6-4378-b441-5cf507a0fbe7</entry>
Oct 23 21:53:49 user nova-compute[74337]:       <entry name="uuid">86f56afb-77e6-4378-b441-5cf507a0fbe7</entry>
Oct 23 21:53:49 user nova-compute[74337]:       <entry name="family">Virtual Machine</entry>
Oct 23 21:53:49 user nova-compute[74337]:     </system>
Oct 23 21:53:49 user nova-compute[74337]:   </sysinfo>
Oct 23 21:53:49 user nova-compute[74337]:   <os>
Oct 23 21:53:49 user nova-compute[74337]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 21:53:49 user nova-compute[74337]:     <boot dev="hd"/>
Oct 23 21:53:49 user nova-compute[74337]:     <smbios mode="sysinfo"/>
Oct 23 21:53:49 user nova-compute[74337]:   </os>
Oct 23 21:53:49 user nova-compute[74337]:   <features>
Oct 23 21:53:49 user nova-compute[74337]:     <acpi/>
Oct 23 21:53:49 user nova-compute[74337]:     <apic/>
Oct 23 21:53:49 user nova-compute[74337]:     <vmcoreinfo/>
Oct 23 21:53:49 user nova-compute[74337]:   </features>
Oct 23 21:53:49 user nova-compute[74337]:   <clock offset="utc">
Oct 23 21:53:49 user nova-compute[74337]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 21:53:49 user nova-compute[74337]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 21:53:49 user nova-compute[74337]:     <timer name="hpet" present="no"/>
Oct 23 21:53:49 user nova-compute[74337]:   </clock>
Oct 23 21:53:49 user nova-compute[74337]:   <cpu mode="custom" match="exact">
Oct 23 21:53:49 user nova-compute[74337]:     <model>Nehalem</model>
Oct 23 21:53:49 user nova-compute[74337]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 21:53:49 user nova-compute[74337]:   </cpu>
Oct 23 21:53:49 user nova-compute[74337]:   <devices>
Oct 23 21:53:49 user nova-compute[74337]:     <disk type="block" device="disk">
Oct 23 21:53:49 user nova-compute[74337]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 21:53:49 user nova-compute[74337]:       <source dev="/dev/sdb"/>
Oct 23 21:53:49 user nova-compute[74337]:       <target dev="vda" bus="virtio"/>
Oct 23 21:53:49 user nova-compute[74337]:       <serial>ec6df319-3945-4eda-a0b9-7c351eaf4398</serial>
Oct 23 21:53:49 user nova-compute[74337]:     </disk>
Oct 23 21:53:49 user nova-compute[74337]:     <interface type="ethernet">
Oct 23 21:53:49 user nova-compute[74337]:       <mac address="fa:16:3e:47:98:97"/>
Oct 23 21:53:49 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:53:49 user nova-compute[74337]:       <mtu size="1442"/>
Oct 23 21:53:49 user nova-compute[74337]:       <target dev="tap148d28e8-27"/>
Oct 23 21:53:49 user nova-compute[74337]:     </interface>
Oct 23 21:53:49 user nova-compute[74337]:     <serial type="pty">
Oct 23 21:53:49 user nova-compute[74337]:       <log file="/opt/stack/data/nova/instances/86f56afb-77e6-4378-b441-5cf507a0fbe7/console.log" append="off"/>
Oct 23 21:53:49 user nova-compute[74337]:     </serial>
Oct 23 21:53:49 user nova-compute[74337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 21:53:49 user nova-compute[74337]:     <video>
Oct 23 21:53:49 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:53:49 user nova-compute[74337]:     </video>
Oct 23 21:53:49 user nova-compute[74337]:     <rng model="virtio">
Oct 23 21:53:49 user nova-compute[74337]:       <backend model="random">/dev/urandom</backend>
Oct 23 21:53:49 user nova-compute[74337]:     </rng>
Oct 23 21:53:49 user nova-compute[74337]:     <controller type="usb" index="0" model="none"/>
Oct 23 21:53:49 user nova-compute[74337]:     <memballoon model="virtio">
Oct 23 21:53:49 user nova-compute[74337]:       <stats period="10"/>
Oct 23 21:53:49 user nova-compute[74337]:     </memballoon>
Oct 23 21:53:49 user nova-compute[74337]:   </devices>
Oct 23 21:53:49 user nova-compute[74337]: </domain>
Oct 23 21:53:49 user nova-compute[74337]:  {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 21:53:49 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:51:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1798504573',display_name='tempest-ServerActionsTestOtherA-server-1798504573',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1798504573',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAUefvW5MXCf+ATdQvlG858gIBXPDNbf7wcgIdNA8u/7ry6R/jyuWYoMofLLf6tWmqavGvJQy7SZOewcrGrMe1Wf24ACMK0qGJkM0S6nAXe5EBQ2zvJtr8dUyXZnBDdU6w==',key_name='tempest-keypair-1448030867',keypairs=<?>,launch_index=0,launched_at=2023-10-23T21:51:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e1f57e58a9ec4c6384dc0d3ca58eb610',ramdisk_id='',reservation_id='r-lyxkco2l',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-100075475',owner_user_name='tempest-ServerActionsTestOtherA-100075475-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:53:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='891ee2e3acc54ed0bc4571f63ff491a0',uuid=86f56afb-77e6-4378-b441-5cf507a0fbe7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "148d28e8-2783-44a9-a08e-c648f0aa9489", "address": "fa:16:3e:47:98:97", "network": {"id": "aff1f95f-fda8-4f0f-8d10-7e3d587e4fda", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2048135647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2048135647-network", "vif_mac": "fa:16:3e:47:98:97"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1f57e58a9ec4c6384dc0d3ca58eb610", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap148d28e8-27", "ovs_interfaceid": "148d28e8-2783-44a9-a08e-c648f0aa9489", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 21:53:49 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Converting VIF {"id": "148d28e8-2783-44a9-a08e-c648f0aa9489", "address": "fa:16:3e:47:98:97", "network": {"id": "aff1f95f-fda8-4f0f-8d10-7e3d587e4fda", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2048135647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2048135647-network", "vif_mac": "fa:16:3e:47:98:97"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1f57e58a9ec4c6384dc0d3ca58eb610", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap148d28e8-27", "ovs_interfaceid": "148d28e8-2783-44a9-a08e-c648f0aa9489", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:53:49 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:98:97,bridge_name='br-int',has_traffic_filtering=True,id=148d28e8-2783-44a9-a08e-c648f0aa9489,network=Network(aff1f95f-fda8-4f0f-8d10-7e3d587e4fda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap148d28e8-27') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:53:49 user nova-compute[74337]: DEBUG os_vif [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:98:97,bridge_name='br-int',has_traffic_filtering=True,id=148d28e8-2783-44a9-a08e-c648f0aa9489,network=Network(aff1f95f-fda8-4f0f-8d10-7e3d587e4fda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap148d28e8-27') {{(pid=74337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 21:53:49 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:53:49 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:53:49 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 21:53:49 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:53:49 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bc8192d2-f52b-58b2-b39c-24c5d302286b', '_type': 'linux-noop'}}, row=False) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:53:49 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:53:49 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:53:49 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:53:49 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap148d28e8-27, may_exist=True, interface_attrs={}) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:53:49 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap148d28e8-27, col_values=(('qos', UUID('269e3278-c281-459d-9c10-74215c913736')),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:53:49 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap148d28e8-27, col_values=(('external_ids', {'iface-id': '148d28e8-2783-44a9-a08e-c648f0aa9489', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:47:98:97', 'vm-uuid': '86f56afb-77e6-4378-b441-5cf507a0fbe7'}),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:53:49 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:53:49 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:53:49 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:53:49 user nova-compute[74337]: INFO os_vif [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:98:97,bridge_name='br-int',has_traffic_filtering=True,id=148d28e8-2783-44a9-a08e-c648f0aa9489,network=Network(aff1f95f-fda8-4f0f-8d10-7e3d587e4fda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap148d28e8-27')
Oct 23 21:53:49 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] No BDM found with device name vda, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 21:53:49 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] No VIF found with MAC fa:16:3e:47:98:97, not building metadata {{(pid=74337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 21:53:51 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:53:51 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:53:51 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:53:51 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:53:51 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:53:53 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:53:53 user nova-compute[74337]: DEBUG nova.compute.manager [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Instance event wait completed in 0 seconds for  {{(pid=74337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 21:53:53 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Instance running successfully.
Oct 23 21:53:53 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Failed to set time: agent not configured {{(pid=74337) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Oct 23 21:53:53 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-b956ab3c-36e3-436b-ad93-f4aff93267ca tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] finish_migration finished successfully. {{(pid=74337) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Oct 23 21:53:53 user nova-compute[74337]: DEBUG nova.compute.manager [req-e6aa055d-3c92-49fb-a802-7455d9e996aa req-fa8e5553-885a-4589-bd9c-a17b108d4195 service nova] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Received event network-vif-plugged-148d28e8-2783-44a9-a08e-c648f0aa9489 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:53:53 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-e6aa055d-3c92-49fb-a802-7455d9e996aa req-fa8e5553-885a-4589-bd9c-a17b108d4195 service nova] Acquiring lock "86f56afb-77e6-4378-b441-5cf507a0fbe7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:53:53 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-e6aa055d-3c92-49fb-a802-7455d9e996aa req-fa8e5553-885a-4589-bd9c-a17b108d4195 service nova] Lock "86f56afb-77e6-4378-b441-5cf507a0fbe7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:53:53 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-e6aa055d-3c92-49fb-a802-7455d9e996aa req-fa8e5553-885a-4589-bd9c-a17b108d4195 service nova] Lock "86f56afb-77e6-4378-b441-5cf507a0fbe7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:53:53 user nova-compute[74337]: DEBUG nova.compute.manager [req-e6aa055d-3c92-49fb-a802-7455d9e996aa req-fa8e5553-885a-4589-bd9c-a17b108d4195 service nova] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] No waiting events found dispatching network-vif-plugged-148d28e8-2783-44a9-a08e-c648f0aa9489 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:53:53 user nova-compute[74337]: WARNING nova.compute.manager [req-e6aa055d-3c92-49fb-a802-7455d9e996aa req-fa8e5553-885a-4589-bd9c-a17b108d4195 service nova] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Received unexpected event network-vif-plugged-148d28e8-2783-44a9-a08e-c648f0aa9489 for instance with vm_state active and task_state resize_finish.
Oct 23 21:53:53 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:53:54 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:53:55 user nova-compute[74337]: DEBUG nova.compute.manager [req-c18feb77-1b17-4730-94c6-dca43032e895 req-a442e6df-d2a2-4444-89cc-73ab2cc9fb61 service nova] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Received event network-vif-plugged-148d28e8-2783-44a9-a08e-c648f0aa9489 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:53:55 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-c18feb77-1b17-4730-94c6-dca43032e895 req-a442e6df-d2a2-4444-89cc-73ab2cc9fb61 service nova] Acquiring lock "86f56afb-77e6-4378-b441-5cf507a0fbe7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:53:55 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-c18feb77-1b17-4730-94c6-dca43032e895 req-a442e6df-d2a2-4444-89cc-73ab2cc9fb61 service nova] Lock "86f56afb-77e6-4378-b441-5cf507a0fbe7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:53:55 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-c18feb77-1b17-4730-94c6-dca43032e895 req-a442e6df-d2a2-4444-89cc-73ab2cc9fb61 service nova] Lock "86f56afb-77e6-4378-b441-5cf507a0fbe7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:53:55 user nova-compute[74337]: DEBUG nova.compute.manager [req-c18feb77-1b17-4730-94c6-dca43032e895 req-a442e6df-d2a2-4444-89cc-73ab2cc9fb61 service nova] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] No waiting events found dispatching network-vif-plugged-148d28e8-2783-44a9-a08e-c648f0aa9489 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:53:55 user nova-compute[74337]: WARNING nova.compute.manager [req-c18feb77-1b17-4730-94c6-dca43032e895 req-a442e6df-d2a2-4444-89cc-73ab2cc9fb61 service nova] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Received unexpected event network-vif-plugged-148d28e8-2783-44a9-a08e-c648f0aa9489 for instance with vm_state resized and task_state None.
Oct 23 21:53:58 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:53:59 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:54:02 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:54:03 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:54:04 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Acquiring lock "bc4c3e54-a845-4ea8-9ffc-a75d42a51788" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:54:04 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "bc4c3e54-a845-4ea8-9ffc-a75d42a51788" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:54:04 user nova-compute[74337]: DEBUG nova.compute.manager [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: bc4c3e54-a845-4ea8-9ffc-a75d42a51788] Starting instance... {{(pid=74337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 21:54:04 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:54:04 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:54:04 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 21:54:04 user nova-compute[74337]: INFO nova.compute.claims [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: bc4c3e54-a845-4ea8-9ffc-a75d42a51788] Claim successful on node user
Oct 23 21:54:04 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:54:04 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:54:04 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.461s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:54:04 user nova-compute[74337]: DEBUG nova.compute.manager [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: bc4c3e54-a845-4ea8-9ffc-a75d42a51788] Start building networks asynchronously for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 21:54:04 user nova-compute[74337]: DEBUG nova.compute.manager [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: bc4c3e54-a845-4ea8-9ffc-a75d42a51788] Allocating IP information in the background. {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 21:54:04 user nova-compute[74337]: DEBUG nova.network.neutron [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: bc4c3e54-a845-4ea8-9ffc-a75d42a51788] allocate_for_instance() {{(pid=74337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 21:54:04 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: bc4c3e54-a845-4ea8-9ffc-a75d42a51788] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 21:54:04 user nova-compute[74337]: DEBUG nova.compute.manager [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: bc4c3e54-a845-4ea8-9ffc-a75d42a51788] Start building block device mappings for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 21:54:04 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:54:04 user nova-compute[74337]: INFO nova.virt.block_device [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: bc4c3e54-a845-4ea8-9ffc-a75d42a51788] Booting with volume b016c715-febf-41d9-bc8f-2ffbf5bf3048 at /dev/vda
Oct 23 21:54:04 user nova-compute[74337]: DEBUG nova.policy [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0c3e635e8e5447138a7f2db11695574c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb567547bd4941fb87435a841c9d17c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74337) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 21:54:05 user nova-compute[74337]: DEBUG os_brick.utils [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:54:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:54:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:54:05 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[34ef348e-fe5e-4d2c-8516-fc138ba6e27b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f34011b66e40\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:54:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:54:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:54:05 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[514f03f1-0892-461d-93c9-f5b8a233b91d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:54:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:54:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:54:05 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b6c36b1-eb41-4e70-b190-ada5f479e949]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:54:05 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e28ba74f-db7f-4aa1-9354-63a5d9aaf073]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:54:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Running cmd (subprocess): nvme version {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:54:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] 'nvme version' failed. Not Retrying. {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 21:54:05 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] nvme not present on system {{(pid=74337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 21:54:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:54:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 21:54:05 user nova-compute[74337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 21:54:05 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bd57fc4-f3a3-4131-a5a3-69c34c79f3c2]: (4, '') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:54:05 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 21:54:05 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 21:54:05 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] LIGHTOS: no hostnqn found. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 21:54:05 user nova-compute[74337]: DEBUG os_brick.utils [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f34011b66e40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:54:05 user nova-compute[74337]: DEBUG nova.virt.block_device [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: bc4c3e54-a845-4ea8-9ffc-a75d42a51788] Updating existing volume attachment record: 381e553a-3ccf-472e-a889-df6304953ca7 {{(pid=74337) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 21:54:05 user nova-compute[74337]: INFO nova.compute.manager [None req-91f4de40-cacb-49d0-9542-6514f2c8ebbd tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] Unrescuing
Oct 23 21:54:05 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-91f4de40-cacb-49d0-9542-6514f2c8ebbd tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Acquiring lock "refresh_cache-bf53e0fc-71d1-48fa-b0b4-ed3400a21c38" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:54:05 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-91f4de40-cacb-49d0-9542-6514f2c8ebbd tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Acquired lock "refresh_cache-bf53e0fc-71d1-48fa-b0b4-ed3400a21c38" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:54:05 user nova-compute[74337]: DEBUG nova.network.neutron [None req-91f4de40-cacb-49d0-9542-6514f2c8ebbd tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] Building network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 21:54:05 user nova-compute[74337]: DEBUG nova.network.neutron [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: bc4c3e54-a845-4ea8-9ffc-a75d42a51788] Successfully created port: 42cc5f62-7b3d-40a1-96f8-29bed95db3de {{(pid=74337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 21:54:05 user nova-compute[74337]: DEBUG nova.network.neutron [None req-91f4de40-cacb-49d0-9542-6514f2c8ebbd tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] Updating instance_info_cache with network_info: [{"id": "d8fa8fea-2adc-42e9-9d0c-cbcbfe43db80", "address": "fa:16:3e:0f:95:9c", "network": {"id": "5f62b1d8-d5d0-4ff9-922b-fc6e72fb640d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-655282105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b85c4f783a4ee7ab67422b49da85ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8fa8fea-2a", "ovs_interfaceid": "d8fa8fea-2adc-42e9-9d0c-cbcbfe43db80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:54:05 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-91f4de40-cacb-49d0-9542-6514f2c8ebbd tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Releasing lock "refresh_cache-bf53e0fc-71d1-48fa-b0b4-ed3400a21c38" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:54:05 user nova-compute[74337]: DEBUG nova.objects.instance [None req-91f4de40-cacb-49d0-9542-6514f2c8ebbd tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lazy-loading 'flavor' on Instance uuid bf53e0fc-71d1-48fa-b0b4-ed3400a21c38 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:54:06 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:54:06 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:54:06 user nova-compute[74337]: DEBUG nova.compute.manager [req-df4ab0dd-c349-40ef-b160-e243711ef92f req-7c17f7f0-9459-425d-9f65-24e7853ffbd8 service nova] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] Received event network-vif-unplugged-d8fa8fea-2adc-42e9-9d0c-cbcbfe43db80 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:54:06 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-df4ab0dd-c349-40ef-b160-e243711ef92f req-7c17f7f0-9459-425d-9f65-24e7853ffbd8 service nova] Acquiring lock "bf53e0fc-71d1-48fa-b0b4-ed3400a21c38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:54:06 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-df4ab0dd-c349-40ef-b160-e243711ef92f req-7c17f7f0-9459-425d-9f65-24e7853ffbd8 service nova] Lock "bf53e0fc-71d1-48fa-b0b4-ed3400a21c38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:54:06 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-df4ab0dd-c349-40ef-b160-e243711ef92f req-7c17f7f0-9459-425d-9f65-24e7853ffbd8 service nova] Lock "bf53e0fc-71d1-48fa-b0b4-ed3400a21c38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:54:06 user nova-compute[74337]: DEBUG nova.compute.manager [req-df4ab0dd-c349-40ef-b160-e243711ef92f req-7c17f7f0-9459-425d-9f65-24e7853ffbd8 service nova] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] No waiting events found dispatching network-vif-unplugged-d8fa8fea-2adc-42e9-9d0c-cbcbfe43db80 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:54:06 user nova-compute[74337]: WARNING nova.compute.manager [req-df4ab0dd-c349-40ef-b160-e243711ef92f req-7c17f7f0-9459-425d-9f65-24e7853ffbd8 service nova] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] Received unexpected event network-vif-unplugged-d8fa8fea-2adc-42e9-9d0c-cbcbfe43db80 for instance with vm_state rescued and task_state unrescuing.
Oct 23 21:54:06 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:54:06 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:54:06 user nova-compute[74337]: DEBUG nova.network.neutron [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: bc4c3e54-a845-4ea8-9ffc-a75d42a51788] Successfully updated port: 42cc5f62-7b3d-40a1-96f8-29bed95db3de {{(pid=74337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 21:54:06 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Acquiring lock "refresh_cache-bc4c3e54-a845-4ea8-9ffc-a75d42a51788" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:54:06 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Acquired lock "refresh_cache-bc4c3e54-a845-4ea8-9ffc-a75d42a51788" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:54:06 user nova-compute[74337]: DEBUG nova.network.neutron [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: bc4c3e54-a845-4ea8-9ffc-a75d42a51788] Building network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 21:54:06 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] Instance destroyed successfully.
Oct 23 21:54:06 user nova-compute[74337]: DEBUG nova.compute.manager [req-7bea2586-4562-4605-bb48-49b3d07c3cad req-e1391b63-2b6b-4b16-9a15-6d016537b1b8 service nova] [instance: bc4c3e54-a845-4ea8-9ffc-a75d42a51788] Received event network-changed-42cc5f62-7b3d-40a1-96f8-29bed95db3de {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:54:06 user nova-compute[74337]: DEBUG nova.compute.manager [req-7bea2586-4562-4605-bb48-49b3d07c3cad req-e1391b63-2b6b-4b16-9a15-6d016537b1b8 service nova] [instance: bc4c3e54-a845-4ea8-9ffc-a75d42a51788] Refreshing instance network info cache due to event network-changed-42cc5f62-7b3d-40a1-96f8-29bed95db3de. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 21:54:06 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-7bea2586-4562-4605-bb48-49b3d07c3cad req-e1391b63-2b6b-4b16-9a15-6d016537b1b8 service nova] Acquiring lock "refresh_cache-bc4c3e54-a845-4ea8-9ffc-a75d42a51788" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:54:06 user nova-compute[74337]: DEBUG nova.network.neutron [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: bc4c3e54-a845-4ea8-9ffc-a75d42a51788] Instance cache missing network info. {{(pid=74337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 21:54:07 user nova-compute[74337]: DEBUG nova.network.neutron [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: bc4c3e54-a845-4ea8-9ffc-a75d42a51788] Updating instance_info_cache with network_info: [{"id": "42cc5f62-7b3d-40a1-96f8-29bed95db3de", "address": "fa:16:3e:88:4f:9a", "network": {"id": "5a18e96f-a6eb-4989-9be3-154b54928b03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-507511840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb567547bd4941fb87435a841c9d17c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42cc5f62-7b", "ovs_interfaceid": "42cc5f62-7b3d-40a1-96f8-29bed95db3de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:54:07 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Releasing lock "refresh_cache-bc4c3e54-a845-4ea8-9ffc-a75d42a51788" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:54:07 user nova-compute[74337]: DEBUG nova.compute.manager [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: bc4c3e54-a845-4ea8-9ffc-a75d42a51788] Instance network_info: |[{"id": "42cc5f62-7b3d-40a1-96f8-29bed95db3de", "address": "fa:16:3e:88:4f:9a", "network": {"id": "5a18e96f-a6eb-4989-9be3-154b54928b03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-507511840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb567547bd4941fb87435a841c9d17c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42cc5f62-7b", "ovs_interfaceid": "42cc5f62-7b3d-40a1-96f8-29bed95db3de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 21:54:07 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-7bea2586-4562-4605-bb48-49b3d07c3cad req-e1391b63-2b6b-4b16-9a15-6d016537b1b8 service nova] Acquired lock "refresh_cache-bc4c3e54-a845-4ea8-9ffc-a75d42a51788" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:54:07 user nova-compute[74337]: DEBUG nova.network.neutron [req-7bea2586-4562-4605-bb48-49b3d07c3cad req-e1391b63-2b6b-4b16-9a15-6d016537b1b8 service nova] [instance: bc4c3e54-a845-4ea8-9ffc-a75d42a51788] Refreshing network info cache for port 42cc5f62-7b3d-40a1-96f8-29bed95db3de {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 21:54:07 user nova-compute[74337]: DEBUG nova.network.neutron [req-7bea2586-4562-4605-bb48-49b3d07c3cad req-e1391b63-2b6b-4b16-9a15-6d016537b1b8 service nova] [instance: bc4c3e54-a845-4ea8-9ffc-a75d42a51788] Updated VIF entry in instance network info cache for port 42cc5f62-7b3d-40a1-96f8-29bed95db3de. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 21:54:07 user nova-compute[74337]: DEBUG nova.network.neutron [req-7bea2586-4562-4605-bb48-49b3d07c3cad req-e1391b63-2b6b-4b16-9a15-6d016537b1b8 service nova] [instance: bc4c3e54-a845-4ea8-9ffc-a75d42a51788] Updating instance_info_cache with network_info: [{"id": "42cc5f62-7b3d-40a1-96f8-29bed95db3de", "address": "fa:16:3e:88:4f:9a", "network": {"id": "5a18e96f-a6eb-4989-9be3-154b54928b03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-507511840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb567547bd4941fb87435a841c9d17c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42cc5f62-7b", "ovs_interfaceid": "42cc5f62-7b3d-40a1-96f8-29bed95db3de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:54:07 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-7bea2586-4562-4605-bb48-49b3d07c3cad req-e1391b63-2b6b-4b16-9a15-6d016537b1b8 service nova] Releasing lock "refresh_cache-bc4c3e54-a845-4ea8-9ffc-a75d42a51788" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:54:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:54:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:54:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:54:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:54:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:54:08 user nova-compute[74337]: DEBUG nova.compute.manager [req-2639429a-6c12-4bdc-828f-3633a088741d req-d21127fd-c3e3-4739-9bd3-7d65ca15201a service nova] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] Received event network-vif-plugged-d8fa8fea-2adc-42e9-9d0c-cbcbfe43db80 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:54:08 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-2639429a-6c12-4bdc-828f-3633a088741d req-d21127fd-c3e3-4739-9bd3-7d65ca15201a service nova] Acquiring lock "bf53e0fc-71d1-48fa-b0b4-ed3400a21c38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:54:08 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-2639429a-6c12-4bdc-828f-3633a088741d req-d21127fd-c3e3-4739-9bd3-7d65ca15201a service nova] Lock "bf53e0fc-71d1-48fa-b0b4-ed3400a21c38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:54:08 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-2639429a-6c12-4bdc-828f-3633a088741d req-d21127fd-c3e3-4739-9bd3-7d65ca15201a service nova] Lock "bf53e0fc-71d1-48fa-b0b4-ed3400a21c38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:54:08 user nova-compute[74337]: DEBUG nova.compute.manager [req-2639429a-6c12-4bdc-828f-3633a088741d req-d21127fd-c3e3-4739-9bd3-7d65ca15201a service nova] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] No waiting events found dispatching network-vif-plugged-d8fa8fea-2adc-42e9-9d0c-cbcbfe43db80 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:54:08 user nova-compute[74337]: WARNING nova.compute.manager [req-2639429a-6c12-4bdc-828f-3633a088741d req-d21127fd-c3e3-4739-9bd3-7d65ca15201a service nova] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] Received unexpected event network-vif-plugged-d8fa8fea-2adc-42e9-9d0c-cbcbfe43db80 for instance with vm_state rescued and task_state unrescuing.
Oct 23 21:54:08 user nova-compute[74337]: DEBUG nova.compute.manager [req-2639429a-6c12-4bdc-828f-3633a088741d req-d21127fd-c3e3-4739-9bd3-7d65ca15201a service nova] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] Received event network-vif-plugged-d8fa8fea-2adc-42e9-9d0c-cbcbfe43db80 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:54:08 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-2639429a-6c12-4bdc-828f-3633a088741d req-d21127fd-c3e3-4739-9bd3-7d65ca15201a service nova] Acquiring lock "bf53e0fc-71d1-48fa-b0b4-ed3400a21c38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:54:08 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-2639429a-6c12-4bdc-828f-3633a088741d req-d21127fd-c3e3-4739-9bd3-7d65ca15201a service nova] Lock "bf53e0fc-71d1-48fa-b0b4-ed3400a21c38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:54:08 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-2639429a-6c12-4bdc-828f-3633a088741d req-d21127fd-c3e3-4739-9bd3-7d65ca15201a service nova] Lock "bf53e0fc-71d1-48fa-b0b4-ed3400a21c38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:54:08 user nova-compute[74337]: DEBUG nova.compute.manager [req-2639429a-6c12-4bdc-828f-3633a088741d req-d21127fd-c3e3-4739-9bd3-7d65ca15201a service nova] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] No waiting events found dispatching network-vif-plugged-d8fa8fea-2adc-42e9-9d0c-cbcbfe43db80 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:54:08 user nova-compute[74337]: WARNING nova.compute.manager [req-2639429a-6c12-4bdc-828f-3633a088741d req-d21127fd-c3e3-4739-9bd3-7d65ca15201a service nova] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] Received unexpected event network-vif-plugged-d8fa8fea-2adc-42e9-9d0c-cbcbfe43db80 for instance with vm_state rescued and task_state unrescuing.
Oct 23 21:54:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:54:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:54:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:54:10 user nova-compute[74337]: DEBUG nova.compute.manager [None req-91f4de40-cacb-49d0-9542-6514f2c8ebbd tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] Checking state {{(pid=74337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 21:54:10 user nova-compute[74337]: DEBUG nova.compute.manager [req-070416e2-3b0f-451f-a7b8-fea1637d1653 req-5fb72b9e-e218-4af9-8a97-6093c877b627 service nova] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] Received event network-vif-plugged-d8fa8fea-2adc-42e9-9d0c-cbcbfe43db80 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:54:10 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-070416e2-3b0f-451f-a7b8-fea1637d1653 req-5fb72b9e-e218-4af9-8a97-6093c877b627 service nova] Acquiring lock "bf53e0fc-71d1-48fa-b0b4-ed3400a21c38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:54:10 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-070416e2-3b0f-451f-a7b8-fea1637d1653 req-5fb72b9e-e218-4af9-8a97-6093c877b627 service nova] Lock "bf53e0fc-71d1-48fa-b0b4-ed3400a21c38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:54:10 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-070416e2-3b0f-451f-a7b8-fea1637d1653 req-5fb72b9e-e218-4af9-8a97-6093c877b627 service nova] Lock "bf53e0fc-71d1-48fa-b0b4-ed3400a21c38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:54:10 user nova-compute[74337]: DEBUG nova.compute.manager [req-070416e2-3b0f-451f-a7b8-fea1637d1653 req-5fb72b9e-e218-4af9-8a97-6093c877b627 service nova] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] No waiting events found dispatching network-vif-plugged-d8fa8fea-2adc-42e9-9d0c-cbcbfe43db80 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:54:10 user nova-compute[74337]: WARNING nova.compute.manager [req-070416e2-3b0f-451f-a7b8-fea1637d1653 req-5fb72b9e-e218-4af9-8a97-6093c877b627 service nova] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] Received unexpected event network-vif-plugged-d8fa8fea-2adc-42e9-9d0c-cbcbfe43db80 for instance with vm_state active and task_state None.
Oct 23 21:54:10 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:54:10 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:54:10 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 21:54:10 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] Acquiring lock "0323b854-c7a1-42e8-ad85-1e929caa6e9d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:54:10 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] Lock "0323b854-c7a1-42e8-ad85-1e929caa6e9d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:54:10 user nova-compute[74337]: DEBUG nova.compute.manager [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d] Starting instance... {{(pid=74337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 21:54:11 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:54:11 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:54:11 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 21:54:11 user nova-compute[74337]: INFO nova.compute.claims [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d] Claim successful on node user
Oct 23 21:54:11 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:54:11 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:54:11 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.503s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:54:11 user nova-compute[74337]: DEBUG nova.compute.manager [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d] Start building networks asynchronously for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 21:54:11 user nova-compute[74337]: DEBUG nova.compute.manager [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d] Allocating IP information in the background. {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 21:54:11 user nova-compute[74337]: DEBUG nova.network.neutron [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d] allocate_for_instance() {{(pid=74337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 21:54:11 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 21:54:11 user nova-compute[74337]: DEBUG nova.compute.manager [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d] Start building block device mappings for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 21:54:11 user nova-compute[74337]: DEBUG nova.policy [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd64b0bdc62064df8b3db31fb2a09cb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998e7763a94e4045bc097208ab368db9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74337) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 21:54:11 user nova-compute[74337]: INFO nova.virt.block_device [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d] Booting with volume 89f93205-ad98-45ff-8903-c2a7251da607 at /dev/vda
Oct 23 21:54:11 user nova-compute[74337]: DEBUG os_brick.utils [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:54:11 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:54:11 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:54:11 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[68557d98-a41d-4b4a-a545-e53911606288]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f34011b66e40\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:54:11 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:54:11 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:54:11 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1747cb1-b050-4f14-8b51-0e960296d904]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:54:11 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:54:11 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:54:11 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b438f373-99c6-4531-bffe-87407076d04e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:54:11 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d9bbb1b-de1a-4fed-9cce-a0ef6cd565e6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:54:11 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] Running cmd (subprocess): nvme version {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:54:11 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] 'nvme version' failed. Not Retrying. {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 21:54:11 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] nvme not present on system {{(pid=74337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 21:54:11 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:54:11 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 21:54:11 user nova-compute[74337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 21:54:11 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[cabd3583-b7f5-4a1b-ac6d-d91916e10b53]: (4, '') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:54:11 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 21:54:11 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 21:54:11 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] LIGHTOS: no hostnqn found. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 21:54:11 user nova-compute[74337]: DEBUG os_brick.utils [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f34011b66e40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:54:11 user nova-compute[74337]: DEBUG nova.virt.block_device [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d] Updating existing volume attachment record: a8070ca4-6d84-4b20-ab4e-133b7afef2cd {{(pid=74337) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 21:54:12 user nova-compute[74337]: DEBUG nova.network.neutron [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d] Successfully created port: acb8f6c5-55fe-4a9d-82b3-70d9503356f2 {{(pid=74337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 21:54:12 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:54:12 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Starting heal instance info cache {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 21:54:12 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "refresh_cache-c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:54:12 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquired lock "refresh_cache-c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:54:12 user nova-compute[74337]: DEBUG nova.network.neutron [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] Forcefully refreshing network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 21:54:12 user nova-compute[74337]: DEBUG nova.network.neutron [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] Updating instance_info_cache with network_info: [{"id": "328722f1-b384-495c-8aea-81780b2d9ca1", "address": "fa:16:3e:28:35:83", "network": {"id": "5f62b1d8-d5d0-4ff9-922b-fc6e72fb640d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-655282105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b85c4f783a4ee7ab67422b49da85ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap328722f1-b3", "ovs_interfaceid": "328722f1-b384-495c-8aea-81780b2d9ca1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:54:12 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Releasing lock "refresh_cache-c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:54:12 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] Updated the network info_cache for instance {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 21:54:12 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:54:12 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:54:13 user nova-compute[74337]: DEBUG nova.network.neutron [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d] Successfully updated port: acb8f6c5-55fe-4a9d-82b3-70d9503356f2 {{(pid=74337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 21:54:13 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] Acquiring lock "refresh_cache-0323b854-c7a1-42e8-ad85-1e929caa6e9d" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:54:13 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] Acquired lock "refresh_cache-0323b854-c7a1-42e8-ad85-1e929caa6e9d" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:54:13 user nova-compute[74337]: DEBUG nova.network.neutron [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d] Building network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 21:54:13 user nova-compute[74337]: DEBUG nova.compute.manager [req-4ca16d9e-6147-4642-a6b6-205e485cb430 req-f059a603-ef50-47eb-936e-8c560236629e service nova] [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d] Received event network-changed-acb8f6c5-55fe-4a9d-82b3-70d9503356f2 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:54:13 user nova-compute[74337]: DEBUG nova.compute.manager [req-4ca16d9e-6147-4642-a6b6-205e485cb430 req-f059a603-ef50-47eb-936e-8c560236629e service nova] [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d] Refreshing instance network info cache due to event network-changed-acb8f6c5-55fe-4a9d-82b3-70d9503356f2. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 21:54:13 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-4ca16d9e-6147-4642-a6b6-205e485cb430 req-f059a603-ef50-47eb-936e-8c560236629e service nova] Acquiring lock "refresh_cache-0323b854-c7a1-42e8-ad85-1e929caa6e9d" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:54:13 user nova-compute[74337]: DEBUG nova.network.neutron [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d] Instance cache missing network info. {{(pid=74337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 21:54:13 user nova-compute[74337]: DEBUG nova.network.neutron [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d] Updating instance_info_cache with network_info: [{"id": "acb8f6c5-55fe-4a9d-82b3-70d9503356f2", "address": "fa:16:3e:ac:1d:a3", "network": {"id": "95dce4e0-8f8c-4034-a0ab-1c8ee0b1e631", "bridge": "br-int", "label": "tempest-TestShelveInstance-603341331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "998e7763a94e4045bc097208ab368db9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacb8f6c5-55", "ovs_interfaceid": "acb8f6c5-55fe-4a9d-82b3-70d9503356f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:54:13 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] Releasing lock "refresh_cache-0323b854-c7a1-42e8-ad85-1e929caa6e9d" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:54:13 user nova-compute[74337]: DEBUG nova.compute.manager [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d] Instance network_info: |[{"id": "acb8f6c5-55fe-4a9d-82b3-70d9503356f2", "address": "fa:16:3e:ac:1d:a3", "network": {"id": "95dce4e0-8f8c-4034-a0ab-1c8ee0b1e631", "bridge": "br-int", "label": "tempest-TestShelveInstance-603341331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "998e7763a94e4045bc097208ab368db9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacb8f6c5-55", "ovs_interfaceid": "acb8f6c5-55fe-4a9d-82b3-70d9503356f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 21:54:13 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-4ca16d9e-6147-4642-a6b6-205e485cb430 req-f059a603-ef50-47eb-936e-8c560236629e service nova] Acquired lock "refresh_cache-0323b854-c7a1-42e8-ad85-1e929caa6e9d" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:54:13 user nova-compute[74337]: DEBUG nova.network.neutron [req-4ca16d9e-6147-4642-a6b6-205e485cb430 req-f059a603-ef50-47eb-936e-8c560236629e service nova] [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d] Refreshing network info cache for port acb8f6c5-55fe-4a9d-82b3-70d9503356f2 {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 21:54:13 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:54:13 user nova-compute[74337]: DEBUG nova.network.neutron [req-4ca16d9e-6147-4642-a6b6-205e485cb430 req-f059a603-ef50-47eb-936e-8c560236629e service nova] [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d] Updated VIF entry in instance network info cache for port acb8f6c5-55fe-4a9d-82b3-70d9503356f2. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 21:54:13 user nova-compute[74337]: DEBUG nova.network.neutron [req-4ca16d9e-6147-4642-a6b6-205e485cb430 req-f059a603-ef50-47eb-936e-8c560236629e service nova] [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d] Updating instance_info_cache with network_info: [{"id": "acb8f6c5-55fe-4a9d-82b3-70d9503356f2", "address": "fa:16:3e:ac:1d:a3", "network": {"id": "95dce4e0-8f8c-4034-a0ab-1c8ee0b1e631", "bridge": "br-int", "label": "tempest-TestShelveInstance-603341331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "998e7763a94e4045bc097208ab368db9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacb8f6c5-55", "ovs_interfaceid": "acb8f6c5-55fe-4a9d-82b3-70d9503356f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:54:13 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-4ca16d9e-6147-4642-a6b6-205e485cb430 req-f059a603-ef50-47eb-936e-8c560236629e service nova] Releasing lock "refresh_cache-0323b854-c7a1-42e8-ad85-1e929caa6e9d" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:54:14 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:54:18 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:54:18 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:54:18 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:54:19 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:54:19 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:54:19 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:54:19 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:54:19 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Auditing locally available compute resources for user (node: user) {{(pid=74337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 21:54:19 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 21:54:19 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5d9d286-4837-4168-a4fe-1bc09e372654/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:54:19 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5d9d286-4837-4168-a4fe-1bc09e372654/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:54:19 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5d9d286-4837-4168-a4fe-1bc09e372654/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:54:19 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:54:19 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5d9d286-4837-4168-a4fe-1bc09e372654/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:54:19 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/547c4d4c-e0dd-495a-b83f-98426d0a4a99/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:54:20 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/547c4d4c-e0dd-495a-b83f-98426d0a4a99/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:54:20 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/547c4d4c-e0dd-495a-b83f-98426d0a4a99/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:54:20 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/547c4d4c-e0dd-495a-b83f-98426d0a4a99/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:54:20 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 21:54:20 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e05fd36-ee44-4992-80a9-f95af608b9f5/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:54:20 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e05fd36-ee44-4992-80a9-f95af608b9f5/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:54:20 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e05fd36-ee44-4992-80a9-f95af608b9f5/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:54:20 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e05fd36-ee44-4992-80a9-f95af608b9f5/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:54:20 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b0f8cc-bfec-42f2-b8cf-29f0603e3169/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:54:20 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b0f8cc-bfec-42f2-b8cf-29f0603e3169/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:54:20 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b0f8cc-bfec-42f2-b8cf-29f0603e3169/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:54:21 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b0f8cc-bfec-42f2-b8cf-29f0603e3169/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:54:21 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e326a14c-61d7-4dca-b55f-db0f3ab0d14e/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:54:21 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e326a14c-61d7-4dca-b55f-db0f3ab0d14e/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:54:21 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e326a14c-61d7-4dca-b55f-db0f3ab0d14e/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:54:21 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e326a14c-61d7-4dca-b55f-db0f3ab0d14e/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:54:21 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 21:54:21 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1189976f-8d02-468d-8fa7-bd5594c5f85a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:54:21 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1189976f-8d02-468d-8fa7-bd5594c5f85a/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:54:21 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1189976f-8d02-468d-8fa7-bd5594c5f85a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:54:21 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1189976f-8d02-468d-8fa7-bd5594c5f85a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:54:22 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:54:22 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:54:22 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Hypervisor/Node resource view: name=user free_ram=7670MB free_disk=25.05628204345703GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 21:54:22 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:54:22 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:54:22 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Applying migration context for instance 86f56afb-77e6-4378-b441-5cf507a0fbe7 as it has an incoming, in-progress migration f4c67630-bc3f-4bc4-b842-4143f24df22e. Migration status is finished {{(pid=74337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 23 21:54:22 user nova-compute[74337]: INFO nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Updating resource usage from migration f4c67630-bc3f-4bc4-b842-4143f24df22e
Oct 23 21:54:22 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 1189976f-8d02-468d-8fa7-bd5594c5f85a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:54:22 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 547c4d4c-e0dd-495a-b83f-98426d0a4a99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:54:22 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 00f757cf-e5dd-476f-81c6-670ed2bf6938 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Oct 23 21:54:22 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:54:22 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 1e05fd36-ee44-4992-80a9-f95af608b9f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:54:22 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance bf53e0fc-71d1-48fa-b0b4-ed3400a21c38 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:54:22 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance e326a14c-61d7-4dca-b55f-db0f3ab0d14e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:54:22 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 86b0f8cc-bfec-42f2-b8cf-29f0603e3169 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:54:22 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance d5d9d286-4837-4168-a4fe-1bc09e372654 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:54:22 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Migration f4c67630-bc3f-4bc4-b842-4143f24df22e is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 23 21:54:22 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 86f56afb-77e6-4378-b441-5cf507a0fbe7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:54:22 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance bc4c3e54-a845-4ea8-9ffc-a75d42a51788 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:54:22 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 0323b854-c7a1-42e8-ad85-1e929caa6e9d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:54:22 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 21:54:22 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 21:54:22 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Refreshing inventories for resource provider dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 23 21:54:22 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Updating ProviderTree inventory for provider dfcf3942-a432-4293-945b-14b86f57d794 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 23 21:54:22 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Updating inventory in ProviderTree for provider dfcf3942-a432-4293-945b-14b86f57d794 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 23 21:54:22 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Refreshing aggregate associations for resource provider dfcf3942-a432-4293-945b-14b86f57d794, aggregates: None {{(pid=74337) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 23 21:54:22 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Refreshing trait associations for resource provider dfcf3942-a432-4293-945b-14b86f57d794, traits: COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE2,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE42,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_EXTEND,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_TRUSTED_CERTS {{(pid=74337) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 23 21:54:23 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:54:23 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:54:23 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Compute_service record updated for user:user {{(pid=74337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 21:54:23 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.915s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:54:23 user nova-compute[74337]: DEBUG nova.compute.manager [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: bc4c3e54-a845-4ea8-9ffc-a75d42a51788] Start spawning the instance on the hypervisor. {{(pid=74337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 21:54:23 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: bc4c3e54-a845-4ea8-9ffc-a75d42a51788] Creating instance directory {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 21:54:23 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: bc4c3e54-a845-4ea8-9ffc-a75d42a51788] Creating image(s)
Oct 23 21:54:23 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: bc4c3e54-a845-4ea8-9ffc-a75d42a51788] Did not create local disks {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 23 21:54:23 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: bc4c3e54-a845-4ea8-9ffc-a75d42a51788] Ensure instance console log exists: /opt/stack/data/nova/instances/bc4c3e54-a845-4ea8-9ffc-a75d42a51788/console.log {{(pid=74337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 21:54:23 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:54:23 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:54:23 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:54:23 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: bc4c3e54-a845-4ea8-9ffc-a75d42a51788] Start _get_guest_xml network_info=[{"id": "42cc5f62-7b3d-40a1-96f8-29bed95db3de", "address": "fa:16:3e:88:4f:9a", "network": {"id": "5a18e96f-a6eb-4989-9be3-154b54928b03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-507511840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb567547bd4941fb87435a841c9d17c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42cc5f62-7b", "ovs_interfaceid": "42cc5f62-7b3d-40a1-96f8-29bed95db3de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '381e553a-3ccf-472e-a889-df6304953ca7', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MQuLsncZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'bc4c3e54-a845-4ea8-9ffc-a75d42a51788', 'attached_at': '', 'detached_at': '', 'volume_id': 'b016c715-febf-41d9-bc8f-2ffbf5bf3048', 'serial': 'b016c715-febf-41d9-bc8f-2ffbf5bf3048'}, 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 21:54:23 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:54:23 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:54:23 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 21:54:23 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] CPU controller missing on host. {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 21:54:23 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 21:54:23 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] CPU controller found on host. {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 21:54:23 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 21:54:23 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T21:29:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 21:54:23 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Flavor limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 21:54:23 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Image limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 21:54:23 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Flavor pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 21:54:23 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Image pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 21:54:23 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 21:54:23 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 21:54:23 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 21:54:23 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Got 1 possible topologies {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 21:54:23 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 21:54:23 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 21:54:23 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: bc4c3e54-a845-4ea8-9ffc-a75d42a51788] Calling os-brick to attach iSCSI Volume {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 21:54:23 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MQuLsncZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:54:23 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:54:23 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:54:23 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:54:23 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:54:23 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:54:23 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:54:23 user nova-compute[74337]: INFO os_brick.initiator.connectors.iscsi [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 21:54:23 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 -p 172.16.0.220:3260 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:54:23 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:54:23 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[490783c7-d2ad-4386-a6d8-977ab14a26c7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:54:23 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 21:54:23 user nova-compute[74337]:  {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:54:23 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 -p 172.16.0.220:3260 --interface default --op new {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:54:23 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:54:23 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[46186117-2b18-4e7c-853b-212f4e1b8000]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048] added\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:54:23 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048] added
Oct 23 21:54:23 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:54:23 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:54:23 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:54:23 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca76a4a4-0439-4f88-8ae8-e5ba5cf8cc6d]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:54:23 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:54:23 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:54:23 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:54:23 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[2605107e-8d02-4c0c-9c0d-aa14adbf5414]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:54:23 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:54:23 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MQuLsncZ {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:54:23 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MQuLsncZ" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:54:23 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7e658fb-fa14-4cdf-9a5a-3858b10f795c]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:54:23 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MQuLsncZ'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:54:23 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:54:23 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:54:23 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d574aa4a-2600-479a-a783-a882093d9a6c]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:54:23 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:54:23 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:54:23 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:54:23 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b9e0fc8-be8c-42f6-801b-6cf488804c6d]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:54:23 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:54:23 user nova-compute[74337]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 (non-flash)
Oct 23 21:54:23 user nova-compute[74337]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 (non-flash)
Oct 23 21:54:23 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:54:23 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:54:23 user nova-compute[74337]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 (non-flash)
Oct 23 21:54:23 user nova-compute[74337]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 (non-flash)
Oct 23 21:54:23 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:54:23 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 -p 172.16.0.220:3260 --login {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:54:23 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:54:23 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e40616a9-ade0-4e75-9278-2ce67caca869]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:54:23 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048, portal: 172.16.0.220,3260]
Oct 23 21:54:23 user nova-compute[74337]: Login to [iface: default, target: iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048, portal: 172.16.0.220,3260] successful.
Oct 23 21:54:23 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:54:23 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:54:23 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:54:23 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b86488e-f5b4-4718-a298-57f50e1ab9c7]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:54:23 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:54:23 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:54:23 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:54:23 user nova-compute[74337]: DEBUG nova.compute.manager [req-31a7f645-6f0f-4f78-ac66-335450a702d8 req-17735389-354f-4cac-af3b-0469037b81d6 service nova] [instance: e326a14c-61d7-4dca-b55f-db0f3ab0d14e] Received event network-changed-790838d0-4783-4446-84a9-2932fe826a36 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:54:23 user nova-compute[74337]: DEBUG nova.compute.manager [req-31a7f645-6f0f-4f78-ac66-335450a702d8 req-17735389-354f-4cac-af3b-0469037b81d6 service nova] [instance: e326a14c-61d7-4dca-b55f-db0f3ab0d14e] Refreshing instance network info cache due to event network-changed-790838d0-4783-4446-84a9-2932fe826a36. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 21:54:23 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-31a7f645-6f0f-4f78-ac66-335450a702d8 req-17735389-354f-4cac-af3b-0469037b81d6 service nova] Acquiring lock "refresh_cache-e326a14c-61d7-4dca-b55f-db0f3ab0d14e" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:54:23 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-31a7f645-6f0f-4f78-ac66-335450a702d8 req-17735389-354f-4cac-af3b-0469037b81d6 service nova] Acquired lock "refresh_cache-e326a14c-61d7-4dca-b55f-db0f3ab0d14e" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:54:23 user nova-compute[74337]: DEBUG nova.network.neutron [req-31a7f645-6f0f-4f78-ac66-335450a702d8 req-17735389-354f-4cac-af3b-0469037b81d6 service nova] [instance: e326a14c-61d7-4dca-b55f-db0f3ab0d14e] Refreshing network info cache for port 790838d0-4783-4446-84a9-2932fe826a36 {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 21:54:23 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:54:23 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4af884f-d224-4639-b043-9db750fc9568]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:54:23 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:54:23 user nova-compute[74337]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 (non-flash)
Oct 23 21:54:23 user nova-compute[74337]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 (non-flash)
Oct 23 21:54:23 user nova-compute[74337]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 (non-flash)
Oct 23 21:54:23 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:54:23 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:54:23 user nova-compute[74337]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 (non-flash)
Oct 23 21:54:23 user nova-compute[74337]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 (non-flash)
Oct 23 21:54:23 user nova-compute[74337]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 (non-flash)
Oct 23 21:54:23 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:54:23 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:54:23 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Connected to 172.16.0.220:3260 {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 21:54:23 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] HCTL ('36', '-', '-', 0) found on session 36 with lun 0 {{(pid=74337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 21:54:23 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 21:54:23 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:54:23 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:54:23 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[16ccc8f2-03e2-4f6d-9b7a-ba797f9d10e7]: (4, ('- - 0', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:54:23 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Searching for a device in session 36 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 21:54:23 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MQuLsncZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 21:54:24 user nova-compute[74337]: DEBUG nova.network.neutron [req-31a7f645-6f0f-4f78-ac66-335450a702d8 req-17735389-354f-4cac-af3b-0469037b81d6 service nova] [instance: e326a14c-61d7-4dca-b55f-db0f3ab0d14e] Updated VIF entry in instance network info cache for port 790838d0-4783-4446-84a9-2932fe826a36. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 21:54:24 user nova-compute[74337]: DEBUG nova.network.neutron [req-31a7f645-6f0f-4f78-ac66-335450a702d8 req-17735389-354f-4cac-af3b-0469037b81d6 service nova] [instance: e326a14c-61d7-4dca-b55f-db0f3ab0d14e] Updating instance_info_cache with network_info: [{"id": "790838d0-4783-4446-84a9-2932fe826a36", "address": "fa:16:3e:99:b7:b3", "network": {"id": "fe0a9f00-e17b-4064-96d2-fd1cc848afb2", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1294741219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96dc585a51343db94529e22adbd6ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap790838d0-47", "ovs_interfaceid": "790838d0-4783-4446-84a9-2932fe826a36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:54:24 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-31a7f645-6f0f-4f78-ac66-335450a702d8 req-17735389-354f-4cac-af3b-0469037b81d6 service nova] Releasing lock "refresh_cache-e326a14c-61d7-4dca-b55f-db0f3ab0d14e" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:54:24 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.345s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:54:24 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] <== connect_volume: return (1347ms) {'type': 'block', 'scsi_wwn': '23662306635653666', 'path': '/dev/sde'} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:54:24 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: bc4c3e54-a845-4ea8-9ffc-a75d42a51788] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23662306635653666', 'path': '/dev/sde'} {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 21:54:24 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:54:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1990079629',display_name='tempest-TestVolumeBootPattern-server-1990079629',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1990079629',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF9NMFNWTU3BVoh69lm2h364CNXP9OO2Sq0+VU67LFY2Y7YP31lo2g7Nqc/sdO6ndxwSu3pXMChCzpRUGVair3TDlV76zriaKktCrpgsBnYg9q7WYnK8Iuk7Ag22Kj7gAw==',key_name='tempest-TestVolumeBootPattern-1223802412',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb567547bd4941fb87435a841c9d17c4',ramdisk_id='',reservation_id='r-inn242p3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-499971371',owner_user_name='tempest-TestVolumeBootPattern-499971371-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:54:05Z,user_data=None,user_id='0c3e635e8e5447138a7f2db11695574c',uuid=bc4c3e54-a845-4ea8-9ffc-a75d42a51788,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "42cc5f62-7b3d-40a1-96f8-29bed95db3de", "address": "fa:16:3e:88:4f:9a", "network": {"id": "5a18e96f-a6eb-4989-9be3-154b54928b03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-507511840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb567547bd4941fb87435a841c9d17c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42cc5f62-7b", "ovs_interfaceid": "42cc5f62-7b3d-40a1-96f8-29bed95db3de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 21:54:24 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Converting VIF {"id": "42cc5f62-7b3d-40a1-96f8-29bed95db3de", "address": "fa:16:3e:88:4f:9a", "network": {"id": "5a18e96f-a6eb-4989-9be3-154b54928b03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-507511840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb567547bd4941fb87435a841c9d17c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42cc5f62-7b", "ovs_interfaceid": "42cc5f62-7b3d-40a1-96f8-29bed95db3de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:54:24 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:4f:9a,bridge_name='br-int',has_traffic_filtering=True,id=42cc5f62-7b3d-40a1-96f8-29bed95db3de,network=Network(5a18e96f-a6eb-4989-9be3-154b54928b03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42cc5f62-7b') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:54:24 user nova-compute[74337]: DEBUG nova.objects.instance [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lazy-loading 'pci_devices' on Instance uuid bc4c3e54-a845-4ea8-9ffc-a75d42a51788 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:54:24 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: bc4c3e54-a845-4ea8-9ffc-a75d42a51788] End _get_guest_xml xml=<domain type="kvm">
Oct 23 21:54:24 user nova-compute[74337]:   <uuid>bc4c3e54-a845-4ea8-9ffc-a75d42a51788</uuid>
Oct 23 21:54:24 user nova-compute[74337]:   <name>instance-00000024</name>
Oct 23 21:54:24 user nova-compute[74337]:   <memory>524288</memory>
Oct 23 21:54:24 user nova-compute[74337]:   <vcpu>1</vcpu>
Oct 23 21:54:24 user nova-compute[74337]:   <metadata>
Oct 23 21:54:24 user nova-compute[74337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 21:54:24 user nova-compute[74337]:       <nova:package version="0.0.0"/>
Oct 23 21:54:24 user nova-compute[74337]:       <nova:name>tempest-TestVolumeBootPattern-server-1990079629</nova:name>
Oct 23 21:54:24 user nova-compute[74337]:       <nova:creationTime>2023-10-23 21:54:23</nova:creationTime>
Oct 23 21:54:24 user nova-compute[74337]:       <nova:flavor name="m1.tiny">
Oct 23 21:54:24 user nova-compute[74337]:         <nova:memory>512</nova:memory>
Oct 23 21:54:24 user nova-compute[74337]:         <nova:disk>1</nova:disk>
Oct 23 21:54:24 user nova-compute[74337]:         <nova:swap>0</nova:swap>
Oct 23 21:54:24 user nova-compute[74337]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 21:54:24 user nova-compute[74337]:         <nova:vcpus>1</nova:vcpus>
Oct 23 21:54:24 user nova-compute[74337]:       </nova:flavor>
Oct 23 21:54:24 user nova-compute[74337]:       <nova:owner>
Oct 23 21:54:24 user nova-compute[74337]:         <nova:user uuid="0c3e635e8e5447138a7f2db11695574c">tempest-TestVolumeBootPattern-499971371-project-member</nova:user>
Oct 23 21:54:24 user nova-compute[74337]:         <nova:project uuid="cb567547bd4941fb87435a841c9d17c4">tempest-TestVolumeBootPattern-499971371</nova:project>
Oct 23 21:54:24 user nova-compute[74337]:       </nova:owner>
Oct 23 21:54:24 user nova-compute[74337]:       <nova:ports>
Oct 23 21:54:24 user nova-compute[74337]:         <nova:port uuid="42cc5f62-7b3d-40a1-96f8-29bed95db3de">
Oct 23 21:54:24 user nova-compute[74337]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 23 21:54:24 user nova-compute[74337]:         </nova:port>
Oct 23 21:54:24 user nova-compute[74337]:       </nova:ports>
Oct 23 21:54:24 user nova-compute[74337]:     </nova:instance>
Oct 23 21:54:24 user nova-compute[74337]:   </metadata>
Oct 23 21:54:24 user nova-compute[74337]:   <sysinfo type="smbios">
Oct 23 21:54:24 user nova-compute[74337]:     <system>
Oct 23 21:54:24 user nova-compute[74337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 21:54:24 user nova-compute[74337]:       <entry name="product">OpenStack Nova</entry>
Oct 23 21:54:24 user nova-compute[74337]:       <entry name="version">0.0.0</entry>
Oct 23 21:54:24 user nova-compute[74337]:       <entry name="serial">bc4c3e54-a845-4ea8-9ffc-a75d42a51788</entry>
Oct 23 21:54:24 user nova-compute[74337]:       <entry name="uuid">bc4c3e54-a845-4ea8-9ffc-a75d42a51788</entry>
Oct 23 21:54:24 user nova-compute[74337]:       <entry name="family">Virtual Machine</entry>
Oct 23 21:54:24 user nova-compute[74337]:     </system>
Oct 23 21:54:24 user nova-compute[74337]:   </sysinfo>
Oct 23 21:54:24 user nova-compute[74337]:   <os>
Oct 23 21:54:24 user nova-compute[74337]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 21:54:24 user nova-compute[74337]:     <boot dev="hd"/>
Oct 23 21:54:24 user nova-compute[74337]:     <smbios mode="sysinfo"/>
Oct 23 21:54:24 user nova-compute[74337]:   </os>
Oct 23 21:54:24 user nova-compute[74337]:   <features>
Oct 23 21:54:24 user nova-compute[74337]:     <acpi/>
Oct 23 21:54:24 user nova-compute[74337]:     <apic/>
Oct 23 21:54:24 user nova-compute[74337]:     <vmcoreinfo/>
Oct 23 21:54:24 user nova-compute[74337]:   </features>
Oct 23 21:54:24 user nova-compute[74337]:   <clock offset="utc">
Oct 23 21:54:24 user nova-compute[74337]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 21:54:24 user nova-compute[74337]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 21:54:24 user nova-compute[74337]:     <timer name="hpet" present="no"/>
Oct 23 21:54:24 user nova-compute[74337]:   </clock>
Oct 23 21:54:24 user nova-compute[74337]:   <cpu mode="custom" match="exact">
Oct 23 21:54:24 user nova-compute[74337]:     <model>Nehalem</model>
Oct 23 21:54:24 user nova-compute[74337]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 21:54:24 user nova-compute[74337]:   </cpu>
Oct 23 21:54:24 user nova-compute[74337]:   <devices>
Oct 23 21:54:24 user nova-compute[74337]:     <disk type="block" device="disk">
Oct 23 21:54:24 user nova-compute[74337]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 21:54:24 user nova-compute[74337]:       <source dev="/dev/sde"/>
Oct 23 21:54:24 user nova-compute[74337]:       <target dev="vda" bus="virtio"/>
Oct 23 21:54:24 user nova-compute[74337]:       <serial>b016c715-febf-41d9-bc8f-2ffbf5bf3048</serial>
Oct 23 21:54:24 user nova-compute[74337]:     </disk>
Oct 23 21:54:24 user nova-compute[74337]:     <interface type="ethernet">
Oct 23 21:54:24 user nova-compute[74337]:       <mac address="fa:16:3e:88:4f:9a"/>
Oct 23 21:54:24 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:54:24 user nova-compute[74337]:       <mtu size="1442"/>
Oct 23 21:54:24 user nova-compute[74337]:       <target dev="tap42cc5f62-7b"/>
Oct 23 21:54:24 user nova-compute[74337]:     </interface>
Oct 23 21:54:24 user nova-compute[74337]:     <serial type="pty">
Oct 23 21:54:24 user nova-compute[74337]:       <log file="/opt/stack/data/nova/instances/bc4c3e54-a845-4ea8-9ffc-a75d42a51788/console.log" append="off"/>
Oct 23 21:54:24 user nova-compute[74337]:     </serial>
Oct 23 21:54:24 user nova-compute[74337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 21:54:24 user nova-compute[74337]:     <video>
Oct 23 21:54:24 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:54:24 user nova-compute[74337]:     </video>
Oct 23 21:54:24 user nova-compute[74337]:     <rng model="virtio">
Oct 23 21:54:24 user nova-compute[74337]:       <backend model="random">/dev/urandom</backend>
Oct 23 21:54:24 user nova-compute[74337]:     </rng>
Oct 23 21:54:24 user nova-compute[74337]:     <controller type="usb" index="0" model="none"/>
Oct 23 21:54:24 user nova-compute[74337]:     <memballoon model="virtio">
Oct 23 21:54:24 user nova-compute[74337]:       <stats period="10"/>
Oct 23 21:54:24 user nova-compute[74337]:     </memballoon>
Oct 23 21:54:24 user nova-compute[74337]:   </devices>
Oct 23 21:54:24 user nova-compute[74337]: </domain>
Oct 23 21:54:24 user nova-compute[74337]:  {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 21:54:24 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:54:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1990079629',display_name='tempest-TestVolumeBootPattern-server-1990079629',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1990079629',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF9NMFNWTU3BVoh69lm2h364CNXP9OO2Sq0+VU67LFY2Y7YP31lo2g7Nqc/sdO6ndxwSu3pXMChCzpRUGVair3TDlV76zriaKktCrpgsBnYg9q7WYnK8Iuk7Ag22Kj7gAw==',key_name='tempest-TestVolumeBootPattern-1223802412',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb567547bd4941fb87435a841c9d17c4',ramdisk_id='',reservation_id='r-inn242p3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-499971371',owner_user_name='tempest-TestVolumeBootPattern-499971371-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:54:05Z,user_data=None,user_id='0c3e635e8e5447138a7f2db11695574c',uuid=bc4c3e54-a845-4ea8-9ffc-a75d42a51788,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "42cc5f62-7b3d-40a1-96f8-29bed95db3de", "address": "fa:16:3e:88:4f:9a", "network": {"id": "5a18e96f-a6eb-4989-9be3-154b54928b03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-507511840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb567547bd4941fb87435a841c9d17c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42cc5f62-7b", "ovs_interfaceid": "42cc5f62-7b3d-40a1-96f8-29bed95db3de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 21:54:24 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Converting VIF {"id": "42cc5f62-7b3d-40a1-96f8-29bed95db3de", "address": "fa:16:3e:88:4f:9a", "network": {"id": "5a18e96f-a6eb-4989-9be3-154b54928b03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-507511840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb567547bd4941fb87435a841c9d17c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42cc5f62-7b", "ovs_interfaceid": "42cc5f62-7b3d-40a1-96f8-29bed95db3de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:54:24 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:4f:9a,bridge_name='br-int',has_traffic_filtering=True,id=42cc5f62-7b3d-40a1-96f8-29bed95db3de,network=Network(5a18e96f-a6eb-4989-9be3-154b54928b03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42cc5f62-7b') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:54:24 user nova-compute[74337]: DEBUG os_vif [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:4f:9a,bridge_name='br-int',has_traffic_filtering=True,id=42cc5f62-7b3d-40a1-96f8-29bed95db3de,network=Network(5a18e96f-a6eb-4989-9be3-154b54928b03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42cc5f62-7b') {{(pid=74337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 21:54:24 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:54:24 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:54:24 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 21:54:24 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:54:24 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8a53d8d4-ff57-5f89-89c6-58aa00cedcd6', '_type': 'linux-noop'}}, row=False) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:54:24 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:54:24 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:54:24 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:54:24 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap42cc5f62-7b, may_exist=True, interface_attrs={}) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:54:24 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap42cc5f62-7b, col_values=(('qos', UUID('befbd81a-c57d-4401-8e3f-68802f377593')),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:54:24 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap42cc5f62-7b, col_values=(('external_ids', {'iface-id': '42cc5f62-7b3d-40a1-96f8-29bed95db3de', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:88:4f:9a', 'vm-uuid': 'bc4c3e54-a845-4ea8-9ffc-a75d42a51788'}),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:54:24 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:54:24 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:54:24 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:54:24 user nova-compute[74337]: INFO os_vif [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:4f:9a,bridge_name='br-int',has_traffic_filtering=True,id=42cc5f62-7b3d-40a1-96f8-29bed95db3de,network=Network(5a18e96f-a6eb-4989-9be3-154b54928b03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42cc5f62-7b')
Oct 23 21:54:24 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] No BDM found with device name vda, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 21:54:24 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] No VIF found with MAC fa:16:3e:88:4f:9a, not building metadata {{(pid=74337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 21:54:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:54:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:54:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:54:26 user nova-compute[74337]: DEBUG nova.compute.manager [req-f341c412-36e6-4a29-adca-5162ec635b4b req-d735bcbb-f09a-4d83-bbe2-aeec90b921f7 service nova] [instance: bc4c3e54-a845-4ea8-9ffc-a75d42a51788] Received event network-vif-plugged-42cc5f62-7b3d-40a1-96f8-29bed95db3de {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:54:26 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-f341c412-36e6-4a29-adca-5162ec635b4b req-d735bcbb-f09a-4d83-bbe2-aeec90b921f7 service nova] Acquiring lock "bc4c3e54-a845-4ea8-9ffc-a75d42a51788-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:54:26 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-f341c412-36e6-4a29-adca-5162ec635b4b req-d735bcbb-f09a-4d83-bbe2-aeec90b921f7 service nova] Lock "bc4c3e54-a845-4ea8-9ffc-a75d42a51788-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:54:26 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-f341c412-36e6-4a29-adca-5162ec635b4b req-d735bcbb-f09a-4d83-bbe2-aeec90b921f7 service nova] Lock "bc4c3e54-a845-4ea8-9ffc-a75d42a51788-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:54:26 user nova-compute[74337]: DEBUG nova.compute.manager [req-f341c412-36e6-4a29-adca-5162ec635b4b req-d735bcbb-f09a-4d83-bbe2-aeec90b921f7 service nova] [instance: bc4c3e54-a845-4ea8-9ffc-a75d42a51788] No waiting events found dispatching network-vif-plugged-42cc5f62-7b3d-40a1-96f8-29bed95db3de {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:54:26 user nova-compute[74337]: WARNING nova.compute.manager [req-f341c412-36e6-4a29-adca-5162ec635b4b req-d735bcbb-f09a-4d83-bbe2-aeec90b921f7 service nova] [instance: bc4c3e54-a845-4ea8-9ffc-a75d42a51788] Received unexpected event network-vif-plugged-42cc5f62-7b3d-40a1-96f8-29bed95db3de for instance with vm_state building and task_state spawning.
Oct 23 21:54:26 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:54:26 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:54:26 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Cleaning up deleted instances {{(pid=74337) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 23 21:54:26 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] There are 0 instances to clean {{(pid=74337) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 23 21:54:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:54:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:54:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:54:28 user nova-compute[74337]: DEBUG nova.compute.manager [req-777ef00a-2ac2-49d2-b0ad-5f48cd7743c4 req-9c8dbd1e-7768-495c-8ed0-f3c29e5d04f2 service nova] [instance: bc4c3e54-a845-4ea8-9ffc-a75d42a51788] Received event network-vif-plugged-42cc5f62-7b3d-40a1-96f8-29bed95db3de {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:54:28 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-777ef00a-2ac2-49d2-b0ad-5f48cd7743c4 req-9c8dbd1e-7768-495c-8ed0-f3c29e5d04f2 service nova] Acquiring lock "bc4c3e54-a845-4ea8-9ffc-a75d42a51788-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:54:28 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-777ef00a-2ac2-49d2-b0ad-5f48cd7743c4 req-9c8dbd1e-7768-495c-8ed0-f3c29e5d04f2 service nova] Lock "bc4c3e54-a845-4ea8-9ffc-a75d42a51788-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:54:28 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-777ef00a-2ac2-49d2-b0ad-5f48cd7743c4 req-9c8dbd1e-7768-495c-8ed0-f3c29e5d04f2 service nova] Lock "bc4c3e54-a845-4ea8-9ffc-a75d42a51788-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:54:28 user nova-compute[74337]: DEBUG nova.compute.manager [req-777ef00a-2ac2-49d2-b0ad-5f48cd7743c4 req-9c8dbd1e-7768-495c-8ed0-f3c29e5d04f2 service nova] [instance: bc4c3e54-a845-4ea8-9ffc-a75d42a51788] No waiting events found dispatching network-vif-plugged-42cc5f62-7b3d-40a1-96f8-29bed95db3de {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:54:28 user nova-compute[74337]: WARNING nova.compute.manager [req-777ef00a-2ac2-49d2-b0ad-5f48cd7743c4 req-9c8dbd1e-7768-495c-8ed0-f3c29e5d04f2 service nova] [instance: bc4c3e54-a845-4ea8-9ffc-a75d42a51788] Received unexpected event network-vif-plugged-42cc5f62-7b3d-40a1-96f8-29bed95db3de for instance with vm_state building and task_state spawning.
Oct 23 21:54:28 user nova-compute[74337]: DEBUG nova.compute.manager [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: bc4c3e54-a845-4ea8-9ffc-a75d42a51788] Instance event wait completed in 0 seconds for  {{(pid=74337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 21:54:28 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: bc4c3e54-a845-4ea8-9ffc-a75d42a51788] Guest created on hypervisor {{(pid=74337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 21:54:28 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: bc4c3e54-a845-4ea8-9ffc-a75d42a51788] Instance spawned successfully.
Oct 23 21:54:28 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: bc4c3e54-a845-4ea8-9ffc-a75d42a51788] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 21:54:28 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: bc4c3e54-a845-4ea8-9ffc-a75d42a51788] Found default for hw_cdrom_bus of ide {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:54:28 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: bc4c3e54-a845-4ea8-9ffc-a75d42a51788] Found default for hw_disk_bus of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:54:28 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: bc4c3e54-a845-4ea8-9ffc-a75d42a51788] Found default for hw_input_bus of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:54:28 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: bc4c3e54-a845-4ea8-9ffc-a75d42a51788] Found default for hw_pointer_model of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:54:28 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: bc4c3e54-a845-4ea8-9ffc-a75d42a51788] Found default for hw_video_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:54:28 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: bc4c3e54-a845-4ea8-9ffc-a75d42a51788] Found default for hw_vif_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:54:28 user nova-compute[74337]: INFO nova.compute.manager [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: bc4c3e54-a845-4ea8-9ffc-a75d42a51788] Took 5.15 seconds to spawn the instance on the hypervisor.
Oct 23 21:54:28 user nova-compute[74337]: DEBUG nova.compute.manager [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: bc4c3e54-a845-4ea8-9ffc-a75d42a51788] Checking state {{(pid=74337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 21:54:28 user nova-compute[74337]: INFO nova.compute.manager [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: bc4c3e54-a845-4ea8-9ffc-a75d42a51788] Took 24.46 seconds to build instance.
Oct 23 21:54:28 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-27535cc0-b81f-46f7-a795-ff0af9788ff2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "bc4c3e54-a845-4ea8-9ffc-a75d42a51788" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.548s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:54:28 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:54:29 user nova-compute[74337]: DEBUG nova.compute.manager [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d] Start spawning the instance on the hypervisor. {{(pid=74337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 21:54:29 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d] Creating instance directory {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 21:54:29 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d] Creating image(s)
Oct 23 21:54:29 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d] Did not create local disks {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 23 21:54:29 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d] Ensure instance console log exists: /opt/stack/data/nova/instances/0323b854-c7a1-42e8-ad85-1e929caa6e9d/console.log {{(pid=74337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 21:54:29 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:54:29 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:54:29 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:54:29 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d] Start _get_guest_xml network_info=[{"id": "acb8f6c5-55fe-4a9d-82b3-70d9503356f2", "address": "fa:16:3e:ac:1d:a3", "network": {"id": "95dce4e0-8f8c-4034-a0ab-1c8ee0b1e631", "bridge": "br-int", "label": "tempest-TestShelveInstance-603341331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "998e7763a94e4045bc097208ab368db9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacb8f6c5-55", "ovs_interfaceid": "acb8f6c5-55fe-4a9d-82b3-70d9503356f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'a8070ca4-6d84-4b20-ab4e-133b7afef2cd', 'delete_on_termination': True, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JeADnxpV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0323b854-c7a1-42e8-ad85-1e929caa6e9d', 'attached_at': '', 'detached_at': '', 'volume_id': '89f93205-ad98-45ff-8903-c2a7251da607', 'serial': '89f93205-ad98-45ff-8903-c2a7251da607'}, 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 21:54:29 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:54:29 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:54:29 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:54:29 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 21:54:29 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] CPU controller missing on host. {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 21:54:29 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 21:54:29 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] CPU controller found on host. {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 21:54:29 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 21:54:29 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T21:29:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 21:54:29 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] Flavor limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 21:54:29 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] Image limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 21:54:29 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] Flavor pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 21:54:29 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] Image pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 21:54:29 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 21:54:29 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 21:54:29 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 21:54:29 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] Got 1 possible topologies {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 21:54:29 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 21:54:29 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 21:54:29 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d] Calling os-brick to attach iSCSI Volume {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 21:54:29 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JeADnxpV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:54:29 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:54:29 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:54:29 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:54:29 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:54:29 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:54:29 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:54:29 user nova-compute[74337]: INFO os_brick.initiator.connectors.iscsi [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 21:54:29 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607 -p 172.16.0.220:3260 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:54:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:54:30 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a1428d8-062f-469e-b1dd-e61788c3e307]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:54:30 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 21:54:30 user nova-compute[74337]:  {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:54:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607 -p 172.16.0.220:3260 --interface default --op new {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:54:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:54:30 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8be00eb-226c-4ef3-8e2f-0fd93a9cffbe]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607] added\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:54:30 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607] added
Oct 23 21:54:30 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:54:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:54:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:54:30 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[9673cf4d-6c04-43bb-92f5-bcb13241be14]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:54:30 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:54:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:54:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:54:30 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c87ea904-7a04-40c1-9ad8-3918226767c6]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:54:30 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:54:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JeADnxpV {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:54:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JeADnxpV" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:54:30 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2e9cca2-5aa8-4966-82fe-2742c7a4cb82]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:54:30 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JeADnxpV'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:54:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:54:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:54:30 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[305fe3d8-08e3-46ac-82d7-de8af6c1af29]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:54:30 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:54:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:54:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:54:30 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a01d2e6d-5360-4f13-b6dd-d4c7fd22b361]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:54:30 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:54:30 user nova-compute[74337]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 (non-flash)
Oct 23 21:54:30 user nova-compute[74337]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 (non-flash)
Oct 23 21:54:30 user nova-compute[74337]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 (non-flash)
Oct 23 21:54:30 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:54:30 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:54:30 user nova-compute[74337]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 (non-flash)
Oct 23 21:54:30 user nova-compute[74337]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 (non-flash)
Oct 23 21:54:30 user nova-compute[74337]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 (non-flash)
Oct 23 21:54:30 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:54:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607 -p 172.16.0.220:3260 --login {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:54:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:54:30 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d56bd80-9c61-46f6-a2a0-a62e541b702b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:54:30 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607, portal: 172.16.0.220,3260]
Oct 23 21:54:30 user nova-compute[74337]: Login to [iface: default, target: iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607, portal: 172.16.0.220,3260] successful.
Oct 23 21:54:30 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:54:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:54:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:54:30 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[312a8199-7a10-41ac-86a5-81e02c26fae9]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:54:30 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:54:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:54:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:54:30 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[94d48899-0d4d-4c4b-ba98-78c3288d39de]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:54:30 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:54:30 user nova-compute[74337]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 (non-flash)
Oct 23 21:54:30 user nova-compute[74337]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 (non-flash)
Oct 23 21:54:30 user nova-compute[74337]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 (non-flash)
Oct 23 21:54:30 user nova-compute[74337]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607 (non-flash)
Oct 23 21:54:30 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:54:30 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:54:30 user nova-compute[74337]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 (non-flash)
Oct 23 21:54:30 user nova-compute[74337]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 (non-flash)
Oct 23 21:54:30 user nova-compute[74337]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 (non-flash)
Oct 23 21:54:30 user nova-compute[74337]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607 (non-flash)
Oct 23 21:54:30 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:54:30 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:54:30 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] Connected to 172.16.0.220:3260 {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 21:54:30 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] HCTL ('37', '-', '-', 0) found on session 37 with lun 0 {{(pid=74337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 21:54:30 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 21:54:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:54:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:54:30 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[7574aaf8-5c8c-4b47-99aa-9d35a2775dab]: (4, ('- - 0', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:54:30 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] Searching for a device in session 37 and hctl ['37', '*', '*', 0] yield: None {{(pid=74337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 21:54:30 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:54:30 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74337) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 23 21:54:30 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-fdca6e08-b1e7-4bed-87a4-ea3e0a46c961 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Acquiring lock "e326a14c-61d7-4dca-b55f-db0f3ab0d14e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:54:30 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-fdca6e08-b1e7-4bed-87a4-ea3e0a46c961 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lock "e326a14c-61d7-4dca-b55f-db0f3ab0d14e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:54:30 user nova-compute[74337]: DEBUG nova.objects.instance [None req-fdca6e08-b1e7-4bed-87a4-ea3e0a46c961 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lazy-loading 'flavor' on Instance uuid e326a14c-61d7-4dca-b55f-db0f3ab0d14e {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:54:30 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-fdca6e08-b1e7-4bed-87a4-ea3e0a46c961 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lock "e326a14c-61d7-4dca-b55f-db0f3ab0d14e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:54:30 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-fdca6e08-b1e7-4bed-87a4-ea3e0a46c961 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Acquiring lock "e326a14c-61d7-4dca-b55f-db0f3ab0d14e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:54:30 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-fdca6e08-b1e7-4bed-87a4-ea3e0a46c961 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lock "e326a14c-61d7-4dca-b55f-db0f3ab0d14e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:54:30 user nova-compute[74337]: INFO nova.compute.manager [None req-fdca6e08-b1e7-4bed-87a4-ea3e0a46c961 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: e326a14c-61d7-4dca-b55f-db0f3ab0d14e] Attaching volume cbfd2bf8-a953-438a-a710-b4b32965d32b to /dev/vdb
Oct 23 21:54:30 user nova-compute[74337]: DEBUG os_brick.utils [None req-fdca6e08-b1e7-4bed-87a4-ea3e0a46c961 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:54:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:54:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:54:30 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc1ff82-07b1-4a76-88ae-c9c9c5e065c8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f34011b66e40\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:54:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:54:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:54:30 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c6c4b55-dd88-464b-ae35-bea25e541860]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:54:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:54:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:54:30 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce5ac62e-35a9-485b-bd5b-bf561615e5c9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:54:30 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c88eb01-a4b5-43b7-ae79-ef4a4aebd04d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:54:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-fdca6e08-b1e7-4bed-87a4-ea3e0a46c961 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Running cmd (subprocess): nvme version {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:54:31 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-fdca6e08-b1e7-4bed-87a4-ea3e0a46c961 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] 'nvme version' failed. Not Retrying. {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 21:54:31 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fdca6e08-b1e7-4bed-87a4-ea3e0a46c961 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] nvme not present on system {{(pid=74337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 21:54:31 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:54:31 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 21:54:31 user nova-compute[74337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 21:54:31 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e611d3c-e9df-4466-bf49-341524869ad8]: (4, '') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:54:31 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-fdca6e08-b1e7-4bed-87a4-ea3e0a46c961 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 21:54:31 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-fdca6e08-b1e7-4bed-87a4-ea3e0a46c961 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 21:54:31 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-fdca6e08-b1e7-4bed-87a4-ea3e0a46c961 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] LIGHTOS: no hostnqn found. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 21:54:31 user nova-compute[74337]: DEBUG os_brick.utils [None req-fdca6e08-b1e7-4bed-87a4-ea3e0a46c961 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f34011b66e40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:54:31 user nova-compute[74337]: DEBUG nova.virt.block_device [None req-fdca6e08-b1e7-4bed-87a4-ea3e0a46c961 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: e326a14c-61d7-4dca-b55f-db0f3ab0d14e] Updating existing volume attachment record: bd1895ee-f068-4398-ba5e-684c429a69cc {{(pid=74337) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 21:54:31 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] Searching for a device in session 37 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 21:54:31 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JeADnxpV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 21:54:31 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:54:31 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '23863363863393631', 'path': '/dev/sdf'} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:54:31 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23863363863393631', 'path': '/dev/sdf'} {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 21:54:31 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:54:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1176046172',display_name='tempest-TestShelveInstance-server-1176046172',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1176046172',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEx0NVJzKM8YzUUbTD2zwIk9bkp8l9p9es52EoZSF1Ew+o3XWxyu0IqZdLM7NOHFVUooxza7tfIdP3DI7McbogvDHZ4o97b/fTH6FHmK29fxkoO6KWxqFL/67IDNTiMxRA==',key_name='tempest-TestShelveInstance-1748914447',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='998e7763a94e4045bc097208ab368db9',ramdisk_id='',reservation_id='r-7ntxojce',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-224278230',owner_user_name='tempest-TestShelveInstance-224278230-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:54:12Z,user_data=None,user_id='d64b0bdc62064df8b3db31fb2a09cb07',uuid=0323b854-c7a1-42e8-ad85-1e929caa6e9d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "acb8f6c5-55fe-4a9d-82b3-70d9503356f2", "address": "fa:16:3e:ac:1d:a3", "network": {"id": "95dce4e0-8f8c-4034-a0ab-1c8ee0b1e631", "bridge": "br-int", "label": "tempest-TestShelveInstance-603341331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "998e7763a94e4045bc097208ab368db9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacb8f6c5-55", "ovs_interfaceid": "acb8f6c5-55fe-4a9d-82b3-70d9503356f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 21:54:31 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] Converting VIF {"id": "acb8f6c5-55fe-4a9d-82b3-70d9503356f2", "address": "fa:16:3e:ac:1d:a3", "network": {"id": "95dce4e0-8f8c-4034-a0ab-1c8ee0b1e631", "bridge": "br-int", "label": "tempest-TestShelveInstance-603341331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "998e7763a94e4045bc097208ab368db9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacb8f6c5-55", "ovs_interfaceid": "acb8f6c5-55fe-4a9d-82b3-70d9503356f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:54:31 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:1d:a3,bridge_name='br-int',has_traffic_filtering=True,id=acb8f6c5-55fe-4a9d-82b3-70d9503356f2,network=Network(95dce4e0-8f8c-4034-a0ab-1c8ee0b1e631),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacb8f6c5-55') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:54:31 user nova-compute[74337]: DEBUG nova.objects.instance [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] Lazy-loading 'pci_devices' on Instance uuid 0323b854-c7a1-42e8-ad85-1e929caa6e9d {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:54:31 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d] End _get_guest_xml xml=<domain type="kvm">
Oct 23 21:54:31 user nova-compute[74337]:   <uuid>0323b854-c7a1-42e8-ad85-1e929caa6e9d</uuid>
Oct 23 21:54:31 user nova-compute[74337]:   <name>instance-00000025</name>
Oct 23 21:54:31 user nova-compute[74337]:   <memory>524288</memory>
Oct 23 21:54:31 user nova-compute[74337]:   <vcpu>1</vcpu>
Oct 23 21:54:31 user nova-compute[74337]:   <metadata>
Oct 23 21:54:31 user nova-compute[74337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 21:54:31 user nova-compute[74337]:       <nova:package version="0.0.0"/>
Oct 23 21:54:31 user nova-compute[74337]:       <nova:name>tempest-TestShelveInstance-server-1176046172</nova:name>
Oct 23 21:54:31 user nova-compute[74337]:       <nova:creationTime>2023-10-23 21:54:29</nova:creationTime>
Oct 23 21:54:31 user nova-compute[74337]:       <nova:flavor name="m1.tiny">
Oct 23 21:54:31 user nova-compute[74337]:         <nova:memory>512</nova:memory>
Oct 23 21:54:31 user nova-compute[74337]:         <nova:disk>1</nova:disk>
Oct 23 21:54:31 user nova-compute[74337]:         <nova:swap>0</nova:swap>
Oct 23 21:54:31 user nova-compute[74337]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 21:54:31 user nova-compute[74337]:         <nova:vcpus>1</nova:vcpus>
Oct 23 21:54:31 user nova-compute[74337]:       </nova:flavor>
Oct 23 21:54:31 user nova-compute[74337]:       <nova:owner>
Oct 23 21:54:31 user nova-compute[74337]:         <nova:user uuid="d64b0bdc62064df8b3db31fb2a09cb07">tempest-TestShelveInstance-224278230-project-member</nova:user>
Oct 23 21:54:31 user nova-compute[74337]:         <nova:project uuid="998e7763a94e4045bc097208ab368db9">tempest-TestShelveInstance-224278230</nova:project>
Oct 23 21:54:31 user nova-compute[74337]:       </nova:owner>
Oct 23 21:54:31 user nova-compute[74337]:       <nova:ports>
Oct 23 21:54:31 user nova-compute[74337]:         <nova:port uuid="acb8f6c5-55fe-4a9d-82b3-70d9503356f2">
Oct 23 21:54:31 user nova-compute[74337]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 23 21:54:31 user nova-compute[74337]:         </nova:port>
Oct 23 21:54:31 user nova-compute[74337]:       </nova:ports>
Oct 23 21:54:31 user nova-compute[74337]:     </nova:instance>
Oct 23 21:54:31 user nova-compute[74337]:   </metadata>
Oct 23 21:54:31 user nova-compute[74337]:   <sysinfo type="smbios">
Oct 23 21:54:31 user nova-compute[74337]:     <system>
Oct 23 21:54:31 user nova-compute[74337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 21:54:31 user nova-compute[74337]:       <entry name="product">OpenStack Nova</entry>
Oct 23 21:54:31 user nova-compute[74337]:       <entry name="version">0.0.0</entry>
Oct 23 21:54:31 user nova-compute[74337]:       <entry name="serial">0323b854-c7a1-42e8-ad85-1e929caa6e9d</entry>
Oct 23 21:54:31 user nova-compute[74337]:       <entry name="uuid">0323b854-c7a1-42e8-ad85-1e929caa6e9d</entry>
Oct 23 21:54:31 user nova-compute[74337]:       <entry name="family">Virtual Machine</entry>
Oct 23 21:54:31 user nova-compute[74337]:     </system>
Oct 23 21:54:31 user nova-compute[74337]:   </sysinfo>
Oct 23 21:54:31 user nova-compute[74337]:   <os>
Oct 23 21:54:31 user nova-compute[74337]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 21:54:31 user nova-compute[74337]:     <boot dev="hd"/>
Oct 23 21:54:31 user nova-compute[74337]:     <smbios mode="sysinfo"/>
Oct 23 21:54:31 user nova-compute[74337]:   </os>
Oct 23 21:54:31 user nova-compute[74337]:   <features>
Oct 23 21:54:31 user nova-compute[74337]:     <acpi/>
Oct 23 21:54:31 user nova-compute[74337]:     <apic/>
Oct 23 21:54:31 user nova-compute[74337]:     <vmcoreinfo/>
Oct 23 21:54:31 user nova-compute[74337]:   </features>
Oct 23 21:54:31 user nova-compute[74337]:   <clock offset="utc">
Oct 23 21:54:31 user nova-compute[74337]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 21:54:31 user nova-compute[74337]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 21:54:31 user nova-compute[74337]:     <timer name="hpet" present="no"/>
Oct 23 21:54:31 user nova-compute[74337]:   </clock>
Oct 23 21:54:31 user nova-compute[74337]:   <cpu mode="custom" match="exact">
Oct 23 21:54:31 user nova-compute[74337]:     <model>Nehalem</model>
Oct 23 21:54:31 user nova-compute[74337]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 21:54:31 user nova-compute[74337]:   </cpu>
Oct 23 21:54:31 user nova-compute[74337]:   <devices>
Oct 23 21:54:31 user nova-compute[74337]:     <disk type="block" device="disk">
Oct 23 21:54:31 user nova-compute[74337]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 21:54:31 user nova-compute[74337]:       <source dev="/dev/sdf"/>
Oct 23 21:54:31 user nova-compute[74337]:       <target dev="vda" bus="virtio"/>
Oct 23 21:54:31 user nova-compute[74337]:       <serial>89f93205-ad98-45ff-8903-c2a7251da607</serial>
Oct 23 21:54:31 user nova-compute[74337]:     </disk>
Oct 23 21:54:31 user nova-compute[74337]:     <interface type="ethernet">
Oct 23 21:54:31 user nova-compute[74337]:       <mac address="fa:16:3e:ac:1d:a3"/>
Oct 23 21:54:31 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:54:31 user nova-compute[74337]:       <mtu size="1442"/>
Oct 23 21:54:31 user nova-compute[74337]:       <target dev="tapacb8f6c5-55"/>
Oct 23 21:54:31 user nova-compute[74337]:     </interface>
Oct 23 21:54:31 user nova-compute[74337]:     <serial type="pty">
Oct 23 21:54:31 user nova-compute[74337]:       <log file="/opt/stack/data/nova/instances/0323b854-c7a1-42e8-ad85-1e929caa6e9d/console.log" append="off"/>
Oct 23 21:54:31 user nova-compute[74337]:     </serial>
Oct 23 21:54:31 user nova-compute[74337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 21:54:31 user nova-compute[74337]:     <video>
Oct 23 21:54:31 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:54:31 user nova-compute[74337]:     </video>
Oct 23 21:54:31 user nova-compute[74337]:     <rng model="virtio">
Oct 23 21:54:31 user nova-compute[74337]:       <backend model="random">/dev/urandom</backend>
Oct 23 21:54:31 user nova-compute[74337]:     </rng>
Oct 23 21:54:31 user nova-compute[74337]:     <controller type="usb" index="0" model="none"/>
Oct 23 21:54:31 user nova-compute[74337]:     <memballoon model="virtio">
Oct 23 21:54:31 user nova-compute[74337]:       <stats period="10"/>
Oct 23 21:54:31 user nova-compute[74337]:     </memballoon>
Oct 23 21:54:31 user nova-compute[74337]:   </devices>
Oct 23 21:54:31 user nova-compute[74337]: </domain>
Oct 23 21:54:31 user nova-compute[74337]:  {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 21:54:31 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:54:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1176046172',display_name='tempest-TestShelveInstance-server-1176046172',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1176046172',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEx0NVJzKM8YzUUbTD2zwIk9bkp8l9p9es52EoZSF1Ew+o3XWxyu0IqZdLM7NOHFVUooxza7tfIdP3DI7McbogvDHZ4o97b/fTH6FHmK29fxkoO6KWxqFL/67IDNTiMxRA==',key_name='tempest-TestShelveInstance-1748914447',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='998e7763a94e4045bc097208ab368db9',ramdisk_id='',reservation_id='r-7ntxojce',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-224278230',owner_user_name='tempest-TestShelveInstance-224278230-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:54:12Z,user_data=None,user_id='d64b0bdc62064df8b3db31fb2a09cb07',uuid=0323b854-c7a1-42e8-ad85-1e929caa6e9d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "acb8f6c5-55fe-4a9d-82b3-70d9503356f2", "address": "fa:16:3e:ac:1d:a3", "network": {"id": "95dce4e0-8f8c-4034-a0ab-1c8ee0b1e631", "bridge": "br-int", "label": "tempest-TestShelveInstance-603341331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "998e7763a94e4045bc097208ab368db9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacb8f6c5-55", "ovs_interfaceid": "acb8f6c5-55fe-4a9d-82b3-70d9503356f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 21:54:31 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] Converting VIF {"id": "acb8f6c5-55fe-4a9d-82b3-70d9503356f2", "address": "fa:16:3e:ac:1d:a3", "network": {"id": "95dce4e0-8f8c-4034-a0ab-1c8ee0b1e631", "bridge": "br-int", "label": "tempest-TestShelveInstance-603341331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "998e7763a94e4045bc097208ab368db9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacb8f6c5-55", "ovs_interfaceid": "acb8f6c5-55fe-4a9d-82b3-70d9503356f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:54:31 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:1d:a3,bridge_name='br-int',has_traffic_filtering=True,id=acb8f6c5-55fe-4a9d-82b3-70d9503356f2,network=Network(95dce4e0-8f8c-4034-a0ab-1c8ee0b1e631),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacb8f6c5-55') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:54:31 user nova-compute[74337]: DEBUG os_vif [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:1d:a3,bridge_name='br-int',has_traffic_filtering=True,id=acb8f6c5-55fe-4a9d-82b3-70d9503356f2,network=Network(95dce4e0-8f8c-4034-a0ab-1c8ee0b1e631),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacb8f6c5-55') {{(pid=74337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 21:54:31 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:54:31 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:54:31 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 21:54:31 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:54:31 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9e7a45c4-2e87-5289-8585-0dce68d12d5a', '_type': 'linux-noop'}}, row=False) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:54:31 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:54:31 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:54:31 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapacb8f6c5-55, may_exist=True, interface_attrs={}) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:54:31 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapacb8f6c5-55, col_values=(('qos', UUID('795b2c7f-dde4-4e35-85cf-44c8d4a2fec7')),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:54:31 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapacb8f6c5-55, col_values=(('external_ids', {'iface-id': 'acb8f6c5-55fe-4a9d-82b3-70d9503356f2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ac:1d:a3', 'vm-uuid': '0323b854-c7a1-42e8-ad85-1e929caa6e9d'}),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:54:31 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:54:31 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:54:31 user nova-compute[74337]: INFO os_vif [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:1d:a3,bridge_name='br-int',has_traffic_filtering=True,id=acb8f6c5-55fe-4a9d-82b3-70d9503356f2,network=Network(95dce4e0-8f8c-4034-a0ab-1c8ee0b1e631),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacb8f6c5-55')
Oct 23 21:54:31 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] No BDM found with device name vda, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 21:54:31 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] No VIF found with MAC fa:16:3e:ac:1d:a3, not building metadata {{(pid=74337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 21:54:32 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:54:32 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:54:32 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:54:33 user nova-compute[74337]: DEBUG nova.compute.manager [req-d9fd08b5-0b5e-461a-9403-d6e120fcf689 req-3ec0fb7b-cbbd-4324-be27-8a28f39adf8d service nova] [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d] Received event network-vif-plugged-acb8f6c5-55fe-4a9d-82b3-70d9503356f2 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:54:33 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-d9fd08b5-0b5e-461a-9403-d6e120fcf689 req-3ec0fb7b-cbbd-4324-be27-8a28f39adf8d service nova] Acquiring lock "0323b854-c7a1-42e8-ad85-1e929caa6e9d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:54:33 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-d9fd08b5-0b5e-461a-9403-d6e120fcf689 req-3ec0fb7b-cbbd-4324-be27-8a28f39adf8d service nova] Lock "0323b854-c7a1-42e8-ad85-1e929caa6e9d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:54:33 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-d9fd08b5-0b5e-461a-9403-d6e120fcf689 req-3ec0fb7b-cbbd-4324-be27-8a28f39adf8d service nova] Lock "0323b854-c7a1-42e8-ad85-1e929caa6e9d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:54:33 user nova-compute[74337]: DEBUG nova.compute.manager [req-d9fd08b5-0b5e-461a-9403-d6e120fcf689 req-3ec0fb7b-cbbd-4324-be27-8a28f39adf8d service nova] [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d] No waiting events found dispatching network-vif-plugged-acb8f6c5-55fe-4a9d-82b3-70d9503356f2 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:54:33 user nova-compute[74337]: WARNING nova.compute.manager [req-d9fd08b5-0b5e-461a-9403-d6e120fcf689 req-3ec0fb7b-cbbd-4324-be27-8a28f39adf8d service nova] [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d] Received unexpected event network-vif-plugged-acb8f6c5-55fe-4a9d-82b3-70d9503356f2 for instance with vm_state building and task_state spawning.
Oct 23 21:54:33 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:54:33 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:54:33 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:54:33 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:54:35 user nova-compute[74337]: DEBUG nova.compute.manager [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d] Instance event wait completed in 0 seconds for  {{(pid=74337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 21:54:35 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d] Guest created on hypervisor {{(pid=74337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 21:54:35 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d] Instance spawned successfully.
Oct 23 21:54:35 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 21:54:35 user nova-compute[74337]: DEBUG nova.compute.manager [req-b5c652f0-433b-434a-a68a-36df5542399f req-40213557-e1d7-4a2f-94cb-a315f137d683 service nova] [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d] Received event network-vif-plugged-acb8f6c5-55fe-4a9d-82b3-70d9503356f2 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:54:35 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-b5c652f0-433b-434a-a68a-36df5542399f req-40213557-e1d7-4a2f-94cb-a315f137d683 service nova] Acquiring lock "0323b854-c7a1-42e8-ad85-1e929caa6e9d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:54:35 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-b5c652f0-433b-434a-a68a-36df5542399f req-40213557-e1d7-4a2f-94cb-a315f137d683 service nova] Lock "0323b854-c7a1-42e8-ad85-1e929caa6e9d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:54:35 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-b5c652f0-433b-434a-a68a-36df5542399f req-40213557-e1d7-4a2f-94cb-a315f137d683 service nova] Lock "0323b854-c7a1-42e8-ad85-1e929caa6e9d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:54:35 user nova-compute[74337]: DEBUG nova.compute.manager [req-b5c652f0-433b-434a-a68a-36df5542399f req-40213557-e1d7-4a2f-94cb-a315f137d683 service nova] [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d] No waiting events found dispatching network-vif-plugged-acb8f6c5-55fe-4a9d-82b3-70d9503356f2 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:54:35 user nova-compute[74337]: WARNING nova.compute.manager [req-b5c652f0-433b-434a-a68a-36df5542399f req-40213557-e1d7-4a2f-94cb-a315f137d683 service nova] [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d] Received unexpected event network-vif-plugged-acb8f6c5-55fe-4a9d-82b3-70d9503356f2 for instance with vm_state building and task_state spawning.
Oct 23 21:54:35 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d] Found default for hw_cdrom_bus of ide {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:54:35 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d] Found default for hw_disk_bus of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:54:35 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d] Found default for hw_input_bus of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:54:35 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d] Found default for hw_pointer_model of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:54:35 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d] Found default for hw_video_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:54:35 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d] Found default for hw_vif_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:54:35 user nova-compute[74337]: INFO nova.compute.manager [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d] Took 5.30 seconds to spawn the instance on the hypervisor.
Oct 23 21:54:35 user nova-compute[74337]: DEBUG nova.compute.manager [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d] Checking state {{(pid=74337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 21:54:35 user nova-compute[74337]: INFO nova.compute.manager [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d] Took 24.29 seconds to build instance.
Oct 23 21:54:35 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-8ac2371b-09c6-41c5-aa23-5ffdc6d2d359 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] Lock "0323b854-c7a1-42e8-ad85-1e929caa6e9d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.393s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:54:36 user nova-compute[74337]: DEBUG nova.compute.manager [req-8ce0b11c-64c0-4f75-b52c-551c415aa8d6 req-8bcf9beb-05e9-4aa2-a223-f2b8a6e9944b service nova] [instance: 86b0f8cc-bfec-42f2-b8cf-29f0603e3169] Received event network-changed-6a452d69-92a5-408b-a63e-c9a1d8501656 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:54:36 user nova-compute[74337]: DEBUG nova.compute.manager [req-8ce0b11c-64c0-4f75-b52c-551c415aa8d6 req-8bcf9beb-05e9-4aa2-a223-f2b8a6e9944b service nova] [instance: 86b0f8cc-bfec-42f2-b8cf-29f0603e3169] Refreshing instance network info cache due to event network-changed-6a452d69-92a5-408b-a63e-c9a1d8501656. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 21:54:36 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-8ce0b11c-64c0-4f75-b52c-551c415aa8d6 req-8bcf9beb-05e9-4aa2-a223-f2b8a6e9944b service nova] Acquiring lock "refresh_cache-86b0f8cc-bfec-42f2-b8cf-29f0603e3169" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:54:36 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-8ce0b11c-64c0-4f75-b52c-551c415aa8d6 req-8bcf9beb-05e9-4aa2-a223-f2b8a6e9944b service nova] Acquired lock "refresh_cache-86b0f8cc-bfec-42f2-b8cf-29f0603e3169" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:54:36 user nova-compute[74337]: DEBUG nova.network.neutron [req-8ce0b11c-64c0-4f75-b52c-551c415aa8d6 req-8bcf9beb-05e9-4aa2-a223-f2b8a6e9944b service nova] [instance: 86b0f8cc-bfec-42f2-b8cf-29f0603e3169] Refreshing network info cache for port 6a452d69-92a5-408b-a63e-c9a1d8501656 {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 21:54:36 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:54:36 user nova-compute[74337]: DEBUG nova.network.neutron [req-8ce0b11c-64c0-4f75-b52c-551c415aa8d6 req-8bcf9beb-05e9-4aa2-a223-f2b8a6e9944b service nova] [instance: 86b0f8cc-bfec-42f2-b8cf-29f0603e3169] Updated VIF entry in instance network info cache for port 6a452d69-92a5-408b-a63e-c9a1d8501656. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 21:54:36 user nova-compute[74337]: DEBUG nova.network.neutron [req-8ce0b11c-64c0-4f75-b52c-551c415aa8d6 req-8bcf9beb-05e9-4aa2-a223-f2b8a6e9944b service nova] [instance: 86b0f8cc-bfec-42f2-b8cf-29f0603e3169] Updating instance_info_cache with network_info: [{"id": "6a452d69-92a5-408b-a63e-c9a1d8501656", "address": "fa:16:3e:bf:09:19", "network": {"id": "787d9979-63ad-4318-b1d7-8ec69c5969fe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1847253864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84a25b3eed8548a5a324e55b28f26252", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a452d69-92", "ovs_interfaceid": "6a452d69-92a5-408b-a63e-c9a1d8501656", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:54:36 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-8ce0b11c-64c0-4f75-b52c-551c415aa8d6 req-8bcf9beb-05e9-4aa2-a223-f2b8a6e9944b service nova] Releasing lock "refresh_cache-86b0f8cc-bfec-42f2-b8cf-29f0603e3169" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:54:38 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:54:41 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:54:42 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-b8c12a58-dcf3-4e2e-983a-10c3d75eafbf tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Acquiring lock "86b0f8cc-bfec-42f2-b8cf-29f0603e3169" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:54:42 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-b8c12a58-dcf3-4e2e-983a-10c3d75eafbf tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lock "86b0f8cc-bfec-42f2-b8cf-29f0603e3169" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:54:42 user nova-compute[74337]: DEBUG nova.objects.instance [None req-b8c12a58-dcf3-4e2e-983a-10c3d75eafbf tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lazy-loading 'flavor' on Instance uuid 86b0f8cc-bfec-42f2-b8cf-29f0603e3169 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:54:42 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-b8c12a58-dcf3-4e2e-983a-10c3d75eafbf tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lock "86b0f8cc-bfec-42f2-b8cf-29f0603e3169" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:54:42 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-b8c12a58-dcf3-4e2e-983a-10c3d75eafbf tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Acquiring lock "86b0f8cc-bfec-42f2-b8cf-29f0603e3169" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:54:42 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-b8c12a58-dcf3-4e2e-983a-10c3d75eafbf tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lock "86b0f8cc-bfec-42f2-b8cf-29f0603e3169" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:54:42 user nova-compute[74337]: INFO nova.compute.manager [None req-b8c12a58-dcf3-4e2e-983a-10c3d75eafbf tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 86b0f8cc-bfec-42f2-b8cf-29f0603e3169] Attaching volume 49e8a83b-e1d0-45e0-994a-8a44bc36b8b6 to /dev/vdb
Oct 23 21:54:42 user nova-compute[74337]: DEBUG os_brick.utils [None req-b8c12a58-dcf3-4e2e-983a-10c3d75eafbf tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:54:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:54:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:54:42 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3905308-b052-4a0a-99cb-a8de55a4f1d4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f34011b66e40\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:54:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:54:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:54:42 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6596d6d7-1d5d-479b-9ba8-a5888402e6b6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:54:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:54:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:54:42 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[8919c325-3399-420a-83fa-50f2a99a8979]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:54:42 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d0a1eb-8056-43d2-95ec-115c5a3047b8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:54:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-b8c12a58-dcf3-4e2e-983a-10c3d75eafbf tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Running cmd (subprocess): nvme version {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:54:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-b8c12a58-dcf3-4e2e-983a-10c3d75eafbf tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] 'nvme version' failed. Not Retrying. {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 21:54:42 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b8c12a58-dcf3-4e2e-983a-10c3d75eafbf tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] nvme not present on system {{(pid=74337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 21:54:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:54:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 21:54:42 user nova-compute[74337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 21:54:42 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[999eea45-1e92-4f2c-9b13-77db88d5e7de]: (4, '') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:54:42 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-b8c12a58-dcf3-4e2e-983a-10c3d75eafbf tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 21:54:42 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-b8c12a58-dcf3-4e2e-983a-10c3d75eafbf tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 21:54:42 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-b8c12a58-dcf3-4e2e-983a-10c3d75eafbf tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] LIGHTOS: no hostnqn found. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 21:54:42 user nova-compute[74337]: DEBUG os_brick.utils [None req-b8c12a58-dcf3-4e2e-983a-10c3d75eafbf tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f34011b66e40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:54:42 user nova-compute[74337]: DEBUG nova.virt.block_device [None req-b8c12a58-dcf3-4e2e-983a-10c3d75eafbf tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 86b0f8cc-bfec-42f2-b8cf-29f0603e3169] Updating existing volume attachment record: e5627e80-78f5-4187-b1fe-a97eebc77321 {{(pid=74337) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 21:54:43 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:54:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:54:48 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:54:50 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fdca6e08-b1e7-4bed-87a4-ea3e0a46c961 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: e326a14c-61d7-4dca-b55f-db0f3ab0d14e] Calling os-brick to attach iSCSI Volume {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 21:54:50 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdca6e08-b1e7-4bed-87a4-ea3e0a46c961 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cbfd2bf8-a953-438a-a710-b4b32965d32b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QeXJoZzB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:54:50 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-fdca6e08-b1e7-4bed-87a4-ea3e0a46c961 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:54:50 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-fdca6e08-b1e7-4bed-87a4-ea3e0a46c961 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:54:50 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-fdca6e08-b1e7-4bed-87a4-ea3e0a46c961 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:54:50 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-fdca6e08-b1e7-4bed-87a4-ea3e0a46c961 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:54:50 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-fdca6e08-b1e7-4bed-87a4-ea3e0a46c961 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cbfd2bf8-a953-438a-a710-b4b32965d32b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:54:50 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-fdca6e08-b1e7-4bed-87a4-ea3e0a46c961 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cbfd2bf8-a953-438a-a710-b4b32965d32b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:54:50 user nova-compute[74337]: INFO os_brick.initiator.connectors.iscsi [None req-fdca6e08-b1e7-4bed-87a4-ea3e0a46c961 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 21:54:50 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbfd2bf8-a953-438a-a710-b4b32965d32b -p 172.16.0.220:3260 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:54:50 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbfd2bf8-a953-438a-a710-b4b32965d32b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:54:50 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[281ba4f5-30ba-4faa-96ee-88ffee59ef2c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:54:50 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdca6e08-b1e7-4bed-87a4-ea3e0a46c961 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 21:54:50 user nova-compute[74337]:  {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:54:50 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbfd2bf8-a953-438a-a710-b4b32965d32b -p 172.16.0.220:3260 --interface default --op new {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:54:50 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbfd2bf8-a953-438a-a710-b4b32965d32b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:54:50 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c89116af-113b-4c95-ac39-fedbf1966900]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cbfd2bf8-a953-438a-a710-b4b32965d32b] added\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:54:50 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdca6e08-b1e7-4bed-87a4-ea3e0a46c961 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cbfd2bf8-a953-438a-a710-b4b32965d32b] added
Oct 23 21:54:50 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:54:50 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbfd2bf8-a953-438a-a710-b4b32965d32b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:54:50 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbfd2bf8-a953-438a-a710-b4b32965d32b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:54:50 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[9668891a-d7cf-4719-8bbb-4ca956577a62]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:54:50 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdca6e08-b1e7-4bed-87a4-ea3e0a46c961 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:54:50 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbfd2bf8-a953-438a-a710-b4b32965d32b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:54:50 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbfd2bf8-a953-438a-a710-b4b32965d32b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:54:50 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b8c4158-0374-49e1-8e3c-e2c383a6c73b]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:54:50 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdca6e08-b1e7-4bed-87a4-ea3e0a46c961 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:54:50 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbfd2bf8-a953-438a-a710-b4b32965d32b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QeXJoZzB {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:54:50 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbfd2bf8-a953-438a-a710-b4b32965d32b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QeXJoZzB" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:54:50 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a47c615-545c-486e-9055-9a22b06ce121]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:54:50 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdca6e08-b1e7-4bed-87a4-ea3e0a46c961 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QeXJoZzB'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:54:50 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbfd2bf8-a953-438a-a710-b4b32965d32b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:54:50 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbfd2bf8-a953-438a-a710-b4b32965d32b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:54:50 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d36056a6-e286-4185-a59f-fe6bc04775bd]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:54:50 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdca6e08-b1e7-4bed-87a4-ea3e0a46c961 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:54:50 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:54:50 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:54:50 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd44f79e-b151-46f8-920e-1023e6a73cc4]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:54:50 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdca6e08-b1e7-4bed-87a4-ea3e0a46c961 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:54:50 user nova-compute[74337]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 (non-flash)
Oct 23 21:54:50 user nova-compute[74337]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 (non-flash)
Oct 23 21:54:50 user nova-compute[74337]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 (non-flash)
Oct 23 21:54:50 user nova-compute[74337]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607 (non-flash)
Oct 23 21:54:50 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:54:50 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdca6e08-b1e7-4bed-87a4-ea3e0a46c961 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:54:50 user nova-compute[74337]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 (non-flash)
Oct 23 21:54:50 user nova-compute[74337]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 (non-flash)
Oct 23 21:54:50 user nova-compute[74337]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 (non-flash)
Oct 23 21:54:50 user nova-compute[74337]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607 (non-flash)
Oct 23 21:54:50 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:54:50 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbfd2bf8-a953-438a-a710-b4b32965d32b -p 172.16.0.220:3260 --login {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:54:50 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbfd2bf8-a953-438a-a710-b4b32965d32b -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:54:50 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[34a86fe7-77dc-404b-a99d-30176955326d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cbfd2bf8-a953-438a-a710-b4b32965d32b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cbfd2bf8-a953-438a-a710-b4b32965d32b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:54:50 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdca6e08-b1e7-4bed-87a4-ea3e0a46c961 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cbfd2bf8-a953-438a-a710-b4b32965d32b, portal: 172.16.0.220,3260]
Oct 23 21:54:50 user nova-compute[74337]: Login to [iface: default, target: iqn.2010-10.org.openstack:cbfd2bf8-a953-438a-a710-b4b32965d32b, portal: 172.16.0.220,3260] successful.
Oct 23 21:54:50 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:54:50 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbfd2bf8-a953-438a-a710-b4b32965d32b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:54:50 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbfd2bf8-a953-438a-a710-b4b32965d32b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:54:50 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b45e5e-3922-44c5-a571-6e6b88a84c36]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:54:50 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdca6e08-b1e7-4bed-87a4-ea3e0a46c961 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:54:50 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:54:50 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:54:50 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef0e194d-844b-4330-a9a6-d2353fdbf566]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbfd2bf8-a953-438a-a710-b4b32965d32b (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:54:50 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdca6e08-b1e7-4bed-87a4-ea3e0a46c961 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:54:50 user nova-compute[74337]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 (non-flash)
Oct 23 21:54:50 user nova-compute[74337]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 (non-flash)
Oct 23 21:54:50 user nova-compute[74337]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 (non-flash)
Oct 23 21:54:50 user nova-compute[74337]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607 (non-flash)
Oct 23 21:54:50 user nova-compute[74337]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbfd2bf8-a953-438a-a710-b4b32965d32b (non-flash)
Oct 23 21:54:50 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:54:50 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdca6e08-b1e7-4bed-87a4-ea3e0a46c961 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:54:50 user nova-compute[74337]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 (non-flash)
Oct 23 21:54:50 user nova-compute[74337]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 (non-flash)
Oct 23 21:54:50 user nova-compute[74337]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 (non-flash)
Oct 23 21:54:50 user nova-compute[74337]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607 (non-flash)
Oct 23 21:54:50 user nova-compute[74337]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbfd2bf8-a953-438a-a710-b4b32965d32b (non-flash)
Oct 23 21:54:50 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:54:50 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-fdca6e08-b1e7-4bed-87a4-ea3e0a46c961 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cbfd2bf8-a953-438a-a710-b4b32965d32b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:54:50 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdca6e08-b1e7-4bed-87a4-ea3e0a46c961 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Connected to 172.16.0.220:3260 {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 21:54:50 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-fdca6e08-b1e7-4bed-87a4-ea3e0a46c961 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] HCTL ('38', '-', '-', 0) found on session 38 with lun 0 {{(pid=74337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 21:54:50 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-fdca6e08-b1e7-4bed-87a4-ea3e0a46c961 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 21:54:50 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:54:50 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:54:50 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b87f7649-8230-43a5-ac85-437d673fc9f1]: (4, ('- - 0', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:54:50 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-fdca6e08-b1e7-4bed-87a4-ea3e0a46c961 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Searching for a device in session 38 and hctl ['38', '*', '*', 0] yield: None {{(pid=74337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 21:54:51 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:54:51 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-fdca6e08-b1e7-4bed-87a4-ea3e0a46c961 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Searching for a device in session 38 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 21:54:51 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdca6e08-b1e7-4bed-87a4-ea3e0a46c961 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:cbfd2bf8-a953-438a-a710-b4b32965d32b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QeXJoZzB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 21:54:51 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-fdca6e08-b1e7-4bed-87a4-ea3e0a46c961 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.345s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:54:51 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdca6e08-b1e7-4bed-87a4-ea3e0a46c961 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] <== connect_volume: return (1348ms) {'type': 'block', 'scsi_wwn': '26437643438326266', 'path': '/dev/sdg'} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:54:51 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fdca6e08-b1e7-4bed-87a4-ea3e0a46c961 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: e326a14c-61d7-4dca-b55f-db0f3ab0d14e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26437643438326266', 'path': '/dev/sdg'} {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 21:54:51 user nova-compute[74337]: DEBUG nova.objects.instance [None req-fdca6e08-b1e7-4bed-87a4-ea3e0a46c961 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lazy-loading 'flavor' on Instance uuid e326a14c-61d7-4dca-b55f-db0f3ab0d14e {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:54:51 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-fdca6e08-b1e7-4bed-87a4-ea3e0a46c961 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 21:54:51 user nova-compute[74337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 21:54:51 user nova-compute[74337]:   <source dev="/dev/sdg"/>
Oct 23 21:54:51 user nova-compute[74337]:   <target dev="vdb" bus="virtio"/>
Oct 23 21:54:51 user nova-compute[74337]:   <serial>cbfd2bf8-a953-438a-a710-b4b32965d32b</serial>
Oct 23 21:54:51 user nova-compute[74337]: </disk>
Oct 23 21:54:51 user nova-compute[74337]:  {{(pid=74337) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 21:54:52 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-fdca6e08-b1e7-4bed-87a4-ea3e0a46c961 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] No BDM found with device name vda, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 21:54:52 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-fdca6e08-b1e7-4bed-87a4-ea3e0a46c961 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 21:54:52 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-fdca6e08-b1e7-4bed-87a4-ea3e0a46c961 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] No VIF found with MAC fa:16:3e:99:b7:b3, not building metadata {{(pid=74337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 21:54:52 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-fdca6e08-b1e7-4bed-87a4-ea3e0a46c961 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lock "e326a14c-61d7-4dca-b55f-db0f3ab0d14e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.468s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:54:53 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:54:56 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:54:58 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-05206f35-b101-426b-8bb0-9d8bbaf557f1 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Acquiring lock "e326a14c-61d7-4dca-b55f-db0f3ab0d14e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:54:58 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-05206f35-b101-426b-8bb0-9d8bbaf557f1 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lock "e326a14c-61d7-4dca-b55f-db0f3ab0d14e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:54:58 user nova-compute[74337]: DEBUG nova.objects.instance [None req-05206f35-b101-426b-8bb0-9d8bbaf557f1 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lazy-loading 'flavor' on Instance uuid e326a14c-61d7-4dca-b55f-db0f3ab0d14e {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:54:58 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-05206f35-b101-426b-8bb0-9d8bbaf557f1 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lock "e326a14c-61d7-4dca-b55f-db0f3ab0d14e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:54:58 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-05206f35-b101-426b-8bb0-9d8bbaf557f1 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Acquiring lock "e326a14c-61d7-4dca-b55f-db0f3ab0d14e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:54:58 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-05206f35-b101-426b-8bb0-9d8bbaf557f1 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lock "e326a14c-61d7-4dca-b55f-db0f3ab0d14e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:54:58 user nova-compute[74337]: INFO nova.compute.manager [None req-05206f35-b101-426b-8bb0-9d8bbaf557f1 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: e326a14c-61d7-4dca-b55f-db0f3ab0d14e] Attaching volume a8c65f7e-9e2c-4a26-bab4-70c7d1e6c118 to /dev/vdc
Oct 23 21:54:58 user nova-compute[74337]: DEBUG os_brick.utils [None req-05206f35-b101-426b-8bb0-9d8bbaf557f1 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:54:58 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:54:58 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:54:58 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[7553d062-0c9e-40ea-b31f-a9a9006550af]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f34011b66e40\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:54:58 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:54:58 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:54:58 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[79b4f3df-a088-463b-a0d7-3149198f5888]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:54:58 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:54:58 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:54:58 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c826c4d3-3e6d-429b-bf12-724ec78dd3c7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:54:58 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ff6c59-58bc-4d85-a96d-1057f242abed]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:54:58 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-05206f35-b101-426b-8bb0-9d8bbaf557f1 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Running cmd (subprocess): nvme version {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:54:58 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-05206f35-b101-426b-8bb0-9d8bbaf557f1 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] 'nvme version' failed. Not Retrying. {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 21:54:58 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-05206f35-b101-426b-8bb0-9d8bbaf557f1 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] nvme not present on system {{(pid=74337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 21:54:58 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:54:58 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:54:58 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 21:54:58 user nova-compute[74337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 21:54:58 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e58d81c-36da-497b-9402-bc9d11be94ad]: (4, '') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:54:58 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-05206f35-b101-426b-8bb0-9d8bbaf557f1 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 21:54:58 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-05206f35-b101-426b-8bb0-9d8bbaf557f1 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 21:54:58 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-05206f35-b101-426b-8bb0-9d8bbaf557f1 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] LIGHTOS: no hostnqn found. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 21:54:58 user nova-compute[74337]: DEBUG os_brick.utils [None req-05206f35-b101-426b-8bb0-9d8bbaf557f1 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f34011b66e40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:54:58 user nova-compute[74337]: DEBUG nova.virt.block_device [None req-05206f35-b101-426b-8bb0-9d8bbaf557f1 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: e326a14c-61d7-4dca-b55f-db0f3ab0d14e] Updating existing volume attachment record: 9a8be995-ef45-4bc9-a9e3-2aae3742ca92 {{(pid=74337) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 21:55:01 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:55:01 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8c12a58-dcf3-4e2e-983a-10c3d75eafbf tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 86b0f8cc-bfec-42f2-b8cf-29f0603e3169] Calling os-brick to attach iSCSI Volume {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 21:55:01 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c12a58-dcf3-4e2e-983a-10c3d75eafbf tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:49e8a83b-e1d0-45e0-994a-8a44bc36b8b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UTIszgNV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:55:01 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-b8c12a58-dcf3-4e2e-983a-10c3d75eafbf tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:55:01 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-b8c12a58-dcf3-4e2e-983a-10c3d75eafbf tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:55:01 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-b8c12a58-dcf3-4e2e-983a-10c3d75eafbf tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:55:01 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-b8c12a58-dcf3-4e2e-983a-10c3d75eafbf tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:55:01 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-b8c12a58-dcf3-4e2e-983a-10c3d75eafbf tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49e8a83b-e1d0-45e0-994a-8a44bc36b8b6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:55:01 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-b8c12a58-dcf3-4e2e-983a-10c3d75eafbf tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49e8a83b-e1d0-45e0-994a-8a44bc36b8b6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:55:01 user nova-compute[74337]: INFO os_brick.initiator.connectors.iscsi [None req-b8c12a58-dcf3-4e2e-983a-10c3d75eafbf tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 21:55:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49e8a83b-e1d0-45e0-994a-8a44bc36b8b6 -p 172.16.0.220:3260 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49e8a83b-e1d0-45e0-994a-8a44bc36b8b6 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:55:01 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[29a7c8df-eed9-4ec8-b0be-5aff60b776da]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:55:01 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c12a58-dcf3-4e2e-983a-10c3d75eafbf tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 21:55:01 user nova-compute[74337]:  {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:55:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49e8a83b-e1d0-45e0-994a-8a44bc36b8b6 -p 172.16.0.220:3260 --interface default --op new {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49e8a83b-e1d0-45e0-994a-8a44bc36b8b6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:55:01 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[f400360d-e089-4702-9e4c-10430eb51347]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:49e8a83b-e1d0-45e0-994a-8a44bc36b8b6] added\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:55:01 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c12a58-dcf3-4e2e-983a-10c3d75eafbf tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:49e8a83b-e1d0-45e0-994a-8a44bc36b8b6] added
Oct 23 21:55:01 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:55:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49e8a83b-e1d0-45e0-994a-8a44bc36b8b6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49e8a83b-e1d0-45e0-994a-8a44bc36b8b6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:55:01 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5bc7637-dc90-4fc4-9809-918ba9faf3b6]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:55:01 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c12a58-dcf3-4e2e-983a-10c3d75eafbf tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:55:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49e8a83b-e1d0-45e0-994a-8a44bc36b8b6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49e8a83b-e1d0-45e0-994a-8a44bc36b8b6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:55:01 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba68952-f562-4a02-b0cc-72d2c4004da7]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:55:01 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c12a58-dcf3-4e2e-983a-10c3d75eafbf tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:55:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49e8a83b-e1d0-45e0-994a-8a44bc36b8b6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UTIszgNV {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49e8a83b-e1d0-45e0-994a-8a44bc36b8b6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UTIszgNV" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:55:01 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[0893882b-c590-49f3-8653-f0418183585c]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:55:01 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c12a58-dcf3-4e2e-983a-10c3d75eafbf tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UTIszgNV'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:55:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49e8a83b-e1d0-45e0-994a-8a44bc36b8b6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49e8a83b-e1d0-45e0-994a-8a44bc36b8b6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:55:01 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce0048c-5752-4f56-b2b9-d9aa1eec5293]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:55:01 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c12a58-dcf3-4e2e-983a-10c3d75eafbf tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:55:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:55:01 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c84c591f-1e3c-4069-a317-a93eadf6ed1b]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbfd2bf8-a953-438a-a710-b4b32965d32b (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:55:01 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c12a58-dcf3-4e2e-983a-10c3d75eafbf tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:55:01 user nova-compute[74337]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 (non-flash)
Oct 23 21:55:01 user nova-compute[74337]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 (non-flash)
Oct 23 21:55:01 user nova-compute[74337]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 (non-flash)
Oct 23 21:55:01 user nova-compute[74337]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607 (non-flash)
Oct 23 21:55:01 user nova-compute[74337]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbfd2bf8-a953-438a-a710-b4b32965d32b (non-flash)
Oct 23 21:55:01 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:55:01 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c12a58-dcf3-4e2e-983a-10c3d75eafbf tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:55:01 user nova-compute[74337]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 (non-flash)
Oct 23 21:55:01 user nova-compute[74337]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 (non-flash)
Oct 23 21:55:01 user nova-compute[74337]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 (non-flash)
Oct 23 21:55:01 user nova-compute[74337]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607 (non-flash)
Oct 23 21:55:01 user nova-compute[74337]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbfd2bf8-a953-438a-a710-b4b32965d32b (non-flash)
Oct 23 21:55:01 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:55:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49e8a83b-e1d0-45e0-994a-8a44bc36b8b6 -p 172.16.0.220:3260 --login {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:02 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49e8a83b-e1d0-45e0-994a-8a44bc36b8b6 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:55:02 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[4429a988-9daf-4795-b00b-a938c42cb85e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:49e8a83b-e1d0-45e0-994a-8a44bc36b8b6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:49e8a83b-e1d0-45e0-994a-8a44bc36b8b6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:55:02 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c12a58-dcf3-4e2e-983a-10c3d75eafbf tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:49e8a83b-e1d0-45e0-994a-8a44bc36b8b6, portal: 172.16.0.220,3260]
Oct 23 21:55:02 user nova-compute[74337]: Login to [iface: default, target: iqn.2010-10.org.openstack:49e8a83b-e1d0-45e0-994a-8a44bc36b8b6, portal: 172.16.0.220,3260] successful.
Oct 23 21:55:02 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:55:02 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49e8a83b-e1d0-45e0-994a-8a44bc36b8b6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:02 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49e8a83b-e1d0-45e0-994a-8a44bc36b8b6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:55:02 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e36cdab-4781-4474-a13f-cfe88b6596c6]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:55:02 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c12a58-dcf3-4e2e-983a-10c3d75eafbf tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:55:02 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:02 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:55:02 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[f060a560-7700-4395-b0da-2c3e79a4f518]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbfd2bf8-a953-438a-a710-b4b32965d32b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49e8a83b-e1d0-45e0-994a-8a44bc36b8b6 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:55:02 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c12a58-dcf3-4e2e-983a-10c3d75eafbf tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:55:02 user nova-compute[74337]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 (non-flash)
Oct 23 21:55:02 user nova-compute[74337]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 (non-flash)
Oct 23 21:55:02 user nova-compute[74337]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 (non-flash)
Oct 23 21:55:02 user nova-compute[74337]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607 (non-flash)
Oct 23 21:55:02 user nova-compute[74337]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbfd2bf8-a953-438a-a710-b4b32965d32b (non-flash)
Oct 23 21:55:02 user nova-compute[74337]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49e8a83b-e1d0-45e0-994a-8a44bc36b8b6 (non-flash)
Oct 23 21:55:02 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:55:02 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c12a58-dcf3-4e2e-983a-10c3d75eafbf tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:55:02 user nova-compute[74337]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 (non-flash)
Oct 23 21:55:02 user nova-compute[74337]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 (non-flash)
Oct 23 21:55:02 user nova-compute[74337]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 (non-flash)
Oct 23 21:55:02 user nova-compute[74337]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607 (non-flash)
Oct 23 21:55:02 user nova-compute[74337]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbfd2bf8-a953-438a-a710-b4b32965d32b (non-flash)
Oct 23 21:55:02 user nova-compute[74337]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49e8a83b-e1d0-45e0-994a-8a44bc36b8b6 (non-flash)
Oct 23 21:55:02 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:55:02 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-b8c12a58-dcf3-4e2e-983a-10c3d75eafbf tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49e8a83b-e1d0-45e0-994a-8a44bc36b8b6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.321s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:55:02 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c12a58-dcf3-4e2e-983a-10c3d75eafbf tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Connected to 172.16.0.220:3260 {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 21:55:02 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-b8c12a58-dcf3-4e2e-983a-10c3d75eafbf tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] HCTL ('39', '-', '-', 0) found on session 39 with lun 0 {{(pid=74337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 21:55:02 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-b8c12a58-dcf3-4e2e-983a-10c3d75eafbf tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=74337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 21:55:02 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:02 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:55:02 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c0a5a98-2a65-461b-b048-84cc599d6d87]: (4, ('- - 0', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:55:02 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-b8c12a58-dcf3-4e2e-983a-10c3d75eafbf tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Searching for a device in session 39 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 21:55:02 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c12a58-dcf3-4e2e-983a-10c3d75eafbf tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:49e8a83b-e1d0-45e0-994a-8a44bc36b8b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UTIszgNV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 21:55:03 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-b8c12a58-dcf3-4e2e-983a-10c3d75eafbf tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.360s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:55:03 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c12a58-dcf3-4e2e-983a-10c3d75eafbf tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] <== connect_volume: return (1362ms) {'type': 'block', 'scsi_wwn': '26165346365393466', 'path': '/dev/sdh'} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:55:03 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8c12a58-dcf3-4e2e-983a-10c3d75eafbf tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 86b0f8cc-bfec-42f2-b8cf-29f0603e3169] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26165346365393466', 'path': '/dev/sdh'} {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 21:55:03 user nova-compute[74337]: DEBUG nova.objects.instance [None req-b8c12a58-dcf3-4e2e-983a-10c3d75eafbf tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lazy-loading 'flavor' on Instance uuid 86b0f8cc-bfec-42f2-b8cf-29f0603e3169 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:55:03 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-b8c12a58-dcf3-4e2e-983a-10c3d75eafbf tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 21:55:03 user nova-compute[74337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 21:55:03 user nova-compute[74337]:   <source dev="/dev/sdh"/>
Oct 23 21:55:03 user nova-compute[74337]:   <target dev="vdb" bus="virtio"/>
Oct 23 21:55:03 user nova-compute[74337]:   <serial>49e8a83b-e1d0-45e0-994a-8a44bc36b8b6</serial>
Oct 23 21:55:03 user nova-compute[74337]: </disk>
Oct 23 21:55:03 user nova-compute[74337]:  {{(pid=74337) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 21:55:03 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-b8c12a58-dcf3-4e2e-983a-10c3d75eafbf tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] No BDM found with device name vda, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 21:55:03 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-b8c12a58-dcf3-4e2e-983a-10c3d75eafbf tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 21:55:03 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-b8c12a58-dcf3-4e2e-983a-10c3d75eafbf tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] No VIF found with MAC fa:16:3e:bf:09:19, not building metadata {{(pid=74337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 21:55:03 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-b8c12a58-dcf3-4e2e-983a-10c3d75eafbf tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lock "86b0f8cc-bfec-42f2-b8cf-29f0603e3169" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.068s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:55:03 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:55:04 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-f56f7fb7-e12e-4b5f-82b4-c15efa4c48b0 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Acquiring lock "86b0f8cc-bfec-42f2-b8cf-29f0603e3169" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:55:04 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-f56f7fb7-e12e-4b5f-82b4-c15efa4c48b0 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lock "86b0f8cc-bfec-42f2-b8cf-29f0603e3169" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:55:04 user nova-compute[74337]: INFO nova.compute.manager [None req-f56f7fb7-e12e-4b5f-82b4-c15efa4c48b0 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 86b0f8cc-bfec-42f2-b8cf-29f0603e3169] Detaching volume 49e8a83b-e1d0-45e0-994a-8a44bc36b8b6
Oct 23 21:55:04 user nova-compute[74337]: INFO nova.virt.block_device [None req-f56f7fb7-e12e-4b5f-82b4-c15efa4c48b0 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 86b0f8cc-bfec-42f2-b8cf-29f0603e3169] Attempting to driver detach volume 49e8a83b-e1d0-45e0-994a-8a44bc36b8b6 from mountpoint /dev/vdb
Oct 23 21:55:04 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-f56f7fb7-e12e-4b5f-82b4-c15efa4c48b0 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Attempting to detach device vdb from instance 86b0f8cc-bfec-42f2-b8cf-29f0603e3169 from the persistent domain config. {{(pid=74337) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 21:55:04 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-f56f7fb7-e12e-4b5f-82b4-c15efa4c48b0 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 21:55:04 user nova-compute[74337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 21:55:04 user nova-compute[74337]:   <source dev="/dev/sdh"/>
Oct 23 21:55:04 user nova-compute[74337]:   <target dev="vdb" bus="virtio"/>
Oct 23 21:55:04 user nova-compute[74337]:   <serial>49e8a83b-e1d0-45e0-994a-8a44bc36b8b6</serial>
Oct 23 21:55:04 user nova-compute[74337]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 21:55:04 user nova-compute[74337]: </disk>
Oct 23 21:55:04 user nova-compute[74337]:  {{(pid=74337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 21:55:04 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-f56f7fb7-e12e-4b5f-82b4-c15efa4c48b0 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Successfully detached device vdb from instance 86b0f8cc-bfec-42f2-b8cf-29f0603e3169 from the persistent domain config.
Oct 23 21:55:04 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-f56f7fb7-e12e-4b5f-82b4-c15efa4c48b0 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 86b0f8cc-bfec-42f2-b8cf-29f0603e3169 from the live domain config. {{(pid=74337) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 21:55:04 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-f56f7fb7-e12e-4b5f-82b4-c15efa4c48b0 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 21:55:04 user nova-compute[74337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 21:55:04 user nova-compute[74337]:   <source dev="/dev/sdh"/>
Oct 23 21:55:04 user nova-compute[74337]:   <target dev="vdb" bus="virtio"/>
Oct 23 21:55:04 user nova-compute[74337]:   <serial>49e8a83b-e1d0-45e0-994a-8a44bc36b8b6</serial>
Oct 23 21:55:04 user nova-compute[74337]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 21:55:04 user nova-compute[74337]: </disk>
Oct 23 21:55:04 user nova-compute[74337]:  {{(pid=74337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 21:55:04 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-f56f7fb7-e12e-4b5f-82b4-c15efa4c48b0 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 86b0f8cc-bfec-42f2-b8cf-29f0603e3169 {{(pid=74337) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 21:55:05 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-d6a9292f-8383-4d19-8f32-a5a498c55cd0 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Acquiring lock "d5d9d286-4837-4168-a4fe-1bc09e372654" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:55:05 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-d6a9292f-8383-4d19-8f32-a5a498c55cd0 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Lock "d5d9d286-4837-4168-a4fe-1bc09e372654" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:55:05 user nova-compute[74337]: DEBUG nova.objects.instance [None req-d6a9292f-8383-4d19-8f32-a5a498c55cd0 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Lazy-loading 'flavor' on Instance uuid d5d9d286-4837-4168-a4fe-1bc09e372654 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:55:05 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-d6a9292f-8383-4d19-8f32-a5a498c55cd0 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Lock "d5d9d286-4837-4168-a4fe-1bc09e372654" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:55:05 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-d6a9292f-8383-4d19-8f32-a5a498c55cd0 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Acquiring lock "d5d9d286-4837-4168-a4fe-1bc09e372654" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:55:05 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-d6a9292f-8383-4d19-8f32-a5a498c55cd0 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Lock "d5d9d286-4837-4168-a4fe-1bc09e372654" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:55:05 user nova-compute[74337]: INFO nova.compute.manager [None req-d6a9292f-8383-4d19-8f32-a5a498c55cd0 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] Attaching volume f147349c-8434-4957-8f5f-ced11857d9b7 to /dev/vdb
Oct 23 21:55:05 user nova-compute[74337]: DEBUG os_brick.utils [None req-d6a9292f-8383-4d19-8f32-a5a498c55cd0 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:55:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:55:05 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fff8d70-d466-4920-b300-53fcdfbd0c7a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f34011b66e40\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:55:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:55:05 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[215a4163-833f-4b32-a7d2-46dd80d2eb70]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:55:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:55:05 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6bb09f0-9df3-4969-bda6-b5b5db1cd2f9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:55:05 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ffa780-c800-455d-8dae-0d0019626cb3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:55:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-d6a9292f-8383-4d19-8f32-a5a498c55cd0 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Running cmd (subprocess): nvme version {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-d6a9292f-8383-4d19-8f32-a5a498c55cd0 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] 'nvme version' failed. Not Retrying. {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 21:55:05 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d6a9292f-8383-4d19-8f32-a5a498c55cd0 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] nvme not present on system {{(pid=74337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 21:55:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 21:55:05 user nova-compute[74337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 21:55:05 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[346d2877-5294-47b6-9682-ff31997972df]: (4, '') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:55:05 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-d6a9292f-8383-4d19-8f32-a5a498c55cd0 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 21:55:05 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-d6a9292f-8383-4d19-8f32-a5a498c55cd0 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 21:55:05 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-d6a9292f-8383-4d19-8f32-a5a498c55cd0 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] LIGHTOS: no hostnqn found. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 21:55:05 user nova-compute[74337]: DEBUG os_brick.utils [None req-d6a9292f-8383-4d19-8f32-a5a498c55cd0 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f34011b66e40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:55:05 user nova-compute[74337]: DEBUG nova.virt.block_device [None req-d6a9292f-8383-4d19-8f32-a5a498c55cd0 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] Updating existing volume attachment record: d94e031e-6c58-4499-b70e-aeb226e0a989 {{(pid=74337) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 21:55:06 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:55:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:55:11 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:55:12 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:55:12 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:55:12 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Starting heal instance info cache {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 21:55:12 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "refresh_cache-1e05fd36-ee44-4992-80a9-f95af608b9f5" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:55:12 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquired lock "refresh_cache-1e05fd36-ee44-4992-80a9-f95af608b9f5" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:55:12 user nova-compute[74337]: DEBUG nova.network.neutron [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 1e05fd36-ee44-4992-80a9-f95af608b9f5] Forcefully refreshing network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 21:55:12 user nova-compute[74337]: DEBUG nova.network.neutron [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 1e05fd36-ee44-4992-80a9-f95af608b9f5] Updating instance_info_cache with network_info: [{"id": "be6c9897-b923-4a1e-813b-ba0b0196ac48", "address": "fa:16:3e:f0:53:16", "network": {"id": "5f62b1d8-d5d0-4ff9-922b-fc6e72fb640d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-655282105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b85c4f783a4ee7ab67422b49da85ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe6c9897-b9", "ovs_interfaceid": "be6c9897-b923-4a1e-813b-ba0b0196ac48", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:55:12 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Releasing lock "refresh_cache-1e05fd36-ee44-4992-80a9-f95af608b9f5" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:55:12 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 1e05fd36-ee44-4992-80a9-f95af608b9f5] Updated the network info_cache for instance {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 21:55:12 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:55:12 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:55:12 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 21:55:13 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:55:14 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:55:16 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-38000959-ec1c-4ca1-931d-777611a12fc2 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Acquiring lock "86f56afb-77e6-4378-b441-5cf507a0fbe7" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:55:16 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-38000959-ec1c-4ca1-931d-777611a12fc2 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lock "86f56afb-77e6-4378-b441-5cf507a0fbe7" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:55:16 user nova-compute[74337]: DEBUG nova.compute.manager [None req-38000959-ec1c-4ca1-931d-777611a12fc2 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Going to confirm migration 2 {{(pid=74337) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4773}}
Oct 23 21:55:16 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:55:16 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:55:16 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 21:55:16 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 21:55:16 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 21:55:16 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:55:16 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-38000959-ec1c-4ca1-931d-777611a12fc2 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Acquiring lock "refresh_cache-86f56afb-77e6-4378-b441-5cf507a0fbe7" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:55:16 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-38000959-ec1c-4ca1-931d-777611a12fc2 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Acquired lock "refresh_cache-86f56afb-77e6-4378-b441-5cf507a0fbe7" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:55:16 user nova-compute[74337]: DEBUG nova.network.neutron [None req-38000959-ec1c-4ca1-931d-777611a12fc2 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Building network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 21:55:16 user nova-compute[74337]: DEBUG nova.objects.instance [None req-38000959-ec1c-4ca1-931d-777611a12fc2 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lazy-loading 'info_cache' on Instance uuid 86f56afb-77e6-4378-b441-5cf507a0fbe7 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:55:16 user nova-compute[74337]: DEBUG nova.network.neutron [None req-38000959-ec1c-4ca1-931d-777611a12fc2 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Updating instance_info_cache with network_info: [{"id": "148d28e8-2783-44a9-a08e-c648f0aa9489", "address": "fa:16:3e:47:98:97", "network": {"id": "aff1f95f-fda8-4f0f-8d10-7e3d587e4fda", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2048135647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1f57e58a9ec4c6384dc0d3ca58eb610", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap148d28e8-27", "ovs_interfaceid": "148d28e8-2783-44a9-a08e-c648f0aa9489", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:55:16 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-38000959-ec1c-4ca1-931d-777611a12fc2 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Releasing lock "refresh_cache-86f56afb-77e6-4378-b441-5cf507a0fbe7" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:55:16 user nova-compute[74337]: DEBUG nova.objects.instance [None req-38000959-ec1c-4ca1-931d-777611a12fc2 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lazy-loading 'migration_context' on Instance uuid 86f56afb-77e6-4378-b441-5cf507a0fbe7 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:55:16 user nova-compute[74337]: DEBUG nova.objects.base [None req-38000959-ec1c-4ca1-931d-777611a12fc2 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Object Instance<86f56afb-77e6-4378-b441-5cf507a0fbe7> lazy-loaded attributes: info_cache,migration_context {{(pid=74337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 21:55:16 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-38000959-ec1c-4ca1-931d-777611a12fc2 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:55:16 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-38000959-ec1c-4ca1-931d-777611a12fc2 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:55:17 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-38000959-ec1c-4ca1-931d-777611a12fc2 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:55:17 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-38000959-ec1c-4ca1-931d-777611a12fc2 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:55:17 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-38000959-ec1c-4ca1-931d-777611a12fc2 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.486s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:55:17 user nova-compute[74337]: INFO nova.scheduler.client.report [None req-38000959-ec1c-4ca1-931d-777611a12fc2 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Deleted allocation for migration f4c67630-bc3f-4bc4-b842-4143f24df22e
Oct 23 21:55:17 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-38000959-ec1c-4ca1-931d-777611a12fc2 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lock "86f56afb-77e6-4378-b441-5cf507a0fbe7" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.391s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:55:17 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05206f35-b101-426b-8bb0-9d8bbaf557f1 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: e326a14c-61d7-4dca-b55f-db0f3ab0d14e] Calling os-brick to attach iSCSI Volume {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 21:55:17 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-05206f35-b101-426b-8bb0-9d8bbaf557f1 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a8c65f7e-9e2c-4a26-bab4-70c7d1e6c118', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EzrLPmfg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:55:17 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-05206f35-b101-426b-8bb0-9d8bbaf557f1 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:55:17 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-05206f35-b101-426b-8bb0-9d8bbaf557f1 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:55:17 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-05206f35-b101-426b-8bb0-9d8bbaf557f1 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:55:17 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-05206f35-b101-426b-8bb0-9d8bbaf557f1 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:55:17 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-05206f35-b101-426b-8bb0-9d8bbaf557f1 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8c65f7e-9e2c-4a26-bab4-70c7d1e6c118" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:55:17 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-05206f35-b101-426b-8bb0-9d8bbaf557f1 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8c65f7e-9e2c-4a26-bab4-70c7d1e6c118" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:55:17 user nova-compute[74337]: INFO os_brick.initiator.connectors.iscsi [None req-05206f35-b101-426b-8bb0-9d8bbaf557f1 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 21:55:17 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8c65f7e-9e2c-4a26-bab4-70c7d1e6c118 -p 172.16.0.220:3260 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:17 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8c65f7e-9e2c-4a26-bab4-70c7d1e6c118 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:55:17 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd3af7b-ed90-49b1-bb1f-5a1287e18d20]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:55:17 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-05206f35-b101-426b-8bb0-9d8bbaf557f1 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 21:55:17 user nova-compute[74337]:  {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:55:17 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8c65f7e-9e2c-4a26-bab4-70c7d1e6c118 -p 172.16.0.220:3260 --interface default --op new {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:17 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8c65f7e-9e2c-4a26-bab4-70c7d1e6c118 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:55:17 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[56bd84b3-741c-4962-941e-7cfc8b50567d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a8c65f7e-9e2c-4a26-bab4-70c7d1e6c118] added\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:55:17 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-05206f35-b101-426b-8bb0-9d8bbaf557f1 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a8c65f7e-9e2c-4a26-bab4-70c7d1e6c118] added
Oct 23 21:55:17 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:55:17 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8c65f7e-9e2c-4a26-bab4-70c7d1e6c118 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:17 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8c65f7e-9e2c-4a26-bab4-70c7d1e6c118 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:55:17 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5c3985b-0a9e-4e13-99a0-0b39ce1006e7]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:55:17 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-05206f35-b101-426b-8bb0-9d8bbaf557f1 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:55:17 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8c65f7e-9e2c-4a26-bab4-70c7d1e6c118 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:17 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8c65f7e-9e2c-4a26-bab4-70c7d1e6c118 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:55:17 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad60549f-f97d-4bd7-bf6f-822dc293769b]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:55:17 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-05206f35-b101-426b-8bb0-9d8bbaf557f1 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:55:17 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8c65f7e-9e2c-4a26-bab4-70c7d1e6c118 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EzrLPmfg {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:17 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8c65f7e-9e2c-4a26-bab4-70c7d1e6c118 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EzrLPmfg" returned: 0 in 0.020s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:55:17 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd7ec438-36ed-4160-bb14-708f37d2db78]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:55:17 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-05206f35-b101-426b-8bb0-9d8bbaf557f1 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EzrLPmfg'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:55:17 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8c65f7e-9e2c-4a26-bab4-70c7d1e6c118 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:17 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8c65f7e-9e2c-4a26-bab4-70c7d1e6c118 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:55:17 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba633119-f8ab-48ce-9f3c-9b7132b28fa2]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:55:17 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-05206f35-b101-426b-8bb0-9d8bbaf557f1 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:55:17 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:18 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:55:18 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[4884ebbf-5f1f-4e14-a8ba-d7271de08c31]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbfd2bf8-a953-438a-a710-b4b32965d32b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49e8a83b-e1d0-45e0-994a-8a44bc36b8b6 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:55:18 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-05206f35-b101-426b-8bb0-9d8bbaf557f1 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:55:18 user nova-compute[74337]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 (non-flash)
Oct 23 21:55:18 user nova-compute[74337]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 (non-flash)
Oct 23 21:55:18 user nova-compute[74337]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 (non-flash)
Oct 23 21:55:18 user nova-compute[74337]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607 (non-flash)
Oct 23 21:55:18 user nova-compute[74337]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbfd2bf8-a953-438a-a710-b4b32965d32b (non-flash)
Oct 23 21:55:18 user nova-compute[74337]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49e8a83b-e1d0-45e0-994a-8a44bc36b8b6 (non-flash)
Oct 23 21:55:18 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:55:18 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-05206f35-b101-426b-8bb0-9d8bbaf557f1 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:55:18 user nova-compute[74337]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 (non-flash)
Oct 23 21:55:18 user nova-compute[74337]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 (non-flash)
Oct 23 21:55:18 user nova-compute[74337]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 (non-flash)
Oct 23 21:55:18 user nova-compute[74337]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607 (non-flash)
Oct 23 21:55:18 user nova-compute[74337]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbfd2bf8-a953-438a-a710-b4b32965d32b (non-flash)
Oct 23 21:55:18 user nova-compute[74337]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49e8a83b-e1d0-45e0-994a-8a44bc36b8b6 (non-flash)
Oct 23 21:55:18 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:55:18 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8c65f7e-9e2c-4a26-bab4-70c7d1e6c118 -p 172.16.0.220:3260 --login {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:18 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8c65f7e-9e2c-4a26-bab4-70c7d1e6c118 -p 172.16.0.220:3260 --login" returned: 0 in 0.091s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:55:18 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b28a58cc-58c9-4684-bf29-0643c19d4b45]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a8c65f7e-9e2c-4a26-bab4-70c7d1e6c118, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a8c65f7e-9e2c-4a26-bab4-70c7d1e6c118, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:55:18 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-05206f35-b101-426b-8bb0-9d8bbaf557f1 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a8c65f7e-9e2c-4a26-bab4-70c7d1e6c118, portal: 172.16.0.220,3260]
Oct 23 21:55:18 user nova-compute[74337]: Login to [iface: default, target: iqn.2010-10.org.openstack:a8c65f7e-9e2c-4a26-bab4-70c7d1e6c118, portal: 172.16.0.220,3260] successful.
Oct 23 21:55:18 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:55:18 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8c65f7e-9e2c-4a26-bab4-70c7d1e6c118 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:18 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8c65f7e-9e2c-4a26-bab4-70c7d1e6c118 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:55:18 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[47182c4b-62d2-4ce2-915c-b5c739818a1c]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:55:18 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-05206f35-b101-426b-8bb0-9d8bbaf557f1 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:55:18 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:18 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:55:18 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[182e6cb4-1141-4d68-88ec-b5bcb1086ffb]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbfd2bf8-a953-438a-a710-b4b32965d32b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49e8a83b-e1d0-45e0-994a-8a44bc36b8b6 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c65f7e-9e2c-4a26-bab4-70c7d1e6c118 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:55:18 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-05206f35-b101-426b-8bb0-9d8bbaf557f1 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:55:18 user nova-compute[74337]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 (non-flash)
Oct 23 21:55:18 user nova-compute[74337]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 (non-flash)
Oct 23 21:55:18 user nova-compute[74337]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 (non-flash)
Oct 23 21:55:18 user nova-compute[74337]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607 (non-flash)
Oct 23 21:55:18 user nova-compute[74337]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbfd2bf8-a953-438a-a710-b4b32965d32b (non-flash)
Oct 23 21:55:18 user nova-compute[74337]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49e8a83b-e1d0-45e0-994a-8a44bc36b8b6 (non-flash)
Oct 23 21:55:18 user nova-compute[74337]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c65f7e-9e2c-4a26-bab4-70c7d1e6c118 (non-flash)
Oct 23 21:55:18 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:55:18 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-05206f35-b101-426b-8bb0-9d8bbaf557f1 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:55:18 user nova-compute[74337]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 (non-flash)
Oct 23 21:55:18 user nova-compute[74337]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 (non-flash)
Oct 23 21:55:18 user nova-compute[74337]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 (non-flash)
Oct 23 21:55:18 user nova-compute[74337]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607 (non-flash)
Oct 23 21:55:18 user nova-compute[74337]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbfd2bf8-a953-438a-a710-b4b32965d32b (non-flash)
Oct 23 21:55:18 user nova-compute[74337]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49e8a83b-e1d0-45e0-994a-8a44bc36b8b6 (non-flash)
Oct 23 21:55:18 user nova-compute[74337]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c65f7e-9e2c-4a26-bab4-70c7d1e6c118 (non-flash)
Oct 23 21:55:18 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:55:18 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-05206f35-b101-426b-8bb0-9d8bbaf557f1 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8c65f7e-9e2c-4a26-bab4-70c7d1e6c118" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.320s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:55:18 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-05206f35-b101-426b-8bb0-9d8bbaf557f1 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Connected to 172.16.0.220:3260 {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 21:55:18 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-05206f35-b101-426b-8bb0-9d8bbaf557f1 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] HCTL ('40', '-', '-', 0) found on session 40 with lun 0 {{(pid=74337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 21:55:18 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-05206f35-b101-426b-8bb0-9d8bbaf557f1 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=74337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 21:55:18 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:18 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:55:18 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f75018-a568-49c0-ac7e-cb6b32d90cad]: (4, ('- - 0', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:55:18 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-05206f35-b101-426b-8bb0-9d8bbaf557f1 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Searching for a device in session 40 and hctl ['40', '*', '*', 0] yield: None {{(pid=74337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 21:55:18 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:55:18 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:55:19 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-05206f35-b101-426b-8bb0-9d8bbaf557f1 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Searching for a device in session 40 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=74337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 21:55:19 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-05206f35-b101-426b-8bb0-9d8bbaf557f1 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:a8c65f7e-9e2c-4a26-bab4-70c7d1e6c118', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EzrLPmfg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 21:55:19 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-05206f35-b101-426b-8bb0-9d8bbaf557f1 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:55:19 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-05206f35-b101-426b-8bb0-9d8bbaf557f1 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] <== connect_volume: return (1352ms) {'type': 'block', 'scsi_wwn': '23633313465636633', 'path': '/dev/sdi'} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:55:19 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05206f35-b101-426b-8bb0-9d8bbaf557f1 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: e326a14c-61d7-4dca-b55f-db0f3ab0d14e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23633313465636633', 'path': '/dev/sdi'} {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 21:55:19 user nova-compute[74337]: DEBUG nova.objects.instance [None req-05206f35-b101-426b-8bb0-9d8bbaf557f1 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lazy-loading 'flavor' on Instance uuid e326a14c-61d7-4dca-b55f-db0f3ab0d14e {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:55:19 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-05206f35-b101-426b-8bb0-9d8bbaf557f1 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 21:55:19 user nova-compute[74337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 21:55:19 user nova-compute[74337]:   <source dev="/dev/sdi"/>
Oct 23 21:55:19 user nova-compute[74337]:   <target dev="vdc" bus="virtio"/>
Oct 23 21:55:19 user nova-compute[74337]:   <serial>a8c65f7e-9e2c-4a26-bab4-70c7d1e6c118</serial>
Oct 23 21:55:19 user nova-compute[74337]: </disk>
Oct 23 21:55:19 user nova-compute[74337]:  {{(pid=74337) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 21:55:19 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-05206f35-b101-426b-8bb0-9d8bbaf557f1 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] No BDM found with device name vda, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 21:55:19 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-05206f35-b101-426b-8bb0-9d8bbaf557f1 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 21:55:19 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-05206f35-b101-426b-8bb0-9d8bbaf557f1 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 21:55:19 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-05206f35-b101-426b-8bb0-9d8bbaf557f1 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] No VIF found with MAC fa:16:3e:99:b7:b3, not building metadata {{(pid=74337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 21:55:19 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-05206f35-b101-426b-8bb0-9d8bbaf557f1 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lock "e326a14c-61d7-4dca-b55f-db0f3ab0d14e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.139s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:55:20 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:55:20 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:55:20 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:55:20 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:55:20 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Auditing locally available compute resources for user (node: user) {{(pid=74337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 21:55:20 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 21:55:20 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-9ba409dd-e85c-47e9-a72a-8db2f6c9222b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Acquiring lock "e326a14c-61d7-4dca-b55f-db0f3ab0d14e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:55:20 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-9ba409dd-e85c-47e9-a72a-8db2f6c9222b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lock "e326a14c-61d7-4dca-b55f-db0f3ab0d14e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:55:20 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 21:55:20 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5d9d286-4837-4168-a4fe-1bc09e372654/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:21 user nova-compute[74337]: INFO nova.compute.manager [None req-9ba409dd-e85c-47e9-a72a-8db2f6c9222b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: e326a14c-61d7-4dca-b55f-db0f3ab0d14e] Detaching volume cbfd2bf8-a953-438a-a710-b4b32965d32b
Oct 23 21:55:21 user nova-compute[74337]: INFO nova.virt.block_device [None req-9ba409dd-e85c-47e9-a72a-8db2f6c9222b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: e326a14c-61d7-4dca-b55f-db0f3ab0d14e] Attempting to driver detach volume cbfd2bf8-a953-438a-a710-b4b32965d32b from mountpoint /dev/vdb
Oct 23 21:55:21 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-9ba409dd-e85c-47e9-a72a-8db2f6c9222b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Attempting to detach device vdb from instance e326a14c-61d7-4dca-b55f-db0f3ab0d14e from the persistent domain config. {{(pid=74337) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 21:55:21 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-9ba409dd-e85c-47e9-a72a-8db2f6c9222b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 21:55:21 user nova-compute[74337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 21:55:21 user nova-compute[74337]:   <source dev="/dev/sdg"/>
Oct 23 21:55:21 user nova-compute[74337]:   <target dev="vdb" bus="virtio"/>
Oct 23 21:55:21 user nova-compute[74337]:   <serial>cbfd2bf8-a953-438a-a710-b4b32965d32b</serial>
Oct 23 21:55:21 user nova-compute[74337]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 21:55:21 user nova-compute[74337]: </disk>
Oct 23 21:55:21 user nova-compute[74337]:  {{(pid=74337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 21:55:21 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-9ba409dd-e85c-47e9-a72a-8db2f6c9222b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Successfully detached device vdb from instance e326a14c-61d7-4dca-b55f-db0f3ab0d14e from the persistent domain config.
Oct 23 21:55:21 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-9ba409dd-e85c-47e9-a72a-8db2f6c9222b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e326a14c-61d7-4dca-b55f-db0f3ab0d14e from the live domain config. {{(pid=74337) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 21:55:21 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-9ba409dd-e85c-47e9-a72a-8db2f6c9222b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 21:55:21 user nova-compute[74337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 21:55:21 user nova-compute[74337]:   <source dev="/dev/sdg"/>
Oct 23 21:55:21 user nova-compute[74337]:   <target dev="vdb" bus="virtio"/>
Oct 23 21:55:21 user nova-compute[74337]:   <serial>cbfd2bf8-a953-438a-a710-b4b32965d32b</serial>
Oct 23 21:55:21 user nova-compute[74337]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 21:55:21 user nova-compute[74337]: </disk>
Oct 23 21:55:21 user nova-compute[74337]:  {{(pid=74337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 21:55:21 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5d9d286-4837-4168-a4fe-1bc09e372654/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:55:21 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5d9d286-4837-4168-a4fe-1bc09e372654/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:21 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5d9d286-4837-4168-a4fe-1bc09e372654/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:55:21 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/547c4d4c-e0dd-495a-b83f-98426d0a4a99/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:21 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:55:21 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/547c4d4c-e0dd-495a-b83f-98426d0a4a99/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:55:21 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/547c4d4c-e0dd-495a-b83f-98426d0a4a99/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:21 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-9ba409dd-e85c-47e9-a72a-8db2f6c9222b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e326a14c-61d7-4dca-b55f-db0f3ab0d14e {{(pid=74337) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 21:55:21 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/547c4d4c-e0dd-495a-b83f-98426d0a4a99/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:55:21 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 21:55:21 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e05fd36-ee44-4992-80a9-f95af608b9f5/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:21 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e05fd36-ee44-4992-80a9-f95af608b9f5/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:55:21 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e05fd36-ee44-4992-80a9-f95af608b9f5/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:22 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e05fd36-ee44-4992-80a9-f95af608b9f5/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:55:22 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b0f8cc-bfec-42f2-b8cf-29f0603e3169/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:22 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b0f8cc-bfec-42f2-b8cf-29f0603e3169/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:55:22 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b0f8cc-bfec-42f2-b8cf-29f0603e3169/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:22 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b0f8cc-bfec-42f2-b8cf-29f0603e3169/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:55:22 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 21:55:22 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e326a14c-61d7-4dca-b55f-db0f3ab0d14e/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:22 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e326a14c-61d7-4dca-b55f-db0f3ab0d14e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:55:22 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e326a14c-61d7-4dca-b55f-db0f3ab0d14e/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:22 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e326a14c-61d7-4dca-b55f-db0f3ab0d14e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:55:22 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] skipping disk /dev/sdi (vdc) as it is a volume {{(pid=74337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 21:55:22 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 21:55:22 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1189976f-8d02-468d-8fa7-bd5594c5f85a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:23 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1189976f-8d02-468d-8fa7-bd5594c5f85a/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:55:23 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1189976f-8d02-468d-8fa7-bd5594c5f85a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:23 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1189976f-8d02-468d-8fa7-bd5594c5f85a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:55:23 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:55:23 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:55:23 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Hypervisor/Node resource view: name=user free_ram=7410MB free_disk=25.044384002685547GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 21:55:23 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:55:23 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:55:23 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 1189976f-8d02-468d-8fa7-bd5594c5f85a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:55:23 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 547c4d4c-e0dd-495a-b83f-98426d0a4a99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:55:23 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 00f757cf-e5dd-476f-81c6-670ed2bf6938 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Oct 23 21:55:23 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:55:23 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 1e05fd36-ee44-4992-80a9-f95af608b9f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:55:23 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance bf53e0fc-71d1-48fa-b0b4-ed3400a21c38 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:55:23 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance e326a14c-61d7-4dca-b55f-db0f3ab0d14e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:55:23 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 86b0f8cc-bfec-42f2-b8cf-29f0603e3169 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:55:23 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance d5d9d286-4837-4168-a4fe-1bc09e372654 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:55:23 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 86f56afb-77e6-4378-b441-5cf507a0fbe7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:55:23 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance bc4c3e54-a845-4ea8-9ffc-a75d42a51788 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:55:23 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 0323b854-c7a1-42e8-ad85-1e929caa6e9d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:55:23 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 21:55:23 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 21:55:23 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:55:24 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:55:24 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:55:24 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Compute_service record updated for user:user {{(pid=74337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 21:55:24 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.536s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:55:24 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6a9292f-8383-4d19-8f32-a5a498c55cd0 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] Calling os-brick to attach iSCSI Volume {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 21:55:24 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6a9292f-8383-4d19-8f32-a5a498c55cd0 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QpXmROZJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:55:24 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-d6a9292f-8383-4d19-8f32-a5a498c55cd0 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:55:24 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-d6a9292f-8383-4d19-8f32-a5a498c55cd0 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:55:24 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-d6a9292f-8383-4d19-8f32-a5a498c55cd0 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:55:24 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-d6a9292f-8383-4d19-8f32-a5a498c55cd0 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:55:24 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-d6a9292f-8383-4d19-8f32-a5a498c55cd0 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:55:24 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-d6a9292f-8383-4d19-8f32-a5a498c55cd0 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:55:24 user nova-compute[74337]: INFO os_brick.initiator.connectors.iscsi [None req-d6a9292f-8383-4d19-8f32-a5a498c55cd0 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 21:55:24 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7 -p 172.16.0.220:3260 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:24 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:55:24 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7ab1d5e-13b6-4a0f-b3b8-f8a8684dd886]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:55:24 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6a9292f-8383-4d19-8f32-a5a498c55cd0 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 21:55:24 user nova-compute[74337]:  {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:55:24 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7 -p 172.16.0.220:3260 --interface default --op new {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:24 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:55:24 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[f80748c0-1be4-4b0f-bc26-e23e6494a973]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7] added\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:55:24 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6a9292f-8383-4d19-8f32-a5a498c55cd0 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7] added
Oct 23 21:55:24 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:55:24 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:24 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:55:24 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[760dfa24-f2a0-47b6-b7a4-90ac4d4210f3]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:55:24 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6a9292f-8383-4d19-8f32-a5a498c55cd0 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:55:24 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:24 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:55:24 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb77c48-435e-4aa4-bf4e-f5b50abaf162]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:55:24 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6a9292f-8383-4d19-8f32-a5a498c55cd0 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:55:24 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QpXmROZJ {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:24 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QpXmROZJ" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:55:24 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca68a2ee-3c67-4691-b12b-360a95ac79e3]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:55:24 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6a9292f-8383-4d19-8f32-a5a498c55cd0 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QpXmROZJ'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:55:24 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:24 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:55:24 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[09dae4b4-cc28-4bc8-8783-d3840c080219]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:55:24 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6a9292f-8383-4d19-8f32-a5a498c55cd0 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:55:24 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:24 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:55:24 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6030322d-6b37-4630-b707-a7c5ed5fef6d]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbfd2bf8-a953-438a-a710-b4b32965d32b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49e8a83b-e1d0-45e0-994a-8a44bc36b8b6 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c65f7e-9e2c-4a26-bab4-70c7d1e6c118 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:55:24 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6a9292f-8383-4d19-8f32-a5a498c55cd0 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:55:24 user nova-compute[74337]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 (non-flash)
Oct 23 21:55:24 user nova-compute[74337]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 (non-flash)
Oct 23 21:55:24 user nova-compute[74337]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 (non-flash)
Oct 23 21:55:24 user nova-compute[74337]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607 (non-flash)
Oct 23 21:55:24 user nova-compute[74337]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbfd2bf8-a953-438a-a710-b4b32965d32b (non-flash)
Oct 23 21:55:24 user nova-compute[74337]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49e8a83b-e1d0-45e0-994a-8a44bc36b8b6 (non-flash)
Oct 23 21:55:24 user nova-compute[74337]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c65f7e-9e2c-4a26-bab4-70c7d1e6c118 (non-flash)
Oct 23 21:55:24 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:55:24 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6a9292f-8383-4d19-8f32-a5a498c55cd0 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:55:24 user nova-compute[74337]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 (non-flash)
Oct 23 21:55:24 user nova-compute[74337]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 (non-flash)
Oct 23 21:55:24 user nova-compute[74337]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 (non-flash)
Oct 23 21:55:24 user nova-compute[74337]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607 (non-flash)
Oct 23 21:55:24 user nova-compute[74337]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbfd2bf8-a953-438a-a710-b4b32965d32b (non-flash)
Oct 23 21:55:24 user nova-compute[74337]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49e8a83b-e1d0-45e0-994a-8a44bc36b8b6 (non-flash)
Oct 23 21:55:24 user nova-compute[74337]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c65f7e-9e2c-4a26-bab4-70c7d1e6c118 (non-flash)
Oct 23 21:55:24 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:55:24 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7 -p 172.16.0.220:3260 --login {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:24 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7 -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:55:24 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a72467e-19ad-4b53-a681-269d95c477eb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:55:24 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6a9292f-8383-4d19-8f32-a5a498c55cd0 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7, portal: 172.16.0.220,3260]
Oct 23 21:55:24 user nova-compute[74337]: Login to [iface: default, target: iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7, portal: 172.16.0.220,3260] successful.
Oct 23 21:55:24 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:55:24 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:24 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:55:24 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[1559c9ef-745a-4518-a14d-3ebf4ea106af]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:55:24 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6a9292f-8383-4d19-8f32-a5a498c55cd0 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:55:24 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:24 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:55:24 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[1234d107-b7be-4c41-8c8c-f972b5b9e7fc]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbfd2bf8-a953-438a-a710-b4b32965d32b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49e8a83b-e1d0-45e0-994a-8a44bc36b8b6 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c65f7e-9e2c-4a26-bab4-70c7d1e6c118 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:55:24 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6a9292f-8383-4d19-8f32-a5a498c55cd0 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:55:24 user nova-compute[74337]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 (non-flash)
Oct 23 21:55:24 user nova-compute[74337]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 (non-flash)
Oct 23 21:55:24 user nova-compute[74337]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 (non-flash)
Oct 23 21:55:24 user nova-compute[74337]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607 (non-flash)
Oct 23 21:55:24 user nova-compute[74337]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbfd2bf8-a953-438a-a710-b4b32965d32b (non-flash)
Oct 23 21:55:24 user nova-compute[74337]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49e8a83b-e1d0-45e0-994a-8a44bc36b8b6 (non-flash)
Oct 23 21:55:24 user nova-compute[74337]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c65f7e-9e2c-4a26-bab4-70c7d1e6c118 (non-flash)
Oct 23 21:55:24 user nova-compute[74337]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7 (non-flash)
Oct 23 21:55:24 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:55:24 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6a9292f-8383-4d19-8f32-a5a498c55cd0 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:55:24 user nova-compute[74337]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 (non-flash)
Oct 23 21:55:24 user nova-compute[74337]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 (non-flash)
Oct 23 21:55:24 user nova-compute[74337]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 (non-flash)
Oct 23 21:55:24 user nova-compute[74337]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607 (non-flash)
Oct 23 21:55:24 user nova-compute[74337]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbfd2bf8-a953-438a-a710-b4b32965d32b (non-flash)
Oct 23 21:55:24 user nova-compute[74337]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49e8a83b-e1d0-45e0-994a-8a44bc36b8b6 (non-flash)
Oct 23 21:55:24 user nova-compute[74337]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c65f7e-9e2c-4a26-bab4-70c7d1e6c118 (non-flash)
Oct 23 21:55:24 user nova-compute[74337]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7 (non-flash)
Oct 23 21:55:24 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:55:24 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-d6a9292f-8383-4d19-8f32-a5a498c55cd0 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:55:24 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6a9292f-8383-4d19-8f32-a5a498c55cd0 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Connected to 172.16.0.220:3260 {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 21:55:24 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-d6a9292f-8383-4d19-8f32-a5a498c55cd0 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] HCTL ('41', '-', '-', 0) found on session 41 with lun 0 {{(pid=74337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 21:55:24 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-d6a9292f-8383-4d19-8f32-a5a498c55cd0 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=74337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 21:55:24 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:24 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:55:24 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[72de5cfd-7dc7-4aaf-b1c7-e1e703bc4216]: (4, ('- - 0', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:55:24 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-d6a9292f-8383-4d19-8f32-a5a498c55cd0 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Searching for a device in session 41 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=74337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 21:55:24 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6a9292f-8383-4d19-8f32-a5a498c55cd0 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QpXmROZJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 21:55:24 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-f56f7fb7-e12e-4b5f-82b4-c15efa4c48b0 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 86b0f8cc-bfec-42f2-b8cf-29f0603e3169 is timed out.
Oct 23 21:55:24 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-f56f7fb7-e12e-4b5f-82b4-c15efa4c48b0 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Successfully detached device vdb from instance 86b0f8cc-bfec-42f2-b8cf-29f0603e3169 from the live domain config.
Oct 23 21:55:24 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f56f7fb7-e12e-4b5f-82b4-c15efa4c48b0 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 86b0f8cc-bfec-42f2-b8cf-29f0603e3169] calling os-brick to detach iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 21:55:24 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f56f7fb7-e12e-4b5f-82b4-c15efa4c48b0 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, {'target_iqn': 'iqn.2010-10.org.openstack:49e8a83b-e1d0-45e0-994a-8a44bc36b8b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UTIszgNV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:55:24 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-f56f7fb7-e12e-4b5f-82b4-c15efa4c48b0 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:55:24 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-f56f7fb7-e12e-4b5f-82b4-c15efa4c48b0 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:55:25 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-d6a9292f-8383-4d19-8f32-a5a498c55cd0 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.353s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:55:25 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6a9292f-8383-4d19-8f32-a5a498c55cd0 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] <== connect_volume: return (1355ms) {'type': 'block', 'scsi_wwn': '26534353139306130', 'path': '/dev/sdj'} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:55:25 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6a9292f-8383-4d19-8f32-a5a498c55cd0 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26534353139306130', 'path': '/dev/sdj'} {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 21:55:25 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-f56f7fb7-e12e-4b5f-82b4-c15efa4c48b0 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.858s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:55:25 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:25 user nova-compute[74337]: DEBUG nova.objects.instance [None req-d6a9292f-8383-4d19-8f32-a5a498c55cd0 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Lazy-loading 'flavor' on Instance uuid d5d9d286-4837-4168-a4fe-1bc09e372654 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:55:25 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:55:25 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[06133df7-ed1c-4ee0-9cea-7d09be7528fc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a8c65f7e-9e2c-4a26-bab4-70c7d1e6c118\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cbfd2bf8-a953-438a-a710-b4b32965d32b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:49e8a83b-e1d0-45e0-994a-8a44bc36b8b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:55:25 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f56f7fb7-e12e-4b5f-82b4-c15efa4c48b0 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 21:55:25 user nova-compute[74337]: No targets found.
Oct 23 21:55:25 user nova-compute[74337]: iSNS:
Oct 23 21:55:25 user nova-compute[74337]: No targets found.
Oct 23 21:55:25 user nova-compute[74337]: STATIC:
Oct 23 21:55:25 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83
Oct 23 21:55:25 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:55:25 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:55:25 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607
Oct 23 21:55:25 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:55:25 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:55:25 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4
Oct 23 21:55:25 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:55:25 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:55:25 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398
Oct 23 21:55:25 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:55:25 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:55:25 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:a8c65f7e-9e2c-4a26-bab4-70c7d1e6c118
Oct 23 21:55:25 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:55:25 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:55:25 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048
Oct 23 21:55:25 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:55:25 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:55:25 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7
Oct 23 21:55:25 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:55:25 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:55:25 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:cbfd2bf8-a953-438a-a710-b4b32965d32b
Oct 23 21:55:25 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:55:25 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:55:25 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:49e8a83b-e1d0-45e0-994a-8a44bc36b8b6
Oct 23 21:55:25 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:55:25 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:55:25 user nova-compute[74337]: FIRMWARE:
Oct 23 21:55:25 user nova-compute[74337]: No targets found.
Oct 23 21:55:25 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:55:25 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f56f7fb7-e12e-4b5f-82b4-c15efa4c48b0 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 21:55:25 user nova-compute[74337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 21:55:25 user nova-compute[74337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 21:55:25 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f56f7fb7-e12e-4b5f-82b4-c15efa4c48b0 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49e8a83b-e1d0-45e0-994a-8a44bc36b8b6', 0)] {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 21:55:25 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:25 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-d6a9292f-8383-4d19-8f32-a5a498c55cd0 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 21:55:25 user nova-compute[74337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 21:55:25 user nova-compute[74337]:   <source dev="/dev/sdj"/>
Oct 23 21:55:25 user nova-compute[74337]:   <target dev="vdb" bus="virtio"/>
Oct 23 21:55:25 user nova-compute[74337]:   <serial>f147349c-8434-4957-8f5f-ced11857d9b7</serial>
Oct 23 21:55:25 user nova-compute[74337]: </disk>
Oct 23 21:55:25 user nova-compute[74337]:  {{(pid=74337) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 21:55:25 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:55:25 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e644062c-d3be-4aca-afac-d189a9cd1253]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49e8a83b-e1d0-45e0-994a-8a44bc36b8b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8c65f7e-9e2c-4a26-bab4-70c7d1e6c118\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbfd2bf8-a953-438a-a710-b4b32965d32b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:55:25 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:25 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:55:25 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5c386e9-295a-4437-9738-48d0b1b0ff3e]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbfd2bf8-a953-438a-a710-b4b32965d32b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49e8a83b-e1d0-45e0-994a-8a44bc36b8b6 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c65f7e-9e2c-4a26-bab4-70c7d1e6c118 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:55:25 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f56f7fb7-e12e-4b5f-82b4-c15efa4c48b0 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:55:25 user nova-compute[74337]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 (non-flash)
Oct 23 21:55:25 user nova-compute[74337]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 (non-flash)
Oct 23 21:55:25 user nova-compute[74337]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 (non-flash)
Oct 23 21:55:25 user nova-compute[74337]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607 (non-flash)
Oct 23 21:55:25 user nova-compute[74337]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbfd2bf8-a953-438a-a710-b4b32965d32b (non-flash)
Oct 23 21:55:25 user nova-compute[74337]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49e8a83b-e1d0-45e0-994a-8a44bc36b8b6 (non-flash)
Oct 23 21:55:25 user nova-compute[74337]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c65f7e-9e2c-4a26-bab4-70c7d1e6c118 (non-flash)
Oct 23 21:55:25 user nova-compute[74337]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7 (non-flash)
Oct 23 21:55:25 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:55:25 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f56f7fb7-e12e-4b5f-82b4-c15efa4c48b0 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:55:25 user nova-compute[74337]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 (non-flash)
Oct 23 21:55:25 user nova-compute[74337]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 (non-flash)
Oct 23 21:55:25 user nova-compute[74337]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 (non-flash)
Oct 23 21:55:25 user nova-compute[74337]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607 (non-flash)
Oct 23 21:55:25 user nova-compute[74337]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbfd2bf8-a953-438a-a710-b4b32965d32b (non-flash)
Oct 23 21:55:25 user nova-compute[74337]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49e8a83b-e1d0-45e0-994a-8a44bc36b8b6 (non-flash)
Oct 23 21:55:25 user nova-compute[74337]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c65f7e-9e2c-4a26-bab4-70c7d1e6c118 (non-flash)
Oct 23 21:55:25 user nova-compute[74337]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7 (non-flash)
Oct 23 21:55:25 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:55:25 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f56f7fb7-e12e-4b5f-82b4-c15efa4c48b0 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5ec8720f70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49e8a83b-e1d0-45e0-994a-8a44bc36b8b6'): ({'sdh'}, set())}) {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 21:55:25 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-f56f7fb7-e12e-4b5f-82b4-c15efa4c48b0 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Removing single pathed devices sdh {{(pid=74337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 21:55:25 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:25 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:55:25 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[3731b4ca-f004-44ba-b3a7-87eb443a3c24]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:55:25 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:25 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.023s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:55:25 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[5edd225c-2e20-49fe-99a1-96f7bcc5cb97]: (4, ('ok\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:55:25 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-f56f7fb7-e12e-4b5f-82b4-c15efa4c48b0 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Flushing IO for device /dev/sdh {{(pid=74337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 21:55:25 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:25 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.016s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:55:25 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[41d5717f-0e05-4f58-8de0-352936a0a4b2]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:55:25 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-f56f7fb7-e12e-4b5f-82b4-c15efa4c48b0 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 21:55:25 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:26 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.045s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:55:26 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e031a06-bb60-4599-9bee-07798880b863]: (4, ('1', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:55:26 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-f56f7fb7-e12e-4b5f-82b4-c15efa4c48b0 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 21:55:26 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-f56f7fb7-e12e-4b5f-82b4-c15efa4c48b0 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] SCSI volumes sdh have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 21:55:26 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f56f7fb7-e12e-4b5f-82b4-c15efa4c48b0 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49e8a83b-e1d0-45e0-994a-8a44bc36b8b6')] {{(pid=74337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 21:55:26 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49e8a83b-e1d0-45e0-994a-8a44bc36b8b6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:26 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49e8a83b-e1d0-45e0-994a-8a44bc36b8b6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:55:26 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c7e29c6-0710-4500-9c63-23ea885b96a6]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:55:26 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f56f7fb7-e12e-4b5f-82b4-c15efa4c48b0 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:55:26 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49e8a83b-e1d0-45e0-994a-8a44bc36b8b6 -p 172.16.0.220:3260 --logout {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:26 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49e8a83b-e1d0-45e0-994a-8a44bc36b8b6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:55:26 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aca2b3e-8726-408c-b020-ff8081773b16]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:49e8a83b-e1d0-45e0-994a-8a44bc36b8b6, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:49e8a83b-e1d0-45e0-994a-8a44bc36b8b6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:55:26 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f56f7fb7-e12e-4b5f-82b4-c15efa4c48b0 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:49e8a83b-e1d0-45e0-994a-8a44bc36b8b6, portal: 172.16.0.220,3260]
Oct 23 21:55:26 user nova-compute[74337]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:49e8a83b-e1d0-45e0-994a-8a44bc36b8b6, portal: 172.16.0.220,3260] successful.
Oct 23 21:55:26 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:55:26 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49e8a83b-e1d0-45e0-994a-8a44bc36b8b6 -p 172.16.0.220:3260 --op delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:26 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49e8a83b-e1d0-45e0-994a-8a44bc36b8b6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:55:26 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[17d7e531-d967-4f4b-ab23-cf6f32b1ebff]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:55:26 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f56f7fb7-e12e-4b5f-82b4-c15efa4c48b0 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:55:26 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-f56f7fb7-e12e-4b5f-82b4-c15efa4c48b0 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:55:26 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f56f7fb7-e12e-4b5f-82b4-c15efa4c48b0 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] <== disconnect_volume: return (1207ms) None {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:55:26 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f56f7fb7-e12e-4b5f-82b4-c15efa4c48b0 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 86b0f8cc-bfec-42f2-b8cf-29f0603e3169] Disconnected iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 21:55:26 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-d6a9292f-8383-4d19-8f32-a5a498c55cd0 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] No BDM found with device name vda, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 21:55:26 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-d6a9292f-8383-4d19-8f32-a5a498c55cd0 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 21:55:26 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-d6a9292f-8383-4d19-8f32-a5a498c55cd0 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] No VIF found with MAC fa:16:3e:be:e5:9b, not building metadata {{(pid=74337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 21:55:26 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-d6a9292f-8383-4d19-8f32-a5a498c55cd0 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Lock "d5d9d286-4837-4168-a4fe-1bc09e372654" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.714s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:55:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:55:26 user nova-compute[74337]: DEBUG nova.objects.instance [None req-f56f7fb7-e12e-4b5f-82b4-c15efa4c48b0 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lazy-loading 'flavor' on Instance uuid 86b0f8cc-bfec-42f2-b8cf-29f0603e3169 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:55:27 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-f56f7fb7-e12e-4b5f-82b4-c15efa4c48b0 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lock "86b0f8cc-bfec-42f2-b8cf-29f0603e3169" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.621s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:55:30 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:55:31 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:55:31 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:55:31 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 21:55:31 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 21:55:31 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 21:55:31 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:55:36 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:55:37 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:55:38 user nova-compute[74337]: DEBUG nova.compute.manager [req-8c9c0f7e-2725-4c91-9de3-06c8fa0d6472 req-32fcc3bd-a289-45b3-99b0-2b77f6724b7d service nova] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] Received event network-changed-16ee3173-b704-43aa-9c44-ffa4d4d82fc4 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:55:38 user nova-compute[74337]: DEBUG nova.compute.manager [req-8c9c0f7e-2725-4c91-9de3-06c8fa0d6472 req-32fcc3bd-a289-45b3-99b0-2b77f6724b7d service nova] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] Refreshing instance network info cache due to event network-changed-16ee3173-b704-43aa-9c44-ffa4d4d82fc4. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 21:55:38 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-8c9c0f7e-2725-4c91-9de3-06c8fa0d6472 req-32fcc3bd-a289-45b3-99b0-2b77f6724b7d service nova] Acquiring lock "refresh_cache-d5d9d286-4837-4168-a4fe-1bc09e372654" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:55:38 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-8c9c0f7e-2725-4c91-9de3-06c8fa0d6472 req-32fcc3bd-a289-45b3-99b0-2b77f6724b7d service nova] Acquired lock "refresh_cache-d5d9d286-4837-4168-a4fe-1bc09e372654" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:55:38 user nova-compute[74337]: DEBUG nova.network.neutron [req-8c9c0f7e-2725-4c91-9de3-06c8fa0d6472 req-32fcc3bd-a289-45b3-99b0-2b77f6724b7d service nova] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] Refreshing network info cache for port 16ee3173-b704-43aa-9c44-ffa4d4d82fc4 {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 21:55:39 user nova-compute[74337]: DEBUG nova.network.neutron [req-8c9c0f7e-2725-4c91-9de3-06c8fa0d6472 req-32fcc3bd-a289-45b3-99b0-2b77f6724b7d service nova] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] Updated VIF entry in instance network info cache for port 16ee3173-b704-43aa-9c44-ffa4d4d82fc4. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 21:55:39 user nova-compute[74337]: DEBUG nova.network.neutron [req-8c9c0f7e-2725-4c91-9de3-06c8fa0d6472 req-32fcc3bd-a289-45b3-99b0-2b77f6724b7d service nova] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] Updating instance_info_cache with network_info: [{"id": "16ee3173-b704-43aa-9c44-ffa4d4d82fc4", "address": "fa:16:3e:be:e5:9b", "network": {"id": "0b1d82b0-acba-470e-aede-1c57a85a8ed3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1250228933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "965415a9973d4714aa49a64d34b232a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16ee3173-b7", "ovs_interfaceid": "16ee3173-b704-43aa-9c44-ffa4d4d82fc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:55:39 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-8c9c0f7e-2725-4c91-9de3-06c8fa0d6472 req-32fcc3bd-a289-45b3-99b0-2b77f6724b7d service nova] Releasing lock "refresh_cache-d5d9d286-4837-4168-a4fe-1bc09e372654" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:55:41 user nova-compute[74337]: DEBUG nova.compute.manager [req-9fdaa030-99ff-40ff-ac73-bb2e67e451ff req-dd51fd27-869a-4c2a-9f91-311a243e4537 service nova] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] Received event network-changed-16ee3173-b704-43aa-9c44-ffa4d4d82fc4 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:55:41 user nova-compute[74337]: DEBUG nova.compute.manager [req-9fdaa030-99ff-40ff-ac73-bb2e67e451ff req-dd51fd27-869a-4c2a-9f91-311a243e4537 service nova] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] Refreshing instance network info cache due to event network-changed-16ee3173-b704-43aa-9c44-ffa4d4d82fc4. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 21:55:41 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-9fdaa030-99ff-40ff-ac73-bb2e67e451ff req-dd51fd27-869a-4c2a-9f91-311a243e4537 service nova] Acquiring lock "refresh_cache-d5d9d286-4837-4168-a4fe-1bc09e372654" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:55:41 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-9fdaa030-99ff-40ff-ac73-bb2e67e451ff req-dd51fd27-869a-4c2a-9f91-311a243e4537 service nova] Acquired lock "refresh_cache-d5d9d286-4837-4168-a4fe-1bc09e372654" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:55:41 user nova-compute[74337]: DEBUG nova.network.neutron [req-9fdaa030-99ff-40ff-ac73-bb2e67e451ff req-dd51fd27-869a-4c2a-9f91-311a243e4537 service nova] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] Refreshing network info cache for port 16ee3173-b704-43aa-9c44-ffa4d4d82fc4 {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 21:55:41 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:55:41 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-9ba409dd-e85c-47e9-a72a-8db2f6c9222b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e326a14c-61d7-4dca-b55f-db0f3ab0d14e is timed out.
Oct 23 21:55:41 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-9ba409dd-e85c-47e9-a72a-8db2f6c9222b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Successfully detached device vdb from instance e326a14c-61d7-4dca-b55f-db0f3ab0d14e from the live domain config.
Oct 23 21:55:41 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ba409dd-e85c-47e9-a72a-8db2f6c9222b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: e326a14c-61d7-4dca-b55f-db0f3ab0d14e] calling os-brick to detach iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 21:55:41 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ba409dd-e85c-47e9-a72a-8db2f6c9222b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, {'target_iqn': 'iqn.2010-10.org.openstack:cbfd2bf8-a953-438a-a710-b4b32965d32b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QeXJoZzB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:55:41 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-9ba409dd-e85c-47e9-a72a-8db2f6c9222b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:55:41 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-9ba409dd-e85c-47e9-a72a-8db2f6c9222b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:55:41 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-9ba409dd-e85c-47e9-a72a-8db2f6c9222b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:55:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:41 user nova-compute[74337]: DEBUG nova.network.neutron [req-9fdaa030-99ff-40ff-ac73-bb2e67e451ff req-dd51fd27-869a-4c2a-9f91-311a243e4537 service nova] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] Updated VIF entry in instance network info cache for port 16ee3173-b704-43aa-9c44-ffa4d4d82fc4. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 21:55:41 user nova-compute[74337]: DEBUG nova.network.neutron [req-9fdaa030-99ff-40ff-ac73-bb2e67e451ff req-dd51fd27-869a-4c2a-9f91-311a243e4537 service nova] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] Updating instance_info_cache with network_info: [{"id": "16ee3173-b704-43aa-9c44-ffa4d4d82fc4", "address": "fa:16:3e:be:e5:9b", "network": {"id": "0b1d82b0-acba-470e-aede-1c57a85a8ed3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1250228933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "965415a9973d4714aa49a64d34b232a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16ee3173-b7", "ovs_interfaceid": "16ee3173-b704-43aa-9c44-ffa4d4d82fc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:55:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:55:41 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d14d68-2276-4b3b-ac34-186d97b3afc4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a8c65f7e-9e2c-4a26-bab4-70c7d1e6c118\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cbfd2bf8-a953-438a-a710-b4b32965d32b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:55:41 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ba409dd-e85c-47e9-a72a-8db2f6c9222b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 21:55:41 user nova-compute[74337]: No targets found.
Oct 23 21:55:41 user nova-compute[74337]: iSNS:
Oct 23 21:55:41 user nova-compute[74337]: No targets found.
Oct 23 21:55:41 user nova-compute[74337]: STATIC:
Oct 23 21:55:41 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83
Oct 23 21:55:41 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:55:41 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:55:41 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607
Oct 23 21:55:41 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:55:41 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:55:41 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4
Oct 23 21:55:41 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:55:41 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:55:41 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398
Oct 23 21:55:41 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:55:41 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:55:41 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:a8c65f7e-9e2c-4a26-bab4-70c7d1e6c118
Oct 23 21:55:41 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:55:41 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:55:41 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048
Oct 23 21:55:41 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:55:41 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:55:41 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7
Oct 23 21:55:41 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:55:41 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:55:41 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:cbfd2bf8-a953-438a-a710-b4b32965d32b
Oct 23 21:55:41 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:55:41 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:55:41 user nova-compute[74337]: FIRMWARE:
Oct 23 21:55:41 user nova-compute[74337]: No targets found.
Oct 23 21:55:41 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:55:41 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ba409dd-e85c-47e9-a72a-8db2f6c9222b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 21:55:41 user nova-compute[74337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 21:55:41 user nova-compute[74337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 21:55:41 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ba409dd-e85c-47e9-a72a-8db2f6c9222b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cbfd2bf8-a953-438a-a710-b4b32965d32b', 0)] {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 21:55:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:41 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-9fdaa030-99ff-40ff-ac73-bb2e67e451ff req-dd51fd27-869a-4c2a-9f91-311a243e4537 service nova] Releasing lock "refresh_cache-d5d9d286-4837-4168-a4fe-1bc09e372654" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:55:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:55:41 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c435842-3184-4a97-88a7-a3485c44f94f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8c65f7e-9e2c-4a26-bab4-70c7d1e6c118\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbfd2bf8-a953-438a-a710-b4b32965d32b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:55:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:55:41 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e92e0ba-bd8a-49c8-bd4a-63b8f9a4b222]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbfd2bf8-a953-438a-a710-b4b32965d32b (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c65f7e-9e2c-4a26-bab4-70c7d1e6c118 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:55:41 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ba409dd-e85c-47e9-a72a-8db2f6c9222b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:55:41 user nova-compute[74337]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 (non-flash)
Oct 23 21:55:41 user nova-compute[74337]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 (non-flash)
Oct 23 21:55:41 user nova-compute[74337]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 (non-flash)
Oct 23 21:55:41 user nova-compute[74337]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607 (non-flash)
Oct 23 21:55:41 user nova-compute[74337]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbfd2bf8-a953-438a-a710-b4b32965d32b (non-flash)
Oct 23 21:55:41 user nova-compute[74337]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c65f7e-9e2c-4a26-bab4-70c7d1e6c118 (non-flash)
Oct 23 21:55:41 user nova-compute[74337]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7 (non-flash)
Oct 23 21:55:41 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:55:41 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ba409dd-e85c-47e9-a72a-8db2f6c9222b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:55:41 user nova-compute[74337]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 (non-flash)
Oct 23 21:55:41 user nova-compute[74337]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 (non-flash)
Oct 23 21:55:41 user nova-compute[74337]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 (non-flash)
Oct 23 21:55:41 user nova-compute[74337]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607 (non-flash)
Oct 23 21:55:41 user nova-compute[74337]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbfd2bf8-a953-438a-a710-b4b32965d32b (non-flash)
Oct 23 21:55:41 user nova-compute[74337]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c65f7e-9e2c-4a26-bab4-70c7d1e6c118 (non-flash)
Oct 23 21:55:41 user nova-compute[74337]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7 (non-flash)
Oct 23 21:55:41 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:55:41 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ba409dd-e85c-47e9-a72a-8db2f6c9222b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5eec3cd1b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cbfd2bf8-a953-438a-a710-b4b32965d32b'): ({'sdg'}, set())}) {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 21:55:41 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-9ba409dd-e85c-47e9-a72a-8db2f6c9222b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Removing single pathed devices sdg {{(pid=74337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 21:55:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:55:41 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[1429089f-dc4b-4294-a682-977949e82cce]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:55:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:55:41 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[997f1617-a93a-44d0-9319-80bf6b3b7789]: (4, ('ok\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:55:41 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-9ba409dd-e85c-47e9-a72a-8db2f6c9222b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Flushing IO for device /dev/sdg {{(pid=74337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 21:55:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.012s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:55:41 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[55aa7958-c210-4459-97e1-3398a0a5e28f]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:55:41 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-9ba409dd-e85c-47e9-a72a-8db2f6c9222b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 21:55:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.032s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:55:41 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f7513d5-e389-48fe-b835-3977c3f41ad2]: (4, ('1', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:55:41 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-9ba409dd-e85c-47e9-a72a-8db2f6c9222b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 21:55:41 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-9ba409dd-e85c-47e9-a72a-8db2f6c9222b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] SCSI volumes sdg have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 21:55:41 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ba409dd-e85c-47e9-a72a-8db2f6c9222b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cbfd2bf8-a953-438a-a710-b4b32965d32b')] {{(pid=74337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 21:55:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbfd2bf8-a953-438a-a710-b4b32965d32b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbfd2bf8-a953-438a-a710-b4b32965d32b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:55:41 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b995cd99-49f4-4976-a0a4-567ac542a36d]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:55:41 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ba409dd-e85c-47e9-a72a-8db2f6c9222b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:55:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbfd2bf8-a953-438a-a710-b4b32965d32b -p 172.16.0.220:3260 --logout {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbfd2bf8-a953-438a-a710-b4b32965d32b -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:55:41 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d31c14-5951-4cba-814e-ccd7a3c46b19]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:cbfd2bf8-a953-438a-a710-b4b32965d32b, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:cbfd2bf8-a953-438a-a710-b4b32965d32b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:55:41 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ba409dd-e85c-47e9-a72a-8db2f6c9222b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:cbfd2bf8-a953-438a-a710-b4b32965d32b, portal: 172.16.0.220,3260]
Oct 23 21:55:41 user nova-compute[74337]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:cbfd2bf8-a953-438a-a710-b4b32965d32b, portal: 172.16.0.220,3260] successful.
Oct 23 21:55:41 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:55:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbfd2bf8-a953-438a-a710-b4b32965d32b -p 172.16.0.220:3260 --op delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbfd2bf8-a953-438a-a710-b4b32965d32b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:55:41 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[039d9dc0-1289-4cc3-863d-98185a78c56c]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:55:41 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ba409dd-e85c-47e9-a72a-8db2f6c9222b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:55:41 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-9ba409dd-e85c-47e9-a72a-8db2f6c9222b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:55:41 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ba409dd-e85c-47e9-a72a-8db2f6c9222b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] <== disconnect_volume: return (349ms) None {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:55:41 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ba409dd-e85c-47e9-a72a-8db2f6c9222b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: e326a14c-61d7-4dca-b55f-db0f3ab0d14e] Disconnected iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 21:55:42 user nova-compute[74337]: DEBUG nova.objects.instance [None req-9ba409dd-e85c-47e9-a72a-8db2f6c9222b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lazy-loading 'flavor' on Instance uuid e326a14c-61d7-4dca-b55f-db0f3ab0d14e {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:55:42 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-9ba409dd-e85c-47e9-a72a-8db2f6c9222b tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lock "e326a14c-61d7-4dca-b55f-db0f3ab0d14e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.820s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:55:43 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-943bde0d-8f1b-4db2-8052-e70a59b4a843 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Acquiring lock "e326a14c-61d7-4dca-b55f-db0f3ab0d14e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:55:43 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-943bde0d-8f1b-4db2-8052-e70a59b4a843 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lock "e326a14c-61d7-4dca-b55f-db0f3ab0d14e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:55:43 user nova-compute[74337]: INFO nova.compute.manager [None req-943bde0d-8f1b-4db2-8052-e70a59b4a843 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: e326a14c-61d7-4dca-b55f-db0f3ab0d14e] Detaching volume a8c65f7e-9e2c-4a26-bab4-70c7d1e6c118
Oct 23 21:55:43 user nova-compute[74337]: INFO nova.virt.block_device [None req-943bde0d-8f1b-4db2-8052-e70a59b4a843 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: e326a14c-61d7-4dca-b55f-db0f3ab0d14e] Attempting to driver detach volume a8c65f7e-9e2c-4a26-bab4-70c7d1e6c118 from mountpoint /dev/vdc
Oct 23 21:55:43 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-943bde0d-8f1b-4db2-8052-e70a59b4a843 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Attempting to detach device vdc from instance e326a14c-61d7-4dca-b55f-db0f3ab0d14e from the persistent domain config. {{(pid=74337) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 21:55:43 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-943bde0d-8f1b-4db2-8052-e70a59b4a843 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 21:55:43 user nova-compute[74337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 21:55:43 user nova-compute[74337]:   <source dev="/dev/sdi"/>
Oct 23 21:55:43 user nova-compute[74337]:   <target dev="vdc" bus="virtio"/>
Oct 23 21:55:43 user nova-compute[74337]:   <serial>a8c65f7e-9e2c-4a26-bab4-70c7d1e6c118</serial>
Oct 23 21:55:43 user nova-compute[74337]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 23 21:55:43 user nova-compute[74337]: </disk>
Oct 23 21:55:43 user nova-compute[74337]:  {{(pid=74337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 21:55:43 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-943bde0d-8f1b-4db2-8052-e70a59b4a843 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Successfully detached device vdc from instance e326a14c-61d7-4dca-b55f-db0f3ab0d14e from the persistent domain config.
Oct 23 21:55:43 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-943bde0d-8f1b-4db2-8052-e70a59b4a843 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance e326a14c-61d7-4dca-b55f-db0f3ab0d14e from the live domain config. {{(pid=74337) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 21:55:43 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-943bde0d-8f1b-4db2-8052-e70a59b4a843 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 21:55:43 user nova-compute[74337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 21:55:43 user nova-compute[74337]:   <source dev="/dev/sdi"/>
Oct 23 21:55:43 user nova-compute[74337]:   <target dev="vdc" bus="virtio"/>
Oct 23 21:55:43 user nova-compute[74337]:   <serial>a8c65f7e-9e2c-4a26-bab4-70c7d1e6c118</serial>
Oct 23 21:55:43 user nova-compute[74337]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 23 21:55:43 user nova-compute[74337]: </disk>
Oct 23 21:55:43 user nova-compute[74337]:  {{(pid=74337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 21:55:43 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:55:43 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-943bde0d-8f1b-4db2-8052-e70a59b4a843 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance e326a14c-61d7-4dca-b55f-db0f3ab0d14e {{(pid=74337) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 21:55:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:55:48 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:55:51 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:55:51 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Acquiring lock "d5d9d286-4837-4168-a4fe-1bc09e372654" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:55:51 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Lock "d5d9d286-4837-4168-a4fe-1bc09e372654" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:55:51 user nova-compute[74337]: INFO nova.compute.manager [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] Rebooting instance
Oct 23 21:55:51 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Acquiring lock "refresh_cache-d5d9d286-4837-4168-a4fe-1bc09e372654" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:55:51 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Acquired lock "refresh_cache-d5d9d286-4837-4168-a4fe-1bc09e372654" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:55:51 user nova-compute[74337]: DEBUG nova.network.neutron [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] Building network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 21:55:52 user nova-compute[74337]: DEBUG nova.network.neutron [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] Updating instance_info_cache with network_info: [{"id": "16ee3173-b704-43aa-9c44-ffa4d4d82fc4", "address": "fa:16:3e:be:e5:9b", "network": {"id": "0b1d82b0-acba-470e-aede-1c57a85a8ed3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1250228933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "965415a9973d4714aa49a64d34b232a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16ee3173-b7", "ovs_interfaceid": "16ee3173-b704-43aa-9c44-ffa4d4d82fc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:55:52 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Releasing lock "refresh_cache-d5d9d286-4837-4168-a4fe-1bc09e372654" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:55:52 user nova-compute[74337]: DEBUG nova.compute.manager [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] Checking state {{(pid=74337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 21:55:52 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:55:52 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:55:52 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:55:52 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:55:52 user nova-compute[74337]: DEBUG nova.compute.manager [req-eefdc6be-da85-46b0-9882-b45787be3f87 req-4cb02fa4-0db2-4262-a097-8931fd8fb280 service nova] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] Received event network-vif-unplugged-16ee3173-b704-43aa-9c44-ffa4d4d82fc4 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:55:52 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-eefdc6be-da85-46b0-9882-b45787be3f87 req-4cb02fa4-0db2-4262-a097-8931fd8fb280 service nova] Acquiring lock "d5d9d286-4837-4168-a4fe-1bc09e372654-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:55:52 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-eefdc6be-da85-46b0-9882-b45787be3f87 req-4cb02fa4-0db2-4262-a097-8931fd8fb280 service nova] Lock "d5d9d286-4837-4168-a4fe-1bc09e372654-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:55:52 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-eefdc6be-da85-46b0-9882-b45787be3f87 req-4cb02fa4-0db2-4262-a097-8931fd8fb280 service nova] Lock "d5d9d286-4837-4168-a4fe-1bc09e372654-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:55:52 user nova-compute[74337]: DEBUG nova.compute.manager [req-eefdc6be-da85-46b0-9882-b45787be3f87 req-4cb02fa4-0db2-4262-a097-8931fd8fb280 service nova] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] No waiting events found dispatching network-vif-unplugged-16ee3173-b704-43aa-9c44-ffa4d4d82fc4 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:55:52 user nova-compute[74337]: WARNING nova.compute.manager [req-eefdc6be-da85-46b0-9882-b45787be3f87 req-4cb02fa4-0db2-4262-a097-8931fd8fb280 service nova] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] Received unexpected event network-vif-unplugged-16ee3173-b704-43aa-9c44-ffa4d4d82fc4 for instance with vm_state active and task_state reboot_started_hard.
Oct 23 21:55:52 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] Instance destroyed successfully.
Oct 23 21:55:52 user nova-compute[74337]: DEBUG nova.objects.instance [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Lazy-loading 'resources' on Instance uuid d5d9d286-4837-4168-a4fe-1bc09e372654 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:55:52 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:53:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-748752527',display_name='tempest-TestMinimumBasicScenario-server-748752527',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-748752527',id=35,image_ref='c9f5f8ff-7674-48c5-a008-032e4795ab33',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIfLpXwFvySixQSBbn4nLlq9zjEg9GhMniy/7jo41PUhYLOeqBGONhSCnyTqv8kIiaxawNifBQnT0i1aAI0ZeKsMK+jJ6PrQUPzAQJ9WenGIpnoBC3sKUguIOqv2XtAxmQ==',key_name='tempest-TestMinimumBasicScenario-1876165380',keypairs=<?>,launch_index=0,launched_at=2023-10-23T21:53:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='965415a9973d4714aa49a64d34b232a6',ramdisk_id='',reservation_id='r-0zsuhsbg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c9f5f8ff-7674-48c5-a008-032e4795ab33',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-295529967',owner_user_name='tempest-TestMinimumBasicScenario-295529967-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T21:55:52Z,user_data=None,user_id='5a20c05457014209a86f285fcc9dd506',uuid=d5d9d286-4837-4168-a4fe-1bc09e372654,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "16ee3173-b704-43aa-9c44-ffa4d4d82fc4", "address": "fa:16:3e:be:e5:9b", "network": {"id": "0b1d82b0-acba-470e-aede-1c57a85a8ed3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1250228933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "965415a9973d4714aa49a64d34b232a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16ee3173-b7", "ovs_interfaceid": "16ee3173-b704-43aa-9c44-ffa4d4d82fc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 21:55:52 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Converting VIF {"id": "16ee3173-b704-43aa-9c44-ffa4d4d82fc4", "address": "fa:16:3e:be:e5:9b", "network": {"id": "0b1d82b0-acba-470e-aede-1c57a85a8ed3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1250228933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "965415a9973d4714aa49a64d34b232a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16ee3173-b7", "ovs_interfaceid": "16ee3173-b704-43aa-9c44-ffa4d4d82fc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:55:52 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:be:e5:9b,bridge_name='br-int',has_traffic_filtering=True,id=16ee3173-b704-43aa-9c44-ffa4d4d82fc4,network=Network(0b1d82b0-acba-470e-aede-1c57a85a8ed3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16ee3173-b7') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:55:52 user nova-compute[74337]: DEBUG os_vif [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:e5:9b,bridge_name='br-int',has_traffic_filtering=True,id=16ee3173-b704-43aa-9c44-ffa4d4d82fc4,network=Network(0b1d82b0-acba-470e-aede-1c57a85a8ed3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16ee3173-b7') {{(pid=74337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 21:55:52 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:55:52 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap16ee3173-b7, bridge=br-int, if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3de5bc72-c65d-4766-8127-f41e91783908) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:55:53 user nova-compute[74337]: INFO os_vif [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:e5:9b,bridge_name='br-int',has_traffic_filtering=True,id=16ee3173-b704-43aa-9c44-ffa4d4d82fc4,network=Network(0b1d82b0-acba-470e-aede-1c57a85a8ed3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16ee3173-b7')
Oct 23 21:55:53 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] calling os-brick to detach iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, {'target_iqn': 'iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QpXmROZJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': True}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:55:53 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:55:53 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[9be681b9-119b-4235-a99c-628aeaafe9ab]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a8c65f7e-9e2c-4a26-bab4-70c7d1e6c118\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 21:55:53 user nova-compute[74337]: No targets found.
Oct 23 21:55:53 user nova-compute[74337]: iSNS:
Oct 23 21:55:53 user nova-compute[74337]: No targets found.
Oct 23 21:55:53 user nova-compute[74337]: STATIC:
Oct 23 21:55:53 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83
Oct 23 21:55:53 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:55:53 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:55:53 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607
Oct 23 21:55:53 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:55:53 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:55:53 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4
Oct 23 21:55:53 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:55:53 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:55:53 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398
Oct 23 21:55:53 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:55:53 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:55:53 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:a8c65f7e-9e2c-4a26-bab4-70c7d1e6c118
Oct 23 21:55:53 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:55:53 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:55:53 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048
Oct 23 21:55:53 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:55:53 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:55:53 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7
Oct 23 21:55:53 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:55:53 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:55:53 user nova-compute[74337]: FIRMWARE:
Oct 23 21:55:53 user nova-compute[74337]: No targets found.
Oct 23 21:55:53 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 21:55:53 user nova-compute[74337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 21:55:53 user nova-compute[74337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7', 0)] {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5666432-1b04-42ca-9d37-abe0c83b777b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8c65f7e-9e2c-4a26-bab4-70c7d1e6c118\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[07198c59-2f17-4aac-8e07-a082d0a61574]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c65f7e-9e2c-4a26-bab4-70c7d1e6c118 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:55:53 user nova-compute[74337]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 (non-flash)
Oct 23 21:55:53 user nova-compute[74337]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 (non-flash)
Oct 23 21:55:53 user nova-compute[74337]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 (non-flash)
Oct 23 21:55:53 user nova-compute[74337]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607 (non-flash)
Oct 23 21:55:53 user nova-compute[74337]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c65f7e-9e2c-4a26-bab4-70c7d1e6c118 (non-flash)
Oct 23 21:55:53 user nova-compute[74337]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7 (non-flash)
Oct 23 21:55:53 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:55:53 user nova-compute[74337]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 (non-flash)
Oct 23 21:55:53 user nova-compute[74337]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 (non-flash)
Oct 23 21:55:53 user nova-compute[74337]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 (non-flash)
Oct 23 21:55:53 user nova-compute[74337]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607 (non-flash)
Oct 23 21:55:53 user nova-compute[74337]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c65f7e-9e2c-4a26-bab4-70c7d1e6c118 (non-flash)
Oct 23 21:55:53 user nova-compute[74337]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7 (non-flash)
Oct 23 21:55:53 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5eec7301f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7'): ({'sdj'}, set())}) {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Removing single pathed devices sdj {{(pid=74337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab9d20d8-3dec-45fa-9868-ac6e21d39adc]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[734213e1-8f60-45a8-a0dc-4ac72bac69a3]: (4, ('ok\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Flushing IO for device /dev/sdj {{(pid=74337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.012s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee2e4aa7-7d25-48b9-83f7-ce63bbbffeeb]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=74337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.048s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b27342-e770-4cda-84e6-20f8d0c256ed]: (4, ('1', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] SCSI volumes sdj have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7')] {{(pid=74337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ebfdf0-ffc5-428c-8223-e9f22299559c]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7 -p 172.16.0.220:3260 --logout {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[068472d2-33ab-4d2e-b883-5cc90ba00b88]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7, portal: 172.16.0.220,3260]
Oct 23 21:55:53 user nova-compute[74337]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7, portal: 172.16.0.220,3260] successful.
Oct 23 21:55:53 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7 -p 172.16.0.220:3260 --op delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe2b983d-2019-4927-9a56-ddee1692359d]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] <== disconnect_volume: return (323ms) None {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] Disconnected iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] Start _get_guest_xml network_info=[{"id": "16ee3173-b704-43aa-9c44-ffa4d4d82fc4", "address": "fa:16:3e:be:e5:9b", "network": {"id": "0b1d82b0-acba-470e-aede-1c57a85a8ed3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1250228933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "965415a9973d4714aa49a64d34b232a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16ee3173-b7", "ovs_interfaceid": "16ee3173-b704-43aa-9c44-ffa4d4d82fc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=c9f5f8ff-7674-48c5-a008-032e4795ab33,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'image_id': 'c9f5f8ff-7674-48c5-a008-032e4795ab33'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'd94e031e-6c58-4499-b70e-aeb226e0a989', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': None, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QpXmROZJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, 'status': 'reserved', 'instance': 'd5d9d286-4837-4168-a4fe-1bc09e372654', 'attached_at': '', 'detached_at': '', 'volume_id': 'f147349c-8434-4957-8f5f-ced11857d9b7', 'serial': 'f147349c-8434-4957-8f5f-ced11857d9b7'}, 'guest_format': None, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 21:55:53 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:55:53 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:55:53 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] CPU controller missing on host. {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] CPU controller found on host. {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T21:29:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=c9f5f8ff-7674-48c5-a008-032e4795ab33,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Flavor limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Image limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Flavor pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Image pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Got 1 possible topologies {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG nova.objects.instance [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Lazy-loading 'vcpu_model' on Instance uuid d5d9d286-4837-4168-a4fe-1bc09e372654 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG nova.objects.base [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Object Instance<d5d9d286-4837-4168-a4fe-1bc09e372654> lazy-loaded attributes: resources,vcpu_model {{(pid=74337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] Calling os-brick to attach iSCSI Volume {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QpXmROZJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:55:53 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:55:53 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:55:53 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:55:53 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:55:53 user nova-compute[74337]: INFO os_brick.initiator.connectors.iscsi [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 21:55:53 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7 -p 172.16.0.220:3260 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d92a60d-ff85-4ce9-9efc-259094e2c570]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 21:55:53 user nova-compute[74337]:  {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7 -p 172.16.0.220:3260 --interface default --op new {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a66c57-c215-4020-98d2-2f671ac9e334]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7] added\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7] added
Oct 23 21:55:53 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c60e16b6-0c41-4746-990b-3c68ea74ff83]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7694c71-f4a9-4281-b583-6c359c26b4f1]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QpXmROZJ {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QpXmROZJ" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[69fe54e6-4960-44b3-aecb-f2f5e276f364]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QpXmROZJ'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b92ada-6505-403b-81f4-3cc3f64dbe6a]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac082d1-d301-46ab-9300-ae661bbabce5]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c65f7e-9e2c-4a26-bab4-70c7d1e6c118 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:55:53 user nova-compute[74337]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 (non-flash)
Oct 23 21:55:53 user nova-compute[74337]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 (non-flash)
Oct 23 21:55:53 user nova-compute[74337]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 (non-flash)
Oct 23 21:55:53 user nova-compute[74337]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607 (non-flash)
Oct 23 21:55:53 user nova-compute[74337]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c65f7e-9e2c-4a26-bab4-70c7d1e6c118 (non-flash)
Oct 23 21:55:53 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:55:53 user nova-compute[74337]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 (non-flash)
Oct 23 21:55:53 user nova-compute[74337]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 (non-flash)
Oct 23 21:55:53 user nova-compute[74337]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 (non-flash)
Oct 23 21:55:53 user nova-compute[74337]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607 (non-flash)
Oct 23 21:55:53 user nova-compute[74337]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c65f7e-9e2c-4a26-bab4-70c7d1e6c118 (non-flash)
Oct 23 21:55:53 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7 -p 172.16.0.220:3260 --login {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d05edb6d-1b30-468a-ac84-890ea4ee5750]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7, portal: 172.16.0.220,3260]
Oct 23 21:55:53 user nova-compute[74337]: Login to [iface: default, target: iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7, portal: 172.16.0.220,3260] successful.
Oct 23 21:55:53 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de3c6d2-0fc0-46fa-a211-4250b7ecf50e]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc110bf3-266a-4fa3-9efa-da61ea0d80bb]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c65f7e-9e2c-4a26-bab4-70c7d1e6c118 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:55:53 user nova-compute[74337]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 (non-flash)
Oct 23 21:55:53 user nova-compute[74337]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 (non-flash)
Oct 23 21:55:53 user nova-compute[74337]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 (non-flash)
Oct 23 21:55:53 user nova-compute[74337]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607 (non-flash)
Oct 23 21:55:53 user nova-compute[74337]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c65f7e-9e2c-4a26-bab4-70c7d1e6c118 (non-flash)
Oct 23 21:55:53 user nova-compute[74337]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7 (non-flash)
Oct 23 21:55:53 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:55:53 user nova-compute[74337]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 (non-flash)
Oct 23 21:55:53 user nova-compute[74337]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 (non-flash)
Oct 23 21:55:53 user nova-compute[74337]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 (non-flash)
Oct 23 21:55:53 user nova-compute[74337]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607 (non-flash)
Oct 23 21:55:53 user nova-compute[74337]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c65f7e-9e2c-4a26-bab4-70c7d1e6c118 (non-flash)
Oct 23 21:55:53 user nova-compute[74337]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7 (non-flash)
Oct 23 21:55:53 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Connected to 172.16.0.220:3260 {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] HCTL ('38', '-', '-', 0) found on session 42 with lun 0 {{(pid=74337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.022s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f8b38d-e873-41c7-80ff-ed321771e6ba]: (4, ('- - 0', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Searching for a device in session 42 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QpXmROZJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 21:55:53 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:55:54 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-e298fad1-02c7-4aeb-81a5-e4e6abd314b4 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Acquiring lock "86b0f8cc-bfec-42f2-b8cf-29f0603e3169" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:55:54 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-e298fad1-02c7-4aeb-81a5-e4e6abd314b4 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lock "86b0f8cc-bfec-42f2-b8cf-29f0603e3169" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:55:54 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-e298fad1-02c7-4aeb-81a5-e4e6abd314b4 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Acquiring lock "86b0f8cc-bfec-42f2-b8cf-29f0603e3169-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:55:54 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-e298fad1-02c7-4aeb-81a5-e4e6abd314b4 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lock "86b0f8cc-bfec-42f2-b8cf-29f0603e3169-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:55:54 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-e298fad1-02c7-4aeb-81a5-e4e6abd314b4 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lock "86b0f8cc-bfec-42f2-b8cf-29f0603e3169-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:55:54 user nova-compute[74337]: INFO nova.compute.manager [None req-e298fad1-02c7-4aeb-81a5-e4e6abd314b4 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 86b0f8cc-bfec-42f2-b8cf-29f0603e3169] Terminating instance
Oct 23 21:55:54 user nova-compute[74337]: DEBUG nova.compute.manager [None req-e298fad1-02c7-4aeb-81a5-e4e6abd314b4 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 86b0f8cc-bfec-42f2-b8cf-29f0603e3169] Start destroying the instance on the hypervisor. {{(pid=74337) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 21:55:54 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.358s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:55:54 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] <== connect_volume: return (1359ms) {'type': 'block', 'scsi_wwn': '26534353139306130', 'path': '/dev/sdg'} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:55:54 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26534353139306130', 'path': '/dev/sdg'} {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 21:55:54 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:55:54 user nova-compute[74337]: DEBUG nova.compute.manager [req-524bc0ee-60c4-48ed-b366-f6cd39f8a69c req-8dce7307-8a29-4d79-aa99-83b47536ebe6 service nova] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] Received event network-vif-plugged-16ee3173-b704-43aa-9c44-ffa4d4d82fc4 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:55:54 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-524bc0ee-60c4-48ed-b366-f6cd39f8a69c req-8dce7307-8a29-4d79-aa99-83b47536ebe6 service nova] Acquiring lock "d5d9d286-4837-4168-a4fe-1bc09e372654-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:55:54 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-524bc0ee-60c4-48ed-b366-f6cd39f8a69c req-8dce7307-8a29-4d79-aa99-83b47536ebe6 service nova] Lock "d5d9d286-4837-4168-a4fe-1bc09e372654-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:55:54 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-524bc0ee-60c4-48ed-b366-f6cd39f8a69c req-8dce7307-8a29-4d79-aa99-83b47536ebe6 service nova] Lock "d5d9d286-4837-4168-a4fe-1bc09e372654-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:55:54 user nova-compute[74337]: DEBUG nova.compute.manager [req-524bc0ee-60c4-48ed-b366-f6cd39f8a69c req-8dce7307-8a29-4d79-aa99-83b47536ebe6 service nova] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] No waiting events found dispatching network-vif-plugged-16ee3173-b704-43aa-9c44-ffa4d4d82fc4 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:55:54 user nova-compute[74337]: WARNING nova.compute.manager [req-524bc0ee-60c4-48ed-b366-f6cd39f8a69c req-8dce7307-8a29-4d79-aa99-83b47536ebe6 service nova] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] Received unexpected event network-vif-plugged-16ee3173-b704-43aa-9c44-ffa4d4d82fc4 for instance with vm_state active and task_state reboot_started_hard.
Oct 23 21:55:54 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:55:54 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:55:54 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:53:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-748752527',display_name='tempest-TestMinimumBasicScenario-server-748752527',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-748752527',id=35,image_ref='c9f5f8ff-7674-48c5-a008-032e4795ab33',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIfLpXwFvySixQSBbn4nLlq9zjEg9GhMniy/7jo41PUhYLOeqBGONhSCnyTqv8kIiaxawNifBQnT0i1aAI0ZeKsMK+jJ6PrQUPzAQJ9WenGIpnoBC3sKUguIOqv2XtAxmQ==',key_name='tempest-TestMinimumBasicScenario-1876165380',keypairs=<?>,launch_index=0,launched_at=2023-10-23T21:53:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='965415a9973d4714aa49a64d34b232a6',ramdisk_id='',reservation_id='r-0zsuhsbg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c9f5f8ff-7674-48c5-a008-032e4795ab33',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-295529967',owner_user_name='tempest-TestMinimumBasicScenario-295529967-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T21:55:52Z,user_data=None,user_id='5a20c05457014209a86f285fcc9dd506',uuid=d5d9d286-4837-4168-a4fe-1bc09e372654,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "16ee3173-b704-43aa-9c44-ffa4d4d82fc4", "address": "fa:16:3e:be:e5:9b", "network": {"id": "0b1d82b0-acba-470e-aede-1c57a85a8ed3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1250228933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "965415a9973d4714aa49a64d34b232a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16ee3173-b7", "ovs_interfaceid": "16ee3173-b704-43aa-9c44-ffa4d4d82fc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 21:55:54 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Converting VIF {"id": "16ee3173-b704-43aa-9c44-ffa4d4d82fc4", "address": "fa:16:3e:be:e5:9b", "network": {"id": "0b1d82b0-acba-470e-aede-1c57a85a8ed3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1250228933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "965415a9973d4714aa49a64d34b232a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16ee3173-b7", "ovs_interfaceid": "16ee3173-b704-43aa-9c44-ffa4d4d82fc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:55:54 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:be:e5:9b,bridge_name='br-int',has_traffic_filtering=True,id=16ee3173-b704-43aa-9c44-ffa4d4d82fc4,network=Network(0b1d82b0-acba-470e-aede-1c57a85a8ed3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16ee3173-b7') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:55:54 user nova-compute[74337]: DEBUG nova.objects.instance [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Lazy-loading 'pci_devices' on Instance uuid d5d9d286-4837-4168-a4fe-1bc09e372654 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:55:54 user nova-compute[74337]: DEBUG nova.objects.base [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Object Instance<d5d9d286-4837-4168-a4fe-1bc09e372654> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=74337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 21:55:54 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] End _get_guest_xml xml=<domain type="kvm">
Oct 23 21:55:54 user nova-compute[74337]:   <uuid>d5d9d286-4837-4168-a4fe-1bc09e372654</uuid>
Oct 23 21:55:54 user nova-compute[74337]:   <name>instance-00000023</name>
Oct 23 21:55:54 user nova-compute[74337]:   <memory>524288</memory>
Oct 23 21:55:54 user nova-compute[74337]:   <vcpu>1</vcpu>
Oct 23 21:55:54 user nova-compute[74337]:   <metadata>
Oct 23 21:55:54 user nova-compute[74337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 21:55:54 user nova-compute[74337]:       <nova:package version="0.0.0"/>
Oct 23 21:55:54 user nova-compute[74337]:       <nova:name>tempest-TestMinimumBasicScenario-server-748752527</nova:name>
Oct 23 21:55:54 user nova-compute[74337]:       <nova:creationTime>2023-10-23 21:55:53</nova:creationTime>
Oct 23 21:55:54 user nova-compute[74337]:       <nova:flavor name="m1.tiny">
Oct 23 21:55:54 user nova-compute[74337]:         <nova:memory>512</nova:memory>
Oct 23 21:55:54 user nova-compute[74337]:         <nova:disk>1</nova:disk>
Oct 23 21:55:54 user nova-compute[74337]:         <nova:swap>0</nova:swap>
Oct 23 21:55:54 user nova-compute[74337]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 21:55:54 user nova-compute[74337]:         <nova:vcpus>1</nova:vcpus>
Oct 23 21:55:54 user nova-compute[74337]:       </nova:flavor>
Oct 23 21:55:54 user nova-compute[74337]:       <nova:owner>
Oct 23 21:55:54 user nova-compute[74337]:         <nova:user uuid="5a20c05457014209a86f285fcc9dd506">tempest-TestMinimumBasicScenario-295529967-project-member</nova:user>
Oct 23 21:55:54 user nova-compute[74337]:         <nova:project uuid="965415a9973d4714aa49a64d34b232a6">tempest-TestMinimumBasicScenario-295529967</nova:project>
Oct 23 21:55:54 user nova-compute[74337]:       </nova:owner>
Oct 23 21:55:54 user nova-compute[74337]:       <nova:root type="image" uuid="c9f5f8ff-7674-48c5-a008-032e4795ab33"/>
Oct 23 21:55:54 user nova-compute[74337]:       <nova:ports>
Oct 23 21:55:54 user nova-compute[74337]:         <nova:port uuid="16ee3173-b704-43aa-9c44-ffa4d4d82fc4">
Oct 23 21:55:54 user nova-compute[74337]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 23 21:55:54 user nova-compute[74337]:         </nova:port>
Oct 23 21:55:54 user nova-compute[74337]:       </nova:ports>
Oct 23 21:55:54 user nova-compute[74337]:     </nova:instance>
Oct 23 21:55:54 user nova-compute[74337]:   </metadata>
Oct 23 21:55:54 user nova-compute[74337]:   <sysinfo type="smbios">
Oct 23 21:55:54 user nova-compute[74337]:     <system>
Oct 23 21:55:54 user nova-compute[74337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 21:55:54 user nova-compute[74337]:       <entry name="product">OpenStack Nova</entry>
Oct 23 21:55:54 user nova-compute[74337]:       <entry name="version">0.0.0</entry>
Oct 23 21:55:54 user nova-compute[74337]:       <entry name="serial">d5d9d286-4837-4168-a4fe-1bc09e372654</entry>
Oct 23 21:55:54 user nova-compute[74337]:       <entry name="uuid">d5d9d286-4837-4168-a4fe-1bc09e372654</entry>
Oct 23 21:55:54 user nova-compute[74337]:       <entry name="family">Virtual Machine</entry>
Oct 23 21:55:54 user nova-compute[74337]:     </system>
Oct 23 21:55:54 user nova-compute[74337]:   </sysinfo>
Oct 23 21:55:54 user nova-compute[74337]:   <os>
Oct 23 21:55:54 user nova-compute[74337]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 21:55:54 user nova-compute[74337]:     <boot dev="hd"/>
Oct 23 21:55:54 user nova-compute[74337]:     <smbios mode="sysinfo"/>
Oct 23 21:55:54 user nova-compute[74337]:   </os>
Oct 23 21:55:54 user nova-compute[74337]:   <features>
Oct 23 21:55:54 user nova-compute[74337]:     <acpi/>
Oct 23 21:55:54 user nova-compute[74337]:     <apic/>
Oct 23 21:55:54 user nova-compute[74337]:     <vmcoreinfo/>
Oct 23 21:55:54 user nova-compute[74337]:   </features>
Oct 23 21:55:54 user nova-compute[74337]:   <clock offset="utc">
Oct 23 21:55:54 user nova-compute[74337]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 21:55:54 user nova-compute[74337]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 21:55:54 user nova-compute[74337]:     <timer name="hpet" present="no"/>
Oct 23 21:55:54 user nova-compute[74337]:   </clock>
Oct 23 21:55:54 user nova-compute[74337]:   <cpu mode="custom" match="exact">
Oct 23 21:55:54 user nova-compute[74337]:     <model>Nehalem</model>
Oct 23 21:55:54 user nova-compute[74337]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 21:55:54 user nova-compute[74337]:   </cpu>
Oct 23 21:55:54 user nova-compute[74337]:   <devices>
Oct 23 21:55:54 user nova-compute[74337]:     <disk type="file" device="disk">
Oct 23 21:55:54 user nova-compute[74337]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 21:55:54 user nova-compute[74337]:       <source file="/opt/stack/data/nova/instances/d5d9d286-4837-4168-a4fe-1bc09e372654/disk"/>
Oct 23 21:55:54 user nova-compute[74337]:       <target dev="vda" bus="virtio"/>
Oct 23 21:55:54 user nova-compute[74337]:     </disk>
Oct 23 21:55:54 user nova-compute[74337]:     <disk type="block" device="disk">
Oct 23 21:55:54 user nova-compute[74337]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 21:55:54 user nova-compute[74337]:       <source dev="/dev/sdg"/>
Oct 23 21:55:54 user nova-compute[74337]:       <target dev="vdb" bus="virtio"/>
Oct 23 21:55:54 user nova-compute[74337]:       <serial>f147349c-8434-4957-8f5f-ced11857d9b7</serial>
Oct 23 21:55:54 user nova-compute[74337]:     </disk>
Oct 23 21:55:54 user nova-compute[74337]:     <interface type="ethernet">
Oct 23 21:55:54 user nova-compute[74337]:       <mac address="fa:16:3e:be:e5:9b"/>
Oct 23 21:55:54 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:55:54 user nova-compute[74337]:       <mtu size="1442"/>
Oct 23 21:55:54 user nova-compute[74337]:       <target dev="tap16ee3173-b7"/>
Oct 23 21:55:54 user nova-compute[74337]:     </interface>
Oct 23 21:55:54 user nova-compute[74337]:     <serial type="pty">
Oct 23 21:55:54 user nova-compute[74337]:       <log file="/opt/stack/data/nova/instances/d5d9d286-4837-4168-a4fe-1bc09e372654/console.log" append="off"/>
Oct 23 21:55:54 user nova-compute[74337]:     </serial>
Oct 23 21:55:54 user nova-compute[74337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 21:55:54 user nova-compute[74337]:     <video>
Oct 23 21:55:54 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:55:54 user nova-compute[74337]:     </video>
Oct 23 21:55:54 user nova-compute[74337]:     <rng model="virtio">
Oct 23 21:55:54 user nova-compute[74337]:       <backend model="random">/dev/urandom</backend>
Oct 23 21:55:54 user nova-compute[74337]:     </rng>
Oct 23 21:55:54 user nova-compute[74337]:     <controller type="usb" index="0" model="none"/>
Oct 23 21:55:54 user nova-compute[74337]:     <memballoon model="virtio">
Oct 23 21:55:54 user nova-compute[74337]:       <stats period="10"/>
Oct 23 21:55:54 user nova-compute[74337]:     </memballoon>
Oct 23 21:55:54 user nova-compute[74337]:   </devices>
Oct 23 21:55:54 user nova-compute[74337]: </domain>
Oct 23 21:55:54 user nova-compute[74337]:  {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 21:55:54 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5d9d286-4837-4168-a4fe-1bc09e372654/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:54 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:55:55 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5d9d286-4837-4168-a4fe-1bc09e372654/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:55:55 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5d9d286-4837-4168-a4fe-1bc09e372654/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:55 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5d9d286-4837-4168-a4fe-1bc09e372654/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:55:55 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=74337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 21:55:55 user nova-compute[74337]: DEBUG nova.objects.instance [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Lazy-loading 'trusted_certs' on Instance uuid d5d9d286-4837-4168-a4fe-1bc09e372654 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:55:55 user nova-compute[74337]: DEBUG nova.objects.base [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Object Instance<d5d9d286-4837-4168-a4fe-1bc09e372654> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=74337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 21:55:55 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/746adc44036d2a3e69d18431dbb1bdef949c3377 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:55 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/746adc44036d2a3e69d18431dbb1bdef949c3377 --force-share --output=json" returned: 0 in 0.169s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:55:55 user nova-compute[74337]: DEBUG nova.virt.disk.api [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d5d9d286-4837-4168-a4fe-1bc09e372654/disk. size=1073741824 {{(pid=74337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 21:55:55 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5d9d286-4837-4168-a4fe-1bc09e372654/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:55 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: 86b0f8cc-bfec-42f2-b8cf-29f0603e3169] Instance destroyed successfully.
Oct 23 21:55:55 user nova-compute[74337]: DEBUG nova.objects.instance [None req-e298fad1-02c7-4aeb-81a5-e4e6abd314b4 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lazy-loading 'resources' on Instance uuid 86b0f8cc-bfec-42f2-b8cf-29f0603e3169 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:55:55 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-e298fad1-02c7-4aeb-81a5-e4e6abd314b4 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:52:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1857992921',display_name='tempest-AttachVolumeNegativeTest-server-1857992921',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1857992921',id=34,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPk7BXXviQFk5M/2s3TeGeWZY/1ACAKpZBqvVMSbxL1/53JpQUgv7qrx/p22+KxK95XhL7hD8F2ndAxHcNa8fTJNItqcCjR3czlGUcmVpDTFiEMMCKefX/a82Ei4joAJhg==',key_name='tempest-keypair-1021732166',keypairs=<?>,launch_index=0,launched_at=2023-10-23T21:52:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='84a25b3eed8548a5a324e55b28f26252',ramdisk_id='',reservation_id='r-ic4s47yq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1446109887',owner_user_name='tempest-AttachVolumeNegativeTest-1446109887-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T21:52:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6f6daa6653264905a5498e00f184080c',uuid=86b0f8cc-bfec-42f2-b8cf-29f0603e3169,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6a452d69-92a5-408b-a63e-c9a1d8501656", "address": "fa:16:3e:bf:09:19", "network": {"id": "787d9979-63ad-4318-b1d7-8ec69c5969fe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1847253864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84a25b3eed8548a5a324e55b28f26252", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a452d69-92", "ovs_interfaceid": "6a452d69-92a5-408b-a63e-c9a1d8501656", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 21:55:55 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-e298fad1-02c7-4aeb-81a5-e4e6abd314b4 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Converting VIF {"id": "6a452d69-92a5-408b-a63e-c9a1d8501656", "address": "fa:16:3e:bf:09:19", "network": {"id": "787d9979-63ad-4318-b1d7-8ec69c5969fe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1847253864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84a25b3eed8548a5a324e55b28f26252", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a452d69-92", "ovs_interfaceid": "6a452d69-92a5-408b-a63e-c9a1d8501656", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:55:55 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-e298fad1-02c7-4aeb-81a5-e4e6abd314b4 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bf:09:19,bridge_name='br-int',has_traffic_filtering=True,id=6a452d69-92a5-408b-a63e-c9a1d8501656,network=Network(787d9979-63ad-4318-b1d7-8ec69c5969fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a452d69-92') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:55:55 user nova-compute[74337]: DEBUG os_vif [None req-e298fad1-02c7-4aeb-81a5-e4e6abd314b4 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bf:09:19,bridge_name='br-int',has_traffic_filtering=True,id=6a452d69-92a5-408b-a63e-c9a1d8501656,network=Network(787d9979-63ad-4318-b1d7-8ec69c5969fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a452d69-92') {{(pid=74337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 21:55:55 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:55:55 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6a452d69-92, bridge=br-int, if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:55:55 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:55:55 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:55:55 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:55:55 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=27f78bee-8622-498d-8908-adbcb32df789) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:55:55 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:55:55 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:55:55 user nova-compute[74337]: INFO os_vif [None req-e298fad1-02c7-4aeb-81a5-e4e6abd314b4 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bf:09:19,bridge_name='br-int',has_traffic_filtering=True,id=6a452d69-92a5-408b-a63e-c9a1d8501656,network=Network(787d9979-63ad-4318-b1d7-8ec69c5969fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a452d69-92')
Oct 23 21:55:55 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-e298fad1-02c7-4aeb-81a5-e4e6abd314b4 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 86b0f8cc-bfec-42f2-b8cf-29f0603e3169] Deleting instance files /opt/stack/data/nova/instances/86b0f8cc-bfec-42f2-b8cf-29f0603e3169_del
Oct 23 21:55:55 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-e298fad1-02c7-4aeb-81a5-e4e6abd314b4 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 86b0f8cc-bfec-42f2-b8cf-29f0603e3169] Deletion of /opt/stack/data/nova/instances/86b0f8cc-bfec-42f2-b8cf-29f0603e3169_del complete
Oct 23 21:55:55 user nova-compute[74337]: INFO nova.compute.manager [None req-e298fad1-02c7-4aeb-81a5-e4e6abd314b4 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] [instance: 86b0f8cc-bfec-42f2-b8cf-29f0603e3169] Took 0.88 seconds to destroy the instance on the hypervisor.
Oct 23 21:55:55 user nova-compute[74337]: DEBUG oslo.service.loopingcall [None req-e298fad1-02c7-4aeb-81a5-e4e6abd314b4 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74337) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 21:55:55 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5d9d286-4837-4168-a4fe-1bc09e372654/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:55:55 user nova-compute[74337]: DEBUG nova.compute.manager [-] [instance: 86b0f8cc-bfec-42f2-b8cf-29f0603e3169] Deallocating network for instance {{(pid=74337) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 21:55:55 user nova-compute[74337]: DEBUG nova.network.neutron [-] [instance: 86b0f8cc-bfec-42f2-b8cf-29f0603e3169] deallocate_for_instance() {{(pid=74337) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 21:55:55 user nova-compute[74337]: DEBUG nova.virt.disk.api [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Cannot resize image /opt/stack/data/nova/instances/d5d9d286-4837-4168-a4fe-1bc09e372654/disk to a smaller size. {{(pid=74337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 21:55:55 user nova-compute[74337]: DEBUG nova.objects.instance [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Lazy-loading 'migration_context' on Instance uuid d5d9d286-4837-4168-a4fe-1bc09e372654 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:55:55 user nova-compute[74337]: DEBUG nova.objects.base [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Object Instance<d5d9d286-4837-4168-a4fe-1bc09e372654> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 21:55:55 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:53:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-748752527',display_name='tempest-TestMinimumBasicScenario-server-748752527',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-748752527',id=35,image_ref='c9f5f8ff-7674-48c5-a008-032e4795ab33',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIfLpXwFvySixQSBbn4nLlq9zjEg9GhMniy/7jo41PUhYLOeqBGONhSCnyTqv8kIiaxawNifBQnT0i1aAI0ZeKsMK+jJ6PrQUPzAQJ9WenGIpnoBC3sKUguIOqv2XtAxmQ==',key_name='tempest-TestMinimumBasicScenario-1876165380',keypairs=<?>,launch_index=0,launched_at=2023-10-23T21:53:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='965415a9973d4714aa49a64d34b232a6',ramdisk_id='',reservation_id='r-0zsuhsbg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c9f5f8ff-7674-48c5-a008-032e4795ab33',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-295529967',owner_user_name='tempest-TestMinimumBasicScenario-295529967-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:55:52Z,user_data=None,user_id='5a20c05457014209a86f285fcc9dd506',uuid=d5d9d286-4837-4168-a4fe-1bc09e372654,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "16ee3173-b704-43aa-9c44-ffa4d4d82fc4", "address": "fa:16:3e:be:e5:9b", "network": {"id": "0b1d82b0-acba-470e-aede-1c57a85a8ed3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1250228933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "965415a9973d4714aa49a64d34b232a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16ee3173-b7", "ovs_interfaceid": "16ee3173-b704-43aa-9c44-ffa4d4d82fc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 21:55:55 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Converting VIF {"id": "16ee3173-b704-43aa-9c44-ffa4d4d82fc4", "address": "fa:16:3e:be:e5:9b", "network": {"id": "0b1d82b0-acba-470e-aede-1c57a85a8ed3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1250228933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "965415a9973d4714aa49a64d34b232a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16ee3173-b7", "ovs_interfaceid": "16ee3173-b704-43aa-9c44-ffa4d4d82fc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:55:55 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:be:e5:9b,bridge_name='br-int',has_traffic_filtering=True,id=16ee3173-b704-43aa-9c44-ffa4d4d82fc4,network=Network(0b1d82b0-acba-470e-aede-1c57a85a8ed3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16ee3173-b7') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:55:55 user nova-compute[74337]: DEBUG os_vif [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:e5:9b,bridge_name='br-int',has_traffic_filtering=True,id=16ee3173-b704-43aa-9c44-ffa4d4d82fc4,network=Network(0b1d82b0-acba-470e-aede-1c57a85a8ed3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16ee3173-b7') {{(pid=74337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 21:55:55 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:55:55 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:55:55 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 21:55:55 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:55:55 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '76681141-86b8-5622-82d6-ffcd2ff32ebb', '_type': 'linux-noop'}}, row=False) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:55:55 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:55:55 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:55:55 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:55:55 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap16ee3173-b7, may_exist=True, interface_attrs={}) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:55:55 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap16ee3173-b7, col_values=(('qos', UUID('48ce7b2b-5a41-4845-9d99-267cfe84a0ef')),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:55:55 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap16ee3173-b7, col_values=(('external_ids', {'iface-id': '16ee3173-b704-43aa-9c44-ffa4d4d82fc4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:be:e5:9b', 'vm-uuid': 'd5d9d286-4837-4168-a4fe-1bc09e372654'}),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:55:55 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:55:55 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:55:55 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:55:55 user nova-compute[74337]: INFO os_vif [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:e5:9b,bridge_name='br-int',has_traffic_filtering=True,id=16ee3173-b704-43aa-9c44-ffa4d4d82fc4,network=Network(0b1d82b0-acba-470e-aede-1c57a85a8ed3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16ee3173-b7')
Oct 23 21:55:56 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-959c367c-cde0-4a78-bd87-5b733e1ec0c9 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Acquiring lock "bf53e0fc-71d1-48fa-b0b4-ed3400a21c38" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:55:56 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-959c367c-cde0-4a78-bd87-5b733e1ec0c9 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lock "bf53e0fc-71d1-48fa-b0b4-ed3400a21c38" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:55:56 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-959c367c-cde0-4a78-bd87-5b733e1ec0c9 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Acquiring lock "bf53e0fc-71d1-48fa-b0b4-ed3400a21c38-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:55:56 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-959c367c-cde0-4a78-bd87-5b733e1ec0c9 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lock "bf53e0fc-71d1-48fa-b0b4-ed3400a21c38-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:55:56 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-959c367c-cde0-4a78-bd87-5b733e1ec0c9 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lock "bf53e0fc-71d1-48fa-b0b4-ed3400a21c38-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:55:56 user nova-compute[74337]: INFO nova.compute.manager [None req-959c367c-cde0-4a78-bd87-5b733e1ec0c9 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] Terminating instance
Oct 23 21:55:56 user nova-compute[74337]: DEBUG nova.compute.manager [None req-959c367c-cde0-4a78-bd87-5b733e1ec0c9 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] Start destroying the instance on the hypervisor. {{(pid=74337) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 21:55:56 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:55:56 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:55:56 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:55:56 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:55:56 user nova-compute[74337]: DEBUG nova.compute.manager [req-07d815ce-cfb3-4fdb-ab6c-d74368275408 req-8e3c8c5c-f2ed-4a22-adfa-64dbbe3c9796 service nova] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] Received event network-vif-unplugged-d8fa8fea-2adc-42e9-9d0c-cbcbfe43db80 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:55:56 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-07d815ce-cfb3-4fdb-ab6c-d74368275408 req-8e3c8c5c-f2ed-4a22-adfa-64dbbe3c9796 service nova] Acquiring lock "bf53e0fc-71d1-48fa-b0b4-ed3400a21c38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:55:56 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-07d815ce-cfb3-4fdb-ab6c-d74368275408 req-8e3c8c5c-f2ed-4a22-adfa-64dbbe3c9796 service nova] Lock "bf53e0fc-71d1-48fa-b0b4-ed3400a21c38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:55:56 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-07d815ce-cfb3-4fdb-ab6c-d74368275408 req-8e3c8c5c-f2ed-4a22-adfa-64dbbe3c9796 service nova] Lock "bf53e0fc-71d1-48fa-b0b4-ed3400a21c38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:55:56 user nova-compute[74337]: DEBUG nova.compute.manager [req-07d815ce-cfb3-4fdb-ab6c-d74368275408 req-8e3c8c5c-f2ed-4a22-adfa-64dbbe3c9796 service nova] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] No waiting events found dispatching network-vif-unplugged-d8fa8fea-2adc-42e9-9d0c-cbcbfe43db80 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:55:56 user nova-compute[74337]: DEBUG nova.compute.manager [req-07d815ce-cfb3-4fdb-ab6c-d74368275408 req-8e3c8c5c-f2ed-4a22-adfa-64dbbe3c9796 service nova] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] Received event network-vif-unplugged-d8fa8fea-2adc-42e9-9d0c-cbcbfe43db80 for instance with task_state deleting. {{(pid=74337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 21:55:56 user nova-compute[74337]: DEBUG nova.network.neutron [-] [instance: 86b0f8cc-bfec-42f2-b8cf-29f0603e3169] Updating instance_info_cache with network_info: [] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:55:56 user nova-compute[74337]: INFO nova.compute.manager [-] [instance: 86b0f8cc-bfec-42f2-b8cf-29f0603e3169] Took 1.23 seconds to deallocate network for instance.
Oct 23 21:55:56 user nova-compute[74337]: DEBUG nova.compute.manager [req-ac3ba83e-538f-49c2-ae41-bea125a3b81d req-f2669ed1-50b6-416f-9586-1ac4a2497f06 service nova] [instance: 86b0f8cc-bfec-42f2-b8cf-29f0603e3169] Received event network-vif-unplugged-6a452d69-92a5-408b-a63e-c9a1d8501656 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:55:56 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ac3ba83e-538f-49c2-ae41-bea125a3b81d req-f2669ed1-50b6-416f-9586-1ac4a2497f06 service nova] Acquiring lock "86b0f8cc-bfec-42f2-b8cf-29f0603e3169-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:55:56 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ac3ba83e-538f-49c2-ae41-bea125a3b81d req-f2669ed1-50b6-416f-9586-1ac4a2497f06 service nova] Lock "86b0f8cc-bfec-42f2-b8cf-29f0603e3169-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:55:56 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ac3ba83e-538f-49c2-ae41-bea125a3b81d req-f2669ed1-50b6-416f-9586-1ac4a2497f06 service nova] Lock "86b0f8cc-bfec-42f2-b8cf-29f0603e3169-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:55:56 user nova-compute[74337]: DEBUG nova.compute.manager [req-ac3ba83e-538f-49c2-ae41-bea125a3b81d req-f2669ed1-50b6-416f-9586-1ac4a2497f06 service nova] [instance: 86b0f8cc-bfec-42f2-b8cf-29f0603e3169] No waiting events found dispatching network-vif-unplugged-6a452d69-92a5-408b-a63e-c9a1d8501656 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:55:56 user nova-compute[74337]: DEBUG nova.compute.manager [req-ac3ba83e-538f-49c2-ae41-bea125a3b81d req-f2669ed1-50b6-416f-9586-1ac4a2497f06 service nova] [instance: 86b0f8cc-bfec-42f2-b8cf-29f0603e3169] Received event network-vif-unplugged-6a452d69-92a5-408b-a63e-c9a1d8501656 for instance with task_state deleting. {{(pid=74337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 21:55:56 user nova-compute[74337]: DEBUG nova.compute.manager [req-ac3ba83e-538f-49c2-ae41-bea125a3b81d req-f2669ed1-50b6-416f-9586-1ac4a2497f06 service nova] [instance: 86b0f8cc-bfec-42f2-b8cf-29f0603e3169] Received event network-vif-plugged-6a452d69-92a5-408b-a63e-c9a1d8501656 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:55:56 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ac3ba83e-538f-49c2-ae41-bea125a3b81d req-f2669ed1-50b6-416f-9586-1ac4a2497f06 service nova] Acquiring lock "86b0f8cc-bfec-42f2-b8cf-29f0603e3169-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:55:56 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ac3ba83e-538f-49c2-ae41-bea125a3b81d req-f2669ed1-50b6-416f-9586-1ac4a2497f06 service nova] Lock "86b0f8cc-bfec-42f2-b8cf-29f0603e3169-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:55:56 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ac3ba83e-538f-49c2-ae41-bea125a3b81d req-f2669ed1-50b6-416f-9586-1ac4a2497f06 service nova] Lock "86b0f8cc-bfec-42f2-b8cf-29f0603e3169-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:55:56 user nova-compute[74337]: DEBUG nova.compute.manager [req-ac3ba83e-538f-49c2-ae41-bea125a3b81d req-f2669ed1-50b6-416f-9586-1ac4a2497f06 service nova] [instance: 86b0f8cc-bfec-42f2-b8cf-29f0603e3169] No waiting events found dispatching network-vif-plugged-6a452d69-92a5-408b-a63e-c9a1d8501656 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:55:56 user nova-compute[74337]: WARNING nova.compute.manager [req-ac3ba83e-538f-49c2-ae41-bea125a3b81d req-f2669ed1-50b6-416f-9586-1ac4a2497f06 service nova] [instance: 86b0f8cc-bfec-42f2-b8cf-29f0603e3169] Received unexpected event network-vif-plugged-6a452d69-92a5-408b-a63e-c9a1d8501656 for instance with vm_state active and task_state deleting.
Oct 23 21:55:56 user nova-compute[74337]: DEBUG nova.compute.manager [req-ac3ba83e-538f-49c2-ae41-bea125a3b81d req-f2669ed1-50b6-416f-9586-1ac4a2497f06 service nova] [instance: bc4c3e54-a845-4ea8-9ffc-a75d42a51788] Received event network-changed-42cc5f62-7b3d-40a1-96f8-29bed95db3de {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:55:56 user nova-compute[74337]: DEBUG nova.compute.manager [req-ac3ba83e-538f-49c2-ae41-bea125a3b81d req-f2669ed1-50b6-416f-9586-1ac4a2497f06 service nova] [instance: bc4c3e54-a845-4ea8-9ffc-a75d42a51788] Refreshing instance network info cache due to event network-changed-42cc5f62-7b3d-40a1-96f8-29bed95db3de. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 21:55:56 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ac3ba83e-538f-49c2-ae41-bea125a3b81d req-f2669ed1-50b6-416f-9586-1ac4a2497f06 service nova] Acquiring lock "refresh_cache-bc4c3e54-a845-4ea8-9ffc-a75d42a51788" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:55:56 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ac3ba83e-538f-49c2-ae41-bea125a3b81d req-f2669ed1-50b6-416f-9586-1ac4a2497f06 service nova] Acquired lock "refresh_cache-bc4c3e54-a845-4ea8-9ffc-a75d42a51788" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:55:56 user nova-compute[74337]: DEBUG nova.network.neutron [req-ac3ba83e-538f-49c2-ae41-bea125a3b81d req-f2669ed1-50b6-416f-9586-1ac4a2497f06 service nova] [instance: bc4c3e54-a845-4ea8-9ffc-a75d42a51788] Refreshing network info cache for port 42cc5f62-7b3d-40a1-96f8-29bed95db3de {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 21:55:56 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-e298fad1-02c7-4aeb-81a5-e4e6abd314b4 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:55:56 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-e298fad1-02c7-4aeb-81a5-e4e6abd314b4 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:55:57 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] Instance destroyed successfully.
Oct 23 21:55:57 user nova-compute[74337]: DEBUG nova.objects.instance [None req-959c367c-cde0-4a78-bd87-5b733e1ec0c9 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lazy-loading 'resources' on Instance uuid bf53e0fc-71d1-48fa-b0b4-ed3400a21c38 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:55:57 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:55:57 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-e298fad1-02c7-4aeb-81a5-e4e6abd314b4 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:55:57 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-e298fad1-02c7-4aeb-81a5-e4e6abd314b4 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:55:57 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:55:57 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:55:57 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-959c367c-cde0-4a78-bd87-5b733e1ec0c9 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:50:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1154963022',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1154963022',id=30,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-23T21:52:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='83b85c4f783a4ee7ab67422b49da85ca',ramdisk_id='',reservation_id='r-tp3clp60',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1944032280',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T21:54:10Z,user_data=None,user_id='a2e424dd3c684c808de14c2a9c3c1ed6',uuid=bf53e0fc-71d1-48fa-b0b4-ed3400a21c38,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d8fa8fea-2adc-42e9-9d0c-cbcbfe43db80", "address": "fa:16:3e:0f:95:9c", "network": {"id": "5f62b1d8-d5d0-4ff9-922b-fc6e72fb640d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-655282105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b85c4f783a4ee7ab67422b49da85ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8fa8fea-2a", "ovs_interfaceid": "d8fa8fea-2adc-42e9-9d0c-cbcbfe43db80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 21:55:57 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-959c367c-cde0-4a78-bd87-5b733e1ec0c9 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Converting VIF {"id": "d8fa8fea-2adc-42e9-9d0c-cbcbfe43db80", "address": "fa:16:3e:0f:95:9c", "network": {"id": "5f62b1d8-d5d0-4ff9-922b-fc6e72fb640d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-655282105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b85c4f783a4ee7ab67422b49da85ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8fa8fea-2a", "ovs_interfaceid": "d8fa8fea-2adc-42e9-9d0c-cbcbfe43db80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:55:57 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-959c367c-cde0-4a78-bd87-5b733e1ec0c9 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0f:95:9c,bridge_name='br-int',has_traffic_filtering=True,id=d8fa8fea-2adc-42e9-9d0c-cbcbfe43db80,network=Network(5f62b1d8-d5d0-4ff9-922b-fc6e72fb640d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8fa8fea-2a') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:55:57 user nova-compute[74337]: DEBUG os_vif [None req-959c367c-cde0-4a78-bd87-5b733e1ec0c9 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:95:9c,bridge_name='br-int',has_traffic_filtering=True,id=d8fa8fea-2adc-42e9-9d0c-cbcbfe43db80,network=Network(5f62b1d8-d5d0-4ff9-922b-fc6e72fb640d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8fa8fea-2a') {{(pid=74337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 21:55:57 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-e298fad1-02c7-4aeb-81a5-e4e6abd314b4 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.459s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:55:57 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:55:57 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd8fa8fea-2a, bridge=br-int, if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:55:57 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:55:57 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:55:57 user nova-compute[74337]: DEBUG nova.network.neutron [req-ac3ba83e-538f-49c2-ae41-bea125a3b81d req-f2669ed1-50b6-416f-9586-1ac4a2497f06 service nova] [instance: bc4c3e54-a845-4ea8-9ffc-a75d42a51788] Updated VIF entry in instance network info cache for port 42cc5f62-7b3d-40a1-96f8-29bed95db3de. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 21:55:57 user nova-compute[74337]: DEBUG nova.network.neutron [req-ac3ba83e-538f-49c2-ae41-bea125a3b81d req-f2669ed1-50b6-416f-9586-1ac4a2497f06 service nova] [instance: bc4c3e54-a845-4ea8-9ffc-a75d42a51788] Updating instance_info_cache with network_info: [{"id": "42cc5f62-7b3d-40a1-96f8-29bed95db3de", "address": "fa:16:3e:88:4f:9a", "network": {"id": "5a18e96f-a6eb-4989-9be3-154b54928b03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-507511840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb567547bd4941fb87435a841c9d17c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42cc5f62-7b", "ovs_interfaceid": "42cc5f62-7b3d-40a1-96f8-29bed95db3de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:55:57 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:55:57 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=de69da94-7614-46d8-b64c-886fd4c4821f) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:55:57 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:55:57 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:55:57 user nova-compute[74337]: INFO os_vif [None req-959c367c-cde0-4a78-bd87-5b733e1ec0c9 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:95:9c,bridge_name='br-int',has_traffic_filtering=True,id=d8fa8fea-2adc-42e9-9d0c-cbcbfe43db80,network=Network(5f62b1d8-d5d0-4ff9-922b-fc6e72fb640d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8fa8fea-2a')
Oct 23 21:55:57 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-959c367c-cde0-4a78-bd87-5b733e1ec0c9 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] calling os-brick to detach iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 21:55:57 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-959c367c-cde0-4a78-bd87-5b733e1ec0c9 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, {'target_iqn': 'iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PKTulDvj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:55:57 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-959c367c-cde0-4a78-bd87-5b733e1ec0c9 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:55:57 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-959c367c-cde0-4a78-bd87-5b733e1ec0c9 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:55:57 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-959c367c-cde0-4a78-bd87-5b733e1ec0c9 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:55:57 user nova-compute[74337]: INFO nova.scheduler.client.report [None req-e298fad1-02c7-4aeb-81a5-e4e6abd314b4 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Deleted allocations for instance 86b0f8cc-bfec-42f2-b8cf-29f0603e3169
Oct 23 21:55:57 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ac3ba83e-538f-49c2-ae41-bea125a3b81d req-f2669ed1-50b6-416f-9586-1ac4a2497f06 service nova] Releasing lock "refresh_cache-bc4c3e54-a845-4ea8-9ffc-a75d42a51788" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:55:57 user nova-compute[74337]: DEBUG nova.compute.manager [req-ac3ba83e-538f-49c2-ae41-bea125a3b81d req-f2669ed1-50b6-416f-9586-1ac4a2497f06 service nova] [instance: 86b0f8cc-bfec-42f2-b8cf-29f0603e3169] Received event network-vif-deleted-6a452d69-92a5-408b-a63e-c9a1d8501656 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:55:57 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:57 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:55:57 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f233569-bfd6-4733-85d1-71252a9313b3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a8c65f7e-9e2c-4a26-bab4-70c7d1e6c118\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:55:57 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-959c367c-cde0-4a78-bd87-5b733e1ec0c9 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 21:55:57 user nova-compute[74337]: No targets found.
Oct 23 21:55:57 user nova-compute[74337]: iSNS:
Oct 23 21:55:57 user nova-compute[74337]: No targets found.
Oct 23 21:55:57 user nova-compute[74337]: STATIC:
Oct 23 21:55:57 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83
Oct 23 21:55:57 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:55:57 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:55:57 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607
Oct 23 21:55:57 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:55:57 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:55:57 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4
Oct 23 21:55:57 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:55:57 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:55:57 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398
Oct 23 21:55:57 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:55:57 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:55:57 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:a8c65f7e-9e2c-4a26-bab4-70c7d1e6c118
Oct 23 21:55:57 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:55:57 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:55:57 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048
Oct 23 21:55:57 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:55:57 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:55:57 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7
Oct 23 21:55:57 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:55:57 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:55:57 user nova-compute[74337]: FIRMWARE:
Oct 23 21:55:57 user nova-compute[74337]: No targets found.
Oct 23 21:55:57 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:55:57 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-959c367c-cde0-4a78-bd87-5b733e1ec0c9 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 21:55:57 user nova-compute[74337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 21:55:57 user nova-compute[74337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 21:55:57 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-959c367c-cde0-4a78-bd87-5b733e1ec0c9 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83', 0)] {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 21:55:57 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:57 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:55:57 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[557dceed-1176-491d-8f78-47ad68d775de]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8c65f7e-9e2c-4a26-bab4-70c7d1e6c118\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:55:57 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:57 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:55:57 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9cb7b8c-291b-41cf-9c5d-38225d29eb92]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c65f7e-9e2c-4a26-bab4-70c7d1e6c118 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:55:57 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-959c367c-cde0-4a78-bd87-5b733e1ec0c9 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:55:57 user nova-compute[74337]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 (non-flash)
Oct 23 21:55:57 user nova-compute[74337]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 (non-flash)
Oct 23 21:55:57 user nova-compute[74337]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 (non-flash)
Oct 23 21:55:57 user nova-compute[74337]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607 (non-flash)
Oct 23 21:55:57 user nova-compute[74337]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c65f7e-9e2c-4a26-bab4-70c7d1e6c118 (non-flash)
Oct 23 21:55:57 user nova-compute[74337]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7 (non-flash)
Oct 23 21:55:57 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:55:57 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-959c367c-cde0-4a78-bd87-5b733e1ec0c9 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:55:57 user nova-compute[74337]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 (non-flash)
Oct 23 21:55:57 user nova-compute[74337]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 (non-flash)
Oct 23 21:55:57 user nova-compute[74337]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 (non-flash)
Oct 23 21:55:57 user nova-compute[74337]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607 (non-flash)
Oct 23 21:55:57 user nova-compute[74337]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c65f7e-9e2c-4a26-bab4-70c7d1e6c118 (non-flash)
Oct 23 21:55:57 user nova-compute[74337]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7 (non-flash)
Oct 23 21:55:57 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:55:57 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-959c367c-cde0-4a78-bd87-5b733e1ec0c9 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5eec708820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83'): ({'sdd'}, set())}) {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 21:55:57 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-959c367c-cde0-4a78-bd87-5b733e1ec0c9 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Removing single pathed devices sdd {{(pid=74337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 21:55:57 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:57 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-e298fad1-02c7-4aeb-81a5-e4e6abd314b4 tempest-AttachVolumeNegativeTest-1446109887 tempest-AttachVolumeNegativeTest-1446109887-project-member] Lock "86b0f8cc-bfec-42f2-b8cf-29f0603e3169" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.819s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:55:57 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:55:57 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[82a4867c-7e2e-4e4b-aafb-4878a11322f3]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:55:57 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:57 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:55:57 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[131d4211-3edd-440f-8f99-c99c998cd57c]: (4, ('ok\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:55:57 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-959c367c-cde0-4a78-bd87-5b733e1ec0c9 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Flushing IO for device /dev/sdd {{(pid=74337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 21:55:57 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:57 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:55:57 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[72da209e-294d-4020-85bd-b9d62a518d50]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:55:57 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-959c367c-cde0-4a78-bd87-5b733e1ec0c9 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 21:55:57 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:57 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.051s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:55:57 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a484bd3-06c6-4158-8e32-f1cba3cf3040]: (4, ('1', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:55:57 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-959c367c-cde0-4a78-bd87-5b733e1ec0c9 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 21:55:57 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-959c367c-cde0-4a78-bd87-5b733e1ec0c9 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] SCSI volumes sdd have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 21:55:57 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-959c367c-cde0-4a78-bd87-5b733e1ec0c9 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83')] {{(pid=74337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 21:55:57 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:57 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:55:57 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8dfcfbd-da48-4bd1-af1a-3283643ce515]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:55:57 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-959c367c-cde0-4a78-bd87-5b733e1ec0c9 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:55:57 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 -p 172.16.0.220:3260 --logout {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:57 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:55:57 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e96eb8c-a392-498a-a779-f1f078c78a92]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:55:57 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-959c367c-cde0-4a78-bd87-5b733e1ec0c9 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83, portal: 172.16.0.220,3260]
Oct 23 21:55:57 user nova-compute[74337]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83, portal: 172.16.0.220,3260] successful.
Oct 23 21:55:57 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:55:57 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 -p 172.16.0.220:3260 --op delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:55:57 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c55c1f59-3672-4335-8c85-014b490d8b83 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:55:57 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a78b658f-f321-4291-8fcb-ef36bf0a9d95]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:55:57 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-959c367c-cde0-4a78-bd87-5b733e1ec0c9 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:55:57 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-959c367c-cde0-4a78-bd87-5b733e1ec0c9 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.400s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:55:57 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-959c367c-cde0-4a78-bd87-5b733e1ec0c9 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] <== disconnect_volume: return (402ms) None {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:55:57 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-959c367c-cde0-4a78-bd87-5b733e1ec0c9 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] Disconnected iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 21:55:57 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-959c367c-cde0-4a78-bd87-5b733e1ec0c9 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] Deleting instance files /opt/stack/data/nova/instances/bf53e0fc-71d1-48fa-b0b4-ed3400a21c38_del
Oct 23 21:55:57 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-959c367c-cde0-4a78-bd87-5b733e1ec0c9 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] Deletion of /opt/stack/data/nova/instances/bf53e0fc-71d1-48fa-b0b4-ed3400a21c38_del complete
Oct 23 21:55:57 user nova-compute[74337]: INFO nova.compute.manager [None req-959c367c-cde0-4a78-bd87-5b733e1ec0c9 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] Took 1.68 seconds to destroy the instance on the hypervisor.
Oct 23 21:55:57 user nova-compute[74337]: DEBUG oslo.service.loopingcall [None req-959c367c-cde0-4a78-bd87-5b733e1ec0c9 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74337) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 21:55:57 user nova-compute[74337]: DEBUG nova.compute.manager [-] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] Deallocating network for instance {{(pid=74337) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 21:55:57 user nova-compute[74337]: DEBUG nova.network.neutron [-] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] deallocate_for_instance() {{(pid=74337) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 21:55:57 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:55:57 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:55:57 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:55:58 user nova-compute[74337]: DEBUG nova.network.neutron [-] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] Updating instance_info_cache with network_info: [] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:55:58 user nova-compute[74337]: INFO nova.compute.manager [-] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] Took 0.47 seconds to deallocate network for instance.
Oct 23 21:55:58 user nova-compute[74337]: DEBUG nova.compute.manager [req-ce6ff31b-ef08-4e36-841e-0ddc20e317c8 req-04b6614a-8970-4393-bc91-d9b7f6dc64e8 service nova] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] Received event network-vif-plugged-d8fa8fea-2adc-42e9-9d0c-cbcbfe43db80 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:55:58 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ce6ff31b-ef08-4e36-841e-0ddc20e317c8 req-04b6614a-8970-4393-bc91-d9b7f6dc64e8 service nova] Acquiring lock "bf53e0fc-71d1-48fa-b0b4-ed3400a21c38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:55:58 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ce6ff31b-ef08-4e36-841e-0ddc20e317c8 req-04b6614a-8970-4393-bc91-d9b7f6dc64e8 service nova] Lock "bf53e0fc-71d1-48fa-b0b4-ed3400a21c38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:55:58 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ce6ff31b-ef08-4e36-841e-0ddc20e317c8 req-04b6614a-8970-4393-bc91-d9b7f6dc64e8 service nova] Lock "bf53e0fc-71d1-48fa-b0b4-ed3400a21c38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:55:58 user nova-compute[74337]: DEBUG nova.compute.manager [req-ce6ff31b-ef08-4e36-841e-0ddc20e317c8 req-04b6614a-8970-4393-bc91-d9b7f6dc64e8 service nova] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] No waiting events found dispatching network-vif-plugged-d8fa8fea-2adc-42e9-9d0c-cbcbfe43db80 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:55:58 user nova-compute[74337]: WARNING nova.compute.manager [req-ce6ff31b-ef08-4e36-841e-0ddc20e317c8 req-04b6614a-8970-4393-bc91-d9b7f6dc64e8 service nova] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] Received unexpected event network-vif-plugged-d8fa8fea-2adc-42e9-9d0c-cbcbfe43db80 for instance with vm_state active and task_state deleting.
Oct 23 21:55:58 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:55:58 user nova-compute[74337]: DEBUG nova.compute.manager [req-ed922f1c-ddea-4700-8eb0-25f92875b11c req-7f4f3ae2-02c8-4490-883c-a3dac7a3672b service nova] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] Received event network-vif-plugged-16ee3173-b704-43aa-9c44-ffa4d4d82fc4 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:55:58 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ed922f1c-ddea-4700-8eb0-25f92875b11c req-7f4f3ae2-02c8-4490-883c-a3dac7a3672b service nova] Acquiring lock "d5d9d286-4837-4168-a4fe-1bc09e372654-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:55:58 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ed922f1c-ddea-4700-8eb0-25f92875b11c req-7f4f3ae2-02c8-4490-883c-a3dac7a3672b service nova] Lock "d5d9d286-4837-4168-a4fe-1bc09e372654-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:55:58 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ed922f1c-ddea-4700-8eb0-25f92875b11c req-7f4f3ae2-02c8-4490-883c-a3dac7a3672b service nova] Lock "d5d9d286-4837-4168-a4fe-1bc09e372654-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:55:58 user nova-compute[74337]: DEBUG nova.compute.manager [req-ed922f1c-ddea-4700-8eb0-25f92875b11c req-7f4f3ae2-02c8-4490-883c-a3dac7a3672b service nova] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] No waiting events found dispatching network-vif-plugged-16ee3173-b704-43aa-9c44-ffa4d4d82fc4 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:55:58 user nova-compute[74337]: WARNING nova.compute.manager [req-ed922f1c-ddea-4700-8eb0-25f92875b11c req-7f4f3ae2-02c8-4490-883c-a3dac7a3672b service nova] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] Received unexpected event network-vif-plugged-16ee3173-b704-43aa-9c44-ffa4d4d82fc4 for instance with vm_state active and task_state reboot_started_hard.
Oct 23 21:55:58 user nova-compute[74337]: DEBUG nova.compute.manager [req-ed922f1c-ddea-4700-8eb0-25f92875b11c req-7f4f3ae2-02c8-4490-883c-a3dac7a3672b service nova] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] Received event network-vif-plugged-16ee3173-b704-43aa-9c44-ffa4d4d82fc4 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:55:58 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ed922f1c-ddea-4700-8eb0-25f92875b11c req-7f4f3ae2-02c8-4490-883c-a3dac7a3672b service nova] Acquiring lock "d5d9d286-4837-4168-a4fe-1bc09e372654-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:55:58 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ed922f1c-ddea-4700-8eb0-25f92875b11c req-7f4f3ae2-02c8-4490-883c-a3dac7a3672b service nova] Lock "d5d9d286-4837-4168-a4fe-1bc09e372654-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:55:58 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ed922f1c-ddea-4700-8eb0-25f92875b11c req-7f4f3ae2-02c8-4490-883c-a3dac7a3672b service nova] Lock "d5d9d286-4837-4168-a4fe-1bc09e372654-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:55:58 user nova-compute[74337]: DEBUG nova.compute.manager [req-ed922f1c-ddea-4700-8eb0-25f92875b11c req-7f4f3ae2-02c8-4490-883c-a3dac7a3672b service nova] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] No waiting events found dispatching network-vif-plugged-16ee3173-b704-43aa-9c44-ffa4d4d82fc4 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:55:58 user nova-compute[74337]: WARNING nova.compute.manager [req-ed922f1c-ddea-4700-8eb0-25f92875b11c req-7f4f3ae2-02c8-4490-883c-a3dac7a3672b service nova] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] Received unexpected event network-vif-plugged-16ee3173-b704-43aa-9c44-ffa4d4d82fc4 for instance with vm_state active and task_state reboot_started_hard.
Oct 23 21:55:58 user nova-compute[74337]: DEBUG nova.compute.manager [req-ed922f1c-ddea-4700-8eb0-25f92875b11c req-7f4f3ae2-02c8-4490-883c-a3dac7a3672b service nova] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] Received event network-vif-deleted-d8fa8fea-2adc-42e9-9d0c-cbcbfe43db80 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:55:59 user nova-compute[74337]: DEBUG nova.compute.manager [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] Instance event wait completed in 0 seconds for  {{(pid=74337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 21:55:59 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] Instance rebooted successfully.
Oct 23 21:55:59 user nova-compute[74337]: DEBUG nova.compute.manager [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] Checking state {{(pid=74337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 21:55:59 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-b603dd7a-8eb5-413a-a8c5-2a9aedda41dc tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Lock "d5d9d286-4837-4168-a4fe-1bc09e372654" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.996s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:56:02 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:56:02 user nova-compute[74337]: DEBUG nova.compute.manager [req-bdffa303-caef-4222-bd38-9b1d3d77ad06 req-6763fb02-dbf4-450d-929b-f5b52e15c143 service nova] [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d] Received event network-changed-acb8f6c5-55fe-4a9d-82b3-70d9503356f2 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:56:02 user nova-compute[74337]: DEBUG nova.compute.manager [req-bdffa303-caef-4222-bd38-9b1d3d77ad06 req-6763fb02-dbf4-450d-929b-f5b52e15c143 service nova] [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d] Refreshing instance network info cache due to event network-changed-acb8f6c5-55fe-4a9d-82b3-70d9503356f2. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 21:56:02 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-bdffa303-caef-4222-bd38-9b1d3d77ad06 req-6763fb02-dbf4-450d-929b-f5b52e15c143 service nova] Acquiring lock "refresh_cache-0323b854-c7a1-42e8-ad85-1e929caa6e9d" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:56:02 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-bdffa303-caef-4222-bd38-9b1d3d77ad06 req-6763fb02-dbf4-450d-929b-f5b52e15c143 service nova] Acquired lock "refresh_cache-0323b854-c7a1-42e8-ad85-1e929caa6e9d" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:56:02 user nova-compute[74337]: DEBUG nova.network.neutron [req-bdffa303-caef-4222-bd38-9b1d3d77ad06 req-6763fb02-dbf4-450d-929b-f5b52e15c143 service nova] [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d] Refreshing network info cache for port acb8f6c5-55fe-4a9d-82b3-70d9503356f2 {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 21:56:03 user nova-compute[74337]: DEBUG nova.network.neutron [req-bdffa303-caef-4222-bd38-9b1d3d77ad06 req-6763fb02-dbf4-450d-929b-f5b52e15c143 service nova] [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d] Updated VIF entry in instance network info cache for port acb8f6c5-55fe-4a9d-82b3-70d9503356f2. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 21:56:03 user nova-compute[74337]: DEBUG nova.network.neutron [req-bdffa303-caef-4222-bd38-9b1d3d77ad06 req-6763fb02-dbf4-450d-929b-f5b52e15c143 service nova] [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d] Updating instance_info_cache with network_info: [{"id": "acb8f6c5-55fe-4a9d-82b3-70d9503356f2", "address": "fa:16:3e:ac:1d:a3", "network": {"id": "95dce4e0-8f8c-4034-a0ab-1c8ee0b1e631", "bridge": "br-int", "label": "tempest-TestShelveInstance-603341331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "998e7763a94e4045bc097208ab368db9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacb8f6c5-55", "ovs_interfaceid": "acb8f6c5-55fe-4a9d-82b3-70d9503356f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:56:03 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-bdffa303-caef-4222-bd38-9b1d3d77ad06 req-6763fb02-dbf4-450d-929b-f5b52e15c143 service nova] Releasing lock "refresh_cache-0323b854-c7a1-42e8-ad85-1e929caa6e9d" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:56:03 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-45b12277-6a1b-4d81-91c3-d20246266eec tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] Acquiring lock "0323b854-c7a1-42e8-ad85-1e929caa6e9d" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:56:03 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-45b12277-6a1b-4d81-91c3-d20246266eec tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] Lock "0323b854-c7a1-42e8-ad85-1e929caa6e9d" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:56:03 user nova-compute[74337]: INFO nova.compute.manager [None req-45b12277-6a1b-4d81-91c3-d20246266eec tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d] Shelve offloading
Oct 23 21:56:03 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:56:03 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:56:03 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:56:03 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:56:03 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:56:03 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-943bde0d-8f1b-4db2-8052-e70a59b4a843 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance e326a14c-61d7-4dca-b55f-db0f3ab0d14e is timed out.
Oct 23 21:56:03 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-943bde0d-8f1b-4db2-8052-e70a59b4a843 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Successfully detached device vdc from instance e326a14c-61d7-4dca-b55f-db0f3ab0d14e from the live domain config.
Oct 23 21:56:03 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-943bde0d-8f1b-4db2-8052-e70a59b4a843 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: e326a14c-61d7-4dca-b55f-db0f3ab0d14e] calling os-brick to detach iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 21:56:03 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-943bde0d-8f1b-4db2-8052-e70a59b4a843 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, {'target_iqn': 'iqn.2010-10.org.openstack:a8c65f7e-9e2c-4a26-bab4-70c7d1e6c118', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EzrLPmfg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:56:03 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-943bde0d-8f1b-4db2-8052-e70a59b4a843 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:56:03 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-943bde0d-8f1b-4db2-8052-e70a59b4a843 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:56:03 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-943bde0d-8f1b-4db2-8052-e70a59b4a843 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:56:03 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:56:04 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:56:04 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[3929cdf9-62ce-421d-8cfb-b5386f0764d6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a8c65f7e-9e2c-4a26-bab4-70c7d1e6c118\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:56:04 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-943bde0d-8f1b-4db2-8052-e70a59b4a843 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 21:56:04 user nova-compute[74337]: No targets found.
Oct 23 21:56:04 user nova-compute[74337]: iSNS:
Oct 23 21:56:04 user nova-compute[74337]: No targets found.
Oct 23 21:56:04 user nova-compute[74337]: STATIC:
Oct 23 21:56:04 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607
Oct 23 21:56:04 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:56:04 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:56:04 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4
Oct 23 21:56:04 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:56:04 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:56:04 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398
Oct 23 21:56:04 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:56:04 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:56:04 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:a8c65f7e-9e2c-4a26-bab4-70c7d1e6c118
Oct 23 21:56:04 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:56:04 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:56:04 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048
Oct 23 21:56:04 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:56:04 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:56:04 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7
Oct 23 21:56:04 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:56:04 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:56:04 user nova-compute[74337]: FIRMWARE:
Oct 23 21:56:04 user nova-compute[74337]: No targets found.
Oct 23 21:56:04 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:56:04 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-943bde0d-8f1b-4db2-8052-e70a59b4a843 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 21:56:04 user nova-compute[74337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 21:56:04 user nova-compute[74337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 21:56:04 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-943bde0d-8f1b-4db2-8052-e70a59b4a843 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8c65f7e-9e2c-4a26-bab4-70c7d1e6c118', 0)] {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 21:56:04 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:56:04 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:56:04 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[65571815-e12d-4803-93b7-29a59e749844]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8c65f7e-9e2c-4a26-bab4-70c7d1e6c118\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:56:04 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:56:04 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:56:04 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[43e55db9-20ff-4b3e-9996-0d161bf3dad8]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c65f7e-9e2c-4a26-bab4-70c7d1e6c118 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:56:04 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-943bde0d-8f1b-4db2-8052-e70a59b4a843 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:56:04 user nova-compute[74337]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 (non-flash)
Oct 23 21:56:04 user nova-compute[74337]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 (non-flash)
Oct 23 21:56:04 user nova-compute[74337]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607 (non-flash)
Oct 23 21:56:04 user nova-compute[74337]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c65f7e-9e2c-4a26-bab4-70c7d1e6c118 (non-flash)
Oct 23 21:56:04 user nova-compute[74337]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7 (non-flash)
Oct 23 21:56:04 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:56:04 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-943bde0d-8f1b-4db2-8052-e70a59b4a843 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:56:04 user nova-compute[74337]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 (non-flash)
Oct 23 21:56:04 user nova-compute[74337]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 (non-flash)
Oct 23 21:56:04 user nova-compute[74337]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607 (non-flash)
Oct 23 21:56:04 user nova-compute[74337]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8c65f7e-9e2c-4a26-bab4-70c7d1e6c118 (non-flash)
Oct 23 21:56:04 user nova-compute[74337]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7 (non-flash)
Oct 23 21:56:04 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:56:04 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-943bde0d-8f1b-4db2-8052-e70a59b4a843 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5eec1f1630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8c65f7e-9e2c-4a26-bab4-70c7d1e6c118'): ({'sdi'}, set())}) {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 21:56:04 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-943bde0d-8f1b-4db2-8052-e70a59b4a843 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Removing single pathed devices sdi {{(pid=74337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 21:56:04 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:56:04 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:56:04 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f4e7f46-a611-45ca-9457-e5b6002ddec4]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:56:04 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:56:04 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.021s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:56:04 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe912f0-16b8-491e-a01c-81ce7b122cd2]: (4, ('ok\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:56:04 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-943bde0d-8f1b-4db2-8052-e70a59b4a843 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Flushing IO for device /dev/sdi {{(pid=74337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 21:56:04 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:56:04 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.015s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:56:04 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6832a908-4882-4f70-85bb-8611fd316292]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:56:04 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-943bde0d-8f1b-4db2-8052-e70a59b4a843 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=74337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 21:56:04 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:56:04 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.065s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:56:04 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f274a6-5a53-4bd7-b023-308c7794fb46]: (4, ('1', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:56:04 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-943bde0d-8f1b-4db2-8052-e70a59b4a843 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 21:56:04 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-943bde0d-8f1b-4db2-8052-e70a59b4a843 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] SCSI volumes sdi have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 21:56:04 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-943bde0d-8f1b-4db2-8052-e70a59b4a843 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8c65f7e-9e2c-4a26-bab4-70c7d1e6c118')] {{(pid=74337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 21:56:04 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8c65f7e-9e2c-4a26-bab4-70c7d1e6c118 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:56:04 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8c65f7e-9e2c-4a26-bab4-70c7d1e6c118 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:56:04 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f75b4a-4b1e-4c9b-9e5d-2cd138bcdc64]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:56:04 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-943bde0d-8f1b-4db2-8052-e70a59b4a843 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:56:04 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8c65f7e-9e2c-4a26-bab4-70c7d1e6c118 -p 172.16.0.220:3260 --logout {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:56:04 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d] Instance destroyed successfully.
Oct 23 21:56:04 user nova-compute[74337]: DEBUG nova.compute.manager [None req-45b12277-6a1b-4d81-91c3-d20246266eec tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d] Checking state {{(pid=74337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 21:56:04 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-45b12277-6a1b-4d81-91c3-d20246266eec tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] Acquiring lock "refresh_cache-0323b854-c7a1-42e8-ad85-1e929caa6e9d" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:56:04 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-45b12277-6a1b-4d81-91c3-d20246266eec tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] Acquired lock "refresh_cache-0323b854-c7a1-42e8-ad85-1e929caa6e9d" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:56:04 user nova-compute[74337]: DEBUG nova.network.neutron [None req-45b12277-6a1b-4d81-91c3-d20246266eec tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d] Building network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 21:56:04 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8c65f7e-9e2c-4a26-bab4-70c7d1e6c118 -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:56:04 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[cefb4e3b-ded0-48f7-acea-eee1358eed67]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:a8c65f7e-9e2c-4a26-bab4-70c7d1e6c118, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:a8c65f7e-9e2c-4a26-bab4-70c7d1e6c118, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:56:04 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-943bde0d-8f1b-4db2-8052-e70a59b4a843 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:a8c65f7e-9e2c-4a26-bab4-70c7d1e6c118, portal: 172.16.0.220,3260]
Oct 23 21:56:04 user nova-compute[74337]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:a8c65f7e-9e2c-4a26-bab4-70c7d1e6c118, portal: 172.16.0.220,3260] successful.
Oct 23 21:56:04 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:56:04 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8c65f7e-9e2c-4a26-bab4-70c7d1e6c118 -p 172.16.0.220:3260 --op delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:56:04 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8c65f7e-9e2c-4a26-bab4-70c7d1e6c118 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:56:04 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb5c5dbe-a31d-4611-bf24-4bc9d2b2ba6a]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:56:04 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-943bde0d-8f1b-4db2-8052-e70a59b4a843 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:56:04 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-943bde0d-8f1b-4db2-8052-e70a59b4a843 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.395s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:56:04 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-943bde0d-8f1b-4db2-8052-e70a59b4a843 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] <== disconnect_volume: return (397ms) None {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:56:04 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-943bde0d-8f1b-4db2-8052-e70a59b4a843 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: e326a14c-61d7-4dca-b55f-db0f3ab0d14e] Disconnected iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 21:56:04 user nova-compute[74337]: DEBUG nova.network.neutron [None req-45b12277-6a1b-4d81-91c3-d20246266eec tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d] Updating instance_info_cache with network_info: [{"id": "acb8f6c5-55fe-4a9d-82b3-70d9503356f2", "address": "fa:16:3e:ac:1d:a3", "network": {"id": "95dce4e0-8f8c-4034-a0ab-1c8ee0b1e631", "bridge": "br-int", "label": "tempest-TestShelveInstance-603341331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "998e7763a94e4045bc097208ab368db9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacb8f6c5-55", "ovs_interfaceid": "acb8f6c5-55fe-4a9d-82b3-70d9503356f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:56:04 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-45b12277-6a1b-4d81-91c3-d20246266eec tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] Releasing lock "refresh_cache-0323b854-c7a1-42e8-ad85-1e929caa6e9d" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:56:04 user nova-compute[74337]: DEBUG nova.compute.manager [req-ba68eb8e-70a4-4255-86f6-9a4b6e9e8f98 req-81dc20e2-9e4e-4893-b884-f977c48b47a2 service nova] [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d] Received event network-vif-unplugged-acb8f6c5-55fe-4a9d-82b3-70d9503356f2 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:56:04 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ba68eb8e-70a4-4255-86f6-9a4b6e9e8f98 req-81dc20e2-9e4e-4893-b884-f977c48b47a2 service nova] Acquiring lock "0323b854-c7a1-42e8-ad85-1e929caa6e9d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:56:04 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ba68eb8e-70a4-4255-86f6-9a4b6e9e8f98 req-81dc20e2-9e4e-4893-b884-f977c48b47a2 service nova] Lock "0323b854-c7a1-42e8-ad85-1e929caa6e9d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:56:04 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ba68eb8e-70a4-4255-86f6-9a4b6e9e8f98 req-81dc20e2-9e4e-4893-b884-f977c48b47a2 service nova] Lock "0323b854-c7a1-42e8-ad85-1e929caa6e9d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:56:04 user nova-compute[74337]: DEBUG nova.compute.manager [req-ba68eb8e-70a4-4255-86f6-9a4b6e9e8f98 req-81dc20e2-9e4e-4893-b884-f977c48b47a2 service nova] [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d] No waiting events found dispatching network-vif-unplugged-acb8f6c5-55fe-4a9d-82b3-70d9503356f2 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:56:04 user nova-compute[74337]: WARNING nova.compute.manager [req-ba68eb8e-70a4-4255-86f6-9a4b6e9e8f98 req-81dc20e2-9e4e-4893-b884-f977c48b47a2 service nova] [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d] Received unexpected event network-vif-unplugged-acb8f6c5-55fe-4a9d-82b3-70d9503356f2 for instance with vm_state active and task_state shelving.
Oct 23 21:56:04 user nova-compute[74337]: DEBUG nova.compute.manager [req-ba68eb8e-70a4-4255-86f6-9a4b6e9e8f98 req-81dc20e2-9e4e-4893-b884-f977c48b47a2 service nova] [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d] Received event network-vif-plugged-acb8f6c5-55fe-4a9d-82b3-70d9503356f2 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:56:04 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ba68eb8e-70a4-4255-86f6-9a4b6e9e8f98 req-81dc20e2-9e4e-4893-b884-f977c48b47a2 service nova] Acquiring lock "0323b854-c7a1-42e8-ad85-1e929caa6e9d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:56:04 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ba68eb8e-70a4-4255-86f6-9a4b6e9e8f98 req-81dc20e2-9e4e-4893-b884-f977c48b47a2 service nova] Lock "0323b854-c7a1-42e8-ad85-1e929caa6e9d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:56:04 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ba68eb8e-70a4-4255-86f6-9a4b6e9e8f98 req-81dc20e2-9e4e-4893-b884-f977c48b47a2 service nova] Lock "0323b854-c7a1-42e8-ad85-1e929caa6e9d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:56:04 user nova-compute[74337]: DEBUG nova.compute.manager [req-ba68eb8e-70a4-4255-86f6-9a4b6e9e8f98 req-81dc20e2-9e4e-4893-b884-f977c48b47a2 service nova] [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d] No waiting events found dispatching network-vif-plugged-acb8f6c5-55fe-4a9d-82b3-70d9503356f2 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:56:04 user nova-compute[74337]: WARNING nova.compute.manager [req-ba68eb8e-70a4-4255-86f6-9a4b6e9e8f98 req-81dc20e2-9e4e-4893-b884-f977c48b47a2 service nova] [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d] Received unexpected event network-vif-plugged-acb8f6c5-55fe-4a9d-82b3-70d9503356f2 for instance with vm_state active and task_state shelving.
Oct 23 21:56:05 user nova-compute[74337]: DEBUG nova.objects.instance [None req-943bde0d-8f1b-4db2-8052-e70a59b4a843 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lazy-loading 'flavor' on Instance uuid e326a14c-61d7-4dca-b55f-db0f3ab0d14e {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:56:05 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-943bde0d-8f1b-4db2-8052-e70a59b4a843 tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lock "e326a14c-61d7-4dca-b55f-db0f3ab0d14e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.876s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:56:05 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d] Instance destroyed successfully.
Oct 23 21:56:05 user nova-compute[74337]: DEBUG nova.objects.instance [None req-45b12277-6a1b-4d81-91c3-d20246266eec tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] Lazy-loading 'resources' on Instance uuid 0323b854-c7a1-42e8-ad85-1e929caa6e9d {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:56:05 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-45b12277-6a1b-4d81-91c3-d20246266eec tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:54:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1176046172',display_name='tempest-TestShelveInstance-server-1176046172',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1176046172',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEx0NVJzKM8YzUUbTD2zwIk9bkp8l9p9es52EoZSF1Ew+o3XWxyu0IqZdLM7NOHFVUooxza7tfIdP3DI7McbogvDHZ4o97b/fTH6FHmK29fxkoO6KWxqFL/67IDNTiMxRA==',key_name='tempest-TestShelveInstance-1748914447',keypairs=<?>,launch_index=0,launched_at=2023-10-23T21:54:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='998e7763a94e4045bc097208ab368db9',ramdisk_id='',reservation_id='r-7ntxojce',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-224278230',owner_user_name='tempest-TestShelveInstance-224278230-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T21:54:35Z,user_data=None,user_id='d64b0bdc62064df8b3db31fb2a09cb07',uuid=0323b854-c7a1-42e8-ad85-1e929caa6e9d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "acb8f6c5-55fe-4a9d-82b3-70d9503356f2", "address": "fa:16:3e:ac:1d:a3", "network": {"id": "95dce4e0-8f8c-4034-a0ab-1c8ee0b1e631", "bridge": "br-int", "label": "tempest-TestShelveInstance-603341331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "998e7763a94e4045bc097208ab368db9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacb8f6c5-55", "ovs_interfaceid": "acb8f6c5-55fe-4a9d-82b3-70d9503356f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 21:56:05 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-45b12277-6a1b-4d81-91c3-d20246266eec tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] Converting VIF {"id": "acb8f6c5-55fe-4a9d-82b3-70d9503356f2", "address": "fa:16:3e:ac:1d:a3", "network": {"id": "95dce4e0-8f8c-4034-a0ab-1c8ee0b1e631", "bridge": "br-int", "label": "tempest-TestShelveInstance-603341331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "998e7763a94e4045bc097208ab368db9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacb8f6c5-55", "ovs_interfaceid": "acb8f6c5-55fe-4a9d-82b3-70d9503356f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:56:05 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-45b12277-6a1b-4d81-91c3-d20246266eec tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:1d:a3,bridge_name='br-int',has_traffic_filtering=True,id=acb8f6c5-55fe-4a9d-82b3-70d9503356f2,network=Network(95dce4e0-8f8c-4034-a0ab-1c8ee0b1e631),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacb8f6c5-55') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:56:05 user nova-compute[74337]: DEBUG os_vif [None req-45b12277-6a1b-4d81-91c3-d20246266eec tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:1d:a3,bridge_name='br-int',has_traffic_filtering=True,id=acb8f6c5-55fe-4a9d-82b3-70d9503356f2,network=Network(95dce4e0-8f8c-4034-a0ab-1c8ee0b1e631),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacb8f6c5-55') {{(pid=74337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 21:56:05 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:56:05 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapacb8f6c5-55, bridge=br-int, if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:56:05 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:56:05 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:56:05 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=795b2c7f-dde4-4e35-85cf-44c8d4a2fec7) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:56:05 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:56:05 user nova-compute[74337]: DEBUG nova.compute.manager [req-b9adb090-a41d-48d6-a5a1-3a5143f282f2 req-20e046a9-4eb9-4113-854b-fccc42e8b560 service nova] [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d] Received event network-changed-acb8f6c5-55fe-4a9d-82b3-70d9503356f2 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:56:05 user nova-compute[74337]: DEBUG nova.compute.manager [req-b9adb090-a41d-48d6-a5a1-3a5143f282f2 req-20e046a9-4eb9-4113-854b-fccc42e8b560 service nova] [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d] Refreshing instance network info cache due to event network-changed-acb8f6c5-55fe-4a9d-82b3-70d9503356f2. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 21:56:05 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-b9adb090-a41d-48d6-a5a1-3a5143f282f2 req-20e046a9-4eb9-4113-854b-fccc42e8b560 service nova] Acquiring lock "refresh_cache-0323b854-c7a1-42e8-ad85-1e929caa6e9d" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:56:05 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-b9adb090-a41d-48d6-a5a1-3a5143f282f2 req-20e046a9-4eb9-4113-854b-fccc42e8b560 service nova] Acquired lock "refresh_cache-0323b854-c7a1-42e8-ad85-1e929caa6e9d" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:56:05 user nova-compute[74337]: DEBUG nova.network.neutron [req-b9adb090-a41d-48d6-a5a1-3a5143f282f2 req-20e046a9-4eb9-4113-854b-fccc42e8b560 service nova] [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d] Refreshing network info cache for port acb8f6c5-55fe-4a9d-82b3-70d9503356f2 {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 21:56:05 user nova-compute[74337]: INFO os_vif [None req-45b12277-6a1b-4d81-91c3-d20246266eec tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:1d:a3,bridge_name='br-int',has_traffic_filtering=True,id=acb8f6c5-55fe-4a9d-82b3-70d9503356f2,network=Network(95dce4e0-8f8c-4034-a0ab-1c8ee0b1e631),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacb8f6c5-55')
Oct 23 21:56:05 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45b12277-6a1b-4d81-91c3-d20246266eec tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d] calling os-brick to detach iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 21:56:05 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b12277-6a1b-4d81-91c3-d20246266eec tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, {'target_iqn': 'iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JeADnxpV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:56:05 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-45b12277-6a1b-4d81-91c3-d20246266eec tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:56:05 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-45b12277-6a1b-4d81-91c3-d20246266eec tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:56:05 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-45b12277-6a1b-4d81-91c3-d20246266eec tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:56:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:56:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:56:05 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1135d42-0f4b-4691-8752-0783f2df1416]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:56:05 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b12277-6a1b-4d81-91c3-d20246266eec tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 21:56:05 user nova-compute[74337]: No targets found.
Oct 23 21:56:05 user nova-compute[74337]: iSNS:
Oct 23 21:56:05 user nova-compute[74337]: No targets found.
Oct 23 21:56:05 user nova-compute[74337]: STATIC:
Oct 23 21:56:05 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607
Oct 23 21:56:05 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:56:05 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:56:05 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4
Oct 23 21:56:05 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:56:05 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:56:05 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398
Oct 23 21:56:05 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:56:05 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:56:05 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048
Oct 23 21:56:05 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:56:05 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:56:05 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7
Oct 23 21:56:05 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:56:05 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:56:05 user nova-compute[74337]: FIRMWARE:
Oct 23 21:56:05 user nova-compute[74337]: No targets found.
Oct 23 21:56:05 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:56:05 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b12277-6a1b-4d81-91c3-d20246266eec tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 21:56:05 user nova-compute[74337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 21:56:05 user nova-compute[74337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 21:56:05 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b12277-6a1b-4d81-91c3-d20246266eec tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607', 0)] {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 21:56:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:56:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:56:05 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[94404ad9-54b7-4d8d-ab18-b021caf0e9f8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:56:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:56:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:56:05 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0f22aaa-990e-4bd1-890a-5471bfb1abd2]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:56:05 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b12277-6a1b-4d81-91c3-d20246266eec tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:56:05 user nova-compute[74337]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 (non-flash)
Oct 23 21:56:05 user nova-compute[74337]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 (non-flash)
Oct 23 21:56:05 user nova-compute[74337]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607 (non-flash)
Oct 23 21:56:05 user nova-compute[74337]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7 (non-flash)
Oct 23 21:56:05 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:56:05 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b12277-6a1b-4d81-91c3-d20246266eec tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:56:05 user nova-compute[74337]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 (non-flash)
Oct 23 21:56:05 user nova-compute[74337]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 (non-flash)
Oct 23 21:56:05 user nova-compute[74337]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607 (non-flash)
Oct 23 21:56:05 user nova-compute[74337]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7 (non-flash)
Oct 23 21:56:05 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:56:05 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b12277-6a1b-4d81-91c3-d20246266eec tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5ef43c3f40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607'): ({'sdf'}, set())}) {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 21:56:05 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-45b12277-6a1b-4d81-91c3-d20246266eec tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] Removing single pathed devices sdf {{(pid=74337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 21:56:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:56:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:56:05 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d945fd35-c808-45e4-b9fc-6e4256a7e8d5]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:56:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:56:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:56:05 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d3ab7d5-2f7c-49a4-8abc-a49a141077c3]: (4, ('ok\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:56:05 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-45b12277-6a1b-4d81-91c3-d20246266eec tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] Flushing IO for device /dev/sdf {{(pid=74337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 21:56:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:56:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:56:05 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[22e2702f-ce33-48e2-8109-c0852af8807d]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:56:05 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-45b12277-6a1b-4d81-91c3-d20246266eec tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 21:56:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:56:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.051s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:56:05 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d377d39-fbc7-4759-9190-7103fd171384]: (4, ('1', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:56:05 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-45b12277-6a1b-4d81-91c3-d20246266eec tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 21:56:05 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-45b12277-6a1b-4d81-91c3-d20246266eec tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] SCSI volumes sdf have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 21:56:05 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b12277-6a1b-4d81-91c3-d20246266eec tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607')] {{(pid=74337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 21:56:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:56:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:56:06 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b093d8f-3f5f-44e4-bf2e-39e215add63b]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:56:06 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b12277-6a1b-4d81-91c3-d20246266eec tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:56:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607 -p 172.16.0.220:3260 --logout {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:56:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:56:06 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6776fa48-a213-4c1f-a6fa-6d19548a454c]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:56:06 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b12277-6a1b-4d81-91c3-d20246266eec tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607, portal: 172.16.0.220,3260]
Oct 23 21:56:06 user nova-compute[74337]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607, portal: 172.16.0.220,3260] successful.
Oct 23 21:56:06 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:56:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607 -p 172.16.0.220:3260 --op delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:56:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89f93205-ad98-45ff-8903-c2a7251da607 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:56:06 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[40881fa8-cb0a-41db-871d-4edf54d4a3e2]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:56:06 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b12277-6a1b-4d81-91c3-d20246266eec tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:56:06 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-45b12277-6a1b-4d81-91c3-d20246266eec tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:56:06 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-45b12277-6a1b-4d81-91c3-d20246266eec tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] <== disconnect_volume: return (349ms) None {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:56:06 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45b12277-6a1b-4d81-91c3-d20246266eec tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d] Disconnected iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 21:56:06 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-45b12277-6a1b-4d81-91c3-d20246266eec tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d] Deleting instance files /opt/stack/data/nova/instances/0323b854-c7a1-42e8-ad85-1e929caa6e9d_del
Oct 23 21:56:06 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-45b12277-6a1b-4d81-91c3-d20246266eec tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d] Deletion of /opt/stack/data/nova/instances/0323b854-c7a1-42e8-ad85-1e929caa6e9d_del complete
Oct 23 21:56:06 user nova-compute[74337]: DEBUG nova.network.neutron [req-b9adb090-a41d-48d6-a5a1-3a5143f282f2 req-20e046a9-4eb9-4113-854b-fccc42e8b560 service nova] [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d] Updated VIF entry in instance network info cache for port acb8f6c5-55fe-4a9d-82b3-70d9503356f2. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 21:56:06 user nova-compute[74337]: DEBUG nova.network.neutron [req-b9adb090-a41d-48d6-a5a1-3a5143f282f2 req-20e046a9-4eb9-4113-854b-fccc42e8b560 service nova] [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d] Updating instance_info_cache with network_info: [{"id": "acb8f6c5-55fe-4a9d-82b3-70d9503356f2", "address": "fa:16:3e:ac:1d:a3", "network": {"id": "95dce4e0-8f8c-4034-a0ab-1c8ee0b1e631", "bridge": null, "label": "tempest-TestShelveInstance-603341331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "998e7763a94e4045bc097208ab368db9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapacb8f6c5-55", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:56:06 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-b9adb090-a41d-48d6-a5a1-3a5143f282f2 req-20e046a9-4eb9-4113-854b-fccc42e8b560 service nova] Releasing lock "refresh_cache-0323b854-c7a1-42e8-ad85-1e929caa6e9d" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:56:06 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-7746e391-518d-493d-a899-257d2884bb5e tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Acquiring lock "e326a14c-61d7-4dca-b55f-db0f3ab0d14e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:56:06 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-7746e391-518d-493d-a899-257d2884bb5e tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lock "e326a14c-61d7-4dca-b55f-db0f3ab0d14e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:56:06 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-7746e391-518d-493d-a899-257d2884bb5e tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Acquiring lock "e326a14c-61d7-4dca-b55f-db0f3ab0d14e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:56:06 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-7746e391-518d-493d-a899-257d2884bb5e tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lock "e326a14c-61d7-4dca-b55f-db0f3ab0d14e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:56:06 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-7746e391-518d-493d-a899-257d2884bb5e tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lock "e326a14c-61d7-4dca-b55f-db0f3ab0d14e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:56:06 user nova-compute[74337]: INFO nova.compute.manager [None req-7746e391-518d-493d-a899-257d2884bb5e tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: e326a14c-61d7-4dca-b55f-db0f3ab0d14e] Terminating instance
Oct 23 21:56:06 user nova-compute[74337]: DEBUG nova.compute.manager [None req-7746e391-518d-493d-a899-257d2884bb5e tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: e326a14c-61d7-4dca-b55f-db0f3ab0d14e] Start destroying the instance on the hypervisor. {{(pid=74337) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 21:56:06 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:56:06 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:56:06 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:56:06 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:56:07 user nova-compute[74337]: DEBUG nova.compute.manager [req-330b9a4f-bffe-4223-9fe2-0bfcf3d941b6 req-ecc8f17f-fc06-4e19-90dd-00433dbbdef8 service nova] [instance: e326a14c-61d7-4dca-b55f-db0f3ab0d14e] Received event network-vif-unplugged-790838d0-4783-4446-84a9-2932fe826a36 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:56:07 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-330b9a4f-bffe-4223-9fe2-0bfcf3d941b6 req-ecc8f17f-fc06-4e19-90dd-00433dbbdef8 service nova] Acquiring lock "e326a14c-61d7-4dca-b55f-db0f3ab0d14e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:56:07 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-330b9a4f-bffe-4223-9fe2-0bfcf3d941b6 req-ecc8f17f-fc06-4e19-90dd-00433dbbdef8 service nova] Lock "e326a14c-61d7-4dca-b55f-db0f3ab0d14e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:56:07 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-330b9a4f-bffe-4223-9fe2-0bfcf3d941b6 req-ecc8f17f-fc06-4e19-90dd-00433dbbdef8 service nova] Lock "e326a14c-61d7-4dca-b55f-db0f3ab0d14e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:56:07 user nova-compute[74337]: DEBUG nova.compute.manager [req-330b9a4f-bffe-4223-9fe2-0bfcf3d941b6 req-ecc8f17f-fc06-4e19-90dd-00433dbbdef8 service nova] [instance: e326a14c-61d7-4dca-b55f-db0f3ab0d14e] No waiting events found dispatching network-vif-unplugged-790838d0-4783-4446-84a9-2932fe826a36 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:56:07 user nova-compute[74337]: DEBUG nova.compute.manager [req-330b9a4f-bffe-4223-9fe2-0bfcf3d941b6 req-ecc8f17f-fc06-4e19-90dd-00433dbbdef8 service nova] [instance: e326a14c-61d7-4dca-b55f-db0f3ab0d14e] Received event network-vif-unplugged-790838d0-4783-4446-84a9-2932fe826a36 for instance with task_state deleting. {{(pid=74337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 21:56:07 user nova-compute[74337]: INFO nova.scheduler.client.report [None req-45b12277-6a1b-4d81-91c3-d20246266eec tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] Deleted allocations for instance 0323b854-c7a1-42e8-ad85-1e929caa6e9d
Oct 23 21:56:07 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-45b12277-6a1b-4d81-91c3-d20246266eec tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:56:07 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-45b12277-6a1b-4d81-91c3-d20246266eec tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:56:07 user nova-compute[74337]: DEBUG nova.objects.instance [None req-45b12277-6a1b-4d81-91c3-d20246266eec tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] Lazy-loading 'numa_topology' on Instance uuid 0323b854-c7a1-42e8-ad85-1e929caa6e9d {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:56:07 user nova-compute[74337]: DEBUG nova.objects.base [None req-45b12277-6a1b-4d81-91c3-d20246266eec tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] Object Instance<0323b854-c7a1-42e8-ad85-1e929caa6e9d> lazy-loaded attributes: resources,numa_topology {{(pid=74337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 21:56:07 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: e326a14c-61d7-4dca-b55f-db0f3ab0d14e] Instance destroyed successfully.
Oct 23 21:56:07 user nova-compute[74337]: DEBUG nova.objects.instance [None req-7746e391-518d-493d-a899-257d2884bb5e tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lazy-loading 'resources' on Instance uuid e326a14c-61d7-4dca-b55f-db0f3ab0d14e {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:56:07 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-7746e391-518d-493d-a899-257d2884bb5e tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:52:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-883589621',display_name='tempest-AttachVolumeTestJSON-server-883589621',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-883589621',id=33,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMXiawn/xXLlNXuals9N80SKTPgilbzx8zrm5REUNwdQeLjTRNZtsfMfVN4o9Kl0PK5yeLRqeG4cHL1COX1nhO6WdGVYSwhLFqkXML72p3hCeKlcOjllsZNPOU9LYZyljQ==',key_name='tempest-keypair-200987838',keypairs=<?>,launch_index=0,launched_at=2023-10-23T21:52:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b96dc585a51343db94529e22adbd6ef3',ramdisk_id='',reservation_id='r-mzg5qo4n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-786463768',owner_user_name='tempest-AttachVolumeTestJSON-786463768-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T21:52:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c82d267bc4d142f8b48c66ffab721618',uuid=e326a14c-61d7-4dca-b55f-db0f3ab0d14e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "790838d0-4783-4446-84a9-2932fe826a36", "address": "fa:16:3e:99:b7:b3", "network": {"id": "fe0a9f00-e17b-4064-96d2-fd1cc848afb2", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1294741219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96dc585a51343db94529e22adbd6ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap790838d0-47", "ovs_interfaceid": "790838d0-4783-4446-84a9-2932fe826a36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 21:56:07 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-7746e391-518d-493d-a899-257d2884bb5e tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Converting VIF {"id": "790838d0-4783-4446-84a9-2932fe826a36", "address": "fa:16:3e:99:b7:b3", "network": {"id": "fe0a9f00-e17b-4064-96d2-fd1cc848afb2", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1294741219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96dc585a51343db94529e22adbd6ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap790838d0-47", "ovs_interfaceid": "790838d0-4783-4446-84a9-2932fe826a36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:56:07 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-7746e391-518d-493d-a899-257d2884bb5e tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:99:b7:b3,bridge_name='br-int',has_traffic_filtering=True,id=790838d0-4783-4446-84a9-2932fe826a36,network=Network(fe0a9f00-e17b-4064-96d2-fd1cc848afb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap790838d0-47') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:56:07 user nova-compute[74337]: DEBUG os_vif [None req-7746e391-518d-493d-a899-257d2884bb5e tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:b7:b3,bridge_name='br-int',has_traffic_filtering=True,id=790838d0-4783-4446-84a9-2932fe826a36,network=Network(fe0a9f00-e17b-4064-96d2-fd1cc848afb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap790838d0-47') {{(pid=74337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 21:56:07 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:56:07 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap790838d0-47, bridge=br-int, if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:56:07 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:56:07 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:56:07 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:56:07 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=eece98a7-46c7-429c-9fa7-9e7a52c10fc3) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:56:07 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:56:07 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:56:07 user nova-compute[74337]: INFO os_vif [None req-7746e391-518d-493d-a899-257d2884bb5e tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:b7:b3,bridge_name='br-int',has_traffic_filtering=True,id=790838d0-4783-4446-84a9-2932fe826a36,network=Network(fe0a9f00-e17b-4064-96d2-fd1cc848afb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap790838d0-47')
Oct 23 21:56:07 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-7746e391-518d-493d-a899-257d2884bb5e tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: e326a14c-61d7-4dca-b55f-db0f3ab0d14e] Deleting instance files /opt/stack/data/nova/instances/e326a14c-61d7-4dca-b55f-db0f3ab0d14e_del
Oct 23 21:56:07 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-7746e391-518d-493d-a899-257d2884bb5e tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: e326a14c-61d7-4dca-b55f-db0f3ab0d14e] Deletion of /opt/stack/data/nova/instances/e326a14c-61d7-4dca-b55f-db0f3ab0d14e_del complete
Oct 23 21:56:07 user nova-compute[74337]: INFO nova.compute.manager [None req-7746e391-518d-493d-a899-257d2884bb5e tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] [instance: e326a14c-61d7-4dca-b55f-db0f3ab0d14e] Took 0.98 seconds to destroy the instance on the hypervisor.
Oct 23 21:56:07 user nova-compute[74337]: DEBUG oslo.service.loopingcall [None req-7746e391-518d-493d-a899-257d2884bb5e tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74337) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 21:56:07 user nova-compute[74337]: DEBUG nova.compute.manager [-] [instance: e326a14c-61d7-4dca-b55f-db0f3ab0d14e] Deallocating network for instance {{(pid=74337) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 21:56:07 user nova-compute[74337]: DEBUG nova.network.neutron [-] [instance: e326a14c-61d7-4dca-b55f-db0f3ab0d14e] deallocate_for_instance() {{(pid=74337) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 21:56:07 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-45b12277-6a1b-4d81-91c3-d20246266eec tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:56:07 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-45b12277-6a1b-4d81-91c3-d20246266eec tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:56:08 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-45b12277-6a1b-4d81-91c3-d20246266eec tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.462s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:56:08 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-45b12277-6a1b-4d81-91c3-d20246266eec tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] Lock "0323b854-c7a1-42e8-ad85-1e929caa6e9d" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 4.678s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:56:08 user nova-compute[74337]: INFO nova.compute.manager [None req-959c367c-cde0-4a78-bd87-5b733e1ec0c9 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: bf53e0fc-71d1-48fa-b0b4-ed3400a21c38] Took 10.03 seconds to detach 1 volumes for instance.
Oct 23 21:56:08 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-959c367c-cde0-4a78-bd87-5b733e1ec0c9 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:56:08 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-959c367c-cde0-4a78-bd87-5b733e1ec0c9 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:56:08 user nova-compute[74337]: DEBUG nova.network.neutron [-] [instance: e326a14c-61d7-4dca-b55f-db0f3ab0d14e] Updating instance_info_cache with network_info: [] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:56:08 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-959c367c-cde0-4a78-bd87-5b733e1ec0c9 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:56:08 user nova-compute[74337]: INFO nova.compute.manager [-] [instance: e326a14c-61d7-4dca-b55f-db0f3ab0d14e] Took 1.01 seconds to deallocate network for instance.
Oct 23 21:56:08 user nova-compute[74337]: DEBUG nova.compute.manager [req-b8b56664-8a6d-423d-83b3-7621d27ffcbe req-282e536c-56a2-44a4-9401-7fd1b972ba6c service nova] [instance: e326a14c-61d7-4dca-b55f-db0f3ab0d14e] Received event network-vif-deleted-790838d0-4783-4446-84a9-2932fe826a36 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:56:08 user nova-compute[74337]: INFO nova.compute.manager [req-b8b56664-8a6d-423d-83b3-7621d27ffcbe req-282e536c-56a2-44a4-9401-7fd1b972ba6c service nova] [instance: e326a14c-61d7-4dca-b55f-db0f3ab0d14e] Neutron deleted interface 790838d0-4783-4446-84a9-2932fe826a36; detaching it from the instance and deleting it from the info cache
Oct 23 21:56:08 user nova-compute[74337]: DEBUG nova.network.neutron [req-b8b56664-8a6d-423d-83b3-7621d27ffcbe req-282e536c-56a2-44a4-9401-7fd1b972ba6c service nova] [instance: e326a14c-61d7-4dca-b55f-db0f3ab0d14e] Updating instance_info_cache with network_info: [] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:56:08 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-959c367c-cde0-4a78-bd87-5b733e1ec0c9 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:56:08 user nova-compute[74337]: DEBUG nova.compute.manager [req-b8b56664-8a6d-423d-83b3-7621d27ffcbe req-282e536c-56a2-44a4-9401-7fd1b972ba6c service nova] [instance: e326a14c-61d7-4dca-b55f-db0f3ab0d14e] Detach interface failed, port_id=790838d0-4783-4446-84a9-2932fe826a36, reason: Instance e326a14c-61d7-4dca-b55f-db0f3ab0d14e could not be found. {{(pid=74337) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 23 21:56:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:56:08 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-959c367c-cde0-4a78-bd87-5b733e1ec0c9 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.404s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:56:08 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-7746e391-518d-493d-a899-257d2884bb5e tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:56:08 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-7746e391-518d-493d-a899-257d2884bb5e tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:56:08 user nova-compute[74337]: INFO nova.scheduler.client.report [None req-959c367c-cde0-4a78-bd87-5b733e1ec0c9 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Deleted allocations for instance bf53e0fc-71d1-48fa-b0b4-ed3400a21c38
Oct 23 21:56:08 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-959c367c-cde0-4a78-bd87-5b733e1ec0c9 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lock "bf53e0fc-71d1-48fa-b0b4-ed3400a21c38" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 12.804s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:56:09 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-7746e391-518d-493d-a899-257d2884bb5e tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:56:09 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-7746e391-518d-493d-a899-257d2884bb5e tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:56:09 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-7746e391-518d-493d-a899-257d2884bb5e tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.336s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:56:09 user nova-compute[74337]: INFO nova.scheduler.client.report [None req-7746e391-518d-493d-a899-257d2884bb5e tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Deleted allocations for instance e326a14c-61d7-4dca-b55f-db0f3ab0d14e
Oct 23 21:56:09 user nova-compute[74337]: DEBUG nova.compute.manager [req-320342a0-5e55-4ec0-a692-ffd8c72526a1 req-8d0d9ddc-7efb-45b2-9e3c-d508e82abec6 service nova] [instance: e326a14c-61d7-4dca-b55f-db0f3ab0d14e] Received event network-vif-plugged-790838d0-4783-4446-84a9-2932fe826a36 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:56:09 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-320342a0-5e55-4ec0-a692-ffd8c72526a1 req-8d0d9ddc-7efb-45b2-9e3c-d508e82abec6 service nova] Acquiring lock "e326a14c-61d7-4dca-b55f-db0f3ab0d14e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:56:09 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-320342a0-5e55-4ec0-a692-ffd8c72526a1 req-8d0d9ddc-7efb-45b2-9e3c-d508e82abec6 service nova] Lock "e326a14c-61d7-4dca-b55f-db0f3ab0d14e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:56:09 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-320342a0-5e55-4ec0-a692-ffd8c72526a1 req-8d0d9ddc-7efb-45b2-9e3c-d508e82abec6 service nova] Lock "e326a14c-61d7-4dca-b55f-db0f3ab0d14e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:56:09 user nova-compute[74337]: DEBUG nova.compute.manager [req-320342a0-5e55-4ec0-a692-ffd8c72526a1 req-8d0d9ddc-7efb-45b2-9e3c-d508e82abec6 service nova] [instance: e326a14c-61d7-4dca-b55f-db0f3ab0d14e] No waiting events found dispatching network-vif-plugged-790838d0-4783-4446-84a9-2932fe826a36 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:56:09 user nova-compute[74337]: WARNING nova.compute.manager [req-320342a0-5e55-4ec0-a692-ffd8c72526a1 req-8d0d9ddc-7efb-45b2-9e3c-d508e82abec6 service nova] [instance: e326a14c-61d7-4dca-b55f-db0f3ab0d14e] Received unexpected event network-vif-plugged-790838d0-4783-4446-84a9-2932fe826a36 for instance with vm_state deleted and task_state None.
Oct 23 21:56:09 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-7746e391-518d-493d-a899-257d2884bb5e tempest-AttachVolumeTestJSON-786463768 tempest-AttachVolumeTestJSON-786463768-project-member] Lock "e326a14c-61d7-4dca-b55f-db0f3ab0d14e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.594s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:56:12 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:56:13 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:56:13 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:56:13 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:56:13 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 21:56:13 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:56:14 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:56:14 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Starting heal instance info cache {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 21:56:14 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "refresh_cache-86f56afb-77e6-4378-b441-5cf507a0fbe7" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:56:14 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquired lock "refresh_cache-86f56afb-77e6-4378-b441-5cf507a0fbe7" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:56:14 user nova-compute[74337]: DEBUG nova.network.neutron [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Forcefully refreshing network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 21:56:14 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Acquiring lock "065c9704-8619-494a-9459-6e53f3a07f9e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:56:14 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "065c9704-8619-494a-9459-6e53f3a07f9e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:56:15 user nova-compute[74337]: DEBUG nova.compute.manager [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 065c9704-8619-494a-9459-6e53f3a07f9e] Starting instance... {{(pid=74337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 21:56:15 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:56:15 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:56:15 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 21:56:15 user nova-compute[74337]: INFO nova.compute.claims [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 065c9704-8619-494a-9459-6e53f3a07f9e] Claim successful on node user
Oct 23 21:56:15 user nova-compute[74337]: DEBUG nova.network.neutron [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Updating instance_info_cache with network_info: [{"id": "148d28e8-2783-44a9-a08e-c648f0aa9489", "address": "fa:16:3e:47:98:97", "network": {"id": "aff1f95f-fda8-4f0f-8d10-7e3d587e4fda", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2048135647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1f57e58a9ec4c6384dc0d3ca58eb610", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap148d28e8-27", "ovs_interfaceid": "148d28e8-2783-44a9-a08e-c648f0aa9489", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:56:15 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Releasing lock "refresh_cache-86f56afb-77e6-4378-b441-5cf507a0fbe7" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:56:15 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Updated the network info_cache for instance {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 21:56:15 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:56:15 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:56:15 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:56:15 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.394s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:56:15 user nova-compute[74337]: DEBUG nova.compute.manager [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 065c9704-8619-494a-9459-6e53f3a07f9e] Start building networks asynchronously for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 21:56:15 user nova-compute[74337]: DEBUG nova.compute.manager [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 065c9704-8619-494a-9459-6e53f3a07f9e] Allocating IP information in the background. {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 21:56:15 user nova-compute[74337]: DEBUG nova.network.neutron [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 065c9704-8619-494a-9459-6e53f3a07f9e] allocate_for_instance() {{(pid=74337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 21:56:15 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 065c9704-8619-494a-9459-6e53f3a07f9e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 21:56:15 user nova-compute[74337]: DEBUG nova.compute.manager [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 065c9704-8619-494a-9459-6e53f3a07f9e] Start building block device mappings for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 21:56:15 user nova-compute[74337]: INFO nova.virt.block_device [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 065c9704-8619-494a-9459-6e53f3a07f9e] Booting with volume ec9ef65f-2d9a-4950-8f01-5e837152c8df at /dev/vda
Oct 23 21:56:15 user nova-compute[74337]: DEBUG nova.policy [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0c3e635e8e5447138a7f2db11695574c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb567547bd4941fb87435a841c9d17c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74337) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 21:56:15 user nova-compute[74337]: DEBUG os_brick.utils [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:56:15 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:56:15 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:56:15 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ac1614-80be-4777-97f2-972348078059]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f34011b66e40\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:56:15 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:56:15 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:56:15 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb56193-a94b-41a2-b060-29f3d3ac6190]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:56:15 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:56:15 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:56:15 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c2fabe-8cbe-40df-a18a-fd858be9ba6a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:56:15 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c55c33d0-3dd8-4606-b977-f958338f190d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:56:15 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Running cmd (subprocess): nvme version {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:56:15 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] 'nvme version' failed. Not Retrying. {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 21:56:15 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] nvme not present on system {{(pid=74337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 21:56:15 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:56:15 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 21:56:15 user nova-compute[74337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 21:56:15 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d988750-595d-4e48-8e0c-998bbe23cfbd]: (4, '') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:56:15 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 21:56:15 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 21:56:15 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] LIGHTOS: no hostnqn found. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 21:56:15 user nova-compute[74337]: DEBUG os_brick.utils [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f34011b66e40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:56:15 user nova-compute[74337]: DEBUG nova.virt.block_device [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 065c9704-8619-494a-9459-6e53f3a07f9e] Updating existing volume attachment record: 24c64f7d-2ca2-4218-8e0b-d15b38b4801f {{(pid=74337) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 21:56:16 user nova-compute[74337]: DEBUG nova.network.neutron [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 065c9704-8619-494a-9459-6e53f3a07f9e] Successfully created port: c4a05fc8-3976-4c52-a1c4-d2bfb51ba32b {{(pid=74337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 21:56:16 user nova-compute[74337]: DEBUG nova.network.neutron [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 065c9704-8619-494a-9459-6e53f3a07f9e] Successfully updated port: c4a05fc8-3976-4c52-a1c4-d2bfb51ba32b {{(pid=74337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 21:56:16 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Acquiring lock "refresh_cache-065c9704-8619-494a-9459-6e53f3a07f9e" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:56:16 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Acquired lock "refresh_cache-065c9704-8619-494a-9459-6e53f3a07f9e" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:56:16 user nova-compute[74337]: DEBUG nova.network.neutron [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 065c9704-8619-494a-9459-6e53f3a07f9e] Building network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 21:56:17 user nova-compute[74337]: DEBUG nova.compute.manager [req-776edf06-ce5d-49da-b9cc-d5fd5019442e req-3cd301d1-49be-4657-9cd2-5a20ab96a3eb service nova] [instance: 065c9704-8619-494a-9459-6e53f3a07f9e] Received event network-changed-c4a05fc8-3976-4c52-a1c4-d2bfb51ba32b {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:56:17 user nova-compute[74337]: DEBUG nova.compute.manager [req-776edf06-ce5d-49da-b9cc-d5fd5019442e req-3cd301d1-49be-4657-9cd2-5a20ab96a3eb service nova] [instance: 065c9704-8619-494a-9459-6e53f3a07f9e] Refreshing instance network info cache due to event network-changed-c4a05fc8-3976-4c52-a1c4-d2bfb51ba32b. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 21:56:17 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-776edf06-ce5d-49da-b9cc-d5fd5019442e req-3cd301d1-49be-4657-9cd2-5a20ab96a3eb service nova] Acquiring lock "refresh_cache-065c9704-8619-494a-9459-6e53f3a07f9e" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:56:17 user nova-compute[74337]: DEBUG nova.network.neutron [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 065c9704-8619-494a-9459-6e53f3a07f9e] Instance cache missing network info. {{(pid=74337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 21:56:17 user nova-compute[74337]: DEBUG nova.network.neutron [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 065c9704-8619-494a-9459-6e53f3a07f9e] Updating instance_info_cache with network_info: [{"id": "c4a05fc8-3976-4c52-a1c4-d2bfb51ba32b", "address": "fa:16:3e:8e:9f:f6", "network": {"id": "5a18e96f-a6eb-4989-9be3-154b54928b03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-507511840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb567547bd4941fb87435a841c9d17c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4a05fc8-39", "ovs_interfaceid": "c4a05fc8-3976-4c52-a1c4-d2bfb51ba32b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:56:17 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Releasing lock "refresh_cache-065c9704-8619-494a-9459-6e53f3a07f9e" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:56:17 user nova-compute[74337]: DEBUG nova.compute.manager [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 065c9704-8619-494a-9459-6e53f3a07f9e] Instance network_info: |[{"id": "c4a05fc8-3976-4c52-a1c4-d2bfb51ba32b", "address": "fa:16:3e:8e:9f:f6", "network": {"id": "5a18e96f-a6eb-4989-9be3-154b54928b03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-507511840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb567547bd4941fb87435a841c9d17c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4a05fc8-39", "ovs_interfaceid": "c4a05fc8-3976-4c52-a1c4-d2bfb51ba32b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 21:56:17 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-776edf06-ce5d-49da-b9cc-d5fd5019442e req-3cd301d1-49be-4657-9cd2-5a20ab96a3eb service nova] Acquired lock "refresh_cache-065c9704-8619-494a-9459-6e53f3a07f9e" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:56:17 user nova-compute[74337]: DEBUG nova.network.neutron [req-776edf06-ce5d-49da-b9cc-d5fd5019442e req-3cd301d1-49be-4657-9cd2-5a20ab96a3eb service nova] [instance: 065c9704-8619-494a-9459-6e53f3a07f9e] Refreshing network info cache for port c4a05fc8-3976-4c52-a1c4-d2bfb51ba32b {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 21:56:17 user nova-compute[74337]: DEBUG nova.network.neutron [req-776edf06-ce5d-49da-b9cc-d5fd5019442e req-3cd301d1-49be-4657-9cd2-5a20ab96a3eb service nova] [instance: 065c9704-8619-494a-9459-6e53f3a07f9e] Updated VIF entry in instance network info cache for port c4a05fc8-3976-4c52-a1c4-d2bfb51ba32b. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 21:56:17 user nova-compute[74337]: DEBUG nova.network.neutron [req-776edf06-ce5d-49da-b9cc-d5fd5019442e req-3cd301d1-49be-4657-9cd2-5a20ab96a3eb service nova] [instance: 065c9704-8619-494a-9459-6e53f3a07f9e] Updating instance_info_cache with network_info: [{"id": "c4a05fc8-3976-4c52-a1c4-d2bfb51ba32b", "address": "fa:16:3e:8e:9f:f6", "network": {"id": "5a18e96f-a6eb-4989-9be3-154b54928b03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-507511840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb567547bd4941fb87435a841c9d17c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4a05fc8-39", "ovs_interfaceid": "c4a05fc8-3976-4c52-a1c4-d2bfb51ba32b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:56:17 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-776edf06-ce5d-49da-b9cc-d5fd5019442e req-3cd301d1-49be-4657-9cd2-5a20ab96a3eb service nova] Releasing lock "refresh_cache-065c9704-8619-494a-9459-6e53f3a07f9e" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:56:17 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:56:18 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:56:18 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:56:19 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:56:21 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:56:21 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:56:21 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:56:21 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:56:21 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Auditing locally available compute resources for user (node: user) {{(pid=74337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 21:56:21 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 21:56:21 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 21:56:21 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5d9d286-4837-4168-a4fe-1bc09e372654/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:56:21 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5d9d286-4837-4168-a4fe-1bc09e372654/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:56:21 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5d9d286-4837-4168-a4fe-1bc09e372654/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:56:21 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5d9d286-4837-4168-a4fe-1bc09e372654/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:56:21 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=74337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 21:56:21 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/547c4d4c-e0dd-495a-b83f-98426d0a4a99/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:56:22 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/547c4d4c-e0dd-495a-b83f-98426d0a4a99/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:56:22 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/547c4d4c-e0dd-495a-b83f-98426d0a4a99/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:56:22 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/547c4d4c-e0dd-495a-b83f-98426d0a4a99/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:56:22 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e05fd36-ee44-4992-80a9-f95af608b9f5/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:56:22 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e05fd36-ee44-4992-80a9-f95af608b9f5/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:56:22 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e05fd36-ee44-4992-80a9-f95af608b9f5/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:56:22 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:56:22 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e05fd36-ee44-4992-80a9-f95af608b9f5/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:56:22 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 21:56:22 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1189976f-8d02-468d-8fa7-bd5594c5f85a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:56:22 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1189976f-8d02-468d-8fa7-bd5594c5f85a/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:56:22 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1189976f-8d02-468d-8fa7-bd5594c5f85a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:56:23 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1189976f-8d02-468d-8fa7-bd5594c5f85a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:56:23 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:56:23 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:56:23 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Hypervisor/Node resource view: name=user free_ram=7965MB free_disk=25.096099853515625GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 21:56:23 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:56:23 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:56:23 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 1189976f-8d02-468d-8fa7-bd5594c5f85a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:56:23 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 547c4d4c-e0dd-495a-b83f-98426d0a4a99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:56:23 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 00f757cf-e5dd-476f-81c6-670ed2bf6938 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Oct 23 21:56:23 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:56:23 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 1e05fd36-ee44-4992-80a9-f95af608b9f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:56:23 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance d5d9d286-4837-4168-a4fe-1bc09e372654 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:56:23 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 86f56afb-77e6-4378-b441-5cf507a0fbe7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:56:23 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance bc4c3e54-a845-4ea8-9ffc-a75d42a51788 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:56:23 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 065c9704-8619-494a-9459-6e53f3a07f9e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:56:23 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 21:56:23 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 21:56:23 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:56:23 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:56:23 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Compute_service record updated for user:user {{(pid=74337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 21:56:23 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.406s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:56:23 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:56:27 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:56:28 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:56:30 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:56:32 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:56:33 user nova-compute[74337]: DEBUG nova.compute.manager [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 065c9704-8619-494a-9459-6e53f3a07f9e] Start spawning the instance on the hypervisor. {{(pid=74337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 21:56:33 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 065c9704-8619-494a-9459-6e53f3a07f9e] Creating instance directory {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 21:56:33 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 065c9704-8619-494a-9459-6e53f3a07f9e] Creating image(s)
Oct 23 21:56:33 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 065c9704-8619-494a-9459-6e53f3a07f9e] Did not create local disks {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 23 21:56:33 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 065c9704-8619-494a-9459-6e53f3a07f9e] Ensure instance console log exists: /opt/stack/data/nova/instances/065c9704-8619-494a-9459-6e53f3a07f9e/console.log {{(pid=74337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 21:56:33 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:56:33 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:56:33 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:56:33 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 065c9704-8619-494a-9459-6e53f3a07f9e] Start _get_guest_xml network_info=[{"id": "c4a05fc8-3976-4c52-a1c4-d2bfb51ba32b", "address": "fa:16:3e:8e:9f:f6", "network": {"id": "5a18e96f-a6eb-4989-9be3-154b54928b03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-507511840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb567547bd4941fb87435a841c9d17c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4a05fc8-39", "ovs_interfaceid": "c4a05fc8-3976-4c52-a1c4-d2bfb51ba32b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '24c64f7d-2ca2-4218-8e0b-d15b38b4801f', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ec9ef65f-2d9a-4950-8f01-5e837152c8df', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fvPkjtCb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '065c9704-8619-494a-9459-6e53f3a07f9e', 'attached_at': '', 'detached_at': '', 'volume_id': 'ec9ef65f-2d9a-4950-8f01-5e837152c8df', 'serial': 'ec9ef65f-2d9a-4950-8f01-5e837152c8df'}, 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 21:56:33 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:56:33 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:56:33 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 21:56:33 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] CPU controller missing on host. {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 21:56:33 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 21:56:33 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] CPU controller found on host. {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 21:56:33 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 21:56:33 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T21:29:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 21:56:33 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Flavor limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 21:56:33 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Image limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 21:56:33 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Flavor pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 21:56:33 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Image pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 21:56:33 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 21:56:33 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 21:56:33 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 21:56:33 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Got 1 possible topologies {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 21:56:33 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 21:56:33 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 21:56:33 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 065c9704-8619-494a-9459-6e53f3a07f9e] Calling os-brick to attach iSCSI Volume {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 21:56:33 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ec9ef65f-2d9a-4950-8f01-5e837152c8df', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fvPkjtCb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:56:33 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:56:33 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:56:33 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:56:33 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:56:33 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec9ef65f-2d9a-4950-8f01-5e837152c8df" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:56:33 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec9ef65f-2d9a-4950-8f01-5e837152c8df" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:56:33 user nova-compute[74337]: INFO os_brick.initiator.connectors.iscsi [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 21:56:33 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec9ef65f-2d9a-4950-8f01-5e837152c8df -p 172.16.0.220:3260 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:56:33 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec9ef65f-2d9a-4950-8f01-5e837152c8df -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:56:33 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[88798ad4-4fdd-4498-9c68-4fc1f5f94b00]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:56:33 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 21:56:33 user nova-compute[74337]:  {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:56:33 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec9ef65f-2d9a-4950-8f01-5e837152c8df -p 172.16.0.220:3260 --interface default --op new {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:56:33 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec9ef65f-2d9a-4950-8f01-5e837152c8df -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:56:33 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d323f67-81cc-4c9b-b4ab-937b26d8803d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ec9ef65f-2d9a-4950-8f01-5e837152c8df] added\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:56:33 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ec9ef65f-2d9a-4950-8f01-5e837152c8df] added
Oct 23 21:56:33 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:56:33 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec9ef65f-2d9a-4950-8f01-5e837152c8df -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:56:33 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec9ef65f-2d9a-4950-8f01-5e837152c8df -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:56:33 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[48f46518-51db-4895-868d-a4ab96949ce1]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:56:33 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:56:33 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec9ef65f-2d9a-4950-8f01-5e837152c8df -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:56:33 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec9ef65f-2d9a-4950-8f01-5e837152c8df -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:56:33 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[333fc719-bf1e-47bd-967a-f96c17709e80]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:56:33 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:56:33 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec9ef65f-2d9a-4950-8f01-5e837152c8df -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fvPkjtCb {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:56:33 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec9ef65f-2d9a-4950-8f01-5e837152c8df -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fvPkjtCb" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:56:33 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3a100ae-024a-48af-a46a-3f612fe64d7a]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:56:33 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fvPkjtCb'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:56:33 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec9ef65f-2d9a-4950-8f01-5e837152c8df -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:56:33 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec9ef65f-2d9a-4950-8f01-5e837152c8df -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:56:33 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d43dc6-8697-491a-9a5c-710ad623059a]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:56:33 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:56:33 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:56:33 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:56:33 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec30472a-58d4-49f2-8814-4d55163fa883]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:56:33 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:56:33 user nova-compute[74337]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 (non-flash)
Oct 23 21:56:33 user nova-compute[74337]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 (non-flash)
Oct 23 21:56:33 user nova-compute[74337]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7 (non-flash)
Oct 23 21:56:33 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:56:33 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:56:33 user nova-compute[74337]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 (non-flash)
Oct 23 21:56:33 user nova-compute[74337]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 (non-flash)
Oct 23 21:56:33 user nova-compute[74337]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7 (non-flash)
Oct 23 21:56:33 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:56:33 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec9ef65f-2d9a-4950-8f01-5e837152c8df -p 172.16.0.220:3260 --login {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:56:33 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec9ef65f-2d9a-4950-8f01-5e837152c8df -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:56:33 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc5f212-0db1-434b-a7f3-91c9cf1e85ee]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ec9ef65f-2d9a-4950-8f01-5e837152c8df, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ec9ef65f-2d9a-4950-8f01-5e837152c8df, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:56:33 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ec9ef65f-2d9a-4950-8f01-5e837152c8df, portal: 172.16.0.220,3260]
Oct 23 21:56:33 user nova-compute[74337]: Login to [iface: default, target: iqn.2010-10.org.openstack:ec9ef65f-2d9a-4950-8f01-5e837152c8df, portal: 172.16.0.220,3260] successful.
Oct 23 21:56:33 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:56:33 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec9ef65f-2d9a-4950-8f01-5e837152c8df -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:56:33 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec9ef65f-2d9a-4950-8f01-5e837152c8df -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:56:33 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b90029c-5611-4d94-8e69-75e61b73063f]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:56:33 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:56:33 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:56:33 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:56:33 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[97e717f4-65bc-4868-8efd-1a4587ae5f71]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec9ef65f-2d9a-4950-8f01-5e837152c8df (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:56:33 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:56:33 user nova-compute[74337]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 (non-flash)
Oct 23 21:56:33 user nova-compute[74337]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 (non-flash)
Oct 23 21:56:33 user nova-compute[74337]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7 (non-flash)
Oct 23 21:56:33 user nova-compute[74337]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec9ef65f-2d9a-4950-8f01-5e837152c8df (non-flash)
Oct 23 21:56:33 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:56:33 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:56:33 user nova-compute[74337]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 (non-flash)
Oct 23 21:56:33 user nova-compute[74337]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 (non-flash)
Oct 23 21:56:33 user nova-compute[74337]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7 (non-flash)
Oct 23 21:56:33 user nova-compute[74337]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec9ef65f-2d9a-4950-8f01-5e837152c8df (non-flash)
Oct 23 21:56:33 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:56:33 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec9ef65f-2d9a-4950-8f01-5e837152c8df" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:56:33 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Connected to 172.16.0.220:3260 {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 21:56:33 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] HCTL ('35', '-', '-', 0) found on session 43 with lun 0 {{(pid=74337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 21:56:33 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 21:56:33 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:56:33 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:56:33 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c23bca5-d9d1-4270-b548-089be2601af9]: (4, ('- - 0', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:56:33 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Searching for a device in session 43 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 21:56:33 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:ec9ef65f-2d9a-4950-8f01-5e837152c8df', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fvPkjtCb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 21:56:33 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:56:34 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.336s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:56:34 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] <== connect_volume: return (1337ms) {'type': 'block', 'scsi_wwn': '23230353264646136', 'path': '/dev/sdd'} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:56:34 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 065c9704-8619-494a-9459-6e53f3a07f9e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23230353264646136', 'path': '/dev/sdd'} {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 21:56:34 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:56:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-820629783',display_name='tempest-TestVolumeBootPattern-server-820629783',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-820629783',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF9NMFNWTU3BVoh69lm2h364CNXP9OO2Sq0+VU67LFY2Y7YP31lo2g7Nqc/sdO6ndxwSu3pXMChCzpRUGVair3TDlV76zriaKktCrpgsBnYg9q7WYnK8Iuk7Ag22Kj7gAw==',key_name='tempest-TestVolumeBootPattern-1223802412',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb567547bd4941fb87435a841c9d17c4',ramdisk_id='',reservation_id='r-onnti6fc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-499971371',owner_user_name='tempest-TestVolumeBootPattern-499971371-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:56:16Z,user_data=None,user_id='0c3e635e8e5447138a7f2db11695574c',uuid=065c9704-8619-494a-9459-6e53f3a07f9e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c4a05fc8-3976-4c52-a1c4-d2bfb51ba32b", "address": "fa:16:3e:8e:9f:f6", "network": {"id": "5a18e96f-a6eb-4989-9be3-154b54928b03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-507511840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb567547bd4941fb87435a841c9d17c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4a05fc8-39", "ovs_interfaceid": "c4a05fc8-3976-4c52-a1c4-d2bfb51ba32b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 21:56:34 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Converting VIF {"id": "c4a05fc8-3976-4c52-a1c4-d2bfb51ba32b", "address": "fa:16:3e:8e:9f:f6", "network": {"id": "5a18e96f-a6eb-4989-9be3-154b54928b03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-507511840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb567547bd4941fb87435a841c9d17c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4a05fc8-39", "ovs_interfaceid": "c4a05fc8-3976-4c52-a1c4-d2bfb51ba32b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:56:34 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:9f:f6,bridge_name='br-int',has_traffic_filtering=True,id=c4a05fc8-3976-4c52-a1c4-d2bfb51ba32b,network=Network(5a18e96f-a6eb-4989-9be3-154b54928b03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4a05fc8-39') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:56:34 user nova-compute[74337]: DEBUG nova.objects.instance [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lazy-loading 'pci_devices' on Instance uuid 065c9704-8619-494a-9459-6e53f3a07f9e {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:56:34 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 065c9704-8619-494a-9459-6e53f3a07f9e] End _get_guest_xml xml=<domain type="kvm">
Oct 23 21:56:34 user nova-compute[74337]:   <uuid>065c9704-8619-494a-9459-6e53f3a07f9e</uuid>
Oct 23 21:56:34 user nova-compute[74337]:   <name>instance-00000026</name>
Oct 23 21:56:34 user nova-compute[74337]:   <memory>524288</memory>
Oct 23 21:56:34 user nova-compute[74337]:   <vcpu>1</vcpu>
Oct 23 21:56:34 user nova-compute[74337]:   <metadata>
Oct 23 21:56:34 user nova-compute[74337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 21:56:34 user nova-compute[74337]:       <nova:package version="0.0.0"/>
Oct 23 21:56:34 user nova-compute[74337]:       <nova:name>tempest-TestVolumeBootPattern-server-820629783</nova:name>
Oct 23 21:56:34 user nova-compute[74337]:       <nova:creationTime>2023-10-23 21:56:33</nova:creationTime>
Oct 23 21:56:34 user nova-compute[74337]:       <nova:flavor name="m1.tiny">
Oct 23 21:56:34 user nova-compute[74337]:         <nova:memory>512</nova:memory>
Oct 23 21:56:34 user nova-compute[74337]:         <nova:disk>1</nova:disk>
Oct 23 21:56:34 user nova-compute[74337]:         <nova:swap>0</nova:swap>
Oct 23 21:56:34 user nova-compute[74337]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 21:56:34 user nova-compute[74337]:         <nova:vcpus>1</nova:vcpus>
Oct 23 21:56:34 user nova-compute[74337]:       </nova:flavor>
Oct 23 21:56:34 user nova-compute[74337]:       <nova:owner>
Oct 23 21:56:34 user nova-compute[74337]:         <nova:user uuid="0c3e635e8e5447138a7f2db11695574c">tempest-TestVolumeBootPattern-499971371-project-member</nova:user>
Oct 23 21:56:34 user nova-compute[74337]:         <nova:project uuid="cb567547bd4941fb87435a841c9d17c4">tempest-TestVolumeBootPattern-499971371</nova:project>
Oct 23 21:56:34 user nova-compute[74337]:       </nova:owner>
Oct 23 21:56:34 user nova-compute[74337]:       <nova:ports>
Oct 23 21:56:34 user nova-compute[74337]:         <nova:port uuid="c4a05fc8-3976-4c52-a1c4-d2bfb51ba32b">
Oct 23 21:56:34 user nova-compute[74337]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 23 21:56:34 user nova-compute[74337]:         </nova:port>
Oct 23 21:56:34 user nova-compute[74337]:       </nova:ports>
Oct 23 21:56:34 user nova-compute[74337]:     </nova:instance>
Oct 23 21:56:34 user nova-compute[74337]:   </metadata>
Oct 23 21:56:34 user nova-compute[74337]:   <sysinfo type="smbios">
Oct 23 21:56:34 user nova-compute[74337]:     <system>
Oct 23 21:56:34 user nova-compute[74337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 21:56:34 user nova-compute[74337]:       <entry name="product">OpenStack Nova</entry>
Oct 23 21:56:34 user nova-compute[74337]:       <entry name="version">0.0.0</entry>
Oct 23 21:56:34 user nova-compute[74337]:       <entry name="serial">065c9704-8619-494a-9459-6e53f3a07f9e</entry>
Oct 23 21:56:34 user nova-compute[74337]:       <entry name="uuid">065c9704-8619-494a-9459-6e53f3a07f9e</entry>
Oct 23 21:56:34 user nova-compute[74337]:       <entry name="family">Virtual Machine</entry>
Oct 23 21:56:34 user nova-compute[74337]:     </system>
Oct 23 21:56:34 user nova-compute[74337]:   </sysinfo>
Oct 23 21:56:34 user nova-compute[74337]:   <os>
Oct 23 21:56:34 user nova-compute[74337]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 21:56:34 user nova-compute[74337]:     <boot dev="hd"/>
Oct 23 21:56:34 user nova-compute[74337]:     <smbios mode="sysinfo"/>
Oct 23 21:56:34 user nova-compute[74337]:   </os>
Oct 23 21:56:34 user nova-compute[74337]:   <features>
Oct 23 21:56:34 user nova-compute[74337]:     <acpi/>
Oct 23 21:56:34 user nova-compute[74337]:     <apic/>
Oct 23 21:56:34 user nova-compute[74337]:     <vmcoreinfo/>
Oct 23 21:56:34 user nova-compute[74337]:   </features>
Oct 23 21:56:34 user nova-compute[74337]:   <clock offset="utc">
Oct 23 21:56:34 user nova-compute[74337]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 21:56:34 user nova-compute[74337]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 21:56:34 user nova-compute[74337]:     <timer name="hpet" present="no"/>
Oct 23 21:56:34 user nova-compute[74337]:   </clock>
Oct 23 21:56:34 user nova-compute[74337]:   <cpu mode="custom" match="exact">
Oct 23 21:56:34 user nova-compute[74337]:     <model>Nehalem</model>
Oct 23 21:56:34 user nova-compute[74337]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 21:56:34 user nova-compute[74337]:   </cpu>
Oct 23 21:56:34 user nova-compute[74337]:   <devices>
Oct 23 21:56:34 user nova-compute[74337]:     <disk type="block" device="disk">
Oct 23 21:56:34 user nova-compute[74337]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 21:56:34 user nova-compute[74337]:       <source dev="/dev/sdd"/>
Oct 23 21:56:34 user nova-compute[74337]:       <target dev="vda" bus="virtio"/>
Oct 23 21:56:34 user nova-compute[74337]:       <serial>ec9ef65f-2d9a-4950-8f01-5e837152c8df</serial>
Oct 23 21:56:34 user nova-compute[74337]:     </disk>
Oct 23 21:56:34 user nova-compute[74337]:     <interface type="ethernet">
Oct 23 21:56:34 user nova-compute[74337]:       <mac address="fa:16:3e:8e:9f:f6"/>
Oct 23 21:56:34 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:56:34 user nova-compute[74337]:       <mtu size="1442"/>
Oct 23 21:56:34 user nova-compute[74337]:       <target dev="tapc4a05fc8-39"/>
Oct 23 21:56:34 user nova-compute[74337]:     </interface>
Oct 23 21:56:34 user nova-compute[74337]:     <serial type="pty">
Oct 23 21:56:34 user nova-compute[74337]:       <log file="/opt/stack/data/nova/instances/065c9704-8619-494a-9459-6e53f3a07f9e/console.log" append="off"/>
Oct 23 21:56:34 user nova-compute[74337]:     </serial>
Oct 23 21:56:34 user nova-compute[74337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 21:56:34 user nova-compute[74337]:     <video>
Oct 23 21:56:34 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:56:34 user nova-compute[74337]:     </video>
Oct 23 21:56:34 user nova-compute[74337]:     <rng model="virtio">
Oct 23 21:56:34 user nova-compute[74337]:       <backend model="random">/dev/urandom</backend>
Oct 23 21:56:34 user nova-compute[74337]:     </rng>
Oct 23 21:56:34 user nova-compute[74337]:     <controller type="usb" index="0" model="none"/>
Oct 23 21:56:34 user nova-compute[74337]:     <memballoon model="virtio">
Oct 23 21:56:34 user nova-compute[74337]:       <stats period="10"/>
Oct 23 21:56:34 user nova-compute[74337]:     </memballoon>
Oct 23 21:56:34 user nova-compute[74337]:   </devices>
Oct 23 21:56:34 user nova-compute[74337]: </domain>
Oct 23 21:56:34 user nova-compute[74337]:  {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 21:56:34 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:56:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-820629783',display_name='tempest-TestVolumeBootPattern-server-820629783',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-820629783',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF9NMFNWTU3BVoh69lm2h364CNXP9OO2Sq0+VU67LFY2Y7YP31lo2g7Nqc/sdO6ndxwSu3pXMChCzpRUGVair3TDlV76zriaKktCrpgsBnYg9q7WYnK8Iuk7Ag22Kj7gAw==',key_name='tempest-TestVolumeBootPattern-1223802412',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb567547bd4941fb87435a841c9d17c4',ramdisk_id='',reservation_id='r-onnti6fc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-499971371',owner_user_name='tempest-TestVolumeBootPattern-499971371-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:56:16Z,user_data=None,user_id='0c3e635e8e5447138a7f2db11695574c',uuid=065c9704-8619-494a-9459-6e53f3a07f9e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c4a05fc8-3976-4c52-a1c4-d2bfb51ba32b", "address": "fa:16:3e:8e:9f:f6", "network": {"id": "5a18e96f-a6eb-4989-9be3-154b54928b03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-507511840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb567547bd4941fb87435a841c9d17c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4a05fc8-39", "ovs_interfaceid": "c4a05fc8-3976-4c52-a1c4-d2bfb51ba32b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 21:56:34 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Converting VIF {"id": "c4a05fc8-3976-4c52-a1c4-d2bfb51ba32b", "address": "fa:16:3e:8e:9f:f6", "network": {"id": "5a18e96f-a6eb-4989-9be3-154b54928b03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-507511840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb567547bd4941fb87435a841c9d17c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4a05fc8-39", "ovs_interfaceid": "c4a05fc8-3976-4c52-a1c4-d2bfb51ba32b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:56:34 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:9f:f6,bridge_name='br-int',has_traffic_filtering=True,id=c4a05fc8-3976-4c52-a1c4-d2bfb51ba32b,network=Network(5a18e96f-a6eb-4989-9be3-154b54928b03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4a05fc8-39') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:56:34 user nova-compute[74337]: DEBUG os_vif [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:9f:f6,bridge_name='br-int',has_traffic_filtering=True,id=c4a05fc8-3976-4c52-a1c4-d2bfb51ba32b,network=Network(5a18e96f-a6eb-4989-9be3-154b54928b03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4a05fc8-39') {{(pid=74337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 21:56:34 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:56:34 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:56:34 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 21:56:34 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:56:34 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7e660c6f-f986-51d1-bc24-d342e33d39b4', '_type': 'linux-noop'}}, row=False) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:56:34 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:56:34 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:56:34 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:56:34 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc4a05fc8-39, may_exist=True, interface_attrs={}) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:56:34 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc4a05fc8-39, col_values=(('qos', UUID('37e145d3-abf2-423a-a5d1-0daf9b39cf6d')),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:56:34 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc4a05fc8-39, col_values=(('external_ids', {'iface-id': 'c4a05fc8-3976-4c52-a1c4-d2bfb51ba32b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8e:9f:f6', 'vm-uuid': '065c9704-8619-494a-9459-6e53f3a07f9e'}),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:56:34 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:56:34 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:56:34 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:56:34 user nova-compute[74337]: INFO os_vif [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:9f:f6,bridge_name='br-int',has_traffic_filtering=True,id=c4a05fc8-3976-4c52-a1c4-d2bfb51ba32b,network=Network(5a18e96f-a6eb-4989-9be3-154b54928b03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4a05fc8-39')
Oct 23 21:56:34 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] No BDM found with device name vda, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 21:56:34 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] No VIF found with MAC fa:16:3e:8e:9f:f6, not building metadata {{(pid=74337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 21:56:35 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:56:35 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:56:35 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:56:36 user nova-compute[74337]: DEBUG nova.compute.manager [req-b3596de7-84f4-4b5d-8af0-8fdf6a5701bb req-5537f7be-39e4-407f-82ed-69d703d2ba77 service nova] [instance: 065c9704-8619-494a-9459-6e53f3a07f9e] Received event network-vif-plugged-c4a05fc8-3976-4c52-a1c4-d2bfb51ba32b {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:56:36 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-b3596de7-84f4-4b5d-8af0-8fdf6a5701bb req-5537f7be-39e4-407f-82ed-69d703d2ba77 service nova] Acquiring lock "065c9704-8619-494a-9459-6e53f3a07f9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:56:36 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-b3596de7-84f4-4b5d-8af0-8fdf6a5701bb req-5537f7be-39e4-407f-82ed-69d703d2ba77 service nova] Lock "065c9704-8619-494a-9459-6e53f3a07f9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:56:36 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-b3596de7-84f4-4b5d-8af0-8fdf6a5701bb req-5537f7be-39e4-407f-82ed-69d703d2ba77 service nova] Lock "065c9704-8619-494a-9459-6e53f3a07f9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:56:36 user nova-compute[74337]: DEBUG nova.compute.manager [req-b3596de7-84f4-4b5d-8af0-8fdf6a5701bb req-5537f7be-39e4-407f-82ed-69d703d2ba77 service nova] [instance: 065c9704-8619-494a-9459-6e53f3a07f9e] No waiting events found dispatching network-vif-plugged-c4a05fc8-3976-4c52-a1c4-d2bfb51ba32b {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:56:36 user nova-compute[74337]: WARNING nova.compute.manager [req-b3596de7-84f4-4b5d-8af0-8fdf6a5701bb req-5537f7be-39e4-407f-82ed-69d703d2ba77 service nova] [instance: 065c9704-8619-494a-9459-6e53f3a07f9e] Received unexpected event network-vif-plugged-c4a05fc8-3976-4c52-a1c4-d2bfb51ba32b for instance with vm_state building and task_state spawning.
Oct 23 21:56:36 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:56:37 user nova-compute[74337]: DEBUG nova.compute.manager [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 065c9704-8619-494a-9459-6e53f3a07f9e] Instance event wait completed in 0 seconds for  {{(pid=74337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 21:56:37 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 065c9704-8619-494a-9459-6e53f3a07f9e] Guest created on hypervisor {{(pid=74337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 21:56:37 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: 065c9704-8619-494a-9459-6e53f3a07f9e] Instance spawned successfully.
Oct 23 21:56:37 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 065c9704-8619-494a-9459-6e53f3a07f9e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 21:56:37 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 065c9704-8619-494a-9459-6e53f3a07f9e] Found default for hw_cdrom_bus of ide {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:56:37 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 065c9704-8619-494a-9459-6e53f3a07f9e] Found default for hw_disk_bus of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:56:37 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 065c9704-8619-494a-9459-6e53f3a07f9e] Found default for hw_input_bus of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:56:37 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 065c9704-8619-494a-9459-6e53f3a07f9e] Found default for hw_pointer_model of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:56:37 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 065c9704-8619-494a-9459-6e53f3a07f9e] Found default for hw_video_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:56:37 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 065c9704-8619-494a-9459-6e53f3a07f9e] Found default for hw_vif_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:56:38 user nova-compute[74337]: INFO nova.compute.manager [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 065c9704-8619-494a-9459-6e53f3a07f9e] Took 4.99 seconds to spawn the instance on the hypervisor.
Oct 23 21:56:38 user nova-compute[74337]: DEBUG nova.compute.manager [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 065c9704-8619-494a-9459-6e53f3a07f9e] Checking state {{(pid=74337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 21:56:38 user nova-compute[74337]: INFO nova.compute.manager [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 065c9704-8619-494a-9459-6e53f3a07f9e] Took 22.99 seconds to build instance.
Oct 23 21:56:38 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-8f42f939-a130-4eb7-81d5-d614377f32a2 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "065c9704-8619-494a-9459-6e53f3a07f9e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.535s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:56:38 user nova-compute[74337]: DEBUG nova.compute.manager [req-9f4d525a-2ef1-4fcb-936d-9d2726f910c7 req-a7bd3a3b-94d1-431e-9598-4d0f1f6e38a6 service nova] [instance: 065c9704-8619-494a-9459-6e53f3a07f9e] Received event network-vif-plugged-c4a05fc8-3976-4c52-a1c4-d2bfb51ba32b {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:56:38 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-9f4d525a-2ef1-4fcb-936d-9d2726f910c7 req-a7bd3a3b-94d1-431e-9598-4d0f1f6e38a6 service nova] Acquiring lock "065c9704-8619-494a-9459-6e53f3a07f9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:56:38 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-9f4d525a-2ef1-4fcb-936d-9d2726f910c7 req-a7bd3a3b-94d1-431e-9598-4d0f1f6e38a6 service nova] Lock "065c9704-8619-494a-9459-6e53f3a07f9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:56:38 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-9f4d525a-2ef1-4fcb-936d-9d2726f910c7 req-a7bd3a3b-94d1-431e-9598-4d0f1f6e38a6 service nova] Lock "065c9704-8619-494a-9459-6e53f3a07f9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:56:38 user nova-compute[74337]: DEBUG nova.compute.manager [req-9f4d525a-2ef1-4fcb-936d-9d2726f910c7 req-a7bd3a3b-94d1-431e-9598-4d0f1f6e38a6 service nova] [instance: 065c9704-8619-494a-9459-6e53f3a07f9e] No waiting events found dispatching network-vif-plugged-c4a05fc8-3976-4c52-a1c4-d2bfb51ba32b {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:56:38 user nova-compute[74337]: WARNING nova.compute.manager [req-9f4d525a-2ef1-4fcb-936d-9d2726f910c7 req-a7bd3a3b-94d1-431e-9598-4d0f1f6e38a6 service nova] [instance: 065c9704-8619-494a-9459-6e53f3a07f9e] Received unexpected event network-vif-plugged-c4a05fc8-3976-4c52-a1c4-d2bfb51ba32b for instance with vm_state active and task_state None.
Oct 23 21:56:38 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:56:39 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:56:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:56:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:56:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 21:56:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 21:56:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 21:56:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:56:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:56:47 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-2d518165-3514-49df-a12e-c079853fed7f tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Acquiring lock "1e05fd36-ee44-4992-80a9-f95af608b9f5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:56:47 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-2d518165-3514-49df-a12e-c079853fed7f tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lock "1e05fd36-ee44-4992-80a9-f95af608b9f5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:56:47 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-2d518165-3514-49df-a12e-c079853fed7f tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Acquiring lock "1e05fd36-ee44-4992-80a9-f95af608b9f5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:56:47 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-2d518165-3514-49df-a12e-c079853fed7f tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lock "1e05fd36-ee44-4992-80a9-f95af608b9f5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:56:47 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-2d518165-3514-49df-a12e-c079853fed7f tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lock "1e05fd36-ee44-4992-80a9-f95af608b9f5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:56:47 user nova-compute[74337]: INFO nova.compute.manager [None req-2d518165-3514-49df-a12e-c079853fed7f tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: 1e05fd36-ee44-4992-80a9-f95af608b9f5] Terminating instance
Oct 23 21:56:47 user nova-compute[74337]: DEBUG nova.compute.manager [None req-2d518165-3514-49df-a12e-c079853fed7f tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: 1e05fd36-ee44-4992-80a9-f95af608b9f5] Start destroying the instance on the hypervisor. {{(pid=74337) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 21:56:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:56:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:56:47 user nova-compute[74337]: DEBUG nova.compute.manager [req-37278f29-5cb4-4967-96b3-1092068a5c17 req-be35ebdb-e882-4118-80ce-b51dfcd8202f service nova] [instance: 1e05fd36-ee44-4992-80a9-f95af608b9f5] Received event network-vif-unplugged-be6c9897-b923-4a1e-813b-ba0b0196ac48 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:56:47 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-37278f29-5cb4-4967-96b3-1092068a5c17 req-be35ebdb-e882-4118-80ce-b51dfcd8202f service nova] Acquiring lock "1e05fd36-ee44-4992-80a9-f95af608b9f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:56:47 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-37278f29-5cb4-4967-96b3-1092068a5c17 req-be35ebdb-e882-4118-80ce-b51dfcd8202f service nova] Lock "1e05fd36-ee44-4992-80a9-f95af608b9f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:56:47 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-37278f29-5cb4-4967-96b3-1092068a5c17 req-be35ebdb-e882-4118-80ce-b51dfcd8202f service nova] Lock "1e05fd36-ee44-4992-80a9-f95af608b9f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:56:47 user nova-compute[74337]: DEBUG nova.compute.manager [req-37278f29-5cb4-4967-96b3-1092068a5c17 req-be35ebdb-e882-4118-80ce-b51dfcd8202f service nova] [instance: 1e05fd36-ee44-4992-80a9-f95af608b9f5] No waiting events found dispatching network-vif-unplugged-be6c9897-b923-4a1e-813b-ba0b0196ac48 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:56:47 user nova-compute[74337]: DEBUG nova.compute.manager [req-37278f29-5cb4-4967-96b3-1092068a5c17 req-be35ebdb-e882-4118-80ce-b51dfcd8202f service nova] [instance: 1e05fd36-ee44-4992-80a9-f95af608b9f5] Received event network-vif-unplugged-be6c9897-b923-4a1e-813b-ba0b0196ac48 for instance with task_state deleting. {{(pid=74337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 21:56:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:56:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:56:47 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: 1e05fd36-ee44-4992-80a9-f95af608b9f5] Instance destroyed successfully.
Oct 23 21:56:47 user nova-compute[74337]: DEBUG nova.objects.instance [None req-2d518165-3514-49df-a12e-c079853fed7f tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lazy-loading 'resources' on Instance uuid 1e05fd36-ee44-4992-80a9-f95af608b9f5 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:56:47 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-2d518165-3514-49df-a12e-c079853fed7f tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:47:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1172209907',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1172209907',id=27,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-23T21:47:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='83b85c4f783a4ee7ab67422b49da85ca',ramdisk_id='',reservation_id='r-1br5ttde',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1944032280',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T21:49:21Z,user_data=None,user_id='a2e424dd3c684c808de14c2a9c3c1ed6',uuid=1e05fd36-ee44-4992-80a9-f95af608b9f5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "be6c9897-b923-4a1e-813b-ba0b0196ac48", "address": "fa:16:3e:f0:53:16", "network": {"id": "5f62b1d8-d5d0-4ff9-922b-fc6e72fb640d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-655282105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b85c4f783a4ee7ab67422b49da85ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe6c9897-b9", "ovs_interfaceid": "be6c9897-b923-4a1e-813b-ba0b0196ac48", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 21:56:47 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-2d518165-3514-49df-a12e-c079853fed7f tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Converting VIF {"id": "be6c9897-b923-4a1e-813b-ba0b0196ac48", "address": "fa:16:3e:f0:53:16", "network": {"id": "5f62b1d8-d5d0-4ff9-922b-fc6e72fb640d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-655282105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b85c4f783a4ee7ab67422b49da85ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe6c9897-b9", "ovs_interfaceid": "be6c9897-b923-4a1e-813b-ba0b0196ac48", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:56:47 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-2d518165-3514-49df-a12e-c079853fed7f tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f0:53:16,bridge_name='br-int',has_traffic_filtering=True,id=be6c9897-b923-4a1e-813b-ba0b0196ac48,network=Network(5f62b1d8-d5d0-4ff9-922b-fc6e72fb640d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe6c9897-b9') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:56:47 user nova-compute[74337]: DEBUG os_vif [None req-2d518165-3514-49df-a12e-c079853fed7f tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:53:16,bridge_name='br-int',has_traffic_filtering=True,id=be6c9897-b923-4a1e-813b-ba0b0196ac48,network=Network(5f62b1d8-d5d0-4ff9-922b-fc6e72fb640d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe6c9897-b9') {{(pid=74337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 21:56:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:56:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbe6c9897-b9, bridge=br-int, if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:56:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:56:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:56:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:56:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=27dc5791-e815-4a5a-8092-9ddf2e59e66a) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:56:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:56:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:56:47 user nova-compute[74337]: INFO os_vif [None req-2d518165-3514-49df-a12e-c079853fed7f tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:53:16,bridge_name='br-int',has_traffic_filtering=True,id=be6c9897-b923-4a1e-813b-ba0b0196ac48,network=Network(5f62b1d8-d5d0-4ff9-922b-fc6e72fb640d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe6c9897-b9')
Oct 23 21:56:47 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-2d518165-3514-49df-a12e-c079853fed7f tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: 1e05fd36-ee44-4992-80a9-f95af608b9f5] Deleting instance files /opt/stack/data/nova/instances/1e05fd36-ee44-4992-80a9-f95af608b9f5_del
Oct 23 21:56:47 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-2d518165-3514-49df-a12e-c079853fed7f tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: 1e05fd36-ee44-4992-80a9-f95af608b9f5] Deletion of /opt/stack/data/nova/instances/1e05fd36-ee44-4992-80a9-f95af608b9f5_del complete
Oct 23 21:56:47 user nova-compute[74337]: INFO nova.compute.manager [None req-2d518165-3514-49df-a12e-c079853fed7f tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: 1e05fd36-ee44-4992-80a9-f95af608b9f5] Took 0.72 seconds to destroy the instance on the hypervisor.
Oct 23 21:56:47 user nova-compute[74337]: DEBUG oslo.service.loopingcall [None req-2d518165-3514-49df-a12e-c079853fed7f tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74337) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 21:56:47 user nova-compute[74337]: DEBUG nova.compute.manager [-] [instance: 1e05fd36-ee44-4992-80a9-f95af608b9f5] Deallocating network for instance {{(pid=74337) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 21:56:47 user nova-compute[74337]: DEBUG nova.network.neutron [-] [instance: 1e05fd36-ee44-4992-80a9-f95af608b9f5] deallocate_for_instance() {{(pid=74337) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 21:56:48 user nova-compute[74337]: DEBUG nova.network.neutron [-] [instance: 1e05fd36-ee44-4992-80a9-f95af608b9f5] Updating instance_info_cache with network_info: [] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:56:48 user nova-compute[74337]: INFO nova.compute.manager [-] [instance: 1e05fd36-ee44-4992-80a9-f95af608b9f5] Took 0.49 seconds to deallocate network for instance.
Oct 23 21:56:48 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-2d518165-3514-49df-a12e-c079853fed7f tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:56:48 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-2d518165-3514-49df-a12e-c079853fed7f tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:56:48 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-2d518165-3514-49df-a12e-c079853fed7f tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:56:48 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-2d518165-3514-49df-a12e-c079853fed7f tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:56:48 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-2d518165-3514-49df-a12e-c079853fed7f tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.358s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:56:48 user nova-compute[74337]: INFO nova.scheduler.client.report [None req-2d518165-3514-49df-a12e-c079853fed7f tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Deleted allocations for instance 1e05fd36-ee44-4992-80a9-f95af608b9f5
Oct 23 21:56:48 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-2d518165-3514-49df-a12e-c079853fed7f tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lock "1e05fd36-ee44-4992-80a9-f95af608b9f5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.775s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:56:49 user nova-compute[74337]: DEBUG nova.compute.manager [req-cffafe14-6fcb-46fb-a87b-951395651b38 req-55addc7b-5958-4a49-b982-745d1a7087b5 service nova] [instance: 1e05fd36-ee44-4992-80a9-f95af608b9f5] Received event network-vif-plugged-be6c9897-b923-4a1e-813b-ba0b0196ac48 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:56:49 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-cffafe14-6fcb-46fb-a87b-951395651b38 req-55addc7b-5958-4a49-b982-745d1a7087b5 service nova] Acquiring lock "1e05fd36-ee44-4992-80a9-f95af608b9f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:56:49 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-cffafe14-6fcb-46fb-a87b-951395651b38 req-55addc7b-5958-4a49-b982-745d1a7087b5 service nova] Lock "1e05fd36-ee44-4992-80a9-f95af608b9f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:56:49 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-cffafe14-6fcb-46fb-a87b-951395651b38 req-55addc7b-5958-4a49-b982-745d1a7087b5 service nova] Lock "1e05fd36-ee44-4992-80a9-f95af608b9f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:56:49 user nova-compute[74337]: DEBUG nova.compute.manager [req-cffafe14-6fcb-46fb-a87b-951395651b38 req-55addc7b-5958-4a49-b982-745d1a7087b5 service nova] [instance: 1e05fd36-ee44-4992-80a9-f95af608b9f5] No waiting events found dispatching network-vif-plugged-be6c9897-b923-4a1e-813b-ba0b0196ac48 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:56:49 user nova-compute[74337]: WARNING nova.compute.manager [req-cffafe14-6fcb-46fb-a87b-951395651b38 req-55addc7b-5958-4a49-b982-745d1a7087b5 service nova] [instance: 1e05fd36-ee44-4992-80a9-f95af608b9f5] Received unexpected event network-vif-plugged-be6c9897-b923-4a1e-813b-ba0b0196ac48 for instance with vm_state deleted and task_state None.
Oct 23 21:56:49 user nova-compute[74337]: DEBUG nova.compute.manager [req-cffafe14-6fcb-46fb-a87b-951395651b38 req-55addc7b-5958-4a49-b982-745d1a7087b5 service nova] [instance: 1e05fd36-ee44-4992-80a9-f95af608b9f5] Received event network-vif-deleted-be6c9897-b923-4a1e-813b-ba0b0196ac48 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:56:50 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-623375e4-6305-47d7-83bc-e24014520f0a tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Acquiring lock "dbad2e14-7b6c-475e-b471-a87cb9e21b7f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:56:50 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-623375e4-6305-47d7-83bc-e24014520f0a tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Lock "dbad2e14-7b6c-475e-b471-a87cb9e21b7f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:56:50 user nova-compute[74337]: DEBUG nova.compute.manager [None req-623375e4-6305-47d7-83bc-e24014520f0a tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Starting instance... {{(pid=74337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 21:56:50 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-623375e4-6305-47d7-83bc-e24014520f0a tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:56:50 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-623375e4-6305-47d7-83bc-e24014520f0a tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:56:50 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-623375e4-6305-47d7-83bc-e24014520f0a tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 21:56:50 user nova-compute[74337]: INFO nova.compute.claims [None req-623375e4-6305-47d7-83bc-e24014520f0a tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Claim successful on node user
Oct 23 21:56:50 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-623375e4-6305-47d7-83bc-e24014520f0a tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:56:50 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-623375e4-6305-47d7-83bc-e24014520f0a tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:56:50 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-623375e4-6305-47d7-83bc-e24014520f0a tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.418s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:56:50 user nova-compute[74337]: DEBUG nova.compute.manager [None req-623375e4-6305-47d7-83bc-e24014520f0a tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Start building networks asynchronously for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 21:56:50 user nova-compute[74337]: DEBUG nova.compute.manager [None req-623375e4-6305-47d7-83bc-e24014520f0a tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Allocating IP information in the background. {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 21:56:50 user nova-compute[74337]: DEBUG nova.network.neutron [None req-623375e4-6305-47d7-83bc-e24014520f0a tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] allocate_for_instance() {{(pid=74337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 21:56:50 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-623375e4-6305-47d7-83bc-e24014520f0a tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 21:56:50 user nova-compute[74337]: DEBUG nova.compute.manager [None req-623375e4-6305-47d7-83bc-e24014520f0a tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Start building block device mappings for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 21:56:50 user nova-compute[74337]: DEBUG nova.policy [None req-623375e4-6305-47d7-83bc-e24014520f0a tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6ddd5c407fbe440e85111213c4c2dd46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd8afde978624cf8a2356e8ce8b4d3f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74337) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 21:56:50 user nova-compute[74337]: DEBUG nova.compute.manager [None req-623375e4-6305-47d7-83bc-e24014520f0a tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Start spawning the instance on the hypervisor. {{(pid=74337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 21:56:50 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-623375e4-6305-47d7-83bc-e24014520f0a tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Creating instance directory {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 21:56:50 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-623375e4-6305-47d7-83bc-e24014520f0a tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Creating image(s)
Oct 23 21:56:50 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-623375e4-6305-47d7-83bc-e24014520f0a tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Acquiring lock "/opt/stack/data/nova/instances/dbad2e14-7b6c-475e-b471-a87cb9e21b7f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:56:50 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-623375e4-6305-47d7-83bc-e24014520f0a tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Lock "/opt/stack/data/nova/instances/dbad2e14-7b6c-475e-b471-a87cb9e21b7f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:56:50 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-623375e4-6305-47d7-83bc-e24014520f0a tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Lock "/opt/stack/data/nova/instances/dbad2e14-7b6c-475e-b471-a87cb9e21b7f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.011s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:56:50 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-623375e4-6305-47d7-83bc-e24014520f0a tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:56:51 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-623375e4-6305-47d7-83bc-e24014520f0a tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.209s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:56:51 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-623375e4-6305-47d7-83bc-e24014520f0a tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Acquiring lock "fc7b140751b8c385de81623e40fb09ce09374ab7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:56:51 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-623375e4-6305-47d7-83bc-e24014520f0a tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Lock "fc7b140751b8c385de81623e40fb09ce09374ab7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:56:51 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-623375e4-6305-47d7-83bc-e24014520f0a tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:56:51 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-623375e4-6305-47d7-83bc-e24014520f0a tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.201s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:56:51 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-623375e4-6305-47d7-83bc-e24014520f0a tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7,backing_fmt=raw /opt/stack/data/nova/instances/dbad2e14-7b6c-475e-b471-a87cb9e21b7f/disk 1073741824 {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:56:51 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-623375e4-6305-47d7-83bc-e24014520f0a tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7,backing_fmt=raw /opt/stack/data/nova/instances/dbad2e14-7b6c-475e-b471-a87cb9e21b7f/disk 1073741824" returned: 0 in 0.069s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:56:51 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-623375e4-6305-47d7-83bc-e24014520f0a tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Lock "fc7b140751b8c385de81623e40fb09ce09374ab7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.277s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:56:51 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-623375e4-6305-47d7-83bc-e24014520f0a tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:56:51 user nova-compute[74337]: DEBUG nova.network.neutron [None req-623375e4-6305-47d7-83bc-e24014520f0a tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Successfully created port: 0b516177-6ded-4b79-9f77-84ba1466f259 {{(pid=74337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 21:56:51 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-623375e4-6305-47d7-83bc-e24014520f0a tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.192s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:56:51 user nova-compute[74337]: DEBUG nova.virt.disk.api [None req-623375e4-6305-47d7-83bc-e24014520f0a tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dbad2e14-7b6c-475e-b471-a87cb9e21b7f/disk. size=1073741824 {{(pid=74337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 21:56:51 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-623375e4-6305-47d7-83bc-e24014520f0a tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbad2e14-7b6c-475e-b471-a87cb9e21b7f/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:56:51 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-623375e4-6305-47d7-83bc-e24014520f0a tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbad2e14-7b6c-475e-b471-a87cb9e21b7f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:56:51 user nova-compute[74337]: DEBUG nova.virt.disk.api [None req-623375e4-6305-47d7-83bc-e24014520f0a tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Cannot resize image /opt/stack/data/nova/instances/dbad2e14-7b6c-475e-b471-a87cb9e21b7f/disk to a smaller size. {{(pid=74337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 21:56:51 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-623375e4-6305-47d7-83bc-e24014520f0a tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Created local disks {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 21:56:51 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-623375e4-6305-47d7-83bc-e24014520f0a tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Ensure instance console log exists: /opt/stack/data/nova/instances/dbad2e14-7b6c-475e-b471-a87cb9e21b7f/console.log {{(pid=74337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 21:56:51 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-623375e4-6305-47d7-83bc-e24014520f0a tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:56:51 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-623375e4-6305-47d7-83bc-e24014520f0a tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:56:51 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-623375e4-6305-47d7-83bc-e24014520f0a tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:56:52 user nova-compute[74337]: DEBUG nova.network.neutron [None req-623375e4-6305-47d7-83bc-e24014520f0a tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Successfully updated port: 0b516177-6ded-4b79-9f77-84ba1466f259 {{(pid=74337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 21:56:52 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-623375e4-6305-47d7-83bc-e24014520f0a tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Acquiring lock "refresh_cache-dbad2e14-7b6c-475e-b471-a87cb9e21b7f" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:56:52 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-623375e4-6305-47d7-83bc-e24014520f0a tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Acquired lock "refresh_cache-dbad2e14-7b6c-475e-b471-a87cb9e21b7f" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:56:52 user nova-compute[74337]: DEBUG nova.network.neutron [None req-623375e4-6305-47d7-83bc-e24014520f0a tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Building network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 21:56:52 user nova-compute[74337]: DEBUG nova.compute.manager [req-d05eec40-e6c9-4589-af30-f2ef384646fe req-6880ab7c-5a82-493a-9fea-ee2224ec930d service nova] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Received event network-changed-0b516177-6ded-4b79-9f77-84ba1466f259 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:56:52 user nova-compute[74337]: DEBUG nova.compute.manager [req-d05eec40-e6c9-4589-af30-f2ef384646fe req-6880ab7c-5a82-493a-9fea-ee2224ec930d service nova] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Refreshing instance network info cache due to event network-changed-0b516177-6ded-4b79-9f77-84ba1466f259. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 21:56:52 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-d05eec40-e6c9-4589-af30-f2ef384646fe req-6880ab7c-5a82-493a-9fea-ee2224ec930d service nova] Acquiring lock "refresh_cache-dbad2e14-7b6c-475e-b471-a87cb9e21b7f" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:56:52 user nova-compute[74337]: DEBUG nova.network.neutron [None req-623375e4-6305-47d7-83bc-e24014520f0a tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Instance cache missing network info. {{(pid=74337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 21:56:52 user nova-compute[74337]: DEBUG nova.network.neutron [None req-623375e4-6305-47d7-83bc-e24014520f0a tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Updating instance_info_cache with network_info: [{"id": "0b516177-6ded-4b79-9f77-84ba1466f259", "address": "fa:16:3e:3e:3f:19", "network": {"id": "0feb8c56-c17f-47d0-9796-91d4bd20e81d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1399506675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd8afde978624cf8a2356e8ce8b4d3f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b516177-6d", "ovs_interfaceid": "0b516177-6ded-4b79-9f77-84ba1466f259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:56:52 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-623375e4-6305-47d7-83bc-e24014520f0a tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Releasing lock "refresh_cache-dbad2e14-7b6c-475e-b471-a87cb9e21b7f" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:56:52 user nova-compute[74337]: DEBUG nova.compute.manager [None req-623375e4-6305-47d7-83bc-e24014520f0a tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Instance network_info: |[{"id": "0b516177-6ded-4b79-9f77-84ba1466f259", "address": "fa:16:3e:3e:3f:19", "network": {"id": "0feb8c56-c17f-47d0-9796-91d4bd20e81d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1399506675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd8afde978624cf8a2356e8ce8b4d3f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b516177-6d", "ovs_interfaceid": "0b516177-6ded-4b79-9f77-84ba1466f259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 21:56:52 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-d05eec40-e6c9-4589-af30-f2ef384646fe req-6880ab7c-5a82-493a-9fea-ee2224ec930d service nova] Acquired lock "refresh_cache-dbad2e14-7b6c-475e-b471-a87cb9e21b7f" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:56:52 user nova-compute[74337]: DEBUG nova.network.neutron [req-d05eec40-e6c9-4589-af30-f2ef384646fe req-6880ab7c-5a82-493a-9fea-ee2224ec930d service nova] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Refreshing network info cache for port 0b516177-6ded-4b79-9f77-84ba1466f259 {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 21:56:52 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-623375e4-6305-47d7-83bc-e24014520f0a tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Start _get_guest_xml network_info=[{"id": "0b516177-6ded-4b79-9f77-84ba1466f259", "address": "fa:16:3e:3e:3f:19", "network": {"id": "0feb8c56-c17f-47d0-9796-91d4bd20e81d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1399506675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd8afde978624cf8a2356e8ce8b4d3f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b516177-6d", "ovs_interfaceid": "0b516177-6ded-4b79-9f77-84ba1466f259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T21:29:21Z,direct_url=<?>,disk_format='qcow2',id=d859d89d-998d-4109-b26a-0d6e28152932,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ff43462300764979a6cf688444336a56',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T21:29:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'image_id': 'd859d89d-998d-4109-b26a-0d6e28152932'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 21:56:52 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-623375e4-6305-47d7-83bc-e24014520f0a tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:56:52 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-623375e4-6305-47d7-83bc-e24014520f0a tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:56:52 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-623375e4-6305-47d7-83bc-e24014520f0a tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 21:56:52 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-623375e4-6305-47d7-83bc-e24014520f0a tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] CPU controller missing on host. {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 21:56:52 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-623375e4-6305-47d7-83bc-e24014520f0a tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 21:56:52 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-623375e4-6305-47d7-83bc-e24014520f0a tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] CPU controller found on host. {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 21:56:52 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-623375e4-6305-47d7-83bc-e24014520f0a tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 21:56:52 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-623375e4-6305-47d7-83bc-e24014520f0a tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T21:29:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T21:29:21Z,direct_url=<?>,disk_format='qcow2',id=d859d89d-998d-4109-b26a-0d6e28152932,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ff43462300764979a6cf688444336a56',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T21:29:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 21:56:52 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-623375e4-6305-47d7-83bc-e24014520f0a tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Flavor limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 21:56:52 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-623375e4-6305-47d7-83bc-e24014520f0a tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Image limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 21:56:52 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-623375e4-6305-47d7-83bc-e24014520f0a tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Flavor pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 21:56:52 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-623375e4-6305-47d7-83bc-e24014520f0a tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Image pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 21:56:52 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-623375e4-6305-47d7-83bc-e24014520f0a tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 21:56:52 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-623375e4-6305-47d7-83bc-e24014520f0a tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 21:56:52 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-623375e4-6305-47d7-83bc-e24014520f0a tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 21:56:52 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-623375e4-6305-47d7-83bc-e24014520f0a tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Got 1 possible topologies {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 21:56:52 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-623375e4-6305-47d7-83bc-e24014520f0a tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 21:56:52 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-623375e4-6305-47d7-83bc-e24014520f0a tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 21:56:52 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-623375e4-6305-47d7-83bc-e24014520f0a tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:56:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-871350340',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-871350340',id=39,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHRDalfqxZaW8tFQ9tDoYtCFE78iJYyBQ1ot3CVX7Ji0u7cN5OwvaEEc+VVh5hRl2DfFzm1xzi24XgwVkSIP+Eap1fKERDd4zLGppmS56DXgviGQt7TMPi4e47AawwOGzg==',key_name='tempest-keypair-1238420293',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dd8afde978624cf8a2356e8ce8b4d3f2',ramdisk_id='',reservation_id='r-fs4u8r0x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-338191707',owner_user_name='tempest-AttachVolumeShelveTestJSON-338191707-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:56:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ddd5c407fbe440e85111213c4c2dd46',uuid=dbad2e14-7b6c-475e-b471-a87cb9e21b7f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0b516177-6ded-4b79-9f77-84ba1466f259", "address": "fa:16:3e:3e:3f:19", "network": {"id": "0feb8c56-c17f-47d0-9796-91d4bd20e81d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1399506675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd8afde978624cf8a2356e8ce8b4d3f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b516177-6d", "ovs_interfaceid": "0b516177-6ded-4b79-9f77-84ba1466f259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 21:56:52 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-623375e4-6305-47d7-83bc-e24014520f0a tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Converting VIF {"id": "0b516177-6ded-4b79-9f77-84ba1466f259", "address": "fa:16:3e:3e:3f:19", "network": {"id": "0feb8c56-c17f-47d0-9796-91d4bd20e81d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1399506675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd8afde978624cf8a2356e8ce8b4d3f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b516177-6d", "ovs_interfaceid": "0b516177-6ded-4b79-9f77-84ba1466f259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:56:52 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-623375e4-6305-47d7-83bc-e24014520f0a tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:3f:19,bridge_name='br-int',has_traffic_filtering=True,id=0b516177-6ded-4b79-9f77-84ba1466f259,network=Network(0feb8c56-c17f-47d0-9796-91d4bd20e81d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b516177-6d') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:56:52 user nova-compute[74337]: DEBUG nova.objects.instance [None req-623375e4-6305-47d7-83bc-e24014520f0a tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Lazy-loading 'pci_devices' on Instance uuid dbad2e14-7b6c-475e-b471-a87cb9e21b7f {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:56:52 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-623375e4-6305-47d7-83bc-e24014520f0a tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] End _get_guest_xml xml=<domain type="kvm">
Oct 23 21:56:52 user nova-compute[74337]:   <uuid>dbad2e14-7b6c-475e-b471-a87cb9e21b7f</uuid>
Oct 23 21:56:52 user nova-compute[74337]:   <name>instance-00000027</name>
Oct 23 21:56:52 user nova-compute[74337]:   <memory>524288</memory>
Oct 23 21:56:52 user nova-compute[74337]:   <vcpu>1</vcpu>
Oct 23 21:56:52 user nova-compute[74337]:   <metadata>
Oct 23 21:56:52 user nova-compute[74337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 21:56:52 user nova-compute[74337]:       <nova:package version="0.0.0"/>
Oct 23 21:56:52 user nova-compute[74337]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-871350340</nova:name>
Oct 23 21:56:52 user nova-compute[74337]:       <nova:creationTime>2023-10-23 21:56:52</nova:creationTime>
Oct 23 21:56:52 user nova-compute[74337]:       <nova:flavor name="m1.tiny">
Oct 23 21:56:52 user nova-compute[74337]:         <nova:memory>512</nova:memory>
Oct 23 21:56:52 user nova-compute[74337]:         <nova:disk>1</nova:disk>
Oct 23 21:56:52 user nova-compute[74337]:         <nova:swap>0</nova:swap>
Oct 23 21:56:52 user nova-compute[74337]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 21:56:52 user nova-compute[74337]:         <nova:vcpus>1</nova:vcpus>
Oct 23 21:56:52 user nova-compute[74337]:       </nova:flavor>
Oct 23 21:56:52 user nova-compute[74337]:       <nova:owner>
Oct 23 21:56:52 user nova-compute[74337]:         <nova:user uuid="6ddd5c407fbe440e85111213c4c2dd46">tempest-AttachVolumeShelveTestJSON-338191707-project-member</nova:user>
Oct 23 21:56:52 user nova-compute[74337]:         <nova:project uuid="dd8afde978624cf8a2356e8ce8b4d3f2">tempest-AttachVolumeShelveTestJSON-338191707</nova:project>
Oct 23 21:56:52 user nova-compute[74337]:       </nova:owner>
Oct 23 21:56:52 user nova-compute[74337]:       <nova:root type="image" uuid="d859d89d-998d-4109-b26a-0d6e28152932"/>
Oct 23 21:56:52 user nova-compute[74337]:       <nova:ports>
Oct 23 21:56:52 user nova-compute[74337]:         <nova:port uuid="0b516177-6ded-4b79-9f77-84ba1466f259">
Oct 23 21:56:52 user nova-compute[74337]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 23 21:56:52 user nova-compute[74337]:         </nova:port>
Oct 23 21:56:52 user nova-compute[74337]:       </nova:ports>
Oct 23 21:56:52 user nova-compute[74337]:     </nova:instance>
Oct 23 21:56:52 user nova-compute[74337]:   </metadata>
Oct 23 21:56:52 user nova-compute[74337]:   <sysinfo type="smbios">
Oct 23 21:56:52 user nova-compute[74337]:     <system>
Oct 23 21:56:52 user nova-compute[74337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 21:56:52 user nova-compute[74337]:       <entry name="product">OpenStack Nova</entry>
Oct 23 21:56:52 user nova-compute[74337]:       <entry name="version">0.0.0</entry>
Oct 23 21:56:52 user nova-compute[74337]:       <entry name="serial">dbad2e14-7b6c-475e-b471-a87cb9e21b7f</entry>
Oct 23 21:56:52 user nova-compute[74337]:       <entry name="uuid">dbad2e14-7b6c-475e-b471-a87cb9e21b7f</entry>
Oct 23 21:56:52 user nova-compute[74337]:       <entry name="family">Virtual Machine</entry>
Oct 23 21:56:52 user nova-compute[74337]:     </system>
Oct 23 21:56:52 user nova-compute[74337]:   </sysinfo>
Oct 23 21:56:52 user nova-compute[74337]:   <os>
Oct 23 21:56:52 user nova-compute[74337]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 21:56:52 user nova-compute[74337]:     <boot dev="hd"/>
Oct 23 21:56:52 user nova-compute[74337]:     <smbios mode="sysinfo"/>
Oct 23 21:56:52 user nova-compute[74337]:   </os>
Oct 23 21:56:52 user nova-compute[74337]:   <features>
Oct 23 21:56:52 user nova-compute[74337]:     <acpi/>
Oct 23 21:56:52 user nova-compute[74337]:     <apic/>
Oct 23 21:56:52 user nova-compute[74337]:     <vmcoreinfo/>
Oct 23 21:56:52 user nova-compute[74337]:   </features>
Oct 23 21:56:52 user nova-compute[74337]:   <clock offset="utc">
Oct 23 21:56:52 user nova-compute[74337]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 21:56:52 user nova-compute[74337]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 21:56:52 user nova-compute[74337]:     <timer name="hpet" present="no"/>
Oct 23 21:56:52 user nova-compute[74337]:   </clock>
Oct 23 21:56:52 user nova-compute[74337]:   <cpu mode="custom" match="exact">
Oct 23 21:56:52 user nova-compute[74337]:     <model>Nehalem</model>
Oct 23 21:56:52 user nova-compute[74337]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 21:56:52 user nova-compute[74337]:   </cpu>
Oct 23 21:56:52 user nova-compute[74337]:   <devices>
Oct 23 21:56:52 user nova-compute[74337]:     <disk type="file" device="disk">
Oct 23 21:56:52 user nova-compute[74337]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 21:56:52 user nova-compute[74337]:       <source file="/opt/stack/data/nova/instances/dbad2e14-7b6c-475e-b471-a87cb9e21b7f/disk"/>
Oct 23 21:56:52 user nova-compute[74337]:       <target dev="vda" bus="virtio"/>
Oct 23 21:56:52 user nova-compute[74337]:     </disk>
Oct 23 21:56:52 user nova-compute[74337]:     <interface type="ethernet">
Oct 23 21:56:52 user nova-compute[74337]:       <mac address="fa:16:3e:3e:3f:19"/>
Oct 23 21:56:52 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:56:52 user nova-compute[74337]:       <mtu size="1442"/>
Oct 23 21:56:52 user nova-compute[74337]:       <target dev="tap0b516177-6d"/>
Oct 23 21:56:52 user nova-compute[74337]:     </interface>
Oct 23 21:56:52 user nova-compute[74337]:     <serial type="pty">
Oct 23 21:56:52 user nova-compute[74337]:       <log file="/opt/stack/data/nova/instances/dbad2e14-7b6c-475e-b471-a87cb9e21b7f/console.log" append="off"/>
Oct 23 21:56:52 user nova-compute[74337]:     </serial>
Oct 23 21:56:52 user nova-compute[74337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 21:56:52 user nova-compute[74337]:     <video>
Oct 23 21:56:52 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:56:52 user nova-compute[74337]:     </video>
Oct 23 21:56:52 user nova-compute[74337]:     <rng model="virtio">
Oct 23 21:56:52 user nova-compute[74337]:       <backend model="random">/dev/urandom</backend>
Oct 23 21:56:52 user nova-compute[74337]:     </rng>
Oct 23 21:56:52 user nova-compute[74337]:     <controller type="usb" index="0" model="none"/>
Oct 23 21:56:52 user nova-compute[74337]:     <memballoon model="virtio">
Oct 23 21:56:52 user nova-compute[74337]:       <stats period="10"/>
Oct 23 21:56:52 user nova-compute[74337]:     </memballoon>
Oct 23 21:56:52 user nova-compute[74337]:   </devices>
Oct 23 21:56:52 user nova-compute[74337]: </domain>
Oct 23 21:56:52 user nova-compute[74337]:  {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 21:56:52 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-623375e4-6305-47d7-83bc-e24014520f0a tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:56:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-871350340',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-871350340',id=39,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHRDalfqxZaW8tFQ9tDoYtCFE78iJYyBQ1ot3CVX7Ji0u7cN5OwvaEEc+VVh5hRl2DfFzm1xzi24XgwVkSIP+Eap1fKERDd4zLGppmS56DXgviGQt7TMPi4e47AawwOGzg==',key_name='tempest-keypair-1238420293',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dd8afde978624cf8a2356e8ce8b4d3f2',ramdisk_id='',reservation_id='r-fs4u8r0x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-338191707',owner_user_name='tempest-AttachVolumeShelveTestJSON-338191707-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:56:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ddd5c407fbe440e85111213c4c2dd46',uuid=dbad2e14-7b6c-475e-b471-a87cb9e21b7f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0b516177-6ded-4b79-9f77-84ba1466f259", "address": "fa:16:3e:3e:3f:19", "network": {"id": "0feb8c56-c17f-47d0-9796-91d4bd20e81d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1399506675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd8afde978624cf8a2356e8ce8b4d3f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b516177-6d", "ovs_interfaceid": "0b516177-6ded-4b79-9f77-84ba1466f259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 21:56:52 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-623375e4-6305-47d7-83bc-e24014520f0a tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Converting VIF {"id": "0b516177-6ded-4b79-9f77-84ba1466f259", "address": "fa:16:3e:3e:3f:19", "network": {"id": "0feb8c56-c17f-47d0-9796-91d4bd20e81d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1399506675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd8afde978624cf8a2356e8ce8b4d3f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b516177-6d", "ovs_interfaceid": "0b516177-6ded-4b79-9f77-84ba1466f259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:56:52 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-623375e4-6305-47d7-83bc-e24014520f0a tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:3f:19,bridge_name='br-int',has_traffic_filtering=True,id=0b516177-6ded-4b79-9f77-84ba1466f259,network=Network(0feb8c56-c17f-47d0-9796-91d4bd20e81d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b516177-6d') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:56:52 user nova-compute[74337]: DEBUG os_vif [None req-623375e4-6305-47d7-83bc-e24014520f0a tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:3f:19,bridge_name='br-int',has_traffic_filtering=True,id=0b516177-6ded-4b79-9f77-84ba1466f259,network=Network(0feb8c56-c17f-47d0-9796-91d4bd20e81d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b516177-6d') {{(pid=74337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 21:56:52 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:56:52 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:56:52 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 21:56:52 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:56:52 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '24a2ce47-af64-5bcf-80d3-fec54a0e8f89', '_type': 'linux-noop'}}, row=False) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:56:52 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:56:52 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:56:52 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:56:52 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0b516177-6d, may_exist=True, interface_attrs={}) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:56:52 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0b516177-6d, col_values=(('qos', UUID('038ef621-7c55-4126-8e1d-9739f52d6a8f')),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:56:52 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0b516177-6d, col_values=(('external_ids', {'iface-id': '0b516177-6ded-4b79-9f77-84ba1466f259', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3e:3f:19', 'vm-uuid': 'dbad2e14-7b6c-475e-b471-a87cb9e21b7f'}),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:56:52 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:56:52 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:56:52 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:56:52 user nova-compute[74337]: INFO os_vif [None req-623375e4-6305-47d7-83bc-e24014520f0a tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:3f:19,bridge_name='br-int',has_traffic_filtering=True,id=0b516177-6ded-4b79-9f77-84ba1466f259,network=Network(0feb8c56-c17f-47d0-9796-91d4bd20e81d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b516177-6d')
Oct 23 21:56:52 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-623375e4-6305-47d7-83bc-e24014520f0a tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] No BDM found with device name vda, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 21:56:52 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-623375e4-6305-47d7-83bc-e24014520f0a tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] No VIF found with MAC fa:16:3e:3e:3f:19, not building metadata {{(pid=74337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 21:56:52 user nova-compute[74337]: DEBUG nova.network.neutron [req-d05eec40-e6c9-4589-af30-f2ef384646fe req-6880ab7c-5a82-493a-9fea-ee2224ec930d service nova] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Updated VIF entry in instance network info cache for port 0b516177-6ded-4b79-9f77-84ba1466f259. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 21:56:52 user nova-compute[74337]: DEBUG nova.network.neutron [req-d05eec40-e6c9-4589-af30-f2ef384646fe req-6880ab7c-5a82-493a-9fea-ee2224ec930d service nova] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Updating instance_info_cache with network_info: [{"id": "0b516177-6ded-4b79-9f77-84ba1466f259", "address": "fa:16:3e:3e:3f:19", "network": {"id": "0feb8c56-c17f-47d0-9796-91d4bd20e81d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1399506675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd8afde978624cf8a2356e8ce8b4d3f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b516177-6d", "ovs_interfaceid": "0b516177-6ded-4b79-9f77-84ba1466f259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:56:52 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-d05eec40-e6c9-4589-af30-f2ef384646fe req-6880ab7c-5a82-493a-9fea-ee2224ec930d service nova] Releasing lock "refresh_cache-dbad2e14-7b6c-475e-b471-a87cb9e21b7f" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:56:53 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:56:54 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:56:54 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:56:54 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:56:54 user nova-compute[74337]: DEBUG nova.compute.manager [req-3b87257d-bd34-4059-b087-ff3dca53780e req-6411bfc1-444e-4451-b180-4be6d6953a29 service nova] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Received event network-vif-plugged-0b516177-6ded-4b79-9f77-84ba1466f259 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:56:54 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-3b87257d-bd34-4059-b087-ff3dca53780e req-6411bfc1-444e-4451-b180-4be6d6953a29 service nova] Acquiring lock "dbad2e14-7b6c-475e-b471-a87cb9e21b7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:56:54 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-3b87257d-bd34-4059-b087-ff3dca53780e req-6411bfc1-444e-4451-b180-4be6d6953a29 service nova] Lock "dbad2e14-7b6c-475e-b471-a87cb9e21b7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:56:54 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-3b87257d-bd34-4059-b087-ff3dca53780e req-6411bfc1-444e-4451-b180-4be6d6953a29 service nova] Lock "dbad2e14-7b6c-475e-b471-a87cb9e21b7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:56:54 user nova-compute[74337]: DEBUG nova.compute.manager [req-3b87257d-bd34-4059-b087-ff3dca53780e req-6411bfc1-444e-4451-b180-4be6d6953a29 service nova] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] No waiting events found dispatching network-vif-plugged-0b516177-6ded-4b79-9f77-84ba1466f259 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:56:54 user nova-compute[74337]: WARNING nova.compute.manager [req-3b87257d-bd34-4059-b087-ff3dca53780e req-6411bfc1-444e-4451-b180-4be6d6953a29 service nova] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Received unexpected event network-vif-plugged-0b516177-6ded-4b79-9f77-84ba1466f259 for instance with vm_state building and task_state spawning.
Oct 23 21:56:54 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:56:54 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:56:54 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:56:54 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:56:56 user nova-compute[74337]: DEBUG nova.compute.manager [None req-623375e4-6305-47d7-83bc-e24014520f0a tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Instance event wait completed in 0 seconds for  {{(pid=74337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 21:56:56 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-623375e4-6305-47d7-83bc-e24014520f0a tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Guest created on hypervisor {{(pid=74337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 21:56:56 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Instance spawned successfully.
Oct 23 21:56:56 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-623375e4-6305-47d7-83bc-e24014520f0a tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 21:56:56 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-623375e4-6305-47d7-83bc-e24014520f0a tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Found default for hw_cdrom_bus of ide {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:56:56 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-623375e4-6305-47d7-83bc-e24014520f0a tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Found default for hw_disk_bus of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:56:56 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-623375e4-6305-47d7-83bc-e24014520f0a tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Found default for hw_input_bus of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:56:56 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-623375e4-6305-47d7-83bc-e24014520f0a tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Found default for hw_pointer_model of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:56:56 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-623375e4-6305-47d7-83bc-e24014520f0a tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Found default for hw_video_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:56:56 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-623375e4-6305-47d7-83bc-e24014520f0a tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Found default for hw_vif_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:56:56 user nova-compute[74337]: DEBUG nova.compute.manager [req-fdbfb166-0563-4436-acfd-42f89817cae2 req-40917b64-9e04-4b7b-8b87-b2450b0a6378 service nova] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Received event network-vif-plugged-0b516177-6ded-4b79-9f77-84ba1466f259 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:56:56 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-fdbfb166-0563-4436-acfd-42f89817cae2 req-40917b64-9e04-4b7b-8b87-b2450b0a6378 service nova] Acquiring lock "dbad2e14-7b6c-475e-b471-a87cb9e21b7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:56:56 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-fdbfb166-0563-4436-acfd-42f89817cae2 req-40917b64-9e04-4b7b-8b87-b2450b0a6378 service nova] Lock "dbad2e14-7b6c-475e-b471-a87cb9e21b7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:56:56 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-fdbfb166-0563-4436-acfd-42f89817cae2 req-40917b64-9e04-4b7b-8b87-b2450b0a6378 service nova] Lock "dbad2e14-7b6c-475e-b471-a87cb9e21b7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:56:56 user nova-compute[74337]: DEBUG nova.compute.manager [req-fdbfb166-0563-4436-acfd-42f89817cae2 req-40917b64-9e04-4b7b-8b87-b2450b0a6378 service nova] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] No waiting events found dispatching network-vif-plugged-0b516177-6ded-4b79-9f77-84ba1466f259 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:56:56 user nova-compute[74337]: WARNING nova.compute.manager [req-fdbfb166-0563-4436-acfd-42f89817cae2 req-40917b64-9e04-4b7b-8b87-b2450b0a6378 service nova] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Received unexpected event network-vif-plugged-0b516177-6ded-4b79-9f77-84ba1466f259 for instance with vm_state building and task_state spawning.
Oct 23 21:56:56 user nova-compute[74337]: INFO nova.compute.manager [None req-623375e4-6305-47d7-83bc-e24014520f0a tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Took 5.37 seconds to spawn the instance on the hypervisor.
Oct 23 21:56:56 user nova-compute[74337]: DEBUG nova.compute.manager [None req-623375e4-6305-47d7-83bc-e24014520f0a tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Checking state {{(pid=74337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 21:56:56 user nova-compute[74337]: INFO nova.compute.manager [None req-623375e4-6305-47d7-83bc-e24014520f0a tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Took 6.10 seconds to build instance.
Oct 23 21:56:56 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-623375e4-6305-47d7-83bc-e24014520f0a tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Lock "dbad2e14-7b6c-475e-b471-a87cb9e21b7f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.199s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:56:57 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:56:58 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:57:02 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:57:03 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:57:07 user nova-compute[74337]: INFO nova.compute.manager [None req-7906a71e-1c72-4f95-91a5-5b56cbba5fd2 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Get console output
Oct 23 21:57:07 user nova-compute[74337]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Oct 23 21:57:07 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:57:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:57:12 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:57:13 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:57:13 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:57:14 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:57:14 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Starting heal instance info cache {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 21:57:14 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Rebuilding the list of instances to heal {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 21:57:14 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "refresh_cache-1189976f-8d02-468d-8fa7-bd5594c5f85a" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:57:14 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquired lock "refresh_cache-1189976f-8d02-468d-8fa7-bd5594c5f85a" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:57:14 user nova-compute[74337]: DEBUG nova.network.neutron [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 1189976f-8d02-468d-8fa7-bd5594c5f85a] Forcefully refreshing network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 21:57:14 user nova-compute[74337]: DEBUG nova.objects.instance [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lazy-loading 'info_cache' on Instance uuid 1189976f-8d02-468d-8fa7-bd5594c5f85a {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:57:14 user nova-compute[74337]: DEBUG nova.network.neutron [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 1189976f-8d02-468d-8fa7-bd5594c5f85a] Updating instance_info_cache with network_info: [{"id": "9c888931-1180-4efd-8ca1-a57252bf8dc5", "address": "fa:16:3e:f9:a2:b8", "network": {"id": "5f62b1d8-d5d0-4ff9-922b-fc6e72fb640d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-655282105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b85c4f783a4ee7ab67422b49da85ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c888931-11", "ovs_interfaceid": "9c888931-1180-4efd-8ca1-a57252bf8dc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:57:14 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Releasing lock "refresh_cache-1189976f-8d02-468d-8fa7-bd5594c5f85a" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:57:14 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 1189976f-8d02-468d-8fa7-bd5594c5f85a] Updated the network info_cache for instance {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 21:57:14 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:57:14 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:57:14 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 21:57:16 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:57:16 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:57:17 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:57:18 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:57:18 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:57:19 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:57:21 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:57:21 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:57:21 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:57:21 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:57:21 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:57:21 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Auditing locally available compute resources for user (node: user) {{(pid=74337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 21:57:21 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 21:57:21 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 21:57:21 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5d9d286-4837-4168-a4fe-1bc09e372654/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:57:21 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5d9d286-4837-4168-a4fe-1bc09e372654/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:57:21 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5d9d286-4837-4168-a4fe-1bc09e372654/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:57:22 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5d9d286-4837-4168-a4fe-1bc09e372654/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:57:22 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=74337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 21:57:22 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/547c4d4c-e0dd-495a-b83f-98426d0a4a99/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:57:22 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/547c4d4c-e0dd-495a-b83f-98426d0a4a99/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:57:22 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/547c4d4c-e0dd-495a-b83f-98426d0a4a99/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:57:22 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/547c4d4c-e0dd-495a-b83f-98426d0a4a99/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:57:22 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbad2e14-7b6c-475e-b471-a87cb9e21b7f/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:57:22 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:57:22 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbad2e14-7b6c-475e-b471-a87cb9e21b7f/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:57:22 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbad2e14-7b6c-475e-b471-a87cb9e21b7f/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:57:22 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbad2e14-7b6c-475e-b471-a87cb9e21b7f/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:57:22 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 21:57:22 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 21:57:22 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1189976f-8d02-468d-8fa7-bd5594c5f85a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:57:23 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1189976f-8d02-468d-8fa7-bd5594c5f85a/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:57:23 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1189976f-8d02-468d-8fa7-bd5594c5f85a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:57:23 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1189976f-8d02-468d-8fa7-bd5594c5f85a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:57:23 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:57:23 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:57:23 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Hypervisor/Node resource view: name=user free_ram=7905MB free_disk=25.230091094970703GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 21:57:23 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:57:23 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:57:23 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:57:23 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 1189976f-8d02-468d-8fa7-bd5594c5f85a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:57:23 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 547c4d4c-e0dd-495a-b83f-98426d0a4a99 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:57:23 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:57:23 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance d5d9d286-4837-4168-a4fe-1bc09e372654 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:57:23 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 86f56afb-77e6-4378-b441-5cf507a0fbe7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:57:23 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance bc4c3e54-a845-4ea8-9ffc-a75d42a51788 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:57:23 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 065c9704-8619-494a-9459-6e53f3a07f9e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:57:23 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance dbad2e14-7b6c-475e-b471-a87cb9e21b7f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:57:23 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 21:57:23 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 21:57:24 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:57:24 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:57:24 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Compute_service record updated for user:user {{(pid=74337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 21:57:24 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.442s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:57:27 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:57:28 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:57:30 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:57:32 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:57:33 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:57:37 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-2392c035-14f2-46fa-9d0f-de6fc7a6d33f tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Acquiring lock "c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:57:37 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-2392c035-14f2-46fa-9d0f-de6fc7a6d33f tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lock "c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:57:37 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-2392c035-14f2-46fa-9d0f-de6fc7a6d33f tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Acquiring lock "c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:57:37 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-2392c035-14f2-46fa-9d0f-de6fc7a6d33f tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lock "c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:57:37 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-2392c035-14f2-46fa-9d0f-de6fc7a6d33f tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lock "c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:57:37 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:57:37 user nova-compute[74337]: INFO nova.compute.manager [None req-2392c035-14f2-46fa-9d0f-de6fc7a6d33f tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] Terminating instance
Oct 23 21:57:37 user nova-compute[74337]: DEBUG nova.compute.manager [None req-2392c035-14f2-46fa-9d0f-de6fc7a6d33f tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] Start destroying the instance on the hypervisor. {{(pid=74337) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 21:57:37 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:57:37 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:57:38 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:57:38 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:57:38 user nova-compute[74337]: DEBUG nova.compute.manager [req-c814511c-7ee4-4124-9f56-a69ba98815ae req-e0ea4abc-3b0c-4cca-a101-161aac4ddbb9 service nova] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] Received event network-vif-unplugged-328722f1-b384-495c-8aea-81780b2d9ca1 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:57:38 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-c814511c-7ee4-4124-9f56-a69ba98815ae req-e0ea4abc-3b0c-4cca-a101-161aac4ddbb9 service nova] Acquiring lock "c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:57:38 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-c814511c-7ee4-4124-9f56-a69ba98815ae req-e0ea4abc-3b0c-4cca-a101-161aac4ddbb9 service nova] Lock "c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:57:38 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-c814511c-7ee4-4124-9f56-a69ba98815ae req-e0ea4abc-3b0c-4cca-a101-161aac4ddbb9 service nova] Lock "c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:57:38 user nova-compute[74337]: DEBUG nova.compute.manager [req-c814511c-7ee4-4124-9f56-a69ba98815ae req-e0ea4abc-3b0c-4cca-a101-161aac4ddbb9 service nova] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] No waiting events found dispatching network-vif-unplugged-328722f1-b384-495c-8aea-81780b2d9ca1 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:57:38 user nova-compute[74337]: DEBUG nova.compute.manager [req-c814511c-7ee4-4124-9f56-a69ba98815ae req-e0ea4abc-3b0c-4cca-a101-161aac4ddbb9 service nova] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] Received event network-vif-unplugged-328722f1-b384-495c-8aea-81780b2d9ca1 for instance with task_state deleting. {{(pid=74337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 21:57:38 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] Instance destroyed successfully.
Oct 23 21:57:38 user nova-compute[74337]: DEBUG nova.objects.instance [None req-2392c035-14f2-46fa-9d0f-de6fc7a6d33f tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lazy-loading 'resources' on Instance uuid c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:57:38 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-2392c035-14f2-46fa-9d0f-de6fc7a6d33f tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:41:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1651996924',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1651996924',id=20,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-23T21:43:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='83b85c4f783a4ee7ab67422b49da85ca',ramdisk_id='',reservation_id='r-53a64lky',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1944032280',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T21:45:39Z,user_data=None,user_id='a2e424dd3c684c808de14c2a9c3c1ed6',uuid=c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "328722f1-b384-495c-8aea-81780b2d9ca1", "address": "fa:16:3e:28:35:83", "network": {"id": "5f62b1d8-d5d0-4ff9-922b-fc6e72fb640d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-655282105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b85c4f783a4ee7ab67422b49da85ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap328722f1-b3", "ovs_interfaceid": "328722f1-b384-495c-8aea-81780b2d9ca1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 21:57:38 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-2392c035-14f2-46fa-9d0f-de6fc7a6d33f tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Converting VIF {"id": "328722f1-b384-495c-8aea-81780b2d9ca1", "address": "fa:16:3e:28:35:83", "network": {"id": "5f62b1d8-d5d0-4ff9-922b-fc6e72fb640d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-655282105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b85c4f783a4ee7ab67422b49da85ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap328722f1-b3", "ovs_interfaceid": "328722f1-b384-495c-8aea-81780b2d9ca1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:57:38 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-2392c035-14f2-46fa-9d0f-de6fc7a6d33f tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:28:35:83,bridge_name='br-int',has_traffic_filtering=True,id=328722f1-b384-495c-8aea-81780b2d9ca1,network=Network(5f62b1d8-d5d0-4ff9-922b-fc6e72fb640d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap328722f1-b3') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:57:38 user nova-compute[74337]: DEBUG os_vif [None req-2392c035-14f2-46fa-9d0f-de6fc7a6d33f tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:35:83,bridge_name='br-int',has_traffic_filtering=True,id=328722f1-b384-495c-8aea-81780b2d9ca1,network=Network(5f62b1d8-d5d0-4ff9-922b-fc6e72fb640d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap328722f1-b3') {{(pid=74337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 21:57:38 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:57:38 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap328722f1-b3, bridge=br-int, if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:57:38 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:57:38 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:57:38 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:57:38 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7fadbe8c-bca6-41b0-8bf4-d89b494612ca) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:57:38 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:57:38 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:57:38 user nova-compute[74337]: INFO os_vif [None req-2392c035-14f2-46fa-9d0f-de6fc7a6d33f tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:35:83,bridge_name='br-int',has_traffic_filtering=True,id=328722f1-b384-495c-8aea-81780b2d9ca1,network=Network(5f62b1d8-d5d0-4ff9-922b-fc6e72fb640d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap328722f1-b3')
Oct 23 21:57:38 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2392c035-14f2-46fa-9d0f-de6fc7a6d33f tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] calling os-brick to detach iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 21:57:38 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2392c035-14f2-46fa-9d0f-de6fc7a6d33f tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, {'target_iqn': 'iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YSOQyrej', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:57:38 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-2392c035-14f2-46fa-9d0f-de6fc7a6d33f tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:57:38 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-2392c035-14f2-46fa-9d0f-de6fc7a6d33f tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:57:38 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-2392c035-14f2-46fa-9d0f-de6fc7a6d33f tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:57:38 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:57:38 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:57:38 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3861957-e78d-4897-a371-46b177d2fa12]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ec9ef65f-2d9a-4950-8f01-5e837152c8df\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:57:38 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2392c035-14f2-46fa-9d0f-de6fc7a6d33f tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 21:57:38 user nova-compute[74337]: No targets found.
Oct 23 21:57:38 user nova-compute[74337]: iSNS:
Oct 23 21:57:38 user nova-compute[74337]: No targets found.
Oct 23 21:57:38 user nova-compute[74337]: STATIC:
Oct 23 21:57:38 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:ec9ef65f-2d9a-4950-8f01-5e837152c8df
Oct 23 21:57:38 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:57:38 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:57:38 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4
Oct 23 21:57:38 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:57:38 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:57:38 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398
Oct 23 21:57:38 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:57:38 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:57:38 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048
Oct 23 21:57:38 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:57:38 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:57:38 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7
Oct 23 21:57:38 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:57:38 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:57:38 user nova-compute[74337]: FIRMWARE:
Oct 23 21:57:38 user nova-compute[74337]: No targets found.
Oct 23 21:57:38 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:57:38 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2392c035-14f2-46fa-9d0f-de6fc7a6d33f tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 21:57:38 user nova-compute[74337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 21:57:38 user nova-compute[74337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 21:57:38 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2392c035-14f2-46fa-9d0f-de6fc7a6d33f tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4', 0)] {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 21:57:38 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:57:38 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:57:38 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ac3f9d5-9758-4ff6-bc27-03ad35119f45]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec9ef65f-2d9a-4950-8f01-5e837152c8df\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:57:38 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:57:38 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:57:38 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f0ed818-3a57-464f-956f-414dcabefe81]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec9ef65f-2d9a-4950-8f01-5e837152c8df (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:57:38 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2392c035-14f2-46fa-9d0f-de6fc7a6d33f tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:57:38 user nova-compute[74337]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 (non-flash)
Oct 23 21:57:38 user nova-compute[74337]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 (non-flash)
Oct 23 21:57:38 user nova-compute[74337]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7 (non-flash)
Oct 23 21:57:38 user nova-compute[74337]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec9ef65f-2d9a-4950-8f01-5e837152c8df (non-flash)
Oct 23 21:57:38 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:57:38 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2392c035-14f2-46fa-9d0f-de6fc7a6d33f tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 (non-flash)
Oct 23 21:57:38 user nova-compute[74337]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 (non-flash)
Oct 23 21:57:38 user nova-compute[74337]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 (non-flash)
Oct 23 21:57:38 user nova-compute[74337]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7 (non-flash)
Oct 23 21:57:38 user nova-compute[74337]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec9ef65f-2d9a-4950-8f01-5e837152c8df (non-flash)
Oct 23 21:57:38 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:57:38 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2392c035-14f2-46fa-9d0f-de6fc7a6d33f tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5ef428bd00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4'): ({'sdc'}, set())}) {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 21:57:38 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-2392c035-14f2-46fa-9d0f-de6fc7a6d33f tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Removing single pathed devices sdc {{(pid=74337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 21:57:38 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:57:38 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:57:38 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[32fe24e0-7ad0-4419-bd6f-5c4a89795c29]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:57:38 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:57:38 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:57:38 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e959a531-66cb-48fa-8f58-28b559c00101]: (4, ('ok\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:57:38 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-2392c035-14f2-46fa-9d0f-de6fc7a6d33f tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Flushing IO for device /dev/sdc {{(pid=74337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 21:57:38 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:57:38 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:57:38 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f0fe18-bb9f-4437-92dc-1fb7ac24d9dc]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:57:38 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-2392c035-14f2-46fa-9d0f-de6fc7a6d33f tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 21:57:38 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:57:38 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:57:38 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[736754cf-99d6-48b7-bc91-48045a98f7e4]: (4, ('1', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:57:38 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-2392c035-14f2-46fa-9d0f-de6fc7a6d33f tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 21:57:38 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-2392c035-14f2-46fa-9d0f-de6fc7a6d33f tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] SCSI volumes sdc have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 21:57:38 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2392c035-14f2-46fa-9d0f-de6fc7a6d33f tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4')] {{(pid=74337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 21:57:38 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:57:38 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:57:38 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[70b8cd0e-480f-4b09-9f90-ee5a7ad0acd3]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:57:38 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2392c035-14f2-46fa-9d0f-de6fc7a6d33f tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:57:38 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 -p 172.16.0.220:3260 --logout {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:57:38 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:57:38 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[788eb57a-c627-4aa4-9d6d-4aa74eb4040d]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:57:38 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2392c035-14f2-46fa-9d0f-de6fc7a6d33f tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4, portal: 172.16.0.220,3260]
Oct 23 21:57:38 user nova-compute[74337]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4, portal: 172.16.0.220,3260] successful.
Oct 23 21:57:38 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:57:38 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 -p 172.16.0.220:3260 --op delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:57:38 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c14e786-3c6e-49fa-a1eb-ab0f37c74bd4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:57:38 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[f738e285-5317-416b-9dc0-1e94d333d247]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:57:38 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2392c035-14f2-46fa-9d0f-de6fc7a6d33f tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:57:38 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-2392c035-14f2-46fa-9d0f-de6fc7a6d33f tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.383s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:57:38 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2392c035-14f2-46fa-9d0f-de6fc7a6d33f tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] <== disconnect_volume: return (385ms) None {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:57:38 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2392c035-14f2-46fa-9d0f-de6fc7a6d33f tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] Disconnected iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 21:57:38 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-2392c035-14f2-46fa-9d0f-de6fc7a6d33f tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] Deleting instance files /opt/stack/data/nova/instances/c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d_del
Oct 23 21:57:38 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-2392c035-14f2-46fa-9d0f-de6fc7a6d33f tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] Deletion of /opt/stack/data/nova/instances/c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d_del complete
Oct 23 21:57:38 user nova-compute[74337]: INFO nova.compute.manager [None req-2392c035-14f2-46fa-9d0f-de6fc7a6d33f tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] Took 1.34 seconds to destroy the instance on the hypervisor.
Oct 23 21:57:38 user nova-compute[74337]: DEBUG oslo.service.loopingcall [None req-2392c035-14f2-46fa-9d0f-de6fc7a6d33f tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74337) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 21:57:38 user nova-compute[74337]: DEBUG nova.compute.manager [-] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] Deallocating network for instance {{(pid=74337) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 21:57:38 user nova-compute[74337]: DEBUG nova.network.neutron [-] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] deallocate_for_instance() {{(pid=74337) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 21:57:39 user nova-compute[74337]: DEBUG nova.network.neutron [-] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] Updating instance_info_cache with network_info: [] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:57:39 user nova-compute[74337]: INFO nova.compute.manager [-] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] Took 0.53 seconds to deallocate network for instance.
Oct 23 21:57:39 user nova-compute[74337]: DEBUG nova.compute.manager [req-d001da16-4c1f-42cf-8f95-feedec48e541 req-24dcb6a6-ace8-470b-a0cc-bdb8d1c6d08c service nova] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] Received event network-vif-deleted-328722f1-b384-495c-8aea-81780b2d9ca1 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:57:39 user nova-compute[74337]: INFO nova.compute.manager [req-d001da16-4c1f-42cf-8f95-feedec48e541 req-24dcb6a6-ace8-470b-a0cc-bdb8d1c6d08c service nova] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] Neutron deleted interface 328722f1-b384-495c-8aea-81780b2d9ca1; detaching it from the instance and deleting it from the info cache
Oct 23 21:57:39 user nova-compute[74337]: DEBUG nova.network.neutron [req-d001da16-4c1f-42cf-8f95-feedec48e541 req-24dcb6a6-ace8-470b-a0cc-bdb8d1c6d08c service nova] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] Updating instance_info_cache with network_info: [] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:57:39 user nova-compute[74337]: DEBUG nova.compute.manager [req-d001da16-4c1f-42cf-8f95-feedec48e541 req-24dcb6a6-ace8-470b-a0cc-bdb8d1c6d08c service nova] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] Detach interface failed, port_id=328722f1-b384-495c-8aea-81780b2d9ca1, reason: Instance c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d could not be found. {{(pid=74337) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 23 21:57:40 user nova-compute[74337]: INFO nova.compute.manager [None req-2392c035-14f2-46fa-9d0f-de6fc7a6d33f tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] Took 0.82 seconds to detach 1 volumes for instance.
Oct 23 21:57:40 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-2392c035-14f2-46fa-9d0f-de6fc7a6d33f tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:57:40 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-2392c035-14f2-46fa-9d0f-de6fc7a6d33f tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:57:40 user nova-compute[74337]: DEBUG nova.compute.manager [req-2a434e20-b8cb-479b-a8f0-3965266df2ab req-2fe612f8-39a5-4490-9a68-a3a86a23a3b6 service nova] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] Received event network-vif-plugged-328722f1-b384-495c-8aea-81780b2d9ca1 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:57:40 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-2a434e20-b8cb-479b-a8f0-3965266df2ab req-2fe612f8-39a5-4490-9a68-a3a86a23a3b6 service nova] Acquiring lock "c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:57:40 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-2a434e20-b8cb-479b-a8f0-3965266df2ab req-2fe612f8-39a5-4490-9a68-a3a86a23a3b6 service nova] Lock "c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:57:40 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-2a434e20-b8cb-479b-a8f0-3965266df2ab req-2fe612f8-39a5-4490-9a68-a3a86a23a3b6 service nova] Lock "c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:57:40 user nova-compute[74337]: DEBUG nova.compute.manager [req-2a434e20-b8cb-479b-a8f0-3965266df2ab req-2fe612f8-39a5-4490-9a68-a3a86a23a3b6 service nova] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] No waiting events found dispatching network-vif-plugged-328722f1-b384-495c-8aea-81780b2d9ca1 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:57:40 user nova-compute[74337]: WARNING nova.compute.manager [req-2a434e20-b8cb-479b-a8f0-3965266df2ab req-2fe612f8-39a5-4490-9a68-a3a86a23a3b6 service nova] [instance: c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d] Received unexpected event network-vif-plugged-328722f1-b384-495c-8aea-81780b2d9ca1 for instance with vm_state deleted and task_state None.
Oct 23 21:57:40 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-2392c035-14f2-46fa-9d0f-de6fc7a6d33f tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:57:40 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-2392c035-14f2-46fa-9d0f-de6fc7a6d33f tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:57:40 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-2392c035-14f2-46fa-9d0f-de6fc7a6d33f tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.286s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:57:40 user nova-compute[74337]: INFO nova.scheduler.client.report [None req-2392c035-14f2-46fa-9d0f-de6fc7a6d33f tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Deleted allocations for instance c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d
Oct 23 21:57:40 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-2392c035-14f2-46fa-9d0f-de6fc7a6d33f tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lock "c859ec42-bb6d-4e4d-8dbf-d0f97bf5255d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.170s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:57:43 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:57:43 user nova-compute[74337]: DEBUG nova.compute.manager [req-5aeac705-2fc0-481b-bab3-787bf654b171 req-014ff47f-5a67-4b7c-b3bb-c359dba25464 service nova] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] Received event network-changed-16ee3173-b704-43aa-9c44-ffa4d4d82fc4 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:57:43 user nova-compute[74337]: DEBUG nova.compute.manager [req-5aeac705-2fc0-481b-bab3-787bf654b171 req-014ff47f-5a67-4b7c-b3bb-c359dba25464 service nova] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] Refreshing instance network info cache due to event network-changed-16ee3173-b704-43aa-9c44-ffa4d4d82fc4. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 21:57:43 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-5aeac705-2fc0-481b-bab3-787bf654b171 req-014ff47f-5a67-4b7c-b3bb-c359dba25464 service nova] Acquiring lock "refresh_cache-d5d9d286-4837-4168-a4fe-1bc09e372654" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:57:43 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-5aeac705-2fc0-481b-bab3-787bf654b171 req-014ff47f-5a67-4b7c-b3bb-c359dba25464 service nova] Acquired lock "refresh_cache-d5d9d286-4837-4168-a4fe-1bc09e372654" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:57:43 user nova-compute[74337]: DEBUG nova.network.neutron [req-5aeac705-2fc0-481b-bab3-787bf654b171 req-014ff47f-5a67-4b7c-b3bb-c359dba25464 service nova] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] Refreshing network info cache for port 16ee3173-b704-43aa-9c44-ffa4d4d82fc4 {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 21:57:43 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:57:44 user nova-compute[74337]: DEBUG nova.network.neutron [req-5aeac705-2fc0-481b-bab3-787bf654b171 req-014ff47f-5a67-4b7c-b3bb-c359dba25464 service nova] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] Updated VIF entry in instance network info cache for port 16ee3173-b704-43aa-9c44-ffa4d4d82fc4. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 21:57:44 user nova-compute[74337]: DEBUG nova.network.neutron [req-5aeac705-2fc0-481b-bab3-787bf654b171 req-014ff47f-5a67-4b7c-b3bb-c359dba25464 service nova] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] Updating instance_info_cache with network_info: [{"id": "16ee3173-b704-43aa-9c44-ffa4d4d82fc4", "address": "fa:16:3e:be:e5:9b", "network": {"id": "0b1d82b0-acba-470e-aede-1c57a85a8ed3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1250228933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "965415a9973d4714aa49a64d34b232a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16ee3173-b7", "ovs_interfaceid": "16ee3173-b704-43aa-9c44-ffa4d4d82fc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:57:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-5aeac705-2fc0-481b-bab3-787bf654b171 req-014ff47f-5a67-4b7c-b3bb-c359dba25464 service nova] Releasing lock "refresh_cache-d5d9d286-4837-4168-a4fe-1bc09e372654" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:57:45 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-c5d882d4-916c-43f4-89fe-7519725eb46a tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Acquiring lock "d5d9d286-4837-4168-a4fe-1bc09e372654" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:57:45 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-c5d882d4-916c-43f4-89fe-7519725eb46a tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Lock "d5d9d286-4837-4168-a4fe-1bc09e372654" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:57:45 user nova-compute[74337]: INFO nova.compute.manager [None req-c5d882d4-916c-43f4-89fe-7519725eb46a tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] Detaching volume f147349c-8434-4957-8f5f-ced11857d9b7
Oct 23 21:57:45 user nova-compute[74337]: INFO nova.virt.block_device [None req-c5d882d4-916c-43f4-89fe-7519725eb46a tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] Attempting to driver detach volume f147349c-8434-4957-8f5f-ced11857d9b7 from mountpoint /dev/vdb
Oct 23 21:57:45 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-c5d882d4-916c-43f4-89fe-7519725eb46a tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Attempting to detach device vdb from instance d5d9d286-4837-4168-a4fe-1bc09e372654 from the persistent domain config. {{(pid=74337) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 21:57:45 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-c5d882d4-916c-43f4-89fe-7519725eb46a tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 21:57:45 user nova-compute[74337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 21:57:45 user nova-compute[74337]:   <source dev="/dev/sdg"/>
Oct 23 21:57:45 user nova-compute[74337]:   <target dev="vdb" bus="virtio"/>
Oct 23 21:57:45 user nova-compute[74337]:   <serial>f147349c-8434-4957-8f5f-ced11857d9b7</serial>
Oct 23 21:57:45 user nova-compute[74337]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 23 21:57:45 user nova-compute[74337]: </disk>
Oct 23 21:57:45 user nova-compute[74337]:  {{(pid=74337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 21:57:45 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-c5d882d4-916c-43f4-89fe-7519725eb46a tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Successfully detached device vdb from instance d5d9d286-4837-4168-a4fe-1bc09e372654 from the persistent domain config.
Oct 23 21:57:45 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-c5d882d4-916c-43f4-89fe-7519725eb46a tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d5d9d286-4837-4168-a4fe-1bc09e372654 from the live domain config. {{(pid=74337) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 21:57:45 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-c5d882d4-916c-43f4-89fe-7519725eb46a tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 21:57:45 user nova-compute[74337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 21:57:45 user nova-compute[74337]:   <source dev="/dev/sdg"/>
Oct 23 21:57:45 user nova-compute[74337]:   <target dev="vdb" bus="virtio"/>
Oct 23 21:57:45 user nova-compute[74337]:   <serial>f147349c-8434-4957-8f5f-ced11857d9b7</serial>
Oct 23 21:57:45 user nova-compute[74337]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 23 21:57:45 user nova-compute[74337]: </disk>
Oct 23 21:57:45 user nova-compute[74337]:  {{(pid=74337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 21:57:45 user nova-compute[74337]: DEBUG nova.compute.manager [req-d4e0678f-02b1-4a94-ab69-54630f90c304 req-ce906e96-504a-4b03-bd15-7cb2fa014c23 service nova] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] Received event network-changed-16ee3173-b704-43aa-9c44-ffa4d4d82fc4 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:57:45 user nova-compute[74337]: DEBUG nova.compute.manager [req-d4e0678f-02b1-4a94-ab69-54630f90c304 req-ce906e96-504a-4b03-bd15-7cb2fa014c23 service nova] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] Refreshing instance network info cache due to event network-changed-16ee3173-b704-43aa-9c44-ffa4d4d82fc4. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 21:57:45 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-d4e0678f-02b1-4a94-ab69-54630f90c304 req-ce906e96-504a-4b03-bd15-7cb2fa014c23 service nova] Acquiring lock "refresh_cache-d5d9d286-4837-4168-a4fe-1bc09e372654" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:57:45 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-d4e0678f-02b1-4a94-ab69-54630f90c304 req-ce906e96-504a-4b03-bd15-7cb2fa014c23 service nova] Acquired lock "refresh_cache-d5d9d286-4837-4168-a4fe-1bc09e372654" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:57:45 user nova-compute[74337]: DEBUG nova.network.neutron [req-d4e0678f-02b1-4a94-ab69-54630f90c304 req-ce906e96-504a-4b03-bd15-7cb2fa014c23 service nova] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] Refreshing network info cache for port 16ee3173-b704-43aa-9c44-ffa4d4d82fc4 {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 21:57:45 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-c5d882d4-916c-43f4-89fe-7519725eb46a tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d5d9d286-4837-4168-a4fe-1bc09e372654 {{(pid=74337) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 21:57:46 user nova-compute[74337]: DEBUG nova.network.neutron [req-d4e0678f-02b1-4a94-ab69-54630f90c304 req-ce906e96-504a-4b03-bd15-7cb2fa014c23 service nova] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] Updated VIF entry in instance network info cache for port 16ee3173-b704-43aa-9c44-ffa4d4d82fc4. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 21:57:46 user nova-compute[74337]: DEBUG nova.network.neutron [req-d4e0678f-02b1-4a94-ab69-54630f90c304 req-ce906e96-504a-4b03-bd15-7cb2fa014c23 service nova] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] Updating instance_info_cache with network_info: [{"id": "16ee3173-b704-43aa-9c44-ffa4d4d82fc4", "address": "fa:16:3e:be:e5:9b", "network": {"id": "0b1d82b0-acba-470e-aede-1c57a85a8ed3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1250228933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "965415a9973d4714aa49a64d34b232a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16ee3173-b7", "ovs_interfaceid": "16ee3173-b704-43aa-9c44-ffa4d4d82fc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:57:46 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-d4e0678f-02b1-4a94-ab69-54630f90c304 req-ce906e96-504a-4b03-bd15-7cb2fa014c23 service nova] Releasing lock "refresh_cache-d5d9d286-4837-4168-a4fe-1bc09e372654" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:57:48 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:57:52 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:57:53 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:57:55 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-c27e6ac0-f87e-49d3-b20d-0270e2aee1d9 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] Acquiring lock "0323b854-c7a1-42e8-ad85-1e929caa6e9d" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:57:55 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-c27e6ac0-f87e-49d3-b20d-0270e2aee1d9 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] Lock "0323b854-c7a1-42e8-ad85-1e929caa6e9d" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:57:55 user nova-compute[74337]: INFO nova.compute.manager [None req-c27e6ac0-f87e-49d3-b20d-0270e2aee1d9 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d] Unshelving
Oct 23 21:57:55 user nova-compute[74337]: INFO nova.virt.block_device [None req-c27e6ac0-f87e-49d3-b20d-0270e2aee1d9 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d] Booting with volume 89f93205-ad98-45ff-8903-c2a7251da607 at /dev/vda
Oct 23 21:57:55 user nova-compute[74337]: DEBUG os_brick.utils [None req-c27e6ac0-f87e-49d3-b20d-0270e2aee1d9 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:57:55 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:57:55 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:57:55 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[267788e6-340e-4c0a-bbce-e7ce80de5341]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f34011b66e40\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:57:55 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:57:55 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:57:55 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b390be1-4391-4c13-9de2-34e968aeb4e6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:57:55 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:57:55 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:57:55 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ff3a36c-d694-4c28-be5b-f4d11329cdb9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:57:55 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[51398196-911e-492f-8c40-a07650cc85ec]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:57:55 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-c27e6ac0-f87e-49d3-b20d-0270e2aee1d9 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] Running cmd (subprocess): nvme version {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:57:55 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-c27e6ac0-f87e-49d3-b20d-0270e2aee1d9 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] 'nvme version' failed. Not Retrying. {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 21:57:55 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c27e6ac0-f87e-49d3-b20d-0270e2aee1d9 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] nvme not present on system {{(pid=74337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 21:57:55 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:57:55 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 21:57:55 user nova-compute[74337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 21:57:55 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ebbb3c8-dac0-425e-93cb-e55b79a92f9a]: (4, '') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:57:55 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-c27e6ac0-f87e-49d3-b20d-0270e2aee1d9 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 21:57:55 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-c27e6ac0-f87e-49d3-b20d-0270e2aee1d9 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 21:57:55 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-c27e6ac0-f87e-49d3-b20d-0270e2aee1d9 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] LIGHTOS: no hostnqn found. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 21:57:55 user nova-compute[74337]: DEBUG os_brick.utils [None req-c27e6ac0-f87e-49d3-b20d-0270e2aee1d9 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f34011b66e40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:57:55 user nova-compute[74337]: DEBUG nova.virt.block_device [None req-c27e6ac0-f87e-49d3-b20d-0270e2aee1d9 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d] Updating existing volume attachment record: 5a6db445-bfdb-458a-9225-22067d63394c {{(pid=74337) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 21:57:56 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:57:58 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:57:58 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:57:59 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:58:03 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:58:03 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:58:05 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-c5d882d4-916c-43f4-89fe-7519725eb46a tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d5d9d286-4837-4168-a4fe-1bc09e372654 is timed out.
Oct 23 21:58:05 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-c5d882d4-916c-43f4-89fe-7519725eb46a tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Successfully detached device vdb from instance d5d9d286-4837-4168-a4fe-1bc09e372654 from the live domain config.
Oct 23 21:58:05 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5d882d4-916c-43f4-89fe-7519725eb46a tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] calling os-brick to detach iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 21:58:05 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5d882d4-916c-43f4-89fe-7519725eb46a tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, {'target_iqn': 'iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QpXmROZJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:58:05 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-c5d882d4-916c-43f4-89fe-7519725eb46a tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:58:05 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-c5d882d4-916c-43f4-89fe-7519725eb46a tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:58:05 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-c5d882d4-916c-43f4-89fe-7519725eb46a tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:58:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:58:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:58:05 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[deae99cb-6eaf-413d-993f-ac5bbf6e9c53]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ec9ef65f-2d9a-4950-8f01-5e837152c8df\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:58:05 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5d882d4-916c-43f4-89fe-7519725eb46a tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 21:58:05 user nova-compute[74337]: No targets found.
Oct 23 21:58:05 user nova-compute[74337]: iSNS:
Oct 23 21:58:05 user nova-compute[74337]: No targets found.
Oct 23 21:58:05 user nova-compute[74337]: STATIC:
Oct 23 21:58:05 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:ec9ef65f-2d9a-4950-8f01-5e837152c8df
Oct 23 21:58:05 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:58:05 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:58:05 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398
Oct 23 21:58:05 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:58:05 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:58:05 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048
Oct 23 21:58:05 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:58:05 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:58:05 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7
Oct 23 21:58:05 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:58:05 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:58:05 user nova-compute[74337]: FIRMWARE:
Oct 23 21:58:05 user nova-compute[74337]: No targets found.
Oct 23 21:58:05 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:58:05 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5d882d4-916c-43f4-89fe-7519725eb46a tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 21:58:05 user nova-compute[74337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 21:58:05 user nova-compute[74337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 21:58:05 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5d882d4-916c-43f4-89fe-7519725eb46a tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7', 0)] {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 21:58:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:58:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:58:05 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b56f0b1-f0e2-428b-85d9-1a73199fd3c5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec9ef65f-2d9a-4950-8f01-5e837152c8df\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:58:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:58:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:58:05 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[0144b01c-d86e-4c7a-8c67-0b0aa5801d8b]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec9ef65f-2d9a-4950-8f01-5e837152c8df (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:58:05 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5d882d4-916c-43f4-89fe-7519725eb46a tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 (non-flash)
Oct 23 21:58:05 user nova-compute[74337]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 (non-flash)
Oct 23 21:58:05 user nova-compute[74337]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7 (non-flash)
Oct 23 21:58:05 user nova-compute[74337]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec9ef65f-2d9a-4950-8f01-5e837152c8df (non-flash)
Oct 23 21:58:05 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:58:05 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5d882d4-916c-43f4-89fe-7519725eb46a tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 (non-flash)
Oct 23 21:58:05 user nova-compute[74337]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 (non-flash)
Oct 23 21:58:05 user nova-compute[74337]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7 (non-flash)
Oct 23 21:58:05 user nova-compute[74337]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec9ef65f-2d9a-4950-8f01-5e837152c8df (non-flash)
Oct 23 21:58:05 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:58:05 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5d882d4-916c-43f4-89fe-7519725eb46a tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5eec2f40d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7'): ({'sdg'}, set())}) {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 21:58:05 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-c5d882d4-916c-43f4-89fe-7519725eb46a tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Removing single pathed devices sdg {{(pid=74337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 21:58:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:58:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:58:05 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ada653-7ad9-4102-a7ea-b6a4fceb874d]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:58:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:58:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:58:06 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb45a954-17be-4d39-a896-d7d4f1871545]: (4, ('ok\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:58:06 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-c5d882d4-916c-43f4-89fe-7519725eb46a tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Flushing IO for device /dev/sdg {{(pid=74337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 21:58:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:58:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:58:06 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb1b505-0371-4963-9c5e-f74178db3e5b]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:58:06 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-c5d882d4-916c-43f4-89fe-7519725eb46a tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 21:58:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:58:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.033s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:58:06 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a44a4c19-79d7-4ce3-99ed-6af3e5db2570]: (4, ('1', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:58:06 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-c5d882d4-916c-43f4-89fe-7519725eb46a tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 21:58:06 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-c5d882d4-916c-43f4-89fe-7519725eb46a tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] SCSI volumes sdg have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 21:58:06 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5d882d4-916c-43f4-89fe-7519725eb46a tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7')] {{(pid=74337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 21:58:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:58:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:58:06 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1cdb55e-5aab-43c9-b9ed-6d035ec963fc]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:58:06 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-2cbdc103-2eaa-4e1f-9b83-86d1dd305e36 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Acquiring lock "e903b923-51ac-46f6-9652-1d33c946e25a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:58:06 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-2cbdc103-2eaa-4e1f-9b83-86d1dd305e36 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Lock "e903b923-51ac-46f6-9652-1d33c946e25a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:58:06 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5d882d4-916c-43f4-89fe-7519725eb46a tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:58:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7 -p 172.16.0.220:3260 --logout {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:58:06 user nova-compute[74337]: DEBUG nova.compute.manager [None req-2cbdc103-2eaa-4e1f-9b83-86d1dd305e36 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] [instance: e903b923-51ac-46f6-9652-1d33c946e25a] Starting instance... {{(pid=74337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 21:58:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:58:06 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec7cd125-155b-4092-a7ed-cbffe48d90ca]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:58:06 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5d882d4-916c-43f4-89fe-7519725eb46a tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7, portal: 172.16.0.220,3260]
Oct 23 21:58:06 user nova-compute[74337]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7, portal: 172.16.0.220,3260] successful.
Oct 23 21:58:06 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:58:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7 -p 172.16.0.220:3260 --op delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:58:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f147349c-8434-4957-8f5f-ced11857d9b7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:58:06 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f5baee7-9bda-47e6-988e-feade1962f3d]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:58:06 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5d882d4-916c-43f4-89fe-7519725eb46a tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:58:06 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-c5d882d4-916c-43f4-89fe-7519725eb46a tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:58:06 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5d882d4-916c-43f4-89fe-7519725eb46a tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] <== disconnect_volume: return (351ms) None {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:58:06 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5d882d4-916c-43f4-89fe-7519725eb46a tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] Disconnected iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 21:58:06 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-2cbdc103-2eaa-4e1f-9b83-86d1dd305e36 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:58:06 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-2cbdc103-2eaa-4e1f-9b83-86d1dd305e36 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:58:06 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-2cbdc103-2eaa-4e1f-9b83-86d1dd305e36 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 21:58:06 user nova-compute[74337]: INFO nova.compute.claims [None req-2cbdc103-2eaa-4e1f-9b83-86d1dd305e36 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] [instance: e903b923-51ac-46f6-9652-1d33c946e25a] Claim successful on node user
Oct 23 21:58:06 user nova-compute[74337]: DEBUG nova.compute.manager [req-708bd8d3-d79a-4716-89c9-99d4829447a6 req-28d65918-e46a-4c24-84f1-85debce37050 service nova] [instance: 065c9704-8619-494a-9459-6e53f3a07f9e] Received event network-changed-c4a05fc8-3976-4c52-a1c4-d2bfb51ba32b {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:58:06 user nova-compute[74337]: DEBUG nova.compute.manager [req-708bd8d3-d79a-4716-89c9-99d4829447a6 req-28d65918-e46a-4c24-84f1-85debce37050 service nova] [instance: 065c9704-8619-494a-9459-6e53f3a07f9e] Refreshing instance network info cache due to event network-changed-c4a05fc8-3976-4c52-a1c4-d2bfb51ba32b. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 21:58:06 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-708bd8d3-d79a-4716-89c9-99d4829447a6 req-28d65918-e46a-4c24-84f1-85debce37050 service nova] Acquiring lock "refresh_cache-065c9704-8619-494a-9459-6e53f3a07f9e" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:58:06 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-708bd8d3-d79a-4716-89c9-99d4829447a6 req-28d65918-e46a-4c24-84f1-85debce37050 service nova] Acquired lock "refresh_cache-065c9704-8619-494a-9459-6e53f3a07f9e" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:58:06 user nova-compute[74337]: DEBUG nova.network.neutron [req-708bd8d3-d79a-4716-89c9-99d4829447a6 req-28d65918-e46a-4c24-84f1-85debce37050 service nova] [instance: 065c9704-8619-494a-9459-6e53f3a07f9e] Refreshing network info cache for port c4a05fc8-3976-4c52-a1c4-d2bfb51ba32b {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 21:58:06 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-2cbdc103-2eaa-4e1f-9b83-86d1dd305e36 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:58:06 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-2cbdc103-2eaa-4e1f-9b83-86d1dd305e36 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:58:06 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-2cbdc103-2eaa-4e1f-9b83-86d1dd305e36 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.435s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:58:06 user nova-compute[74337]: DEBUG nova.compute.manager [None req-2cbdc103-2eaa-4e1f-9b83-86d1dd305e36 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] [instance: e903b923-51ac-46f6-9652-1d33c946e25a] Start building networks asynchronously for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 21:58:06 user nova-compute[74337]: DEBUG nova.compute.manager [None req-2cbdc103-2eaa-4e1f-9b83-86d1dd305e36 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] [instance: e903b923-51ac-46f6-9652-1d33c946e25a] Allocating IP information in the background. {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 21:58:06 user nova-compute[74337]: DEBUG nova.network.neutron [None req-2cbdc103-2eaa-4e1f-9b83-86d1dd305e36 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] [instance: e903b923-51ac-46f6-9652-1d33c946e25a] allocate_for_instance() {{(pid=74337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 21:58:06 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-2cbdc103-2eaa-4e1f-9b83-86d1dd305e36 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] [instance: e903b923-51ac-46f6-9652-1d33c946e25a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 21:58:06 user nova-compute[74337]: DEBUG nova.compute.manager [None req-2cbdc103-2eaa-4e1f-9b83-86d1dd305e36 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] [instance: e903b923-51ac-46f6-9652-1d33c946e25a] Start building block device mappings for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 21:58:06 user nova-compute[74337]: DEBUG nova.network.neutron [req-708bd8d3-d79a-4716-89c9-99d4829447a6 req-28d65918-e46a-4c24-84f1-85debce37050 service nova] [instance: 065c9704-8619-494a-9459-6e53f3a07f9e] Updated VIF entry in instance network info cache for port c4a05fc8-3976-4c52-a1c4-d2bfb51ba32b. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 21:58:06 user nova-compute[74337]: DEBUG nova.network.neutron [req-708bd8d3-d79a-4716-89c9-99d4829447a6 req-28d65918-e46a-4c24-84f1-85debce37050 service nova] [instance: 065c9704-8619-494a-9459-6e53f3a07f9e] Updating instance_info_cache with network_info: [{"id": "c4a05fc8-3976-4c52-a1c4-d2bfb51ba32b", "address": "fa:16:3e:8e:9f:f6", "network": {"id": "5a18e96f-a6eb-4989-9be3-154b54928b03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-507511840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb567547bd4941fb87435a841c9d17c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4a05fc8-39", "ovs_interfaceid": "c4a05fc8-3976-4c52-a1c4-d2bfb51ba32b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:58:06 user nova-compute[74337]: DEBUG nova.policy [None req-2cbdc103-2eaa-4e1f-9b83-86d1dd305e36 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '112575ac7c2d4409a95aa1844d967afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10913ebbab6441bdaa5b0bd97bf1dfb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74337) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 21:58:06 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-708bd8d3-d79a-4716-89c9-99d4829447a6 req-28d65918-e46a-4c24-84f1-85debce37050 service nova] Releasing lock "refresh_cache-065c9704-8619-494a-9459-6e53f3a07f9e" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:58:06 user nova-compute[74337]: DEBUG nova.compute.manager [None req-2cbdc103-2eaa-4e1f-9b83-86d1dd305e36 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] [instance: e903b923-51ac-46f6-9652-1d33c946e25a] Start spawning the instance on the hypervisor. {{(pid=74337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 21:58:06 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-2cbdc103-2eaa-4e1f-9b83-86d1dd305e36 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] [instance: e903b923-51ac-46f6-9652-1d33c946e25a] Creating instance directory {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 21:58:06 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-2cbdc103-2eaa-4e1f-9b83-86d1dd305e36 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] [instance: e903b923-51ac-46f6-9652-1d33c946e25a] Creating image(s)
Oct 23 21:58:06 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-2cbdc103-2eaa-4e1f-9b83-86d1dd305e36 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Acquiring lock "/opt/stack/data/nova/instances/e903b923-51ac-46f6-9652-1d33c946e25a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:58:06 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-2cbdc103-2eaa-4e1f-9b83-86d1dd305e36 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Lock "/opt/stack/data/nova/instances/e903b923-51ac-46f6-9652-1d33c946e25a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:58:06 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-2cbdc103-2eaa-4e1f-9b83-86d1dd305e36 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Lock "/opt/stack/data/nova/instances/e903b923-51ac-46f6-9652-1d33c946e25a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:58:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-2cbdc103-2eaa-4e1f-9b83-86d1dd305e36 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:58:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-2cbdc103-2eaa-4e1f-9b83-86d1dd305e36 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.184s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:58:07 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-2cbdc103-2eaa-4e1f-9b83-86d1dd305e36 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Acquiring lock "fc7b140751b8c385de81623e40fb09ce09374ab7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:58:07 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-2cbdc103-2eaa-4e1f-9b83-86d1dd305e36 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Lock "fc7b140751b8c385de81623e40fb09ce09374ab7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:58:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-2cbdc103-2eaa-4e1f-9b83-86d1dd305e36 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:58:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-2cbdc103-2eaa-4e1f-9b83-86d1dd305e36 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.195s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:58:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-2cbdc103-2eaa-4e1f-9b83-86d1dd305e36 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7,backing_fmt=raw /opt/stack/data/nova/instances/e903b923-51ac-46f6-9652-1d33c946e25a/disk 1073741824 {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:58:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-2cbdc103-2eaa-4e1f-9b83-86d1dd305e36 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7,backing_fmt=raw /opt/stack/data/nova/instances/e903b923-51ac-46f6-9652-1d33c946e25a/disk 1073741824" returned: 0 in 0.054s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:58:07 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-2cbdc103-2eaa-4e1f-9b83-86d1dd305e36 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Lock "fc7b140751b8c385de81623e40fb09ce09374ab7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:58:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-2cbdc103-2eaa-4e1f-9b83-86d1dd305e36 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:58:07 user nova-compute[74337]: DEBUG nova.network.neutron [None req-2cbdc103-2eaa-4e1f-9b83-86d1dd305e36 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] [instance: e903b923-51ac-46f6-9652-1d33c946e25a] Successfully created port: 156a94ae-3ed6-4ea7-a55f-6230e9050946 {{(pid=74337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 21:58:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-2cbdc103-2eaa-4e1f-9b83-86d1dd305e36 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.194s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:58:07 user nova-compute[74337]: DEBUG nova.virt.disk.api [None req-2cbdc103-2eaa-4e1f-9b83-86d1dd305e36 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e903b923-51ac-46f6-9652-1d33c946e25a/disk. size=1073741824 {{(pid=74337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 21:58:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-2cbdc103-2eaa-4e1f-9b83-86d1dd305e36 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e903b923-51ac-46f6-9652-1d33c946e25a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:58:07 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-2cbdc103-2eaa-4e1f-9b83-86d1dd305e36 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e903b923-51ac-46f6-9652-1d33c946e25a/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:58:07 user nova-compute[74337]: DEBUG nova.virt.disk.api [None req-2cbdc103-2eaa-4e1f-9b83-86d1dd305e36 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Cannot resize image /opt/stack/data/nova/instances/e903b923-51ac-46f6-9652-1d33c946e25a/disk to a smaller size. {{(pid=74337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 21:58:07 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-2cbdc103-2eaa-4e1f-9b83-86d1dd305e36 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] [instance: e903b923-51ac-46f6-9652-1d33c946e25a] Created local disks {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 21:58:07 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-2cbdc103-2eaa-4e1f-9b83-86d1dd305e36 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] [instance: e903b923-51ac-46f6-9652-1d33c946e25a] Ensure instance console log exists: /opt/stack/data/nova/instances/e903b923-51ac-46f6-9652-1d33c946e25a/console.log {{(pid=74337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 21:58:07 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-2cbdc103-2eaa-4e1f-9b83-86d1dd305e36 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:58:07 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-2cbdc103-2eaa-4e1f-9b83-86d1dd305e36 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:58:07 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-2cbdc103-2eaa-4e1f-9b83-86d1dd305e36 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:58:08 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-bb5831c4-409f-4598-b742-3a9bad0321fb tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Acquiring lock "86f56afb-77e6-4378-b441-5cf507a0fbe7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:58:08 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-bb5831c4-409f-4598-b742-3a9bad0321fb tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lock "86f56afb-77e6-4378-b441-5cf507a0fbe7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:58:08 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-bb5831c4-409f-4598-b742-3a9bad0321fb tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Acquiring lock "86f56afb-77e6-4378-b441-5cf507a0fbe7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:58:08 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-bb5831c4-409f-4598-b742-3a9bad0321fb tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lock "86f56afb-77e6-4378-b441-5cf507a0fbe7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:58:08 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-bb5831c4-409f-4598-b742-3a9bad0321fb tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lock "86f56afb-77e6-4378-b441-5cf507a0fbe7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:58:08 user nova-compute[74337]: INFO nova.compute.manager [None req-bb5831c4-409f-4598-b742-3a9bad0321fb tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Terminating instance
Oct 23 21:58:08 user nova-compute[74337]: DEBUG nova.compute.manager [None req-bb5831c4-409f-4598-b742-3a9bad0321fb tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Start destroying the instance on the hypervisor. {{(pid=74337) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 21:58:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:58:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:58:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:58:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:58:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:58:08 user nova-compute[74337]: DEBUG nova.network.neutron [None req-2cbdc103-2eaa-4e1f-9b83-86d1dd305e36 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] [instance: e903b923-51ac-46f6-9652-1d33c946e25a] Successfully updated port: 156a94ae-3ed6-4ea7-a55f-6230e9050946 {{(pid=74337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 21:58:08 user nova-compute[74337]: DEBUG nova.compute.manager [req-9715fc3e-39ca-4bb2-b837-b4ca791858dd req-2bee2718-82b3-4ae1-b9db-2aea8d373b91 service nova] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Received event network-vif-unplugged-148d28e8-2783-44a9-a08e-c648f0aa9489 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:58:08 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-9715fc3e-39ca-4bb2-b837-b4ca791858dd req-2bee2718-82b3-4ae1-b9db-2aea8d373b91 service nova] Acquiring lock "86f56afb-77e6-4378-b441-5cf507a0fbe7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:58:08 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-9715fc3e-39ca-4bb2-b837-b4ca791858dd req-2bee2718-82b3-4ae1-b9db-2aea8d373b91 service nova] Lock "86f56afb-77e6-4378-b441-5cf507a0fbe7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:58:08 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-9715fc3e-39ca-4bb2-b837-b4ca791858dd req-2bee2718-82b3-4ae1-b9db-2aea8d373b91 service nova] Lock "86f56afb-77e6-4378-b441-5cf507a0fbe7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:58:08 user nova-compute[74337]: DEBUG nova.compute.manager [req-9715fc3e-39ca-4bb2-b837-b4ca791858dd req-2bee2718-82b3-4ae1-b9db-2aea8d373b91 service nova] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] No waiting events found dispatching network-vif-unplugged-148d28e8-2783-44a9-a08e-c648f0aa9489 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:58:08 user nova-compute[74337]: DEBUG nova.compute.manager [req-9715fc3e-39ca-4bb2-b837-b4ca791858dd req-2bee2718-82b3-4ae1-b9db-2aea8d373b91 service nova] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Received event network-vif-unplugged-148d28e8-2783-44a9-a08e-c648f0aa9489 for instance with task_state deleting. {{(pid=74337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 21:58:08 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-2cbdc103-2eaa-4e1f-9b83-86d1dd305e36 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Acquiring lock "refresh_cache-e903b923-51ac-46f6-9652-1d33c946e25a" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:58:08 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-2cbdc103-2eaa-4e1f-9b83-86d1dd305e36 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Acquired lock "refresh_cache-e903b923-51ac-46f6-9652-1d33c946e25a" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:58:08 user nova-compute[74337]: DEBUG nova.network.neutron [None req-2cbdc103-2eaa-4e1f-9b83-86d1dd305e36 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] [instance: e903b923-51ac-46f6-9652-1d33c946e25a] Building network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 21:58:08 user nova-compute[74337]: DEBUG nova.network.neutron [None req-2cbdc103-2eaa-4e1f-9b83-86d1dd305e36 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] [instance: e903b923-51ac-46f6-9652-1d33c946e25a] Instance cache missing network info. {{(pid=74337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 21:58:08 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-eb517bfc-c723-40c8-88d6-9849a7d1c838 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Acquiring lock "065c9704-8619-494a-9459-6e53f3a07f9e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:58:08 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-eb517bfc-c723-40c8-88d6-9849a7d1c838 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "065c9704-8619-494a-9459-6e53f3a07f9e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:58:08 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-eb517bfc-c723-40c8-88d6-9849a7d1c838 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Acquiring lock "065c9704-8619-494a-9459-6e53f3a07f9e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:58:08 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-eb517bfc-c723-40c8-88d6-9849a7d1c838 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "065c9704-8619-494a-9459-6e53f3a07f9e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:58:08 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-eb517bfc-c723-40c8-88d6-9849a7d1c838 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "065c9704-8619-494a-9459-6e53f3a07f9e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:58:08 user nova-compute[74337]: INFO nova.compute.manager [None req-eb517bfc-c723-40c8-88d6-9849a7d1c838 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 065c9704-8619-494a-9459-6e53f3a07f9e] Terminating instance
Oct 23 21:58:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:58:08 user nova-compute[74337]: DEBUG nova.compute.manager [None req-eb517bfc-c723-40c8-88d6-9849a7d1c838 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 065c9704-8619-494a-9459-6e53f3a07f9e] Start destroying the instance on the hypervisor. {{(pid=74337) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 21:58:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:58:09 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Instance destroyed successfully.
Oct 23 21:58:09 user nova-compute[74337]: DEBUG nova.objects.instance [None req-bb5831c4-409f-4598-b742-3a9bad0321fb tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lazy-loading 'resources' on Instance uuid 86f56afb-77e6-4378-b441-5cf507a0fbe7 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-bb5831c4-409f-4598-b742-3a9bad0321fb tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:51:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1798504573',display_name='tempest-ServerActionsTestOtherA-server-1798504573',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1798504573',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAUefvW5MXCf+ATdQvlG858gIBXPDNbf7wcgIdNA8u/7ry6R/jyuWYoMofLLf6tWmqavGvJQy7SZOewcrGrMe1Wf24ACMK0qGJkM0S6nAXe5EBQ2zvJtr8dUyXZnBDdU6w==',key_name='tempest-keypair-1448030867',keypairs=<?>,launch_index=0,launched_at=2023-10-23T21:53:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e1f57e58a9ec4c6384dc0d3ca58eb610',ramdisk_id='',reservation_id='r-lyxkco2l',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-100075475',owner_user_name='tempest-ServerActionsTestOtherA-100075475-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T21:55:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='891ee2e3acc54ed0bc4571f63ff491a0',uuid=86f56afb-77e6-4378-b441-5cf507a0fbe7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "148d28e8-2783-44a9-a08e-c648f0aa9489", "address": "fa:16:3e:47:98:97", "network": {"id": "aff1f95f-fda8-4f0f-8d10-7e3d587e4fda", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2048135647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1f57e58a9ec4c6384dc0d3ca58eb610", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap148d28e8-27", "ovs_interfaceid": "148d28e8-2783-44a9-a08e-c648f0aa9489", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-bb5831c4-409f-4598-b742-3a9bad0321fb tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Converting VIF {"id": "148d28e8-2783-44a9-a08e-c648f0aa9489", "address": "fa:16:3e:47:98:97", "network": {"id": "aff1f95f-fda8-4f0f-8d10-7e3d587e4fda", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2048135647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1f57e58a9ec4c6384dc0d3ca58eb610", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap148d28e8-27", "ovs_interfaceid": "148d28e8-2783-44a9-a08e-c648f0aa9489", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-bb5831c4-409f-4598-b742-3a9bad0321fb tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:47:98:97,bridge_name='br-int',has_traffic_filtering=True,id=148d28e8-2783-44a9-a08e-c648f0aa9489,network=Network(aff1f95f-fda8-4f0f-8d10-7e3d587e4fda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap148d28e8-27') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG os_vif [None req-bb5831c4-409f-4598-b742-3a9bad0321fb tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:98:97,bridge_name='br-int',has_traffic_filtering=True,id=148d28e8-2783-44a9-a08e-c648f0aa9489,network=Network(aff1f95f-fda8-4f0f-8d10-7e3d587e4fda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap148d28e8-27') {{(pid=74337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap148d28e8-27, bridge=br-int, if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=269e3278-c281-459d-9c10-74215c913736) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:58:09 user nova-compute[74337]: INFO os_vif [None req-bb5831c4-409f-4598-b742-3a9bad0321fb tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:98:97,bridge_name='br-int',has_traffic_filtering=True,id=148d28e8-2783-44a9-a08e-c648f0aa9489,network=Network(aff1f95f-fda8-4f0f-8d10-7e3d587e4fda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap148d28e8-27')
Oct 23 21:58:09 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb5831c4-409f-4598-b742-3a9bad0321fb tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] calling os-brick to detach iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb5831c4-409f-4598-b742-3a9bad0321fb tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, {'target_iqn': 'iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HKWwxeEB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:58:09 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-bb5831c4-409f-4598-b742-3a9bad0321fb tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:58:09 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-bb5831c4-409f-4598-b742-3a9bad0321fb tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-bb5831c4-409f-4598-b742-3a9bad0321fb tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e58e382-c550-4af2-bd31-b6a05c91d4b9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ec9ef65f-2d9a-4950-8f01-5e837152c8df\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb5831c4-409f-4598-b742-3a9bad0321fb tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 21:58:09 user nova-compute[74337]: No targets found.
Oct 23 21:58:09 user nova-compute[74337]: iSNS:
Oct 23 21:58:09 user nova-compute[74337]: No targets found.
Oct 23 21:58:09 user nova-compute[74337]: STATIC:
Oct 23 21:58:09 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:ec9ef65f-2d9a-4950-8f01-5e837152c8df
Oct 23 21:58:09 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:58:09 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:58:09 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398
Oct 23 21:58:09 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:58:09 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:58:09 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048
Oct 23 21:58:09 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:58:09 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:58:09 user nova-compute[74337]: FIRMWARE:
Oct 23 21:58:09 user nova-compute[74337]: No targets found.
Oct 23 21:58:09 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb5831c4-409f-4598-b742-3a9bad0321fb tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 21:58:09 user nova-compute[74337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 21:58:09 user nova-compute[74337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb5831c4-409f-4598-b742-3a9bad0321fb tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398', 0)] {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac47d62-492d-40e8-8d69-44cabc1a2118]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec9ef65f-2d9a-4950-8f01-5e837152c8df\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[69458a5c-4620-4287-9080-bead92607bd3]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec9ef65f-2d9a-4950-8f01-5e837152c8df (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb5831c4-409f-4598-b742-3a9bad0321fb tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 (non-flash)
Oct 23 21:58:09 user nova-compute[74337]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 (non-flash)
Oct 23 21:58:09 user nova-compute[74337]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec9ef65f-2d9a-4950-8f01-5e837152c8df (non-flash)
Oct 23 21:58:09 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb5831c4-409f-4598-b742-3a9bad0321fb tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 (non-flash)
Oct 23 21:58:09 user nova-compute[74337]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 (non-flash)
Oct 23 21:58:09 user nova-compute[74337]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec9ef65f-2d9a-4950-8f01-5e837152c8df (non-flash)
Oct 23 21:58:09 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb5831c4-409f-4598-b742-3a9bad0321fb tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5ef4147d90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398'): ({'sdb'}, set())}) {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-bb5831c4-409f-4598-b742-3a9bad0321fb tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Removing single pathed devices sdb {{(pid=74337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[39cdf8fa-922b-41f3-bd9c-fec0191663bf]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.028s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[653b5c97-3d9b-426a-a72a-e89725f67cae]: (4, ('ok\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-bb5831c4-409f-4598-b742-3a9bad0321fb tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Flushing IO for device /dev/sdb {{(pid=74337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[86a78544-a328-47f9-8b4c-b9cbd706fcdf]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-bb5831c4-409f-4598-b742-3a9bad0321fb tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG nova.compute.manager [req-55cece8a-77d7-4f54-a238-fb6711f5bf52 req-5dce7faf-ebcd-499c-ba96-a6d084465a30 service nova] [instance: 065c9704-8619-494a-9459-6e53f3a07f9e] Received event network-vif-unplugged-c4a05fc8-3976-4c52-a1c4-d2bfb51ba32b {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-55cece8a-77d7-4f54-a238-fb6711f5bf52 req-5dce7faf-ebcd-499c-ba96-a6d084465a30 service nova] Acquiring lock "065c9704-8619-494a-9459-6e53f3a07f9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-55cece8a-77d7-4f54-a238-fb6711f5bf52 req-5dce7faf-ebcd-499c-ba96-a6d084465a30 service nova] Lock "065c9704-8619-494a-9459-6e53f3a07f9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-55cece8a-77d7-4f54-a238-fb6711f5bf52 req-5dce7faf-ebcd-499c-ba96-a6d084465a30 service nova] Lock "065c9704-8619-494a-9459-6e53f3a07f9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG nova.compute.manager [req-55cece8a-77d7-4f54-a238-fb6711f5bf52 req-5dce7faf-ebcd-499c-ba96-a6d084465a30 service nova] [instance: 065c9704-8619-494a-9459-6e53f3a07f9e] No waiting events found dispatching network-vif-unplugged-c4a05fc8-3976-4c52-a1c4-d2bfb51ba32b {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG nova.compute.manager [req-55cece8a-77d7-4f54-a238-fb6711f5bf52 req-5dce7faf-ebcd-499c-ba96-a6d084465a30 service nova] [instance: 065c9704-8619-494a-9459-6e53f3a07f9e] Received event network-vif-unplugged-c4a05fc8-3976-4c52-a1c4-d2bfb51ba32b for instance with task_state deleting. {{(pid=74337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc79c1c9-0f77-4c5e-bb70-10c0fe1fc9e7]: (4, ('1', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-bb5831c4-409f-4598-b742-3a9bad0321fb tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-bb5831c4-409f-4598-b742-3a9bad0321fb tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] SCSI volumes sdb have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb5831c4-409f-4598-b742-3a9bad0321fb tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398')] {{(pid=74337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[949b50e3-b80a-45d8-a3ca-1be49ffa9a23]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb5831c4-409f-4598-b742-3a9bad0321fb tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 -p 172.16.0.220:3260 --logout {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 -p 172.16.0.220:3260 --logout" returned: 0 in 0.094s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a7ab13e-3bda-49bf-946a-d8d89260015d]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb5831c4-409f-4598-b742-3a9bad0321fb tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398, portal: 172.16.0.220,3260]
Oct 23 21:58:09 user nova-compute[74337]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398, portal: 172.16.0.220,3260] successful.
Oct 23 21:58:09 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 -p 172.16.0.220:3260 --op delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec6df319-3945-4eda-a0b9-7c351eaf4398 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[4962fc03-b355-48dc-a611-46cf4325cac4]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb5831c4-409f-4598-b742-3a9bad0321fb tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-bb5831c4-409f-4598-b742-3a9bad0321fb tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.384s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb5831c4-409f-4598-b742-3a9bad0321fb tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] <== disconnect_volume: return (386ms) None {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb5831c4-409f-4598-b742-3a9bad0321fb tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Disconnected iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 21:58:09 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-bb5831c4-409f-4598-b742-3a9bad0321fb tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Deleting instance files /opt/stack/data/nova/instances/86f56afb-77e6-4378-b441-5cf507a0fbe7_del
Oct 23 21:58:09 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-bb5831c4-409f-4598-b742-3a9bad0321fb tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Deletion of /opt/stack/data/nova/instances/86f56afb-77e6-4378-b441-5cf507a0fbe7_del complete
Oct 23 21:58:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:58:09 user nova-compute[74337]: INFO nova.compute.manager [None req-bb5831c4-409f-4598-b742-3a9bad0321fb tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Took 1.41 seconds to destroy the instance on the hypervisor.
Oct 23 21:58:09 user nova-compute[74337]: DEBUG oslo.service.loopingcall [None req-bb5831c4-409f-4598-b742-3a9bad0321fb tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74337) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG nova.compute.manager [-] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Deallocating network for instance {{(pid=74337) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG nova.network.neutron [-] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] deallocate_for_instance() {{(pid=74337) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:58:09 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: 065c9704-8619-494a-9459-6e53f3a07f9e] Instance destroyed successfully.
Oct 23 21:58:09 user nova-compute[74337]: DEBUG nova.objects.instance [None req-eb517bfc-c723-40c8-88d6-9849a7d1c838 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lazy-loading 'resources' on Instance uuid 065c9704-8619-494a-9459-6e53f3a07f9e {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-eb517bfc-c723-40c8-88d6-9849a7d1c838 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:56:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-820629783',display_name='tempest-TestVolumeBootPattern-server-820629783',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-820629783',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF9NMFNWTU3BVoh69lm2h364CNXP9OO2Sq0+VU67LFY2Y7YP31lo2g7Nqc/sdO6ndxwSu3pXMChCzpRUGVair3TDlV76zriaKktCrpgsBnYg9q7WYnK8Iuk7Ag22Kj7gAw==',key_name='tempest-TestVolumeBootPattern-1223802412',keypairs=<?>,launch_index=0,launched_at=2023-10-23T21:56:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cb567547bd4941fb87435a841c9d17c4',ramdisk_id='',reservation_id='r-onnti6fc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-499971371',owner_user_name='tempest-TestVolumeBootPattern-499971371-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T21:56:38Z,user_data=None,user_id='0c3e635e8e5447138a7f2db11695574c',uuid=065c9704-8619-494a-9459-6e53f3a07f9e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c4a05fc8-3976-4c52-a1c4-d2bfb51ba32b", "address": "fa:16:3e:8e:9f:f6", "network": {"id": "5a18e96f-a6eb-4989-9be3-154b54928b03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-507511840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb567547bd4941fb87435a841c9d17c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4a05fc8-39", "ovs_interfaceid": "c4a05fc8-3976-4c52-a1c4-d2bfb51ba32b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-eb517bfc-c723-40c8-88d6-9849a7d1c838 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Converting VIF {"id": "c4a05fc8-3976-4c52-a1c4-d2bfb51ba32b", "address": "fa:16:3e:8e:9f:f6", "network": {"id": "5a18e96f-a6eb-4989-9be3-154b54928b03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-507511840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb567547bd4941fb87435a841c9d17c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4a05fc8-39", "ovs_interfaceid": "c4a05fc8-3976-4c52-a1c4-d2bfb51ba32b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-eb517bfc-c723-40c8-88d6-9849a7d1c838 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8e:9f:f6,bridge_name='br-int',has_traffic_filtering=True,id=c4a05fc8-3976-4c52-a1c4-d2bfb51ba32b,network=Network(5a18e96f-a6eb-4989-9be3-154b54928b03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4a05fc8-39') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG os_vif [None req-eb517bfc-c723-40c8-88d6-9849a7d1c838 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:9f:f6,bridge_name='br-int',has_traffic_filtering=True,id=c4a05fc8-3976-4c52-a1c4-d2bfb51ba32b,network=Network(5a18e96f-a6eb-4989-9be3-154b54928b03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4a05fc8-39') {{(pid=74337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc4a05fc8-39, bridge=br-int, if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=37e145d3-abf2-423a-a5d1-0daf9b39cf6d) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:58:09 user nova-compute[74337]: INFO os_vif [None req-eb517bfc-c723-40c8-88d6-9849a7d1c838 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:9f:f6,bridge_name='br-int',has_traffic_filtering=True,id=c4a05fc8-3976-4c52-a1c4-d2bfb51ba32b,network=Network(5a18e96f-a6eb-4989-9be3-154b54928b03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4a05fc8-39')
Oct 23 21:58:09 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb517bfc-c723-40c8-88d6-9849a7d1c838 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 065c9704-8619-494a-9459-6e53f3a07f9e] calling os-brick to detach iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb517bfc-c723-40c8-88d6-9849a7d1c838 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, {'target_iqn': 'iqn.2010-10.org.openstack:ec9ef65f-2d9a-4950-8f01-5e837152c8df', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fvPkjtCb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:58:09 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-eb517bfc-c723-40c8-88d6-9849a7d1c838 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:58:09 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-eb517bfc-c723-40c8-88d6-9849a7d1c838 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-eb517bfc-c723-40c8-88d6-9849a7d1c838 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[0192da88-e6c1-4aee-807d-816399ba1dc5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ec9ef65f-2d9a-4950-8f01-5e837152c8df\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb517bfc-c723-40c8-88d6-9849a7d1c838 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 21:58:09 user nova-compute[74337]: No targets found.
Oct 23 21:58:09 user nova-compute[74337]: iSNS:
Oct 23 21:58:09 user nova-compute[74337]: No targets found.
Oct 23 21:58:09 user nova-compute[74337]: STATIC:
Oct 23 21:58:09 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:ec9ef65f-2d9a-4950-8f01-5e837152c8df
Oct 23 21:58:09 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:58:09 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:58:09 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048
Oct 23 21:58:09 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:58:09 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:58:09 user nova-compute[74337]: FIRMWARE:
Oct 23 21:58:09 user nova-compute[74337]: No targets found.
Oct 23 21:58:09 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb517bfc-c723-40c8-88d6-9849a7d1c838 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 21:58:09 user nova-compute[74337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 21:58:09 user nova-compute[74337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb517bfc-c723-40c8-88d6-9849a7d1c838 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec9ef65f-2d9a-4950-8f01-5e837152c8df', 0)] {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3b303a3-a0f4-413c-b414-7b32b2d76d46]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec9ef65f-2d9a-4950-8f01-5e837152c8df\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b03abb-96d7-48dd-a294-16fe48830136]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec9ef65f-2d9a-4950-8f01-5e837152c8df (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb517bfc-c723-40c8-88d6-9849a7d1c838 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 (non-flash)
Oct 23 21:58:09 user nova-compute[74337]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec9ef65f-2d9a-4950-8f01-5e837152c8df (non-flash)
Oct 23 21:58:09 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb517bfc-c723-40c8-88d6-9849a7d1c838 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 (non-flash)
Oct 23 21:58:09 user nova-compute[74337]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec9ef65f-2d9a-4950-8f01-5e837152c8df (non-flash)
Oct 23 21:58:09 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb517bfc-c723-40c8-88d6-9849a7d1c838 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5ef4147be0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec9ef65f-2d9a-4950-8f01-5e837152c8df'): ({'sdd'}, set())}) {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-eb517bfc-c723-40c8-88d6-9849a7d1c838 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Removing single pathed devices sdd {{(pid=74337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[066ecea3-5ce1-472e-91ac-d765d9b18269]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.029s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[219b662b-fc44-4495-a162-1efe64c4d026]: (4, ('ok\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-eb517bfc-c723-40c8-88d6-9849a7d1c838 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Flushing IO for device /dev/sdd {{(pid=74337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:58:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:58:10 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.020s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:58:10 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed96fe5-4ff7-416a-9143-ca22a5d841ec]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:58:10 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-eb517bfc-c723-40c8-88d6-9849a7d1c838 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 21:58:10 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:58:10 user nova-compute[74337]: DEBUG nova.network.neutron [None req-2cbdc103-2eaa-4e1f-9b83-86d1dd305e36 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] [instance: e903b923-51ac-46f6-9652-1d33c946e25a] Updating instance_info_cache with network_info: [{"id": "156a94ae-3ed6-4ea7-a55f-6230e9050946", "address": "fa:16:3e:65:2f:9b", "network": {"id": "89c20314-7bb0-4ea1-b024-d474e5deb03a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-600863519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10913ebbab6441bdaa5b0bd97bf1dfb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap156a94ae-3e", "ovs_interfaceid": "156a94ae-3ed6-4ea7-a55f-6230e9050946", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:58:10 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-2cbdc103-2eaa-4e1f-9b83-86d1dd305e36 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Releasing lock "refresh_cache-e903b923-51ac-46f6-9652-1d33c946e25a" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:58:10 user nova-compute[74337]: DEBUG nova.compute.manager [None req-2cbdc103-2eaa-4e1f-9b83-86d1dd305e36 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] [instance: e903b923-51ac-46f6-9652-1d33c946e25a] Instance network_info: |[{"id": "156a94ae-3ed6-4ea7-a55f-6230e9050946", "address": "fa:16:3e:65:2f:9b", "network": {"id": "89c20314-7bb0-4ea1-b024-d474e5deb03a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-600863519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10913ebbab6441bdaa5b0bd97bf1dfb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap156a94ae-3e", "ovs_interfaceid": "156a94ae-3ed6-4ea7-a55f-6230e9050946", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 21:58:10 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.053s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:58:10 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1e3d5f9-31ed-40c3-baef-33142211b77c]: (4, ('1', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:58:10 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-2cbdc103-2eaa-4e1f-9b83-86d1dd305e36 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] [instance: e903b923-51ac-46f6-9652-1d33c946e25a] Start _get_guest_xml network_info=[{"id": "156a94ae-3ed6-4ea7-a55f-6230e9050946", "address": "fa:16:3e:65:2f:9b", "network": {"id": "89c20314-7bb0-4ea1-b024-d474e5deb03a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-600863519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10913ebbab6441bdaa5b0bd97bf1dfb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap156a94ae-3e", "ovs_interfaceid": "156a94ae-3ed6-4ea7-a55f-6230e9050946", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T21:29:21Z,direct_url=<?>,disk_format='qcow2',id=d859d89d-998d-4109-b26a-0d6e28152932,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ff43462300764979a6cf688444336a56',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T21:29:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'image_id': 'd859d89d-998d-4109-b26a-0d6e28152932'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 21:58:10 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-eb517bfc-c723-40c8-88d6-9849a7d1c838 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 21:58:10 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-eb517bfc-c723-40c8-88d6-9849a7d1c838 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] SCSI volumes sdd have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 21:58:10 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb517bfc-c723-40c8-88d6-9849a7d1c838 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec9ef65f-2d9a-4950-8f01-5e837152c8df')] {{(pid=74337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 21:58:10 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec9ef65f-2d9a-4950-8f01-5e837152c8df -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:58:10 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-2cbdc103-2eaa-4e1f-9b83-86d1dd305e36 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:58:10 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-2cbdc103-2eaa-4e1f-9b83-86d1dd305e36 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:58:10 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-2cbdc103-2eaa-4e1f-9b83-86d1dd305e36 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 21:58:10 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-2cbdc103-2eaa-4e1f-9b83-86d1dd305e36 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] CPU controller missing on host. {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 21:58:10 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-2cbdc103-2eaa-4e1f-9b83-86d1dd305e36 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 21:58:10 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-2cbdc103-2eaa-4e1f-9b83-86d1dd305e36 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] CPU controller found on host. {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 21:58:10 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-2cbdc103-2eaa-4e1f-9b83-86d1dd305e36 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 21:58:10 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-2cbdc103-2eaa-4e1f-9b83-86d1dd305e36 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T21:29:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T21:29:21Z,direct_url=<?>,disk_format='qcow2',id=d859d89d-998d-4109-b26a-0d6e28152932,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ff43462300764979a6cf688444336a56',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T21:29:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 21:58:10 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-2cbdc103-2eaa-4e1f-9b83-86d1dd305e36 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Flavor limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 21:58:10 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-2cbdc103-2eaa-4e1f-9b83-86d1dd305e36 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Image limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 21:58:10 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-2cbdc103-2eaa-4e1f-9b83-86d1dd305e36 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Flavor pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 21:58:10 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-2cbdc103-2eaa-4e1f-9b83-86d1dd305e36 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Image pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 21:58:10 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-2cbdc103-2eaa-4e1f-9b83-86d1dd305e36 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 21:58:10 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-2cbdc103-2eaa-4e1f-9b83-86d1dd305e36 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 21:58:10 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-2cbdc103-2eaa-4e1f-9b83-86d1dd305e36 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 21:58:10 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-2cbdc103-2eaa-4e1f-9b83-86d1dd305e36 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Got 1 possible topologies {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 21:58:10 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-2cbdc103-2eaa-4e1f-9b83-86d1dd305e36 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 21:58:10 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-2cbdc103-2eaa-4e1f-9b83-86d1dd305e36 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 21:58:10 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-2cbdc103-2eaa-4e1f-9b83-86d1dd305e36 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:58:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1098761863',display_name='tempest-VolumesActionsTest-instance-1098761863',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1098761863',id=40,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='10913ebbab6441bdaa5b0bd97bf1dfb8',ramdisk_id='',reservation_id='r-u20gmy3d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-959580854',owner_user_name='tempest-VolumesActionsTest-959580854-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:58:07Z,user_data=None,user_id='112575ac7c2d4409a95aa1844d967afa',uuid=e903b923-51ac-46f6-9652-1d33c946e25a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "156a94ae-3ed6-4ea7-a55f-6230e9050946", "address": "fa:16:3e:65:2f:9b", "network": {"id": "89c20314-7bb0-4ea1-b024-d474e5deb03a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-600863519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10913ebbab6441bdaa5b0bd97bf1dfb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap156a94ae-3e", "ovs_interfaceid": "156a94ae-3ed6-4ea7-a55f-6230e9050946", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 21:58:10 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-2cbdc103-2eaa-4e1f-9b83-86d1dd305e36 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Converting VIF {"id": "156a94ae-3ed6-4ea7-a55f-6230e9050946", "address": "fa:16:3e:65:2f:9b", "network": {"id": "89c20314-7bb0-4ea1-b024-d474e5deb03a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-600863519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10913ebbab6441bdaa5b0bd97bf1dfb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap156a94ae-3e", "ovs_interfaceid": "156a94ae-3ed6-4ea7-a55f-6230e9050946", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:58:10 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-2cbdc103-2eaa-4e1f-9b83-86d1dd305e36 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:2f:9b,bridge_name='br-int',has_traffic_filtering=True,id=156a94ae-3ed6-4ea7-a55f-6230e9050946,network=Network(89c20314-7bb0-4ea1-b024-d474e5deb03a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap156a94ae-3e') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:58:10 user nova-compute[74337]: DEBUG nova.objects.instance [None req-2cbdc103-2eaa-4e1f-9b83-86d1dd305e36 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Lazy-loading 'pci_devices' on Instance uuid e903b923-51ac-46f6-9652-1d33c946e25a {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:58:10 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec9ef65f-2d9a-4950-8f01-5e837152c8df -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:58:10 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a683e109-ff7e-4c4d-917c-c1ddcec914f7]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:58:10 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb517bfc-c723-40c8-88d6-9849a7d1c838 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:58:10 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec9ef65f-2d9a-4950-8f01-5e837152c8df -p 172.16.0.220:3260 --logout {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:58:10 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-2cbdc103-2eaa-4e1f-9b83-86d1dd305e36 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] [instance: e903b923-51ac-46f6-9652-1d33c946e25a] End _get_guest_xml xml=<domain type="kvm">
Oct 23 21:58:10 user nova-compute[74337]:   <uuid>e903b923-51ac-46f6-9652-1d33c946e25a</uuid>
Oct 23 21:58:10 user nova-compute[74337]:   <name>instance-00000028</name>
Oct 23 21:58:10 user nova-compute[74337]:   <memory>524288</memory>
Oct 23 21:58:10 user nova-compute[74337]:   <vcpu>1</vcpu>
Oct 23 21:58:10 user nova-compute[74337]:   <metadata>
Oct 23 21:58:10 user nova-compute[74337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 21:58:10 user nova-compute[74337]:       <nova:package version="0.0.0"/>
Oct 23 21:58:10 user nova-compute[74337]:       <nova:name>tempest-VolumesActionsTest-instance-1098761863</nova:name>
Oct 23 21:58:10 user nova-compute[74337]:       <nova:creationTime>2023-10-23 21:58:10</nova:creationTime>
Oct 23 21:58:10 user nova-compute[74337]:       <nova:flavor name="m1.tiny">
Oct 23 21:58:10 user nova-compute[74337]:         <nova:memory>512</nova:memory>
Oct 23 21:58:10 user nova-compute[74337]:         <nova:disk>1</nova:disk>
Oct 23 21:58:10 user nova-compute[74337]:         <nova:swap>0</nova:swap>
Oct 23 21:58:10 user nova-compute[74337]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 21:58:10 user nova-compute[74337]:         <nova:vcpus>1</nova:vcpus>
Oct 23 21:58:10 user nova-compute[74337]:       </nova:flavor>
Oct 23 21:58:10 user nova-compute[74337]:       <nova:owner>
Oct 23 21:58:10 user nova-compute[74337]:         <nova:user uuid="112575ac7c2d4409a95aa1844d967afa">tempest-VolumesActionsTest-959580854-project-member</nova:user>
Oct 23 21:58:10 user nova-compute[74337]:         <nova:project uuid="10913ebbab6441bdaa5b0bd97bf1dfb8">tempest-VolumesActionsTest-959580854</nova:project>
Oct 23 21:58:10 user nova-compute[74337]:       </nova:owner>
Oct 23 21:58:10 user nova-compute[74337]:       <nova:root type="image" uuid="d859d89d-998d-4109-b26a-0d6e28152932"/>
Oct 23 21:58:10 user nova-compute[74337]:       <nova:ports>
Oct 23 21:58:10 user nova-compute[74337]:         <nova:port uuid="156a94ae-3ed6-4ea7-a55f-6230e9050946">
Oct 23 21:58:10 user nova-compute[74337]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 23 21:58:10 user nova-compute[74337]:         </nova:port>
Oct 23 21:58:10 user nova-compute[74337]:       </nova:ports>
Oct 23 21:58:10 user nova-compute[74337]:     </nova:instance>
Oct 23 21:58:10 user nova-compute[74337]:   </metadata>
Oct 23 21:58:10 user nova-compute[74337]:   <sysinfo type="smbios">
Oct 23 21:58:10 user nova-compute[74337]:     <system>
Oct 23 21:58:10 user nova-compute[74337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 21:58:10 user nova-compute[74337]:       <entry name="product">OpenStack Nova</entry>
Oct 23 21:58:10 user nova-compute[74337]:       <entry name="version">0.0.0</entry>
Oct 23 21:58:10 user nova-compute[74337]:       <entry name="serial">e903b923-51ac-46f6-9652-1d33c946e25a</entry>
Oct 23 21:58:10 user nova-compute[74337]:       <entry name="uuid">e903b923-51ac-46f6-9652-1d33c946e25a</entry>
Oct 23 21:58:10 user nova-compute[74337]:       <entry name="family">Virtual Machine</entry>
Oct 23 21:58:10 user nova-compute[74337]:     </system>
Oct 23 21:58:10 user nova-compute[74337]:   </sysinfo>
Oct 23 21:58:10 user nova-compute[74337]:   <os>
Oct 23 21:58:10 user nova-compute[74337]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 21:58:10 user nova-compute[74337]:     <boot dev="hd"/>
Oct 23 21:58:10 user nova-compute[74337]:     <smbios mode="sysinfo"/>
Oct 23 21:58:10 user nova-compute[74337]:   </os>
Oct 23 21:58:10 user nova-compute[74337]:   <features>
Oct 23 21:58:10 user nova-compute[74337]:     <acpi/>
Oct 23 21:58:10 user nova-compute[74337]:     <apic/>
Oct 23 21:58:10 user nova-compute[74337]:     <vmcoreinfo/>
Oct 23 21:58:10 user nova-compute[74337]:   </features>
Oct 23 21:58:10 user nova-compute[74337]:   <clock offset="utc">
Oct 23 21:58:10 user nova-compute[74337]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 21:58:10 user nova-compute[74337]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 21:58:10 user nova-compute[74337]:     <timer name="hpet" present="no"/>
Oct 23 21:58:10 user nova-compute[74337]:   </clock>
Oct 23 21:58:10 user nova-compute[74337]:   <cpu mode="custom" match="exact">
Oct 23 21:58:10 user nova-compute[74337]:     <model>Nehalem</model>
Oct 23 21:58:10 user nova-compute[74337]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 21:58:10 user nova-compute[74337]:   </cpu>
Oct 23 21:58:10 user nova-compute[74337]:   <devices>
Oct 23 21:58:10 user nova-compute[74337]:     <disk type="file" device="disk">
Oct 23 21:58:10 user nova-compute[74337]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 21:58:10 user nova-compute[74337]:       <source file="/opt/stack/data/nova/instances/e903b923-51ac-46f6-9652-1d33c946e25a/disk"/>
Oct 23 21:58:10 user nova-compute[74337]:       <target dev="vda" bus="virtio"/>
Oct 23 21:58:10 user nova-compute[74337]:     </disk>
Oct 23 21:58:10 user nova-compute[74337]:     <interface type="ethernet">
Oct 23 21:58:10 user nova-compute[74337]:       <mac address="fa:16:3e:65:2f:9b"/>
Oct 23 21:58:10 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:58:10 user nova-compute[74337]:       <mtu size="1442"/>
Oct 23 21:58:10 user nova-compute[74337]:       <target dev="tap156a94ae-3e"/>
Oct 23 21:58:10 user nova-compute[74337]:     </interface>
Oct 23 21:58:10 user nova-compute[74337]:     <serial type="pty">
Oct 23 21:58:10 user nova-compute[74337]:       <log file="/opt/stack/data/nova/instances/e903b923-51ac-46f6-9652-1d33c946e25a/console.log" append="off"/>
Oct 23 21:58:10 user nova-compute[74337]:     </serial>
Oct 23 21:58:10 user nova-compute[74337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 21:58:10 user nova-compute[74337]:     <video>
Oct 23 21:58:10 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:58:10 user nova-compute[74337]:     </video>
Oct 23 21:58:10 user nova-compute[74337]:     <rng model="virtio">
Oct 23 21:58:10 user nova-compute[74337]:       <backend model="random">/dev/urandom</backend>
Oct 23 21:58:10 user nova-compute[74337]:     </rng>
Oct 23 21:58:10 user nova-compute[74337]:     <controller type="usb" index="0" model="none"/>
Oct 23 21:58:10 user nova-compute[74337]:     <memballoon model="virtio">
Oct 23 21:58:10 user nova-compute[74337]:       <stats period="10"/>
Oct 23 21:58:10 user nova-compute[74337]:     </memballoon>
Oct 23 21:58:10 user nova-compute[74337]:   </devices>
Oct 23 21:58:10 user nova-compute[74337]: </domain>
Oct 23 21:58:10 user nova-compute[74337]:  {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 21:58:10 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-2cbdc103-2eaa-4e1f-9b83-86d1dd305e36 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:58:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1098761863',display_name='tempest-VolumesActionsTest-instance-1098761863',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1098761863',id=40,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='10913ebbab6441bdaa5b0bd97bf1dfb8',ramdisk_id='',reservation_id='r-u20gmy3d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-959580854',owner_user_name='tempest-VolumesActionsTest-959580854-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:58:07Z,user_data=None,user_id='112575ac7c2d4409a95aa1844d967afa',uuid=e903b923-51ac-46f6-9652-1d33c946e25a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "156a94ae-3ed6-4ea7-a55f-6230e9050946", "address": "fa:16:3e:65:2f:9b", "network": {"id": "89c20314-7bb0-4ea1-b024-d474e5deb03a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-600863519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10913ebbab6441bdaa5b0bd97bf1dfb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap156a94ae-3e", "ovs_interfaceid": "156a94ae-3ed6-4ea7-a55f-6230e9050946", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 21:58:10 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-2cbdc103-2eaa-4e1f-9b83-86d1dd305e36 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Converting VIF {"id": "156a94ae-3ed6-4ea7-a55f-6230e9050946", "address": "fa:16:3e:65:2f:9b", "network": {"id": "89c20314-7bb0-4ea1-b024-d474e5deb03a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-600863519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10913ebbab6441bdaa5b0bd97bf1dfb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap156a94ae-3e", "ovs_interfaceid": "156a94ae-3ed6-4ea7-a55f-6230e9050946", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:58:10 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-2cbdc103-2eaa-4e1f-9b83-86d1dd305e36 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:2f:9b,bridge_name='br-int',has_traffic_filtering=True,id=156a94ae-3ed6-4ea7-a55f-6230e9050946,network=Network(89c20314-7bb0-4ea1-b024-d474e5deb03a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap156a94ae-3e') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:58:10 user nova-compute[74337]: DEBUG os_vif [None req-2cbdc103-2eaa-4e1f-9b83-86d1dd305e36 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:2f:9b,bridge_name='br-int',has_traffic_filtering=True,id=156a94ae-3ed6-4ea7-a55f-6230e9050946,network=Network(89c20314-7bb0-4ea1-b024-d474e5deb03a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap156a94ae-3e') {{(pid=74337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 21:58:10 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:58:10 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:58:10 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 21:58:10 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:58:10 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a105c184-deb6-5b5c-8ddb-eb6e9881b94d', '_type': 'linux-noop'}}, row=False) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:58:10 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:58:10 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:58:10 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:58:10 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap156a94ae-3e, may_exist=True, interface_attrs={}) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:58:10 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap156a94ae-3e, col_values=(('qos', UUID('8cc08ef2-4dc3-46f8-9793-43a8d050f331')),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:58:10 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap156a94ae-3e, col_values=(('external_ids', {'iface-id': '156a94ae-3ed6-4ea7-a55f-6230e9050946', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:65:2f:9b', 'vm-uuid': 'e903b923-51ac-46f6-9652-1d33c946e25a'}),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:58:10 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:58:10 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:58:10 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:58:10 user nova-compute[74337]: INFO os_vif [None req-2cbdc103-2eaa-4e1f-9b83-86d1dd305e36 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:2f:9b,bridge_name='br-int',has_traffic_filtering=True,id=156a94ae-3ed6-4ea7-a55f-6230e9050946,network=Network(89c20314-7bb0-4ea1-b024-d474e5deb03a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap156a94ae-3e')
Oct 23 21:58:10 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec9ef65f-2d9a-4950-8f01-5e837152c8df -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:58:10 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[905d62d4-6e9c-4c4d-801e-c0eae88f5fd2]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:ec9ef65f-2d9a-4950-8f01-5e837152c8df, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:ec9ef65f-2d9a-4950-8f01-5e837152c8df, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:58:10 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb517bfc-c723-40c8-88d6-9849a7d1c838 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:ec9ef65f-2d9a-4950-8f01-5e837152c8df, portal: 172.16.0.220,3260]
Oct 23 21:58:10 user nova-compute[74337]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:ec9ef65f-2d9a-4950-8f01-5e837152c8df, portal: 172.16.0.220,3260] successful.
Oct 23 21:58:10 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:58:10 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec9ef65f-2d9a-4950-8f01-5e837152c8df -p 172.16.0.220:3260 --op delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:58:10 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec9ef65f-2d9a-4950-8f01-5e837152c8df -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:58:10 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8173c0d-97b2-4b58-9072-04c4bcc71c0a]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:58:10 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb517bfc-c723-40c8-88d6-9849a7d1c838 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:58:10 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-eb517bfc-c723-40c8-88d6-9849a7d1c838 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.426s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:58:10 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb517bfc-c723-40c8-88d6-9849a7d1c838 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] <== disconnect_volume: return (430ms) None {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:58:10 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb517bfc-c723-40c8-88d6-9849a7d1c838 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 065c9704-8619-494a-9459-6e53f3a07f9e] Disconnected iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 21:58:10 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-eb517bfc-c723-40c8-88d6-9849a7d1c838 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 065c9704-8619-494a-9459-6e53f3a07f9e] Deleting instance files /opt/stack/data/nova/instances/065c9704-8619-494a-9459-6e53f3a07f9e_del
Oct 23 21:58:10 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-eb517bfc-c723-40c8-88d6-9849a7d1c838 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 065c9704-8619-494a-9459-6e53f3a07f9e] Deletion of /opt/stack/data/nova/instances/065c9704-8619-494a-9459-6e53f3a07f9e_del complete
Oct 23 21:58:10 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-2cbdc103-2eaa-4e1f-9b83-86d1dd305e36 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] No BDM found with device name vda, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 21:58:10 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-2cbdc103-2eaa-4e1f-9b83-86d1dd305e36 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] No VIF found with MAC fa:16:3e:65:2f:9b, not building metadata {{(pid=74337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 21:58:10 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:58:10 user nova-compute[74337]: INFO nova.compute.manager [None req-eb517bfc-c723-40c8-88d6-9849a7d1c838 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 065c9704-8619-494a-9459-6e53f3a07f9e] Took 1.40 seconds to destroy the instance on the hypervisor.
Oct 23 21:58:10 user nova-compute[74337]: DEBUG oslo.service.loopingcall [None req-eb517bfc-c723-40c8-88d6-9849a7d1c838 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74337) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 21:58:10 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:58:10 user nova-compute[74337]: DEBUG nova.compute.manager [-] [instance: 065c9704-8619-494a-9459-6e53f3a07f9e] Deallocating network for instance {{(pid=74337) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 21:58:10 user nova-compute[74337]: DEBUG nova.network.neutron [-] [instance: 065c9704-8619-494a-9459-6e53f3a07f9e] deallocate_for_instance() {{(pid=74337) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 21:58:10 user nova-compute[74337]: DEBUG nova.objects.instance [None req-c5d882d4-916c-43f4-89fe-7519725eb46a tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Lazy-loading 'flavor' on Instance uuid d5d9d286-4837-4168-a4fe-1bc09e372654 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:58:10 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-c5d882d4-916c-43f4-89fe-7519725eb46a tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Lock "d5d9d286-4837-4168-a4fe-1bc09e372654" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 25.087s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:58:10 user nova-compute[74337]: DEBUG nova.network.neutron [-] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Updating instance_info_cache with network_info: [] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:58:10 user nova-compute[74337]: INFO nova.compute.manager [-] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Took 0.85 seconds to deallocate network for instance.
Oct 23 21:58:10 user nova-compute[74337]: DEBUG nova.compute.manager [req-f0715459-40f7-4073-b18b-e329d164bc36 req-53aac665-7ce1-4d7d-a610-a888dffdca7b service nova] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Received event network-vif-deleted-148d28e8-2783-44a9-a08e-c648f0aa9489 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:58:10 user nova-compute[74337]: INFO nova.compute.manager [req-f0715459-40f7-4073-b18b-e329d164bc36 req-53aac665-7ce1-4d7d-a610-a888dffdca7b service nova] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Neutron deleted interface 148d28e8-2783-44a9-a08e-c648f0aa9489; detaching it from the instance and deleting it from the info cache
Oct 23 21:58:10 user nova-compute[74337]: DEBUG nova.network.neutron [req-f0715459-40f7-4073-b18b-e329d164bc36 req-53aac665-7ce1-4d7d-a610-a888dffdca7b service nova] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Updating instance_info_cache with network_info: [] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:58:10 user nova-compute[74337]: DEBUG nova.compute.manager [req-f0715459-40f7-4073-b18b-e329d164bc36 req-53aac665-7ce1-4d7d-a610-a888dffdca7b service nova] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Detach interface failed, port_id=148d28e8-2783-44a9-a08e-c648f0aa9489, reason: Instance 86f56afb-77e6-4378-b441-5cf507a0fbe7 could not be found. {{(pid=74337) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 23 21:58:10 user nova-compute[74337]: DEBUG nova.compute.manager [req-43ff6f95-8aff-45d8-9f3d-6acb82b635ab req-5187fb0a-c715-47a3-b0bc-38ddadfcef3f service nova] [instance: e903b923-51ac-46f6-9652-1d33c946e25a] Received event network-changed-156a94ae-3ed6-4ea7-a55f-6230e9050946 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:58:10 user nova-compute[74337]: DEBUG nova.compute.manager [req-43ff6f95-8aff-45d8-9f3d-6acb82b635ab req-5187fb0a-c715-47a3-b0bc-38ddadfcef3f service nova] [instance: e903b923-51ac-46f6-9652-1d33c946e25a] Refreshing instance network info cache due to event network-changed-156a94ae-3ed6-4ea7-a55f-6230e9050946. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 21:58:10 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-43ff6f95-8aff-45d8-9f3d-6acb82b635ab req-5187fb0a-c715-47a3-b0bc-38ddadfcef3f service nova] Acquiring lock "refresh_cache-e903b923-51ac-46f6-9652-1d33c946e25a" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:58:10 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-43ff6f95-8aff-45d8-9f3d-6acb82b635ab req-5187fb0a-c715-47a3-b0bc-38ddadfcef3f service nova] Acquired lock "refresh_cache-e903b923-51ac-46f6-9652-1d33c946e25a" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:58:10 user nova-compute[74337]: DEBUG nova.network.neutron [req-43ff6f95-8aff-45d8-9f3d-6acb82b635ab req-5187fb0a-c715-47a3-b0bc-38ddadfcef3f service nova] [instance: e903b923-51ac-46f6-9652-1d33c946e25a] Refreshing network info cache for port 156a94ae-3ed6-4ea7-a55f-6230e9050946 {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 21:58:10 user nova-compute[74337]: DEBUG nova.network.neutron [-] [instance: 065c9704-8619-494a-9459-6e53f3a07f9e] Updating instance_info_cache with network_info: [] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:58:10 user nova-compute[74337]: INFO nova.compute.manager [-] [instance: 065c9704-8619-494a-9459-6e53f3a07f9e] Took 0.59 seconds to deallocate network for instance.
Oct 23 21:58:11 user nova-compute[74337]: DEBUG nova.network.neutron [req-43ff6f95-8aff-45d8-9f3d-6acb82b635ab req-5187fb0a-c715-47a3-b0bc-38ddadfcef3f service nova] [instance: e903b923-51ac-46f6-9652-1d33c946e25a] Updated VIF entry in instance network info cache for port 156a94ae-3ed6-4ea7-a55f-6230e9050946. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 21:58:11 user nova-compute[74337]: DEBUG nova.network.neutron [req-43ff6f95-8aff-45d8-9f3d-6acb82b635ab req-5187fb0a-c715-47a3-b0bc-38ddadfcef3f service nova] [instance: e903b923-51ac-46f6-9652-1d33c946e25a] Updating instance_info_cache with network_info: [{"id": "156a94ae-3ed6-4ea7-a55f-6230e9050946", "address": "fa:16:3e:65:2f:9b", "network": {"id": "89c20314-7bb0-4ea1-b024-d474e5deb03a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-600863519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10913ebbab6441bdaa5b0bd97bf1dfb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap156a94ae-3e", "ovs_interfaceid": "156a94ae-3ed6-4ea7-a55f-6230e9050946", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:58:11 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-43ff6f95-8aff-45d8-9f3d-6acb82b635ab req-5187fb0a-c715-47a3-b0bc-38ddadfcef3f service nova] Releasing lock "refresh_cache-e903b923-51ac-46f6-9652-1d33c946e25a" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:58:11 user nova-compute[74337]: DEBUG nova.compute.manager [req-43ff6f95-8aff-45d8-9f3d-6acb82b635ab req-5187fb0a-c715-47a3-b0bc-38ddadfcef3f service nova] [instance: 065c9704-8619-494a-9459-6e53f3a07f9e] Received event network-changed-c4a05fc8-3976-4c52-a1c4-d2bfb51ba32b {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:58:11 user nova-compute[74337]: DEBUG nova.compute.manager [req-43ff6f95-8aff-45d8-9f3d-6acb82b635ab req-5187fb0a-c715-47a3-b0bc-38ddadfcef3f service nova] [instance: 065c9704-8619-494a-9459-6e53f3a07f9e] Refreshing instance network info cache due to event network-changed-c4a05fc8-3976-4c52-a1c4-d2bfb51ba32b. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 21:58:11 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-43ff6f95-8aff-45d8-9f3d-6acb82b635ab req-5187fb0a-c715-47a3-b0bc-38ddadfcef3f service nova] Acquiring lock "refresh_cache-065c9704-8619-494a-9459-6e53f3a07f9e" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:58:11 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-43ff6f95-8aff-45d8-9f3d-6acb82b635ab req-5187fb0a-c715-47a3-b0bc-38ddadfcef3f service nova] Acquired lock "refresh_cache-065c9704-8619-494a-9459-6e53f3a07f9e" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:58:11 user nova-compute[74337]: DEBUG nova.network.neutron [req-43ff6f95-8aff-45d8-9f3d-6acb82b635ab req-5187fb0a-c715-47a3-b0bc-38ddadfcef3f service nova] [instance: 065c9704-8619-494a-9459-6e53f3a07f9e] Refreshing network info cache for port c4a05fc8-3976-4c52-a1c4-d2bfb51ba32b {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 21:58:11 user nova-compute[74337]: DEBUG nova.network.neutron [req-43ff6f95-8aff-45d8-9f3d-6acb82b635ab req-5187fb0a-c715-47a3-b0bc-38ddadfcef3f service nova] [instance: 065c9704-8619-494a-9459-6e53f3a07f9e] Instance cache missing network info. {{(pid=74337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 21:58:11 user nova-compute[74337]: DEBUG nova.network.neutron [req-43ff6f95-8aff-45d8-9f3d-6acb82b635ab req-5187fb0a-c715-47a3-b0bc-38ddadfcef3f service nova] [instance: 065c9704-8619-494a-9459-6e53f3a07f9e] Updating instance_info_cache with network_info: [] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:58:11 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-43ff6f95-8aff-45d8-9f3d-6acb82b635ab req-5187fb0a-c715-47a3-b0bc-38ddadfcef3f service nova] Releasing lock "refresh_cache-065c9704-8619-494a-9459-6e53f3a07f9e" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:58:11 user nova-compute[74337]: DEBUG nova.compute.manager [req-43ff6f95-8aff-45d8-9f3d-6acb82b635ab req-5187fb0a-c715-47a3-b0bc-38ddadfcef3f service nova] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Received event network-vif-plugged-148d28e8-2783-44a9-a08e-c648f0aa9489 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:58:11 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-43ff6f95-8aff-45d8-9f3d-6acb82b635ab req-5187fb0a-c715-47a3-b0bc-38ddadfcef3f service nova] Acquiring lock "86f56afb-77e6-4378-b441-5cf507a0fbe7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:58:11 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-43ff6f95-8aff-45d8-9f3d-6acb82b635ab req-5187fb0a-c715-47a3-b0bc-38ddadfcef3f service nova] Lock "86f56afb-77e6-4378-b441-5cf507a0fbe7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:58:11 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-43ff6f95-8aff-45d8-9f3d-6acb82b635ab req-5187fb0a-c715-47a3-b0bc-38ddadfcef3f service nova] Lock "86f56afb-77e6-4378-b441-5cf507a0fbe7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:58:11 user nova-compute[74337]: DEBUG nova.compute.manager [req-43ff6f95-8aff-45d8-9f3d-6acb82b635ab req-5187fb0a-c715-47a3-b0bc-38ddadfcef3f service nova] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] No waiting events found dispatching network-vif-plugged-148d28e8-2783-44a9-a08e-c648f0aa9489 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:58:11 user nova-compute[74337]: WARNING nova.compute.manager [req-43ff6f95-8aff-45d8-9f3d-6acb82b635ab req-5187fb0a-c715-47a3-b0bc-38ddadfcef3f service nova] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Received unexpected event network-vif-plugged-148d28e8-2783-44a9-a08e-c648f0aa9489 for instance with vm_state active and task_state deleting.
Oct 23 21:58:11 user nova-compute[74337]: DEBUG nova.compute.manager [req-9243aae9-3138-4f71-ba86-2fe40a9d06ae req-228ee5d6-0f57-4e1b-bbc8-7e1029bdecba service nova] [instance: 065c9704-8619-494a-9459-6e53f3a07f9e] Received event network-vif-plugged-c4a05fc8-3976-4c52-a1c4-d2bfb51ba32b {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:58:11 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-9243aae9-3138-4f71-ba86-2fe40a9d06ae req-228ee5d6-0f57-4e1b-bbc8-7e1029bdecba service nova] Acquiring lock "065c9704-8619-494a-9459-6e53f3a07f9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:58:11 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-9243aae9-3138-4f71-ba86-2fe40a9d06ae req-228ee5d6-0f57-4e1b-bbc8-7e1029bdecba service nova] Lock "065c9704-8619-494a-9459-6e53f3a07f9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:58:11 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-9243aae9-3138-4f71-ba86-2fe40a9d06ae req-228ee5d6-0f57-4e1b-bbc8-7e1029bdecba service nova] Lock "065c9704-8619-494a-9459-6e53f3a07f9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:58:11 user nova-compute[74337]: DEBUG nova.compute.manager [req-9243aae9-3138-4f71-ba86-2fe40a9d06ae req-228ee5d6-0f57-4e1b-bbc8-7e1029bdecba service nova] [instance: 065c9704-8619-494a-9459-6e53f3a07f9e] No waiting events found dispatching network-vif-plugged-c4a05fc8-3976-4c52-a1c4-d2bfb51ba32b {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:58:11 user nova-compute[74337]: WARNING nova.compute.manager [req-9243aae9-3138-4f71-ba86-2fe40a9d06ae req-228ee5d6-0f57-4e1b-bbc8-7e1029bdecba service nova] [instance: 065c9704-8619-494a-9459-6e53f3a07f9e] Received unexpected event network-vif-plugged-c4a05fc8-3976-4c52-a1c4-d2bfb51ba32b for instance with vm_state active and task_state deleting.
Oct 23 21:58:11 user nova-compute[74337]: DEBUG nova.compute.manager [req-9243aae9-3138-4f71-ba86-2fe40a9d06ae req-228ee5d6-0f57-4e1b-bbc8-7e1029bdecba service nova] [instance: 065c9704-8619-494a-9459-6e53f3a07f9e] Received event network-vif-plugged-c4a05fc8-3976-4c52-a1c4-d2bfb51ba32b {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:58:11 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-9243aae9-3138-4f71-ba86-2fe40a9d06ae req-228ee5d6-0f57-4e1b-bbc8-7e1029bdecba service nova] Acquiring lock "065c9704-8619-494a-9459-6e53f3a07f9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:58:11 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-9243aae9-3138-4f71-ba86-2fe40a9d06ae req-228ee5d6-0f57-4e1b-bbc8-7e1029bdecba service nova] Lock "065c9704-8619-494a-9459-6e53f3a07f9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:58:11 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-9243aae9-3138-4f71-ba86-2fe40a9d06ae req-228ee5d6-0f57-4e1b-bbc8-7e1029bdecba service nova] Lock "065c9704-8619-494a-9459-6e53f3a07f9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:58:11 user nova-compute[74337]: DEBUG nova.compute.manager [req-9243aae9-3138-4f71-ba86-2fe40a9d06ae req-228ee5d6-0f57-4e1b-bbc8-7e1029bdecba service nova] [instance: 065c9704-8619-494a-9459-6e53f3a07f9e] No waiting events found dispatching network-vif-plugged-c4a05fc8-3976-4c52-a1c4-d2bfb51ba32b {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:58:11 user nova-compute[74337]: WARNING nova.compute.manager [req-9243aae9-3138-4f71-ba86-2fe40a9d06ae req-228ee5d6-0f57-4e1b-bbc8-7e1029bdecba service nova] [instance: 065c9704-8619-494a-9459-6e53f3a07f9e] Received unexpected event network-vif-plugged-c4a05fc8-3976-4c52-a1c4-d2bfb51ba32b for instance with vm_state active and task_state deleting.
Oct 23 21:58:11 user nova-compute[74337]: DEBUG nova.compute.manager [req-9243aae9-3138-4f71-ba86-2fe40a9d06ae req-228ee5d6-0f57-4e1b-bbc8-7e1029bdecba service nova] [instance: 065c9704-8619-494a-9459-6e53f3a07f9e] Received event network-vif-plugged-c4a05fc8-3976-4c52-a1c4-d2bfb51ba32b {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:58:11 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-9243aae9-3138-4f71-ba86-2fe40a9d06ae req-228ee5d6-0f57-4e1b-bbc8-7e1029bdecba service nova] Acquiring lock "065c9704-8619-494a-9459-6e53f3a07f9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:58:11 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-9243aae9-3138-4f71-ba86-2fe40a9d06ae req-228ee5d6-0f57-4e1b-bbc8-7e1029bdecba service nova] Lock "065c9704-8619-494a-9459-6e53f3a07f9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:58:11 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-9243aae9-3138-4f71-ba86-2fe40a9d06ae req-228ee5d6-0f57-4e1b-bbc8-7e1029bdecba service nova] Lock "065c9704-8619-494a-9459-6e53f3a07f9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:58:11 user nova-compute[74337]: DEBUG nova.compute.manager [req-9243aae9-3138-4f71-ba86-2fe40a9d06ae req-228ee5d6-0f57-4e1b-bbc8-7e1029bdecba service nova] [instance: 065c9704-8619-494a-9459-6e53f3a07f9e] No waiting events found dispatching network-vif-plugged-c4a05fc8-3976-4c52-a1c4-d2bfb51ba32b {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:58:11 user nova-compute[74337]: WARNING nova.compute.manager [req-9243aae9-3138-4f71-ba86-2fe40a9d06ae req-228ee5d6-0f57-4e1b-bbc8-7e1029bdecba service nova] [instance: 065c9704-8619-494a-9459-6e53f3a07f9e] Received unexpected event network-vif-plugged-c4a05fc8-3976-4c52-a1c4-d2bfb51ba32b for instance with vm_state active and task_state deleting.
Oct 23 21:58:11 user nova-compute[74337]: DEBUG nova.compute.manager [req-9243aae9-3138-4f71-ba86-2fe40a9d06ae req-228ee5d6-0f57-4e1b-bbc8-7e1029bdecba service nova] [instance: 065c9704-8619-494a-9459-6e53f3a07f9e] Received event network-vif-unplugged-c4a05fc8-3976-4c52-a1c4-d2bfb51ba32b {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:58:11 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-9243aae9-3138-4f71-ba86-2fe40a9d06ae req-228ee5d6-0f57-4e1b-bbc8-7e1029bdecba service nova] Acquiring lock "065c9704-8619-494a-9459-6e53f3a07f9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:58:11 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-9243aae9-3138-4f71-ba86-2fe40a9d06ae req-228ee5d6-0f57-4e1b-bbc8-7e1029bdecba service nova] Lock "065c9704-8619-494a-9459-6e53f3a07f9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:58:11 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-9243aae9-3138-4f71-ba86-2fe40a9d06ae req-228ee5d6-0f57-4e1b-bbc8-7e1029bdecba service nova] Lock "065c9704-8619-494a-9459-6e53f3a07f9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:58:11 user nova-compute[74337]: DEBUG nova.compute.manager [req-9243aae9-3138-4f71-ba86-2fe40a9d06ae req-228ee5d6-0f57-4e1b-bbc8-7e1029bdecba service nova] [instance: 065c9704-8619-494a-9459-6e53f3a07f9e] No waiting events found dispatching network-vif-unplugged-c4a05fc8-3976-4c52-a1c4-d2bfb51ba32b {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:58:11 user nova-compute[74337]: DEBUG nova.compute.manager [req-9243aae9-3138-4f71-ba86-2fe40a9d06ae req-228ee5d6-0f57-4e1b-bbc8-7e1029bdecba service nova] [instance: 065c9704-8619-494a-9459-6e53f3a07f9e] Received event network-vif-unplugged-c4a05fc8-3976-4c52-a1c4-d2bfb51ba32b for instance with task_state deleting. {{(pid=74337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 21:58:11 user nova-compute[74337]: DEBUG nova.compute.manager [req-9243aae9-3138-4f71-ba86-2fe40a9d06ae req-228ee5d6-0f57-4e1b-bbc8-7e1029bdecba service nova] [instance: 065c9704-8619-494a-9459-6e53f3a07f9e] Received event network-vif-plugged-c4a05fc8-3976-4c52-a1c4-d2bfb51ba32b {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:58:11 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-9243aae9-3138-4f71-ba86-2fe40a9d06ae req-228ee5d6-0f57-4e1b-bbc8-7e1029bdecba service nova] Acquiring lock "065c9704-8619-494a-9459-6e53f3a07f9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:58:11 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-9243aae9-3138-4f71-ba86-2fe40a9d06ae req-228ee5d6-0f57-4e1b-bbc8-7e1029bdecba service nova] Lock "065c9704-8619-494a-9459-6e53f3a07f9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:58:11 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-9243aae9-3138-4f71-ba86-2fe40a9d06ae req-228ee5d6-0f57-4e1b-bbc8-7e1029bdecba service nova] Lock "065c9704-8619-494a-9459-6e53f3a07f9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:58:11 user nova-compute[74337]: DEBUG nova.compute.manager [req-9243aae9-3138-4f71-ba86-2fe40a9d06ae req-228ee5d6-0f57-4e1b-bbc8-7e1029bdecba service nova] [instance: 065c9704-8619-494a-9459-6e53f3a07f9e] No waiting events found dispatching network-vif-plugged-c4a05fc8-3976-4c52-a1c4-d2bfb51ba32b {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:58:11 user nova-compute[74337]: WARNING nova.compute.manager [req-9243aae9-3138-4f71-ba86-2fe40a9d06ae req-228ee5d6-0f57-4e1b-bbc8-7e1029bdecba service nova] [instance: 065c9704-8619-494a-9459-6e53f3a07f9e] Received unexpected event network-vif-plugged-c4a05fc8-3976-4c52-a1c4-d2bfb51ba32b for instance with vm_state active and task_state deleting.
Oct 23 21:58:11 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:58:11 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:58:11 user nova-compute[74337]: INFO nova.compute.manager [None req-bb5831c4-409f-4598-b742-3a9bad0321fb tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Took 1.23 seconds to detach 1 volumes for instance.
Oct 23 21:58:11 user nova-compute[74337]: DEBUG nova.compute.manager [None req-bb5831c4-409f-4598-b742-3a9bad0321fb tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 86f56afb-77e6-4378-b441-5cf507a0fbe7] Deleting volume: ec6df319-3945-4eda-a0b9-7c351eaf4398 {{(pid=74337) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 23 21:58:11 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-bb5831c4-409f-4598-b742-3a9bad0321fb tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:58:11 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-bb5831c4-409f-4598-b742-3a9bad0321fb tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:58:12 user nova-compute[74337]: INFO nova.compute.manager [None req-eb517bfc-c723-40c8-88d6-9849a7d1c838 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: 065c9704-8619-494a-9459-6e53f3a07f9e] Took 1.20 seconds to detach 1 volumes for instance.
Oct 23 21:58:12 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-eb517bfc-c723-40c8-88d6-9849a7d1c838 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:58:12 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:58:12 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:58:12 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:58:12 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:58:12 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-bb5831c4-409f-4598-b742-3a9bad0321fb tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:58:12 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-bb5831c4-409f-4598-b742-3a9bad0321fb tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:58:12 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-bb5831c4-409f-4598-b742-3a9bad0321fb tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.368s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:58:12 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-eb517bfc-c723-40c8-88d6-9849a7d1c838 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.121s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:58:12 user nova-compute[74337]: INFO nova.scheduler.client.report [None req-bb5831c4-409f-4598-b742-3a9bad0321fb tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Deleted allocations for instance 86f56afb-77e6-4378-b441-5cf507a0fbe7
Oct 23 21:58:12 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-bb5831c4-409f-4598-b742-3a9bad0321fb tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lock "86f56afb-77e6-4378-b441-5cf507a0fbe7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.174s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:58:12 user nova-compute[74337]: ERROR nova.volume.cinder [None req-c27e6ac0-f87e-49d3-b20d-0270e2aee1d9 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] Update attachment failed for attachment 5a6db445-bfdb-458a-9225-22067d63394c. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-cffbad69-8831-4bb9-87bb-fc556dac09b0) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-cffbad69-8831-4bb9-87bb-fc556dac09b0)
Oct 23 21:58:12 user nova-compute[74337]: ERROR nova.compute.manager [None req-c27e6ac0-f87e-49d3-b20d-0270e2aee1d9 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d] Instance failed block device setup: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-cffbad69-8831-4bb9-87bb-fc556dac09b0)
Oct 23 21:58:12 user nova-compute[74337]: ERROR nova.compute.manager [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d] Traceback (most recent call last):
Oct 23 21:58:12 user nova-compute[74337]: ERROR nova.compute.manager [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d]   File "/opt/stack/nova/nova/compute/manager.py", line 2190, in _prep_block_device
Oct 23 21:58:12 user nova-compute[74337]: ERROR nova.compute.manager [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d]     driver_block_device.attach_block_devices(
Oct 23 21:58:12 user nova-compute[74337]: ERROR nova.compute.manager [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d]   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Oct 23 21:58:12 user nova-compute[74337]: ERROR nova.compute.manager [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d]     _log_and_attach(device)
Oct 23 21:58:12 user nova-compute[74337]: ERROR nova.compute.manager [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d]   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Oct 23 21:58:12 user nova-compute[74337]: ERROR nova.compute.manager [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d]     bdm.attach(*attach_args, **attach_kwargs)
Oct 23 21:58:12 user nova-compute[74337]: ERROR nova.compute.manager [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Oct 23 21:58:12 user nova-compute[74337]: ERROR nova.compute.manager [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d]     ret_val = method(obj, context, *args, **kwargs)
Oct 23 21:58:12 user nova-compute[74337]: ERROR nova.compute.manager [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Oct 23 21:58:12 user nova-compute[74337]: ERROR nova.compute.manager [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d]     self._do_attach(context, instance, volume, volume_api,
Oct 23 21:58:12 user nova-compute[74337]: ERROR nova.compute.manager [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Oct 23 21:58:12 user nova-compute[74337]: ERROR nova.compute.manager [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d]     self._volume_attach(context, volume, connector, instance,
Oct 23 21:58:12 user nova-compute[74337]: ERROR nova.compute.manager [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Oct 23 21:58:12 user nova-compute[74337]: ERROR nova.compute.manager [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d]     connection_info = volume_api.attachment_update(
Oct 23 21:58:12 user nova-compute[74337]: ERROR nova.compute.manager [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 23 21:58:12 user nova-compute[74337]: ERROR nova.compute.manager [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d]     res = method(self, ctx, *args, **kwargs)
Oct 23 21:58:12 user nova-compute[74337]: ERROR nova.compute.manager [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 23 21:58:12 user nova-compute[74337]: ERROR nova.compute.manager [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d]     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 23 21:58:12 user nova-compute[74337]: ERROR nova.compute.manager [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 23 21:58:12 user nova-compute[74337]: ERROR nova.compute.manager [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d]     with excutils.save_and_reraise_exception():
Oct 23 21:58:12 user nova-compute[74337]: ERROR nova.compute.manager [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 23 21:58:12 user nova-compute[74337]: ERROR nova.compute.manager [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d]     self.force_reraise()
Oct 23 21:58:12 user nova-compute[74337]: ERROR nova.compute.manager [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 23 21:58:12 user nova-compute[74337]: ERROR nova.compute.manager [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d]     raise self.value
Oct 23 21:58:12 user nova-compute[74337]: ERROR nova.compute.manager [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 23 21:58:12 user nova-compute[74337]: ERROR nova.compute.manager [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d]     context, '3.44', skip_version_check=True).attachments.update(
Oct 23 21:58:12 user nova-compute[74337]: ERROR nova.compute.manager [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 23 21:58:12 user nova-compute[74337]: ERROR nova.compute.manager [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d]     return method.func(obj, *args, **kwargs)
Oct 23 21:58:12 user nova-compute[74337]: ERROR nova.compute.manager [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 23 21:58:12 user nova-compute[74337]: ERROR nova.compute.manager [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d]     resp = self._update('/attachments/%s' % id, body)
Oct 23 21:58:12 user nova-compute[74337]: ERROR nova.compute.manager [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 23 21:58:12 user nova-compute[74337]: ERROR nova.compute.manager [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d]     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 23 21:58:12 user nova-compute[74337]: ERROR nova.compute.manager [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 23 21:58:12 user nova-compute[74337]: ERROR nova.compute.manager [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d]     return self._cs_request(url, 'PUT', **kwargs)
Oct 23 21:58:12 user nova-compute[74337]: ERROR nova.compute.manager [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 23 21:58:12 user nova-compute[74337]: ERROR nova.compute.manager [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d]     return self.request(url, method, **kwargs)
Oct 23 21:58:12 user nova-compute[74337]: ERROR nova.compute.manager [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 23 21:58:12 user nova-compute[74337]: ERROR nova.compute.manager [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d]     raise exceptions.from_response(resp, body)
Oct 23 21:58:12 user nova-compute[74337]: ERROR nova.compute.manager [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-cffbad69-8831-4bb9-87bb-fc556dac09b0)
Oct 23 21:58:12 user nova-compute[74337]: ERROR nova.compute.manager [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d] 
Oct 23 21:58:12 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-c27e6ac0-f87e-49d3-b20d-0270e2aee1d9 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] Lock "0323b854-c7a1-42e8-ad85-1e929caa6e9d" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 17.083s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:58:12 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-eb517bfc-c723-40c8-88d6-9849a7d1c838 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:58:12 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-eb517bfc-c723-40c8-88d6-9849a7d1c838 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:58:12 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-eb517bfc-c723-40c8-88d6-9849a7d1c838 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.304s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:58:12 user nova-compute[74337]: INFO nova.scheduler.client.report [None req-eb517bfc-c723-40c8-88d6-9849a7d1c838 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Deleted allocations for instance 065c9704-8619-494a-9459-6e53f3a07f9e
Oct 23 21:58:12 user nova-compute[74337]: INFO nova.compute.manager [None req-c27e6ac0-f87e-49d3-b20d-0270e2aee1d9 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] [instance: 0323b854-c7a1-42e8-ad85-1e929caa6e9d] Successfully reverted task state from spawning on failure for instance.
Oct 23 21:58:12 user nova-compute[74337]: ERROR oslo_messaging.rpc.server [None req-c27e6ac0-f87e-49d3-b20d-0270e2aee1d9 tempest-TestShelveInstance-224278230 tempest-TestShelveInstance-224278230-project-member] Exception during message handling: nova.exception.InvalidBDM: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-cffbad69-8831-4bb9-87bb-fc556dac09b0)
Oct 23 21:58:12 user nova-compute[74337]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 23 21:58:12 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 2190, in _prep_block_device
Oct 23 21:58:12 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     driver_block_device.attach_block_devices(
Oct 23 21:58:12 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Oct 23 21:58:12 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     _log_and_attach(device)
Oct 23 21:58:12 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Oct 23 21:58:12 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     bdm.attach(*attach_args, **attach_kwargs)
Oct 23 21:58:12 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Oct 23 21:58:12 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Oct 23 21:58:12 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Oct 23 21:58:12 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Oct 23 21:58:12 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Oct 23 21:58:12 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Oct 23 21:58:12 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Oct 23 21:58:12 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Oct 23 21:58:12 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 23 21:58:12 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Oct 23 21:58:12 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 23 21:58:12 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 23 21:58:12 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 23 21:58:12 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 23 21:58:12 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 23 21:58:12 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 23 21:58:12 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 23 21:58:12 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 23 21:58:12 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 23 21:58:12 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Oct 23 21:58:12 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 23 21:58:12 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Oct 23 21:58:12 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 23 21:58:12 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Oct 23 21:58:12 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 23 21:58:12 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 23 21:58:12 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 23 21:58:12 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Oct 23 21:58:12 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 23 21:58:12 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Oct 23 21:58:12 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 23 21:58:12 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Oct 23 21:58:12 user nova-compute[74337]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-cffbad69-8831-4bb9-87bb-fc556dac09b0)
Oct 23 21:58:12 user nova-compute[74337]: ERROR oslo_messaging.rpc.server 
Oct 23 21:58:12 user nova-compute[74337]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred:
Oct 23 21:58:12 user nova-compute[74337]: ERROR oslo_messaging.rpc.server 
Oct 23 21:58:12 user nova-compute[74337]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 23 21:58:12 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 23 21:58:12 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 23 21:58:12 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 23 21:58:12 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 23 21:58:12 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 23 21:58:12 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 23 21:58:12 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 23 21:58:12 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 23 21:58:12 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 23 21:58:12 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 23 21:58:12 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 23 21:58:12 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 23 21:58:12 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 23 21:58:12 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 23 21:58:12 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 166, in decorated_function
Oct 23 21:58:12 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 23 21:58:12 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 23 21:58:12 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 23 21:58:12 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 23 21:58:12 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 23 21:58:12 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 157, in decorated_function
Oct 23 21:58:12 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 23 21:58:12 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Oct 23 21:58:12 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 23 21:58:12 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Oct 23 21:58:12 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 23 21:58:12 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 23 21:58:12 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 23 21:58:12 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 23 21:58:12 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 23 21:58:12 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Oct 23 21:58:12 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 23 21:58:12 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7082, in unshelve_instance
Oct 23 21:58:12 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     do_unshelve_instance()
Oct 23 21:58:12 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Oct 23 21:58:12 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Oct 23 21:58:12 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7079, in do_unshelve_instance
Oct 23 21:58:12 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     self._unshelve_instance(
Oct 23 21:58:12 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7111, in _unshelve_instance
Oct 23 21:58:12 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     block_device_info = self._prep_block_device(context, instance, bdms)
Oct 23 21:58:12 user nova-compute[74337]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 2209, in _prep_block_device
Oct 23 21:58:12 user nova-compute[74337]: ERROR oslo_messaging.rpc.server     raise exception.InvalidBDM(str(ex))
Oct 23 21:58:12 user nova-compute[74337]: ERROR oslo_messaging.rpc.server nova.exception.InvalidBDM: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-cffbad69-8831-4bb9-87bb-fc556dac09b0)
Oct 23 21:58:12 user nova-compute[74337]: ERROR oslo_messaging.rpc.server 
Oct 23 21:58:12 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-eb517bfc-c723-40c8-88d6-9849a7d1c838 tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "065c9704-8619-494a-9459-6e53f3a07f9e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.827s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:58:12 user nova-compute[74337]: DEBUG nova.compute.manager [req-dd7daec5-5eb0-4bcc-9b8d-587d2aa293ee req-2b9d09c4-d0f4-48eb-a99e-e0ce96864fcf service nova] [instance: 065c9704-8619-494a-9459-6e53f3a07f9e] Received event network-vif-deleted-c4a05fc8-3976-4c52-a1c4-d2bfb51ba32b {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:58:12 user nova-compute[74337]: DEBUG nova.compute.manager [req-dd7daec5-5eb0-4bcc-9b8d-587d2aa293ee req-2b9d09c4-d0f4-48eb-a99e-e0ce96864fcf service nova] [instance: e903b923-51ac-46f6-9652-1d33c946e25a] Received event network-vif-plugged-156a94ae-3ed6-4ea7-a55f-6230e9050946 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:58:12 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-dd7daec5-5eb0-4bcc-9b8d-587d2aa293ee req-2b9d09c4-d0f4-48eb-a99e-e0ce96864fcf service nova] Acquiring lock "e903b923-51ac-46f6-9652-1d33c946e25a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:58:12 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-dd7daec5-5eb0-4bcc-9b8d-587d2aa293ee req-2b9d09c4-d0f4-48eb-a99e-e0ce96864fcf service nova] Lock "e903b923-51ac-46f6-9652-1d33c946e25a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:58:12 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-dd7daec5-5eb0-4bcc-9b8d-587d2aa293ee req-2b9d09c4-d0f4-48eb-a99e-e0ce96864fcf service nova] Lock "e903b923-51ac-46f6-9652-1d33c946e25a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:58:12 user nova-compute[74337]: DEBUG nova.compute.manager [req-dd7daec5-5eb0-4bcc-9b8d-587d2aa293ee req-2b9d09c4-d0f4-48eb-a99e-e0ce96864fcf service nova] [instance: e903b923-51ac-46f6-9652-1d33c946e25a] No waiting events found dispatching network-vif-plugged-156a94ae-3ed6-4ea7-a55f-6230e9050946 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:58:12 user nova-compute[74337]: WARNING nova.compute.manager [req-dd7daec5-5eb0-4bcc-9b8d-587d2aa293ee req-2b9d09c4-d0f4-48eb-a99e-e0ce96864fcf service nova] [instance: e903b923-51ac-46f6-9652-1d33c946e25a] Received unexpected event network-vif-plugged-156a94ae-3ed6-4ea7-a55f-6230e9050946 for instance with vm_state building and task_state spawning.
Oct 23 21:58:12 user nova-compute[74337]: DEBUG nova.compute.manager [req-dd7daec5-5eb0-4bcc-9b8d-587d2aa293ee req-2b9d09c4-d0f4-48eb-a99e-e0ce96864fcf service nova] [instance: e903b923-51ac-46f6-9652-1d33c946e25a] Received event network-vif-plugged-156a94ae-3ed6-4ea7-a55f-6230e9050946 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:58:12 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-dd7daec5-5eb0-4bcc-9b8d-587d2aa293ee req-2b9d09c4-d0f4-48eb-a99e-e0ce96864fcf service nova] Acquiring lock "e903b923-51ac-46f6-9652-1d33c946e25a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:58:12 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-dd7daec5-5eb0-4bcc-9b8d-587d2aa293ee req-2b9d09c4-d0f4-48eb-a99e-e0ce96864fcf service nova] Lock "e903b923-51ac-46f6-9652-1d33c946e25a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:58:12 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-dd7daec5-5eb0-4bcc-9b8d-587d2aa293ee req-2b9d09c4-d0f4-48eb-a99e-e0ce96864fcf service nova] Lock "e903b923-51ac-46f6-9652-1d33c946e25a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:58:12 user nova-compute[74337]: DEBUG nova.compute.manager [req-dd7daec5-5eb0-4bcc-9b8d-587d2aa293ee req-2b9d09c4-d0f4-48eb-a99e-e0ce96864fcf service nova] [instance: e903b923-51ac-46f6-9652-1d33c946e25a] No waiting events found dispatching network-vif-plugged-156a94ae-3ed6-4ea7-a55f-6230e9050946 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:58:12 user nova-compute[74337]: WARNING nova.compute.manager [req-dd7daec5-5eb0-4bcc-9b8d-587d2aa293ee req-2b9d09c4-d0f4-48eb-a99e-e0ce96864fcf service nova] [instance: e903b923-51ac-46f6-9652-1d33c946e25a] Received unexpected event network-vif-plugged-156a94ae-3ed6-4ea7-a55f-6230e9050946 for instance with vm_state building and task_state spawning.
Oct 23 21:58:13 user nova-compute[74337]: DEBUG nova.compute.manager [None req-2cbdc103-2eaa-4e1f-9b83-86d1dd305e36 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] [instance: e903b923-51ac-46f6-9652-1d33c946e25a] Instance event wait completed in 0 seconds for  {{(pid=74337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 21:58:13 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-2cbdc103-2eaa-4e1f-9b83-86d1dd305e36 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] [instance: e903b923-51ac-46f6-9652-1d33c946e25a] Guest created on hypervisor {{(pid=74337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 21:58:13 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: e903b923-51ac-46f6-9652-1d33c946e25a] Instance spawned successfully.
Oct 23 21:58:13 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-2cbdc103-2eaa-4e1f-9b83-86d1dd305e36 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] [instance: e903b923-51ac-46f6-9652-1d33c946e25a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 21:58:13 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-2cbdc103-2eaa-4e1f-9b83-86d1dd305e36 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] [instance: e903b923-51ac-46f6-9652-1d33c946e25a] Found default for hw_cdrom_bus of ide {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:58:13 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-2cbdc103-2eaa-4e1f-9b83-86d1dd305e36 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] [instance: e903b923-51ac-46f6-9652-1d33c946e25a] Found default for hw_disk_bus of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:58:13 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-2cbdc103-2eaa-4e1f-9b83-86d1dd305e36 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] [instance: e903b923-51ac-46f6-9652-1d33c946e25a] Found default for hw_input_bus of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:58:13 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-2cbdc103-2eaa-4e1f-9b83-86d1dd305e36 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] [instance: e903b923-51ac-46f6-9652-1d33c946e25a] Found default for hw_pointer_model of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:58:13 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-2cbdc103-2eaa-4e1f-9b83-86d1dd305e36 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] [instance: e903b923-51ac-46f6-9652-1d33c946e25a] Found default for hw_video_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:58:13 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-2cbdc103-2eaa-4e1f-9b83-86d1dd305e36 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] [instance: e903b923-51ac-46f6-9652-1d33c946e25a] Found default for hw_vif_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:58:13 user nova-compute[74337]: INFO nova.compute.manager [None req-2cbdc103-2eaa-4e1f-9b83-86d1dd305e36 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] [instance: e903b923-51ac-46f6-9652-1d33c946e25a] Took 6.96 seconds to spawn the instance on the hypervisor.
Oct 23 21:58:13 user nova-compute[74337]: DEBUG nova.compute.manager [None req-2cbdc103-2eaa-4e1f-9b83-86d1dd305e36 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] [instance: e903b923-51ac-46f6-9652-1d33c946e25a] Checking state {{(pid=74337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 21:58:13 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:58:13 user nova-compute[74337]: INFO nova.compute.manager [None req-2cbdc103-2eaa-4e1f-9b83-86d1dd305e36 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] [instance: e903b923-51ac-46f6-9652-1d33c946e25a] Took 7.73 seconds to build instance.
Oct 23 21:58:13 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-2cbdc103-2eaa-4e1f-9b83-86d1dd305e36 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Lock "e903b923-51ac-46f6-9652-1d33c946e25a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.853s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:58:14 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:58:15 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:58:15 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:58:16 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:58:16 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Starting heal instance info cache {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 21:58:16 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "refresh_cache-547c4d4c-e0dd-495a-b83f-98426d0a4a99" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:58:16 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquired lock "refresh_cache-547c4d4c-e0dd-495a-b83f-98426d0a4a99" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:58:16 user nova-compute[74337]: DEBUG nova.network.neutron [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 547c4d4c-e0dd-495a-b83f-98426d0a4a99] Forcefully refreshing network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 21:58:16 user nova-compute[74337]: DEBUG nova.network.neutron [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 547c4d4c-e0dd-495a-b83f-98426d0a4a99] Updating instance_info_cache with network_info: [{"id": "2dd20d7f-9490-476a-90ed-e6a1c9085e4d", "address": "fa:16:3e:5f:e1:f7", "network": {"id": "aff1f95f-fda8-4f0f-8d10-7e3d587e4fda", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2048135647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1f57e58a9ec4c6384dc0d3ca58eb610", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd20d7f-94", "ovs_interfaceid": "2dd20d7f-9490-476a-90ed-e6a1c9085e4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:58:17 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Releasing lock "refresh_cache-547c4d4c-e0dd-495a-b83f-98426d0a4a99" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:58:17 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 547c4d4c-e0dd-495a-b83f-98426d0a4a99] Updated the network info_cache for instance {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 21:58:17 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:58:17 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:58:17 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 21:58:20 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:58:20 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:58:21 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:58:21 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:58:21 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:58:21 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:58:21 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Auditing locally available compute resources for user (node: user) {{(pid=74337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 21:58:21 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 21:58:21 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e903b923-51ac-46f6-9652-1d33c946e25a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:58:21 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e903b923-51ac-46f6-9652-1d33c946e25a/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:58:21 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e903b923-51ac-46f6-9652-1d33c946e25a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:58:22 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e903b923-51ac-46f6-9652-1d33c946e25a/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:58:22 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5d9d286-4837-4168-a4fe-1bc09e372654/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:58:22 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5d9d286-4837-4168-a4fe-1bc09e372654/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:58:22 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5d9d286-4837-4168-a4fe-1bc09e372654/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:58:22 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5d9d286-4837-4168-a4fe-1bc09e372654/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:58:22 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/547c4d4c-e0dd-495a-b83f-98426d0a4a99/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:58:22 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/547c4d4c-e0dd-495a-b83f-98426d0a4a99/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:58:22 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/547c4d4c-e0dd-495a-b83f-98426d0a4a99/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:58:22 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/547c4d4c-e0dd-495a-b83f-98426d0a4a99/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:58:22 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbad2e14-7b6c-475e-b471-a87cb9e21b7f/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:58:23 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbad2e14-7b6c-475e-b471-a87cb9e21b7f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:58:23 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbad2e14-7b6c-475e-b471-a87cb9e21b7f/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:58:23 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbad2e14-7b6c-475e-b471-a87cb9e21b7f/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:58:23 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1189976f-8d02-468d-8fa7-bd5594c5f85a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:58:23 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1189976f-8d02-468d-8fa7-bd5594c5f85a/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:58:23 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1189976f-8d02-468d-8fa7-bd5594c5f85a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:58:23 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1189976f-8d02-468d-8fa7-bd5594c5f85a/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:58:24 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:58:24 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:58:24 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Hypervisor/Node resource view: name=user free_ram=8170MB free_disk=25.224349975585938GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 21:58:24 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:58:24 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:58:24 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 1189976f-8d02-468d-8fa7-bd5594c5f85a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:58:24 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 547c4d4c-e0dd-495a-b83f-98426d0a4a99 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:58:24 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance d5d9d286-4837-4168-a4fe-1bc09e372654 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:58:24 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance bc4c3e54-a845-4ea8-9ffc-a75d42a51788 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:58:24 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance dbad2e14-7b6c-475e-b471-a87cb9e21b7f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:58:24 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 0323b854-c7a1-42e8-ad85-1e929caa6e9d has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Oct 23 21:58:24 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance e903b923-51ac-46f6-9652-1d33c946e25a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:58:24 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 21:58:24 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 21:58:24 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:58:24 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:58:24 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Compute_service record updated for user:user {{(pid=74337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 21:58:24 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.397s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:58:25 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:58:25 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:58:28 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:58:28 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-ba6b2582-6183-48ad-a6ee-196788ff52f1 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Acquiring lock "1189976f-8d02-468d-8fa7-bd5594c5f85a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:58:28 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-ba6b2582-6183-48ad-a6ee-196788ff52f1 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lock "1189976f-8d02-468d-8fa7-bd5594c5f85a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:58:28 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-ba6b2582-6183-48ad-a6ee-196788ff52f1 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Acquiring lock "1189976f-8d02-468d-8fa7-bd5594c5f85a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:58:28 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-ba6b2582-6183-48ad-a6ee-196788ff52f1 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lock "1189976f-8d02-468d-8fa7-bd5594c5f85a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:58:28 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-ba6b2582-6183-48ad-a6ee-196788ff52f1 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lock "1189976f-8d02-468d-8fa7-bd5594c5f85a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:58:28 user nova-compute[74337]: INFO nova.compute.manager [None req-ba6b2582-6183-48ad-a6ee-196788ff52f1 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: 1189976f-8d02-468d-8fa7-bd5594c5f85a] Terminating instance
Oct 23 21:58:28 user nova-compute[74337]: DEBUG nova.compute.manager [None req-ba6b2582-6183-48ad-a6ee-196788ff52f1 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: 1189976f-8d02-468d-8fa7-bd5594c5f85a] Start destroying the instance on the hypervisor. {{(pid=74337) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 21:58:29 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:58:29 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:58:29 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:58:29 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:58:29 user nova-compute[74337]: DEBUG nova.compute.manager [req-ab803074-af55-42f4-a9c3-9494d1e21837 req-b9c0c033-267d-4905-bc66-af2cf47e8575 service nova] [instance: 1189976f-8d02-468d-8fa7-bd5594c5f85a] Received event network-vif-unplugged-9c888931-1180-4efd-8ca1-a57252bf8dc5 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:58:29 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ab803074-af55-42f4-a9c3-9494d1e21837 req-b9c0c033-267d-4905-bc66-af2cf47e8575 service nova] Acquiring lock "1189976f-8d02-468d-8fa7-bd5594c5f85a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:58:29 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ab803074-af55-42f4-a9c3-9494d1e21837 req-b9c0c033-267d-4905-bc66-af2cf47e8575 service nova] Lock "1189976f-8d02-468d-8fa7-bd5594c5f85a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:58:29 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ab803074-af55-42f4-a9c3-9494d1e21837 req-b9c0c033-267d-4905-bc66-af2cf47e8575 service nova] Lock "1189976f-8d02-468d-8fa7-bd5594c5f85a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:58:29 user nova-compute[74337]: DEBUG nova.compute.manager [req-ab803074-af55-42f4-a9c3-9494d1e21837 req-b9c0c033-267d-4905-bc66-af2cf47e8575 service nova] [instance: 1189976f-8d02-468d-8fa7-bd5594c5f85a] No waiting events found dispatching network-vif-unplugged-9c888931-1180-4efd-8ca1-a57252bf8dc5 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:58:29 user nova-compute[74337]: DEBUG nova.compute.manager [req-ab803074-af55-42f4-a9c3-9494d1e21837 req-b9c0c033-267d-4905-bc66-af2cf47e8575 service nova] [instance: 1189976f-8d02-468d-8fa7-bd5594c5f85a] Received event network-vif-unplugged-9c888931-1180-4efd-8ca1-a57252bf8dc5 for instance with task_state deleting. {{(pid=74337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 21:58:29 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:58:29 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:58:29 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: 1189976f-8d02-468d-8fa7-bd5594c5f85a] Instance destroyed successfully.
Oct 23 21:58:29 user nova-compute[74337]: DEBUG nova.objects.instance [None req-ba6b2582-6183-48ad-a6ee-196788ff52f1 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lazy-loading 'resources' on Instance uuid 1189976f-8d02-468d-8fa7-bd5594c5f85a {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:58:29 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-ba6b2582-6183-48ad-a6ee-196788ff52f1 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:38:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-202634150',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-202634150',id=15,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-23T21:38:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='83b85c4f783a4ee7ab67422b49da85ca',ramdisk_id='',reservation_id='r-fxhna0bf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1944032280',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T21:40:48Z,user_data=None,user_id='a2e424dd3c684c808de14c2a9c3c1ed6',uuid=1189976f-8d02-468d-8fa7-bd5594c5f85a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9c888931-1180-4efd-8ca1-a57252bf8dc5", "address": "fa:16:3e:f9:a2:b8", "network": {"id": "5f62b1d8-d5d0-4ff9-922b-fc6e72fb640d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-655282105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b85c4f783a4ee7ab67422b49da85ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c888931-11", "ovs_interfaceid": "9c888931-1180-4efd-8ca1-a57252bf8dc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 21:58:29 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-ba6b2582-6183-48ad-a6ee-196788ff52f1 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Converting VIF {"id": "9c888931-1180-4efd-8ca1-a57252bf8dc5", "address": "fa:16:3e:f9:a2:b8", "network": {"id": "5f62b1d8-d5d0-4ff9-922b-fc6e72fb640d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-655282105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b85c4f783a4ee7ab67422b49da85ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c888931-11", "ovs_interfaceid": "9c888931-1180-4efd-8ca1-a57252bf8dc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:58:29 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-ba6b2582-6183-48ad-a6ee-196788ff52f1 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f9:a2:b8,bridge_name='br-int',has_traffic_filtering=True,id=9c888931-1180-4efd-8ca1-a57252bf8dc5,network=Network(5f62b1d8-d5d0-4ff9-922b-fc6e72fb640d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c888931-11') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:58:29 user nova-compute[74337]: DEBUG os_vif [None req-ba6b2582-6183-48ad-a6ee-196788ff52f1 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:a2:b8,bridge_name='br-int',has_traffic_filtering=True,id=9c888931-1180-4efd-8ca1-a57252bf8dc5,network=Network(5f62b1d8-d5d0-4ff9-922b-fc6e72fb640d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c888931-11') {{(pid=74337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 21:58:29 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:58:29 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9c888931-11, bridge=br-int, if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:58:29 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:58:29 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:58:29 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:58:29 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3e8a610d-f878-4de6-b660-16f45796e31f) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:58:29 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:58:29 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:58:29 user nova-compute[74337]: INFO os_vif [None req-ba6b2582-6183-48ad-a6ee-196788ff52f1 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:a2:b8,bridge_name='br-int',has_traffic_filtering=True,id=9c888931-1180-4efd-8ca1-a57252bf8dc5,network=Network(5f62b1d8-d5d0-4ff9-922b-fc6e72fb640d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c888931-11')
Oct 23 21:58:29 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-ba6b2582-6183-48ad-a6ee-196788ff52f1 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: 1189976f-8d02-468d-8fa7-bd5594c5f85a] Deleting instance files /opt/stack/data/nova/instances/1189976f-8d02-468d-8fa7-bd5594c5f85a_del
Oct 23 21:58:29 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-ba6b2582-6183-48ad-a6ee-196788ff52f1 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: 1189976f-8d02-468d-8fa7-bd5594c5f85a] Deletion of /opt/stack/data/nova/instances/1189976f-8d02-468d-8fa7-bd5594c5f85a_del complete
Oct 23 21:58:29 user nova-compute[74337]: INFO nova.compute.manager [None req-ba6b2582-6183-48ad-a6ee-196788ff52f1 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] [instance: 1189976f-8d02-468d-8fa7-bd5594c5f85a] Took 0.69 seconds to destroy the instance on the hypervisor.
Oct 23 21:58:29 user nova-compute[74337]: DEBUG oslo.service.loopingcall [None req-ba6b2582-6183-48ad-a6ee-196788ff52f1 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74337) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 21:58:29 user nova-compute[74337]: DEBUG nova.compute.manager [-] [instance: 1189976f-8d02-468d-8fa7-bd5594c5f85a] Deallocating network for instance {{(pid=74337) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 21:58:29 user nova-compute[74337]: DEBUG nova.network.neutron [-] [instance: 1189976f-8d02-468d-8fa7-bd5594c5f85a] deallocate_for_instance() {{(pid=74337) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 21:58:30 user nova-compute[74337]: DEBUG nova.network.neutron [-] [instance: 1189976f-8d02-468d-8fa7-bd5594c5f85a] Updating instance_info_cache with network_info: [] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:58:30 user nova-compute[74337]: INFO nova.compute.manager [-] [instance: 1189976f-8d02-468d-8fa7-bd5594c5f85a] Took 0.42 seconds to deallocate network for instance.
Oct 23 21:58:30 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-ba6b2582-6183-48ad-a6ee-196788ff52f1 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:58:30 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-ba6b2582-6183-48ad-a6ee-196788ff52f1 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:58:30 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-ba6b2582-6183-48ad-a6ee-196788ff52f1 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:58:30 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-ba6b2582-6183-48ad-a6ee-196788ff52f1 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:58:30 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-ba6b2582-6183-48ad-a6ee-196788ff52f1 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.236s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:58:30 user nova-compute[74337]: INFO nova.scheduler.client.report [None req-ba6b2582-6183-48ad-a6ee-196788ff52f1 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Deleted allocations for instance 1189976f-8d02-468d-8fa7-bd5594c5f85a
Oct 23 21:58:30 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:58:30 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-ba6b2582-6183-48ad-a6ee-196788ff52f1 tempest-ServerBootFromVolumeStableRescueTest-1944032280 tempest-ServerBootFromVolumeStableRescueTest-1944032280-project-member] Lock "1189976f-8d02-468d-8fa7-bd5594c5f85a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.551s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:58:31 user nova-compute[74337]: DEBUG nova.compute.manager [req-11d56fc4-5fe5-435a-9036-33edd0ba3101 req-8502dbdd-4343-40a2-b62b-6e2a738ec2ae service nova] [instance: 1189976f-8d02-468d-8fa7-bd5594c5f85a] Received event network-vif-plugged-9c888931-1180-4efd-8ca1-a57252bf8dc5 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:58:31 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-11d56fc4-5fe5-435a-9036-33edd0ba3101 req-8502dbdd-4343-40a2-b62b-6e2a738ec2ae service nova] Acquiring lock "1189976f-8d02-468d-8fa7-bd5594c5f85a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:58:31 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-11d56fc4-5fe5-435a-9036-33edd0ba3101 req-8502dbdd-4343-40a2-b62b-6e2a738ec2ae service nova] Lock "1189976f-8d02-468d-8fa7-bd5594c5f85a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:58:31 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-11d56fc4-5fe5-435a-9036-33edd0ba3101 req-8502dbdd-4343-40a2-b62b-6e2a738ec2ae service nova] Lock "1189976f-8d02-468d-8fa7-bd5594c5f85a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:58:31 user nova-compute[74337]: DEBUG nova.compute.manager [req-11d56fc4-5fe5-435a-9036-33edd0ba3101 req-8502dbdd-4343-40a2-b62b-6e2a738ec2ae service nova] [instance: 1189976f-8d02-468d-8fa7-bd5594c5f85a] No waiting events found dispatching network-vif-plugged-9c888931-1180-4efd-8ca1-a57252bf8dc5 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:58:31 user nova-compute[74337]: WARNING nova.compute.manager [req-11d56fc4-5fe5-435a-9036-33edd0ba3101 req-8502dbdd-4343-40a2-b62b-6e2a738ec2ae service nova] [instance: 1189976f-8d02-468d-8fa7-bd5594c5f85a] Received unexpected event network-vif-plugged-9c888931-1180-4efd-8ca1-a57252bf8dc5 for instance with vm_state deleted and task_state None.
Oct 23 21:58:31 user nova-compute[74337]: DEBUG nova.compute.manager [req-11d56fc4-5fe5-435a-9036-33edd0ba3101 req-8502dbdd-4343-40a2-b62b-6e2a738ec2ae service nova] [instance: 1189976f-8d02-468d-8fa7-bd5594c5f85a] Received event network-vif-deleted-9c888931-1180-4efd-8ca1-a57252bf8dc5 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:58:33 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:58:34 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:58:38 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:58:39 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:58:41 user nova-compute[74337]: DEBUG nova.compute.manager [req-245260d0-54ee-4096-a0c9-8b17070855e9 req-5ae27c02-c17e-4833-aa8c-37354c652a59 service nova] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Received event network-changed-0b516177-6ded-4b79-9f77-84ba1466f259 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:58:41 user nova-compute[74337]: DEBUG nova.compute.manager [req-245260d0-54ee-4096-a0c9-8b17070855e9 req-5ae27c02-c17e-4833-aa8c-37354c652a59 service nova] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Refreshing instance network info cache due to event network-changed-0b516177-6ded-4b79-9f77-84ba1466f259. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 21:58:41 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-245260d0-54ee-4096-a0c9-8b17070855e9 req-5ae27c02-c17e-4833-aa8c-37354c652a59 service nova] Acquiring lock "refresh_cache-dbad2e14-7b6c-475e-b471-a87cb9e21b7f" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:58:41 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-245260d0-54ee-4096-a0c9-8b17070855e9 req-5ae27c02-c17e-4833-aa8c-37354c652a59 service nova] Acquired lock "refresh_cache-dbad2e14-7b6c-475e-b471-a87cb9e21b7f" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:58:41 user nova-compute[74337]: DEBUG nova.network.neutron [req-245260d0-54ee-4096-a0c9-8b17070855e9 req-5ae27c02-c17e-4833-aa8c-37354c652a59 service nova] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Refreshing network info cache for port 0b516177-6ded-4b79-9f77-84ba1466f259 {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 21:58:41 user nova-compute[74337]: DEBUG nova.network.neutron [req-245260d0-54ee-4096-a0c9-8b17070855e9 req-5ae27c02-c17e-4833-aa8c-37354c652a59 service nova] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Updated VIF entry in instance network info cache for port 0b516177-6ded-4b79-9f77-84ba1466f259. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 21:58:41 user nova-compute[74337]: DEBUG nova.network.neutron [req-245260d0-54ee-4096-a0c9-8b17070855e9 req-5ae27c02-c17e-4833-aa8c-37354c652a59 service nova] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Updating instance_info_cache with network_info: [{"id": "0b516177-6ded-4b79-9f77-84ba1466f259", "address": "fa:16:3e:3e:3f:19", "network": {"id": "0feb8c56-c17f-47d0-9796-91d4bd20e81d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1399506675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd8afde978624cf8a2356e8ce8b4d3f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b516177-6d", "ovs_interfaceid": "0b516177-6ded-4b79-9f77-84ba1466f259", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:58:42 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-245260d0-54ee-4096-a0c9-8b17070855e9 req-5ae27c02-c17e-4833-aa8c-37354c652a59 service nova] Releasing lock "refresh_cache-dbad2e14-7b6c-475e-b471-a87cb9e21b7f" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:58:43 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:58:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:58:45 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-9ab37ebc-1f58-415b-ae22-bf511e5fb701 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Acquiring lock "d5d9d286-4837-4168-a4fe-1bc09e372654" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:58:45 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-9ab37ebc-1f58-415b-ae22-bf511e5fb701 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Lock "d5d9d286-4837-4168-a4fe-1bc09e372654" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:58:45 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-9ab37ebc-1f58-415b-ae22-bf511e5fb701 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Acquiring lock "d5d9d286-4837-4168-a4fe-1bc09e372654-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:58:45 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-9ab37ebc-1f58-415b-ae22-bf511e5fb701 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Lock "d5d9d286-4837-4168-a4fe-1bc09e372654-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:58:45 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-9ab37ebc-1f58-415b-ae22-bf511e5fb701 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Lock "d5d9d286-4837-4168-a4fe-1bc09e372654-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:58:45 user nova-compute[74337]: INFO nova.compute.manager [None req-9ab37ebc-1f58-415b-ae22-bf511e5fb701 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] Terminating instance
Oct 23 21:58:45 user nova-compute[74337]: DEBUG nova.compute.manager [None req-9ab37ebc-1f58-415b-ae22-bf511e5fb701 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] Start destroying the instance on the hypervisor. {{(pid=74337) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 21:58:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:58:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:58:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:58:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:58:45 user nova-compute[74337]: DEBUG nova.compute.manager [req-df60670d-365a-4e67-b676-62405591bb1f req-72cee5d2-6175-4e8b-9d97-b1c11e9e9e15 service nova] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] Received event network-vif-unplugged-16ee3173-b704-43aa-9c44-ffa4d4d82fc4 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:58:45 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-df60670d-365a-4e67-b676-62405591bb1f req-72cee5d2-6175-4e8b-9d97-b1c11e9e9e15 service nova] Acquiring lock "d5d9d286-4837-4168-a4fe-1bc09e372654-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:58:45 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-df60670d-365a-4e67-b676-62405591bb1f req-72cee5d2-6175-4e8b-9d97-b1c11e9e9e15 service nova] Lock "d5d9d286-4837-4168-a4fe-1bc09e372654-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:58:45 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-df60670d-365a-4e67-b676-62405591bb1f req-72cee5d2-6175-4e8b-9d97-b1c11e9e9e15 service nova] Lock "d5d9d286-4837-4168-a4fe-1bc09e372654-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:58:45 user nova-compute[74337]: DEBUG nova.compute.manager [req-df60670d-365a-4e67-b676-62405591bb1f req-72cee5d2-6175-4e8b-9d97-b1c11e9e9e15 service nova] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] No waiting events found dispatching network-vif-unplugged-16ee3173-b704-43aa-9c44-ffa4d4d82fc4 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:58:45 user nova-compute[74337]: DEBUG nova.compute.manager [req-df60670d-365a-4e67-b676-62405591bb1f req-72cee5d2-6175-4e8b-9d97-b1c11e9e9e15 service nova] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] Received event network-vif-unplugged-16ee3173-b704-43aa-9c44-ffa4d4d82fc4 for instance with task_state deleting. {{(pid=74337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 21:58:46 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] Instance destroyed successfully.
Oct 23 21:58:46 user nova-compute[74337]: DEBUG nova.objects.instance [None req-9ab37ebc-1f58-415b-ae22-bf511e5fb701 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Lazy-loading 'resources' on Instance uuid d5d9d286-4837-4168-a4fe-1bc09e372654 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:58:46 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-9ab37ebc-1f58-415b-ae22-bf511e5fb701 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:53:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-748752527',display_name='tempest-TestMinimumBasicScenario-server-748752527',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-748752527',id=35,image_ref='c9f5f8ff-7674-48c5-a008-032e4795ab33',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIfLpXwFvySixQSBbn4nLlq9zjEg9GhMniy/7jo41PUhYLOeqBGONhSCnyTqv8kIiaxawNifBQnT0i1aAI0ZeKsMK+jJ6PrQUPzAQJ9WenGIpnoBC3sKUguIOqv2XtAxmQ==',key_name='tempest-TestMinimumBasicScenario-1876165380',keypairs=<?>,launch_index=0,launched_at=2023-10-23T21:53:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='965415a9973d4714aa49a64d34b232a6',ramdisk_id='',reservation_id='r-0zsuhsbg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='c9f5f8ff-7674-48c5-a008-032e4795ab33',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-295529967',owner_user_name='tempest-TestMinimumBasicScenario-295529967-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T21:56:00Z,user_data=None,user_id='5a20c05457014209a86f285fcc9dd506',uuid=d5d9d286-4837-4168-a4fe-1bc09e372654,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "16ee3173-b704-43aa-9c44-ffa4d4d82fc4", "address": "fa:16:3e:be:e5:9b", "network": {"id": "0b1d82b0-acba-470e-aede-1c57a85a8ed3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1250228933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "965415a9973d4714aa49a64d34b232a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16ee3173-b7", "ovs_interfaceid": "16ee3173-b704-43aa-9c44-ffa4d4d82fc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 21:58:46 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-9ab37ebc-1f58-415b-ae22-bf511e5fb701 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Converting VIF {"id": "16ee3173-b704-43aa-9c44-ffa4d4d82fc4", "address": "fa:16:3e:be:e5:9b", "network": {"id": "0b1d82b0-acba-470e-aede-1c57a85a8ed3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1250228933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "965415a9973d4714aa49a64d34b232a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16ee3173-b7", "ovs_interfaceid": "16ee3173-b704-43aa-9c44-ffa4d4d82fc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:58:46 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-9ab37ebc-1f58-415b-ae22-bf511e5fb701 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:be:e5:9b,bridge_name='br-int',has_traffic_filtering=True,id=16ee3173-b704-43aa-9c44-ffa4d4d82fc4,network=Network(0b1d82b0-acba-470e-aede-1c57a85a8ed3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16ee3173-b7') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:58:46 user nova-compute[74337]: DEBUG os_vif [None req-9ab37ebc-1f58-415b-ae22-bf511e5fb701 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:e5:9b,bridge_name='br-int',has_traffic_filtering=True,id=16ee3173-b704-43aa-9c44-ffa4d4d82fc4,network=Network(0b1d82b0-acba-470e-aede-1c57a85a8ed3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16ee3173-b7') {{(pid=74337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 21:58:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:58:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap16ee3173-b7, bridge=br-int, if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:58:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:58:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:58:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:58:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=48ce7b2b-5a41-4845-9d99-267cfe84a0ef) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:58:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:58:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:58:46 user nova-compute[74337]: INFO os_vif [None req-9ab37ebc-1f58-415b-ae22-bf511e5fb701 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:e5:9b,bridge_name='br-int',has_traffic_filtering=True,id=16ee3173-b704-43aa-9c44-ffa4d4d82fc4,network=Network(0b1d82b0-acba-470e-aede-1c57a85a8ed3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16ee3173-b7')
Oct 23 21:58:46 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-9ab37ebc-1f58-415b-ae22-bf511e5fb701 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] Deleting instance files /opt/stack/data/nova/instances/d5d9d286-4837-4168-a4fe-1bc09e372654_del
Oct 23 21:58:46 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-9ab37ebc-1f58-415b-ae22-bf511e5fb701 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] Deletion of /opt/stack/data/nova/instances/d5d9d286-4837-4168-a4fe-1bc09e372654_del complete
Oct 23 21:58:46 user nova-compute[74337]: INFO nova.compute.manager [None req-9ab37ebc-1f58-415b-ae22-bf511e5fb701 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] Took 0.87 seconds to destroy the instance on the hypervisor.
Oct 23 21:58:46 user nova-compute[74337]: DEBUG oslo.service.loopingcall [None req-9ab37ebc-1f58-415b-ae22-bf511e5fb701 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74337) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 21:58:46 user nova-compute[74337]: DEBUG nova.compute.manager [-] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] Deallocating network for instance {{(pid=74337) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 21:58:46 user nova-compute[74337]: DEBUG nova.network.neutron [-] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] deallocate_for_instance() {{(pid=74337) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 21:58:46 user nova-compute[74337]: DEBUG nova.network.neutron [-] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] Updating instance_info_cache with network_info: [] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:58:46 user nova-compute[74337]: INFO nova.compute.manager [-] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] Took 0.48 seconds to deallocate network for instance.
Oct 23 21:58:46 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-9ab37ebc-1f58-415b-ae22-bf511e5fb701 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:58:46 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-9ab37ebc-1f58-415b-ae22-bf511e5fb701 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:58:47 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-9ab37ebc-1f58-415b-ae22-bf511e5fb701 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:58:47 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-9ab37ebc-1f58-415b-ae22-bf511e5fb701 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:58:47 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-9ab37ebc-1f58-415b-ae22-bf511e5fb701 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.270s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:58:47 user nova-compute[74337]: INFO nova.scheduler.client.report [None req-9ab37ebc-1f58-415b-ae22-bf511e5fb701 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Deleted allocations for instance d5d9d286-4837-4168-a4fe-1bc09e372654
Oct 23 21:58:47 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-9ab37ebc-1f58-415b-ae22-bf511e5fb701 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Lock "d5d9d286-4837-4168-a4fe-1bc09e372654" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.846s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:58:47 user nova-compute[74337]: DEBUG nova.compute.manager [req-80fa3b7a-c701-496f-a91a-b92df2bb6c99 req-a30fe850-c746-479a-82dd-bb681f4f6701 service nova] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] Received event network-vif-plugged-16ee3173-b704-43aa-9c44-ffa4d4d82fc4 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:58:47 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-80fa3b7a-c701-496f-a91a-b92df2bb6c99 req-a30fe850-c746-479a-82dd-bb681f4f6701 service nova] Acquiring lock "d5d9d286-4837-4168-a4fe-1bc09e372654-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:58:47 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-80fa3b7a-c701-496f-a91a-b92df2bb6c99 req-a30fe850-c746-479a-82dd-bb681f4f6701 service nova] Lock "d5d9d286-4837-4168-a4fe-1bc09e372654-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:58:47 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-80fa3b7a-c701-496f-a91a-b92df2bb6c99 req-a30fe850-c746-479a-82dd-bb681f4f6701 service nova] Lock "d5d9d286-4837-4168-a4fe-1bc09e372654-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:58:47 user nova-compute[74337]: DEBUG nova.compute.manager [req-80fa3b7a-c701-496f-a91a-b92df2bb6c99 req-a30fe850-c746-479a-82dd-bb681f4f6701 service nova] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] No waiting events found dispatching network-vif-plugged-16ee3173-b704-43aa-9c44-ffa4d4d82fc4 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:58:47 user nova-compute[74337]: WARNING nova.compute.manager [req-80fa3b7a-c701-496f-a91a-b92df2bb6c99 req-a30fe850-c746-479a-82dd-bb681f4f6701 service nova] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] Received unexpected event network-vif-plugged-16ee3173-b704-43aa-9c44-ffa4d4d82fc4 for instance with vm_state deleted and task_state None.
Oct 23 21:58:47 user nova-compute[74337]: DEBUG nova.compute.manager [req-80fa3b7a-c701-496f-a91a-b92df2bb6c99 req-a30fe850-c746-479a-82dd-bb681f4f6701 service nova] [instance: d5d9d286-4837-4168-a4fe-1bc09e372654] Received event network-vif-deleted-16ee3173-b704-43aa-9c44-ffa4d4d82fc4 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:58:48 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-58871df2-3ce1-4231-b5b1-603f2b74ccf3 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Acquiring lock "dbad2e14-7b6c-475e-b471-a87cb9e21b7f" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:58:48 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-58871df2-3ce1-4231-b5b1-603f2b74ccf3 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Lock "dbad2e14-7b6c-475e-b471-a87cb9e21b7f" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:58:48 user nova-compute[74337]: INFO nova.compute.manager [None req-58871df2-3ce1-4231-b5b1-603f2b74ccf3 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Shelving
Oct 23 21:58:48 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:58:48 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:58:48 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:58:48 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:58:49 user nova-compute[74337]: DEBUG nova.compute.manager [req-0c09d650-6152-4cf4-a01a-67ff90ca4ad5 req-d99a6bd5-5fdc-40e4-9720-761880092e48 service nova] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Received event network-vif-unplugged-0b516177-6ded-4b79-9f77-84ba1466f259 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:58:49 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-0c09d650-6152-4cf4-a01a-67ff90ca4ad5 req-d99a6bd5-5fdc-40e4-9720-761880092e48 service nova] Acquiring lock "dbad2e14-7b6c-475e-b471-a87cb9e21b7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:58:49 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-0c09d650-6152-4cf4-a01a-67ff90ca4ad5 req-d99a6bd5-5fdc-40e4-9720-761880092e48 service nova] Lock "dbad2e14-7b6c-475e-b471-a87cb9e21b7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:58:49 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-0c09d650-6152-4cf4-a01a-67ff90ca4ad5 req-d99a6bd5-5fdc-40e4-9720-761880092e48 service nova] Lock "dbad2e14-7b6c-475e-b471-a87cb9e21b7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:58:49 user nova-compute[74337]: DEBUG nova.compute.manager [req-0c09d650-6152-4cf4-a01a-67ff90ca4ad5 req-d99a6bd5-5fdc-40e4-9720-761880092e48 service nova] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] No waiting events found dispatching network-vif-unplugged-0b516177-6ded-4b79-9f77-84ba1466f259 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:58:49 user nova-compute[74337]: WARNING nova.compute.manager [req-0c09d650-6152-4cf4-a01a-67ff90ca4ad5 req-d99a6bd5-5fdc-40e4-9720-761880092e48 service nova] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Received unexpected event network-vif-unplugged-0b516177-6ded-4b79-9f77-84ba1466f259 for instance with vm_state active and task_state shelving.
Oct 23 21:58:49 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Instance destroyed successfully.
Oct 23 21:58:49 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-58871df2-3ce1-4231-b5b1-603f2b74ccf3 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Beginning cold snapshot process
Oct 23 21:58:49 user nova-compute[74337]: DEBUG nova.privsep.utils [None req-58871df2-3ce1-4231-b5b1-603f2b74ccf3 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74337) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 23 21:58:49 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-58871df2-3ce1-4231-b5b1-603f2b74ccf3 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/dbad2e14-7b6c-475e-b471-a87cb9e21b7f/disk /opt/stack/data/nova/instances/snapshots/tmpnuqqw1s2/52c37170f0314ab48d60ff2219e563cf {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:58:50 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-58871df2-3ce1-4231-b5b1-603f2b74ccf3 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/dbad2e14-7b6c-475e-b471-a87cb9e21b7f/disk /opt/stack/data/nova/instances/snapshots/tmpnuqqw1s2/52c37170f0314ab48d60ff2219e563cf" returned: 0 in 0.944s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:58:50 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-58871df2-3ce1-4231-b5b1-603f2b74ccf3 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Snapshot extracted, beginning image upload
Oct 23 21:58:51 user nova-compute[74337]: DEBUG nova.compute.manager [req-87469793-687f-4515-8e94-8a54bca54405 req-7ade4e7f-52c2-4540-82d1-28776b4ba22f service nova] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Received event network-vif-plugged-0b516177-6ded-4b79-9f77-84ba1466f259 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:58:51 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-87469793-687f-4515-8e94-8a54bca54405 req-7ade4e7f-52c2-4540-82d1-28776b4ba22f service nova] Acquiring lock "dbad2e14-7b6c-475e-b471-a87cb9e21b7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:58:51 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-87469793-687f-4515-8e94-8a54bca54405 req-7ade4e7f-52c2-4540-82d1-28776b4ba22f service nova] Lock "dbad2e14-7b6c-475e-b471-a87cb9e21b7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:58:51 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-87469793-687f-4515-8e94-8a54bca54405 req-7ade4e7f-52c2-4540-82d1-28776b4ba22f service nova] Lock "dbad2e14-7b6c-475e-b471-a87cb9e21b7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:58:51 user nova-compute[74337]: DEBUG nova.compute.manager [req-87469793-687f-4515-8e94-8a54bca54405 req-7ade4e7f-52c2-4540-82d1-28776b4ba22f service nova] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] No waiting events found dispatching network-vif-plugged-0b516177-6ded-4b79-9f77-84ba1466f259 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:58:51 user nova-compute[74337]: WARNING nova.compute.manager [req-87469793-687f-4515-8e94-8a54bca54405 req-7ade4e7f-52c2-4540-82d1-28776b4ba22f service nova] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Received unexpected event network-vif-plugged-0b516177-6ded-4b79-9f77-84ba1466f259 for instance with vm_state active and task_state shelving_image_uploading.
Oct 23 21:58:51 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:58:52 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:58:53 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-58871df2-3ce1-4231-b5b1-603f2b74ccf3 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Snapshot image upload complete
Oct 23 21:58:53 user nova-compute[74337]: DEBUG nova.compute.manager [None req-58871df2-3ce1-4231-b5b1-603f2b74ccf3 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Checking state {{(pid=74337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 21:58:53 user nova-compute[74337]: INFO nova.compute.manager [None req-58871df2-3ce1-4231-b5b1-603f2b74ccf3 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Shelve offloading
Oct 23 21:58:53 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Instance destroyed successfully.
Oct 23 21:58:53 user nova-compute[74337]: DEBUG nova.compute.manager [None req-58871df2-3ce1-4231-b5b1-603f2b74ccf3 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Checking state {{(pid=74337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 21:58:53 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-58871df2-3ce1-4231-b5b1-603f2b74ccf3 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Acquiring lock "refresh_cache-dbad2e14-7b6c-475e-b471-a87cb9e21b7f" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:58:53 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-58871df2-3ce1-4231-b5b1-603f2b74ccf3 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Acquired lock "refresh_cache-dbad2e14-7b6c-475e-b471-a87cb9e21b7f" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:58:53 user nova-compute[74337]: DEBUG nova.network.neutron [None req-58871df2-3ce1-4231-b5b1-603f2b74ccf3 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Building network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 21:58:54 user nova-compute[74337]: DEBUG nova.network.neutron [None req-58871df2-3ce1-4231-b5b1-603f2b74ccf3 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Updating instance_info_cache with network_info: [{"id": "0b516177-6ded-4b79-9f77-84ba1466f259", "address": "fa:16:3e:3e:3f:19", "network": {"id": "0feb8c56-c17f-47d0-9796-91d4bd20e81d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1399506675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd8afde978624cf8a2356e8ce8b4d3f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b516177-6d", "ovs_interfaceid": "0b516177-6ded-4b79-9f77-84ba1466f259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:58:54 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-58871df2-3ce1-4231-b5b1-603f2b74ccf3 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Releasing lock "refresh_cache-dbad2e14-7b6c-475e-b471-a87cb9e21b7f" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:58:54 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Instance destroyed successfully.
Oct 23 21:58:54 user nova-compute[74337]: DEBUG nova.objects.instance [None req-58871df2-3ce1-4231-b5b1-603f2b74ccf3 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Lazy-loading 'resources' on Instance uuid dbad2e14-7b6c-475e-b471-a87cb9e21b7f {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:58:54 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-58871df2-3ce1-4231-b5b1-603f2b74ccf3 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:56:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-871350340',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-871350340',id=39,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHRDalfqxZaW8tFQ9tDoYtCFE78iJYyBQ1ot3CVX7Ji0u7cN5OwvaEEc+VVh5hRl2DfFzm1xzi24XgwVkSIP+Eap1fKERDd4zLGppmS56DXgviGQt7TMPi4e47AawwOGzg==',key_name='tempest-keypair-1238420293',keypairs=<?>,launch_index=0,launched_at=2023-10-23T21:56:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='dd8afde978624cf8a2356e8ce8b4d3f2',ramdisk_id='',reservation_id='r-fs4u8r0x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-338191707',owner_user_name='tempest-AttachVolumeShelveTestJSON-338191707-project-member',shelved_at='2023-10-23T21:58:53.338940',shelved_host='user',shelved_image_id='7507d6a0-9570-4b7f-ad30-d527cae18b71'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T21:58:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ddd5c407fbe440e85111213c4c2dd46',uuid=dbad2e14-7b6c-475e-b471-a87cb9e21b7f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "0b516177-6ded-4b79-9f77-84ba1466f259", "address": "fa:16:3e:3e:3f:19", "network": {"id": "0feb8c56-c17f-47d0-9796-91d4bd20e81d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1399506675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd8afde978624cf8a2356e8ce8b4d3f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b516177-6d", "ovs_interfaceid": "0b516177-6ded-4b79-9f77-84ba1466f259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 21:58:54 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-58871df2-3ce1-4231-b5b1-603f2b74ccf3 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Converting VIF {"id": "0b516177-6ded-4b79-9f77-84ba1466f259", "address": "fa:16:3e:3e:3f:19", "network": {"id": "0feb8c56-c17f-47d0-9796-91d4bd20e81d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1399506675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd8afde978624cf8a2356e8ce8b4d3f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b516177-6d", "ovs_interfaceid": "0b516177-6ded-4b79-9f77-84ba1466f259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:58:54 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-58871df2-3ce1-4231-b5b1-603f2b74ccf3 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:3f:19,bridge_name='br-int',has_traffic_filtering=True,id=0b516177-6ded-4b79-9f77-84ba1466f259,network=Network(0feb8c56-c17f-47d0-9796-91d4bd20e81d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b516177-6d') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:58:54 user nova-compute[74337]: DEBUG os_vif [None req-58871df2-3ce1-4231-b5b1-603f2b74ccf3 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:3f:19,bridge_name='br-int',has_traffic_filtering=True,id=0b516177-6ded-4b79-9f77-84ba1466f259,network=Network(0feb8c56-c17f-47d0-9796-91d4bd20e81d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b516177-6d') {{(pid=74337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 21:58:54 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:58:54 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0b516177-6d, bridge=br-int, if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:58:54 user nova-compute[74337]: DEBUG nova.compute.manager [req-186d0e09-9973-4cb7-bac3-9f1b21a940b9 req-d5759f6d-632a-456e-880f-d553ccd1e329 service nova] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Received event network-changed-0b516177-6ded-4b79-9f77-84ba1466f259 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:58:54 user nova-compute[74337]: DEBUG nova.compute.manager [req-186d0e09-9973-4cb7-bac3-9f1b21a940b9 req-d5759f6d-632a-456e-880f-d553ccd1e329 service nova] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Refreshing instance network info cache due to event network-changed-0b516177-6ded-4b79-9f77-84ba1466f259. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 21:58:54 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-186d0e09-9973-4cb7-bac3-9f1b21a940b9 req-d5759f6d-632a-456e-880f-d553ccd1e329 service nova] Acquiring lock "refresh_cache-dbad2e14-7b6c-475e-b471-a87cb9e21b7f" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:58:54 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-186d0e09-9973-4cb7-bac3-9f1b21a940b9 req-d5759f6d-632a-456e-880f-d553ccd1e329 service nova] Acquired lock "refresh_cache-dbad2e14-7b6c-475e-b471-a87cb9e21b7f" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:58:54 user nova-compute[74337]: DEBUG nova.network.neutron [req-186d0e09-9973-4cb7-bac3-9f1b21a940b9 req-d5759f6d-632a-456e-880f-d553ccd1e329 service nova] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Refreshing network info cache for port 0b516177-6ded-4b79-9f77-84ba1466f259 {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 21:58:54 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:58:54 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:58:54 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:58:54 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=038ef621-7c55-4126-8e1d-9739f52d6a8f) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:58:54 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:58:54 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:58:54 user nova-compute[74337]: INFO os_vif [None req-58871df2-3ce1-4231-b5b1-603f2b74ccf3 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:3f:19,bridge_name='br-int',has_traffic_filtering=True,id=0b516177-6ded-4b79-9f77-84ba1466f259,network=Network(0feb8c56-c17f-47d0-9796-91d4bd20e81d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b516177-6d')
Oct 23 21:58:54 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-58871df2-3ce1-4231-b5b1-603f2b74ccf3 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Deleting instance files /opt/stack/data/nova/instances/dbad2e14-7b6c-475e-b471-a87cb9e21b7f_del
Oct 23 21:58:54 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-58871df2-3ce1-4231-b5b1-603f2b74ccf3 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Deletion of /opt/stack/data/nova/instances/dbad2e14-7b6c-475e-b471-a87cb9e21b7f_del complete
Oct 23 21:58:55 user nova-compute[74337]: INFO nova.scheduler.client.report [None req-58871df2-3ce1-4231-b5b1-603f2b74ccf3 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Deleted allocations for instance dbad2e14-7b6c-475e-b471-a87cb9e21b7f
Oct 23 21:58:55 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-58871df2-3ce1-4231-b5b1-603f2b74ccf3 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:58:55 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-58871df2-3ce1-4231-b5b1-603f2b74ccf3 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:58:55 user nova-compute[74337]: DEBUG nova.objects.instance [None req-58871df2-3ce1-4231-b5b1-603f2b74ccf3 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Lazy-loading 'numa_topology' on Instance uuid dbad2e14-7b6c-475e-b471-a87cb9e21b7f {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:58:55 user nova-compute[74337]: DEBUG nova.objects.base [None req-58871df2-3ce1-4231-b5b1-603f2b74ccf3 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Object Instance<dbad2e14-7b6c-475e-b471-a87cb9e21b7f> lazy-loaded attributes: resources,numa_topology {{(pid=74337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 21:58:55 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-58871df2-3ce1-4231-b5b1-603f2b74ccf3 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:58:55 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-58871df2-3ce1-4231-b5b1-603f2b74ccf3 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:58:55 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-58871df2-3ce1-4231-b5b1-603f2b74ccf3 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.195s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:58:55 user nova-compute[74337]: DEBUG nova.network.neutron [req-186d0e09-9973-4cb7-bac3-9f1b21a940b9 req-d5759f6d-632a-456e-880f-d553ccd1e329 service nova] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Updated VIF entry in instance network info cache for port 0b516177-6ded-4b79-9f77-84ba1466f259. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 21:58:55 user nova-compute[74337]: DEBUG nova.network.neutron [req-186d0e09-9973-4cb7-bac3-9f1b21a940b9 req-d5759f6d-632a-456e-880f-d553ccd1e329 service nova] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Updating instance_info_cache with network_info: [{"id": "0b516177-6ded-4b79-9f77-84ba1466f259", "address": "fa:16:3e:3e:3f:19", "network": {"id": "0feb8c56-c17f-47d0-9796-91d4bd20e81d", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1399506675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd8afde978624cf8a2356e8ce8b4d3f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap0b516177-6d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:58:55 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-186d0e09-9973-4cb7-bac3-9f1b21a940b9 req-d5759f6d-632a-456e-880f-d553ccd1e329 service nova] Releasing lock "refresh_cache-dbad2e14-7b6c-475e-b471-a87cb9e21b7f" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:58:55 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-58871df2-3ce1-4231-b5b1-603f2b74ccf3 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Lock "dbad2e14-7b6c-475e-b471-a87cb9e21b7f" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.568s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:58:58 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:58:59 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:59:04 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:59:06 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:59:08 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-1b72159e-73e9-415c-973f-c677a2bac133 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Acquiring lock "547c4d4c-e0dd-495a-b83f-98426d0a4a99" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:59:08 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-1b72159e-73e9-415c-973f-c677a2bac133 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lock "547c4d4c-e0dd-495a-b83f-98426d0a4a99" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:59:08 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-1b72159e-73e9-415c-973f-c677a2bac133 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Acquiring lock "547c4d4c-e0dd-495a-b83f-98426d0a4a99-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:59:08 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-1b72159e-73e9-415c-973f-c677a2bac133 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lock "547c4d4c-e0dd-495a-b83f-98426d0a4a99-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:59:08 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-1b72159e-73e9-415c-973f-c677a2bac133 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lock "547c4d4c-e0dd-495a-b83f-98426d0a4a99-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:59:08 user nova-compute[74337]: INFO nova.compute.manager [None req-1b72159e-73e9-415c-973f-c677a2bac133 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 547c4d4c-e0dd-495a-b83f-98426d0a4a99] Terminating instance
Oct 23 21:59:08 user nova-compute[74337]: DEBUG nova.compute.manager [None req-1b72159e-73e9-415c-973f-c677a2bac133 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 547c4d4c-e0dd-495a-b83f-98426d0a4a99] Start destroying the instance on the hypervisor. {{(pid=74337) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 21:59:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:59:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:59:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:59:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:59:08 user nova-compute[74337]: DEBUG nova.compute.manager [req-f106763f-55e0-48f5-9d05-0646dd8b2943 req-98d9799c-b42d-41ff-b58b-464d9cf70186 service nova] [instance: 547c4d4c-e0dd-495a-b83f-98426d0a4a99] Received event network-vif-unplugged-2dd20d7f-9490-476a-90ed-e6a1c9085e4d {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:59:08 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-f106763f-55e0-48f5-9d05-0646dd8b2943 req-98d9799c-b42d-41ff-b58b-464d9cf70186 service nova] Acquiring lock "547c4d4c-e0dd-495a-b83f-98426d0a4a99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:59:08 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-f106763f-55e0-48f5-9d05-0646dd8b2943 req-98d9799c-b42d-41ff-b58b-464d9cf70186 service nova] Lock "547c4d4c-e0dd-495a-b83f-98426d0a4a99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:59:08 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-f106763f-55e0-48f5-9d05-0646dd8b2943 req-98d9799c-b42d-41ff-b58b-464d9cf70186 service nova] Lock "547c4d4c-e0dd-495a-b83f-98426d0a4a99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:59:08 user nova-compute[74337]: DEBUG nova.compute.manager [req-f106763f-55e0-48f5-9d05-0646dd8b2943 req-98d9799c-b42d-41ff-b58b-464d9cf70186 service nova] [instance: 547c4d4c-e0dd-495a-b83f-98426d0a4a99] No waiting events found dispatching network-vif-unplugged-2dd20d7f-9490-476a-90ed-e6a1c9085e4d {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:59:08 user nova-compute[74337]: DEBUG nova.compute.manager [req-f106763f-55e0-48f5-9d05-0646dd8b2943 req-98d9799c-b42d-41ff-b58b-464d9cf70186 service nova] [instance: 547c4d4c-e0dd-495a-b83f-98426d0a4a99] Received event network-vif-unplugged-2dd20d7f-9490-476a-90ed-e6a1c9085e4d for instance with task_state deleting. {{(pid=74337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 21:59:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:59:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:59:09 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: 547c4d4c-e0dd-495a-b83f-98426d0a4a99] Instance destroyed successfully.
Oct 23 21:59:09 user nova-compute[74337]: DEBUG nova.objects.instance [None req-1b72159e-73e9-415c-973f-c677a2bac133 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lazy-loading 'resources' on Instance uuid 547c4d4c-e0dd-495a-b83f-98426d0a4a99 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:59:09 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-1b72159e-73e9-415c-973f-c677a2bac133 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:39:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1158479955',display_name='tempest-ServerActionsTestOtherA-server-1158479955',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1158479955',id=17,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAUefvW5MXCf+ATdQvlG858gIBXPDNbf7wcgIdNA8u/7ry6R/jyuWYoMofLLf6tWmqavGvJQy7SZOewcrGrMe1Wf24ACMK0qGJkM0S6nAXe5EBQ2zvJtr8dUyXZnBDdU6w==',key_name='tempest-keypair-1448030867',keypairs=<?>,launch_index=0,launched_at=2023-10-23T21:39:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e1f57e58a9ec4c6384dc0d3ca58eb610',ramdisk_id='',reservation_id='r-n7s1gje7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-100075475',owner_user_name='tempest-ServerActionsTestOtherA-100075475-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T21:39:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='891ee2e3acc54ed0bc4571f63ff491a0',uuid=547c4d4c-e0dd-495a-b83f-98426d0a4a99,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2dd20d7f-9490-476a-90ed-e6a1c9085e4d", "address": "fa:16:3e:5f:e1:f7", "network": {"id": "aff1f95f-fda8-4f0f-8d10-7e3d587e4fda", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2048135647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1f57e58a9ec4c6384dc0d3ca58eb610", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd20d7f-94", "ovs_interfaceid": "2dd20d7f-9490-476a-90ed-e6a1c9085e4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 21:59:09 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-1b72159e-73e9-415c-973f-c677a2bac133 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Converting VIF {"id": "2dd20d7f-9490-476a-90ed-e6a1c9085e4d", "address": "fa:16:3e:5f:e1:f7", "network": {"id": "aff1f95f-fda8-4f0f-8d10-7e3d587e4fda", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2048135647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1f57e58a9ec4c6384dc0d3ca58eb610", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd20d7f-94", "ovs_interfaceid": "2dd20d7f-9490-476a-90ed-e6a1c9085e4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:59:09 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-1b72159e-73e9-415c-973f-c677a2bac133 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5f:e1:f7,bridge_name='br-int',has_traffic_filtering=True,id=2dd20d7f-9490-476a-90ed-e6a1c9085e4d,network=Network(aff1f95f-fda8-4f0f-8d10-7e3d587e4fda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dd20d7f-94') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:59:09 user nova-compute[74337]: DEBUG os_vif [None req-1b72159e-73e9-415c-973f-c677a2bac133 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:e1:f7,bridge_name='br-int',has_traffic_filtering=True,id=2dd20d7f-9490-476a-90ed-e6a1c9085e4d,network=Network(aff1f95f-fda8-4f0f-8d10-7e3d587e4fda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dd20d7f-94') {{(pid=74337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 21:59:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:59:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2dd20d7f-94, bridge=br-int, if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:59:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:59:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:59:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:59:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ab729482-dae2-41e9-a0a3-6071dd3850b0) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:59:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:59:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:59:09 user nova-compute[74337]: INFO os_vif [None req-1b72159e-73e9-415c-973f-c677a2bac133 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:e1:f7,bridge_name='br-int',has_traffic_filtering=True,id=2dd20d7f-9490-476a-90ed-e6a1c9085e4d,network=Network(aff1f95f-fda8-4f0f-8d10-7e3d587e4fda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dd20d7f-94')
Oct 23 21:59:09 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-1b72159e-73e9-415c-973f-c677a2bac133 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 547c4d4c-e0dd-495a-b83f-98426d0a4a99] Deleting instance files /opt/stack/data/nova/instances/547c4d4c-e0dd-495a-b83f-98426d0a4a99_del
Oct 23 21:59:09 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-1b72159e-73e9-415c-973f-c677a2bac133 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 547c4d4c-e0dd-495a-b83f-98426d0a4a99] Deletion of /opt/stack/data/nova/instances/547c4d4c-e0dd-495a-b83f-98426d0a4a99_del complete
Oct 23 21:59:09 user nova-compute[74337]: INFO nova.compute.manager [None req-1b72159e-73e9-415c-973f-c677a2bac133 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] [instance: 547c4d4c-e0dd-495a-b83f-98426d0a4a99] Took 0.91 seconds to destroy the instance on the hypervisor.
Oct 23 21:59:09 user nova-compute[74337]: DEBUG oslo.service.loopingcall [None req-1b72159e-73e9-415c-973f-c677a2bac133 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74337) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 21:59:09 user nova-compute[74337]: DEBUG nova.compute.manager [-] [instance: 547c4d4c-e0dd-495a-b83f-98426d0a4a99] Deallocating network for instance {{(pid=74337) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 21:59:09 user nova-compute[74337]: DEBUG nova.network.neutron [-] [instance: 547c4d4c-e0dd-495a-b83f-98426d0a4a99] deallocate_for_instance() {{(pid=74337) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 21:59:10 user nova-compute[74337]: DEBUG nova.network.neutron [-] [instance: 547c4d4c-e0dd-495a-b83f-98426d0a4a99] Updating instance_info_cache with network_info: [] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:59:10 user nova-compute[74337]: INFO nova.compute.manager [-] [instance: 547c4d4c-e0dd-495a-b83f-98426d0a4a99] Took 0.53 seconds to deallocate network for instance.
Oct 23 21:59:10 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-1b72159e-73e9-415c-973f-c677a2bac133 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:59:10 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-1b72159e-73e9-415c-973f-c677a2bac133 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:59:10 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-1b72159e-73e9-415c-973f-c677a2bac133 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:59:10 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-1b72159e-73e9-415c-973f-c677a2bac133 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:59:10 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-1b72159e-73e9-415c-973f-c677a2bac133 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.180s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:59:10 user nova-compute[74337]: INFO nova.scheduler.client.report [None req-1b72159e-73e9-415c-973f-c677a2bac133 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Deleted allocations for instance 547c4d4c-e0dd-495a-b83f-98426d0a4a99
Oct 23 21:59:10 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-1b72159e-73e9-415c-973f-c677a2bac133 tempest-ServerActionsTestOtherA-100075475 tempest-ServerActionsTestOtherA-100075475-project-member] Lock "547c4d4c-e0dd-495a-b83f-98426d0a4a99" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.807s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:59:11 user nova-compute[74337]: DEBUG nova.compute.manager [req-921af621-91c4-4dcf-a80e-fd96fe73f6a4 req-b907f34f-014a-4946-a622-7c8f2ce006e2 service nova] [instance: 547c4d4c-e0dd-495a-b83f-98426d0a4a99] Received event network-vif-plugged-2dd20d7f-9490-476a-90ed-e6a1c9085e4d {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:59:11 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-921af621-91c4-4dcf-a80e-fd96fe73f6a4 req-b907f34f-014a-4946-a622-7c8f2ce006e2 service nova] Acquiring lock "547c4d4c-e0dd-495a-b83f-98426d0a4a99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:59:11 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-921af621-91c4-4dcf-a80e-fd96fe73f6a4 req-b907f34f-014a-4946-a622-7c8f2ce006e2 service nova] Lock "547c4d4c-e0dd-495a-b83f-98426d0a4a99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:59:11 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-921af621-91c4-4dcf-a80e-fd96fe73f6a4 req-b907f34f-014a-4946-a622-7c8f2ce006e2 service nova] Lock "547c4d4c-e0dd-495a-b83f-98426d0a4a99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:59:11 user nova-compute[74337]: DEBUG nova.compute.manager [req-921af621-91c4-4dcf-a80e-fd96fe73f6a4 req-b907f34f-014a-4946-a622-7c8f2ce006e2 service nova] [instance: 547c4d4c-e0dd-495a-b83f-98426d0a4a99] No waiting events found dispatching network-vif-plugged-2dd20d7f-9490-476a-90ed-e6a1c9085e4d {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:59:11 user nova-compute[74337]: WARNING nova.compute.manager [req-921af621-91c4-4dcf-a80e-fd96fe73f6a4 req-b907f34f-014a-4946-a622-7c8f2ce006e2 service nova] [instance: 547c4d4c-e0dd-495a-b83f-98426d0a4a99] Received unexpected event network-vif-plugged-2dd20d7f-9490-476a-90ed-e6a1c9085e4d for instance with vm_state deleted and task_state None.
Oct 23 21:59:11 user nova-compute[74337]: DEBUG nova.compute.manager [req-921af621-91c4-4dcf-a80e-fd96fe73f6a4 req-b907f34f-014a-4946-a622-7c8f2ce006e2 service nova] [instance: 547c4d4c-e0dd-495a-b83f-98426d0a4a99] Received event network-vif-deleted-2dd20d7f-9490-476a-90ed-e6a1c9085e4d {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:59:13 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:59:14 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:59:14 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:59:16 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:59:17 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:59:17 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:59:17 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:59:17 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 21:59:18 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:59:18 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Starting heal instance info cache {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 21:59:18 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "refresh_cache-bc4c3e54-a845-4ea8-9ffc-a75d42a51788" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:59:18 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquired lock "refresh_cache-bc4c3e54-a845-4ea8-9ffc-a75d42a51788" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:59:18 user nova-compute[74337]: DEBUG nova.network.neutron [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: bc4c3e54-a845-4ea8-9ffc-a75d42a51788] Forcefully refreshing network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 21:59:19 user nova-compute[74337]: DEBUG nova.network.neutron [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: bc4c3e54-a845-4ea8-9ffc-a75d42a51788] Updating instance_info_cache with network_info: [{"id": "42cc5f62-7b3d-40a1-96f8-29bed95db3de", "address": "fa:16:3e:88:4f:9a", "network": {"id": "5a18e96f-a6eb-4989-9be3-154b54928b03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-507511840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb567547bd4941fb87435a841c9d17c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42cc5f62-7b", "ovs_interfaceid": "42cc5f62-7b3d-40a1-96f8-29bed95db3de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:59:19 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Releasing lock "refresh_cache-bc4c3e54-a845-4ea8-9ffc-a75d42a51788" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:59:19 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: bc4c3e54-a845-4ea8-9ffc-a75d42a51788] Updated the network info_cache for instance {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 21:59:19 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:59:19 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:59:19 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 21:59:19 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 21:59:19 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 21:59:19 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:59:21 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:59:21 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:59:21 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:59:21 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:59:21 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:59:21 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Auditing locally available compute resources for user (node: user) {{(pid=74337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 21:59:21 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 21:59:21 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e903b923-51ac-46f6-9652-1d33c946e25a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:59:21 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e903b923-51ac-46f6-9652-1d33c946e25a/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:59:21 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e903b923-51ac-46f6-9652-1d33c946e25a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:59:21 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:59:21 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e903b923-51ac-46f6-9652-1d33c946e25a/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:59:22 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:59:22 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:59:22 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Hypervisor/Node resource view: name=user free_ram=8501MB free_disk=25.345935821533203GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 21:59:22 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:59:22 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:59:22 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance bc4c3e54-a845-4ea8-9ffc-a75d42a51788 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:59:22 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 0323b854-c7a1-42e8-ad85-1e929caa6e9d has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Oct 23 21:59:22 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance e903b923-51ac-46f6-9652-1d33c946e25a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 21:59:22 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 21:59:22 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 21:59:22 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:59:22 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:59:22 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Compute_service record updated for user:user {{(pid=74337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 21:59:22 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.463s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:59:23 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:59:24 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:59:27 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:59:27 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:59:27 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Cleaning up deleted instances {{(pid=74337) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 23 21:59:27 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] There are 0 instances to clean {{(pid=74337) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 23 21:59:28 user nova-compute[74337]: DEBUG nova.compute.manager [req-453e6e21-a85a-451c-80d8-54ae12541736 req-b0227983-5ab1-46ca-b913-e25e5becdb8b service nova] [instance: bc4c3e54-a845-4ea8-9ffc-a75d42a51788] Received event network-changed-42cc5f62-7b3d-40a1-96f8-29bed95db3de {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:59:28 user nova-compute[74337]: DEBUG nova.compute.manager [req-453e6e21-a85a-451c-80d8-54ae12541736 req-b0227983-5ab1-46ca-b913-e25e5becdb8b service nova] [instance: bc4c3e54-a845-4ea8-9ffc-a75d42a51788] Refreshing instance network info cache due to event network-changed-42cc5f62-7b3d-40a1-96f8-29bed95db3de. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 21:59:28 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-453e6e21-a85a-451c-80d8-54ae12541736 req-b0227983-5ab1-46ca-b913-e25e5becdb8b service nova] Acquiring lock "refresh_cache-bc4c3e54-a845-4ea8-9ffc-a75d42a51788" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:59:28 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-453e6e21-a85a-451c-80d8-54ae12541736 req-b0227983-5ab1-46ca-b913-e25e5becdb8b service nova] Acquired lock "refresh_cache-bc4c3e54-a845-4ea8-9ffc-a75d42a51788" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:59:28 user nova-compute[74337]: DEBUG nova.network.neutron [req-453e6e21-a85a-451c-80d8-54ae12541736 req-b0227983-5ab1-46ca-b913-e25e5becdb8b service nova] [instance: bc4c3e54-a845-4ea8-9ffc-a75d42a51788] Refreshing network info cache for port 42cc5f62-7b3d-40a1-96f8-29bed95db3de {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 21:59:28 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-b1bb8674-474c-46a4-a894-38b15d12c5ce tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Acquiring lock "bc4c3e54-a845-4ea8-9ffc-a75d42a51788" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:59:28 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-b1bb8674-474c-46a4-a894-38b15d12c5ce tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "bc4c3e54-a845-4ea8-9ffc-a75d42a51788" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:59:28 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-b1bb8674-474c-46a4-a894-38b15d12c5ce tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Acquiring lock "bc4c3e54-a845-4ea8-9ffc-a75d42a51788-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:59:28 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-b1bb8674-474c-46a4-a894-38b15d12c5ce tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "bc4c3e54-a845-4ea8-9ffc-a75d42a51788-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:59:28 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-b1bb8674-474c-46a4-a894-38b15d12c5ce tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "bc4c3e54-a845-4ea8-9ffc-a75d42a51788-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:59:28 user nova-compute[74337]: INFO nova.compute.manager [None req-b1bb8674-474c-46a4-a894-38b15d12c5ce tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: bc4c3e54-a845-4ea8-9ffc-a75d42a51788] Terminating instance
Oct 23 21:59:28 user nova-compute[74337]: DEBUG nova.compute.manager [None req-b1bb8674-474c-46a4-a894-38b15d12c5ce tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: bc4c3e54-a845-4ea8-9ffc-a75d42a51788] Start destroying the instance on the hypervisor. {{(pid=74337) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 21:59:28 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:59:28 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:59:28 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:59:28 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:59:28 user nova-compute[74337]: DEBUG nova.network.neutron [req-453e6e21-a85a-451c-80d8-54ae12541736 req-b0227983-5ab1-46ca-b913-e25e5becdb8b service nova] [instance: bc4c3e54-a845-4ea8-9ffc-a75d42a51788] Updated VIF entry in instance network info cache for port 42cc5f62-7b3d-40a1-96f8-29bed95db3de. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 21:59:28 user nova-compute[74337]: DEBUG nova.network.neutron [req-453e6e21-a85a-451c-80d8-54ae12541736 req-b0227983-5ab1-46ca-b913-e25e5becdb8b service nova] [instance: bc4c3e54-a845-4ea8-9ffc-a75d42a51788] Updating instance_info_cache with network_info: [{"id": "42cc5f62-7b3d-40a1-96f8-29bed95db3de", "address": "fa:16:3e:88:4f:9a", "network": {"id": "5a18e96f-a6eb-4989-9be3-154b54928b03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-507511840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb567547bd4941fb87435a841c9d17c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42cc5f62-7b", "ovs_interfaceid": "42cc5f62-7b3d-40a1-96f8-29bed95db3de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:59:28 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-453e6e21-a85a-451c-80d8-54ae12541736 req-b0227983-5ab1-46ca-b913-e25e5becdb8b service nova] Releasing lock "refresh_cache-bc4c3e54-a845-4ea8-9ffc-a75d42a51788" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:59:28 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:59:29 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: bc4c3e54-a845-4ea8-9ffc-a75d42a51788] Instance destroyed successfully.
Oct 23 21:59:29 user nova-compute[74337]: DEBUG nova.objects.instance [None req-b1bb8674-474c-46a4-a894-38b15d12c5ce tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lazy-loading 'resources' on Instance uuid bc4c3e54-a845-4ea8-9ffc-a75d42a51788 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:59:29 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-b1bb8674-474c-46a4-a894-38b15d12c5ce tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:54:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1990079629',display_name='tempest-TestVolumeBootPattern-server-1990079629',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1990079629',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF9NMFNWTU3BVoh69lm2h364CNXP9OO2Sq0+VU67LFY2Y7YP31lo2g7Nqc/sdO6ndxwSu3pXMChCzpRUGVair3TDlV76zriaKktCrpgsBnYg9q7WYnK8Iuk7Ag22Kj7gAw==',key_name='tempest-TestVolumeBootPattern-1223802412',keypairs=<?>,launch_index=0,launched_at=2023-10-23T21:54:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cb567547bd4941fb87435a841c9d17c4',ramdisk_id='',reservation_id='r-inn242p3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-499971371',owner_user_name='tempest-TestVolumeBootPattern-499971371-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T21:54:29Z,user_data=None,user_id='0c3e635e8e5447138a7f2db11695574c',uuid=bc4c3e54-a845-4ea8-9ffc-a75d42a51788,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "42cc5f62-7b3d-40a1-96f8-29bed95db3de", "address": "fa:16:3e:88:4f:9a", "network": {"id": "5a18e96f-a6eb-4989-9be3-154b54928b03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-507511840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb567547bd4941fb87435a841c9d17c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42cc5f62-7b", "ovs_interfaceid": "42cc5f62-7b3d-40a1-96f8-29bed95db3de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 21:59:29 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-b1bb8674-474c-46a4-a894-38b15d12c5ce tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Converting VIF {"id": "42cc5f62-7b3d-40a1-96f8-29bed95db3de", "address": "fa:16:3e:88:4f:9a", "network": {"id": "5a18e96f-a6eb-4989-9be3-154b54928b03", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-507511840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb567547bd4941fb87435a841c9d17c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42cc5f62-7b", "ovs_interfaceid": "42cc5f62-7b3d-40a1-96f8-29bed95db3de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:59:29 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-b1bb8674-474c-46a4-a894-38b15d12c5ce tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:88:4f:9a,bridge_name='br-int',has_traffic_filtering=True,id=42cc5f62-7b3d-40a1-96f8-29bed95db3de,network=Network(5a18e96f-a6eb-4989-9be3-154b54928b03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42cc5f62-7b') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:59:29 user nova-compute[74337]: DEBUG os_vif [None req-b1bb8674-474c-46a4-a894-38b15d12c5ce tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:4f:9a,bridge_name='br-int',has_traffic_filtering=True,id=42cc5f62-7b3d-40a1-96f8-29bed95db3de,network=Network(5a18e96f-a6eb-4989-9be3-154b54928b03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42cc5f62-7b') {{(pid=74337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 21:59:29 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:59:29 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap42cc5f62-7b, bridge=br-int, if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:59:29 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:59:29 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:59:29 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:59:29 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=befbd81a-c57d-4401-8e3f-68802f377593) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:59:29 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:59:29 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:59:29 user nova-compute[74337]: INFO os_vif [None req-b1bb8674-474c-46a4-a894-38b15d12c5ce tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:4f:9a,bridge_name='br-int',has_traffic_filtering=True,id=42cc5f62-7b3d-40a1-96f8-29bed95db3de,network=Network(5a18e96f-a6eb-4989-9be3-154b54928b03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42cc5f62-7b')
Oct 23 21:59:29 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1bb8674-474c-46a4-a894-38b15d12c5ce tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: bc4c3e54-a845-4ea8-9ffc-a75d42a51788] calling os-brick to detach iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 21:59:29 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1bb8674-474c-46a4-a894-38b15d12c5ce tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, {'target_iqn': 'iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MQuLsncZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 21:59:29 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-b1bb8674-474c-46a4-a894-38b15d12c5ce tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 21:59:29 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-b1bb8674-474c-46a4-a894-38b15d12c5ce tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 21:59:29 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-b1bb8674-474c-46a4-a894-38b15d12c5ce tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 21:59:29 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:59:29 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:59:29 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c515d44b-8d16-4489-9659-2fe6b85ce485]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:59:29 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1bb8674-474c-46a4-a894-38b15d12c5ce tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 21:59:29 user nova-compute[74337]: No targets found.
Oct 23 21:59:29 user nova-compute[74337]: iSNS:
Oct 23 21:59:29 user nova-compute[74337]: No targets found.
Oct 23 21:59:29 user nova-compute[74337]: STATIC:
Oct 23 21:59:29 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048
Oct 23 21:59:29 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 21:59:29 user nova-compute[74337]:                 Iface Name: default
Oct 23 21:59:29 user nova-compute[74337]: FIRMWARE:
Oct 23 21:59:29 user nova-compute[74337]: No targets found.
Oct 23 21:59:29 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:59:29 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1bb8674-474c-46a4-a894-38b15d12c5ce tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 21:59:29 user nova-compute[74337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 21:59:29 user nova-compute[74337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 21:59:29 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1bb8674-474c-46a4-a894-38b15d12c5ce tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048', 0)] {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 21:59:29 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:59:29 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:59:29 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[711f078b-4ca5-41b9-9218-4aceee3c95e1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:59:29 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:59:29 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:59:29 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f8d0a0d-a462-4cfe-b938-617c538add87]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:59:29 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1bb8674-474c-46a4-a894-38b15d12c5ce tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 (non-flash)
Oct 23 21:59:29 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 21:59:29 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1bb8674-474c-46a4-a894-38b15d12c5ce tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 (non-flash)
Oct 23 21:59:29 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 21:59:29 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1bb8674-474c-46a4-a894-38b15d12c5ce tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5eec387370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048'): ({'sde'}, set())}) {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 21:59:29 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-b1bb8674-474c-46a4-a894-38b15d12c5ce tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Removing single pathed devices sde {{(pid=74337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 21:59:29 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:59:29 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:59:29 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d665991-760d-4447-9a58-91cfeaa54bea]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:59:29 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:59:29 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:59:29 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d994ba8f-0795-4d44-8b63-97260751eaf1]: (4, ('ok\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:59:29 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-b1bb8674-474c-46a4-a894-38b15d12c5ce tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Flushing IO for device /dev/sde {{(pid=74337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 21:59:29 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:59:29 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:59:29 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c107db15-b115-453d-941d-ace46797a1f1]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:59:29 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-b1bb8674-474c-46a4-a894-38b15d12c5ce tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 21:59:29 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:59:29 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.050s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:59:29 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[867aa0ed-76fa-4901-86f0-bc516b80f058]: (4, ('1', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:59:29 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-b1bb8674-474c-46a4-a894-38b15d12c5ce tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 21:59:29 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-b1bb8674-474c-46a4-a894-38b15d12c5ce tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] SCSI volumes sde have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 21:59:29 user nova-compute[74337]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOe1ccca6a-6b0f5e6f28d48921', '/dev/disk/by-id/scsi-23662306635653666', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_e1ccca6a') {{(pid=85566) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 23 21:59:29 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd92674-2563-40cb-9085-be8bdad10562]: (4, None) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:59:29 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1bb8674-474c-46a4-a894-38b15d12c5ce tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048')] {{(pid=74337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 21:59:29 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:59:29 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:59:29 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ca70715-e2b6-4c54-ad98-2c091cdd0bbd]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:59:29 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1bb8674-474c-46a4-a894-38b15d12c5ce tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:59:29 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 -p 172.16.0.220:3260 --logout {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:59:29 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:59:29 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[29691d3a-b065-45c1-bfef-20034071d313]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:59:29 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1bb8674-474c-46a4-a894-38b15d12c5ce tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048, portal: 172.16.0.220,3260]
Oct 23 21:59:29 user nova-compute[74337]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048, portal: 172.16.0.220,3260] successful.
Oct 23 21:59:29 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:59:29 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 -p 172.16.0.220:3260 --op delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:59:29 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b016c715-febf-41d9-bc8f-2ffbf5bf3048 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:59:29 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a997c7b-91b3-497e-9ea0-f71c45901583]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 21:59:29 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1bb8674-474c-46a4-a894-38b15d12c5ce tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 21:59:29 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-b1bb8674-474c-46a4-a894-38b15d12c5ce tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 21:59:29 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1bb8674-474c-46a4-a894-38b15d12c5ce tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] <== disconnect_volume: return (339ms) None {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 21:59:29 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1bb8674-474c-46a4-a894-38b15d12c5ce tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: bc4c3e54-a845-4ea8-9ffc-a75d42a51788] Disconnected iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 21:59:29 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-b1bb8674-474c-46a4-a894-38b15d12c5ce tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: bc4c3e54-a845-4ea8-9ffc-a75d42a51788] Deleting instance files /opt/stack/data/nova/instances/bc4c3e54-a845-4ea8-9ffc-a75d42a51788_del
Oct 23 21:59:29 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-b1bb8674-474c-46a4-a894-38b15d12c5ce tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: bc4c3e54-a845-4ea8-9ffc-a75d42a51788] Deletion of /opt/stack/data/nova/instances/bc4c3e54-a845-4ea8-9ffc-a75d42a51788_del complete
Oct 23 21:59:29 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:59:29 user nova-compute[74337]: INFO nova.compute.manager [None req-b1bb8674-474c-46a4-a894-38b15d12c5ce tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: bc4c3e54-a845-4ea8-9ffc-a75d42a51788] Took 1.32 seconds to destroy the instance on the hypervisor.
Oct 23 21:59:29 user nova-compute[74337]: DEBUG oslo.service.loopingcall [None req-b1bb8674-474c-46a4-a894-38b15d12c5ce tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74337) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 21:59:29 user nova-compute[74337]: DEBUG nova.compute.manager [-] [instance: bc4c3e54-a845-4ea8-9ffc-a75d42a51788] Deallocating network for instance {{(pid=74337) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 21:59:29 user nova-compute[74337]: DEBUG nova.network.neutron [-] [instance: bc4c3e54-a845-4ea8-9ffc-a75d42a51788] deallocate_for_instance() {{(pid=74337) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 21:59:30 user nova-compute[74337]: DEBUG nova.compute.manager [req-4cab3d3f-da43-47dd-aa08-3b61df15eb93 req-7f286b6e-5e7d-40f3-839d-9630257f175d service nova] [instance: bc4c3e54-a845-4ea8-9ffc-a75d42a51788] Received event network-vif-unplugged-42cc5f62-7b3d-40a1-96f8-29bed95db3de {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:59:30 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-4cab3d3f-da43-47dd-aa08-3b61df15eb93 req-7f286b6e-5e7d-40f3-839d-9630257f175d service nova] Acquiring lock "bc4c3e54-a845-4ea8-9ffc-a75d42a51788-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:59:30 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-4cab3d3f-da43-47dd-aa08-3b61df15eb93 req-7f286b6e-5e7d-40f3-839d-9630257f175d service nova] Lock "bc4c3e54-a845-4ea8-9ffc-a75d42a51788-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:59:30 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-4cab3d3f-da43-47dd-aa08-3b61df15eb93 req-7f286b6e-5e7d-40f3-839d-9630257f175d service nova] Lock "bc4c3e54-a845-4ea8-9ffc-a75d42a51788-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:59:30 user nova-compute[74337]: DEBUG nova.compute.manager [req-4cab3d3f-da43-47dd-aa08-3b61df15eb93 req-7f286b6e-5e7d-40f3-839d-9630257f175d service nova] [instance: bc4c3e54-a845-4ea8-9ffc-a75d42a51788] No waiting events found dispatching network-vif-unplugged-42cc5f62-7b3d-40a1-96f8-29bed95db3de {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:59:30 user nova-compute[74337]: DEBUG nova.compute.manager [req-4cab3d3f-da43-47dd-aa08-3b61df15eb93 req-7f286b6e-5e7d-40f3-839d-9630257f175d service nova] [instance: bc4c3e54-a845-4ea8-9ffc-a75d42a51788] Received event network-vif-unplugged-42cc5f62-7b3d-40a1-96f8-29bed95db3de for instance with task_state deleting. {{(pid=74337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 21:59:30 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:59:30 user nova-compute[74337]: DEBUG nova.network.neutron [-] [instance: bc4c3e54-a845-4ea8-9ffc-a75d42a51788] Updating instance_info_cache with network_info: [] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:59:30 user nova-compute[74337]: INFO nova.compute.manager [-] [instance: bc4c3e54-a845-4ea8-9ffc-a75d42a51788] Took 1.28 seconds to deallocate network for instance.
Oct 23 21:59:30 user nova-compute[74337]: DEBUG nova.compute.manager [req-50e3e681-6da0-47a4-817d-442d815ff0d6 req-128e37ae-662d-487f-b2eb-0316ed6115b5 service nova] [instance: bc4c3e54-a845-4ea8-9ffc-a75d42a51788] Received event network-vif-deleted-42cc5f62-7b3d-40a1-96f8-29bed95db3de {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:59:31 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-02dbc008-3cc6-4bfe-a79e-e052f229e606 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Acquiring lock "999843b2-b757-480b-bd21-bf281954bc46" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:59:31 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-02dbc008-3cc6-4bfe-a79e-e052f229e606 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Lock "999843b2-b757-480b-bd21-bf281954bc46" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:59:31 user nova-compute[74337]: DEBUG nova.compute.manager [None req-02dbc008-3cc6-4bfe-a79e-e052f229e606 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Starting instance... {{(pid=74337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 21:59:31 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-02dbc008-3cc6-4bfe-a79e-e052f229e606 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:59:31 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-02dbc008-3cc6-4bfe-a79e-e052f229e606 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:59:31 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-02dbc008-3cc6-4bfe-a79e-e052f229e606 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 21:59:31 user nova-compute[74337]: INFO nova.compute.claims [None req-02dbc008-3cc6-4bfe-a79e-e052f229e606 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Claim successful on node user
Oct 23 21:59:31 user nova-compute[74337]: INFO nova.compute.manager [None req-b1bb8674-474c-46a4-a894-38b15d12c5ce tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] [instance: bc4c3e54-a845-4ea8-9ffc-a75d42a51788] Took 0.95 seconds to detach 1 volumes for instance.
Oct 23 21:59:31 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-02dbc008-3cc6-4bfe-a79e-e052f229e606 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Refreshing inventories for resource provider dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 23 21:59:31 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-b1bb8674-474c-46a4-a894-38b15d12c5ce tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:59:31 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-02dbc008-3cc6-4bfe-a79e-e052f229e606 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Updating ProviderTree inventory for provider dfcf3942-a432-4293-945b-14b86f57d794 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 23 21:59:31 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-02dbc008-3cc6-4bfe-a79e-e052f229e606 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Updating inventory in ProviderTree for provider dfcf3942-a432-4293-945b-14b86f57d794 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 23 21:59:31 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-02dbc008-3cc6-4bfe-a79e-e052f229e606 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Refreshing aggregate associations for resource provider dfcf3942-a432-4293-945b-14b86f57d794, aggregates: None {{(pid=74337) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 23 21:59:31 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-02dbc008-3cc6-4bfe-a79e-e052f229e606 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Refreshing trait associations for resource provider dfcf3942-a432-4293-945b-14b86f57d794, traits: COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE2,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE42,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_EXTEND,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_TRUSTED_CERTS {{(pid=74337) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 23 21:59:32 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-02dbc008-3cc6-4bfe-a79e-e052f229e606 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:59:32 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-02dbc008-3cc6-4bfe-a79e-e052f229e606 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:59:32 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-02dbc008-3cc6-4bfe-a79e-e052f229e606 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.404s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:59:32 user nova-compute[74337]: DEBUG nova.compute.manager [None req-02dbc008-3cc6-4bfe-a79e-e052f229e606 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Start building networks asynchronously for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 21:59:32 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-b1bb8674-474c-46a4-a894-38b15d12c5ce tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.255s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:59:32 user nova-compute[74337]: DEBUG nova.compute.manager [None req-02dbc008-3cc6-4bfe-a79e-e052f229e606 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Allocating IP information in the background. {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 21:59:32 user nova-compute[74337]: DEBUG nova.network.neutron [None req-02dbc008-3cc6-4bfe-a79e-e052f229e606 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 999843b2-b757-480b-bd21-bf281954bc46] allocate_for_instance() {{(pid=74337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 21:59:32 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-02dbc008-3cc6-4bfe-a79e-e052f229e606 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 21:59:32 user nova-compute[74337]: DEBUG nova.compute.manager [None req-02dbc008-3cc6-4bfe-a79e-e052f229e606 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Start building block device mappings for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 21:59:32 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-b1bb8674-474c-46a4-a894-38b15d12c5ce tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:59:32 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-b1bb8674-474c-46a4-a894-38b15d12c5ce tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:59:32 user nova-compute[74337]: DEBUG nova.policy [None req-02dbc008-3cc6-4bfe-a79e-e052f229e606 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a0f5c4ec386544e1afd2f0a7d1b1c94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80f79dd6954748e4806a568a4127396f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74337) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 21:59:32 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-b1bb8674-474c-46a4-a894-38b15d12c5ce tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.182s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:59:32 user nova-compute[74337]: INFO nova.scheduler.client.report [None req-b1bb8674-474c-46a4-a894-38b15d12c5ce tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Deleted allocations for instance bc4c3e54-a845-4ea8-9ffc-a75d42a51788
Oct 23 21:59:32 user nova-compute[74337]: DEBUG nova.compute.manager [None req-02dbc008-3cc6-4bfe-a79e-e052f229e606 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Start spawning the instance on the hypervisor. {{(pid=74337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 21:59:32 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-02dbc008-3cc6-4bfe-a79e-e052f229e606 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Creating instance directory {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 21:59:32 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-02dbc008-3cc6-4bfe-a79e-e052f229e606 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Creating image(s)
Oct 23 21:59:32 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-02dbc008-3cc6-4bfe-a79e-e052f229e606 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Acquiring lock "/opt/stack/data/nova/instances/999843b2-b757-480b-bd21-bf281954bc46/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:59:32 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-02dbc008-3cc6-4bfe-a79e-e052f229e606 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Lock "/opt/stack/data/nova/instances/999843b2-b757-480b-bd21-bf281954bc46/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:59:32 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-02dbc008-3cc6-4bfe-a79e-e052f229e606 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Lock "/opt/stack/data/nova/instances/999843b2-b757-480b-bd21-bf281954bc46/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:59:32 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-76cf4242-cb9e-43e8-927d-46995dd93978 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Acquiring lock "27710919-a717-42fa-a436-a261d92c1c2a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:59:32 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-76cf4242-cb9e-43e8-927d-46995dd93978 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Lock "27710919-a717-42fa-a436-a261d92c1c2a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:59:32 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-02dbc008-3cc6-4bfe-a79e-e052f229e606 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:59:32 user nova-compute[74337]: DEBUG nova.compute.manager [None req-76cf4242-cb9e-43e8-927d-46995dd93978 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 27710919-a717-42fa-a436-a261d92c1c2a] Starting instance... {{(pid=74337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 21:59:32 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-b1bb8674-474c-46a4-a894-38b15d12c5ce tempest-TestVolumeBootPattern-499971371 tempest-TestVolumeBootPattern-499971371-project-member] Lock "bc4c3e54-a845-4ea8-9ffc-a75d42a51788" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.206s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:59:32 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-76cf4242-cb9e-43e8-927d-46995dd93978 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:59:32 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-76cf4242-cb9e-43e8-927d-46995dd93978 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:59:32 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-76cf4242-cb9e-43e8-927d-46995dd93978 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 21:59:32 user nova-compute[74337]: INFO nova.compute.claims [None req-76cf4242-cb9e-43e8-927d-46995dd93978 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 27710919-a717-42fa-a436-a261d92c1c2a] Claim successful on node user
Oct 23 21:59:32 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-02dbc008-3cc6-4bfe-a79e-e052f229e606 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.200s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:59:32 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-02dbc008-3cc6-4bfe-a79e-e052f229e606 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Acquiring lock "fc7b140751b8c385de81623e40fb09ce09374ab7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:59:32 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-02dbc008-3cc6-4bfe-a79e-e052f229e606 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Lock "fc7b140751b8c385de81623e40fb09ce09374ab7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:59:32 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-02dbc008-3cc6-4bfe-a79e-e052f229e606 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:59:32 user nova-compute[74337]: DEBUG nova.compute.manager [req-488e7cce-1034-4d30-9a5d-384d6d077a0a req-cb740181-0930-4edb-9963-e633cf09d4c2 service nova] [instance: bc4c3e54-a845-4ea8-9ffc-a75d42a51788] Received event network-vif-plugged-42cc5f62-7b3d-40a1-96f8-29bed95db3de {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:59:32 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-488e7cce-1034-4d30-9a5d-384d6d077a0a req-cb740181-0930-4edb-9963-e633cf09d4c2 service nova] Acquiring lock "bc4c3e54-a845-4ea8-9ffc-a75d42a51788-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:59:32 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-488e7cce-1034-4d30-9a5d-384d6d077a0a req-cb740181-0930-4edb-9963-e633cf09d4c2 service nova] Lock "bc4c3e54-a845-4ea8-9ffc-a75d42a51788-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:59:32 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-488e7cce-1034-4d30-9a5d-384d6d077a0a req-cb740181-0930-4edb-9963-e633cf09d4c2 service nova] Lock "bc4c3e54-a845-4ea8-9ffc-a75d42a51788-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:59:32 user nova-compute[74337]: DEBUG nova.compute.manager [req-488e7cce-1034-4d30-9a5d-384d6d077a0a req-cb740181-0930-4edb-9963-e633cf09d4c2 service nova] [instance: bc4c3e54-a845-4ea8-9ffc-a75d42a51788] No waiting events found dispatching network-vif-plugged-42cc5f62-7b3d-40a1-96f8-29bed95db3de {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:59:32 user nova-compute[74337]: WARNING nova.compute.manager [req-488e7cce-1034-4d30-9a5d-384d6d077a0a req-cb740181-0930-4edb-9963-e633cf09d4c2 service nova] [instance: bc4c3e54-a845-4ea8-9ffc-a75d42a51788] Received unexpected event network-vif-plugged-42cc5f62-7b3d-40a1-96f8-29bed95db3de for instance with vm_state deleted and task_state None.
Oct 23 21:59:32 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-02dbc008-3cc6-4bfe-a79e-e052f229e606 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.201s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:59:32 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-02dbc008-3cc6-4bfe-a79e-e052f229e606 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7,backing_fmt=raw /opt/stack/data/nova/instances/999843b2-b757-480b-bd21-bf281954bc46/disk 1073741824 {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:59:32 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-02dbc008-3cc6-4bfe-a79e-e052f229e606 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7,backing_fmt=raw /opt/stack/data/nova/instances/999843b2-b757-480b-bd21-bf281954bc46/disk 1073741824" returned: 0 in 0.065s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:59:32 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-02dbc008-3cc6-4bfe-a79e-e052f229e606 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Lock "fc7b140751b8c385de81623e40fb09ce09374ab7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:59:32 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-02dbc008-3cc6-4bfe-a79e-e052f229e606 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:59:32 user nova-compute[74337]: DEBUG nova.network.neutron [None req-02dbc008-3cc6-4bfe-a79e-e052f229e606 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Successfully created port: 02913be6-773f-402a-a534-d7567aeb5b7a {{(pid=74337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 21:59:32 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-76cf4242-cb9e-43e8-927d-46995dd93978 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:59:32 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-76cf4242-cb9e-43e8-927d-46995dd93978 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:59:32 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-76cf4242-cb9e-43e8-927d-46995dd93978 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.468s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:59:32 user nova-compute[74337]: DEBUG nova.compute.manager [None req-76cf4242-cb9e-43e8-927d-46995dd93978 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 27710919-a717-42fa-a436-a261d92c1c2a] Start building networks asynchronously for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 21:59:33 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-02dbc008-3cc6-4bfe-a79e-e052f229e606 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.184s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:59:33 user nova-compute[74337]: DEBUG nova.virt.disk.api [None req-02dbc008-3cc6-4bfe-a79e-e052f229e606 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Checking if we can resize image /opt/stack/data/nova/instances/999843b2-b757-480b-bd21-bf281954bc46/disk. size=1073741824 {{(pid=74337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 21:59:33 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-02dbc008-3cc6-4bfe-a79e-e052f229e606 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/999843b2-b757-480b-bd21-bf281954bc46/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:59:33 user nova-compute[74337]: DEBUG nova.compute.manager [None req-76cf4242-cb9e-43e8-927d-46995dd93978 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 27710919-a717-42fa-a436-a261d92c1c2a] Allocating IP information in the background. {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 21:59:33 user nova-compute[74337]: DEBUG nova.network.neutron [None req-76cf4242-cb9e-43e8-927d-46995dd93978 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 27710919-a717-42fa-a436-a261d92c1c2a] allocate_for_instance() {{(pid=74337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 21:59:33 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-76cf4242-cb9e-43e8-927d-46995dd93978 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 27710919-a717-42fa-a436-a261d92c1c2a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 21:59:33 user nova-compute[74337]: DEBUG nova.compute.manager [None req-76cf4242-cb9e-43e8-927d-46995dd93978 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 27710919-a717-42fa-a436-a261d92c1c2a] Start building block device mappings for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 21:59:33 user nova-compute[74337]: DEBUG nova.policy [None req-76cf4242-cb9e-43e8-927d-46995dd93978 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a0f5c4ec386544e1afd2f0a7d1b1c94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80f79dd6954748e4806a568a4127396f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74337) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 21:59:33 user nova-compute[74337]: DEBUG nova.compute.manager [None req-76cf4242-cb9e-43e8-927d-46995dd93978 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 27710919-a717-42fa-a436-a261d92c1c2a] Start spawning the instance on the hypervisor. {{(pid=74337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 21:59:33 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-76cf4242-cb9e-43e8-927d-46995dd93978 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 27710919-a717-42fa-a436-a261d92c1c2a] Creating instance directory {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 21:59:33 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-76cf4242-cb9e-43e8-927d-46995dd93978 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 27710919-a717-42fa-a436-a261d92c1c2a] Creating image(s)
Oct 23 21:59:33 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-76cf4242-cb9e-43e8-927d-46995dd93978 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Acquiring lock "/opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:59:33 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-76cf4242-cb9e-43e8-927d-46995dd93978 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Lock "/opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:59:33 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-76cf4242-cb9e-43e8-927d-46995dd93978 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Lock "/opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:59:33 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-76cf4242-cb9e-43e8-927d-46995dd93978 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:59:33 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-02dbc008-3cc6-4bfe-a79e-e052f229e606 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/999843b2-b757-480b-bd21-bf281954bc46/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:59:33 user nova-compute[74337]: DEBUG nova.virt.disk.api [None req-02dbc008-3cc6-4bfe-a79e-e052f229e606 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Cannot resize image /opt/stack/data/nova/instances/999843b2-b757-480b-bd21-bf281954bc46/disk to a smaller size. {{(pid=74337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 21:59:33 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-02dbc008-3cc6-4bfe-a79e-e052f229e606 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Created local disks {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 21:59:33 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-02dbc008-3cc6-4bfe-a79e-e052f229e606 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Ensure instance console log exists: /opt/stack/data/nova/instances/999843b2-b757-480b-bd21-bf281954bc46/console.log {{(pid=74337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 21:59:33 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-02dbc008-3cc6-4bfe-a79e-e052f229e606 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:59:33 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-02dbc008-3cc6-4bfe-a79e-e052f229e606 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:59:33 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-02dbc008-3cc6-4bfe-a79e-e052f229e606 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:59:33 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-76cf4242-cb9e-43e8-927d-46995dd93978 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.204s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:59:33 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-76cf4242-cb9e-43e8-927d-46995dd93978 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Acquiring lock "fc7b140751b8c385de81623e40fb09ce09374ab7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:59:33 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-76cf4242-cb9e-43e8-927d-46995dd93978 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Lock "fc7b140751b8c385de81623e40fb09ce09374ab7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:59:33 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-76cf4242-cb9e-43e8-927d-46995dd93978 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:59:33 user nova-compute[74337]: DEBUG nova.network.neutron [None req-02dbc008-3cc6-4bfe-a79e-e052f229e606 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Successfully updated port: 02913be6-773f-402a-a534-d7567aeb5b7a {{(pid=74337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 21:59:33 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:59:33 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74337) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 23 21:59:33 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-02dbc008-3cc6-4bfe-a79e-e052f229e606 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Acquiring lock "refresh_cache-999843b2-b757-480b-bd21-bf281954bc46" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:59:33 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-02dbc008-3cc6-4bfe-a79e-e052f229e606 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Acquired lock "refresh_cache-999843b2-b757-480b-bd21-bf281954bc46" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:59:33 user nova-compute[74337]: DEBUG nova.network.neutron [None req-02dbc008-3cc6-4bfe-a79e-e052f229e606 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Building network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 21:59:33 user nova-compute[74337]: DEBUG nova.compute.manager [req-ef33e6a7-7708-4ccc-81cc-ddfdacedef55 req-14717ed7-7153-4d80-bda5-dab21f888c4e service nova] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Received event network-changed-02913be6-773f-402a-a534-d7567aeb5b7a {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:59:33 user nova-compute[74337]: DEBUG nova.compute.manager [req-ef33e6a7-7708-4ccc-81cc-ddfdacedef55 req-14717ed7-7153-4d80-bda5-dab21f888c4e service nova] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Refreshing instance network info cache due to event network-changed-02913be6-773f-402a-a534-d7567aeb5b7a. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 21:59:33 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ef33e6a7-7708-4ccc-81cc-ddfdacedef55 req-14717ed7-7153-4d80-bda5-dab21f888c4e service nova] Acquiring lock "refresh_cache-999843b2-b757-480b-bd21-bf281954bc46" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:59:33 user nova-compute[74337]: DEBUG nova.network.neutron [None req-02dbc008-3cc6-4bfe-a79e-e052f229e606 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Instance cache missing network info. {{(pid=74337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 21:59:33 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-76cf4242-cb9e-43e8-927d-46995dd93978 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.202s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:59:33 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-76cf4242-cb9e-43e8-927d-46995dd93978 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7,backing_fmt=raw /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk 1073741824 {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:59:33 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-76cf4242-cb9e-43e8-927d-46995dd93978 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7,backing_fmt=raw /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk 1073741824" returned: 0 in 0.050s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:59:33 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-76cf4242-cb9e-43e8-927d-46995dd93978 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Lock "fc7b140751b8c385de81623e40fb09ce09374ab7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:59:33 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-76cf4242-cb9e-43e8-927d-46995dd93978 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:59:33 user nova-compute[74337]: DEBUG nova.network.neutron [None req-76cf4242-cb9e-43e8-927d-46995dd93978 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 27710919-a717-42fa-a436-a261d92c1c2a] Successfully created port: 85905b2e-3e09-4236-8fe7-ea6c31324ae6 {{(pid=74337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 21:59:33 user nova-compute[74337]: DEBUG nova.network.neutron [None req-02dbc008-3cc6-4bfe-a79e-e052f229e606 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Updating instance_info_cache with network_info: [{"id": "02913be6-773f-402a-a534-d7567aeb5b7a", "address": "fa:16:3e:a2:cd:9d", "network": {"id": "122fdd20-8bf5-4374-b50c-82e5dc8684db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-81475496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80f79dd6954748e4806a568a4127396f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02913be6-77", "ovs_interfaceid": "02913be6-773f-402a-a534-d7567aeb5b7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:59:33 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-02dbc008-3cc6-4bfe-a79e-e052f229e606 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Releasing lock "refresh_cache-999843b2-b757-480b-bd21-bf281954bc46" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:59:33 user nova-compute[74337]: DEBUG nova.compute.manager [None req-02dbc008-3cc6-4bfe-a79e-e052f229e606 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Instance network_info: |[{"id": "02913be6-773f-402a-a534-d7567aeb5b7a", "address": "fa:16:3e:a2:cd:9d", "network": {"id": "122fdd20-8bf5-4374-b50c-82e5dc8684db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-81475496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80f79dd6954748e4806a568a4127396f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02913be6-77", "ovs_interfaceid": "02913be6-773f-402a-a534-d7567aeb5b7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 21:59:33 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ef33e6a7-7708-4ccc-81cc-ddfdacedef55 req-14717ed7-7153-4d80-bda5-dab21f888c4e service nova] Acquired lock "refresh_cache-999843b2-b757-480b-bd21-bf281954bc46" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:59:33 user nova-compute[74337]: DEBUG nova.network.neutron [req-ef33e6a7-7708-4ccc-81cc-ddfdacedef55 req-14717ed7-7153-4d80-bda5-dab21f888c4e service nova] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Refreshing network info cache for port 02913be6-773f-402a-a534-d7567aeb5b7a {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 21:59:33 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-02dbc008-3cc6-4bfe-a79e-e052f229e606 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Start _get_guest_xml network_info=[{"id": "02913be6-773f-402a-a534-d7567aeb5b7a", "address": "fa:16:3e:a2:cd:9d", "network": {"id": "122fdd20-8bf5-4374-b50c-82e5dc8684db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-81475496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80f79dd6954748e4806a568a4127396f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02913be6-77", "ovs_interfaceid": "02913be6-773f-402a-a534-d7567aeb5b7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T21:29:21Z,direct_url=<?>,disk_format='qcow2',id=d859d89d-998d-4109-b26a-0d6e28152932,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ff43462300764979a6cf688444336a56',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T21:29:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'image_id': 'd859d89d-998d-4109-b26a-0d6e28152932'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 21:59:33 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-76cf4242-cb9e-43e8-927d-46995dd93978 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.199s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:59:33 user nova-compute[74337]: DEBUG nova.virt.disk.api [None req-76cf4242-cb9e-43e8-927d-46995dd93978 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Checking if we can resize image /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk. size=1073741824 {{(pid=74337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 21:59:33 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-76cf4242-cb9e-43e8-927d-46995dd93978 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:59:33 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-02dbc008-3cc6-4bfe-a79e-e052f229e606 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:59:33 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-02dbc008-3cc6-4bfe-a79e-e052f229e606 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:59:33 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-02dbc008-3cc6-4bfe-a79e-e052f229e606 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 21:59:33 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-02dbc008-3cc6-4bfe-a79e-e052f229e606 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] CPU controller missing on host. {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 21:59:33 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-02dbc008-3cc6-4bfe-a79e-e052f229e606 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 21:59:33 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-02dbc008-3cc6-4bfe-a79e-e052f229e606 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] CPU controller found on host. {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 21:59:33 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-02dbc008-3cc6-4bfe-a79e-e052f229e606 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 21:59:33 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-02dbc008-3cc6-4bfe-a79e-e052f229e606 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T21:29:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T21:29:21Z,direct_url=<?>,disk_format='qcow2',id=d859d89d-998d-4109-b26a-0d6e28152932,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ff43462300764979a6cf688444336a56',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T21:29:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 21:59:33 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-02dbc008-3cc6-4bfe-a79e-e052f229e606 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Flavor limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 21:59:33 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-02dbc008-3cc6-4bfe-a79e-e052f229e606 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Image limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 21:59:33 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-02dbc008-3cc6-4bfe-a79e-e052f229e606 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Flavor pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 21:59:33 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-02dbc008-3cc6-4bfe-a79e-e052f229e606 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Image pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 21:59:33 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-02dbc008-3cc6-4bfe-a79e-e052f229e606 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 21:59:33 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-02dbc008-3cc6-4bfe-a79e-e052f229e606 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 21:59:33 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-02dbc008-3cc6-4bfe-a79e-e052f229e606 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 21:59:33 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-02dbc008-3cc6-4bfe-a79e-e052f229e606 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Got 1 possible topologies {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 21:59:33 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-02dbc008-3cc6-4bfe-a79e-e052f229e606 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 21:59:33 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-02dbc008-3cc6-4bfe-a79e-e052f229e606 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 21:59:33 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-02dbc008-3cc6-4bfe-a79e-e052f229e606 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:59:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1406033408',display_name='tempest-ServerRescueNegativeTestJSON-server-1406033408',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1406033408',id=41,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='80f79dd6954748e4806a568a4127396f',ramdisk_id='',reservation_id='r-e3hxkbx8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2089412853',owner_user_name='tempest-ServerRescueNegativeTestJSON-2089412853-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:59:32Z,user_data=None,user_id='a0f5c4ec386544e1afd2f0a7d1b1c94f',uuid=999843b2-b757-480b-bd21-bf281954bc46,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "02913be6-773f-402a-a534-d7567aeb5b7a", "address": "fa:16:3e:a2:cd:9d", "network": {"id": "122fdd20-8bf5-4374-b50c-82e5dc8684db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-81475496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80f79dd6954748e4806a568a4127396f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02913be6-77", "ovs_interfaceid": "02913be6-773f-402a-a534-d7567aeb5b7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 21:59:33 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-02dbc008-3cc6-4bfe-a79e-e052f229e606 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Converting VIF {"id": "02913be6-773f-402a-a534-d7567aeb5b7a", "address": "fa:16:3e:a2:cd:9d", "network": {"id": "122fdd20-8bf5-4374-b50c-82e5dc8684db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-81475496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80f79dd6954748e4806a568a4127396f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02913be6-77", "ovs_interfaceid": "02913be6-773f-402a-a534-d7567aeb5b7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:59:33 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-02dbc008-3cc6-4bfe-a79e-e052f229e606 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:cd:9d,bridge_name='br-int',has_traffic_filtering=True,id=02913be6-773f-402a-a534-d7567aeb5b7a,network=Network(122fdd20-8bf5-4374-b50c-82e5dc8684db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02913be6-77') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:59:34 user nova-compute[74337]: DEBUG nova.objects.instance [None req-02dbc008-3cc6-4bfe-a79e-e052f229e606 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Lazy-loading 'pci_devices' on Instance uuid 999843b2-b757-480b-bd21-bf281954bc46 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:59:34 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:59:34 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-02dbc008-3cc6-4bfe-a79e-e052f229e606 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 999843b2-b757-480b-bd21-bf281954bc46] End _get_guest_xml xml=<domain type="kvm">
Oct 23 21:59:34 user nova-compute[74337]:   <uuid>999843b2-b757-480b-bd21-bf281954bc46</uuid>
Oct 23 21:59:34 user nova-compute[74337]:   <name>instance-00000029</name>
Oct 23 21:59:34 user nova-compute[74337]:   <memory>524288</memory>
Oct 23 21:59:34 user nova-compute[74337]:   <vcpu>1</vcpu>
Oct 23 21:59:34 user nova-compute[74337]:   <metadata>
Oct 23 21:59:34 user nova-compute[74337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 21:59:34 user nova-compute[74337]:       <nova:package version="0.0.0"/>
Oct 23 21:59:34 user nova-compute[74337]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1406033408</nova:name>
Oct 23 21:59:34 user nova-compute[74337]:       <nova:creationTime>2023-10-23 21:59:33</nova:creationTime>
Oct 23 21:59:34 user nova-compute[74337]:       <nova:flavor name="m1.tiny">
Oct 23 21:59:34 user nova-compute[74337]:         <nova:memory>512</nova:memory>
Oct 23 21:59:34 user nova-compute[74337]:         <nova:disk>1</nova:disk>
Oct 23 21:59:34 user nova-compute[74337]:         <nova:swap>0</nova:swap>
Oct 23 21:59:34 user nova-compute[74337]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 21:59:34 user nova-compute[74337]:         <nova:vcpus>1</nova:vcpus>
Oct 23 21:59:34 user nova-compute[74337]:       </nova:flavor>
Oct 23 21:59:34 user nova-compute[74337]:       <nova:owner>
Oct 23 21:59:34 user nova-compute[74337]:         <nova:user uuid="a0f5c4ec386544e1afd2f0a7d1b1c94f">tempest-ServerRescueNegativeTestJSON-2089412853-project-member</nova:user>
Oct 23 21:59:34 user nova-compute[74337]:         <nova:project uuid="80f79dd6954748e4806a568a4127396f">tempest-ServerRescueNegativeTestJSON-2089412853</nova:project>
Oct 23 21:59:34 user nova-compute[74337]:       </nova:owner>
Oct 23 21:59:34 user nova-compute[74337]:       <nova:root type="image" uuid="d859d89d-998d-4109-b26a-0d6e28152932"/>
Oct 23 21:59:34 user nova-compute[74337]:       <nova:ports>
Oct 23 21:59:34 user nova-compute[74337]:         <nova:port uuid="02913be6-773f-402a-a534-d7567aeb5b7a">
Oct 23 21:59:34 user nova-compute[74337]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 23 21:59:34 user nova-compute[74337]:         </nova:port>
Oct 23 21:59:34 user nova-compute[74337]:       </nova:ports>
Oct 23 21:59:34 user nova-compute[74337]:     </nova:instance>
Oct 23 21:59:34 user nova-compute[74337]:   </metadata>
Oct 23 21:59:34 user nova-compute[74337]:   <sysinfo type="smbios">
Oct 23 21:59:34 user nova-compute[74337]:     <system>
Oct 23 21:59:34 user nova-compute[74337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 21:59:34 user nova-compute[74337]:       <entry name="product">OpenStack Nova</entry>
Oct 23 21:59:34 user nova-compute[74337]:       <entry name="version">0.0.0</entry>
Oct 23 21:59:34 user nova-compute[74337]:       <entry name="serial">999843b2-b757-480b-bd21-bf281954bc46</entry>
Oct 23 21:59:34 user nova-compute[74337]:       <entry name="uuid">999843b2-b757-480b-bd21-bf281954bc46</entry>
Oct 23 21:59:34 user nova-compute[74337]:       <entry name="family">Virtual Machine</entry>
Oct 23 21:59:34 user nova-compute[74337]:     </system>
Oct 23 21:59:34 user nova-compute[74337]:   </sysinfo>
Oct 23 21:59:34 user nova-compute[74337]:   <os>
Oct 23 21:59:34 user nova-compute[74337]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 21:59:34 user nova-compute[74337]:     <boot dev="hd"/>
Oct 23 21:59:34 user nova-compute[74337]:     <smbios mode="sysinfo"/>
Oct 23 21:59:34 user nova-compute[74337]:   </os>
Oct 23 21:59:34 user nova-compute[74337]:   <features>
Oct 23 21:59:34 user nova-compute[74337]:     <acpi/>
Oct 23 21:59:34 user nova-compute[74337]:     <apic/>
Oct 23 21:59:34 user nova-compute[74337]:     <vmcoreinfo/>
Oct 23 21:59:34 user nova-compute[74337]:   </features>
Oct 23 21:59:34 user nova-compute[74337]:   <clock offset="utc">
Oct 23 21:59:34 user nova-compute[74337]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 21:59:34 user nova-compute[74337]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 21:59:34 user nova-compute[74337]:     <timer name="hpet" present="no"/>
Oct 23 21:59:34 user nova-compute[74337]:   </clock>
Oct 23 21:59:34 user nova-compute[74337]:   <cpu mode="custom" match="exact">
Oct 23 21:59:34 user nova-compute[74337]:     <model>Nehalem</model>
Oct 23 21:59:34 user nova-compute[74337]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 21:59:34 user nova-compute[74337]:   </cpu>
Oct 23 21:59:34 user nova-compute[74337]:   <devices>
Oct 23 21:59:34 user nova-compute[74337]:     <disk type="file" device="disk">
Oct 23 21:59:34 user nova-compute[74337]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 21:59:34 user nova-compute[74337]:       <source file="/opt/stack/data/nova/instances/999843b2-b757-480b-bd21-bf281954bc46/disk"/>
Oct 23 21:59:34 user nova-compute[74337]:       <target dev="vda" bus="virtio"/>
Oct 23 21:59:34 user nova-compute[74337]:     </disk>
Oct 23 21:59:34 user nova-compute[74337]:     <interface type="ethernet">
Oct 23 21:59:34 user nova-compute[74337]:       <mac address="fa:16:3e:a2:cd:9d"/>
Oct 23 21:59:34 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:59:34 user nova-compute[74337]:       <mtu size="1442"/>
Oct 23 21:59:34 user nova-compute[74337]:       <target dev="tap02913be6-77"/>
Oct 23 21:59:34 user nova-compute[74337]:     </interface>
Oct 23 21:59:34 user nova-compute[74337]:     <serial type="pty">
Oct 23 21:59:34 user nova-compute[74337]:       <log file="/opt/stack/data/nova/instances/999843b2-b757-480b-bd21-bf281954bc46/console.log" append="off"/>
Oct 23 21:59:34 user nova-compute[74337]:     </serial>
Oct 23 21:59:34 user nova-compute[74337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 21:59:34 user nova-compute[74337]:     <video>
Oct 23 21:59:34 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:59:34 user nova-compute[74337]:     </video>
Oct 23 21:59:34 user nova-compute[74337]:     <rng model="virtio">
Oct 23 21:59:34 user nova-compute[74337]:       <backend model="random">/dev/urandom</backend>
Oct 23 21:59:34 user nova-compute[74337]:     </rng>
Oct 23 21:59:34 user nova-compute[74337]:     <controller type="usb" index="0" model="none"/>
Oct 23 21:59:34 user nova-compute[74337]:     <memballoon model="virtio">
Oct 23 21:59:34 user nova-compute[74337]:       <stats period="10"/>
Oct 23 21:59:34 user nova-compute[74337]:     </memballoon>
Oct 23 21:59:34 user nova-compute[74337]:   </devices>
Oct 23 21:59:34 user nova-compute[74337]: </domain>
Oct 23 21:59:34 user nova-compute[74337]:  {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 21:59:34 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-02dbc008-3cc6-4bfe-a79e-e052f229e606 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:59:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1406033408',display_name='tempest-ServerRescueNegativeTestJSON-server-1406033408',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1406033408',id=41,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='80f79dd6954748e4806a568a4127396f',ramdisk_id='',reservation_id='r-e3hxkbx8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2089412853',owner_user_name='tempest-ServerRescueNegativeTestJSON-2089412853-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:59:32Z,user_data=None,user_id='a0f5c4ec386544e1afd2f0a7d1b1c94f',uuid=999843b2-b757-480b-bd21-bf281954bc46,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "02913be6-773f-402a-a534-d7567aeb5b7a", "address": "fa:16:3e:a2:cd:9d", "network": {"id": "122fdd20-8bf5-4374-b50c-82e5dc8684db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-81475496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80f79dd6954748e4806a568a4127396f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02913be6-77", "ovs_interfaceid": "02913be6-773f-402a-a534-d7567aeb5b7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 21:59:34 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-02dbc008-3cc6-4bfe-a79e-e052f229e606 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Converting VIF {"id": "02913be6-773f-402a-a534-d7567aeb5b7a", "address": "fa:16:3e:a2:cd:9d", "network": {"id": "122fdd20-8bf5-4374-b50c-82e5dc8684db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-81475496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80f79dd6954748e4806a568a4127396f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02913be6-77", "ovs_interfaceid": "02913be6-773f-402a-a534-d7567aeb5b7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:59:34 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-02dbc008-3cc6-4bfe-a79e-e052f229e606 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:cd:9d,bridge_name='br-int',has_traffic_filtering=True,id=02913be6-773f-402a-a534-d7567aeb5b7a,network=Network(122fdd20-8bf5-4374-b50c-82e5dc8684db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02913be6-77') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:59:34 user nova-compute[74337]: DEBUG os_vif [None req-02dbc008-3cc6-4bfe-a79e-e052f229e606 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:cd:9d,bridge_name='br-int',has_traffic_filtering=True,id=02913be6-773f-402a-a534-d7567aeb5b7a,network=Network(122fdd20-8bf5-4374-b50c-82e5dc8684db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02913be6-77') {{(pid=74337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 21:59:34 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:59:34 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:59:34 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 21:59:34 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:59:34 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7e14e31f-a48a-5c47-a938-4915c6bdce4a', '_type': 'linux-noop'}}, row=False) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:59:34 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:59:34 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:59:34 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:59:34 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap02913be6-77, may_exist=True, interface_attrs={}) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:59:34 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap02913be6-77, col_values=(('qos', UUID('2959809b-3ca9-4e01-9fa7-78deec3d5499')),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:59:34 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap02913be6-77, col_values=(('external_ids', {'iface-id': '02913be6-773f-402a-a534-d7567aeb5b7a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a2:cd:9d', 'vm-uuid': '999843b2-b757-480b-bd21-bf281954bc46'}),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:59:34 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:59:34 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:59:34 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-76cf4242-cb9e-43e8-927d-46995dd93978 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:59:34 user nova-compute[74337]: DEBUG nova.virt.disk.api [None req-76cf4242-cb9e-43e8-927d-46995dd93978 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Cannot resize image /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk to a smaller size. {{(pid=74337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 21:59:34 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-76cf4242-cb9e-43e8-927d-46995dd93978 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 27710919-a717-42fa-a436-a261d92c1c2a] Created local disks {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 21:59:34 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-76cf4242-cb9e-43e8-927d-46995dd93978 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 27710919-a717-42fa-a436-a261d92c1c2a] Ensure instance console log exists: /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/console.log {{(pid=74337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 21:59:34 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-76cf4242-cb9e-43e8-927d-46995dd93978 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:59:34 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-76cf4242-cb9e-43e8-927d-46995dd93978 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:59:34 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-76cf4242-cb9e-43e8-927d-46995dd93978 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:59:34 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:59:34 user nova-compute[74337]: INFO os_vif [None req-02dbc008-3cc6-4bfe-a79e-e052f229e606 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:cd:9d,bridge_name='br-int',has_traffic_filtering=True,id=02913be6-773f-402a-a534-d7567aeb5b7a,network=Network(122fdd20-8bf5-4374-b50c-82e5dc8684db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02913be6-77')
Oct 23 21:59:34 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-02dbc008-3cc6-4bfe-a79e-e052f229e606 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] No BDM found with device name vda, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 21:59:34 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-02dbc008-3cc6-4bfe-a79e-e052f229e606 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] No VIF found with MAC fa:16:3e:a2:cd:9d, not building metadata {{(pid=74337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 21:59:34 user nova-compute[74337]: DEBUG nova.network.neutron [None req-76cf4242-cb9e-43e8-927d-46995dd93978 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 27710919-a717-42fa-a436-a261d92c1c2a] Successfully updated port: 85905b2e-3e09-4236-8fe7-ea6c31324ae6 {{(pid=74337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 21:59:34 user nova-compute[74337]: DEBUG nova.network.neutron [req-ef33e6a7-7708-4ccc-81cc-ddfdacedef55 req-14717ed7-7153-4d80-bda5-dab21f888c4e service nova] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Updated VIF entry in instance network info cache for port 02913be6-773f-402a-a534-d7567aeb5b7a. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 21:59:34 user nova-compute[74337]: DEBUG nova.network.neutron [req-ef33e6a7-7708-4ccc-81cc-ddfdacedef55 req-14717ed7-7153-4d80-bda5-dab21f888c4e service nova] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Updating instance_info_cache with network_info: [{"id": "02913be6-773f-402a-a534-d7567aeb5b7a", "address": "fa:16:3e:a2:cd:9d", "network": {"id": "122fdd20-8bf5-4374-b50c-82e5dc8684db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-81475496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80f79dd6954748e4806a568a4127396f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02913be6-77", "ovs_interfaceid": "02913be6-773f-402a-a534-d7567aeb5b7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:59:34 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-76cf4242-cb9e-43e8-927d-46995dd93978 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Acquiring lock "refresh_cache-27710919-a717-42fa-a436-a261d92c1c2a" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:59:34 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-76cf4242-cb9e-43e8-927d-46995dd93978 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Acquired lock "refresh_cache-27710919-a717-42fa-a436-a261d92c1c2a" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:59:34 user nova-compute[74337]: DEBUG nova.network.neutron [None req-76cf4242-cb9e-43e8-927d-46995dd93978 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 27710919-a717-42fa-a436-a261d92c1c2a] Building network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 21:59:34 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ef33e6a7-7708-4ccc-81cc-ddfdacedef55 req-14717ed7-7153-4d80-bda5-dab21f888c4e service nova] Releasing lock "refresh_cache-999843b2-b757-480b-bd21-bf281954bc46" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:59:34 user nova-compute[74337]: DEBUG nova.network.neutron [None req-76cf4242-cb9e-43e8-927d-46995dd93978 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 27710919-a717-42fa-a436-a261d92c1c2a] Instance cache missing network info. {{(pid=74337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 21:59:34 user nova-compute[74337]: DEBUG nova.compute.manager [req-6b41b7dd-7ac5-4b37-8acb-80f9c9935061 req-43abb345-8931-4543-816d-99ff0da45136 service nova] [instance: 27710919-a717-42fa-a436-a261d92c1c2a] Received event network-changed-85905b2e-3e09-4236-8fe7-ea6c31324ae6 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:59:34 user nova-compute[74337]: DEBUG nova.compute.manager [req-6b41b7dd-7ac5-4b37-8acb-80f9c9935061 req-43abb345-8931-4543-816d-99ff0da45136 service nova] [instance: 27710919-a717-42fa-a436-a261d92c1c2a] Refreshing instance network info cache due to event network-changed-85905b2e-3e09-4236-8fe7-ea6c31324ae6. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 21:59:34 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-6b41b7dd-7ac5-4b37-8acb-80f9c9935061 req-43abb345-8931-4543-816d-99ff0da45136 service nova] Acquiring lock "refresh_cache-27710919-a717-42fa-a436-a261d92c1c2a" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:59:34 user nova-compute[74337]: DEBUG nova.network.neutron [None req-76cf4242-cb9e-43e8-927d-46995dd93978 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 27710919-a717-42fa-a436-a261d92c1c2a] Updating instance_info_cache with network_info: [{"id": "85905b2e-3e09-4236-8fe7-ea6c31324ae6", "address": "fa:16:3e:50:cd:90", "network": {"id": "122fdd20-8bf5-4374-b50c-82e5dc8684db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-81475496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80f79dd6954748e4806a568a4127396f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85905b2e-3e", "ovs_interfaceid": "85905b2e-3e09-4236-8fe7-ea6c31324ae6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:59:34 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-76cf4242-cb9e-43e8-927d-46995dd93978 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Releasing lock "refresh_cache-27710919-a717-42fa-a436-a261d92c1c2a" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:59:34 user nova-compute[74337]: DEBUG nova.compute.manager [None req-76cf4242-cb9e-43e8-927d-46995dd93978 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 27710919-a717-42fa-a436-a261d92c1c2a] Instance network_info: |[{"id": "85905b2e-3e09-4236-8fe7-ea6c31324ae6", "address": "fa:16:3e:50:cd:90", "network": {"id": "122fdd20-8bf5-4374-b50c-82e5dc8684db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-81475496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80f79dd6954748e4806a568a4127396f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85905b2e-3e", "ovs_interfaceid": "85905b2e-3e09-4236-8fe7-ea6c31324ae6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 21:59:34 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-6b41b7dd-7ac5-4b37-8acb-80f9c9935061 req-43abb345-8931-4543-816d-99ff0da45136 service nova] Acquired lock "refresh_cache-27710919-a717-42fa-a436-a261d92c1c2a" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:59:34 user nova-compute[74337]: DEBUG nova.network.neutron [req-6b41b7dd-7ac5-4b37-8acb-80f9c9935061 req-43abb345-8931-4543-816d-99ff0da45136 service nova] [instance: 27710919-a717-42fa-a436-a261d92c1c2a] Refreshing network info cache for port 85905b2e-3e09-4236-8fe7-ea6c31324ae6 {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 21:59:34 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-76cf4242-cb9e-43e8-927d-46995dd93978 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 27710919-a717-42fa-a436-a261d92c1c2a] Start _get_guest_xml network_info=[{"id": "85905b2e-3e09-4236-8fe7-ea6c31324ae6", "address": "fa:16:3e:50:cd:90", "network": {"id": "122fdd20-8bf5-4374-b50c-82e5dc8684db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-81475496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80f79dd6954748e4806a568a4127396f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85905b2e-3e", "ovs_interfaceid": "85905b2e-3e09-4236-8fe7-ea6c31324ae6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T21:29:21Z,direct_url=<?>,disk_format='qcow2',id=d859d89d-998d-4109-b26a-0d6e28152932,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ff43462300764979a6cf688444336a56',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T21:29:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'image_id': 'd859d89d-998d-4109-b26a-0d6e28152932'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 21:59:34 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-76cf4242-cb9e-43e8-927d-46995dd93978 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:59:34 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-76cf4242-cb9e-43e8-927d-46995dd93978 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:59:34 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-76cf4242-cb9e-43e8-927d-46995dd93978 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 21:59:34 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-76cf4242-cb9e-43e8-927d-46995dd93978 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] CPU controller missing on host. {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 21:59:34 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-76cf4242-cb9e-43e8-927d-46995dd93978 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 21:59:34 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-76cf4242-cb9e-43e8-927d-46995dd93978 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] CPU controller found on host. {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 21:59:34 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-76cf4242-cb9e-43e8-927d-46995dd93978 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 21:59:34 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-76cf4242-cb9e-43e8-927d-46995dd93978 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T21:29:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T21:29:21Z,direct_url=<?>,disk_format='qcow2',id=d859d89d-998d-4109-b26a-0d6e28152932,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ff43462300764979a6cf688444336a56',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T21:29:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 21:59:34 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-76cf4242-cb9e-43e8-927d-46995dd93978 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Flavor limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 21:59:34 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-76cf4242-cb9e-43e8-927d-46995dd93978 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Image limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 21:59:34 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-76cf4242-cb9e-43e8-927d-46995dd93978 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Flavor pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 21:59:34 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-76cf4242-cb9e-43e8-927d-46995dd93978 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Image pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 21:59:34 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-76cf4242-cb9e-43e8-927d-46995dd93978 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 21:59:34 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-76cf4242-cb9e-43e8-927d-46995dd93978 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 21:59:34 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-76cf4242-cb9e-43e8-927d-46995dd93978 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 21:59:34 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-76cf4242-cb9e-43e8-927d-46995dd93978 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Got 1 possible topologies {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 21:59:34 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-76cf4242-cb9e-43e8-927d-46995dd93978 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 21:59:34 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-76cf4242-cb9e-43e8-927d-46995dd93978 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 21:59:34 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-76cf4242-cb9e-43e8-927d-46995dd93978 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:59:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-728469709',display_name='tempest-ServerRescueNegativeTestJSON-server-728469709',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-728469709',id=42,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='80f79dd6954748e4806a568a4127396f',ramdisk_id='',reservation_id='r-s6fq6tqs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2089412853',owner_user_name='tempest-ServerRescueNegativeTestJSON-2089412853-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:59:33Z,user_data=None,user_id='a0f5c4ec386544e1afd2f0a7d1b1c94f',uuid=27710919-a717-42fa-a436-a261d92c1c2a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85905b2e-3e09-4236-8fe7-ea6c31324ae6", "address": "fa:16:3e:50:cd:90", "network": {"id": "122fdd20-8bf5-4374-b50c-82e5dc8684db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-81475496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80f79dd6954748e4806a568a4127396f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85905b2e-3e", "ovs_interfaceid": "85905b2e-3e09-4236-8fe7-ea6c31324ae6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 21:59:34 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-76cf4242-cb9e-43e8-927d-46995dd93978 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Converting VIF {"id": "85905b2e-3e09-4236-8fe7-ea6c31324ae6", "address": "fa:16:3e:50:cd:90", "network": {"id": "122fdd20-8bf5-4374-b50c-82e5dc8684db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-81475496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80f79dd6954748e4806a568a4127396f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85905b2e-3e", "ovs_interfaceid": "85905b2e-3e09-4236-8fe7-ea6c31324ae6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:59:34 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-76cf4242-cb9e-43e8-927d-46995dd93978 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:cd:90,bridge_name='br-int',has_traffic_filtering=True,id=85905b2e-3e09-4236-8fe7-ea6c31324ae6,network=Network(122fdd20-8bf5-4374-b50c-82e5dc8684db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85905b2e-3e') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:59:34 user nova-compute[74337]: DEBUG nova.objects.instance [None req-76cf4242-cb9e-43e8-927d-46995dd93978 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Lazy-loading 'pci_devices' on Instance uuid 27710919-a717-42fa-a436-a261d92c1c2a {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:59:34 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-76cf4242-cb9e-43e8-927d-46995dd93978 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 27710919-a717-42fa-a436-a261d92c1c2a] End _get_guest_xml xml=<domain type="kvm">
Oct 23 21:59:34 user nova-compute[74337]:   <uuid>27710919-a717-42fa-a436-a261d92c1c2a</uuid>
Oct 23 21:59:34 user nova-compute[74337]:   <name>instance-0000002a</name>
Oct 23 21:59:34 user nova-compute[74337]:   <memory>524288</memory>
Oct 23 21:59:34 user nova-compute[74337]:   <vcpu>1</vcpu>
Oct 23 21:59:34 user nova-compute[74337]:   <metadata>
Oct 23 21:59:34 user nova-compute[74337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 21:59:34 user nova-compute[74337]:       <nova:package version="0.0.0"/>
Oct 23 21:59:34 user nova-compute[74337]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-728469709</nova:name>
Oct 23 21:59:34 user nova-compute[74337]:       <nova:creationTime>2023-10-23 21:59:34</nova:creationTime>
Oct 23 21:59:34 user nova-compute[74337]:       <nova:flavor name="m1.tiny">
Oct 23 21:59:34 user nova-compute[74337]:         <nova:memory>512</nova:memory>
Oct 23 21:59:34 user nova-compute[74337]:         <nova:disk>1</nova:disk>
Oct 23 21:59:34 user nova-compute[74337]:         <nova:swap>0</nova:swap>
Oct 23 21:59:34 user nova-compute[74337]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 21:59:34 user nova-compute[74337]:         <nova:vcpus>1</nova:vcpus>
Oct 23 21:59:34 user nova-compute[74337]:       </nova:flavor>
Oct 23 21:59:34 user nova-compute[74337]:       <nova:owner>
Oct 23 21:59:34 user nova-compute[74337]:         <nova:user uuid="a0f5c4ec386544e1afd2f0a7d1b1c94f">tempest-ServerRescueNegativeTestJSON-2089412853-project-member</nova:user>
Oct 23 21:59:34 user nova-compute[74337]:         <nova:project uuid="80f79dd6954748e4806a568a4127396f">tempest-ServerRescueNegativeTestJSON-2089412853</nova:project>
Oct 23 21:59:34 user nova-compute[74337]:       </nova:owner>
Oct 23 21:59:34 user nova-compute[74337]:       <nova:root type="image" uuid="d859d89d-998d-4109-b26a-0d6e28152932"/>
Oct 23 21:59:34 user nova-compute[74337]:       <nova:ports>
Oct 23 21:59:34 user nova-compute[74337]:         <nova:port uuid="85905b2e-3e09-4236-8fe7-ea6c31324ae6">
Oct 23 21:59:34 user nova-compute[74337]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 23 21:59:34 user nova-compute[74337]:         </nova:port>
Oct 23 21:59:34 user nova-compute[74337]:       </nova:ports>
Oct 23 21:59:34 user nova-compute[74337]:     </nova:instance>
Oct 23 21:59:34 user nova-compute[74337]:   </metadata>
Oct 23 21:59:34 user nova-compute[74337]:   <sysinfo type="smbios">
Oct 23 21:59:34 user nova-compute[74337]:     <system>
Oct 23 21:59:34 user nova-compute[74337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 21:59:34 user nova-compute[74337]:       <entry name="product">OpenStack Nova</entry>
Oct 23 21:59:34 user nova-compute[74337]:       <entry name="version">0.0.0</entry>
Oct 23 21:59:34 user nova-compute[74337]:       <entry name="serial">27710919-a717-42fa-a436-a261d92c1c2a</entry>
Oct 23 21:59:34 user nova-compute[74337]:       <entry name="uuid">27710919-a717-42fa-a436-a261d92c1c2a</entry>
Oct 23 21:59:34 user nova-compute[74337]:       <entry name="family">Virtual Machine</entry>
Oct 23 21:59:34 user nova-compute[74337]:     </system>
Oct 23 21:59:34 user nova-compute[74337]:   </sysinfo>
Oct 23 21:59:34 user nova-compute[74337]:   <os>
Oct 23 21:59:34 user nova-compute[74337]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 21:59:34 user nova-compute[74337]:     <boot dev="hd"/>
Oct 23 21:59:34 user nova-compute[74337]:     <smbios mode="sysinfo"/>
Oct 23 21:59:34 user nova-compute[74337]:   </os>
Oct 23 21:59:34 user nova-compute[74337]:   <features>
Oct 23 21:59:34 user nova-compute[74337]:     <acpi/>
Oct 23 21:59:34 user nova-compute[74337]:     <apic/>
Oct 23 21:59:34 user nova-compute[74337]:     <vmcoreinfo/>
Oct 23 21:59:34 user nova-compute[74337]:   </features>
Oct 23 21:59:34 user nova-compute[74337]:   <clock offset="utc">
Oct 23 21:59:34 user nova-compute[74337]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 21:59:34 user nova-compute[74337]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 21:59:34 user nova-compute[74337]:     <timer name="hpet" present="no"/>
Oct 23 21:59:34 user nova-compute[74337]:   </clock>
Oct 23 21:59:34 user nova-compute[74337]:   <cpu mode="custom" match="exact">
Oct 23 21:59:34 user nova-compute[74337]:     <model>Nehalem</model>
Oct 23 21:59:34 user nova-compute[74337]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 21:59:34 user nova-compute[74337]:   </cpu>
Oct 23 21:59:34 user nova-compute[74337]:   <devices>
Oct 23 21:59:34 user nova-compute[74337]:     <disk type="file" device="disk">
Oct 23 21:59:34 user nova-compute[74337]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 21:59:34 user nova-compute[74337]:       <source file="/opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk"/>
Oct 23 21:59:34 user nova-compute[74337]:       <target dev="vda" bus="virtio"/>
Oct 23 21:59:34 user nova-compute[74337]:     </disk>
Oct 23 21:59:34 user nova-compute[74337]:     <interface type="ethernet">
Oct 23 21:59:34 user nova-compute[74337]:       <mac address="fa:16:3e:50:cd:90"/>
Oct 23 21:59:34 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:59:34 user nova-compute[74337]:       <mtu size="1442"/>
Oct 23 21:59:34 user nova-compute[74337]:       <target dev="tap85905b2e-3e"/>
Oct 23 21:59:34 user nova-compute[74337]:     </interface>
Oct 23 21:59:34 user nova-compute[74337]:     <serial type="pty">
Oct 23 21:59:34 user nova-compute[74337]:       <log file="/opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/console.log" append="off"/>
Oct 23 21:59:34 user nova-compute[74337]:     </serial>
Oct 23 21:59:34 user nova-compute[74337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 21:59:34 user nova-compute[74337]:     <video>
Oct 23 21:59:34 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:59:34 user nova-compute[74337]:     </video>
Oct 23 21:59:34 user nova-compute[74337]:     <rng model="virtio">
Oct 23 21:59:34 user nova-compute[74337]:       <backend model="random">/dev/urandom</backend>
Oct 23 21:59:34 user nova-compute[74337]:     </rng>
Oct 23 21:59:34 user nova-compute[74337]:     <controller type="usb" index="0" model="none"/>
Oct 23 21:59:34 user nova-compute[74337]:     <memballoon model="virtio">
Oct 23 21:59:34 user nova-compute[74337]:       <stats period="10"/>
Oct 23 21:59:34 user nova-compute[74337]:     </memballoon>
Oct 23 21:59:34 user nova-compute[74337]:   </devices>
Oct 23 21:59:34 user nova-compute[74337]: </domain>
Oct 23 21:59:34 user nova-compute[74337]:  {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 21:59:34 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-76cf4242-cb9e-43e8-927d-46995dd93978 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:59:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-728469709',display_name='tempest-ServerRescueNegativeTestJSON-server-728469709',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-728469709',id=42,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='80f79dd6954748e4806a568a4127396f',ramdisk_id='',reservation_id='r-s6fq6tqs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2089412853',owner_user_name='tempest-ServerRescueNegativeTestJSON-2089412853-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:59:33Z,user_data=None,user_id='a0f5c4ec386544e1afd2f0a7d1b1c94f',uuid=27710919-a717-42fa-a436-a261d92c1c2a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85905b2e-3e09-4236-8fe7-ea6c31324ae6", "address": "fa:16:3e:50:cd:90", "network": {"id": "122fdd20-8bf5-4374-b50c-82e5dc8684db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-81475496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80f79dd6954748e4806a568a4127396f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85905b2e-3e", "ovs_interfaceid": "85905b2e-3e09-4236-8fe7-ea6c31324ae6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 21:59:34 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-76cf4242-cb9e-43e8-927d-46995dd93978 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Converting VIF {"id": "85905b2e-3e09-4236-8fe7-ea6c31324ae6", "address": "fa:16:3e:50:cd:90", "network": {"id": "122fdd20-8bf5-4374-b50c-82e5dc8684db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-81475496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80f79dd6954748e4806a568a4127396f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85905b2e-3e", "ovs_interfaceid": "85905b2e-3e09-4236-8fe7-ea6c31324ae6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:59:34 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-76cf4242-cb9e-43e8-927d-46995dd93978 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:cd:90,bridge_name='br-int',has_traffic_filtering=True,id=85905b2e-3e09-4236-8fe7-ea6c31324ae6,network=Network(122fdd20-8bf5-4374-b50c-82e5dc8684db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85905b2e-3e') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:59:34 user nova-compute[74337]: DEBUG os_vif [None req-76cf4242-cb9e-43e8-927d-46995dd93978 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:cd:90,bridge_name='br-int',has_traffic_filtering=True,id=85905b2e-3e09-4236-8fe7-ea6c31324ae6,network=Network(122fdd20-8bf5-4374-b50c-82e5dc8684db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85905b2e-3e') {{(pid=74337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 21:59:34 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:59:34 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:59:34 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 21:59:34 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:59:34 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8486f1e3-7e9b-55ad-884a-8f476663907d', '_type': 'linux-noop'}}, row=False) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:59:34 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:59:34 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:59:34 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:59:34 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap85905b2e-3e, may_exist=True, interface_attrs={}) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:59:34 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap85905b2e-3e, col_values=(('qos', UUID('ea13b280-0c26-4a52-9211-6e8b5f0b5b57')),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:59:34 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap85905b2e-3e, col_values=(('external_ids', {'iface-id': '85905b2e-3e09-4236-8fe7-ea6c31324ae6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:50:cd:90', 'vm-uuid': '27710919-a717-42fa-a436-a261d92c1c2a'}),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:59:34 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:59:34 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:59:34 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:59:34 user nova-compute[74337]: INFO os_vif [None req-76cf4242-cb9e-43e8-927d-46995dd93978 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:cd:90,bridge_name='br-int',has_traffic_filtering=True,id=85905b2e-3e09-4236-8fe7-ea6c31324ae6,network=Network(122fdd20-8bf5-4374-b50c-82e5dc8684db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85905b2e-3e')
Oct 23 21:59:34 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-76cf4242-cb9e-43e8-927d-46995dd93978 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] No BDM found with device name vda, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 21:59:34 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-76cf4242-cb9e-43e8-927d-46995dd93978 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] No VIF found with MAC fa:16:3e:50:cd:90, not building metadata {{(pid=74337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 21:59:35 user nova-compute[74337]: DEBUG nova.network.neutron [req-6b41b7dd-7ac5-4b37-8acb-80f9c9935061 req-43abb345-8931-4543-816d-99ff0da45136 service nova] [instance: 27710919-a717-42fa-a436-a261d92c1c2a] Updated VIF entry in instance network info cache for port 85905b2e-3e09-4236-8fe7-ea6c31324ae6. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 21:59:35 user nova-compute[74337]: DEBUG nova.network.neutron [req-6b41b7dd-7ac5-4b37-8acb-80f9c9935061 req-43abb345-8931-4543-816d-99ff0da45136 service nova] [instance: 27710919-a717-42fa-a436-a261d92c1c2a] Updating instance_info_cache with network_info: [{"id": "85905b2e-3e09-4236-8fe7-ea6c31324ae6", "address": "fa:16:3e:50:cd:90", "network": {"id": "122fdd20-8bf5-4374-b50c-82e5dc8684db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-81475496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80f79dd6954748e4806a568a4127396f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85905b2e-3e", "ovs_interfaceid": "85905b2e-3e09-4236-8fe7-ea6c31324ae6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:59:35 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-6b41b7dd-7ac5-4b37-8acb-80f9c9935061 req-43abb345-8931-4543-816d-99ff0da45136 service nova] Releasing lock "refresh_cache-27710919-a717-42fa-a436-a261d92c1c2a" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:59:35 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:59:35 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:59:35 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:59:35 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:59:35 user nova-compute[74337]: DEBUG nova.compute.manager [req-2254f389-5873-40a0-b23b-c0c571500910 req-8ddc6c02-e4a3-4036-a7c9-0e37c2c08155 service nova] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Received event network-vif-plugged-02913be6-773f-402a-a534-d7567aeb5b7a {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:59:35 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-2254f389-5873-40a0-b23b-c0c571500910 req-8ddc6c02-e4a3-4036-a7c9-0e37c2c08155 service nova] Acquiring lock "999843b2-b757-480b-bd21-bf281954bc46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:59:35 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-2254f389-5873-40a0-b23b-c0c571500910 req-8ddc6c02-e4a3-4036-a7c9-0e37c2c08155 service nova] Lock "999843b2-b757-480b-bd21-bf281954bc46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:59:35 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-2254f389-5873-40a0-b23b-c0c571500910 req-8ddc6c02-e4a3-4036-a7c9-0e37c2c08155 service nova] Lock "999843b2-b757-480b-bd21-bf281954bc46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:59:35 user nova-compute[74337]: DEBUG nova.compute.manager [req-2254f389-5873-40a0-b23b-c0c571500910 req-8ddc6c02-e4a3-4036-a7c9-0e37c2c08155 service nova] [instance: 999843b2-b757-480b-bd21-bf281954bc46] No waiting events found dispatching network-vif-plugged-02913be6-773f-402a-a534-d7567aeb5b7a {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:59:35 user nova-compute[74337]: WARNING nova.compute.manager [req-2254f389-5873-40a0-b23b-c0c571500910 req-8ddc6c02-e4a3-4036-a7c9-0e37c2c08155 service nova] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Received unexpected event network-vif-plugged-02913be6-773f-402a-a534-d7567aeb5b7a for instance with vm_state building and task_state spawning.
Oct 23 21:59:36 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:59:36 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:59:36 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:59:36 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:59:36 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:59:36 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:59:36 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:59:37 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:59:38 user nova-compute[74337]: DEBUG nova.compute.manager [req-f8344223-0508-4653-a02f-0bc0d9541411 req-57ba82bf-ede2-4365-8990-c27fad01a25f service nova] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Received event network-vif-plugged-02913be6-773f-402a-a534-d7567aeb5b7a {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:59:38 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-f8344223-0508-4653-a02f-0bc0d9541411 req-57ba82bf-ede2-4365-8990-c27fad01a25f service nova] Acquiring lock "999843b2-b757-480b-bd21-bf281954bc46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:59:38 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-f8344223-0508-4653-a02f-0bc0d9541411 req-57ba82bf-ede2-4365-8990-c27fad01a25f service nova] Lock "999843b2-b757-480b-bd21-bf281954bc46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:59:38 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-f8344223-0508-4653-a02f-0bc0d9541411 req-57ba82bf-ede2-4365-8990-c27fad01a25f service nova] Lock "999843b2-b757-480b-bd21-bf281954bc46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:59:38 user nova-compute[74337]: DEBUG nova.compute.manager [req-f8344223-0508-4653-a02f-0bc0d9541411 req-57ba82bf-ede2-4365-8990-c27fad01a25f service nova] [instance: 999843b2-b757-480b-bd21-bf281954bc46] No waiting events found dispatching network-vif-plugged-02913be6-773f-402a-a534-d7567aeb5b7a {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:59:38 user nova-compute[74337]: WARNING nova.compute.manager [req-f8344223-0508-4653-a02f-0bc0d9541411 req-57ba82bf-ede2-4365-8990-c27fad01a25f service nova] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Received unexpected event network-vif-plugged-02913be6-773f-402a-a534-d7567aeb5b7a for instance with vm_state building and task_state spawning.
Oct 23 21:59:38 user nova-compute[74337]: DEBUG nova.compute.manager [req-f8344223-0508-4653-a02f-0bc0d9541411 req-57ba82bf-ede2-4365-8990-c27fad01a25f service nova] [instance: 27710919-a717-42fa-a436-a261d92c1c2a] Received event network-vif-plugged-85905b2e-3e09-4236-8fe7-ea6c31324ae6 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:59:38 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-f8344223-0508-4653-a02f-0bc0d9541411 req-57ba82bf-ede2-4365-8990-c27fad01a25f service nova] Acquiring lock "27710919-a717-42fa-a436-a261d92c1c2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:59:38 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-f8344223-0508-4653-a02f-0bc0d9541411 req-57ba82bf-ede2-4365-8990-c27fad01a25f service nova] Lock "27710919-a717-42fa-a436-a261d92c1c2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:59:38 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-f8344223-0508-4653-a02f-0bc0d9541411 req-57ba82bf-ede2-4365-8990-c27fad01a25f service nova] Lock "27710919-a717-42fa-a436-a261d92c1c2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:59:38 user nova-compute[74337]: DEBUG nova.compute.manager [req-f8344223-0508-4653-a02f-0bc0d9541411 req-57ba82bf-ede2-4365-8990-c27fad01a25f service nova] [instance: 27710919-a717-42fa-a436-a261d92c1c2a] No waiting events found dispatching network-vif-plugged-85905b2e-3e09-4236-8fe7-ea6c31324ae6 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:59:38 user nova-compute[74337]: WARNING nova.compute.manager [req-f8344223-0508-4653-a02f-0bc0d9541411 req-57ba82bf-ede2-4365-8990-c27fad01a25f service nova] [instance: 27710919-a717-42fa-a436-a261d92c1c2a] Received unexpected event network-vif-plugged-85905b2e-3e09-4236-8fe7-ea6c31324ae6 for instance with vm_state building and task_state spawning.
Oct 23 21:59:38 user nova-compute[74337]: DEBUG nova.compute.manager [req-f8344223-0508-4653-a02f-0bc0d9541411 req-57ba82bf-ede2-4365-8990-c27fad01a25f service nova] [instance: 27710919-a717-42fa-a436-a261d92c1c2a] Received event network-vif-plugged-85905b2e-3e09-4236-8fe7-ea6c31324ae6 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:59:38 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-f8344223-0508-4653-a02f-0bc0d9541411 req-57ba82bf-ede2-4365-8990-c27fad01a25f service nova] Acquiring lock "27710919-a717-42fa-a436-a261d92c1c2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:59:38 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-f8344223-0508-4653-a02f-0bc0d9541411 req-57ba82bf-ede2-4365-8990-c27fad01a25f service nova] Lock "27710919-a717-42fa-a436-a261d92c1c2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:59:38 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-f8344223-0508-4653-a02f-0bc0d9541411 req-57ba82bf-ede2-4365-8990-c27fad01a25f service nova] Lock "27710919-a717-42fa-a436-a261d92c1c2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:59:38 user nova-compute[74337]: DEBUG nova.compute.manager [req-f8344223-0508-4653-a02f-0bc0d9541411 req-57ba82bf-ede2-4365-8990-c27fad01a25f service nova] [instance: 27710919-a717-42fa-a436-a261d92c1c2a] No waiting events found dispatching network-vif-plugged-85905b2e-3e09-4236-8fe7-ea6c31324ae6 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:59:38 user nova-compute[74337]: WARNING nova.compute.manager [req-f8344223-0508-4653-a02f-0bc0d9541411 req-57ba82bf-ede2-4365-8990-c27fad01a25f service nova] [instance: 27710919-a717-42fa-a436-a261d92c1c2a] Received unexpected event network-vif-plugged-85905b2e-3e09-4236-8fe7-ea6c31324ae6 for instance with vm_state building and task_state spawning.
Oct 23 21:59:38 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:59:39 user nova-compute[74337]: DEBUG nova.compute.manager [None req-02dbc008-3cc6-4bfe-a79e-e052f229e606 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Instance event wait completed in 0 seconds for  {{(pid=74337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 21:59:39 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-02dbc008-3cc6-4bfe-a79e-e052f229e606 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Guest created on hypervisor {{(pid=74337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 21:59:39 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Instance spawned successfully.
Oct 23 21:59:39 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-02dbc008-3cc6-4bfe-a79e-e052f229e606 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 21:59:39 user nova-compute[74337]: DEBUG nova.compute.manager [None req-76cf4242-cb9e-43e8-927d-46995dd93978 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 27710919-a717-42fa-a436-a261d92c1c2a] Instance event wait completed in 0 seconds for  {{(pid=74337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 21:59:39 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-76cf4242-cb9e-43e8-927d-46995dd93978 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 27710919-a717-42fa-a436-a261d92c1c2a] Guest created on hypervisor {{(pid=74337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 21:59:39 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: 27710919-a717-42fa-a436-a261d92c1c2a] Instance spawned successfully.
Oct 23 21:59:39 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-76cf4242-cb9e-43e8-927d-46995dd93978 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 27710919-a717-42fa-a436-a261d92c1c2a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 21:59:39 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-02dbc008-3cc6-4bfe-a79e-e052f229e606 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Found default for hw_cdrom_bus of ide {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:59:39 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-02dbc008-3cc6-4bfe-a79e-e052f229e606 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Found default for hw_disk_bus of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:59:39 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-02dbc008-3cc6-4bfe-a79e-e052f229e606 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Found default for hw_input_bus of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:59:39 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-02dbc008-3cc6-4bfe-a79e-e052f229e606 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Found default for hw_pointer_model of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:59:39 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-02dbc008-3cc6-4bfe-a79e-e052f229e606 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Found default for hw_video_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:59:39 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-02dbc008-3cc6-4bfe-a79e-e052f229e606 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Found default for hw_vif_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:59:39 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-76cf4242-cb9e-43e8-927d-46995dd93978 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 27710919-a717-42fa-a436-a261d92c1c2a] Found default for hw_cdrom_bus of ide {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:59:39 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-76cf4242-cb9e-43e8-927d-46995dd93978 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 27710919-a717-42fa-a436-a261d92c1c2a] Found default for hw_disk_bus of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:59:39 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-76cf4242-cb9e-43e8-927d-46995dd93978 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 27710919-a717-42fa-a436-a261d92c1c2a] Found default for hw_input_bus of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:59:39 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-76cf4242-cb9e-43e8-927d-46995dd93978 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 27710919-a717-42fa-a436-a261d92c1c2a] Found default for hw_pointer_model of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:59:39 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-76cf4242-cb9e-43e8-927d-46995dd93978 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 27710919-a717-42fa-a436-a261d92c1c2a] Found default for hw_video_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:59:39 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-76cf4242-cb9e-43e8-927d-46995dd93978 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 27710919-a717-42fa-a436-a261d92c1c2a] Found default for hw_vif_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:59:39 user nova-compute[74337]: INFO nova.compute.manager [None req-02dbc008-3cc6-4bfe-a79e-e052f229e606 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Took 7.07 seconds to spawn the instance on the hypervisor.
Oct 23 21:59:39 user nova-compute[74337]: DEBUG nova.compute.manager [None req-02dbc008-3cc6-4bfe-a79e-e052f229e606 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Checking state {{(pid=74337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 21:59:39 user nova-compute[74337]: INFO nova.compute.manager [None req-76cf4242-cb9e-43e8-927d-46995dd93978 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 27710919-a717-42fa-a436-a261d92c1c2a] Took 6.22 seconds to spawn the instance on the hypervisor.
Oct 23 21:59:39 user nova-compute[74337]: DEBUG nova.compute.manager [None req-76cf4242-cb9e-43e8-927d-46995dd93978 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 27710919-a717-42fa-a436-a261d92c1c2a] Checking state {{(pid=74337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 21:59:39 user nova-compute[74337]: INFO nova.compute.manager [None req-02dbc008-3cc6-4bfe-a79e-e052f229e606 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Took 7.83 seconds to build instance.
Oct 23 21:59:39 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-02dbc008-3cc6-4bfe-a79e-e052f229e606 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Lock "999843b2-b757-480b-bd21-bf281954bc46" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.933s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:59:39 user nova-compute[74337]: INFO nova.compute.manager [None req-76cf4242-cb9e-43e8-927d-46995dd93978 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 27710919-a717-42fa-a436-a261d92c1c2a] Took 7.06 seconds to build instance.
Oct 23 21:59:39 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-76cf4242-cb9e-43e8-927d-46995dd93978 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Lock "27710919-a717-42fa-a436-a261d92c1c2a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.180s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:59:39 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:59:40 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Acquiring lock "9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:59:40 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Lock "9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:59:40 user nova-compute[74337]: DEBUG nova.compute.manager [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] Starting instance... {{(pid=74337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 21:59:40 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:59:40 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:59:40 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 21:59:40 user nova-compute[74337]: INFO nova.compute.claims [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] Claim successful on node user
Oct 23 21:59:40 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:59:40 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:59:40 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.291s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:59:40 user nova-compute[74337]: DEBUG nova.compute.manager [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] Start building networks asynchronously for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 21:59:40 user nova-compute[74337]: DEBUG nova.compute.manager [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] Allocating IP information in the background. {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 21:59:40 user nova-compute[74337]: DEBUG nova.network.neutron [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] allocate_for_instance() {{(pid=74337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 21:59:40 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 21:59:40 user nova-compute[74337]: DEBUG nova.compute.manager [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] Start building block device mappings for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 21:59:41 user nova-compute[74337]: DEBUG nova.policy [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5a20c05457014209a86f285fcc9dd506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965415a9973d4714aa49a64d34b232a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74337) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 21:59:41 user nova-compute[74337]: DEBUG nova.compute.manager [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] Start spawning the instance on the hypervisor. {{(pid=74337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 21:59:41 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] Creating instance directory {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 21:59:41 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] Creating image(s)
Oct 23 21:59:41 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Acquiring lock "/opt/stack/data/nova/instances/9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:59:41 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Lock "/opt/stack/data/nova/instances/9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:59:41 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Lock "/opt/stack/data/nova/instances/9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.010s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:59:41 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Acquiring lock "e9997274d7c27ef78f57166543564fb929aa06fd" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:59:41 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Lock "e9997274d7c27ef78f57166543564fb929aa06fd" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:59:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9997274d7c27ef78f57166543564fb929aa06fd.part --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:59:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9997274d7c27ef78f57166543564fb929aa06fd.part --force-share --output=json" returned: 0 in 0.206s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:59:41 user nova-compute[74337]: DEBUG nova.virt.images [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] b94d675a-138f-488a-92c5-1d5cd6e463aa was qcow2, converting to raw {{(pid=74337) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 23 21:59:41 user nova-compute[74337]: DEBUG nova.privsep.utils [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74337) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 23 21:59:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e9997274d7c27ef78f57166543564fb929aa06fd.part /opt/stack/data/nova/instances/_base/e9997274d7c27ef78f57166543564fb929aa06fd.converted {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:59:42 user nova-compute[74337]: DEBUG nova.network.neutron [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] Successfully created port: 28c36a5b-ff7d-4426-9b09-6114a8c43fe5 {{(pid=74337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 21:59:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e9997274d7c27ef78f57166543564fb929aa06fd.part /opt/stack/data/nova/instances/_base/e9997274d7c27ef78f57166543564fb929aa06fd.converted" returned: 0 in 0.213s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:59:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9997274d7c27ef78f57166543564fb929aa06fd.converted --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:59:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9997274d7c27ef78f57166543564fb929aa06fd.converted --force-share --output=json" returned: 0 in 0.204s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:59:42 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Lock "e9997274d7c27ef78f57166543564fb929aa06fd" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.228s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:59:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9997274d7c27ef78f57166543564fb929aa06fd --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:59:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9997274d7c27ef78f57166543564fb929aa06fd --force-share --output=json" returned: 0 in 0.206s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:59:42 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Acquiring lock "e9997274d7c27ef78f57166543564fb929aa06fd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:59:42 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Lock "e9997274d7c27ef78f57166543564fb929aa06fd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:59:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9997274d7c27ef78f57166543564fb929aa06fd --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:59:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9997274d7c27ef78f57166543564fb929aa06fd --force-share --output=json" returned: 0 in 0.196s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:59:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9997274d7c27ef78f57166543564fb929aa06fd,backing_fmt=raw /opt/stack/data/nova/instances/9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c/disk 1073741824 {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:59:42 user nova-compute[74337]: DEBUG nova.network.neutron [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] Successfully updated port: 28c36a5b-ff7d-4426-9b09-6114a8c43fe5 {{(pid=74337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 21:59:42 user nova-compute[74337]: DEBUG nova.compute.manager [req-0db65dfd-9d5d-4d03-bc08-1c002f161b47 req-c4a529ab-6dae-4d8b-9cac-cd05bf90db28 service nova] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] Received event network-changed-28c36a5b-ff7d-4426-9b09-6114a8c43fe5 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:59:42 user nova-compute[74337]: DEBUG nova.compute.manager [req-0db65dfd-9d5d-4d03-bc08-1c002f161b47 req-c4a529ab-6dae-4d8b-9cac-cd05bf90db28 service nova] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] Refreshing instance network info cache due to event network-changed-28c36a5b-ff7d-4426-9b09-6114a8c43fe5. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 21:59:42 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-0db65dfd-9d5d-4d03-bc08-1c002f161b47 req-c4a529ab-6dae-4d8b-9cac-cd05bf90db28 service nova] Acquiring lock "refresh_cache-9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:59:42 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-0db65dfd-9d5d-4d03-bc08-1c002f161b47 req-c4a529ab-6dae-4d8b-9cac-cd05bf90db28 service nova] Acquired lock "refresh_cache-9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:59:42 user nova-compute[74337]: DEBUG nova.network.neutron [req-0db65dfd-9d5d-4d03-bc08-1c002f161b47 req-c4a529ab-6dae-4d8b-9cac-cd05bf90db28 service nova] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] Refreshing network info cache for port 28c36a5b-ff7d-4426-9b09-6114a8c43fe5 {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 21:59:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9997274d7c27ef78f57166543564fb929aa06fd,backing_fmt=raw /opt/stack/data/nova/instances/9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c/disk 1073741824" returned: 0 in 0.103s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:59:42 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Acquiring lock "refresh_cache-9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 21:59:42 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Lock "e9997274d7c27ef78f57166543564fb929aa06fd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.308s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:59:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9997274d7c27ef78f57166543564fb929aa06fd --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:59:43 user nova-compute[74337]: DEBUG nova.network.neutron [req-0db65dfd-9d5d-4d03-bc08-1c002f161b47 req-c4a529ab-6dae-4d8b-9cac-cd05bf90db28 service nova] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] Instance cache missing network info. {{(pid=74337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 21:59:43 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9997274d7c27ef78f57166543564fb929aa06fd --force-share --output=json" returned: 0 in 0.197s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:59:43 user nova-compute[74337]: DEBUG nova.virt.disk.api [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c/disk. size=1073741824 {{(pid=74337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 21:59:43 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 21:59:43 user nova-compute[74337]: DEBUG nova.network.neutron [req-0db65dfd-9d5d-4d03-bc08-1c002f161b47 req-c4a529ab-6dae-4d8b-9cac-cd05bf90db28 service nova] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] Updating instance_info_cache with network_info: [] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:59:43 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-0db65dfd-9d5d-4d03-bc08-1c002f161b47 req-c4a529ab-6dae-4d8b-9cac-cd05bf90db28 service nova] Releasing lock "refresh_cache-9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:59:43 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Acquired lock "refresh_cache-9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 21:59:43 user nova-compute[74337]: DEBUG nova.network.neutron [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] Building network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 21:59:43 user nova-compute[74337]: DEBUG nova.network.neutron [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] Instance cache missing network info. {{(pid=74337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 21:59:43 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 21:59:43 user nova-compute[74337]: DEBUG nova.virt.disk.api [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Cannot resize image /opt/stack/data/nova/instances/9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c/disk to a smaller size. {{(pid=74337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 21:59:43 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] Created local disks {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 21:59:43 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] Ensure instance console log exists: /opt/stack/data/nova/instances/9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c/console.log {{(pid=74337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 21:59:43 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:59:43 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:59:43 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:59:43 user nova-compute[74337]: DEBUG nova.network.neutron [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] Updating instance_info_cache with network_info: [{"id": "28c36a5b-ff7d-4426-9b09-6114a8c43fe5", "address": "fa:16:3e:df:42:15", "network": {"id": "0b1d82b0-acba-470e-aede-1c57a85a8ed3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1250228933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "965415a9973d4714aa49a64d34b232a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28c36a5b-ff", "ovs_interfaceid": "28c36a5b-ff7d-4426-9b09-6114a8c43fe5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:59:43 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Releasing lock "refresh_cache-9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 21:59:43 user nova-compute[74337]: DEBUG nova.compute.manager [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] Instance network_info: |[{"id": "28c36a5b-ff7d-4426-9b09-6114a8c43fe5", "address": "fa:16:3e:df:42:15", "network": {"id": "0b1d82b0-acba-470e-aede-1c57a85a8ed3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1250228933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "965415a9973d4714aa49a64d34b232a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28c36a5b-ff", "ovs_interfaceid": "28c36a5b-ff7d-4426-9b09-6114a8c43fe5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 21:59:43 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] Start _get_guest_xml network_info=[{"id": "28c36a5b-ff7d-4426-9b09-6114a8c43fe5", "address": "fa:16:3e:df:42:15", "network": {"id": "0b1d82b0-acba-470e-aede-1c57a85a8ed3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1250228933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "965415a9973d4714aa49a64d34b232a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28c36a5b-ff", "ovs_interfaceid": "28c36a5b-ff7d-4426-9b09-6114a8c43fe5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T21:59:37Z,direct_url=<?>,disk_format='qcow2',id=b94d675a-138f-488a-92c5-1d5cd6e463aa,min_disk=0,min_ram=0,name='tempest-scenario-img--1879582347',owner='965415a9973d4714aa49a64d34b232a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T21:59:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'image_id': 'b94d675a-138f-488a-92c5-1d5cd6e463aa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 21:59:43 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:59:43 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 21:59:43 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 21:59:43 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] CPU controller missing on host. {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 21:59:43 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 21:59:43 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] CPU controller found on host. {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 21:59:43 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 21:59:43 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T21:29:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T21:59:37Z,direct_url=<?>,disk_format='qcow2',id=b94d675a-138f-488a-92c5-1d5cd6e463aa,min_disk=0,min_ram=0,name='tempest-scenario-img--1879582347',owner='965415a9973d4714aa49a64d34b232a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T21:59:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 21:59:43 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Flavor limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 21:59:43 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Image limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 21:59:43 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Flavor pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 21:59:43 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Image pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 21:59:43 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 21:59:43 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 21:59:43 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 21:59:43 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Got 1 possible topologies {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 21:59:43 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 21:59:43 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 21:59:43 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:59:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1167202695',display_name='tempest-TestMinimumBasicScenario-server-1167202695',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1167202695',id=43,image_ref='b94d675a-138f-488a-92c5-1d5cd6e463aa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFVpJ5DCLjjRrlrv/T1cJBeXMsthHFc4ZrTDVDtD1yr3GsqmWtj3fuqEYSlQrEVV5l2AM4io/VMMPw9pGRFIxmGAWLZ3YLAnw6HBKHE6A4ZxRNdwO/8j8SELlvTPjvuLlA==',key_name='tempest-TestMinimumBasicScenario-919891039',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='965415a9973d4714aa49a64d34b232a6',ramdisk_id='',reservation_id='r-vf3jl1zs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b94d675a-138f-488a-92c5-1d5cd6e463aa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-295529967',owner_user_name='tempest-TestMinimumBasicScenario-295529967-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:59:41Z,user_data=None,user_id='5a20c05457014209a86f285fcc9dd506',uuid=9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "28c36a5b-ff7d-4426-9b09-6114a8c43fe5", "address": "fa:16:3e:df:42:15", "network": {"id": "0b1d82b0-acba-470e-aede-1c57a85a8ed3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1250228933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "965415a9973d4714aa49a64d34b232a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28c36a5b-ff", "ovs_interfaceid": "28c36a5b-ff7d-4426-9b09-6114a8c43fe5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 21:59:43 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Converting VIF {"id": "28c36a5b-ff7d-4426-9b09-6114a8c43fe5", "address": "fa:16:3e:df:42:15", "network": {"id": "0b1d82b0-acba-470e-aede-1c57a85a8ed3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1250228933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "965415a9973d4714aa49a64d34b232a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28c36a5b-ff", "ovs_interfaceid": "28c36a5b-ff7d-4426-9b09-6114a8c43fe5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:59:43 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:42:15,bridge_name='br-int',has_traffic_filtering=True,id=28c36a5b-ff7d-4426-9b09-6114a8c43fe5,network=Network(0b1d82b0-acba-470e-aede-1c57a85a8ed3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28c36a5b-ff') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:59:43 user nova-compute[74337]: DEBUG nova.objects.instance [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Lazy-loading 'pci_devices' on Instance uuid 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:59:43 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] End _get_guest_xml xml=<domain type="kvm">
Oct 23 21:59:43 user nova-compute[74337]:   <uuid>9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c</uuid>
Oct 23 21:59:43 user nova-compute[74337]:   <name>instance-0000002b</name>
Oct 23 21:59:43 user nova-compute[74337]:   <memory>524288</memory>
Oct 23 21:59:43 user nova-compute[74337]:   <vcpu>1</vcpu>
Oct 23 21:59:43 user nova-compute[74337]:   <metadata>
Oct 23 21:59:43 user nova-compute[74337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 21:59:43 user nova-compute[74337]:       <nova:package version="0.0.0"/>
Oct 23 21:59:43 user nova-compute[74337]:       <nova:name>tempest-TestMinimumBasicScenario-server-1167202695</nova:name>
Oct 23 21:59:43 user nova-compute[74337]:       <nova:creationTime>2023-10-23 21:59:43</nova:creationTime>
Oct 23 21:59:43 user nova-compute[74337]:       <nova:flavor name="m1.tiny">
Oct 23 21:59:43 user nova-compute[74337]:         <nova:memory>512</nova:memory>
Oct 23 21:59:43 user nova-compute[74337]:         <nova:disk>1</nova:disk>
Oct 23 21:59:43 user nova-compute[74337]:         <nova:swap>0</nova:swap>
Oct 23 21:59:43 user nova-compute[74337]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 21:59:43 user nova-compute[74337]:         <nova:vcpus>1</nova:vcpus>
Oct 23 21:59:43 user nova-compute[74337]:       </nova:flavor>
Oct 23 21:59:43 user nova-compute[74337]:       <nova:owner>
Oct 23 21:59:43 user nova-compute[74337]:         <nova:user uuid="5a20c05457014209a86f285fcc9dd506">tempest-TestMinimumBasicScenario-295529967-project-member</nova:user>
Oct 23 21:59:43 user nova-compute[74337]:         <nova:project uuid="965415a9973d4714aa49a64d34b232a6">tempest-TestMinimumBasicScenario-295529967</nova:project>
Oct 23 21:59:43 user nova-compute[74337]:       </nova:owner>
Oct 23 21:59:43 user nova-compute[74337]:       <nova:root type="image" uuid="b94d675a-138f-488a-92c5-1d5cd6e463aa"/>
Oct 23 21:59:43 user nova-compute[74337]:       <nova:ports>
Oct 23 21:59:43 user nova-compute[74337]:         <nova:port uuid="28c36a5b-ff7d-4426-9b09-6114a8c43fe5">
Oct 23 21:59:43 user nova-compute[74337]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 23 21:59:43 user nova-compute[74337]:         </nova:port>
Oct 23 21:59:43 user nova-compute[74337]:       </nova:ports>
Oct 23 21:59:43 user nova-compute[74337]:     </nova:instance>
Oct 23 21:59:43 user nova-compute[74337]:   </metadata>
Oct 23 21:59:43 user nova-compute[74337]:   <sysinfo type="smbios">
Oct 23 21:59:43 user nova-compute[74337]:     <system>
Oct 23 21:59:43 user nova-compute[74337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 21:59:43 user nova-compute[74337]:       <entry name="product">OpenStack Nova</entry>
Oct 23 21:59:43 user nova-compute[74337]:       <entry name="version">0.0.0</entry>
Oct 23 21:59:43 user nova-compute[74337]:       <entry name="serial">9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c</entry>
Oct 23 21:59:43 user nova-compute[74337]:       <entry name="uuid">9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c</entry>
Oct 23 21:59:43 user nova-compute[74337]:       <entry name="family">Virtual Machine</entry>
Oct 23 21:59:43 user nova-compute[74337]:     </system>
Oct 23 21:59:43 user nova-compute[74337]:   </sysinfo>
Oct 23 21:59:43 user nova-compute[74337]:   <os>
Oct 23 21:59:43 user nova-compute[74337]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 21:59:43 user nova-compute[74337]:     <boot dev="hd"/>
Oct 23 21:59:43 user nova-compute[74337]:     <smbios mode="sysinfo"/>
Oct 23 21:59:43 user nova-compute[74337]:   </os>
Oct 23 21:59:43 user nova-compute[74337]:   <features>
Oct 23 21:59:43 user nova-compute[74337]:     <acpi/>
Oct 23 21:59:43 user nova-compute[74337]:     <apic/>
Oct 23 21:59:43 user nova-compute[74337]:     <vmcoreinfo/>
Oct 23 21:59:43 user nova-compute[74337]:   </features>
Oct 23 21:59:43 user nova-compute[74337]:   <clock offset="utc">
Oct 23 21:59:43 user nova-compute[74337]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 21:59:43 user nova-compute[74337]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 21:59:43 user nova-compute[74337]:     <timer name="hpet" present="no"/>
Oct 23 21:59:43 user nova-compute[74337]:   </clock>
Oct 23 21:59:43 user nova-compute[74337]:   <cpu mode="custom" match="exact">
Oct 23 21:59:43 user nova-compute[74337]:     <model>Nehalem</model>
Oct 23 21:59:43 user nova-compute[74337]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 21:59:43 user nova-compute[74337]:   </cpu>
Oct 23 21:59:43 user nova-compute[74337]:   <devices>
Oct 23 21:59:43 user nova-compute[74337]:     <disk type="file" device="disk">
Oct 23 21:59:43 user nova-compute[74337]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 21:59:43 user nova-compute[74337]:       <source file="/opt/stack/data/nova/instances/9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c/disk"/>
Oct 23 21:59:43 user nova-compute[74337]:       <target dev="vda" bus="virtio"/>
Oct 23 21:59:43 user nova-compute[74337]:     </disk>
Oct 23 21:59:43 user nova-compute[74337]:     <interface type="ethernet">
Oct 23 21:59:43 user nova-compute[74337]:       <mac address="fa:16:3e:df:42:15"/>
Oct 23 21:59:43 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:59:43 user nova-compute[74337]:       <mtu size="1442"/>
Oct 23 21:59:43 user nova-compute[74337]:       <target dev="tap28c36a5b-ff"/>
Oct 23 21:59:43 user nova-compute[74337]:     </interface>
Oct 23 21:59:43 user nova-compute[74337]:     <serial type="pty">
Oct 23 21:59:43 user nova-compute[74337]:       <log file="/opt/stack/data/nova/instances/9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c/console.log" append="off"/>
Oct 23 21:59:43 user nova-compute[74337]:     </serial>
Oct 23 21:59:43 user nova-compute[74337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 21:59:43 user nova-compute[74337]:     <video>
Oct 23 21:59:43 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 21:59:43 user nova-compute[74337]:     </video>
Oct 23 21:59:43 user nova-compute[74337]:     <rng model="virtio">
Oct 23 21:59:43 user nova-compute[74337]:       <backend model="random">/dev/urandom</backend>
Oct 23 21:59:43 user nova-compute[74337]:     </rng>
Oct 23 21:59:43 user nova-compute[74337]:     <controller type="usb" index="0" model="none"/>
Oct 23 21:59:43 user nova-compute[74337]:     <memballoon model="virtio">
Oct 23 21:59:43 user nova-compute[74337]:       <stats period="10"/>
Oct 23 21:59:43 user nova-compute[74337]:     </memballoon>
Oct 23 21:59:43 user nova-compute[74337]:   </devices>
Oct 23 21:59:43 user nova-compute[74337]: </domain>
Oct 23 21:59:43 user nova-compute[74337]:  {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 21:59:43 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:59:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1167202695',display_name='tempest-TestMinimumBasicScenario-server-1167202695',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1167202695',id=43,image_ref='b94d675a-138f-488a-92c5-1d5cd6e463aa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFVpJ5DCLjjRrlrv/T1cJBeXMsthHFc4ZrTDVDtD1yr3GsqmWtj3fuqEYSlQrEVV5l2AM4io/VMMPw9pGRFIxmGAWLZ3YLAnw6HBKHE6A4ZxRNdwO/8j8SELlvTPjvuLlA==',key_name='tempest-TestMinimumBasicScenario-919891039',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='965415a9973d4714aa49a64d34b232a6',ramdisk_id='',reservation_id='r-vf3jl1zs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b94d675a-138f-488a-92c5-1d5cd6e463aa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-295529967',owner_user_name='tempest-TestMinimumBasicScenario-295529967-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:59:41Z,user_data=None,user_id='5a20c05457014209a86f285fcc9dd506',uuid=9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "28c36a5b-ff7d-4426-9b09-6114a8c43fe5", "address": "fa:16:3e:df:42:15", "network": {"id": "0b1d82b0-acba-470e-aede-1c57a85a8ed3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1250228933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "965415a9973d4714aa49a64d34b232a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28c36a5b-ff", "ovs_interfaceid": "28c36a5b-ff7d-4426-9b09-6114a8c43fe5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 21:59:43 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Converting VIF {"id": "28c36a5b-ff7d-4426-9b09-6114a8c43fe5", "address": "fa:16:3e:df:42:15", "network": {"id": "0b1d82b0-acba-470e-aede-1c57a85a8ed3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1250228933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "965415a9973d4714aa49a64d34b232a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28c36a5b-ff", "ovs_interfaceid": "28c36a5b-ff7d-4426-9b09-6114a8c43fe5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:59:43 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:42:15,bridge_name='br-int',has_traffic_filtering=True,id=28c36a5b-ff7d-4426-9b09-6114a8c43fe5,network=Network(0b1d82b0-acba-470e-aede-1c57a85a8ed3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28c36a5b-ff') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:59:43 user nova-compute[74337]: DEBUG os_vif [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:42:15,bridge_name='br-int',has_traffic_filtering=True,id=28c36a5b-ff7d-4426-9b09-6114a8c43fe5,network=Network(0b1d82b0-acba-470e-aede-1c57a85a8ed3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28c36a5b-ff') {{(pid=74337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 21:59:43 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:59:43 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:59:43 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 21:59:43 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:59:43 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '17519634-0965-5b56-90a4-0384600c3779', '_type': 'linux-noop'}}, row=False) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:59:43 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:59:43 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:59:43 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:59:43 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap28c36a5b-ff, may_exist=True, interface_attrs={}) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:59:43 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap28c36a5b-ff, col_values=(('qos', UUID('0bd298cb-54d4-4a20-b8e0-6dca5df911fc')),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:59:43 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap28c36a5b-ff, col_values=(('external_ids', {'iface-id': '28c36a5b-ff7d-4426-9b09-6114a8c43fe5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:42:15', 'vm-uuid': '9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c'}),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:59:43 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:59:43 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:59:43 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:59:43 user nova-compute[74337]: INFO os_vif [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:42:15,bridge_name='br-int',has_traffic_filtering=True,id=28c36a5b-ff7d-4426-9b09-6114a8c43fe5,network=Network(0b1d82b0-acba-470e-aede-1c57a85a8ed3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28c36a5b-ff')
Oct 23 21:59:43 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] No BDM found with device name vda, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 21:59:43 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] No VIF found with MAC fa:16:3e:df:42:15, not building metadata {{(pid=74337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 21:59:43 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:59:44 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 21:59:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:59:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:59:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:59:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:59:45 user nova-compute[74337]: DEBUG nova.compute.manager [req-e1a52bd7-acc4-40f4-8599-a756aef2db35 req-b0fb68b0-4e53-48c0-97f2-28207623398c service nova] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] Received event network-vif-plugged-28c36a5b-ff7d-4426-9b09-6114a8c43fe5 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:59:45 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-e1a52bd7-acc4-40f4-8599-a756aef2db35 req-b0fb68b0-4e53-48c0-97f2-28207623398c service nova] Acquiring lock "9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:59:45 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-e1a52bd7-acc4-40f4-8599-a756aef2db35 req-b0fb68b0-4e53-48c0-97f2-28207623398c service nova] Lock "9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:59:45 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-e1a52bd7-acc4-40f4-8599-a756aef2db35 req-b0fb68b0-4e53-48c0-97f2-28207623398c service nova] Lock "9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:59:45 user nova-compute[74337]: DEBUG nova.compute.manager [req-e1a52bd7-acc4-40f4-8599-a756aef2db35 req-b0fb68b0-4e53-48c0-97f2-28207623398c service nova] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] No waiting events found dispatching network-vif-plugged-28c36a5b-ff7d-4426-9b09-6114a8c43fe5 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:59:45 user nova-compute[74337]: WARNING nova.compute.manager [req-e1a52bd7-acc4-40f4-8599-a756aef2db35 req-b0fb68b0-4e53-48c0-97f2-28207623398c service nova] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] Received unexpected event network-vif-plugged-28c36a5b-ff7d-4426-9b09-6114a8c43fe5 for instance with vm_state building and task_state spawning.
Oct 23 21:59:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:59:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:59:47 user nova-compute[74337]: DEBUG nova.compute.manager [req-e064dcb5-2514-4ac9-acf0-ea512044ad7c req-927f0387-d7cc-4610-850b-b99e7a96cf61 service nova] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] Received event network-vif-plugged-28c36a5b-ff7d-4426-9b09-6114a8c43fe5 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:59:47 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-e064dcb5-2514-4ac9-acf0-ea512044ad7c req-927f0387-d7cc-4610-850b-b99e7a96cf61 service nova] Acquiring lock "9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:59:47 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-e064dcb5-2514-4ac9-acf0-ea512044ad7c req-927f0387-d7cc-4610-850b-b99e7a96cf61 service nova] Lock "9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:59:47 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-e064dcb5-2514-4ac9-acf0-ea512044ad7c req-927f0387-d7cc-4610-850b-b99e7a96cf61 service nova] Lock "9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:59:47 user nova-compute[74337]: DEBUG nova.compute.manager [req-e064dcb5-2514-4ac9-acf0-ea512044ad7c req-927f0387-d7cc-4610-850b-b99e7a96cf61 service nova] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] No waiting events found dispatching network-vif-plugged-28c36a5b-ff7d-4426-9b09-6114a8c43fe5 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 21:59:47 user nova-compute[74337]: WARNING nova.compute.manager [req-e064dcb5-2514-4ac9-acf0-ea512044ad7c req-927f0387-d7cc-4610-850b-b99e7a96cf61 service nova] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] Received unexpected event network-vif-plugged-28c36a5b-ff7d-4426-9b09-6114a8c43fe5 for instance with vm_state building and task_state spawning.
Oct 23 21:59:47 user nova-compute[74337]: DEBUG nova.compute.manager [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] Instance event wait completed in 0 seconds for  {{(pid=74337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 21:59:47 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] Guest created on hypervisor {{(pid=74337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 21:59:47 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] Instance spawned successfully.
Oct 23 21:59:47 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 21:59:47 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] Found default for hw_cdrom_bus of ide {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:59:47 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] Found default for hw_disk_bus of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:59:47 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] Found default for hw_input_bus of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:59:47 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] Found default for hw_pointer_model of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:59:47 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] Found default for hw_video_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:59:47 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] Found default for hw_vif_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 21:59:47 user nova-compute[74337]: INFO nova.compute.manager [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] Took 6.64 seconds to spawn the instance on the hypervisor.
Oct 23 21:59:47 user nova-compute[74337]: DEBUG nova.compute.manager [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] Checking state {{(pid=74337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 21:59:47 user nova-compute[74337]: INFO nova.compute.manager [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] Took 7.37 seconds to build instance.
Oct 23 21:59:47 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-e05c57b1-77ec-4173-ba3a-af4a2087b6b7 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Lock "9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.538s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:59:48 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:59:48 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:59:50 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:59:52 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:59:53 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:59:53 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:59:54 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:59:56 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:59:56 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4d5832d4-59ec-423c-b66f-eafdf4978d12 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Acquiring lock "e903b923-51ac-46f6-9652-1d33c946e25a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:59:56 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4d5832d4-59ec-423c-b66f-eafdf4978d12 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Lock "e903b923-51ac-46f6-9652-1d33c946e25a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:59:56 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4d5832d4-59ec-423c-b66f-eafdf4978d12 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Acquiring lock "e903b923-51ac-46f6-9652-1d33c946e25a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:59:56 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4d5832d4-59ec-423c-b66f-eafdf4978d12 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Lock "e903b923-51ac-46f6-9652-1d33c946e25a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:59:56 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4d5832d4-59ec-423c-b66f-eafdf4978d12 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Lock "e903b923-51ac-46f6-9652-1d33c946e25a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:59:56 user nova-compute[74337]: INFO nova.compute.manager [None req-4d5832d4-59ec-423c-b66f-eafdf4978d12 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] [instance: e903b923-51ac-46f6-9652-1d33c946e25a] Terminating instance
Oct 23 21:59:56 user nova-compute[74337]: DEBUG nova.compute.manager [None req-4d5832d4-59ec-423c-b66f-eafdf4978d12 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] [instance: e903b923-51ac-46f6-9652-1d33c946e25a] Start destroying the instance on the hypervisor. {{(pid=74337) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 21:59:56 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:59:56 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:59:56 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:59:56 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:59:57 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: e903b923-51ac-46f6-9652-1d33c946e25a] Instance destroyed successfully.
Oct 23 21:59:57 user nova-compute[74337]: DEBUG nova.objects.instance [None req-4d5832d4-59ec-423c-b66f-eafdf4978d12 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Lazy-loading 'resources' on Instance uuid e903b923-51ac-46f6-9652-1d33c946e25a {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 21:59:57 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-4d5832d4-59ec-423c-b66f-eafdf4978d12 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:58:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1098761863',display_name='tempest-VolumesActionsTest-instance-1098761863',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1098761863',id=40,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-23T21:58:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='10913ebbab6441bdaa5b0bd97bf1dfb8',ramdisk_id='',reservation_id='r-u20gmy3d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-959580854',owner_user_name='tempest-VolumesActionsTest-959580854-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T21:58:14Z,user_data=None,user_id='112575ac7c2d4409a95aa1844d967afa',uuid=e903b923-51ac-46f6-9652-1d33c946e25a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "156a94ae-3ed6-4ea7-a55f-6230e9050946", "address": "fa:16:3e:65:2f:9b", "network": {"id": "89c20314-7bb0-4ea1-b024-d474e5deb03a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-600863519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10913ebbab6441bdaa5b0bd97bf1dfb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap156a94ae-3e", "ovs_interfaceid": "156a94ae-3ed6-4ea7-a55f-6230e9050946", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 21:59:57 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-4d5832d4-59ec-423c-b66f-eafdf4978d12 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Converting VIF {"id": "156a94ae-3ed6-4ea7-a55f-6230e9050946", "address": "fa:16:3e:65:2f:9b", "network": {"id": "89c20314-7bb0-4ea1-b024-d474e5deb03a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-600863519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10913ebbab6441bdaa5b0bd97bf1dfb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap156a94ae-3e", "ovs_interfaceid": "156a94ae-3ed6-4ea7-a55f-6230e9050946", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 21:59:57 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-4d5832d4-59ec-423c-b66f-eafdf4978d12 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:2f:9b,bridge_name='br-int',has_traffic_filtering=True,id=156a94ae-3ed6-4ea7-a55f-6230e9050946,network=Network(89c20314-7bb0-4ea1-b024-d474e5deb03a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap156a94ae-3e') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 21:59:57 user nova-compute[74337]: DEBUG os_vif [None req-4d5832d4-59ec-423c-b66f-eafdf4978d12 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:2f:9b,bridge_name='br-int',has_traffic_filtering=True,id=156a94ae-3ed6-4ea7-a55f-6230e9050946,network=Network(89c20314-7bb0-4ea1-b024-d474e5deb03a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap156a94ae-3e') {{(pid=74337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 21:59:57 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:59:57 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap156a94ae-3e, bridge=br-int, if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:59:57 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:59:57 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 21:59:57 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:59:57 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8cc08ef2-4dc3-46f8-9793-43a8d050f331) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 21:59:57 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:59:57 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:59:57 user nova-compute[74337]: INFO os_vif [None req-4d5832d4-59ec-423c-b66f-eafdf4978d12 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:2f:9b,bridge_name='br-int',has_traffic_filtering=True,id=156a94ae-3ed6-4ea7-a55f-6230e9050946,network=Network(89c20314-7bb0-4ea1-b024-d474e5deb03a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap156a94ae-3e')
Oct 23 21:59:57 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-4d5832d4-59ec-423c-b66f-eafdf4978d12 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] [instance: e903b923-51ac-46f6-9652-1d33c946e25a] Deleting instance files /opt/stack/data/nova/instances/e903b923-51ac-46f6-9652-1d33c946e25a_del
Oct 23 21:59:57 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-4d5832d4-59ec-423c-b66f-eafdf4978d12 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] [instance: e903b923-51ac-46f6-9652-1d33c946e25a] Deletion of /opt/stack/data/nova/instances/e903b923-51ac-46f6-9652-1d33c946e25a_del complete
Oct 23 21:59:57 user nova-compute[74337]: INFO nova.compute.manager [None req-4d5832d4-59ec-423c-b66f-eafdf4978d12 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] [instance: e903b923-51ac-46f6-9652-1d33c946e25a] Took 0.67 seconds to destroy the instance on the hypervisor.
Oct 23 21:59:57 user nova-compute[74337]: DEBUG oslo.service.loopingcall [None req-4d5832d4-59ec-423c-b66f-eafdf4978d12 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74337) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 21:59:57 user nova-compute[74337]: DEBUG nova.compute.manager [-] [instance: e903b923-51ac-46f6-9652-1d33c946e25a] Deallocating network for instance {{(pid=74337) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 21:59:57 user nova-compute[74337]: DEBUG nova.network.neutron [-] [instance: e903b923-51ac-46f6-9652-1d33c946e25a] deallocate_for_instance() {{(pid=74337) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 21:59:57 user nova-compute[74337]: DEBUG nova.network.neutron [-] [instance: e903b923-51ac-46f6-9652-1d33c946e25a] Updating instance_info_cache with network_info: [] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:59:57 user nova-compute[74337]: DEBUG nova.compute.manager [req-aba1d64a-e82d-4dc0-83fc-20c28fed7221 req-efe827d1-65d7-45e9-8fb1-8d3bc7d3fe6b service nova] [instance: e903b923-51ac-46f6-9652-1d33c946e25a] Received event network-vif-deleted-156a94ae-3ed6-4ea7-a55f-6230e9050946 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 21:59:57 user nova-compute[74337]: INFO nova.compute.manager [req-aba1d64a-e82d-4dc0-83fc-20c28fed7221 req-efe827d1-65d7-45e9-8fb1-8d3bc7d3fe6b service nova] [instance: e903b923-51ac-46f6-9652-1d33c946e25a] Neutron deleted interface 156a94ae-3ed6-4ea7-a55f-6230e9050946; detaching it from the instance and deleting it from the info cache
Oct 23 21:59:57 user nova-compute[74337]: DEBUG nova.network.neutron [req-aba1d64a-e82d-4dc0-83fc-20c28fed7221 req-efe827d1-65d7-45e9-8fb1-8d3bc7d3fe6b service nova] [instance: e903b923-51ac-46f6-9652-1d33c946e25a] Updating instance_info_cache with network_info: [] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 21:59:57 user nova-compute[74337]: INFO nova.compute.manager [-] [instance: e903b923-51ac-46f6-9652-1d33c946e25a] Took 0.47 seconds to deallocate network for instance.
Oct 23 21:59:57 user nova-compute[74337]: DEBUG nova.compute.manager [req-aba1d64a-e82d-4dc0-83fc-20c28fed7221 req-efe827d1-65d7-45e9-8fb1-8d3bc7d3fe6b service nova] [instance: e903b923-51ac-46f6-9652-1d33c946e25a] Detach interface failed, port_id=156a94ae-3ed6-4ea7-a55f-6230e9050946, reason: Instance e903b923-51ac-46f6-9652-1d33c946e25a could not be found. {{(pid=74337) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 23 21:59:57 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4d5832d4-59ec-423c-b66f-eafdf4978d12 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 21:59:57 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4d5832d4-59ec-423c-b66f-eafdf4978d12 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 21:59:58 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-4d5832d4-59ec-423c-b66f-eafdf4978d12 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 21:59:58 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-4d5832d4-59ec-423c-b66f-eafdf4978d12 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 21:59:58 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4d5832d4-59ec-423c-b66f-eafdf4978d12 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.223s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:59:58 user nova-compute[74337]: INFO nova.scheduler.client.report [None req-4d5832d4-59ec-423c-b66f-eafdf4978d12 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Deleted allocations for instance e903b923-51ac-46f6-9652-1d33c946e25a
Oct 23 21:59:58 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4d5832d4-59ec-423c-b66f-eafdf4978d12 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Lock "e903b923-51ac-46f6-9652-1d33c946e25a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.570s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 21:59:58 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 21:59:59 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:00:02 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:00:02 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:00:03 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:00:04 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4587250a-f89b-4baf-bb10-e796758f5a2b tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Acquiring lock "6326434d-56d2-43a0-b171-f0f7bd1de5a8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:00:04 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4587250a-f89b-4baf-bb10-e796758f5a2b tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Lock "6326434d-56d2-43a0-b171-f0f7bd1de5a8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:00:04 user nova-compute[74337]: DEBUG nova.compute.manager [None req-4587250a-f89b-4baf-bb10-e796758f5a2b tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] [instance: 6326434d-56d2-43a0-b171-f0f7bd1de5a8] Starting instance... {{(pid=74337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 22:00:04 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4587250a-f89b-4baf-bb10-e796758f5a2b tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:00:04 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4587250a-f89b-4baf-bb10-e796758f5a2b tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:00:04 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-4587250a-f89b-4baf-bb10-e796758f5a2b tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 22:00:04 user nova-compute[74337]: INFO nova.compute.claims [None req-4587250a-f89b-4baf-bb10-e796758f5a2b tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] [instance: 6326434d-56d2-43a0-b171-f0f7bd1de5a8] Claim successful on node user
Oct 23 22:00:04 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-4587250a-f89b-4baf-bb10-e796758f5a2b tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 22:00:04 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-4587250a-f89b-4baf-bb10-e796758f5a2b tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 22:00:04 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4587250a-f89b-4baf-bb10-e796758f5a2b tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.492s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:00:04 user nova-compute[74337]: DEBUG nova.compute.manager [None req-4587250a-f89b-4baf-bb10-e796758f5a2b tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] [instance: 6326434d-56d2-43a0-b171-f0f7bd1de5a8] Start building networks asynchronously for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 22:00:05 user nova-compute[74337]: DEBUG nova.compute.manager [None req-4587250a-f89b-4baf-bb10-e796758f5a2b tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] [instance: 6326434d-56d2-43a0-b171-f0f7bd1de5a8] Allocating IP information in the background. {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 22:00:05 user nova-compute[74337]: DEBUG nova.network.neutron [None req-4587250a-f89b-4baf-bb10-e796758f5a2b tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] [instance: 6326434d-56d2-43a0-b171-f0f7bd1de5a8] allocate_for_instance() {{(pid=74337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 22:00:05 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-4587250a-f89b-4baf-bb10-e796758f5a2b tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] [instance: 6326434d-56d2-43a0-b171-f0f7bd1de5a8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 22:00:05 user nova-compute[74337]: DEBUG nova.compute.manager [None req-4587250a-f89b-4baf-bb10-e796758f5a2b tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] [instance: 6326434d-56d2-43a0-b171-f0f7bd1de5a8] Start building block device mappings for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 22:00:05 user nova-compute[74337]: DEBUG nova.policy [None req-4587250a-f89b-4baf-bb10-e796758f5a2b tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '16f96346d5c44132bfc6ed76966c6930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f838429412604ad4a6dea808cf3c92b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74337) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 22:00:05 user nova-compute[74337]: DEBUG nova.compute.manager [None req-4587250a-f89b-4baf-bb10-e796758f5a2b tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] [instance: 6326434d-56d2-43a0-b171-f0f7bd1de5a8] Start spawning the instance on the hypervisor. {{(pid=74337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 22:00:05 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-4587250a-f89b-4baf-bb10-e796758f5a2b tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] [instance: 6326434d-56d2-43a0-b171-f0f7bd1de5a8] Creating instance directory {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 22:00:05 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-4587250a-f89b-4baf-bb10-e796758f5a2b tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] [instance: 6326434d-56d2-43a0-b171-f0f7bd1de5a8] Creating image(s)
Oct 23 22:00:05 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4587250a-f89b-4baf-bb10-e796758f5a2b tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Acquiring lock "/opt/stack/data/nova/instances/6326434d-56d2-43a0-b171-f0f7bd1de5a8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:00:05 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4587250a-f89b-4baf-bb10-e796758f5a2b tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Lock "/opt/stack/data/nova/instances/6326434d-56d2-43a0-b171-f0f7bd1de5a8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:00:05 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4587250a-f89b-4baf-bb10-e796758f5a2b tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Lock "/opt/stack/data/nova/instances/6326434d-56d2-43a0-b171-f0f7bd1de5a8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:00:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-4587250a-f89b-4baf-bb10-e796758f5a2b tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:00:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-4587250a-f89b-4baf-bb10-e796758f5a2b tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.188s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:00:05 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4587250a-f89b-4baf-bb10-e796758f5a2b tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Acquiring lock "fc7b140751b8c385de81623e40fb09ce09374ab7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:00:05 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4587250a-f89b-4baf-bb10-e796758f5a2b tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Lock "fc7b140751b8c385de81623e40fb09ce09374ab7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:00:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-4587250a-f89b-4baf-bb10-e796758f5a2b tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:00:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-4587250a-f89b-4baf-bb10-e796758f5a2b tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.187s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:00:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-4587250a-f89b-4baf-bb10-e796758f5a2b tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7,backing_fmt=raw /opt/stack/data/nova/instances/6326434d-56d2-43a0-b171-f0f7bd1de5a8/disk 1073741824 {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:00:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-4587250a-f89b-4baf-bb10-e796758f5a2b tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7,backing_fmt=raw /opt/stack/data/nova/instances/6326434d-56d2-43a0-b171-f0f7bd1de5a8/disk 1073741824" returned: 0 in 0.049s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:00:05 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4587250a-f89b-4baf-bb10-e796758f5a2b tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Lock "fc7b140751b8c385de81623e40fb09ce09374ab7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:00:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-4587250a-f89b-4baf-bb10-e796758f5a2b tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:00:05 user nova-compute[74337]: DEBUG nova.network.neutron [None req-4587250a-f89b-4baf-bb10-e796758f5a2b tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] [instance: 6326434d-56d2-43a0-b171-f0f7bd1de5a8] Successfully created port: 2c0d1355-d2c2-4504-82a1-705e29a2d065 {{(pid=74337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 22:00:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-4587250a-f89b-4baf-bb10-e796758f5a2b tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.197s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:00:05 user nova-compute[74337]: DEBUG nova.virt.disk.api [None req-4587250a-f89b-4baf-bb10-e796758f5a2b tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6326434d-56d2-43a0-b171-f0f7bd1de5a8/disk. size=1073741824 {{(pid=74337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 22:00:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-4587250a-f89b-4baf-bb10-e796758f5a2b tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6326434d-56d2-43a0-b171-f0f7bd1de5a8/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:00:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-4587250a-f89b-4baf-bb10-e796758f5a2b tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6326434d-56d2-43a0-b171-f0f7bd1de5a8/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:00:06 user nova-compute[74337]: DEBUG nova.virt.disk.api [None req-4587250a-f89b-4baf-bb10-e796758f5a2b tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Cannot resize image /opt/stack/data/nova/instances/6326434d-56d2-43a0-b171-f0f7bd1de5a8/disk to a smaller size. {{(pid=74337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 22:00:06 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-4587250a-f89b-4baf-bb10-e796758f5a2b tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] [instance: 6326434d-56d2-43a0-b171-f0f7bd1de5a8] Created local disks {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 22:00:06 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-4587250a-f89b-4baf-bb10-e796758f5a2b tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] [instance: 6326434d-56d2-43a0-b171-f0f7bd1de5a8] Ensure instance console log exists: /opt/stack/data/nova/instances/6326434d-56d2-43a0-b171-f0f7bd1de5a8/console.log {{(pid=74337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 22:00:06 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4587250a-f89b-4baf-bb10-e796758f5a2b tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:00:06 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4587250a-f89b-4baf-bb10-e796758f5a2b tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:00:06 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4587250a-f89b-4baf-bb10-e796758f5a2b tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:00:06 user nova-compute[74337]: DEBUG nova.network.neutron [None req-4587250a-f89b-4baf-bb10-e796758f5a2b tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] [instance: 6326434d-56d2-43a0-b171-f0f7bd1de5a8] Successfully updated port: 2c0d1355-d2c2-4504-82a1-705e29a2d065 {{(pid=74337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 22:00:06 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4587250a-f89b-4baf-bb10-e796758f5a2b tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Acquiring lock "refresh_cache-6326434d-56d2-43a0-b171-f0f7bd1de5a8" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 22:00:06 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4587250a-f89b-4baf-bb10-e796758f5a2b tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Acquired lock "refresh_cache-6326434d-56d2-43a0-b171-f0f7bd1de5a8" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 22:00:06 user nova-compute[74337]: DEBUG nova.network.neutron [None req-4587250a-f89b-4baf-bb10-e796758f5a2b tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] [instance: 6326434d-56d2-43a0-b171-f0f7bd1de5a8] Building network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 22:00:06 user nova-compute[74337]: DEBUG nova.compute.manager [req-d46abae2-cc4b-4300-a81d-6d7c3cf68d5f req-a3733e75-81e2-43d1-a869-0efe71e351ec service nova] [instance: 6326434d-56d2-43a0-b171-f0f7bd1de5a8] Received event network-changed-2c0d1355-d2c2-4504-82a1-705e29a2d065 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:00:06 user nova-compute[74337]: DEBUG nova.compute.manager [req-d46abae2-cc4b-4300-a81d-6d7c3cf68d5f req-a3733e75-81e2-43d1-a869-0efe71e351ec service nova] [instance: 6326434d-56d2-43a0-b171-f0f7bd1de5a8] Refreshing instance network info cache due to event network-changed-2c0d1355-d2c2-4504-82a1-705e29a2d065. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 22:00:06 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-d46abae2-cc4b-4300-a81d-6d7c3cf68d5f req-a3733e75-81e2-43d1-a869-0efe71e351ec service nova] Acquiring lock "refresh_cache-6326434d-56d2-43a0-b171-f0f7bd1de5a8" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 22:00:06 user nova-compute[74337]: DEBUG nova.network.neutron [None req-4587250a-f89b-4baf-bb10-e796758f5a2b tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] [instance: 6326434d-56d2-43a0-b171-f0f7bd1de5a8] Instance cache missing network info. {{(pid=74337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 22:00:06 user nova-compute[74337]: DEBUG nova.network.neutron [None req-4587250a-f89b-4baf-bb10-e796758f5a2b tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] [instance: 6326434d-56d2-43a0-b171-f0f7bd1de5a8] Updating instance_info_cache with network_info: [{"id": "2c0d1355-d2c2-4504-82a1-705e29a2d065", "address": "fa:16:3e:06:70:87", "network": {"id": "144e037b-415c-4af4-a16c-081ac621f89b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1182284183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f838429412604ad4a6dea808cf3c92b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c0d1355-d2", "ovs_interfaceid": "2c0d1355-d2c2-4504-82a1-705e29a2d065", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 22:00:07 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4587250a-f89b-4baf-bb10-e796758f5a2b tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Releasing lock "refresh_cache-6326434d-56d2-43a0-b171-f0f7bd1de5a8" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 22:00:07 user nova-compute[74337]: DEBUG nova.compute.manager [None req-4587250a-f89b-4baf-bb10-e796758f5a2b tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] [instance: 6326434d-56d2-43a0-b171-f0f7bd1de5a8] Instance network_info: |[{"id": "2c0d1355-d2c2-4504-82a1-705e29a2d065", "address": "fa:16:3e:06:70:87", "network": {"id": "144e037b-415c-4af4-a16c-081ac621f89b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1182284183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f838429412604ad4a6dea808cf3c92b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c0d1355-d2", "ovs_interfaceid": "2c0d1355-d2c2-4504-82a1-705e29a2d065", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 22:00:07 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-d46abae2-cc4b-4300-a81d-6d7c3cf68d5f req-a3733e75-81e2-43d1-a869-0efe71e351ec service nova] Acquired lock "refresh_cache-6326434d-56d2-43a0-b171-f0f7bd1de5a8" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 22:00:07 user nova-compute[74337]: DEBUG nova.network.neutron [req-d46abae2-cc4b-4300-a81d-6d7c3cf68d5f req-a3733e75-81e2-43d1-a869-0efe71e351ec service nova] [instance: 6326434d-56d2-43a0-b171-f0f7bd1de5a8] Refreshing network info cache for port 2c0d1355-d2c2-4504-82a1-705e29a2d065 {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 22:00:07 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-4587250a-f89b-4baf-bb10-e796758f5a2b tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] [instance: 6326434d-56d2-43a0-b171-f0f7bd1de5a8] Start _get_guest_xml network_info=[{"id": "2c0d1355-d2c2-4504-82a1-705e29a2d065", "address": "fa:16:3e:06:70:87", "network": {"id": "144e037b-415c-4af4-a16c-081ac621f89b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1182284183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f838429412604ad4a6dea808cf3c92b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c0d1355-d2", "ovs_interfaceid": "2c0d1355-d2c2-4504-82a1-705e29a2d065", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T21:29:21Z,direct_url=<?>,disk_format='qcow2',id=d859d89d-998d-4109-b26a-0d6e28152932,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ff43462300764979a6cf688444336a56',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T21:29:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'image_id': 'd859d89d-998d-4109-b26a-0d6e28152932'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 22:00:07 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-4587250a-f89b-4baf-bb10-e796758f5a2b tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:00:07 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-4587250a-f89b-4baf-bb10-e796758f5a2b tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:00:07 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-4587250a-f89b-4baf-bb10-e796758f5a2b tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 22:00:07 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-4587250a-f89b-4baf-bb10-e796758f5a2b tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] CPU controller missing on host. {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 22:00:07 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-4587250a-f89b-4baf-bb10-e796758f5a2b tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 22:00:07 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-4587250a-f89b-4baf-bb10-e796758f5a2b tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] CPU controller found on host. {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 22:00:07 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-4587250a-f89b-4baf-bb10-e796758f5a2b tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 22:00:07 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-4587250a-f89b-4baf-bb10-e796758f5a2b tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T21:29:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T21:29:21Z,direct_url=<?>,disk_format='qcow2',id=d859d89d-998d-4109-b26a-0d6e28152932,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ff43462300764979a6cf688444336a56',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T21:29:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 22:00:07 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-4587250a-f89b-4baf-bb10-e796758f5a2b tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Flavor limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 22:00:07 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-4587250a-f89b-4baf-bb10-e796758f5a2b tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Image limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 22:00:07 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-4587250a-f89b-4baf-bb10-e796758f5a2b tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Flavor pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 22:00:07 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-4587250a-f89b-4baf-bb10-e796758f5a2b tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Image pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 22:00:07 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-4587250a-f89b-4baf-bb10-e796758f5a2b tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 22:00:07 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-4587250a-f89b-4baf-bb10-e796758f5a2b tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 22:00:07 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-4587250a-f89b-4baf-bb10-e796758f5a2b tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 22:00:07 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-4587250a-f89b-4baf-bb10-e796758f5a2b tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Got 1 possible topologies {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 22:00:07 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-4587250a-f89b-4baf-bb10-e796758f5a2b tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 22:00:07 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-4587250a-f89b-4baf-bb10-e796758f5a2b tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 22:00:07 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-4587250a-f89b-4baf-bb10-e796758f5a2b tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T22:00:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-2118885877',display_name='tempest-TestServerVolumeAttachmentScenario-server-2118885877',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-2118885877',id=44,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOlPpRTdCGk73S/8D17g34dxL6zhBVBHh/jBhNVAmyV7YH/pcHQq+lR9RVFeBxv5kS28ecMVZQHX4g06NfynmXoET7yOBu/gz2FTdiyjJoOgJjQCvqCGrUNiiFlSskapqw==',key_name='tempest-keypair-1561680692',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f838429412604ad4a6dea808cf3c92b7',ramdisk_id='',reservation_id='r-n8de0hkt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-919428222',owner_user_name='tempest-TestServerVolumeAttachmentScenario-919428222-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T22:00:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='16f96346d5c44132bfc6ed76966c6930',uuid=6326434d-56d2-43a0-b171-f0f7bd1de5a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2c0d1355-d2c2-4504-82a1-705e29a2d065", "address": "fa:16:3e:06:70:87", "network": {"id": "144e037b-415c-4af4-a16c-081ac621f89b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1182284183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f838429412604ad4a6dea808cf3c92b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c0d1355-d2", "ovs_interfaceid": "2c0d1355-d2c2-4504-82a1-705e29a2d065", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 22:00:07 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-4587250a-f89b-4baf-bb10-e796758f5a2b tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Converting VIF {"id": "2c0d1355-d2c2-4504-82a1-705e29a2d065", "address": "fa:16:3e:06:70:87", "network": {"id": "144e037b-415c-4af4-a16c-081ac621f89b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1182284183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f838429412604ad4a6dea808cf3c92b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c0d1355-d2", "ovs_interfaceid": "2c0d1355-d2c2-4504-82a1-705e29a2d065", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 22:00:07 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-4587250a-f89b-4baf-bb10-e796758f5a2b tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:70:87,bridge_name='br-int',has_traffic_filtering=True,id=2c0d1355-d2c2-4504-82a1-705e29a2d065,network=Network(144e037b-415c-4af4-a16c-081ac621f89b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c0d1355-d2') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 22:00:07 user nova-compute[74337]: DEBUG nova.objects.instance [None req-4587250a-f89b-4baf-bb10-e796758f5a2b tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Lazy-loading 'pci_devices' on Instance uuid 6326434d-56d2-43a0-b171-f0f7bd1de5a8 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:00:07 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-4587250a-f89b-4baf-bb10-e796758f5a2b tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] [instance: 6326434d-56d2-43a0-b171-f0f7bd1de5a8] End _get_guest_xml xml=<domain type="kvm">
Oct 23 22:00:07 user nova-compute[74337]:   <uuid>6326434d-56d2-43a0-b171-f0f7bd1de5a8</uuid>
Oct 23 22:00:07 user nova-compute[74337]:   <name>instance-0000002c</name>
Oct 23 22:00:07 user nova-compute[74337]:   <memory>524288</memory>
Oct 23 22:00:07 user nova-compute[74337]:   <vcpu>1</vcpu>
Oct 23 22:00:07 user nova-compute[74337]:   <metadata>
Oct 23 22:00:07 user nova-compute[74337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 22:00:07 user nova-compute[74337]:       <nova:package version="0.0.0"/>
Oct 23 22:00:07 user nova-compute[74337]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-2118885877</nova:name>
Oct 23 22:00:07 user nova-compute[74337]:       <nova:creationTime>2023-10-23 22:00:07</nova:creationTime>
Oct 23 22:00:07 user nova-compute[74337]:       <nova:flavor name="m1.tiny">
Oct 23 22:00:07 user nova-compute[74337]:         <nova:memory>512</nova:memory>
Oct 23 22:00:07 user nova-compute[74337]:         <nova:disk>1</nova:disk>
Oct 23 22:00:07 user nova-compute[74337]:         <nova:swap>0</nova:swap>
Oct 23 22:00:07 user nova-compute[74337]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 22:00:07 user nova-compute[74337]:         <nova:vcpus>1</nova:vcpus>
Oct 23 22:00:07 user nova-compute[74337]:       </nova:flavor>
Oct 23 22:00:07 user nova-compute[74337]:       <nova:owner>
Oct 23 22:00:07 user nova-compute[74337]:         <nova:user uuid="16f96346d5c44132bfc6ed76966c6930">tempest-TestServerVolumeAttachmentScenario-919428222-project-member</nova:user>
Oct 23 22:00:07 user nova-compute[74337]:         <nova:project uuid="f838429412604ad4a6dea808cf3c92b7">tempest-TestServerVolumeAttachmentScenario-919428222</nova:project>
Oct 23 22:00:07 user nova-compute[74337]:       </nova:owner>
Oct 23 22:00:07 user nova-compute[74337]:       <nova:root type="image" uuid="d859d89d-998d-4109-b26a-0d6e28152932"/>
Oct 23 22:00:07 user nova-compute[74337]:       <nova:ports>
Oct 23 22:00:07 user nova-compute[74337]:         <nova:port uuid="2c0d1355-d2c2-4504-82a1-705e29a2d065">
Oct 23 22:00:07 user nova-compute[74337]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 23 22:00:07 user nova-compute[74337]:         </nova:port>
Oct 23 22:00:07 user nova-compute[74337]:       </nova:ports>
Oct 23 22:00:07 user nova-compute[74337]:     </nova:instance>
Oct 23 22:00:07 user nova-compute[74337]:   </metadata>
Oct 23 22:00:07 user nova-compute[74337]:   <sysinfo type="smbios">
Oct 23 22:00:07 user nova-compute[74337]:     <system>
Oct 23 22:00:07 user nova-compute[74337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 22:00:07 user nova-compute[74337]:       <entry name="product">OpenStack Nova</entry>
Oct 23 22:00:07 user nova-compute[74337]:       <entry name="version">0.0.0</entry>
Oct 23 22:00:07 user nova-compute[74337]:       <entry name="serial">6326434d-56d2-43a0-b171-f0f7bd1de5a8</entry>
Oct 23 22:00:07 user nova-compute[74337]:       <entry name="uuid">6326434d-56d2-43a0-b171-f0f7bd1de5a8</entry>
Oct 23 22:00:07 user nova-compute[74337]:       <entry name="family">Virtual Machine</entry>
Oct 23 22:00:07 user nova-compute[74337]:     </system>
Oct 23 22:00:07 user nova-compute[74337]:   </sysinfo>
Oct 23 22:00:07 user nova-compute[74337]:   <os>
Oct 23 22:00:07 user nova-compute[74337]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 22:00:07 user nova-compute[74337]:     <boot dev="hd"/>
Oct 23 22:00:07 user nova-compute[74337]:     <smbios mode="sysinfo"/>
Oct 23 22:00:07 user nova-compute[74337]:   </os>
Oct 23 22:00:07 user nova-compute[74337]:   <features>
Oct 23 22:00:07 user nova-compute[74337]:     <acpi/>
Oct 23 22:00:07 user nova-compute[74337]:     <apic/>
Oct 23 22:00:07 user nova-compute[74337]:     <vmcoreinfo/>
Oct 23 22:00:07 user nova-compute[74337]:   </features>
Oct 23 22:00:07 user nova-compute[74337]:   <clock offset="utc">
Oct 23 22:00:07 user nova-compute[74337]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 22:00:07 user nova-compute[74337]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 22:00:07 user nova-compute[74337]:     <timer name="hpet" present="no"/>
Oct 23 22:00:07 user nova-compute[74337]:   </clock>
Oct 23 22:00:07 user nova-compute[74337]:   <cpu mode="custom" match="exact">
Oct 23 22:00:07 user nova-compute[74337]:     <model>Nehalem</model>
Oct 23 22:00:07 user nova-compute[74337]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 22:00:07 user nova-compute[74337]:   </cpu>
Oct 23 22:00:07 user nova-compute[74337]:   <devices>
Oct 23 22:00:07 user nova-compute[74337]:     <disk type="file" device="disk">
Oct 23 22:00:07 user nova-compute[74337]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 22:00:07 user nova-compute[74337]:       <source file="/opt/stack/data/nova/instances/6326434d-56d2-43a0-b171-f0f7bd1de5a8/disk"/>
Oct 23 22:00:07 user nova-compute[74337]:       <target dev="vda" bus="virtio"/>
Oct 23 22:00:07 user nova-compute[74337]:     </disk>
Oct 23 22:00:07 user nova-compute[74337]:     <interface type="ethernet">
Oct 23 22:00:07 user nova-compute[74337]:       <mac address="fa:16:3e:06:70:87"/>
Oct 23 22:00:07 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 22:00:07 user nova-compute[74337]:       <mtu size="1442"/>
Oct 23 22:00:07 user nova-compute[74337]:       <target dev="tap2c0d1355-d2"/>
Oct 23 22:00:07 user nova-compute[74337]:     </interface>
Oct 23 22:00:07 user nova-compute[74337]:     <serial type="pty">
Oct 23 22:00:07 user nova-compute[74337]:       <log file="/opt/stack/data/nova/instances/6326434d-56d2-43a0-b171-f0f7bd1de5a8/console.log" append="off"/>
Oct 23 22:00:07 user nova-compute[74337]:     </serial>
Oct 23 22:00:07 user nova-compute[74337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 22:00:07 user nova-compute[74337]:     <video>
Oct 23 22:00:07 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 22:00:07 user nova-compute[74337]:     </video>
Oct 23 22:00:07 user nova-compute[74337]:     <rng model="virtio">
Oct 23 22:00:07 user nova-compute[74337]:       <backend model="random">/dev/urandom</backend>
Oct 23 22:00:07 user nova-compute[74337]:     </rng>
Oct 23 22:00:07 user nova-compute[74337]:     <controller type="usb" index="0" model="none"/>
Oct 23 22:00:07 user nova-compute[74337]:     <memballoon model="virtio">
Oct 23 22:00:07 user nova-compute[74337]:       <stats period="10"/>
Oct 23 22:00:07 user nova-compute[74337]:     </memballoon>
Oct 23 22:00:07 user nova-compute[74337]:   </devices>
Oct 23 22:00:07 user nova-compute[74337]: </domain>
Oct 23 22:00:07 user nova-compute[74337]:  {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 22:00:07 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-4587250a-f89b-4baf-bb10-e796758f5a2b tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T22:00:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-2118885877',display_name='tempest-TestServerVolumeAttachmentScenario-server-2118885877',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-2118885877',id=44,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOlPpRTdCGk73S/8D17g34dxL6zhBVBHh/jBhNVAmyV7YH/pcHQq+lR9RVFeBxv5kS28ecMVZQHX4g06NfynmXoET7yOBu/gz2FTdiyjJoOgJjQCvqCGrUNiiFlSskapqw==',key_name='tempest-keypair-1561680692',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f838429412604ad4a6dea808cf3c92b7',ramdisk_id='',reservation_id='r-n8de0hkt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-919428222',owner_user_name='tempest-TestServerVolumeAttachmentScenario-919428222-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T22:00:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='16f96346d5c44132bfc6ed76966c6930',uuid=6326434d-56d2-43a0-b171-f0f7bd1de5a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2c0d1355-d2c2-4504-82a1-705e29a2d065", "address": "fa:16:3e:06:70:87", "network": {"id": "144e037b-415c-4af4-a16c-081ac621f89b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1182284183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f838429412604ad4a6dea808cf3c92b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c0d1355-d2", "ovs_interfaceid": "2c0d1355-d2c2-4504-82a1-705e29a2d065", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 22:00:07 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-4587250a-f89b-4baf-bb10-e796758f5a2b tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Converting VIF {"id": "2c0d1355-d2c2-4504-82a1-705e29a2d065", "address": "fa:16:3e:06:70:87", "network": {"id": "144e037b-415c-4af4-a16c-081ac621f89b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1182284183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f838429412604ad4a6dea808cf3c92b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c0d1355-d2", "ovs_interfaceid": "2c0d1355-d2c2-4504-82a1-705e29a2d065", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 22:00:07 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-4587250a-f89b-4baf-bb10-e796758f5a2b tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:70:87,bridge_name='br-int',has_traffic_filtering=True,id=2c0d1355-d2c2-4504-82a1-705e29a2d065,network=Network(144e037b-415c-4af4-a16c-081ac621f89b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c0d1355-d2') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 22:00:07 user nova-compute[74337]: DEBUG os_vif [None req-4587250a-f89b-4baf-bb10-e796758f5a2b tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:70:87,bridge_name='br-int',has_traffic_filtering=True,id=2c0d1355-d2c2-4504-82a1-705e29a2d065,network=Network(144e037b-415c-4af4-a16c-081ac621f89b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c0d1355-d2') {{(pid=74337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 22:00:07 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:00:07 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:00:07 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 22:00:07 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:00:07 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b6b9b9af-7de9-5c05-8c8e-ea0e328f5284', '_type': 'linux-noop'}}, row=False) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:00:07 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:00:07 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:00:07 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:00:07 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2c0d1355-d2, may_exist=True, interface_attrs={}) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:00:07 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2c0d1355-d2, col_values=(('qos', UUID('90bdb13f-55bc-45d2-9c2f-871a4a72e5ca')),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:00:07 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2c0d1355-d2, col_values=(('external_ids', {'iface-id': '2c0d1355-d2c2-4504-82a1-705e29a2d065', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:06:70:87', 'vm-uuid': '6326434d-56d2-43a0-b171-f0f7bd1de5a8'}),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:00:07 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:00:07 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:00:07 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:00:07 user nova-compute[74337]: INFO os_vif [None req-4587250a-f89b-4baf-bb10-e796758f5a2b tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:70:87,bridge_name='br-int',has_traffic_filtering=True,id=2c0d1355-d2c2-4504-82a1-705e29a2d065,network=Network(144e037b-415c-4af4-a16c-081ac621f89b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c0d1355-d2')
Oct 23 22:00:07 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-4587250a-f89b-4baf-bb10-e796758f5a2b tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] No BDM found with device name vda, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 22:00:07 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-4587250a-f89b-4baf-bb10-e796758f5a2b tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] No VIF found with MAC fa:16:3e:06:70:87, not building metadata {{(pid=74337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 22:00:07 user nova-compute[74337]: DEBUG nova.network.neutron [req-d46abae2-cc4b-4300-a81d-6d7c3cf68d5f req-a3733e75-81e2-43d1-a869-0efe71e351ec service nova] [instance: 6326434d-56d2-43a0-b171-f0f7bd1de5a8] Updated VIF entry in instance network info cache for port 2c0d1355-d2c2-4504-82a1-705e29a2d065. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 22:00:07 user nova-compute[74337]: DEBUG nova.network.neutron [req-d46abae2-cc4b-4300-a81d-6d7c3cf68d5f req-a3733e75-81e2-43d1-a869-0efe71e351ec service nova] [instance: 6326434d-56d2-43a0-b171-f0f7bd1de5a8] Updating instance_info_cache with network_info: [{"id": "2c0d1355-d2c2-4504-82a1-705e29a2d065", "address": "fa:16:3e:06:70:87", "network": {"id": "144e037b-415c-4af4-a16c-081ac621f89b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1182284183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f838429412604ad4a6dea808cf3c92b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c0d1355-d2", "ovs_interfaceid": "2c0d1355-d2c2-4504-82a1-705e29a2d065", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 22:00:07 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-d46abae2-cc4b-4300-a81d-6d7c3cf68d5f req-a3733e75-81e2-43d1-a869-0efe71e351ec service nova] Releasing lock "refresh_cache-6326434d-56d2-43a0-b171-f0f7bd1de5a8" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 22:00:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:00:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:00:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:00:08 user nova-compute[74337]: DEBUG nova.compute.manager [req-d9ed8614-77d2-40e3-b562-fb1c3db01c84 req-3be8f922-0d47-4b50-870b-178769c3c161 service nova] [instance: 6326434d-56d2-43a0-b171-f0f7bd1de5a8] Received event network-vif-plugged-2c0d1355-d2c2-4504-82a1-705e29a2d065 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:00:08 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-d9ed8614-77d2-40e3-b562-fb1c3db01c84 req-3be8f922-0d47-4b50-870b-178769c3c161 service nova] Acquiring lock "6326434d-56d2-43a0-b171-f0f7bd1de5a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:00:08 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-d9ed8614-77d2-40e3-b562-fb1c3db01c84 req-3be8f922-0d47-4b50-870b-178769c3c161 service nova] Lock "6326434d-56d2-43a0-b171-f0f7bd1de5a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:00:08 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-d9ed8614-77d2-40e3-b562-fb1c3db01c84 req-3be8f922-0d47-4b50-870b-178769c3c161 service nova] Lock "6326434d-56d2-43a0-b171-f0f7bd1de5a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:00:08 user nova-compute[74337]: DEBUG nova.compute.manager [req-d9ed8614-77d2-40e3-b562-fb1c3db01c84 req-3be8f922-0d47-4b50-870b-178769c3c161 service nova] [instance: 6326434d-56d2-43a0-b171-f0f7bd1de5a8] No waiting events found dispatching network-vif-plugged-2c0d1355-d2c2-4504-82a1-705e29a2d065 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 22:00:08 user nova-compute[74337]: WARNING nova.compute.manager [req-d9ed8614-77d2-40e3-b562-fb1c3db01c84 req-3be8f922-0d47-4b50-870b-178769c3c161 service nova] [instance: 6326434d-56d2-43a0-b171-f0f7bd1de5a8] Received unexpected event network-vif-plugged-2c0d1355-d2c2-4504-82a1-705e29a2d065 for instance with vm_state building and task_state spawning.
Oct 23 22:00:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:00:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:00:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:00:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:00:10 user nova-compute[74337]: DEBUG nova.compute.manager [None req-4587250a-f89b-4baf-bb10-e796758f5a2b tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] [instance: 6326434d-56d2-43a0-b171-f0f7bd1de5a8] Instance event wait completed in 0 seconds for  {{(pid=74337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 22:00:10 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-4587250a-f89b-4baf-bb10-e796758f5a2b tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] [instance: 6326434d-56d2-43a0-b171-f0f7bd1de5a8] Guest created on hypervisor {{(pid=74337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 22:00:10 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: 6326434d-56d2-43a0-b171-f0f7bd1de5a8] Instance spawned successfully.
Oct 23 22:00:10 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-4587250a-f89b-4baf-bb10-e796758f5a2b tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] [instance: 6326434d-56d2-43a0-b171-f0f7bd1de5a8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 22:00:10 user nova-compute[74337]: DEBUG nova.compute.manager [req-981fa01c-c012-4ca1-8b2b-041c1db9cd41 req-d0e59b22-f28a-4c76-9b96-c331fcc455e3 service nova] [instance: 6326434d-56d2-43a0-b171-f0f7bd1de5a8] Received event network-vif-plugged-2c0d1355-d2c2-4504-82a1-705e29a2d065 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:00:10 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-981fa01c-c012-4ca1-8b2b-041c1db9cd41 req-d0e59b22-f28a-4c76-9b96-c331fcc455e3 service nova] Acquiring lock "6326434d-56d2-43a0-b171-f0f7bd1de5a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:00:10 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-981fa01c-c012-4ca1-8b2b-041c1db9cd41 req-d0e59b22-f28a-4c76-9b96-c331fcc455e3 service nova] Lock "6326434d-56d2-43a0-b171-f0f7bd1de5a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:00:10 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-981fa01c-c012-4ca1-8b2b-041c1db9cd41 req-d0e59b22-f28a-4c76-9b96-c331fcc455e3 service nova] Lock "6326434d-56d2-43a0-b171-f0f7bd1de5a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:00:10 user nova-compute[74337]: DEBUG nova.compute.manager [req-981fa01c-c012-4ca1-8b2b-041c1db9cd41 req-d0e59b22-f28a-4c76-9b96-c331fcc455e3 service nova] [instance: 6326434d-56d2-43a0-b171-f0f7bd1de5a8] No waiting events found dispatching network-vif-plugged-2c0d1355-d2c2-4504-82a1-705e29a2d065 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 22:00:10 user nova-compute[74337]: WARNING nova.compute.manager [req-981fa01c-c012-4ca1-8b2b-041c1db9cd41 req-d0e59b22-f28a-4c76-9b96-c331fcc455e3 service nova] [instance: 6326434d-56d2-43a0-b171-f0f7bd1de5a8] Received unexpected event network-vif-plugged-2c0d1355-d2c2-4504-82a1-705e29a2d065 for instance with vm_state building and task_state spawning.
Oct 23 22:00:10 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-4587250a-f89b-4baf-bb10-e796758f5a2b tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] [instance: 6326434d-56d2-43a0-b171-f0f7bd1de5a8] Found default for hw_cdrom_bus of ide {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 22:00:10 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-4587250a-f89b-4baf-bb10-e796758f5a2b tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] [instance: 6326434d-56d2-43a0-b171-f0f7bd1de5a8] Found default for hw_disk_bus of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 22:00:10 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-4587250a-f89b-4baf-bb10-e796758f5a2b tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] [instance: 6326434d-56d2-43a0-b171-f0f7bd1de5a8] Found default for hw_input_bus of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 22:00:10 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-4587250a-f89b-4baf-bb10-e796758f5a2b tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] [instance: 6326434d-56d2-43a0-b171-f0f7bd1de5a8] Found default for hw_pointer_model of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 22:00:10 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-4587250a-f89b-4baf-bb10-e796758f5a2b tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] [instance: 6326434d-56d2-43a0-b171-f0f7bd1de5a8] Found default for hw_video_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 22:00:10 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-4587250a-f89b-4baf-bb10-e796758f5a2b tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] [instance: 6326434d-56d2-43a0-b171-f0f7bd1de5a8] Found default for hw_vif_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 22:00:10 user nova-compute[74337]: INFO nova.compute.manager [None req-4587250a-f89b-4baf-bb10-e796758f5a2b tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] [instance: 6326434d-56d2-43a0-b171-f0f7bd1de5a8] Took 5.81 seconds to spawn the instance on the hypervisor.
Oct 23 22:00:10 user nova-compute[74337]: DEBUG nova.compute.manager [None req-4587250a-f89b-4baf-bb10-e796758f5a2b tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] [instance: 6326434d-56d2-43a0-b171-f0f7bd1de5a8] Checking state {{(pid=74337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 22:00:11 user nova-compute[74337]: INFO nova.compute.manager [None req-4587250a-f89b-4baf-bb10-e796758f5a2b tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] [instance: 6326434d-56d2-43a0-b171-f0f7bd1de5a8] Took 6.63 seconds to build instance.
Oct 23 22:00:11 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4587250a-f89b-4baf-bb10-e796758f5a2b tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Lock "6326434d-56d2-43a0-b171-f0f7bd1de5a8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.740s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:00:12 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:00:13 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:00:17 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:00:17 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:00:17 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:00:17 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:00:17 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 22:00:18 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:00:19 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:00:20 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:00:20 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Starting heal instance info cache {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 22:00:20 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Skipping network cache update for instance because it has been migrated to another host. {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9965}}
Oct 23 22:00:20 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Didn't find any instances for network info cache update. {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 23 22:00:21 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:00:21 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:00:21 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Triggering sync for uuid 999843b2-b757-480b-bd21-bf281954bc46 {{(pid=74337) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 23 22:00:21 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Triggering sync for uuid 27710919-a717-42fa-a436-a261d92c1c2a {{(pid=74337) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 23 22:00:21 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Triggering sync for uuid 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c {{(pid=74337) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 23 22:00:21 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Triggering sync for uuid 6326434d-56d2-43a0-b171-f0f7bd1de5a8 {{(pid=74337) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 23 22:00:21 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "999843b2-b757-480b-bd21-bf281954bc46" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:00:21 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "999843b2-b757-480b-bd21-bf281954bc46" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:00:21 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "27710919-a717-42fa-a436-a261d92c1c2a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:00:21 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "27710919-a717-42fa-a436-a261d92c1c2a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:00:21 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:00:21 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:00:21 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "6326434d-56d2-43a0-b171-f0f7bd1de5a8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:00:21 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "6326434d-56d2-43a0-b171-f0f7bd1de5a8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:00:21 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "999843b2-b757-480b-bd21-bf281954bc46" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.034s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:00:21 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "27710919-a717-42fa-a436-a261d92c1c2a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.035s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:00:21 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.037s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:00:21 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "6326434d-56d2-43a0-b171-f0f7bd1de5a8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.038s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:00:22 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:00:22 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:00:23 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:00:23 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:00:23 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:00:23 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:00:23 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Auditing locally available compute resources for user (node: user) {{(pid=74337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 22:00:23 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/999843b2-b757-480b-bd21-bf281954bc46/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:00:23 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/999843b2-b757-480b-bd21-bf281954bc46/disk --force-share --output=json" returned: 0 in 0.321s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:00:23 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/999843b2-b757-480b-bd21-bf281954bc46/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:00:23 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:00:24 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/999843b2-b757-480b-bd21-bf281954bc46/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:00:24 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6326434d-56d2-43a0-b171-f0f7bd1de5a8/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:00:24 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6326434d-56d2-43a0-b171-f0f7bd1de5a8/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:00:24 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6326434d-56d2-43a0-b171-f0f7bd1de5a8/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:00:24 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6326434d-56d2-43a0-b171-f0f7bd1de5a8/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:00:24 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:00:24 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:00:24 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:00:24 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:00:24 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:00:25 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:00:25 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:00:25 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:00:25 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:00:25 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:00:25 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Hypervisor/Node resource view: name=user free_ram=8145MB free_disk=25.253910064697266GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 22:00:25 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:00:25 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:00:25 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 0323b854-c7a1-42e8-ad85-1e929caa6e9d has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Oct 23 22:00:25 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 999843b2-b757-480b-bd21-bf281954bc46 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 22:00:25 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 27710919-a717-42fa-a436-a261d92c1c2a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 22:00:25 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 22:00:25 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 6326434d-56d2-43a0-b171-f0f7bd1de5a8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 22:00:25 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 22:00:25 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 22:00:26 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 22:00:26 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 22:00:26 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Compute_service record updated for user:user {{(pid=74337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 22:00:26 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.359s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:00:27 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:00:28 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:00:31 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:00:32 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:00:33 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:00:34 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:00:34 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:00:34 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:00:37 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:00:37 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:00:38 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:00:39 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:00:40 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:00:41 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-54d8dc23-20da-449f-9231-c2deec58823d tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Acquiring lock "dbad2e14-7b6c-475e-b471-a87cb9e21b7f" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:00:41 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-54d8dc23-20da-449f-9231-c2deec58823d tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Lock "dbad2e14-7b6c-475e-b471-a87cb9e21b7f" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:00:41 user nova-compute[74337]: INFO nova.compute.manager [None req-54d8dc23-20da-449f-9231-c2deec58823d tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Unshelving
Oct 23 22:00:41 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-54d8dc23-20da-449f-9231-c2deec58823d tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:00:41 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-54d8dc23-20da-449f-9231-c2deec58823d tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:00:41 user nova-compute[74337]: DEBUG nova.objects.instance [None req-54d8dc23-20da-449f-9231-c2deec58823d tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Lazy-loading 'pci_requests' on Instance uuid dbad2e14-7b6c-475e-b471-a87cb9e21b7f {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:00:41 user nova-compute[74337]: DEBUG nova.objects.instance [None req-54d8dc23-20da-449f-9231-c2deec58823d tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Lazy-loading 'numa_topology' on Instance uuid dbad2e14-7b6c-475e-b471-a87cb9e21b7f {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:00:41 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-54d8dc23-20da-449f-9231-c2deec58823d tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 22:00:41 user nova-compute[74337]: INFO nova.compute.claims [None req-54d8dc23-20da-449f-9231-c2deec58823d tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Claim successful on node user
Oct 23 22:00:42 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-54d8dc23-20da-449f-9231-c2deec58823d tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 22:00:42 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-54d8dc23-20da-449f-9231-c2deec58823d tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 22:00:42 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-54d8dc23-20da-449f-9231-c2deec58823d tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.325s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:00:42 user nova-compute[74337]: INFO nova.network.neutron [None req-54d8dc23-20da-449f-9231-c2deec58823d tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Updating port 0b516177-6ded-4b79-9f77-84ba1466f259 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Oct 23 22:00:42 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:00:42 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-54d8dc23-20da-449f-9231-c2deec58823d tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Acquiring lock "refresh_cache-dbad2e14-7b6c-475e-b471-a87cb9e21b7f" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 22:00:42 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-54d8dc23-20da-449f-9231-c2deec58823d tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Acquired lock "refresh_cache-dbad2e14-7b6c-475e-b471-a87cb9e21b7f" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 22:00:42 user nova-compute[74337]: DEBUG nova.network.neutron [None req-54d8dc23-20da-449f-9231-c2deec58823d tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Building network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 22:00:42 user nova-compute[74337]: DEBUG nova.compute.manager [req-a4361159-2500-43ce-a611-df4bd2bc3e8b req-4f40d4ad-08e9-4c41-b461-52238cab6da0 service nova] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Received event network-changed-0b516177-6ded-4b79-9f77-84ba1466f259 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:00:42 user nova-compute[74337]: DEBUG nova.compute.manager [req-a4361159-2500-43ce-a611-df4bd2bc3e8b req-4f40d4ad-08e9-4c41-b461-52238cab6da0 service nova] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Refreshing instance network info cache due to event network-changed-0b516177-6ded-4b79-9f77-84ba1466f259. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 22:00:42 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-a4361159-2500-43ce-a611-df4bd2bc3e8b req-4f40d4ad-08e9-4c41-b461-52238cab6da0 service nova] Acquiring lock "refresh_cache-dbad2e14-7b6c-475e-b471-a87cb9e21b7f" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 22:00:43 user nova-compute[74337]: DEBUG nova.network.neutron [None req-54d8dc23-20da-449f-9231-c2deec58823d tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Updating instance_info_cache with network_info: [{"id": "0b516177-6ded-4b79-9f77-84ba1466f259", "address": "fa:16:3e:3e:3f:19", "network": {"id": "0feb8c56-c17f-47d0-9796-91d4bd20e81d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1399506675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd8afde978624cf8a2356e8ce8b4d3f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b516177-6d", "ovs_interfaceid": "0b516177-6ded-4b79-9f77-84ba1466f259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 22:00:43 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-54d8dc23-20da-449f-9231-c2deec58823d tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Releasing lock "refresh_cache-dbad2e14-7b6c-475e-b471-a87cb9e21b7f" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 22:00:43 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-54d8dc23-20da-449f-9231-c2deec58823d tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Creating instance directory {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 22:00:43 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-54d8dc23-20da-449f-9231-c2deec58823d tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Creating image(s)
Oct 23 22:00:43 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-54d8dc23-20da-449f-9231-c2deec58823d tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Acquiring lock "/opt/stack/data/nova/instances/dbad2e14-7b6c-475e-b471-a87cb9e21b7f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:00:43 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-54d8dc23-20da-449f-9231-c2deec58823d tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Lock "/opt/stack/data/nova/instances/dbad2e14-7b6c-475e-b471-a87cb9e21b7f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:00:43 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-54d8dc23-20da-449f-9231-c2deec58823d tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Lock "/opt/stack/data/nova/instances/dbad2e14-7b6c-475e-b471-a87cb9e21b7f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:00:43 user nova-compute[74337]: DEBUG nova.objects.instance [None req-54d8dc23-20da-449f-9231-c2deec58823d tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Lazy-loading 'trusted_certs' on Instance uuid dbad2e14-7b6c-475e-b471-a87cb9e21b7f {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:00:43 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-a4361159-2500-43ce-a611-df4bd2bc3e8b req-4f40d4ad-08e9-4c41-b461-52238cab6da0 service nova] Acquired lock "refresh_cache-dbad2e14-7b6c-475e-b471-a87cb9e21b7f" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 22:00:43 user nova-compute[74337]: DEBUG nova.network.neutron [req-a4361159-2500-43ce-a611-df4bd2bc3e8b req-4f40d4ad-08e9-4c41-b461-52238cab6da0 service nova] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Refreshing network info cache for port 0b516177-6ded-4b79-9f77-84ba1466f259 {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 22:00:43 user nova-compute[74337]: DEBUG nova.objects.base [None req-54d8dc23-20da-449f-9231-c2deec58823d tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Object Instance<dbad2e14-7b6c-475e-b471-a87cb9e21b7f> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 22:00:43 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-54d8dc23-20da-449f-9231-c2deec58823d tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Acquiring lock "28680da52240c940085d2156dc603d09ed4cfa61" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:00:43 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-54d8dc23-20da-449f-9231-c2deec58823d tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Lock "28680da52240c940085d2156dc603d09ed4cfa61" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:00:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-54d8dc23-20da-449f-9231-c2deec58823d tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28680da52240c940085d2156dc603d09ed4cfa61.part --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:00:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:00:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-fbf0443a-b5d7-4857-a192-b0bd1ff652d5 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Acquiring lock "b7a67b37-36b4-42d4-a1a3-7e5d9896d948" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:00:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-fbf0443a-b5d7-4857-a192-b0bd1ff652d5 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Lock "b7a67b37-36b4-42d4-a1a3-7e5d9896d948" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:00:44 user nova-compute[74337]: DEBUG nova.compute.manager [None req-fbf0443a-b5d7-4857-a192-b0bd1ff652d5 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] [instance: b7a67b37-36b4-42d4-a1a3-7e5d9896d948] Starting instance... {{(pid=74337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 22:00:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-fbf0443a-b5d7-4857-a192-b0bd1ff652d5 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:00:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-fbf0443a-b5d7-4857-a192-b0bd1ff652d5 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:00:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-54d8dc23-20da-449f-9231-c2deec58823d tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28680da52240c940085d2156dc603d09ed4cfa61.part --force-share --output=json" returned: 0 in 0.184s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:00:44 user nova-compute[74337]: DEBUG nova.virt.images [None req-54d8dc23-20da-449f-9231-c2deec58823d tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] 7507d6a0-9570-4b7f-ad30-d527cae18b71 was qcow2, converting to raw {{(pid=74337) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 23 22:00:44 user nova-compute[74337]: DEBUG nova.privsep.utils [None req-54d8dc23-20da-449f-9231-c2deec58823d tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74337) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 23 22:00:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-54d8dc23-20da-449f-9231-c2deec58823d tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/28680da52240c940085d2156dc603d09ed4cfa61.part /opt/stack/data/nova/instances/_base/28680da52240c940085d2156dc603d09ed4cfa61.converted {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:00:44 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-fbf0443a-b5d7-4857-a192-b0bd1ff652d5 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 22:00:44 user nova-compute[74337]: INFO nova.compute.claims [None req-fbf0443a-b5d7-4857-a192-b0bd1ff652d5 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] [instance: b7a67b37-36b4-42d4-a1a3-7e5d9896d948] Claim successful on node user
Oct 23 22:00:44 user nova-compute[74337]: DEBUG nova.network.neutron [req-a4361159-2500-43ce-a611-df4bd2bc3e8b req-4f40d4ad-08e9-4c41-b461-52238cab6da0 service nova] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Updated VIF entry in instance network info cache for port 0b516177-6ded-4b79-9f77-84ba1466f259. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 22:00:44 user nova-compute[74337]: DEBUG nova.network.neutron [req-a4361159-2500-43ce-a611-df4bd2bc3e8b req-4f40d4ad-08e9-4c41-b461-52238cab6da0 service nova] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Updating instance_info_cache with network_info: [{"id": "0b516177-6ded-4b79-9f77-84ba1466f259", "address": "fa:16:3e:3e:3f:19", "network": {"id": "0feb8c56-c17f-47d0-9796-91d4bd20e81d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1399506675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd8afde978624cf8a2356e8ce8b4d3f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b516177-6d", "ovs_interfaceid": "0b516177-6ded-4b79-9f77-84ba1466f259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 22:00:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-a4361159-2500-43ce-a611-df4bd2bc3e8b req-4f40d4ad-08e9-4c41-b461-52238cab6da0 service nova] Releasing lock "refresh_cache-dbad2e14-7b6c-475e-b471-a87cb9e21b7f" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 22:00:44 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-fbf0443a-b5d7-4857-a192-b0bd1ff652d5 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 22:00:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-54d8dc23-20da-449f-9231-c2deec58823d tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/28680da52240c940085d2156dc603d09ed4cfa61.part /opt/stack/data/nova/instances/_base/28680da52240c940085d2156dc603d09ed4cfa61.converted" returned: 0 in 0.547s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:00:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-54d8dc23-20da-449f-9231-c2deec58823d tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28680da52240c940085d2156dc603d09ed4cfa61.converted --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:00:45 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-fbf0443a-b5d7-4857-a192-b0bd1ff652d5 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 22:00:45 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-fbf0443a-b5d7-4857-a192-b0bd1ff652d5 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.658s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:00:45 user nova-compute[74337]: DEBUG nova.compute.manager [None req-fbf0443a-b5d7-4857-a192-b0bd1ff652d5 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] [instance: b7a67b37-36b4-42d4-a1a3-7e5d9896d948] Start building networks asynchronously for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 22:00:45 user nova-compute[74337]: DEBUG nova.compute.manager [None req-fbf0443a-b5d7-4857-a192-b0bd1ff652d5 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] [instance: b7a67b37-36b4-42d4-a1a3-7e5d9896d948] Allocating IP information in the background. {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 22:00:45 user nova-compute[74337]: DEBUG nova.network.neutron [None req-fbf0443a-b5d7-4857-a192-b0bd1ff652d5 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] [instance: b7a67b37-36b4-42d4-a1a3-7e5d9896d948] allocate_for_instance() {{(pid=74337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 22:00:45 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-fbf0443a-b5d7-4857-a192-b0bd1ff652d5 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] [instance: b7a67b37-36b4-42d4-a1a3-7e5d9896d948] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 22:00:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-54d8dc23-20da-449f-9231-c2deec58823d tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28680da52240c940085d2156dc603d09ed4cfa61.converted --force-share --output=json" returned: 0 in 0.178s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:00:45 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-54d8dc23-20da-449f-9231-c2deec58823d tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Lock "28680da52240c940085d2156dc603d09ed4cfa61" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:00:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-54d8dc23-20da-449f-9231-c2deec58823d tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28680da52240c940085d2156dc603d09ed4cfa61 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:00:45 user nova-compute[74337]: DEBUG nova.compute.manager [None req-fbf0443a-b5d7-4857-a192-b0bd1ff652d5 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] [instance: b7a67b37-36b4-42d4-a1a3-7e5d9896d948] Start building block device mappings for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 22:00:45 user nova-compute[74337]: DEBUG nova.policy [None req-fbf0443a-b5d7-4857-a192-b0bd1ff652d5 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd005925ecc004b1a9b63d24d9f753256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b672a253930043eda6ea2b27559f15fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74337) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 22:00:45 user nova-compute[74337]: DEBUG nova.compute.manager [None req-fbf0443a-b5d7-4857-a192-b0bd1ff652d5 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] [instance: b7a67b37-36b4-42d4-a1a3-7e5d9896d948] Start spawning the instance on the hypervisor. {{(pid=74337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 22:00:45 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-fbf0443a-b5d7-4857-a192-b0bd1ff652d5 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] [instance: b7a67b37-36b4-42d4-a1a3-7e5d9896d948] Creating instance directory {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 22:00:45 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-fbf0443a-b5d7-4857-a192-b0bd1ff652d5 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] [instance: b7a67b37-36b4-42d4-a1a3-7e5d9896d948] Creating image(s)
Oct 23 22:00:45 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-fbf0443a-b5d7-4857-a192-b0bd1ff652d5 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Acquiring lock "/opt/stack/data/nova/instances/b7a67b37-36b4-42d4-a1a3-7e5d9896d948/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:00:45 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-fbf0443a-b5d7-4857-a192-b0bd1ff652d5 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Lock "/opt/stack/data/nova/instances/b7a67b37-36b4-42d4-a1a3-7e5d9896d948/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:00:45 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-fbf0443a-b5d7-4857-a192-b0bd1ff652d5 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Lock "/opt/stack/data/nova/instances/b7a67b37-36b4-42d4-a1a3-7e5d9896d948/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:00:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-fbf0443a-b5d7-4857-a192-b0bd1ff652d5 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:00:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-54d8dc23-20da-449f-9231-c2deec58823d tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28680da52240c940085d2156dc603d09ed4cfa61 --force-share --output=json" returned: 0 in 0.236s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:00:45 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-54d8dc23-20da-449f-9231-c2deec58823d tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Acquiring lock "28680da52240c940085d2156dc603d09ed4cfa61" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:00:45 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-54d8dc23-20da-449f-9231-c2deec58823d tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Lock "28680da52240c940085d2156dc603d09ed4cfa61" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:00:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-54d8dc23-20da-449f-9231-c2deec58823d tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28680da52240c940085d2156dc603d09ed4cfa61 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:00:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-fbf0443a-b5d7-4857-a192-b0bd1ff652d5 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.177s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:00:45 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-fbf0443a-b5d7-4857-a192-b0bd1ff652d5 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Acquiring lock "fc7b140751b8c385de81623e40fb09ce09374ab7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:00:45 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-fbf0443a-b5d7-4857-a192-b0bd1ff652d5 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Lock "fc7b140751b8c385de81623e40fb09ce09374ab7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:00:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-fbf0443a-b5d7-4857-a192-b0bd1ff652d5 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:00:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-54d8dc23-20da-449f-9231-c2deec58823d tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28680da52240c940085d2156dc603d09ed4cfa61 --force-share --output=json" returned: 0 in 0.180s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:00:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-54d8dc23-20da-449f-9231-c2deec58823d tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28680da52240c940085d2156dc603d09ed4cfa61,backing_fmt=raw /opt/stack/data/nova/instances/dbad2e14-7b6c-475e-b471-a87cb9e21b7f/disk 1073741824 {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:00:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-54d8dc23-20da-449f-9231-c2deec58823d tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28680da52240c940085d2156dc603d09ed4cfa61,backing_fmt=raw /opt/stack/data/nova/instances/dbad2e14-7b6c-475e-b471-a87cb9e21b7f/disk 1073741824" returned: 0 in 0.053s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:00:45 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-54d8dc23-20da-449f-9231-c2deec58823d tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Lock "28680da52240c940085d2156dc603d09ed4cfa61" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:00:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-54d8dc23-20da-449f-9231-c2deec58823d tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28680da52240c940085d2156dc603d09ed4cfa61 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:00:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-fbf0443a-b5d7-4857-a192-b0bd1ff652d5 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.190s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:00:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-fbf0443a-b5d7-4857-a192-b0bd1ff652d5 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7,backing_fmt=raw /opt/stack/data/nova/instances/b7a67b37-36b4-42d4-a1a3-7e5d9896d948/disk 1073741824 {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:00:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-fbf0443a-b5d7-4857-a192-b0bd1ff652d5 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7,backing_fmt=raw /opt/stack/data/nova/instances/b7a67b37-36b4-42d4-a1a3-7e5d9896d948/disk 1073741824" returned: 0 in 0.049s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:00:45 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-fbf0443a-b5d7-4857-a192-b0bd1ff652d5 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Lock "fc7b140751b8c385de81623e40fb09ce09374ab7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:00:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-fbf0443a-b5d7-4857-a192-b0bd1ff652d5 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:00:45 user nova-compute[74337]: DEBUG nova.network.neutron [None req-fbf0443a-b5d7-4857-a192-b0bd1ff652d5 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] [instance: b7a67b37-36b4-42d4-a1a3-7e5d9896d948] Successfully created port: 35fea171-071b-4e56-8bb4-a4185a1e6da3 {{(pid=74337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 22:00:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-54d8dc23-20da-449f-9231-c2deec58823d tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28680da52240c940085d2156dc603d09ed4cfa61 --force-share --output=json" returned: 0 in 0.196s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:00:45 user nova-compute[74337]: DEBUG nova.objects.instance [None req-54d8dc23-20da-449f-9231-c2deec58823d tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Lazy-loading 'migration_context' on Instance uuid dbad2e14-7b6c-475e-b471-a87cb9e21b7f {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:00:45 user nova-compute[74337]: DEBUG nova.objects.base [None req-54d8dc23-20da-449f-9231-c2deec58823d tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Object Instance<dbad2e14-7b6c-475e-b471-a87cb9e21b7f> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 22:00:45 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-54d8dc23-20da-449f-9231-c2deec58823d tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Rebasing disk image.
Oct 23 22:00:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-54d8dc23-20da-449f-9231-c2deec58823d tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:00:46 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-fbf0443a-b5d7-4857-a192-b0bd1ff652d5 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.170s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:00:46 user nova-compute[74337]: DEBUG nova.virt.disk.api [None req-fbf0443a-b5d7-4857-a192-b0bd1ff652d5 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b7a67b37-36b4-42d4-a1a3-7e5d9896d948/disk. size=1073741824 {{(pid=74337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 22:00:46 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-fbf0443a-b5d7-4857-a192-b0bd1ff652d5 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7a67b37-36b4-42d4-a1a3-7e5d9896d948/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:00:46 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-54d8dc23-20da-449f-9231-c2deec58823d tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.172s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:00:46 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-54d8dc23-20da-449f-9231-c2deec58823d tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 -F raw /opt/stack/data/nova/instances/dbad2e14-7b6c-475e-b471-a87cb9e21b7f/disk {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:00:46 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-fbf0443a-b5d7-4857-a192-b0bd1ff652d5 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7a67b37-36b4-42d4-a1a3-7e5d9896d948/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:00:46 user nova-compute[74337]: DEBUG nova.virt.disk.api [None req-fbf0443a-b5d7-4857-a192-b0bd1ff652d5 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Cannot resize image /opt/stack/data/nova/instances/b7a67b37-36b4-42d4-a1a3-7e5d9896d948/disk to a smaller size. {{(pid=74337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 22:00:46 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-fbf0443a-b5d7-4857-a192-b0bd1ff652d5 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] [instance: b7a67b37-36b4-42d4-a1a3-7e5d9896d948] Created local disks {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 22:00:46 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-fbf0443a-b5d7-4857-a192-b0bd1ff652d5 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] [instance: b7a67b37-36b4-42d4-a1a3-7e5d9896d948] Ensure instance console log exists: /opt/stack/data/nova/instances/b7a67b37-36b4-42d4-a1a3-7e5d9896d948/console.log {{(pid=74337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 22:00:46 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-fbf0443a-b5d7-4857-a192-b0bd1ff652d5 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:00:46 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-fbf0443a-b5d7-4857-a192-b0bd1ff652d5 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:00:46 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-fbf0443a-b5d7-4857-a192-b0bd1ff652d5 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:00:46 user nova-compute[74337]: DEBUG nova.network.neutron [None req-fbf0443a-b5d7-4857-a192-b0bd1ff652d5 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] [instance: b7a67b37-36b4-42d4-a1a3-7e5d9896d948] Successfully updated port: 35fea171-071b-4e56-8bb4-a4185a1e6da3 {{(pid=74337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 22:00:46 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-fbf0443a-b5d7-4857-a192-b0bd1ff652d5 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Acquiring lock "refresh_cache-b7a67b37-36b4-42d4-a1a3-7e5d9896d948" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 22:00:46 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-fbf0443a-b5d7-4857-a192-b0bd1ff652d5 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Acquired lock "refresh_cache-b7a67b37-36b4-42d4-a1a3-7e5d9896d948" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 22:00:46 user nova-compute[74337]: DEBUG nova.network.neutron [None req-fbf0443a-b5d7-4857-a192-b0bd1ff652d5 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] [instance: b7a67b37-36b4-42d4-a1a3-7e5d9896d948] Building network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 22:00:46 user nova-compute[74337]: DEBUG nova.compute.manager [req-07c2ab0c-78a0-4a37-a36f-78fa248e8ca3 req-d9a2d037-58d9-40a4-88c3-398107b55228 service nova] [instance: b7a67b37-36b4-42d4-a1a3-7e5d9896d948] Received event network-changed-35fea171-071b-4e56-8bb4-a4185a1e6da3 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:00:46 user nova-compute[74337]: DEBUG nova.compute.manager [req-07c2ab0c-78a0-4a37-a36f-78fa248e8ca3 req-d9a2d037-58d9-40a4-88c3-398107b55228 service nova] [instance: b7a67b37-36b4-42d4-a1a3-7e5d9896d948] Refreshing instance network info cache due to event network-changed-35fea171-071b-4e56-8bb4-a4185a1e6da3. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 22:00:46 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-07c2ab0c-78a0-4a37-a36f-78fa248e8ca3 req-d9a2d037-58d9-40a4-88c3-398107b55228 service nova] Acquiring lock "refresh_cache-b7a67b37-36b4-42d4-a1a3-7e5d9896d948" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 22:00:46 user nova-compute[74337]: DEBUG nova.network.neutron [None req-fbf0443a-b5d7-4857-a192-b0bd1ff652d5 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] [instance: b7a67b37-36b4-42d4-a1a3-7e5d9896d948] Instance cache missing network info. {{(pid=74337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 22:00:47 user nova-compute[74337]: DEBUG nova.network.neutron [None req-fbf0443a-b5d7-4857-a192-b0bd1ff652d5 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] [instance: b7a67b37-36b4-42d4-a1a3-7e5d9896d948] Updating instance_info_cache with network_info: [{"id": "35fea171-071b-4e56-8bb4-a4185a1e6da3", "address": "fa:16:3e:d3:de:6c", "network": {"id": "2afac13f-fb75-4d79-ae11-92c0c98e710f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-597086266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b672a253930043eda6ea2b27559f15fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35fea171-07", "ovs_interfaceid": "35fea171-071b-4e56-8bb4-a4185a1e6da3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 22:00:47 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-fbf0443a-b5d7-4857-a192-b0bd1ff652d5 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Releasing lock "refresh_cache-b7a67b37-36b4-42d4-a1a3-7e5d9896d948" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 22:00:47 user nova-compute[74337]: DEBUG nova.compute.manager [None req-fbf0443a-b5d7-4857-a192-b0bd1ff652d5 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] [instance: b7a67b37-36b4-42d4-a1a3-7e5d9896d948] Instance network_info: |[{"id": "35fea171-071b-4e56-8bb4-a4185a1e6da3", "address": "fa:16:3e:d3:de:6c", "network": {"id": "2afac13f-fb75-4d79-ae11-92c0c98e710f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-597086266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b672a253930043eda6ea2b27559f15fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35fea171-07", "ovs_interfaceid": "35fea171-071b-4e56-8bb4-a4185a1e6da3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 22:00:47 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-07c2ab0c-78a0-4a37-a36f-78fa248e8ca3 req-d9a2d037-58d9-40a4-88c3-398107b55228 service nova] Acquired lock "refresh_cache-b7a67b37-36b4-42d4-a1a3-7e5d9896d948" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 22:00:47 user nova-compute[74337]: DEBUG nova.network.neutron [req-07c2ab0c-78a0-4a37-a36f-78fa248e8ca3 req-d9a2d037-58d9-40a4-88c3-398107b55228 service nova] [instance: b7a67b37-36b4-42d4-a1a3-7e5d9896d948] Refreshing network info cache for port 35fea171-071b-4e56-8bb4-a4185a1e6da3 {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 22:00:47 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-fbf0443a-b5d7-4857-a192-b0bd1ff652d5 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] [instance: b7a67b37-36b4-42d4-a1a3-7e5d9896d948] Start _get_guest_xml network_info=[{"id": "35fea171-071b-4e56-8bb4-a4185a1e6da3", "address": "fa:16:3e:d3:de:6c", "network": {"id": "2afac13f-fb75-4d79-ae11-92c0c98e710f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-597086266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b672a253930043eda6ea2b27559f15fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35fea171-07", "ovs_interfaceid": "35fea171-071b-4e56-8bb4-a4185a1e6da3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T21:29:21Z,direct_url=<?>,disk_format='qcow2',id=d859d89d-998d-4109-b26a-0d6e28152932,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ff43462300764979a6cf688444336a56',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T21:29:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'image_id': 'd859d89d-998d-4109-b26a-0d6e28152932'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 22:00:47 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-fbf0443a-b5d7-4857-a192-b0bd1ff652d5 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:00:47 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-fbf0443a-b5d7-4857-a192-b0bd1ff652d5 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:00:47 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-fbf0443a-b5d7-4857-a192-b0bd1ff652d5 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 22:00:47 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-fbf0443a-b5d7-4857-a192-b0bd1ff652d5 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] CPU controller missing on host. {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 22:00:47 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-fbf0443a-b5d7-4857-a192-b0bd1ff652d5 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 22:00:47 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-fbf0443a-b5d7-4857-a192-b0bd1ff652d5 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] CPU controller found on host. {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 22:00:47 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-fbf0443a-b5d7-4857-a192-b0bd1ff652d5 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 22:00:47 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-fbf0443a-b5d7-4857-a192-b0bd1ff652d5 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T21:29:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T21:29:21Z,direct_url=<?>,disk_format='qcow2',id=d859d89d-998d-4109-b26a-0d6e28152932,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ff43462300764979a6cf688444336a56',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T21:29:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 22:00:47 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-fbf0443a-b5d7-4857-a192-b0bd1ff652d5 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Flavor limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 22:00:47 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-fbf0443a-b5d7-4857-a192-b0bd1ff652d5 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Image limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 22:00:47 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-fbf0443a-b5d7-4857-a192-b0bd1ff652d5 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Flavor pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 22:00:47 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-fbf0443a-b5d7-4857-a192-b0bd1ff652d5 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Image pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 22:00:47 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-fbf0443a-b5d7-4857-a192-b0bd1ff652d5 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 22:00:47 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-fbf0443a-b5d7-4857-a192-b0bd1ff652d5 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 22:00:47 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-fbf0443a-b5d7-4857-a192-b0bd1ff652d5 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 22:00:47 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-fbf0443a-b5d7-4857-a192-b0bd1ff652d5 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Got 1 possible topologies {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 22:00:47 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-fbf0443a-b5d7-4857-a192-b0bd1ff652d5 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 22:00:47 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-fbf0443a-b5d7-4857-a192-b0bd1ff652d5 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 22:00:47 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-fbf0443a-b5d7-4857-a192-b0bd1ff652d5 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T22:00:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-550311047',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-550311047',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-5503110',id=45,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHlF2PNKbzrW2vMSs7/oFAAPXg77UNXSK1f4N7vZjuT0m5sk7VZ8HztHE49e0R95Q2tXzYgEReuiBKtnYfnPuRKvFSHbTWtDFSVgZqCBA9oR92jZjHDZbzyiVPukN3kTNw==',key_name='tempest-keypair-66739911',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b672a253930043eda6ea2b27559f15fb',ramdisk_id='',reservation_id='r-h37c30i0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-878947822',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T22:00:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d005925ecc004b1a9b63d24d9f753256',uuid=b7a67b37-36b4-42d4-a1a3-7e5d9896d948,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "35fea171-071b-4e56-8bb4-a4185a1e6da3", "address": "fa:16:3e:d3:de:6c", "network": {"id": "2afac13f-fb75-4d79-ae11-92c0c98e710f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-597086266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b672a253930043eda6ea2b27559f15fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35fea171-07", "ovs_interfaceid": "35fea171-071b-4e56-8bb4-a4185a1e6da3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 22:00:47 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-fbf0443a-b5d7-4857-a192-b0bd1ff652d5 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Converting VIF {"id": "35fea171-071b-4e56-8bb4-a4185a1e6da3", "address": "fa:16:3e:d3:de:6c", "network": {"id": "2afac13f-fb75-4d79-ae11-92c0c98e710f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-597086266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b672a253930043eda6ea2b27559f15fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35fea171-07", "ovs_interfaceid": "35fea171-071b-4e56-8bb4-a4185a1e6da3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 22:00:47 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-fbf0443a-b5d7-4857-a192-b0bd1ff652d5 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:de:6c,bridge_name='br-int',has_traffic_filtering=True,id=35fea171-071b-4e56-8bb4-a4185a1e6da3,network=Network(2afac13f-fb75-4d79-ae11-92c0c98e710f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35fea171-07') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 22:00:47 user nova-compute[74337]: DEBUG nova.objects.instance [None req-fbf0443a-b5d7-4857-a192-b0bd1ff652d5 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Lazy-loading 'pci_devices' on Instance uuid b7a67b37-36b4-42d4-a1a3-7e5d9896d948 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:00:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:00:47 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-fbf0443a-b5d7-4857-a192-b0bd1ff652d5 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] [instance: b7a67b37-36b4-42d4-a1a3-7e5d9896d948] End _get_guest_xml xml=<domain type="kvm">
Oct 23 22:00:47 user nova-compute[74337]:   <uuid>b7a67b37-36b4-42d4-a1a3-7e5d9896d948</uuid>
Oct 23 22:00:47 user nova-compute[74337]:   <name>instance-0000002d</name>
Oct 23 22:00:47 user nova-compute[74337]:   <memory>524288</memory>
Oct 23 22:00:47 user nova-compute[74337]:   <vcpu>1</vcpu>
Oct 23 22:00:47 user nova-compute[74337]:   <metadata>
Oct 23 22:00:47 user nova-compute[74337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 22:00:47 user nova-compute[74337]:       <nova:package version="0.0.0"/>
Oct 23 22:00:47 user nova-compute[74337]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-550311047</nova:name>
Oct 23 22:00:47 user nova-compute[74337]:       <nova:creationTime>2023-10-23 22:00:47</nova:creationTime>
Oct 23 22:00:47 user nova-compute[74337]:       <nova:flavor name="m1.tiny">
Oct 23 22:00:47 user nova-compute[74337]:         <nova:memory>512</nova:memory>
Oct 23 22:00:47 user nova-compute[74337]:         <nova:disk>1</nova:disk>
Oct 23 22:00:47 user nova-compute[74337]:         <nova:swap>0</nova:swap>
Oct 23 22:00:47 user nova-compute[74337]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 22:00:47 user nova-compute[74337]:         <nova:vcpus>1</nova:vcpus>
Oct 23 22:00:47 user nova-compute[74337]:       </nova:flavor>
Oct 23 22:00:47 user nova-compute[74337]:       <nova:owner>
Oct 23 22:00:47 user nova-compute[74337]:         <nova:user uuid="d005925ecc004b1a9b63d24d9f753256">tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member</nova:user>
Oct 23 22:00:47 user nova-compute[74337]:         <nova:project uuid="b672a253930043eda6ea2b27559f15fb">tempest-TestServerVolumeAttachScenarioOldVersion-878947822</nova:project>
Oct 23 22:00:47 user nova-compute[74337]:       </nova:owner>
Oct 23 22:00:47 user nova-compute[74337]:       <nova:root type="image" uuid="d859d89d-998d-4109-b26a-0d6e28152932"/>
Oct 23 22:00:47 user nova-compute[74337]:       <nova:ports>
Oct 23 22:00:47 user nova-compute[74337]:         <nova:port uuid="35fea171-071b-4e56-8bb4-a4185a1e6da3">
Oct 23 22:00:47 user nova-compute[74337]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 23 22:00:47 user nova-compute[74337]:         </nova:port>
Oct 23 22:00:47 user nova-compute[74337]:       </nova:ports>
Oct 23 22:00:47 user nova-compute[74337]:     </nova:instance>
Oct 23 22:00:47 user nova-compute[74337]:   </metadata>
Oct 23 22:00:47 user nova-compute[74337]:   <sysinfo type="smbios">
Oct 23 22:00:47 user nova-compute[74337]:     <system>
Oct 23 22:00:47 user nova-compute[74337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 22:00:47 user nova-compute[74337]:       <entry name="product">OpenStack Nova</entry>
Oct 23 22:00:47 user nova-compute[74337]:       <entry name="version">0.0.0</entry>
Oct 23 22:00:47 user nova-compute[74337]:       <entry name="serial">b7a67b37-36b4-42d4-a1a3-7e5d9896d948</entry>
Oct 23 22:00:47 user nova-compute[74337]:       <entry name="uuid">b7a67b37-36b4-42d4-a1a3-7e5d9896d948</entry>
Oct 23 22:00:47 user nova-compute[74337]:       <entry name="family">Virtual Machine</entry>
Oct 23 22:00:47 user nova-compute[74337]:     </system>
Oct 23 22:00:47 user nova-compute[74337]:   </sysinfo>
Oct 23 22:00:47 user nova-compute[74337]:   <os>
Oct 23 22:00:47 user nova-compute[74337]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 22:00:47 user nova-compute[74337]:     <boot dev="hd"/>
Oct 23 22:00:47 user nova-compute[74337]:     <smbios mode="sysinfo"/>
Oct 23 22:00:47 user nova-compute[74337]:   </os>
Oct 23 22:00:47 user nova-compute[74337]:   <features>
Oct 23 22:00:47 user nova-compute[74337]:     <acpi/>
Oct 23 22:00:47 user nova-compute[74337]:     <apic/>
Oct 23 22:00:47 user nova-compute[74337]:     <vmcoreinfo/>
Oct 23 22:00:47 user nova-compute[74337]:   </features>
Oct 23 22:00:47 user nova-compute[74337]:   <clock offset="utc">
Oct 23 22:00:47 user nova-compute[74337]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 22:00:47 user nova-compute[74337]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 22:00:47 user nova-compute[74337]:     <timer name="hpet" present="no"/>
Oct 23 22:00:47 user nova-compute[74337]:   </clock>
Oct 23 22:00:47 user nova-compute[74337]:   <cpu mode="custom" match="exact">
Oct 23 22:00:47 user nova-compute[74337]:     <model>Nehalem</model>
Oct 23 22:00:47 user nova-compute[74337]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 22:00:47 user nova-compute[74337]:   </cpu>
Oct 23 22:00:47 user nova-compute[74337]:   <devices>
Oct 23 22:00:47 user nova-compute[74337]:     <disk type="file" device="disk">
Oct 23 22:00:47 user nova-compute[74337]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 22:00:47 user nova-compute[74337]:       <source file="/opt/stack/data/nova/instances/b7a67b37-36b4-42d4-a1a3-7e5d9896d948/disk"/>
Oct 23 22:00:47 user nova-compute[74337]:       <target dev="vda" bus="virtio"/>
Oct 23 22:00:47 user nova-compute[74337]:     </disk>
Oct 23 22:00:47 user nova-compute[74337]:     <interface type="ethernet">
Oct 23 22:00:47 user nova-compute[74337]:       <mac address="fa:16:3e:d3:de:6c"/>
Oct 23 22:00:47 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 22:00:47 user nova-compute[74337]:       <mtu size="1442"/>
Oct 23 22:00:47 user nova-compute[74337]:       <target dev="tap35fea171-07"/>
Oct 23 22:00:47 user nova-compute[74337]:     </interface>
Oct 23 22:00:47 user nova-compute[74337]:     <serial type="pty">
Oct 23 22:00:47 user nova-compute[74337]:       <log file="/opt/stack/data/nova/instances/b7a67b37-36b4-42d4-a1a3-7e5d9896d948/console.log" append="off"/>
Oct 23 22:00:47 user nova-compute[74337]:     </serial>
Oct 23 22:00:47 user nova-compute[74337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 22:00:47 user nova-compute[74337]:     <video>
Oct 23 22:00:47 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 22:00:47 user nova-compute[74337]:     </video>
Oct 23 22:00:47 user nova-compute[74337]:     <rng model="virtio">
Oct 23 22:00:47 user nova-compute[74337]:       <backend model="random">/dev/urandom</backend>
Oct 23 22:00:47 user nova-compute[74337]:     </rng>
Oct 23 22:00:47 user nova-compute[74337]:     <controller type="usb" index="0" model="none"/>
Oct 23 22:00:47 user nova-compute[74337]:     <memballoon model="virtio">
Oct 23 22:00:47 user nova-compute[74337]:       <stats period="10"/>
Oct 23 22:00:47 user nova-compute[74337]:     </memballoon>
Oct 23 22:00:47 user nova-compute[74337]:   </devices>
Oct 23 22:00:47 user nova-compute[74337]: </domain>
Oct 23 22:00:47 user nova-compute[74337]:  {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 22:00:47 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-fbf0443a-b5d7-4857-a192-b0bd1ff652d5 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T22:00:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-550311047',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-550311047',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-5503110',id=45,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHlF2PNKbzrW2vMSs7/oFAAPXg77UNXSK1f4N7vZjuT0m5sk7VZ8HztHE49e0R95Q2tXzYgEReuiBKtnYfnPuRKvFSHbTWtDFSVgZqCBA9oR92jZjHDZbzyiVPukN3kTNw==',key_name='tempest-keypair-66739911',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b672a253930043eda6ea2b27559f15fb',ramdisk_id='',reservation_id='r-h37c30i0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-878947822',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T22:00:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d005925ecc004b1a9b63d24d9f753256',uuid=b7a67b37-36b4-42d4-a1a3-7e5d9896d948,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "35fea171-071b-4e56-8bb4-a4185a1e6da3", "address": "fa:16:3e:d3:de:6c", "network": {"id": "2afac13f-fb75-4d79-ae11-92c0c98e710f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-597086266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b672a253930043eda6ea2b27559f15fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35fea171-07", "ovs_interfaceid": "35fea171-071b-4e56-8bb4-a4185a1e6da3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 22:00:47 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-fbf0443a-b5d7-4857-a192-b0bd1ff652d5 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Converting VIF {"id": "35fea171-071b-4e56-8bb4-a4185a1e6da3", "address": "fa:16:3e:d3:de:6c", "network": {"id": "2afac13f-fb75-4d79-ae11-92c0c98e710f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-597086266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b672a253930043eda6ea2b27559f15fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35fea171-07", "ovs_interfaceid": "35fea171-071b-4e56-8bb4-a4185a1e6da3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 22:00:47 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-fbf0443a-b5d7-4857-a192-b0bd1ff652d5 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:de:6c,bridge_name='br-int',has_traffic_filtering=True,id=35fea171-071b-4e56-8bb4-a4185a1e6da3,network=Network(2afac13f-fb75-4d79-ae11-92c0c98e710f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35fea171-07') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 22:00:47 user nova-compute[74337]: DEBUG os_vif [None req-fbf0443a-b5d7-4857-a192-b0bd1ff652d5 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:de:6c,bridge_name='br-int',has_traffic_filtering=True,id=35fea171-071b-4e56-8bb4-a4185a1e6da3,network=Network(2afac13f-fb75-4d79-ae11-92c0c98e710f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35fea171-07') {{(pid=74337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 22:00:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:00:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:00:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 22:00:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:00:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f5496629-6c77-5c46-b979-7ab827939e02', '_type': 'linux-noop'}}, row=False) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:00:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:00:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:00:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:00:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap35fea171-07, may_exist=True, interface_attrs={}) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:00:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap35fea171-07, col_values=(('qos', UUID('3ebacb63-c131-4216-b8b2-703634da5119')),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:00:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap35fea171-07, col_values=(('external_ids', {'iface-id': '35fea171-071b-4e56-8bb4-a4185a1e6da3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d3:de:6c', 'vm-uuid': 'b7a67b37-36b4-42d4-a1a3-7e5d9896d948'}),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:00:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:00:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:00:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:00:47 user nova-compute[74337]: INFO os_vif [None req-fbf0443a-b5d7-4857-a192-b0bd1ff652d5 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:de:6c,bridge_name='br-int',has_traffic_filtering=True,id=35fea171-071b-4e56-8bb4-a4185a1e6da3,network=Network(2afac13f-fb75-4d79-ae11-92c0c98e710f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35fea171-07')
Oct 23 22:00:47 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-fbf0443a-b5d7-4857-a192-b0bd1ff652d5 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] No BDM found with device name vda, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 22:00:47 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-fbf0443a-b5d7-4857-a192-b0bd1ff652d5 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] No VIF found with MAC fa:16:3e:d3:de:6c, not building metadata {{(pid=74337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 22:00:47 user nova-compute[74337]: DEBUG nova.network.neutron [req-07c2ab0c-78a0-4a37-a36f-78fa248e8ca3 req-d9a2d037-58d9-40a4-88c3-398107b55228 service nova] [instance: b7a67b37-36b4-42d4-a1a3-7e5d9896d948] Updated VIF entry in instance network info cache for port 35fea171-071b-4e56-8bb4-a4185a1e6da3. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 22:00:47 user nova-compute[74337]: DEBUG nova.network.neutron [req-07c2ab0c-78a0-4a37-a36f-78fa248e8ca3 req-d9a2d037-58d9-40a4-88c3-398107b55228 service nova] [instance: b7a67b37-36b4-42d4-a1a3-7e5d9896d948] Updating instance_info_cache with network_info: [{"id": "35fea171-071b-4e56-8bb4-a4185a1e6da3", "address": "fa:16:3e:d3:de:6c", "network": {"id": "2afac13f-fb75-4d79-ae11-92c0c98e710f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-597086266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b672a253930043eda6ea2b27559f15fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35fea171-07", "ovs_interfaceid": "35fea171-071b-4e56-8bb4-a4185a1e6da3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 22:00:47 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-07c2ab0c-78a0-4a37-a36f-78fa248e8ca3 req-d9a2d037-58d9-40a4-88c3-398107b55228 service nova] Releasing lock "refresh_cache-b7a67b37-36b4-42d4-a1a3-7e5d9896d948" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 22:00:49 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:00:49 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-54d8dc23-20da-449f-9231-c2deec58823d tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 -F raw /opt/stack/data/nova/instances/dbad2e14-7b6c-475e-b471-a87cb9e21b7f/disk" returned: 0 in 3.099s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:00:49 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:00:49 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-54d8dc23-20da-449f-9231-c2deec58823d tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Created local disks {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 22:00:49 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-54d8dc23-20da-449f-9231-c2deec58823d tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Ensure instance console log exists: /opt/stack/data/nova/instances/dbad2e14-7b6c-475e-b471-a87cb9e21b7f/console.log {{(pid=74337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 22:00:49 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-54d8dc23-20da-449f-9231-c2deec58823d tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:00:49 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-54d8dc23-20da-449f-9231-c2deec58823d tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:00:49 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-54d8dc23-20da-449f-9231-c2deec58823d tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:00:49 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-54d8dc23-20da-449f-9231-c2deec58823d tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Start _get_guest_xml network_info=[{"id": "0b516177-6ded-4b79-9f77-84ba1466f259", "address": "fa:16:3e:3e:3f:19", "network": {"id": "0feb8c56-c17f-47d0-9796-91d4bd20e81d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1399506675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd8afde978624cf8a2356e8ce8b4d3f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b516177-6d", "ovs_interfaceid": "0b516177-6ded-4b79-9f77-84ba1466f259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c3a5ed3eb79999259bcaf793dce83811',container_format='bare',created_at=2023-10-23T21:58:49Z,direct_url=<?>,disk_format='qcow2',id=7507d6a0-9570-4b7f-ad30-d527cae18b71,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-871350340-shelved',owner='dd8afde978624cf8a2356e8ce8b4d3f2',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-23T21:58:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'image_id': 'd859d89d-998d-4109-b26a-0d6e28152932'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 22:00:49 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:00:49 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:00:49 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-54d8dc23-20da-449f-9231-c2deec58823d tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:00:49 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-54d8dc23-20da-449f-9231-c2deec58823d tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:00:49 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-54d8dc23-20da-449f-9231-c2deec58823d tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 22:00:49 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-54d8dc23-20da-449f-9231-c2deec58823d tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] CPU controller missing on host. {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 22:00:49 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-54d8dc23-20da-449f-9231-c2deec58823d tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 22:00:49 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-54d8dc23-20da-449f-9231-c2deec58823d tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] CPU controller found on host. {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 22:00:49 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-54d8dc23-20da-449f-9231-c2deec58823d tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 22:00:49 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-54d8dc23-20da-449f-9231-c2deec58823d tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T21:29:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c3a5ed3eb79999259bcaf793dce83811',container_format='bare',created_at=2023-10-23T21:58:49Z,direct_url=<?>,disk_format='qcow2',id=7507d6a0-9570-4b7f-ad30-d527cae18b71,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-871350340-shelved',owner='dd8afde978624cf8a2356e8ce8b4d3f2',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-23T21:58:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 22:00:49 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-54d8dc23-20da-449f-9231-c2deec58823d tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Flavor limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 22:00:49 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-54d8dc23-20da-449f-9231-c2deec58823d tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Image limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 22:00:49 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-54d8dc23-20da-449f-9231-c2deec58823d tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Flavor pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 22:00:49 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-54d8dc23-20da-449f-9231-c2deec58823d tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Image pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 22:00:49 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-54d8dc23-20da-449f-9231-c2deec58823d tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 22:00:49 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-54d8dc23-20da-449f-9231-c2deec58823d tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 22:00:49 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-54d8dc23-20da-449f-9231-c2deec58823d tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 22:00:49 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-54d8dc23-20da-449f-9231-c2deec58823d tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Got 1 possible topologies {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 22:00:49 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-54d8dc23-20da-449f-9231-c2deec58823d tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 22:00:49 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-54d8dc23-20da-449f-9231-c2deec58823d tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 22:00:49 user nova-compute[74337]: DEBUG nova.objects.instance [None req-54d8dc23-20da-449f-9231-c2deec58823d tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Lazy-loading 'vcpu_model' on Instance uuid dbad2e14-7b6c-475e-b471-a87cb9e21b7f {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:00:49 user nova-compute[74337]: DEBUG nova.objects.base [None req-54d8dc23-20da-449f-9231-c2deec58823d tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Object Instance<dbad2e14-7b6c-475e-b471-a87cb9e21b7f> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 22:00:49 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-54d8dc23-20da-449f-9231-c2deec58823d tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-23T21:56:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-871350340',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-871350340',id=39,image_ref='7507d6a0-9570-4b7f-ad30-d527cae18b71',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1238420293',keypairs=<?>,launch_index=0,launched_at=2023-10-23T21:56:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='dd8afde978624cf8a2356e8ce8b4d3f2',ramdisk_id='',reservation_id='r-fs4u8r0x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-338191707',owner_user_name='tempest-AttachVolumeShelveTestJSON-338191707-project-member',shelved_at='2023-10-23T21:58:53.338940',shelved_host='user',shelved_image_id='7507d6a0-9570-4b7f-ad30-d527cae18b71'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T22:00:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ddd5c407fbe440e85111213c4c2dd46',uuid=dbad2e14-7b6c-475e-b471-a87cb9e21b7f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "0b516177-6ded-4b79-9f77-84ba1466f259", "address": "fa:16:3e:3e:3f:19", "network": {"id": "0feb8c56-c17f-47d0-9796-91d4bd20e81d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1399506675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd8afde978624cf8a2356e8ce8b4d3f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b516177-6d", "ovs_interfaceid": "0b516177-6ded-4b79-9f77-84ba1466f259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 22:00:49 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-54d8dc23-20da-449f-9231-c2deec58823d tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Converting VIF {"id": "0b516177-6ded-4b79-9f77-84ba1466f259", "address": "fa:16:3e:3e:3f:19", "network": {"id": "0feb8c56-c17f-47d0-9796-91d4bd20e81d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1399506675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd8afde978624cf8a2356e8ce8b4d3f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b516177-6d", "ovs_interfaceid": "0b516177-6ded-4b79-9f77-84ba1466f259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 22:00:49 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-54d8dc23-20da-449f-9231-c2deec58823d tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:3f:19,bridge_name='br-int',has_traffic_filtering=True,id=0b516177-6ded-4b79-9f77-84ba1466f259,network=Network(0feb8c56-c17f-47d0-9796-91d4bd20e81d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b516177-6d') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 22:00:49 user nova-compute[74337]: DEBUG nova.objects.instance [None req-54d8dc23-20da-449f-9231-c2deec58823d tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Lazy-loading 'pci_devices' on Instance uuid dbad2e14-7b6c-475e-b471-a87cb9e21b7f {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:00:49 user nova-compute[74337]: DEBUG nova.objects.base [None req-54d8dc23-20da-449f-9231-c2deec58823d tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Object Instance<dbad2e14-7b6c-475e-b471-a87cb9e21b7f> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 22:00:49 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-54d8dc23-20da-449f-9231-c2deec58823d tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] End _get_guest_xml xml=<domain type="kvm">
Oct 23 22:00:49 user nova-compute[74337]:   <uuid>dbad2e14-7b6c-475e-b471-a87cb9e21b7f</uuid>
Oct 23 22:00:49 user nova-compute[74337]:   <name>instance-00000027</name>
Oct 23 22:00:49 user nova-compute[74337]:   <memory>524288</memory>
Oct 23 22:00:49 user nova-compute[74337]:   <vcpu>1</vcpu>
Oct 23 22:00:49 user nova-compute[74337]:   <metadata>
Oct 23 22:00:49 user nova-compute[74337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 22:00:49 user nova-compute[74337]:       <nova:package version="0.0.0"/>
Oct 23 22:00:49 user nova-compute[74337]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-871350340</nova:name>
Oct 23 22:00:49 user nova-compute[74337]:       <nova:creationTime>2023-10-23 22:00:49</nova:creationTime>
Oct 23 22:00:49 user nova-compute[74337]:       <nova:flavor name="m1.tiny">
Oct 23 22:00:49 user nova-compute[74337]:         <nova:memory>512</nova:memory>
Oct 23 22:00:49 user nova-compute[74337]:         <nova:disk>1</nova:disk>
Oct 23 22:00:49 user nova-compute[74337]:         <nova:swap>0</nova:swap>
Oct 23 22:00:49 user nova-compute[74337]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 22:00:49 user nova-compute[74337]:         <nova:vcpus>1</nova:vcpus>
Oct 23 22:00:49 user nova-compute[74337]:       </nova:flavor>
Oct 23 22:00:49 user nova-compute[74337]:       <nova:owner>
Oct 23 22:00:49 user nova-compute[74337]:         <nova:user uuid="6ddd5c407fbe440e85111213c4c2dd46">tempest-AttachVolumeShelveTestJSON-338191707-project-member</nova:user>
Oct 23 22:00:49 user nova-compute[74337]:         <nova:project uuid="dd8afde978624cf8a2356e8ce8b4d3f2">tempest-AttachVolumeShelveTestJSON-338191707</nova:project>
Oct 23 22:00:49 user nova-compute[74337]:       </nova:owner>
Oct 23 22:00:49 user nova-compute[74337]:       <nova:root type="image" uuid="7507d6a0-9570-4b7f-ad30-d527cae18b71"/>
Oct 23 22:00:49 user nova-compute[74337]:       <nova:ports>
Oct 23 22:00:49 user nova-compute[74337]:         <nova:port uuid="0b516177-6ded-4b79-9f77-84ba1466f259">
Oct 23 22:00:49 user nova-compute[74337]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 23 22:00:49 user nova-compute[74337]:         </nova:port>
Oct 23 22:00:49 user nova-compute[74337]:       </nova:ports>
Oct 23 22:00:49 user nova-compute[74337]:     </nova:instance>
Oct 23 22:00:49 user nova-compute[74337]:   </metadata>
Oct 23 22:00:49 user nova-compute[74337]:   <sysinfo type="smbios">
Oct 23 22:00:49 user nova-compute[74337]:     <system>
Oct 23 22:00:49 user nova-compute[74337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 22:00:49 user nova-compute[74337]:       <entry name="product">OpenStack Nova</entry>
Oct 23 22:00:49 user nova-compute[74337]:       <entry name="version">0.0.0</entry>
Oct 23 22:00:49 user nova-compute[74337]:       <entry name="serial">dbad2e14-7b6c-475e-b471-a87cb9e21b7f</entry>
Oct 23 22:00:49 user nova-compute[74337]:       <entry name="uuid">dbad2e14-7b6c-475e-b471-a87cb9e21b7f</entry>
Oct 23 22:00:49 user nova-compute[74337]:       <entry name="family">Virtual Machine</entry>
Oct 23 22:00:49 user nova-compute[74337]:     </system>
Oct 23 22:00:49 user nova-compute[74337]:   </sysinfo>
Oct 23 22:00:49 user nova-compute[74337]:   <os>
Oct 23 22:00:49 user nova-compute[74337]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 22:00:49 user nova-compute[74337]:     <boot dev="hd"/>
Oct 23 22:00:49 user nova-compute[74337]:     <smbios mode="sysinfo"/>
Oct 23 22:00:49 user nova-compute[74337]:   </os>
Oct 23 22:00:49 user nova-compute[74337]:   <features>
Oct 23 22:00:49 user nova-compute[74337]:     <acpi/>
Oct 23 22:00:49 user nova-compute[74337]:     <apic/>
Oct 23 22:00:49 user nova-compute[74337]:     <vmcoreinfo/>
Oct 23 22:00:49 user nova-compute[74337]:   </features>
Oct 23 22:00:49 user nova-compute[74337]:   <clock offset="utc">
Oct 23 22:00:49 user nova-compute[74337]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 22:00:49 user nova-compute[74337]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 22:00:49 user nova-compute[74337]:     <timer name="hpet" present="no"/>
Oct 23 22:00:49 user nova-compute[74337]:   </clock>
Oct 23 22:00:49 user nova-compute[74337]:   <cpu mode="custom" match="exact">
Oct 23 22:00:49 user nova-compute[74337]:     <model>Nehalem</model>
Oct 23 22:00:49 user nova-compute[74337]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 22:00:49 user nova-compute[74337]:   </cpu>
Oct 23 22:00:49 user nova-compute[74337]:   <devices>
Oct 23 22:00:49 user nova-compute[74337]:     <disk type="file" device="disk">
Oct 23 22:00:49 user nova-compute[74337]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 22:00:49 user nova-compute[74337]:       <source file="/opt/stack/data/nova/instances/dbad2e14-7b6c-475e-b471-a87cb9e21b7f/disk"/>
Oct 23 22:00:49 user nova-compute[74337]:       <target dev="vda" bus="virtio"/>
Oct 23 22:00:49 user nova-compute[74337]:     </disk>
Oct 23 22:00:49 user nova-compute[74337]:     <interface type="ethernet">
Oct 23 22:00:49 user nova-compute[74337]:       <mac address="fa:16:3e:3e:3f:19"/>
Oct 23 22:00:49 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 22:00:49 user nova-compute[74337]:       <mtu size="1442"/>
Oct 23 22:00:49 user nova-compute[74337]:       <target dev="tap0b516177-6d"/>
Oct 23 22:00:49 user nova-compute[74337]:     </interface>
Oct 23 22:00:49 user nova-compute[74337]:     <serial type="pty">
Oct 23 22:00:49 user nova-compute[74337]:       <log file="/opt/stack/data/nova/instances/dbad2e14-7b6c-475e-b471-a87cb9e21b7f/console.log" append="off"/>
Oct 23 22:00:49 user nova-compute[74337]:     </serial>
Oct 23 22:00:49 user nova-compute[74337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 22:00:49 user nova-compute[74337]:     <video>
Oct 23 22:00:49 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 22:00:49 user nova-compute[74337]:     </video>
Oct 23 22:00:49 user nova-compute[74337]:     <rng model="virtio">
Oct 23 22:00:49 user nova-compute[74337]:       <backend model="random">/dev/urandom</backend>
Oct 23 22:00:49 user nova-compute[74337]:     </rng>
Oct 23 22:00:49 user nova-compute[74337]:     <controller type="usb" index="0" model="none"/>
Oct 23 22:00:49 user nova-compute[74337]:     <memballoon model="virtio">
Oct 23 22:00:49 user nova-compute[74337]:       <stats period="10"/>
Oct 23 22:00:49 user nova-compute[74337]:     </memballoon>
Oct 23 22:00:49 user nova-compute[74337]:   </devices>
Oct 23 22:00:49 user nova-compute[74337]: </domain>
Oct 23 22:00:49 user nova-compute[74337]:  {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 22:00:49 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-54d8dc23-20da-449f-9231-c2deec58823d tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-23T21:56:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-871350340',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-871350340',id=39,image_ref='7507d6a0-9570-4b7f-ad30-d527cae18b71',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1238420293',keypairs=<?>,launch_index=0,launched_at=2023-10-23T21:56:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='dd8afde978624cf8a2356e8ce8b4d3f2',ramdisk_id='',reservation_id='r-fs4u8r0x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-338191707',owner_user_name='tempest-AttachVolumeShelveTestJSON-338191707-project-member',shelved_at='2023-10-23T21:58:53.338940',shelved_host='user',shelved_image_id='7507d6a0-9570-4b7f-ad30-d527cae18b71'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T22:00:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ddd5c407fbe440e85111213c4c2dd46',uuid=dbad2e14-7b6c-475e-b471-a87cb9e21b7f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "0b516177-6ded-4b79-9f77-84ba1466f259", "address": "fa:16:3e:3e:3f:19", "network": {"id": "0feb8c56-c17f-47d0-9796-91d4bd20e81d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1399506675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd8afde978624cf8a2356e8ce8b4d3f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b516177-6d", "ovs_interfaceid": "0b516177-6ded-4b79-9f77-84ba1466f259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 22:00:49 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-54d8dc23-20da-449f-9231-c2deec58823d tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Converting VIF {"id": "0b516177-6ded-4b79-9f77-84ba1466f259", "address": "fa:16:3e:3e:3f:19", "network": {"id": "0feb8c56-c17f-47d0-9796-91d4bd20e81d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1399506675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd8afde978624cf8a2356e8ce8b4d3f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b516177-6d", "ovs_interfaceid": "0b516177-6ded-4b79-9f77-84ba1466f259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 22:00:49 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-54d8dc23-20da-449f-9231-c2deec58823d tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:3f:19,bridge_name='br-int',has_traffic_filtering=True,id=0b516177-6ded-4b79-9f77-84ba1466f259,network=Network(0feb8c56-c17f-47d0-9796-91d4bd20e81d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b516177-6d') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 22:00:49 user nova-compute[74337]: DEBUG os_vif [None req-54d8dc23-20da-449f-9231-c2deec58823d tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:3f:19,bridge_name='br-int',has_traffic_filtering=True,id=0b516177-6ded-4b79-9f77-84ba1466f259,network=Network(0feb8c56-c17f-47d0-9796-91d4bd20e81d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b516177-6d') {{(pid=74337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 22:00:49 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:00:49 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:00:49 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 22:00:49 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:00:49 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '24a2ce47-af64-5bcf-80d3-fec54a0e8f89', '_type': 'linux-noop'}}, row=False) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:00:49 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:00:49 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:00:49 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:00:49 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:00:49 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0b516177-6d, may_exist=True, interface_attrs={}) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:00:49 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0b516177-6d, col_values=(('qos', UUID('0cca560a-9c2f-4414-87bf-af3a8782ace4')),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:00:49 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0b516177-6d, col_values=(('external_ids', {'iface-id': '0b516177-6ded-4b79-9f77-84ba1466f259', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3e:3f:19', 'vm-uuid': 'dbad2e14-7b6c-475e-b471-a87cb9e21b7f'}),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:00:49 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:00:49 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:00:49 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:00:49 user nova-compute[74337]: INFO os_vif [None req-54d8dc23-20da-449f-9231-c2deec58823d tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:3f:19,bridge_name='br-int',has_traffic_filtering=True,id=0b516177-6ded-4b79-9f77-84ba1466f259,network=Network(0feb8c56-c17f-47d0-9796-91d4bd20e81d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b516177-6d')
Oct 23 22:00:49 user nova-compute[74337]: DEBUG nova.compute.manager [req-6f012f58-8ec7-4183-b353-0d90d7ed784b req-1e8bfe17-9ee4-470d-9957-9f0867aad20c service nova] [instance: b7a67b37-36b4-42d4-a1a3-7e5d9896d948] Received event network-vif-plugged-35fea171-071b-4e56-8bb4-a4185a1e6da3 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:00:49 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-6f012f58-8ec7-4183-b353-0d90d7ed784b req-1e8bfe17-9ee4-470d-9957-9f0867aad20c service nova] Acquiring lock "b7a67b37-36b4-42d4-a1a3-7e5d9896d948-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:00:49 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-6f012f58-8ec7-4183-b353-0d90d7ed784b req-1e8bfe17-9ee4-470d-9957-9f0867aad20c service nova] Lock "b7a67b37-36b4-42d4-a1a3-7e5d9896d948-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:00:49 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-6f012f58-8ec7-4183-b353-0d90d7ed784b req-1e8bfe17-9ee4-470d-9957-9f0867aad20c service nova] Lock "b7a67b37-36b4-42d4-a1a3-7e5d9896d948-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:00:49 user nova-compute[74337]: DEBUG nova.compute.manager [req-6f012f58-8ec7-4183-b353-0d90d7ed784b req-1e8bfe17-9ee4-470d-9957-9f0867aad20c service nova] [instance: b7a67b37-36b4-42d4-a1a3-7e5d9896d948] No waiting events found dispatching network-vif-plugged-35fea171-071b-4e56-8bb4-a4185a1e6da3 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 22:00:49 user nova-compute[74337]: WARNING nova.compute.manager [req-6f012f58-8ec7-4183-b353-0d90d7ed784b req-1e8bfe17-9ee4-470d-9957-9f0867aad20c service nova] [instance: b7a67b37-36b4-42d4-a1a3-7e5d9896d948] Received unexpected event network-vif-plugged-35fea171-071b-4e56-8bb4-a4185a1e6da3 for instance with vm_state building and task_state spawning.
Oct 23 22:00:49 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-54d8dc23-20da-449f-9231-c2deec58823d tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] No BDM found with device name vda, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 22:00:49 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-54d8dc23-20da-449f-9231-c2deec58823d tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] No VIF found with MAC fa:16:3e:3e:3f:19, not building metadata {{(pid=74337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 22:00:49 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-9d24abb0-a8f8-4383-a4d7-a1a6a8da8502 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Acquiring lock "b42311a5-4334-42ba-9375-e27bc946d490" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:00:49 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-9d24abb0-a8f8-4383-a4d7-a1a6a8da8502 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Lock "b42311a5-4334-42ba-9375-e27bc946d490" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:00:49 user nova-compute[74337]: DEBUG nova.compute.manager [None req-9d24abb0-a8f8-4383-a4d7-a1a6a8da8502 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] [instance: b42311a5-4334-42ba-9375-e27bc946d490] Starting instance... {{(pid=74337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 22:00:49 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-9d24abb0-a8f8-4383-a4d7-a1a6a8da8502 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:00:49 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-9d24abb0-a8f8-4383-a4d7-a1a6a8da8502 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:00:49 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-9d24abb0-a8f8-4383-a4d7-a1a6a8da8502 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 22:00:49 user nova-compute[74337]: INFO nova.compute.claims [None req-9d24abb0-a8f8-4383-a4d7-a1a6a8da8502 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] [instance: b42311a5-4334-42ba-9375-e27bc946d490] Claim successful on node user
Oct 23 22:00:49 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:00:49 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:00:49 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:00:49 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:00:49 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:00:50 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-9d24abb0-a8f8-4383-a4d7-a1a6a8da8502 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 22:00:50 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-9d24abb0-a8f8-4383-a4d7-a1a6a8da8502 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 22:00:50 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-9d24abb0-a8f8-4383-a4d7-a1a6a8da8502 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.372s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:00:50 user nova-compute[74337]: DEBUG nova.compute.manager [None req-9d24abb0-a8f8-4383-a4d7-a1a6a8da8502 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] [instance: b42311a5-4334-42ba-9375-e27bc946d490] Start building networks asynchronously for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 22:00:50 user nova-compute[74337]: DEBUG nova.compute.manager [None req-9d24abb0-a8f8-4383-a4d7-a1a6a8da8502 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] [instance: b42311a5-4334-42ba-9375-e27bc946d490] Allocating IP information in the background. {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 22:00:50 user nova-compute[74337]: DEBUG nova.network.neutron [None req-9d24abb0-a8f8-4383-a4d7-a1a6a8da8502 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] [instance: b42311a5-4334-42ba-9375-e27bc946d490] allocate_for_instance() {{(pid=74337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 22:00:50 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-9d24abb0-a8f8-4383-a4d7-a1a6a8da8502 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] [instance: b42311a5-4334-42ba-9375-e27bc946d490] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 22:00:50 user nova-compute[74337]: DEBUG nova.compute.manager [None req-9d24abb0-a8f8-4383-a4d7-a1a6a8da8502 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] [instance: b42311a5-4334-42ba-9375-e27bc946d490] Start building block device mappings for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 22:00:50 user nova-compute[74337]: DEBUG nova.policy [None req-9d24abb0-a8f8-4383-a4d7-a1a6a8da8502 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '112575ac7c2d4409a95aa1844d967afa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10913ebbab6441bdaa5b0bd97bf1dfb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74337) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 22:00:50 user nova-compute[74337]: DEBUG nova.compute.manager [None req-9d24abb0-a8f8-4383-a4d7-a1a6a8da8502 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] [instance: b42311a5-4334-42ba-9375-e27bc946d490] Start spawning the instance on the hypervisor. {{(pid=74337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 22:00:50 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-9d24abb0-a8f8-4383-a4d7-a1a6a8da8502 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] [instance: b42311a5-4334-42ba-9375-e27bc946d490] Creating instance directory {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 22:00:50 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-9d24abb0-a8f8-4383-a4d7-a1a6a8da8502 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] [instance: b42311a5-4334-42ba-9375-e27bc946d490] Creating image(s)
Oct 23 22:00:50 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-9d24abb0-a8f8-4383-a4d7-a1a6a8da8502 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Acquiring lock "/opt/stack/data/nova/instances/b42311a5-4334-42ba-9375-e27bc946d490/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:00:50 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-9d24abb0-a8f8-4383-a4d7-a1a6a8da8502 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Lock "/opt/stack/data/nova/instances/b42311a5-4334-42ba-9375-e27bc946d490/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:00:50 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-9d24abb0-a8f8-4383-a4d7-a1a6a8da8502 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Lock "/opt/stack/data/nova/instances/b42311a5-4334-42ba-9375-e27bc946d490/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:00:50 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-9d24abb0-a8f8-4383-a4d7-a1a6a8da8502 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:00:50 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-9d24abb0-a8f8-4383-a4d7-a1a6a8da8502 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.180s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:00:50 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-9d24abb0-a8f8-4383-a4d7-a1a6a8da8502 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Acquiring lock "fc7b140751b8c385de81623e40fb09ce09374ab7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:00:50 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-9d24abb0-a8f8-4383-a4d7-a1a6a8da8502 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Lock "fc7b140751b8c385de81623e40fb09ce09374ab7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:00:50 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-9d24abb0-a8f8-4383-a4d7-a1a6a8da8502 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:00:50 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-9d24abb0-a8f8-4383-a4d7-a1a6a8da8502 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.327s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:00:50 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-9d24abb0-a8f8-4383-a4d7-a1a6a8da8502 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7,backing_fmt=raw /opt/stack/data/nova/instances/b42311a5-4334-42ba-9375-e27bc946d490/disk 1073741824 {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:00:50 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-9d24abb0-a8f8-4383-a4d7-a1a6a8da8502 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7,backing_fmt=raw /opt/stack/data/nova/instances/b42311a5-4334-42ba-9375-e27bc946d490/disk 1073741824" returned: 0 in 0.052s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:00:50 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-9d24abb0-a8f8-4383-a4d7-a1a6a8da8502 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Lock "fc7b140751b8c385de81623e40fb09ce09374ab7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.387s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:00:50 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-9d24abb0-a8f8-4383-a4d7-a1a6a8da8502 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:00:50 user nova-compute[74337]: DEBUG nova.network.neutron [None req-9d24abb0-a8f8-4383-a4d7-a1a6a8da8502 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] [instance: b42311a5-4334-42ba-9375-e27bc946d490] Successfully created port: 825ed2da-43b7-4f1e-a078-4a55a3e7ed4f {{(pid=74337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 22:00:51 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-9d24abb0-a8f8-4383-a4d7-a1a6a8da8502 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.182s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:00:51 user nova-compute[74337]: DEBUG nova.virt.disk.api [None req-9d24abb0-a8f8-4383-a4d7-a1a6a8da8502 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b42311a5-4334-42ba-9375-e27bc946d490/disk. size=1073741824 {{(pid=74337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 22:00:51 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-9d24abb0-a8f8-4383-a4d7-a1a6a8da8502 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b42311a5-4334-42ba-9375-e27bc946d490/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:00:51 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:00:51 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:00:51 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:00:51 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:00:51 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-9d24abb0-a8f8-4383-a4d7-a1a6a8da8502 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b42311a5-4334-42ba-9375-e27bc946d490/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:00:51 user nova-compute[74337]: DEBUG nova.virt.disk.api [None req-9d24abb0-a8f8-4383-a4d7-a1a6a8da8502 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Cannot resize image /opt/stack/data/nova/instances/b42311a5-4334-42ba-9375-e27bc946d490/disk to a smaller size. {{(pid=74337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 22:00:51 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-9d24abb0-a8f8-4383-a4d7-a1a6a8da8502 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] [instance: b42311a5-4334-42ba-9375-e27bc946d490] Created local disks {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 22:00:51 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-9d24abb0-a8f8-4383-a4d7-a1a6a8da8502 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] [instance: b42311a5-4334-42ba-9375-e27bc946d490] Ensure instance console log exists: /opt/stack/data/nova/instances/b42311a5-4334-42ba-9375-e27bc946d490/console.log {{(pid=74337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 22:00:51 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-9d24abb0-a8f8-4383-a4d7-a1a6a8da8502 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:00:51 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-9d24abb0-a8f8-4383-a4d7-a1a6a8da8502 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:00:51 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-9d24abb0-a8f8-4383-a4d7-a1a6a8da8502 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:00:51 user nova-compute[74337]: DEBUG nova.compute.manager [req-cb039d84-00e9-4b5a-aa04-a1e404b8ad48 req-4d39785f-708a-40a6-91b4-731a0a8f86eb service nova] [instance: b7a67b37-36b4-42d4-a1a3-7e5d9896d948] Received event network-vif-plugged-35fea171-071b-4e56-8bb4-a4185a1e6da3 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:00:51 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-cb039d84-00e9-4b5a-aa04-a1e404b8ad48 req-4d39785f-708a-40a6-91b4-731a0a8f86eb service nova] Acquiring lock "b7a67b37-36b4-42d4-a1a3-7e5d9896d948-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:00:51 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-cb039d84-00e9-4b5a-aa04-a1e404b8ad48 req-4d39785f-708a-40a6-91b4-731a0a8f86eb service nova] Lock "b7a67b37-36b4-42d4-a1a3-7e5d9896d948-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:00:51 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-cb039d84-00e9-4b5a-aa04-a1e404b8ad48 req-4d39785f-708a-40a6-91b4-731a0a8f86eb service nova] Lock "b7a67b37-36b4-42d4-a1a3-7e5d9896d948-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:00:51 user nova-compute[74337]: DEBUG nova.compute.manager [req-cb039d84-00e9-4b5a-aa04-a1e404b8ad48 req-4d39785f-708a-40a6-91b4-731a0a8f86eb service nova] [instance: b7a67b37-36b4-42d4-a1a3-7e5d9896d948] No waiting events found dispatching network-vif-plugged-35fea171-071b-4e56-8bb4-a4185a1e6da3 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 22:00:51 user nova-compute[74337]: WARNING nova.compute.manager [req-cb039d84-00e9-4b5a-aa04-a1e404b8ad48 req-4d39785f-708a-40a6-91b4-731a0a8f86eb service nova] [instance: b7a67b37-36b4-42d4-a1a3-7e5d9896d948] Received unexpected event network-vif-plugged-35fea171-071b-4e56-8bb4-a4185a1e6da3 for instance with vm_state building and task_state spawning.
Oct 23 22:00:51 user nova-compute[74337]: DEBUG nova.compute.manager [req-cb039d84-00e9-4b5a-aa04-a1e404b8ad48 req-4d39785f-708a-40a6-91b4-731a0a8f86eb service nova] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Received event network-vif-plugged-0b516177-6ded-4b79-9f77-84ba1466f259 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:00:51 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-cb039d84-00e9-4b5a-aa04-a1e404b8ad48 req-4d39785f-708a-40a6-91b4-731a0a8f86eb service nova] Acquiring lock "dbad2e14-7b6c-475e-b471-a87cb9e21b7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:00:51 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-cb039d84-00e9-4b5a-aa04-a1e404b8ad48 req-4d39785f-708a-40a6-91b4-731a0a8f86eb service nova] Lock "dbad2e14-7b6c-475e-b471-a87cb9e21b7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:00:51 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-cb039d84-00e9-4b5a-aa04-a1e404b8ad48 req-4d39785f-708a-40a6-91b4-731a0a8f86eb service nova] Lock "dbad2e14-7b6c-475e-b471-a87cb9e21b7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:00:51 user nova-compute[74337]: DEBUG nova.compute.manager [req-cb039d84-00e9-4b5a-aa04-a1e404b8ad48 req-4d39785f-708a-40a6-91b4-731a0a8f86eb service nova] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] No waiting events found dispatching network-vif-plugged-0b516177-6ded-4b79-9f77-84ba1466f259 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 22:00:51 user nova-compute[74337]: WARNING nova.compute.manager [req-cb039d84-00e9-4b5a-aa04-a1e404b8ad48 req-4d39785f-708a-40a6-91b4-731a0a8f86eb service nova] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Received unexpected event network-vif-plugged-0b516177-6ded-4b79-9f77-84ba1466f259 for instance with vm_state shelved_offloaded and task_state spawning.
Oct 23 22:00:51 user nova-compute[74337]: DEBUG nova.network.neutron [None req-9d24abb0-a8f8-4383-a4d7-a1a6a8da8502 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] [instance: b42311a5-4334-42ba-9375-e27bc946d490] Successfully updated port: 825ed2da-43b7-4f1e-a078-4a55a3e7ed4f {{(pid=74337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 22:00:51 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-9d24abb0-a8f8-4383-a4d7-a1a6a8da8502 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Acquiring lock "refresh_cache-b42311a5-4334-42ba-9375-e27bc946d490" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 22:00:51 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-9d24abb0-a8f8-4383-a4d7-a1a6a8da8502 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Acquired lock "refresh_cache-b42311a5-4334-42ba-9375-e27bc946d490" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 22:00:51 user nova-compute[74337]: DEBUG nova.network.neutron [None req-9d24abb0-a8f8-4383-a4d7-a1a6a8da8502 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] [instance: b42311a5-4334-42ba-9375-e27bc946d490] Building network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 22:00:51 user nova-compute[74337]: DEBUG nova.compute.manager [req-6a914ac2-dd03-4aa0-a70d-147904f18b4c req-831014da-940a-46c5-ae9e-8f7b8c58e4fe service nova] [instance: b42311a5-4334-42ba-9375-e27bc946d490] Received event network-changed-825ed2da-43b7-4f1e-a078-4a55a3e7ed4f {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:00:51 user nova-compute[74337]: DEBUG nova.compute.manager [req-6a914ac2-dd03-4aa0-a70d-147904f18b4c req-831014da-940a-46c5-ae9e-8f7b8c58e4fe service nova] [instance: b42311a5-4334-42ba-9375-e27bc946d490] Refreshing instance network info cache due to event network-changed-825ed2da-43b7-4f1e-a078-4a55a3e7ed4f. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 22:00:51 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-6a914ac2-dd03-4aa0-a70d-147904f18b4c req-831014da-940a-46c5-ae9e-8f7b8c58e4fe service nova] Acquiring lock "refresh_cache-b42311a5-4334-42ba-9375-e27bc946d490" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 22:00:51 user nova-compute[74337]: DEBUG nova.network.neutron [None req-9d24abb0-a8f8-4383-a4d7-a1a6a8da8502 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] [instance: b42311a5-4334-42ba-9375-e27bc946d490] Instance cache missing network info. {{(pid=74337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 22:00:51 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:00:51 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:00:51 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:00:51 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:00:51 user nova-compute[74337]: DEBUG nova.network.neutron [None req-9d24abb0-a8f8-4383-a4d7-a1a6a8da8502 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] [instance: b42311a5-4334-42ba-9375-e27bc946d490] Updating instance_info_cache with network_info: [{"id": "825ed2da-43b7-4f1e-a078-4a55a3e7ed4f", "address": "fa:16:3e:33:95:f5", "network": {"id": "89c20314-7bb0-4ea1-b024-d474e5deb03a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-600863519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10913ebbab6441bdaa5b0bd97bf1dfb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap825ed2da-43", "ovs_interfaceid": "825ed2da-43b7-4f1e-a078-4a55a3e7ed4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 22:00:51 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-9d24abb0-a8f8-4383-a4d7-a1a6a8da8502 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Releasing lock "refresh_cache-b42311a5-4334-42ba-9375-e27bc946d490" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 22:00:51 user nova-compute[74337]: DEBUG nova.compute.manager [None req-9d24abb0-a8f8-4383-a4d7-a1a6a8da8502 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] [instance: b42311a5-4334-42ba-9375-e27bc946d490] Instance network_info: |[{"id": "825ed2da-43b7-4f1e-a078-4a55a3e7ed4f", "address": "fa:16:3e:33:95:f5", "network": {"id": "89c20314-7bb0-4ea1-b024-d474e5deb03a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-600863519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10913ebbab6441bdaa5b0bd97bf1dfb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap825ed2da-43", "ovs_interfaceid": "825ed2da-43b7-4f1e-a078-4a55a3e7ed4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 22:00:51 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-6a914ac2-dd03-4aa0-a70d-147904f18b4c req-831014da-940a-46c5-ae9e-8f7b8c58e4fe service nova] Acquired lock "refresh_cache-b42311a5-4334-42ba-9375-e27bc946d490" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 22:00:51 user nova-compute[74337]: DEBUG nova.network.neutron [req-6a914ac2-dd03-4aa0-a70d-147904f18b4c req-831014da-940a-46c5-ae9e-8f7b8c58e4fe service nova] [instance: b42311a5-4334-42ba-9375-e27bc946d490] Refreshing network info cache for port 825ed2da-43b7-4f1e-a078-4a55a3e7ed4f {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 22:00:51 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-9d24abb0-a8f8-4383-a4d7-a1a6a8da8502 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] [instance: b42311a5-4334-42ba-9375-e27bc946d490] Start _get_guest_xml network_info=[{"id": "825ed2da-43b7-4f1e-a078-4a55a3e7ed4f", "address": "fa:16:3e:33:95:f5", "network": {"id": "89c20314-7bb0-4ea1-b024-d474e5deb03a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-600863519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10913ebbab6441bdaa5b0bd97bf1dfb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap825ed2da-43", "ovs_interfaceid": "825ed2da-43b7-4f1e-a078-4a55a3e7ed4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T21:29:21Z,direct_url=<?>,disk_format='qcow2',id=d859d89d-998d-4109-b26a-0d6e28152932,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ff43462300764979a6cf688444336a56',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T21:29:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'image_id': 'd859d89d-998d-4109-b26a-0d6e28152932'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 22:00:52 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-9d24abb0-a8f8-4383-a4d7-a1a6a8da8502 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:00:52 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-9d24abb0-a8f8-4383-a4d7-a1a6a8da8502 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:00:52 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-9d24abb0-a8f8-4383-a4d7-a1a6a8da8502 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 22:00:52 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-9d24abb0-a8f8-4383-a4d7-a1a6a8da8502 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] CPU controller missing on host. {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 22:00:52 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-9d24abb0-a8f8-4383-a4d7-a1a6a8da8502 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 22:00:52 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-9d24abb0-a8f8-4383-a4d7-a1a6a8da8502 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] CPU controller found on host. {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 22:00:52 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-9d24abb0-a8f8-4383-a4d7-a1a6a8da8502 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 22:00:52 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-9d24abb0-a8f8-4383-a4d7-a1a6a8da8502 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T21:29:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T21:29:21Z,direct_url=<?>,disk_format='qcow2',id=d859d89d-998d-4109-b26a-0d6e28152932,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ff43462300764979a6cf688444336a56',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T21:29:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 22:00:52 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-9d24abb0-a8f8-4383-a4d7-a1a6a8da8502 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Flavor limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 22:00:52 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-9d24abb0-a8f8-4383-a4d7-a1a6a8da8502 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Image limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 22:00:52 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-9d24abb0-a8f8-4383-a4d7-a1a6a8da8502 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Flavor pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 22:00:52 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-9d24abb0-a8f8-4383-a4d7-a1a6a8da8502 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Image pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 22:00:52 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-9d24abb0-a8f8-4383-a4d7-a1a6a8da8502 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 22:00:52 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-9d24abb0-a8f8-4383-a4d7-a1a6a8da8502 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 22:00:52 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-9d24abb0-a8f8-4383-a4d7-a1a6a8da8502 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 22:00:52 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-9d24abb0-a8f8-4383-a4d7-a1a6a8da8502 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Got 1 possible topologies {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 22:00:52 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-9d24abb0-a8f8-4383-a4d7-a1a6a8da8502 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 22:00:52 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-9d24abb0-a8f8-4383-a4d7-a1a6a8da8502 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 22:00:52 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-9d24abb0-a8f8-4383-a4d7-a1a6a8da8502 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T22:00:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-850767745',display_name='tempest-VolumesActionsTest-instance-850767745',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-850767745',id=46,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='10913ebbab6441bdaa5b0bd97bf1dfb8',ramdisk_id='',reservation_id='r-ltab5cdd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-959580854',owner_user_name='tempest-VolumesActionsTest-959580854-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T22:00:50Z,user_data=None,user_id='112575ac7c2d4409a95aa1844d967afa',uuid=b42311a5-4334-42ba-9375-e27bc946d490,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "825ed2da-43b7-4f1e-a078-4a55a3e7ed4f", "address": "fa:16:3e:33:95:f5", "network": {"id": "89c20314-7bb0-4ea1-b024-d474e5deb03a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-600863519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10913ebbab6441bdaa5b0bd97bf1dfb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap825ed2da-43", "ovs_interfaceid": "825ed2da-43b7-4f1e-a078-4a55a3e7ed4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 22:00:52 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-9d24abb0-a8f8-4383-a4d7-a1a6a8da8502 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Converting VIF {"id": "825ed2da-43b7-4f1e-a078-4a55a3e7ed4f", "address": "fa:16:3e:33:95:f5", "network": {"id": "89c20314-7bb0-4ea1-b024-d474e5deb03a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-600863519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10913ebbab6441bdaa5b0bd97bf1dfb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap825ed2da-43", "ovs_interfaceid": "825ed2da-43b7-4f1e-a078-4a55a3e7ed4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 22:00:52 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-9d24abb0-a8f8-4383-a4d7-a1a6a8da8502 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:95:f5,bridge_name='br-int',has_traffic_filtering=True,id=825ed2da-43b7-4f1e-a078-4a55a3e7ed4f,network=Network(89c20314-7bb0-4ea1-b024-d474e5deb03a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap825ed2da-43') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 22:00:52 user nova-compute[74337]: DEBUG nova.objects.instance [None req-9d24abb0-a8f8-4383-a4d7-a1a6a8da8502 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Lazy-loading 'pci_devices' on Instance uuid b42311a5-4334-42ba-9375-e27bc946d490 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:00:52 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-9d24abb0-a8f8-4383-a4d7-a1a6a8da8502 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] [instance: b42311a5-4334-42ba-9375-e27bc946d490] End _get_guest_xml xml=<domain type="kvm">
Oct 23 22:00:52 user nova-compute[74337]:   <uuid>b42311a5-4334-42ba-9375-e27bc946d490</uuid>
Oct 23 22:00:52 user nova-compute[74337]:   <name>instance-0000002e</name>
Oct 23 22:00:52 user nova-compute[74337]:   <memory>524288</memory>
Oct 23 22:00:52 user nova-compute[74337]:   <vcpu>1</vcpu>
Oct 23 22:00:52 user nova-compute[74337]:   <metadata>
Oct 23 22:00:52 user nova-compute[74337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 22:00:52 user nova-compute[74337]:       <nova:package version="0.0.0"/>
Oct 23 22:00:52 user nova-compute[74337]:       <nova:name>tempest-VolumesActionsTest-instance-850767745</nova:name>
Oct 23 22:00:52 user nova-compute[74337]:       <nova:creationTime>2023-10-23 22:00:52</nova:creationTime>
Oct 23 22:00:52 user nova-compute[74337]:       <nova:flavor name="m1.tiny">
Oct 23 22:00:52 user nova-compute[74337]:         <nova:memory>512</nova:memory>
Oct 23 22:00:52 user nova-compute[74337]:         <nova:disk>1</nova:disk>
Oct 23 22:00:52 user nova-compute[74337]:         <nova:swap>0</nova:swap>
Oct 23 22:00:52 user nova-compute[74337]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 22:00:52 user nova-compute[74337]:         <nova:vcpus>1</nova:vcpus>
Oct 23 22:00:52 user nova-compute[74337]:       </nova:flavor>
Oct 23 22:00:52 user nova-compute[74337]:       <nova:owner>
Oct 23 22:00:52 user nova-compute[74337]:         <nova:user uuid="112575ac7c2d4409a95aa1844d967afa">tempest-VolumesActionsTest-959580854-project-member</nova:user>
Oct 23 22:00:52 user nova-compute[74337]:         <nova:project uuid="10913ebbab6441bdaa5b0bd97bf1dfb8">tempest-VolumesActionsTest-959580854</nova:project>
Oct 23 22:00:52 user nova-compute[74337]:       </nova:owner>
Oct 23 22:00:52 user nova-compute[74337]:       <nova:root type="image" uuid="d859d89d-998d-4109-b26a-0d6e28152932"/>
Oct 23 22:00:52 user nova-compute[74337]:       <nova:ports>
Oct 23 22:00:52 user nova-compute[74337]:         <nova:port uuid="825ed2da-43b7-4f1e-a078-4a55a3e7ed4f">
Oct 23 22:00:52 user nova-compute[74337]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 23 22:00:52 user nova-compute[74337]:         </nova:port>
Oct 23 22:00:52 user nova-compute[74337]:       </nova:ports>
Oct 23 22:00:52 user nova-compute[74337]:     </nova:instance>
Oct 23 22:00:52 user nova-compute[74337]:   </metadata>
Oct 23 22:00:52 user nova-compute[74337]:   <sysinfo type="smbios">
Oct 23 22:00:52 user nova-compute[74337]:     <system>
Oct 23 22:00:52 user nova-compute[74337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 22:00:52 user nova-compute[74337]:       <entry name="product">OpenStack Nova</entry>
Oct 23 22:00:52 user nova-compute[74337]:       <entry name="version">0.0.0</entry>
Oct 23 22:00:52 user nova-compute[74337]:       <entry name="serial">b42311a5-4334-42ba-9375-e27bc946d490</entry>
Oct 23 22:00:52 user nova-compute[74337]:       <entry name="uuid">b42311a5-4334-42ba-9375-e27bc946d490</entry>
Oct 23 22:00:52 user nova-compute[74337]:       <entry name="family">Virtual Machine</entry>
Oct 23 22:00:52 user nova-compute[74337]:     </system>
Oct 23 22:00:52 user nova-compute[74337]:   </sysinfo>
Oct 23 22:00:52 user nova-compute[74337]:   <os>
Oct 23 22:00:52 user nova-compute[74337]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 22:00:52 user nova-compute[74337]:     <boot dev="hd"/>
Oct 23 22:00:52 user nova-compute[74337]:     <smbios mode="sysinfo"/>
Oct 23 22:00:52 user nova-compute[74337]:   </os>
Oct 23 22:00:52 user nova-compute[74337]:   <features>
Oct 23 22:00:52 user nova-compute[74337]:     <acpi/>
Oct 23 22:00:52 user nova-compute[74337]:     <apic/>
Oct 23 22:00:52 user nova-compute[74337]:     <vmcoreinfo/>
Oct 23 22:00:52 user nova-compute[74337]:   </features>
Oct 23 22:00:52 user nova-compute[74337]:   <clock offset="utc">
Oct 23 22:00:52 user nova-compute[74337]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 22:00:52 user nova-compute[74337]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 22:00:52 user nova-compute[74337]:     <timer name="hpet" present="no"/>
Oct 23 22:00:52 user nova-compute[74337]:   </clock>
Oct 23 22:00:52 user nova-compute[74337]:   <cpu mode="custom" match="exact">
Oct 23 22:00:52 user nova-compute[74337]:     <model>Nehalem</model>
Oct 23 22:00:52 user nova-compute[74337]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 22:00:52 user nova-compute[74337]:   </cpu>
Oct 23 22:00:52 user nova-compute[74337]:   <devices>
Oct 23 22:00:52 user nova-compute[74337]:     <disk type="file" device="disk">
Oct 23 22:00:52 user nova-compute[74337]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 22:00:52 user nova-compute[74337]:       <source file="/opt/stack/data/nova/instances/b42311a5-4334-42ba-9375-e27bc946d490/disk"/>
Oct 23 22:00:52 user nova-compute[74337]:       <target dev="vda" bus="virtio"/>
Oct 23 22:00:52 user nova-compute[74337]:     </disk>
Oct 23 22:00:52 user nova-compute[74337]:     <interface type="ethernet">
Oct 23 22:00:52 user nova-compute[74337]:       <mac address="fa:16:3e:33:95:f5"/>
Oct 23 22:00:52 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 22:00:52 user nova-compute[74337]:       <mtu size="1442"/>
Oct 23 22:00:52 user nova-compute[74337]:       <target dev="tap825ed2da-43"/>
Oct 23 22:00:52 user nova-compute[74337]:     </interface>
Oct 23 22:00:52 user nova-compute[74337]:     <serial type="pty">
Oct 23 22:00:52 user nova-compute[74337]:       <log file="/opt/stack/data/nova/instances/b42311a5-4334-42ba-9375-e27bc946d490/console.log" append="off"/>
Oct 23 22:00:52 user nova-compute[74337]:     </serial>
Oct 23 22:00:52 user nova-compute[74337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 22:00:52 user nova-compute[74337]:     <video>
Oct 23 22:00:52 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 22:00:52 user nova-compute[74337]:     </video>
Oct 23 22:00:52 user nova-compute[74337]:     <rng model="virtio">
Oct 23 22:00:52 user nova-compute[74337]:       <backend model="random">/dev/urandom</backend>
Oct 23 22:00:52 user nova-compute[74337]:     </rng>
Oct 23 22:00:52 user nova-compute[74337]:     <controller type="usb" index="0" model="none"/>
Oct 23 22:00:52 user nova-compute[74337]:     <memballoon model="virtio">
Oct 23 22:00:52 user nova-compute[74337]:       <stats period="10"/>
Oct 23 22:00:52 user nova-compute[74337]:     </memballoon>
Oct 23 22:00:52 user nova-compute[74337]:   </devices>
Oct 23 22:00:52 user nova-compute[74337]: </domain>
Oct 23 22:00:52 user nova-compute[74337]:  {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 22:00:52 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-9d24abb0-a8f8-4383-a4d7-a1a6a8da8502 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T22:00:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-850767745',display_name='tempest-VolumesActionsTest-instance-850767745',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-850767745',id=46,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='10913ebbab6441bdaa5b0bd97bf1dfb8',ramdisk_id='',reservation_id='r-ltab5cdd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-959580854',owner_user_name='tempest-VolumesActionsTest-959580854-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T22:00:50Z,user_data=None,user_id='112575ac7c2d4409a95aa1844d967afa',uuid=b42311a5-4334-42ba-9375-e27bc946d490,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "825ed2da-43b7-4f1e-a078-4a55a3e7ed4f", "address": "fa:16:3e:33:95:f5", "network": {"id": "89c20314-7bb0-4ea1-b024-d474e5deb03a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-600863519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10913ebbab6441bdaa5b0bd97bf1dfb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap825ed2da-43", "ovs_interfaceid": "825ed2da-43b7-4f1e-a078-4a55a3e7ed4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 22:00:52 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-9d24abb0-a8f8-4383-a4d7-a1a6a8da8502 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Converting VIF {"id": "825ed2da-43b7-4f1e-a078-4a55a3e7ed4f", "address": "fa:16:3e:33:95:f5", "network": {"id": "89c20314-7bb0-4ea1-b024-d474e5deb03a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-600863519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10913ebbab6441bdaa5b0bd97bf1dfb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap825ed2da-43", "ovs_interfaceid": "825ed2da-43b7-4f1e-a078-4a55a3e7ed4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 22:00:52 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-9d24abb0-a8f8-4383-a4d7-a1a6a8da8502 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:95:f5,bridge_name='br-int',has_traffic_filtering=True,id=825ed2da-43b7-4f1e-a078-4a55a3e7ed4f,network=Network(89c20314-7bb0-4ea1-b024-d474e5deb03a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap825ed2da-43') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 22:00:52 user nova-compute[74337]: DEBUG os_vif [None req-9d24abb0-a8f8-4383-a4d7-a1a6a8da8502 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:95:f5,bridge_name='br-int',has_traffic_filtering=True,id=825ed2da-43b7-4f1e-a078-4a55a3e7ed4f,network=Network(89c20314-7bb0-4ea1-b024-d474e5deb03a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap825ed2da-43') {{(pid=74337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 22:00:52 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:00:52 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:00:52 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 22:00:52 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:00:52 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '808f6ce4-f7b2-5bee-bcbc-d8ba2f2142a3', '_type': 'linux-noop'}}, row=False) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:00:52 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:00:52 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:00:52 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:00:52 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap825ed2da-43, may_exist=True, interface_attrs={}) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:00:52 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap825ed2da-43, col_values=(('qos', UUID('5781b8cc-0e10-44f6-a10d-6361c4d740df')),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:00:52 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap825ed2da-43, col_values=(('external_ids', {'iface-id': '825ed2da-43b7-4f1e-a078-4a55a3e7ed4f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:33:95:f5', 'vm-uuid': 'b42311a5-4334-42ba-9375-e27bc946d490'}),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:00:52 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:00:52 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:00:52 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:00:52 user nova-compute[74337]: INFO os_vif [None req-9d24abb0-a8f8-4383-a4d7-a1a6a8da8502 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:95:f5,bridge_name='br-int',has_traffic_filtering=True,id=825ed2da-43b7-4f1e-a078-4a55a3e7ed4f,network=Network(89c20314-7bb0-4ea1-b024-d474e5deb03a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap825ed2da-43')
Oct 23 22:00:52 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-9d24abb0-a8f8-4383-a4d7-a1a6a8da8502 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] No BDM found with device name vda, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 22:00:52 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-9d24abb0-a8f8-4383-a4d7-a1a6a8da8502 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] No VIF found with MAC fa:16:3e:33:95:f5, not building metadata {{(pid=74337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 22:00:52 user nova-compute[74337]: DEBUG nova.network.neutron [req-6a914ac2-dd03-4aa0-a70d-147904f18b4c req-831014da-940a-46c5-ae9e-8f7b8c58e4fe service nova] [instance: b42311a5-4334-42ba-9375-e27bc946d490] Updated VIF entry in instance network info cache for port 825ed2da-43b7-4f1e-a078-4a55a3e7ed4f. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 22:00:52 user nova-compute[74337]: DEBUG nova.network.neutron [req-6a914ac2-dd03-4aa0-a70d-147904f18b4c req-831014da-940a-46c5-ae9e-8f7b8c58e4fe service nova] [instance: b42311a5-4334-42ba-9375-e27bc946d490] Updating instance_info_cache with network_info: [{"id": "825ed2da-43b7-4f1e-a078-4a55a3e7ed4f", "address": "fa:16:3e:33:95:f5", "network": {"id": "89c20314-7bb0-4ea1-b024-d474e5deb03a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-600863519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10913ebbab6441bdaa5b0bd97bf1dfb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap825ed2da-43", "ovs_interfaceid": "825ed2da-43b7-4f1e-a078-4a55a3e7ed4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 22:00:52 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-6a914ac2-dd03-4aa0-a70d-147904f18b4c req-831014da-940a-46c5-ae9e-8f7b8c58e4fe service nova] Releasing lock "refresh_cache-b42311a5-4334-42ba-9375-e27bc946d490" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 22:00:52 user nova-compute[74337]: DEBUG nova.compute.manager [None req-fbf0443a-b5d7-4857-a192-b0bd1ff652d5 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] [instance: b7a67b37-36b4-42d4-a1a3-7e5d9896d948] Instance event wait completed in 0 seconds for  {{(pid=74337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 22:00:52 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-fbf0443a-b5d7-4857-a192-b0bd1ff652d5 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] [instance: b7a67b37-36b4-42d4-a1a3-7e5d9896d948] Guest created on hypervisor {{(pid=74337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 22:00:52 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: b7a67b37-36b4-42d4-a1a3-7e5d9896d948] Instance spawned successfully.
Oct 23 22:00:52 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-fbf0443a-b5d7-4857-a192-b0bd1ff652d5 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] [instance: b7a67b37-36b4-42d4-a1a3-7e5d9896d948] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 22:00:52 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-fbf0443a-b5d7-4857-a192-b0bd1ff652d5 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] [instance: b7a67b37-36b4-42d4-a1a3-7e5d9896d948] Found default for hw_cdrom_bus of ide {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 22:00:52 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-fbf0443a-b5d7-4857-a192-b0bd1ff652d5 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] [instance: b7a67b37-36b4-42d4-a1a3-7e5d9896d948] Found default for hw_disk_bus of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 22:00:52 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-fbf0443a-b5d7-4857-a192-b0bd1ff652d5 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] [instance: b7a67b37-36b4-42d4-a1a3-7e5d9896d948] Found default for hw_input_bus of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 22:00:52 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-fbf0443a-b5d7-4857-a192-b0bd1ff652d5 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] [instance: b7a67b37-36b4-42d4-a1a3-7e5d9896d948] Found default for hw_pointer_model of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 22:00:52 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-fbf0443a-b5d7-4857-a192-b0bd1ff652d5 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] [instance: b7a67b37-36b4-42d4-a1a3-7e5d9896d948] Found default for hw_video_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 22:00:52 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-fbf0443a-b5d7-4857-a192-b0bd1ff652d5 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] [instance: b7a67b37-36b4-42d4-a1a3-7e5d9896d948] Found default for hw_vif_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 22:00:52 user nova-compute[74337]: INFO nova.compute.manager [None req-fbf0443a-b5d7-4857-a192-b0bd1ff652d5 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] [instance: b7a67b37-36b4-42d4-a1a3-7e5d9896d948] Took 7.58 seconds to spawn the instance on the hypervisor.
Oct 23 22:00:52 user nova-compute[74337]: DEBUG nova.compute.manager [None req-fbf0443a-b5d7-4857-a192-b0bd1ff652d5 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] [instance: b7a67b37-36b4-42d4-a1a3-7e5d9896d948] Checking state {{(pid=74337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 22:00:53 user nova-compute[74337]: INFO nova.compute.manager [None req-fbf0443a-b5d7-4857-a192-b0bd1ff652d5 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] [instance: b7a67b37-36b4-42d4-a1a3-7e5d9896d948] Took 8.65 seconds to build instance.
Oct 23 22:00:53 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-fbf0443a-b5d7-4857-a192-b0bd1ff652d5 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Lock "b7a67b37-36b4-42d4-a1a3-7e5d9896d948" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.764s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:00:53 user nova-compute[74337]: DEBUG nova.compute.manager [None req-54d8dc23-20da-449f-9231-c2deec58823d tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Instance event wait completed in 0 seconds for  {{(pid=74337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 22:00:53 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-54d8dc23-20da-449f-9231-c2deec58823d tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Guest created on hypervisor {{(pid=74337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 22:00:53 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:00:53 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Instance spawned successfully.
Oct 23 22:00:53 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:00:53 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:00:53 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:00:53 user nova-compute[74337]: DEBUG nova.compute.manager [req-079be1f7-85c4-4511-9c23-c090725b9319 req-a9a0bdb3-d3af-4558-9f1f-90f011bc9dce service nova] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Received event network-vif-plugged-0b516177-6ded-4b79-9f77-84ba1466f259 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:00:53 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-079be1f7-85c4-4511-9c23-c090725b9319 req-a9a0bdb3-d3af-4558-9f1f-90f011bc9dce service nova] Acquiring lock "dbad2e14-7b6c-475e-b471-a87cb9e21b7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:00:53 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-079be1f7-85c4-4511-9c23-c090725b9319 req-a9a0bdb3-d3af-4558-9f1f-90f011bc9dce service nova] Lock "dbad2e14-7b6c-475e-b471-a87cb9e21b7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:00:53 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-079be1f7-85c4-4511-9c23-c090725b9319 req-a9a0bdb3-d3af-4558-9f1f-90f011bc9dce service nova] Lock "dbad2e14-7b6c-475e-b471-a87cb9e21b7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:00:53 user nova-compute[74337]: DEBUG nova.compute.manager [req-079be1f7-85c4-4511-9c23-c090725b9319 req-a9a0bdb3-d3af-4558-9f1f-90f011bc9dce service nova] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] No waiting events found dispatching network-vif-plugged-0b516177-6ded-4b79-9f77-84ba1466f259 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 22:00:53 user nova-compute[74337]: WARNING nova.compute.manager [req-079be1f7-85c4-4511-9c23-c090725b9319 req-a9a0bdb3-d3af-4558-9f1f-90f011bc9dce service nova] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Received unexpected event network-vif-plugged-0b516177-6ded-4b79-9f77-84ba1466f259 for instance with vm_state shelved_offloaded and task_state spawning.
Oct 23 22:00:53 user nova-compute[74337]: DEBUG nova.compute.manager [None req-54d8dc23-20da-449f-9231-c2deec58823d tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Checking state {{(pid=74337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 22:00:54 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:00:54 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-54d8dc23-20da-449f-9231-c2deec58823d tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Lock "dbad2e14-7b6c-475e-b471-a87cb9e21b7f" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 12.332s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:00:54 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:00:54 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:00:54 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:00:55 user nova-compute[74337]: DEBUG nova.compute.manager [req-f1771b28-b8b4-4e52-a4e6-9839453f4ae1 req-72d9849a-db2c-4620-91be-337000ba0f37 service nova] [instance: b42311a5-4334-42ba-9375-e27bc946d490] Received event network-vif-plugged-825ed2da-43b7-4f1e-a078-4a55a3e7ed4f {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:00:55 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-f1771b28-b8b4-4e52-a4e6-9839453f4ae1 req-72d9849a-db2c-4620-91be-337000ba0f37 service nova] Acquiring lock "b42311a5-4334-42ba-9375-e27bc946d490-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:00:55 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-f1771b28-b8b4-4e52-a4e6-9839453f4ae1 req-72d9849a-db2c-4620-91be-337000ba0f37 service nova] Lock "b42311a5-4334-42ba-9375-e27bc946d490-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:00:55 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-f1771b28-b8b4-4e52-a4e6-9839453f4ae1 req-72d9849a-db2c-4620-91be-337000ba0f37 service nova] Lock "b42311a5-4334-42ba-9375-e27bc946d490-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:00:55 user nova-compute[74337]: DEBUG nova.compute.manager [req-f1771b28-b8b4-4e52-a4e6-9839453f4ae1 req-72d9849a-db2c-4620-91be-337000ba0f37 service nova] [instance: b42311a5-4334-42ba-9375-e27bc946d490] No waiting events found dispatching network-vif-plugged-825ed2da-43b7-4f1e-a078-4a55a3e7ed4f {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 22:00:55 user nova-compute[74337]: WARNING nova.compute.manager [req-f1771b28-b8b4-4e52-a4e6-9839453f4ae1 req-72d9849a-db2c-4620-91be-337000ba0f37 service nova] [instance: b42311a5-4334-42ba-9375-e27bc946d490] Received unexpected event network-vif-plugged-825ed2da-43b7-4f1e-a078-4a55a3e7ed4f for instance with vm_state building and task_state spawning.
Oct 23 22:00:55 user nova-compute[74337]: DEBUG nova.compute.manager [req-f1771b28-b8b4-4e52-a4e6-9839453f4ae1 req-72d9849a-db2c-4620-91be-337000ba0f37 service nova] [instance: b42311a5-4334-42ba-9375-e27bc946d490] Received event network-vif-plugged-825ed2da-43b7-4f1e-a078-4a55a3e7ed4f {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:00:55 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-f1771b28-b8b4-4e52-a4e6-9839453f4ae1 req-72d9849a-db2c-4620-91be-337000ba0f37 service nova] Acquiring lock "b42311a5-4334-42ba-9375-e27bc946d490-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:00:55 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-f1771b28-b8b4-4e52-a4e6-9839453f4ae1 req-72d9849a-db2c-4620-91be-337000ba0f37 service nova] Lock "b42311a5-4334-42ba-9375-e27bc946d490-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:00:55 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-f1771b28-b8b4-4e52-a4e6-9839453f4ae1 req-72d9849a-db2c-4620-91be-337000ba0f37 service nova] Lock "b42311a5-4334-42ba-9375-e27bc946d490-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:00:55 user nova-compute[74337]: DEBUG nova.compute.manager [req-f1771b28-b8b4-4e52-a4e6-9839453f4ae1 req-72d9849a-db2c-4620-91be-337000ba0f37 service nova] [instance: b42311a5-4334-42ba-9375-e27bc946d490] No waiting events found dispatching network-vif-plugged-825ed2da-43b7-4f1e-a078-4a55a3e7ed4f {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 22:00:55 user nova-compute[74337]: WARNING nova.compute.manager [req-f1771b28-b8b4-4e52-a4e6-9839453f4ae1 req-72d9849a-db2c-4620-91be-337000ba0f37 service nova] [instance: b42311a5-4334-42ba-9375-e27bc946d490] Received unexpected event network-vif-plugged-825ed2da-43b7-4f1e-a078-4a55a3e7ed4f for instance with vm_state building and task_state spawning.
Oct 23 22:00:55 user nova-compute[74337]: DEBUG nova.compute.manager [None req-9d24abb0-a8f8-4383-a4d7-a1a6a8da8502 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] [instance: b42311a5-4334-42ba-9375-e27bc946d490] Instance event wait completed in 0 seconds for  {{(pid=74337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 22:00:55 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-9d24abb0-a8f8-4383-a4d7-a1a6a8da8502 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] [instance: b42311a5-4334-42ba-9375-e27bc946d490] Guest created on hypervisor {{(pid=74337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 22:00:55 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: b42311a5-4334-42ba-9375-e27bc946d490] Instance spawned successfully.
Oct 23 22:00:55 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-9d24abb0-a8f8-4383-a4d7-a1a6a8da8502 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] [instance: b42311a5-4334-42ba-9375-e27bc946d490] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 22:00:55 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-9d24abb0-a8f8-4383-a4d7-a1a6a8da8502 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] [instance: b42311a5-4334-42ba-9375-e27bc946d490] Found default for hw_cdrom_bus of ide {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 22:00:55 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-9d24abb0-a8f8-4383-a4d7-a1a6a8da8502 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] [instance: b42311a5-4334-42ba-9375-e27bc946d490] Found default for hw_disk_bus of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 22:00:55 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-9d24abb0-a8f8-4383-a4d7-a1a6a8da8502 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] [instance: b42311a5-4334-42ba-9375-e27bc946d490] Found default for hw_input_bus of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 22:00:55 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-9d24abb0-a8f8-4383-a4d7-a1a6a8da8502 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] [instance: b42311a5-4334-42ba-9375-e27bc946d490] Found default for hw_pointer_model of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 22:00:55 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-9d24abb0-a8f8-4383-a4d7-a1a6a8da8502 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] [instance: b42311a5-4334-42ba-9375-e27bc946d490] Found default for hw_video_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 22:00:55 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-9d24abb0-a8f8-4383-a4d7-a1a6a8da8502 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] [instance: b42311a5-4334-42ba-9375-e27bc946d490] Found default for hw_vif_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 22:00:55 user nova-compute[74337]: INFO nova.compute.manager [None req-9d24abb0-a8f8-4383-a4d7-a1a6a8da8502 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] [instance: b42311a5-4334-42ba-9375-e27bc946d490] Took 5.59 seconds to spawn the instance on the hypervisor.
Oct 23 22:00:55 user nova-compute[74337]: DEBUG nova.compute.manager [None req-9d24abb0-a8f8-4383-a4d7-a1a6a8da8502 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] [instance: b42311a5-4334-42ba-9375-e27bc946d490] Checking state {{(pid=74337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 22:00:55 user nova-compute[74337]: INFO nova.compute.manager [None req-9d24abb0-a8f8-4383-a4d7-a1a6a8da8502 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] [instance: b42311a5-4334-42ba-9375-e27bc946d490] Took 6.29 seconds to build instance.
Oct 23 22:00:56 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-9d24abb0-a8f8-4383-a4d7-a1a6a8da8502 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Lock "b42311a5-4334-42ba-9375-e27bc946d490" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.393s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:00:57 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:00:59 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:01:02 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:01:04 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:01:07 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:01:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:01:12 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:01:14 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:01:16 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:01:17 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:01:17 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:01:17 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:01:18 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:01:18 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 22:01:19 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:01:20 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:01:21 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:01:21 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Starting heal instance info cache {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 22:01:21 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Rebuilding the list of instances to heal {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 22:01:21 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "refresh_cache-999843b2-b757-480b-bd21-bf281954bc46" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 22:01:21 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquired lock "refresh_cache-999843b2-b757-480b-bd21-bf281954bc46" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 22:01:21 user nova-compute[74337]: DEBUG nova.network.neutron [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Forcefully refreshing network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 22:01:21 user nova-compute[74337]: DEBUG nova.objects.instance [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lazy-loading 'info_cache' on Instance uuid 999843b2-b757-480b-bd21-bf281954bc46 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:01:22 user nova-compute[74337]: DEBUG nova.network.neutron [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Updating instance_info_cache with network_info: [{"id": "02913be6-773f-402a-a534-d7567aeb5b7a", "address": "fa:16:3e:a2:cd:9d", "network": {"id": "122fdd20-8bf5-4374-b50c-82e5dc8684db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-81475496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80f79dd6954748e4806a568a4127396f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02913be6-77", "ovs_interfaceid": "02913be6-773f-402a-a534-d7567aeb5b7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 22:01:22 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Releasing lock "refresh_cache-999843b2-b757-480b-bd21-bf281954bc46" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 22:01:22 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Updated the network info_cache for instance {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 22:01:22 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:01:22 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:01:22 user nova-compute[74337]: INFO nova.compute.manager [None req-307660c3-d242-4218-be2f-c5bfbd746c30 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 27710919-a717-42fa-a436-a261d92c1c2a] Rescuing
Oct 23 22:01:22 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-307660c3-d242-4218-be2f-c5bfbd746c30 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Acquiring lock "refresh_cache-27710919-a717-42fa-a436-a261d92c1c2a" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 22:01:22 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-307660c3-d242-4218-be2f-c5bfbd746c30 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Acquired lock "refresh_cache-27710919-a717-42fa-a436-a261d92c1c2a" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 22:01:22 user nova-compute[74337]: DEBUG nova.network.neutron [None req-307660c3-d242-4218-be2f-c5bfbd746c30 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 27710919-a717-42fa-a436-a261d92c1c2a] Building network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 22:01:22 user nova-compute[74337]: DEBUG nova.network.neutron [None req-307660c3-d242-4218-be2f-c5bfbd746c30 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 27710919-a717-42fa-a436-a261d92c1c2a] Updating instance_info_cache with network_info: [{"id": "85905b2e-3e09-4236-8fe7-ea6c31324ae6", "address": "fa:16:3e:50:cd:90", "network": {"id": "122fdd20-8bf5-4374-b50c-82e5dc8684db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-81475496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80f79dd6954748e4806a568a4127396f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85905b2e-3e", "ovs_interfaceid": "85905b2e-3e09-4236-8fe7-ea6c31324ae6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 22:01:22 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-307660c3-d242-4218-be2f-c5bfbd746c30 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Releasing lock "refresh_cache-27710919-a717-42fa-a436-a261d92c1c2a" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 22:01:23 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:01:23 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:01:23 user nova-compute[74337]: DEBUG nova.compute.manager [req-b91c6def-9fc6-4b71-9521-785b606b4dbf req-53a731e0-4568-42bc-99bf-bdf2b7561c4e service nova] [instance: 27710919-a717-42fa-a436-a261d92c1c2a] Received event network-vif-unplugged-85905b2e-3e09-4236-8fe7-ea6c31324ae6 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:01:23 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-b91c6def-9fc6-4b71-9521-785b606b4dbf req-53a731e0-4568-42bc-99bf-bdf2b7561c4e service nova] Acquiring lock "27710919-a717-42fa-a436-a261d92c1c2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:01:23 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-b91c6def-9fc6-4b71-9521-785b606b4dbf req-53a731e0-4568-42bc-99bf-bdf2b7561c4e service nova] Lock "27710919-a717-42fa-a436-a261d92c1c2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:01:23 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-b91c6def-9fc6-4b71-9521-785b606b4dbf req-53a731e0-4568-42bc-99bf-bdf2b7561c4e service nova] Lock "27710919-a717-42fa-a436-a261d92c1c2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:01:23 user nova-compute[74337]: DEBUG nova.compute.manager [req-b91c6def-9fc6-4b71-9521-785b606b4dbf req-53a731e0-4568-42bc-99bf-bdf2b7561c4e service nova] [instance: 27710919-a717-42fa-a436-a261d92c1c2a] No waiting events found dispatching network-vif-unplugged-85905b2e-3e09-4236-8fe7-ea6c31324ae6 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 22:01:23 user nova-compute[74337]: WARNING nova.compute.manager [req-b91c6def-9fc6-4b71-9521-785b606b4dbf req-53a731e0-4568-42bc-99bf-bdf2b7561c4e service nova] [instance: 27710919-a717-42fa-a436-a261d92c1c2a] Received unexpected event network-vif-unplugged-85905b2e-3e09-4236-8fe7-ea6c31324ae6 for instance with vm_state active and task_state rescuing.
Oct 23 22:01:23 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:01:23 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:01:23 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:01:23 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: 27710919-a717-42fa-a436-a261d92c1c2a] Instance destroyed successfully.
Oct 23 22:01:23 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-307660c3-d242-4218-be2f-c5bfbd746c30 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 27710919-a717-42fa-a436-a261d92c1c2a] Attempting rescue
Oct 23 22:01:23 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-307660c3-d242-4218-be2f-c5bfbd746c30 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74337) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 23 22:01:23 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-307660c3-d242-4218-be2f-c5bfbd746c30 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 27710919-a717-42fa-a436-a261d92c1c2a] Instance directory exists: not creating {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 23 22:01:23 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-307660c3-d242-4218-be2f-c5bfbd746c30 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 27710919-a717-42fa-a436-a261d92c1c2a] Creating image(s)
Oct 23 22:01:23 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-307660c3-d242-4218-be2f-c5bfbd746c30 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Acquiring lock "/opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:01:23 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-307660c3-d242-4218-be2f-c5bfbd746c30 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Lock "/opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:01:23 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-307660c3-d242-4218-be2f-c5bfbd746c30 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Lock "/opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:01:23 user nova-compute[74337]: DEBUG nova.objects.instance [None req-307660c3-d242-4218-be2f-c5bfbd746c30 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Lazy-loading 'trusted_certs' on Instance uuid 27710919-a717-42fa-a436-a261d92c1c2a {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:01:23 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-307660c3-d242-4218-be2f-c5bfbd746c30 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Acquiring lock "fc7b140751b8c385de81623e40fb09ce09374ab7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:01:23 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-307660c3-d242-4218-be2f-c5bfbd746c30 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Lock "fc7b140751b8c385de81623e40fb09ce09374ab7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:01:23 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-307660c3-d242-4218-be2f-c5bfbd746c30 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:01:24 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:01:24 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-307660c3-d242-4218-be2f-c5bfbd746c30 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.183s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:01:24 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-307660c3-d242-4218-be2f-c5bfbd746c30 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7,backing_fmt=raw /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk.rescue {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:01:24 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-307660c3-d242-4218-be2f-c5bfbd746c30 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7,backing_fmt=raw /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk.rescue" returned: 0 in 0.051s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:01:24 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-307660c3-d242-4218-be2f-c5bfbd746c30 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Lock "fc7b140751b8c385de81623e40fb09ce09374ab7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:01:24 user nova-compute[74337]: DEBUG nova.objects.instance [None req-307660c3-d242-4218-be2f-c5bfbd746c30 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Lazy-loading 'migration_context' on Instance uuid 27710919-a717-42fa-a436-a261d92c1c2a {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:01:24 user nova-compute[74337]: DEBUG nova.objects.base [None req-307660c3-d242-4218-be2f-c5bfbd746c30 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Object Instance<27710919-a717-42fa-a436-a261d92c1c2a> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 22:01:24 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-307660c3-d242-4218-be2f-c5bfbd746c30 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 27710919-a717-42fa-a436-a261d92c1c2a] Created local disks {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 22:01:24 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-307660c3-d242-4218-be2f-c5bfbd746c30 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 27710919-a717-42fa-a436-a261d92c1c2a] Start _get_guest_xml network_info=[{"id": "85905b2e-3e09-4236-8fe7-ea6c31324ae6", "address": "fa:16:3e:50:cd:90", "network": {"id": "122fdd20-8bf5-4374-b50c-82e5dc8684db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-81475496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-81475496-network", "vif_mac": "fa:16:3e:50:cd:90"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80f79dd6954748e4806a568a4127396f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85905b2e-3e", "ovs_interfaceid": "85905b2e-3e09-4236-8fe7-ea6c31324ae6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T21:29:21Z,direct_url=<?>,disk_format='qcow2',id=d859d89d-998d-4109-b26a-0d6e28152932,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ff43462300764979a6cf688444336a56',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T21:29:22Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'd859d89d-998d-4109-b26a-0d6e28152932', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 22:01:24 user nova-compute[74337]: DEBUG nova.objects.instance [None req-307660c3-d242-4218-be2f-c5bfbd746c30 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Lazy-loading 'resources' on Instance uuid 27710919-a717-42fa-a436-a261d92c1c2a {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:01:24 user nova-compute[74337]: DEBUG nova.objects.base [None req-307660c3-d242-4218-be2f-c5bfbd746c30 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Object Instance<27710919-a717-42fa-a436-a261d92c1c2a> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 22:01:24 user nova-compute[74337]: DEBUG nova.objects.instance [None req-307660c3-d242-4218-be2f-c5bfbd746c30 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Lazy-loading 'numa_topology' on Instance uuid 27710919-a717-42fa-a436-a261d92c1c2a {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:01:24 user nova-compute[74337]: DEBUG nova.objects.base [None req-307660c3-d242-4218-be2f-c5bfbd746c30 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Object Instance<27710919-a717-42fa-a436-a261d92c1c2a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 22:01:24 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-307660c3-d242-4218-be2f-c5bfbd746c30 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:01:24 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-307660c3-d242-4218-be2f-c5bfbd746c30 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:01:24 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-307660c3-d242-4218-be2f-c5bfbd746c30 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 22:01:24 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-307660c3-d242-4218-be2f-c5bfbd746c30 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] CPU controller missing on host. {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 22:01:24 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-307660c3-d242-4218-be2f-c5bfbd746c30 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 22:01:24 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-307660c3-d242-4218-be2f-c5bfbd746c30 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] CPU controller found on host. {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 22:01:24 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-307660c3-d242-4218-be2f-c5bfbd746c30 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 22:01:24 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-307660c3-d242-4218-be2f-c5bfbd746c30 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T21:29:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T21:29:21Z,direct_url=<?>,disk_format='qcow2',id=d859d89d-998d-4109-b26a-0d6e28152932,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ff43462300764979a6cf688444336a56',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T21:29:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 22:01:24 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-307660c3-d242-4218-be2f-c5bfbd746c30 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Flavor limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 22:01:24 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-307660c3-d242-4218-be2f-c5bfbd746c30 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Image limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 22:01:24 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-307660c3-d242-4218-be2f-c5bfbd746c30 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Flavor pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 22:01:24 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-307660c3-d242-4218-be2f-c5bfbd746c30 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Image pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 22:01:24 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-307660c3-d242-4218-be2f-c5bfbd746c30 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 22:01:24 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-307660c3-d242-4218-be2f-c5bfbd746c30 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 22:01:24 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-307660c3-d242-4218-be2f-c5bfbd746c30 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 22:01:24 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-307660c3-d242-4218-be2f-c5bfbd746c30 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Got 1 possible topologies {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 22:01:24 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-307660c3-d242-4218-be2f-c5bfbd746c30 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 22:01:24 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-307660c3-d242-4218-be2f-c5bfbd746c30 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 22:01:24 user nova-compute[74337]: DEBUG nova.objects.instance [None req-307660c3-d242-4218-be2f-c5bfbd746c30 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Lazy-loading 'vcpu_model' on Instance uuid 27710919-a717-42fa-a436-a261d92c1c2a {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:01:24 user nova-compute[74337]: DEBUG nova.objects.base [None req-307660c3-d242-4218-be2f-c5bfbd746c30 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Object Instance<27710919-a717-42fa-a436-a261d92c1c2a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 22:01:24 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-307660c3-d242-4218-be2f-c5bfbd746c30 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:59:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-728469709',display_name='tempest-ServerRescueNegativeTestJSON-server-728469709',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-728469709',id=42,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-23T21:59:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='80f79dd6954748e4806a568a4127396f',ramdisk_id='',reservation_id='r-s6fq6tqs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2089412853',owner_user_name='tempest-ServerRescueNegativeTestJSON-2089412853-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:59:39Z,user_data=None,user_id='a0f5c4ec386544e1afd2f0a7d1b1c94f',uuid=27710919-a717-42fa-a436-a261d92c1c2a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "85905b2e-3e09-4236-8fe7-ea6c31324ae6", "address": "fa:16:3e:50:cd:90", "network": {"id": "122fdd20-8bf5-4374-b50c-82e5dc8684db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-81475496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-81475496-network", "vif_mac": "fa:16:3e:50:cd:90"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80f79dd6954748e4806a568a4127396f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85905b2e-3e", "ovs_interfaceid": "85905b2e-3e09-4236-8fe7-ea6c31324ae6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 22:01:24 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-307660c3-d242-4218-be2f-c5bfbd746c30 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Converting VIF {"id": "85905b2e-3e09-4236-8fe7-ea6c31324ae6", "address": "fa:16:3e:50:cd:90", "network": {"id": "122fdd20-8bf5-4374-b50c-82e5dc8684db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-81475496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-81475496-network", "vif_mac": "fa:16:3e:50:cd:90"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80f79dd6954748e4806a568a4127396f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85905b2e-3e", "ovs_interfaceid": "85905b2e-3e09-4236-8fe7-ea6c31324ae6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 22:01:24 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-307660c3-d242-4218-be2f-c5bfbd746c30 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:50:cd:90,bridge_name='br-int',has_traffic_filtering=True,id=85905b2e-3e09-4236-8fe7-ea6c31324ae6,network=Network(122fdd20-8bf5-4374-b50c-82e5dc8684db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85905b2e-3e') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 22:01:24 user nova-compute[74337]: DEBUG nova.objects.instance [None req-307660c3-d242-4218-be2f-c5bfbd746c30 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Lazy-loading 'pci_devices' on Instance uuid 27710919-a717-42fa-a436-a261d92c1c2a {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:01:24 user nova-compute[74337]: DEBUG nova.objects.base [None req-307660c3-d242-4218-be2f-c5bfbd746c30 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Object Instance<27710919-a717-42fa-a436-a261d92c1c2a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 22:01:24 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-307660c3-d242-4218-be2f-c5bfbd746c30 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 27710919-a717-42fa-a436-a261d92c1c2a] End _get_guest_xml xml=<domain type="kvm">
Oct 23 22:01:24 user nova-compute[74337]:   <uuid>27710919-a717-42fa-a436-a261d92c1c2a</uuid>
Oct 23 22:01:24 user nova-compute[74337]:   <name>instance-0000002a</name>
Oct 23 22:01:24 user nova-compute[74337]:   <memory>524288</memory>
Oct 23 22:01:24 user nova-compute[74337]:   <vcpu>1</vcpu>
Oct 23 22:01:24 user nova-compute[74337]:   <metadata>
Oct 23 22:01:24 user nova-compute[74337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 22:01:24 user nova-compute[74337]:       <nova:package version="0.0.0"/>
Oct 23 22:01:24 user nova-compute[74337]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-728469709</nova:name>
Oct 23 22:01:24 user nova-compute[74337]:       <nova:creationTime>2023-10-23 22:01:24</nova:creationTime>
Oct 23 22:01:24 user nova-compute[74337]:       <nova:flavor name="m1.tiny">
Oct 23 22:01:24 user nova-compute[74337]:         <nova:memory>512</nova:memory>
Oct 23 22:01:24 user nova-compute[74337]:         <nova:disk>1</nova:disk>
Oct 23 22:01:24 user nova-compute[74337]:         <nova:swap>0</nova:swap>
Oct 23 22:01:24 user nova-compute[74337]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 22:01:24 user nova-compute[74337]:         <nova:vcpus>1</nova:vcpus>
Oct 23 22:01:24 user nova-compute[74337]:       </nova:flavor>
Oct 23 22:01:24 user nova-compute[74337]:       <nova:owner>
Oct 23 22:01:24 user nova-compute[74337]:         <nova:user uuid="a0f5c4ec386544e1afd2f0a7d1b1c94f">tempest-ServerRescueNegativeTestJSON-2089412853-project-member</nova:user>
Oct 23 22:01:24 user nova-compute[74337]:         <nova:project uuid="80f79dd6954748e4806a568a4127396f">tempest-ServerRescueNegativeTestJSON-2089412853</nova:project>
Oct 23 22:01:24 user nova-compute[74337]:       </nova:owner>
Oct 23 22:01:24 user nova-compute[74337]:       <nova:root type="image" uuid="d859d89d-998d-4109-b26a-0d6e28152932"/>
Oct 23 22:01:24 user nova-compute[74337]:       <nova:ports>
Oct 23 22:01:24 user nova-compute[74337]:         <nova:port uuid="85905b2e-3e09-4236-8fe7-ea6c31324ae6">
Oct 23 22:01:24 user nova-compute[74337]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 23 22:01:24 user nova-compute[74337]:         </nova:port>
Oct 23 22:01:24 user nova-compute[74337]:       </nova:ports>
Oct 23 22:01:24 user nova-compute[74337]:     </nova:instance>
Oct 23 22:01:24 user nova-compute[74337]:   </metadata>
Oct 23 22:01:24 user nova-compute[74337]:   <sysinfo type="smbios">
Oct 23 22:01:24 user nova-compute[74337]:     <system>
Oct 23 22:01:24 user nova-compute[74337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 22:01:24 user nova-compute[74337]:       <entry name="product">OpenStack Nova</entry>
Oct 23 22:01:24 user nova-compute[74337]:       <entry name="version">0.0.0</entry>
Oct 23 22:01:24 user nova-compute[74337]:       <entry name="serial">27710919-a717-42fa-a436-a261d92c1c2a</entry>
Oct 23 22:01:24 user nova-compute[74337]:       <entry name="uuid">27710919-a717-42fa-a436-a261d92c1c2a</entry>
Oct 23 22:01:24 user nova-compute[74337]:       <entry name="family">Virtual Machine</entry>
Oct 23 22:01:24 user nova-compute[74337]:     </system>
Oct 23 22:01:24 user nova-compute[74337]:   </sysinfo>
Oct 23 22:01:24 user nova-compute[74337]:   <os>
Oct 23 22:01:24 user nova-compute[74337]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 22:01:24 user nova-compute[74337]:     <smbios mode="sysinfo"/>
Oct 23 22:01:24 user nova-compute[74337]:   </os>
Oct 23 22:01:24 user nova-compute[74337]:   <features>
Oct 23 22:01:24 user nova-compute[74337]:     <acpi/>
Oct 23 22:01:24 user nova-compute[74337]:     <apic/>
Oct 23 22:01:24 user nova-compute[74337]:     <vmcoreinfo/>
Oct 23 22:01:24 user nova-compute[74337]:   </features>
Oct 23 22:01:24 user nova-compute[74337]:   <clock offset="utc">
Oct 23 22:01:24 user nova-compute[74337]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 22:01:24 user nova-compute[74337]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 22:01:24 user nova-compute[74337]:     <timer name="hpet" present="no"/>
Oct 23 22:01:24 user nova-compute[74337]:   </clock>
Oct 23 22:01:24 user nova-compute[74337]:   <cpu mode="custom" match="exact">
Oct 23 22:01:24 user nova-compute[74337]:     <model>Nehalem</model>
Oct 23 22:01:24 user nova-compute[74337]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 22:01:24 user nova-compute[74337]:   </cpu>
Oct 23 22:01:24 user nova-compute[74337]:   <devices>
Oct 23 22:01:24 user nova-compute[74337]:     <disk type="file" device="disk">
Oct 23 22:01:24 user nova-compute[74337]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 22:01:24 user nova-compute[74337]:       <source file="/opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk.rescue"/>
Oct 23 22:01:24 user nova-compute[74337]:       <target dev="vda" bus="virtio"/>
Oct 23 22:01:24 user nova-compute[74337]:     </disk>
Oct 23 22:01:24 user nova-compute[74337]:     <disk type="file" device="disk">
Oct 23 22:01:24 user nova-compute[74337]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 22:01:24 user nova-compute[74337]:       <source file="/opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk"/>
Oct 23 22:01:24 user nova-compute[74337]:       <target dev="vdb" bus="virtio"/>
Oct 23 22:01:24 user nova-compute[74337]:     </disk>
Oct 23 22:01:24 user nova-compute[74337]:     <interface type="ethernet">
Oct 23 22:01:24 user nova-compute[74337]:       <mac address="fa:16:3e:50:cd:90"/>
Oct 23 22:01:24 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 22:01:24 user nova-compute[74337]:       <mtu size="1442"/>
Oct 23 22:01:24 user nova-compute[74337]:       <target dev="tap85905b2e-3e"/>
Oct 23 22:01:24 user nova-compute[74337]:     </interface>
Oct 23 22:01:24 user nova-compute[74337]:     <serial type="pty">
Oct 23 22:01:24 user nova-compute[74337]:       <log file="/opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/console.log" append="off"/>
Oct 23 22:01:24 user nova-compute[74337]:     </serial>
Oct 23 22:01:24 user nova-compute[74337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 22:01:24 user nova-compute[74337]:     <video>
Oct 23 22:01:24 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 22:01:24 user nova-compute[74337]:     </video>
Oct 23 22:01:24 user nova-compute[74337]:     <rng model="virtio">
Oct 23 22:01:24 user nova-compute[74337]:       <backend model="random">/dev/urandom</backend>
Oct 23 22:01:24 user nova-compute[74337]:     </rng>
Oct 23 22:01:24 user nova-compute[74337]:     <controller type="usb" index="0" model="none"/>
Oct 23 22:01:24 user nova-compute[74337]:     <memballoon model="virtio">
Oct 23 22:01:24 user nova-compute[74337]:       <stats period="10"/>
Oct 23 22:01:24 user nova-compute[74337]:     </memballoon>
Oct 23 22:01:24 user nova-compute[74337]:   </devices>
Oct 23 22:01:24 user nova-compute[74337]: </domain>
Oct 23 22:01:24 user nova-compute[74337]:  {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 22:01:24 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: 27710919-a717-42fa-a436-a261d92c1c2a] Instance destroyed successfully.
Oct 23 22:01:24 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-307660c3-d242-4218-be2f-c5bfbd746c30 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] No BDM found with device name vda, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 22:01:24 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-307660c3-d242-4218-be2f-c5bfbd746c30 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 22:01:24 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-307660c3-d242-4218-be2f-c5bfbd746c30 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] No VIF found with MAC fa:16:3e:50:cd:90, not building metadata {{(pid=74337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 22:01:24 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:01:24 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:01:24 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:01:24 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:01:24 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:01:24 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Auditing locally available compute resources for user (node: user) {{(pid=74337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 22:01:25 user nova-compute[74337]: DEBUG nova.compute.manager [req-c99d6a45-41ae-4eb2-a817-8b4a9ac637ed req-fac7d485-6f62-4b70-85a9-279921720b47 service nova] [instance: 27710919-a717-42fa-a436-a261d92c1c2a] Received event network-vif-plugged-85905b2e-3e09-4236-8fe7-ea6c31324ae6 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:01:25 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-c99d6a45-41ae-4eb2-a817-8b4a9ac637ed req-fac7d485-6f62-4b70-85a9-279921720b47 service nova] Acquiring lock "27710919-a717-42fa-a436-a261d92c1c2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:01:25 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-c99d6a45-41ae-4eb2-a817-8b4a9ac637ed req-fac7d485-6f62-4b70-85a9-279921720b47 service nova] Lock "27710919-a717-42fa-a436-a261d92c1c2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:01:25 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-c99d6a45-41ae-4eb2-a817-8b4a9ac637ed req-fac7d485-6f62-4b70-85a9-279921720b47 service nova] Lock "27710919-a717-42fa-a436-a261d92c1c2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:01:25 user nova-compute[74337]: DEBUG nova.compute.manager [req-c99d6a45-41ae-4eb2-a817-8b4a9ac637ed req-fac7d485-6f62-4b70-85a9-279921720b47 service nova] [instance: 27710919-a717-42fa-a436-a261d92c1c2a] No waiting events found dispatching network-vif-plugged-85905b2e-3e09-4236-8fe7-ea6c31324ae6 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 22:01:25 user nova-compute[74337]: WARNING nova.compute.manager [req-c99d6a45-41ae-4eb2-a817-8b4a9ac637ed req-fac7d485-6f62-4b70-85a9-279921720b47 service nova] [instance: 27710919-a717-42fa-a436-a261d92c1c2a] Received unexpected event network-vif-plugged-85905b2e-3e09-4236-8fe7-ea6c31324ae6 for instance with vm_state active and task_state rescuing.
Oct 23 22:01:25 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:01:25 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:01:25 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:01:25 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:01:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:01:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:01:26 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/999843b2-b757-480b-bd21-bf281954bc46/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:01:26 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/999843b2-b757-480b-bd21-bf281954bc46/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:01:26 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/999843b2-b757-480b-bd21-bf281954bc46/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:01:26 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/999843b2-b757-480b-bd21-bf281954bc46/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:01:26 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6326434d-56d2-43a0-b171-f0f7bd1de5a8/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:01:27 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6326434d-56d2-43a0-b171-f0f7bd1de5a8/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:01:27 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6326434d-56d2-43a0-b171-f0f7bd1de5a8/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:01:27 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:01:27 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6326434d-56d2-43a0-b171-f0f7bd1de5a8/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:01:27 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7a67b37-36b4-42d4-a1a3-7e5d9896d948/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:01:27 user nova-compute[74337]: DEBUG nova.compute.manager [req-5102874c-ebfe-470c-b0af-7a6288d18597 req-0c5f7d66-a238-4086-991b-b74826514293 service nova] [instance: 27710919-a717-42fa-a436-a261d92c1c2a] Received event network-vif-plugged-85905b2e-3e09-4236-8fe7-ea6c31324ae6 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:01:27 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-5102874c-ebfe-470c-b0af-7a6288d18597 req-0c5f7d66-a238-4086-991b-b74826514293 service nova] Acquiring lock "27710919-a717-42fa-a436-a261d92c1c2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:01:27 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-5102874c-ebfe-470c-b0af-7a6288d18597 req-0c5f7d66-a238-4086-991b-b74826514293 service nova] Lock "27710919-a717-42fa-a436-a261d92c1c2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:01:27 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-5102874c-ebfe-470c-b0af-7a6288d18597 req-0c5f7d66-a238-4086-991b-b74826514293 service nova] Lock "27710919-a717-42fa-a436-a261d92c1c2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:01:27 user nova-compute[74337]: DEBUG nova.compute.manager [req-5102874c-ebfe-470c-b0af-7a6288d18597 req-0c5f7d66-a238-4086-991b-b74826514293 service nova] [instance: 27710919-a717-42fa-a436-a261d92c1c2a] No waiting events found dispatching network-vif-plugged-85905b2e-3e09-4236-8fe7-ea6c31324ae6 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 22:01:27 user nova-compute[74337]: WARNING nova.compute.manager [req-5102874c-ebfe-470c-b0af-7a6288d18597 req-0c5f7d66-a238-4086-991b-b74826514293 service nova] [instance: 27710919-a717-42fa-a436-a261d92c1c2a] Received unexpected event network-vif-plugged-85905b2e-3e09-4236-8fe7-ea6c31324ae6 for instance with vm_state active and task_state rescuing.
Oct 23 22:01:27 user nova-compute[74337]: DEBUG nova.compute.manager [req-5102874c-ebfe-470c-b0af-7a6288d18597 req-0c5f7d66-a238-4086-991b-b74826514293 service nova] [instance: 27710919-a717-42fa-a436-a261d92c1c2a] Received event network-vif-plugged-85905b2e-3e09-4236-8fe7-ea6c31324ae6 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:01:27 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-5102874c-ebfe-470c-b0af-7a6288d18597 req-0c5f7d66-a238-4086-991b-b74826514293 service nova] Acquiring lock "27710919-a717-42fa-a436-a261d92c1c2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:01:27 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-5102874c-ebfe-470c-b0af-7a6288d18597 req-0c5f7d66-a238-4086-991b-b74826514293 service nova] Lock "27710919-a717-42fa-a436-a261d92c1c2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:01:27 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-5102874c-ebfe-470c-b0af-7a6288d18597 req-0c5f7d66-a238-4086-991b-b74826514293 service nova] Lock "27710919-a717-42fa-a436-a261d92c1c2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:01:27 user nova-compute[74337]: DEBUG nova.compute.manager [req-5102874c-ebfe-470c-b0af-7a6288d18597 req-0c5f7d66-a238-4086-991b-b74826514293 service nova] [instance: 27710919-a717-42fa-a436-a261d92c1c2a] No waiting events found dispatching network-vif-plugged-85905b2e-3e09-4236-8fe7-ea6c31324ae6 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 22:01:27 user nova-compute[74337]: WARNING nova.compute.manager [req-5102874c-ebfe-470c-b0af-7a6288d18597 req-0c5f7d66-a238-4086-991b-b74826514293 service nova] [instance: 27710919-a717-42fa-a436-a261d92c1c2a] Received unexpected event network-vif-plugged-85905b2e-3e09-4236-8fe7-ea6c31324ae6 for instance with vm_state active and task_state rescuing.
Oct 23 22:01:27 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7a67b37-36b4-42d4-a1a3-7e5d9896d948/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:01:27 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7a67b37-36b4-42d4-a1a3-7e5d9896d948/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:01:27 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7a67b37-36b4-42d4-a1a3-7e5d9896d948/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:01:27 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbad2e14-7b6c-475e-b471-a87cb9e21b7f/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:01:27 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbad2e14-7b6c-475e-b471-a87cb9e21b7f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:01:27 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbad2e14-7b6c-475e-b471-a87cb9e21b7f/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:01:28 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbad2e14-7b6c-475e-b471-a87cb9e21b7f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:01:28 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk.rescue --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:01:28 user nova-compute[74337]: DEBUG nova.compute.manager [None req-307660c3-d242-4218-be2f-c5bfbd746c30 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 27710919-a717-42fa-a436-a261d92c1c2a] Checking state {{(pid=74337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 22:01:28 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk.rescue --force-share --output=json" returned: 0 in 0.221s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:01:28 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk.rescue --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:01:28 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:01:28 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:01:28 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:01:28 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:01:28 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:01:28 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:01:29 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:01:29 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:01:29 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:01:29 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:01:29 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b42311a5-4334-42ba-9375-e27bc946d490/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:01:29 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b42311a5-4334-42ba-9375-e27bc946d490/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:01:29 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b42311a5-4334-42ba-9375-e27bc946d490/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:01:29 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b42311a5-4334-42ba-9375-e27bc946d490/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:01:30 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:01:30 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:01:30 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Hypervisor/Node resource view: name=user free_ram=7826MB free_disk=25.11548614501953GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 22:01:30 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:01:30 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:01:30 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 0323b854-c7a1-42e8-ad85-1e929caa6e9d has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Oct 23 22:01:30 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 999843b2-b757-480b-bd21-bf281954bc46 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 22:01:30 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 27710919-a717-42fa-a436-a261d92c1c2a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 22:01:30 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 22:01:30 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 6326434d-56d2-43a0-b171-f0f7bd1de5a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 22:01:30 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance dbad2e14-7b6c-475e-b471-a87cb9e21b7f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 22:01:30 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance b7a67b37-36b4-42d4-a1a3-7e5d9896d948 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 22:01:30 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance b42311a5-4334-42ba-9375-e27bc946d490 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 22:01:30 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 22:01:30 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 22:01:30 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 22:01:30 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 22:01:30 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Compute_service record updated for user:user {{(pid=74337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 22:01:30 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.618s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:01:32 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:01:34 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:01:37 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:01:37 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-f73df63d-f5b8-4ba4-9768-94f93c610125 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Acquiring lock "9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:01:37 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-f73df63d-f5b8-4ba4-9768-94f93c610125 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Lock "9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:01:37 user nova-compute[74337]: DEBUG nova.objects.instance [None req-f73df63d-f5b8-4ba4-9768-94f93c610125 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Lazy-loading 'flavor' on Instance uuid 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:01:37 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-f73df63d-f5b8-4ba4-9768-94f93c610125 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Lock "9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.121s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:01:37 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-f73df63d-f5b8-4ba4-9768-94f93c610125 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Acquiring lock "9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:01:37 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-f73df63d-f5b8-4ba4-9768-94f93c610125 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Lock "9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:01:37 user nova-compute[74337]: INFO nova.compute.manager [None req-f73df63d-f5b8-4ba4-9768-94f93c610125 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] Attaching volume f5916c61-f2d0-4a31-9a25-8257b511640c to /dev/vdb
Oct 23 22:01:38 user nova-compute[74337]: DEBUG os_brick.utils [None req-f73df63d-f5b8-4ba4-9768-94f93c610125 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 22:01:38 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:01:38 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:01:38 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c576b9-a966-44e9-b418-14d2e506cfa0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f34011b66e40\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:01:38 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:01:38 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.033s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:01:38 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[767c0e0c-d30a-40bd-bd16-62f70a704309]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:01:38 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:01:38 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:01:38 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d144d2-fa24-4939-9d1e-e6544684c1f4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:01:38 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de3b9c2-aa74-4e9b-bd4b-f044892677c0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:01:38 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-f73df63d-f5b8-4ba4-9768-94f93c610125 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Running cmd (subprocess): nvme version {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:01:38 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-f73df63d-f5b8-4ba4-9768-94f93c610125 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] 'nvme version' failed. Not Retrying. {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 22:01:38 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f73df63d-f5b8-4ba4-9768-94f93c610125 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] nvme not present on system {{(pid=74337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 22:01:38 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:01:38 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 22:01:38 user nova-compute[74337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 22:01:38 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c28c053-c547-4d96-b544-f1dde2c23db5]: (4, '') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:01:38 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-f73df63d-f5b8-4ba4-9768-94f93c610125 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 22:01:38 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-f73df63d-f5b8-4ba4-9768-94f93c610125 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 22:01:38 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-f73df63d-f5b8-4ba4-9768-94f93c610125 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] LIGHTOS: no hostnqn found. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 22:01:38 user nova-compute[74337]: DEBUG os_brick.utils [None req-f73df63d-f5b8-4ba4-9768-94f93c610125 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] <== get_connector_properties: return (174ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f34011b66e40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 22:01:38 user nova-compute[74337]: DEBUG nova.virt.block_device [None req-f73df63d-f5b8-4ba4-9768-94f93c610125 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] Updating existing volume attachment record: 75436cbb-5dd0-4d52-bda4-e1cd63b0d359 {{(pid=74337) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 22:01:38 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:01:42 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:01:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:01:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:01:49 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:01:52 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:01:54 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:01:55 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f73df63d-f5b8-4ba4-9768-94f93c610125 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] Calling os-brick to attach iSCSI Volume {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 22:01:55 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f73df63d-f5b8-4ba4-9768-94f93c610125 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f5916c61-f2d0-4a31-9a25-8257b511640c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QovGuwyM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 22:01:55 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-f73df63d-f5b8-4ba4-9768-94f93c610125 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 22:01:55 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-f73df63d-f5b8-4ba4-9768-94f93c610125 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 22:01:55 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-f73df63d-f5b8-4ba4-9768-94f93c610125 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 22:01:55 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-f73df63d-f5b8-4ba4-9768-94f93c610125 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 22:01:55 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-f73df63d-f5b8-4ba4-9768-94f93c610125 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f5916c61-f2d0-4a31-9a25-8257b511640c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 22:01:55 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-f73df63d-f5b8-4ba4-9768-94f93c610125 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f5916c61-f2d0-4a31-9a25-8257b511640c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 22:01:55 user nova-compute[74337]: INFO os_brick.initiator.connectors.iscsi [None req-f73df63d-f5b8-4ba4-9768-94f93c610125 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 22:01:55 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5916c61-f2d0-4a31-9a25-8257b511640c -p 172.16.0.220:3260 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:01:55 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5916c61-f2d0-4a31-9a25-8257b511640c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:01:55 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[19738e75-91d2-4826-b1fe-5976285832bf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:01:55 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f73df63d-f5b8-4ba4-9768-94f93c610125 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 22:01:55 user nova-compute[74337]:  {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:01:55 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5916c61-f2d0-4a31-9a25-8257b511640c -p 172.16.0.220:3260 --interface default --op new {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:01:55 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5916c61-f2d0-4a31-9a25-8257b511640c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:01:55 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[3382c35c-1394-4706-9997-be81ce558b7f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f5916c61-f2d0-4a31-9a25-8257b511640c] added\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:01:55 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f73df63d-f5b8-4ba4-9768-94f93c610125 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f5916c61-f2d0-4a31-9a25-8257b511640c] added
Oct 23 22:01:55 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:01:55 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5916c61-f2d0-4a31-9a25-8257b511640c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:01:55 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5916c61-f2d0-4a31-9a25-8257b511640c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:01:55 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd123b15-b794-4452-bad3-f22591948144]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:01:55 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f73df63d-f5b8-4ba4-9768-94f93c610125 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:01:55 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5916c61-f2d0-4a31-9a25-8257b511640c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:01:55 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5916c61-f2d0-4a31-9a25-8257b511640c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:01:55 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc8bba3f-6d7f-4bfe-8176-c38619131242]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:01:55 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f73df63d-f5b8-4ba4-9768-94f93c610125 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:01:55 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5916c61-f2d0-4a31-9a25-8257b511640c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QovGuwyM {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:01:55 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5916c61-f2d0-4a31-9a25-8257b511640c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QovGuwyM" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:01:55 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd168c2c-42b8-4f65-bd95-31d74edd9914]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:01:55 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f73df63d-f5b8-4ba4-9768-94f93c610125 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QovGuwyM'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:01:55 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5916c61-f2d0-4a31-9a25-8257b511640c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:01:55 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5916c61-f2d0-4a31-9a25-8257b511640c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:01:55 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a25264-0bbf-4456-908e-d37594341cd8]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:01:55 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f73df63d-f5b8-4ba4-9768-94f93c610125 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:01:55 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:01:55 user nova-compute[74337]: DEBUG nova.compute.manager [req-ab4af90e-0a0a-42ea-ad91-c2ae7acb4d14 req-68a75ed5-47f1-42f3-ab9f-77a021e76955 service nova] [instance: 6326434d-56d2-43a0-b171-f0f7bd1de5a8] Received event network-changed-2c0d1355-d2c2-4504-82a1-705e29a2d065 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:01:55 user nova-compute[74337]: DEBUG nova.compute.manager [req-ab4af90e-0a0a-42ea-ad91-c2ae7acb4d14 req-68a75ed5-47f1-42f3-ab9f-77a021e76955 service nova] [instance: 6326434d-56d2-43a0-b171-f0f7bd1de5a8] Refreshing instance network info cache due to event network-changed-2c0d1355-d2c2-4504-82a1-705e29a2d065. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 22:01:55 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ab4af90e-0a0a-42ea-ad91-c2ae7acb4d14 req-68a75ed5-47f1-42f3-ab9f-77a021e76955 service nova] Acquiring lock "refresh_cache-6326434d-56d2-43a0-b171-f0f7bd1de5a8" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 22:01:55 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ab4af90e-0a0a-42ea-ad91-c2ae7acb4d14 req-68a75ed5-47f1-42f3-ab9f-77a021e76955 service nova] Acquired lock "refresh_cache-6326434d-56d2-43a0-b171-f0f7bd1de5a8" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 22:01:55 user nova-compute[74337]: DEBUG nova.network.neutron [req-ab4af90e-0a0a-42ea-ad91-c2ae7acb4d14 req-68a75ed5-47f1-42f3-ab9f-77a021e76955 service nova] [instance: 6326434d-56d2-43a0-b171-f0f7bd1de5a8] Refreshing network info cache for port 2c0d1355-d2c2-4504-82a1-705e29a2d065 {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 22:01:55 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:01:55 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f4a983-d56a-494f-bd36-8a4ad25936e8]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:01:55 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f73df63d-f5b8-4ba4-9768-94f93c610125 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 23 22:01:55 user nova-compute[74337]:  {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 22:01:55 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f73df63d-f5b8-4ba4-9768-94f93c610125 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 23 22:01:55 user nova-compute[74337]:  {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 22:01:55 user nova-compute[74337]: WARNING os_brick.initiator.connectors.iscsi [None req-f73df63d-f5b8-4ba4-9768-94f93c610125 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 23 22:01:55 user nova-compute[74337]: 
Oct 23 22:01:55 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5916c61-f2d0-4a31-9a25-8257b511640c -p 172.16.0.220:3260 --login {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:01:55 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5916c61-f2d0-4a31-9a25-8257b511640c -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:01:55 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa8b3516-2281-4d9f-af6a-07139cc2f24f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f5916c61-f2d0-4a31-9a25-8257b511640c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f5916c61-f2d0-4a31-9a25-8257b511640c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:01:55 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f73df63d-f5b8-4ba4-9768-94f93c610125 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f5916c61-f2d0-4a31-9a25-8257b511640c, portal: 172.16.0.220,3260]
Oct 23 22:01:55 user nova-compute[74337]: Login to [iface: default, target: iqn.2010-10.org.openstack:f5916c61-f2d0-4a31-9a25-8257b511640c, portal: 172.16.0.220,3260] successful.
Oct 23 22:01:55 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:01:55 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5916c61-f2d0-4a31-9a25-8257b511640c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:01:55 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5916c61-f2d0-4a31-9a25-8257b511640c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:01:55 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e10cc97-7910-48df-8b4f-4090d48148fb]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:01:55 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f73df63d-f5b8-4ba4-9768-94f93c610125 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:01:55 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:01:55 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:01:55 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6db9b0c-62c4-4ed2-9fa0-efaae591e463]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5916c61-f2d0-4a31-9a25-8257b511640c (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:01:55 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f73df63d-f5b8-4ba4-9768-94f93c610125 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5916c61-f2d0-4a31-9a25-8257b511640c (non-flash)
Oct 23 22:01:55 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 22:01:55 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f73df63d-f5b8-4ba4-9768-94f93c610125 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5916c61-f2d0-4a31-9a25-8257b511640c (non-flash)
Oct 23 22:01:55 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 22:01:55 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-f73df63d-f5b8-4ba4-9768-94f93c610125 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f5916c61-f2d0-4a31-9a25-8257b511640c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.252s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 22:01:55 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f73df63d-f5b8-4ba4-9768-94f93c610125 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Connected to 172.16.0.220:3260 {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 22:01:55 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-f73df63d-f5b8-4ba4-9768-94f93c610125 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] HCTL ('33', '-', '-', 0) found on session 44 with lun 0 {{(pid=74337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 22:01:55 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-f73df63d-f5b8-4ba4-9768-94f93c610125 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 22:01:55 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:01:55 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:01:55 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e01a2cc-7402-4083-bf8f-999a73c8ba87]: (4, ('- - 0', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:01:55 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-f73df63d-f5b8-4ba4-9768-94f93c610125 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: None {{(pid=74337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 22:01:55 user nova-compute[74337]: DEBUG nova.network.neutron [req-ab4af90e-0a0a-42ea-ad91-c2ae7acb4d14 req-68a75ed5-47f1-42f3-ab9f-77a021e76955 service nova] [instance: 6326434d-56d2-43a0-b171-f0f7bd1de5a8] Updated VIF entry in instance network info cache for port 2c0d1355-d2c2-4504-82a1-705e29a2d065. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 22:01:55 user nova-compute[74337]: DEBUG nova.network.neutron [req-ab4af90e-0a0a-42ea-ad91-c2ae7acb4d14 req-68a75ed5-47f1-42f3-ab9f-77a021e76955 service nova] [instance: 6326434d-56d2-43a0-b171-f0f7bd1de5a8] Updating instance_info_cache with network_info: [{"id": "2c0d1355-d2c2-4504-82a1-705e29a2d065", "address": "fa:16:3e:06:70:87", "network": {"id": "144e037b-415c-4af4-a16c-081ac621f89b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1182284183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f838429412604ad4a6dea808cf3c92b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c0d1355-d2", "ovs_interfaceid": "2c0d1355-d2c2-4504-82a1-705e29a2d065", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 22:01:55 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ab4af90e-0a0a-42ea-ad91-c2ae7acb4d14 req-68a75ed5-47f1-42f3-ab9f-77a021e76955 service nova] Releasing lock "refresh_cache-6326434d-56d2-43a0-b171-f0f7bd1de5a8" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 22:01:55 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-bc5dd975-546e-4b9c-9e7c-eb1bbf78cb2d tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Acquiring lock "6326434d-56d2-43a0-b171-f0f7bd1de5a8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:01:55 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-bc5dd975-546e-4b9c-9e7c-eb1bbf78cb2d tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Lock "6326434d-56d2-43a0-b171-f0f7bd1de5a8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:01:55 user nova-compute[74337]: DEBUG nova.objects.instance [None req-bc5dd975-546e-4b9c-9e7c-eb1bbf78cb2d tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Lazy-loading 'flavor' on Instance uuid 6326434d-56d2-43a0-b171-f0f7bd1de5a8 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:01:55 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-bc5dd975-546e-4b9c-9e7c-eb1bbf78cb2d tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Lock "6326434d-56d2-43a0-b171-f0f7bd1de5a8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:01:56 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-bc5dd975-546e-4b9c-9e7c-eb1bbf78cb2d tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Acquiring lock "6326434d-56d2-43a0-b171-f0f7bd1de5a8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:01:56 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-bc5dd975-546e-4b9c-9e7c-eb1bbf78cb2d tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Lock "6326434d-56d2-43a0-b171-f0f7bd1de5a8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:01:56 user nova-compute[74337]: INFO nova.compute.manager [None req-bc5dd975-546e-4b9c-9e7c-eb1bbf78cb2d tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] [instance: 6326434d-56d2-43a0-b171-f0f7bd1de5a8] Attaching volume bfde0014-67b1-482f-9e27-dfb3d9c28026 to /dev/vdb
Oct 23 22:01:56 user nova-compute[74337]: DEBUG os_brick.utils [None req-bc5dd975-546e-4b9c-9e7c-eb1bbf78cb2d tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 22:01:56 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:01:56 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:01:56 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8de9442-9e6b-4b64-b20e-93d7e16d8050]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f34011b66e40\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:01:56 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:01:56 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:01:56 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[f93e19e5-28c3-482d-908d-4594d008a180]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:01:56 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:01:56 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:01:56 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[03e133cd-eb8f-4e4a-8bfc-45b0e1818441]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:01:56 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0578411-97df-42e1-82fe-64eb8d58d579]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:01:56 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-bc5dd975-546e-4b9c-9e7c-eb1bbf78cb2d tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Running cmd (subprocess): nvme version {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:01:56 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-bc5dd975-546e-4b9c-9e7c-eb1bbf78cb2d tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] 'nvme version' failed. Not Retrying. {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 22:01:56 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bc5dd975-546e-4b9c-9e7c-eb1bbf78cb2d tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] nvme not present on system {{(pid=74337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 22:01:56 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:01:56 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 22:01:56 user nova-compute[74337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 22:01:56 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[77c8712f-87b8-4202-938b-ac232b4bd320]: (4, '') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:01:56 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-bc5dd975-546e-4b9c-9e7c-eb1bbf78cb2d tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 22:01:56 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-bc5dd975-546e-4b9c-9e7c-eb1bbf78cb2d tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 22:01:56 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-bc5dd975-546e-4b9c-9e7c-eb1bbf78cb2d tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] LIGHTOS: no hostnqn found. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 22:01:56 user nova-compute[74337]: DEBUG os_brick.utils [None req-bc5dd975-546e-4b9c-9e7c-eb1bbf78cb2d tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f34011b66e40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 22:01:56 user nova-compute[74337]: DEBUG nova.virt.block_device [None req-bc5dd975-546e-4b9c-9e7c-eb1bbf78cb2d tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] [instance: 6326434d-56d2-43a0-b171-f0f7bd1de5a8] Updating existing volume attachment record: 89910971-bd95-472f-a87e-6c8335c9c967 {{(pid=74337) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 22:01:56 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-f73df63d-f5b8-4ba4-9768-94f93c610125 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 22:01:56 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f73df63d-f5b8-4ba4-9768-94f93c610125 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f5916c61-f2d0-4a31-9a25-8257b511640c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QovGuwyM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 22:01:56 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-f73df63d-f5b8-4ba4-9768-94f93c610125 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.286s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 22:01:56 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f73df63d-f5b8-4ba4-9768-94f93c610125 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] <== connect_volume: return (1288ms) {'type': 'block', 'scsi_wwn': '23661623133393465', 'path': '/dev/sdb'} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 22:01:56 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f73df63d-f5b8-4ba4-9768-94f93c610125 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23661623133393465', 'path': '/dev/sdb'} {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 22:01:56 user nova-compute[74337]: DEBUG nova.objects.instance [None req-f73df63d-f5b8-4ba4-9768-94f93c610125 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Lazy-loading 'flavor' on Instance uuid 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:01:56 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-f73df63d-f5b8-4ba4-9768-94f93c610125 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 22:01:56 user nova-compute[74337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 22:01:56 user nova-compute[74337]:   <source dev="/dev/sdb"/>
Oct 23 22:01:56 user nova-compute[74337]:   <target dev="vdb" bus="virtio"/>
Oct 23 22:01:56 user nova-compute[74337]:   <serial>f5916c61-f2d0-4a31-9a25-8257b511640c</serial>
Oct 23 22:01:56 user nova-compute[74337]: </disk>
Oct 23 22:01:56 user nova-compute[74337]:  {{(pid=74337) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 22:01:56 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-f73df63d-f5b8-4ba4-9768-94f93c610125 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] No BDM found with device name vda, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 22:01:56 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-f73df63d-f5b8-4ba4-9768-94f93c610125 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 22:01:56 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-f73df63d-f5b8-4ba4-9768-94f93c610125 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] No VIF found with MAC fa:16:3e:df:42:15, not building metadata {{(pid=74337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 22:01:57 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-f73df63d-f5b8-4ba4-9768-94f93c610125 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Lock "9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.152s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:01:57 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:01:59 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:01:59 user nova-compute[74337]: DEBUG nova.compute.manager [req-483d9aa2-a84b-4126-b060-7527a442f833 req-340fccba-ec9c-4005-87f4-f019f4e42c72 service nova] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] Received event network-changed-28c36a5b-ff7d-4426-9b09-6114a8c43fe5 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:01:59 user nova-compute[74337]: DEBUG nova.compute.manager [req-483d9aa2-a84b-4126-b060-7527a442f833 req-340fccba-ec9c-4005-87f4-f019f4e42c72 service nova] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] Refreshing instance network info cache due to event network-changed-28c36a5b-ff7d-4426-9b09-6114a8c43fe5. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 22:01:59 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-483d9aa2-a84b-4126-b060-7527a442f833 req-340fccba-ec9c-4005-87f4-f019f4e42c72 service nova] Acquiring lock "refresh_cache-9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 22:01:59 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-483d9aa2-a84b-4126-b060-7527a442f833 req-340fccba-ec9c-4005-87f4-f019f4e42c72 service nova] Acquired lock "refresh_cache-9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 22:01:59 user nova-compute[74337]: DEBUG nova.network.neutron [req-483d9aa2-a84b-4126-b060-7527a442f833 req-340fccba-ec9c-4005-87f4-f019f4e42c72 service nova] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] Refreshing network info cache for port 28c36a5b-ff7d-4426-9b09-6114a8c43fe5 {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 22:01:59 user nova-compute[74337]: DEBUG nova.network.neutron [req-483d9aa2-a84b-4126-b060-7527a442f833 req-340fccba-ec9c-4005-87f4-f019f4e42c72 service nova] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] Updated VIF entry in instance network info cache for port 28c36a5b-ff7d-4426-9b09-6114a8c43fe5. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 22:01:59 user nova-compute[74337]: DEBUG nova.network.neutron [req-483d9aa2-a84b-4126-b060-7527a442f833 req-340fccba-ec9c-4005-87f4-f019f4e42c72 service nova] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] Updating instance_info_cache with network_info: [{"id": "28c36a5b-ff7d-4426-9b09-6114a8c43fe5", "address": "fa:16:3e:df:42:15", "network": {"id": "0b1d82b0-acba-470e-aede-1c57a85a8ed3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1250228933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "965415a9973d4714aa49a64d34b232a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28c36a5b-ff", "ovs_interfaceid": "28c36a5b-ff7d-4426-9b09-6114a8c43fe5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 22:01:59 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-483d9aa2-a84b-4126-b060-7527a442f833 req-340fccba-ec9c-4005-87f4-f019f4e42c72 service nova] Releasing lock "refresh_cache-9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 22:02:01 user nova-compute[74337]: DEBUG nova.compute.manager [req-6e2e9959-23a7-4f01-a155-1f7ffc0ce8c9 req-c84016fc-a5a6-4ed1-bcdc-a662bdadb344 service nova] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] Received event network-changed-28c36a5b-ff7d-4426-9b09-6114a8c43fe5 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:02:01 user nova-compute[74337]: DEBUG nova.compute.manager [req-6e2e9959-23a7-4f01-a155-1f7ffc0ce8c9 req-c84016fc-a5a6-4ed1-bcdc-a662bdadb344 service nova] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] Refreshing instance network info cache due to event network-changed-28c36a5b-ff7d-4426-9b09-6114a8c43fe5. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 22:02:01 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-6e2e9959-23a7-4f01-a155-1f7ffc0ce8c9 req-c84016fc-a5a6-4ed1-bcdc-a662bdadb344 service nova] Acquiring lock "refresh_cache-9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 22:02:01 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-6e2e9959-23a7-4f01-a155-1f7ffc0ce8c9 req-c84016fc-a5a6-4ed1-bcdc-a662bdadb344 service nova] Acquired lock "refresh_cache-9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 22:02:01 user nova-compute[74337]: DEBUG nova.network.neutron [req-6e2e9959-23a7-4f01-a155-1f7ffc0ce8c9 req-c84016fc-a5a6-4ed1-bcdc-a662bdadb344 service nova] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] Refreshing network info cache for port 28c36a5b-ff7d-4426-9b09-6114a8c43fe5 {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 22:02:02 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-f59c5b08-50b3-4af7-be7d-9c2d15bc1038 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Acquiring lock "9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:02:02 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-f59c5b08-50b3-4af7-be7d-9c2d15bc1038 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Lock "9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:02:02 user nova-compute[74337]: INFO nova.compute.manager [None req-f59c5b08-50b3-4af7-be7d-9c2d15bc1038 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] Rebooting instance
Oct 23 22:02:02 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-f59c5b08-50b3-4af7-be7d-9c2d15bc1038 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Acquiring lock "refresh_cache-9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 22:02:02 user nova-compute[74337]: DEBUG nova.network.neutron [req-6e2e9959-23a7-4f01-a155-1f7ffc0ce8c9 req-c84016fc-a5a6-4ed1-bcdc-a662bdadb344 service nova] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] Updated VIF entry in instance network info cache for port 28c36a5b-ff7d-4426-9b09-6114a8c43fe5. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 22:02:02 user nova-compute[74337]: DEBUG nova.network.neutron [req-6e2e9959-23a7-4f01-a155-1f7ffc0ce8c9 req-c84016fc-a5a6-4ed1-bcdc-a662bdadb344 service nova] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] Updating instance_info_cache with network_info: [{"id": "28c36a5b-ff7d-4426-9b09-6114a8c43fe5", "address": "fa:16:3e:df:42:15", "network": {"id": "0b1d82b0-acba-470e-aede-1c57a85a8ed3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1250228933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "965415a9973d4714aa49a64d34b232a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28c36a5b-ff", "ovs_interfaceid": "28c36a5b-ff7d-4426-9b09-6114a8c43fe5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 22:02:02 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:02:02 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-6e2e9959-23a7-4f01-a155-1f7ffc0ce8c9 req-c84016fc-a5a6-4ed1-bcdc-a662bdadb344 service nova] Releasing lock "refresh_cache-9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 22:02:02 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-f59c5b08-50b3-4af7-be7d-9c2d15bc1038 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Acquired lock "refresh_cache-9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 22:02:02 user nova-compute[74337]: DEBUG nova.network.neutron [None req-f59c5b08-50b3-4af7-be7d-9c2d15bc1038 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] Building network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 22:02:02 user nova-compute[74337]: DEBUG nova.network.neutron [None req-f59c5b08-50b3-4af7-be7d-9c2d15bc1038 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] Updating instance_info_cache with network_info: [{"id": "28c36a5b-ff7d-4426-9b09-6114a8c43fe5", "address": "fa:16:3e:df:42:15", "network": {"id": "0b1d82b0-acba-470e-aede-1c57a85a8ed3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1250228933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "965415a9973d4714aa49a64d34b232a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28c36a5b-ff", "ovs_interfaceid": "28c36a5b-ff7d-4426-9b09-6114a8c43fe5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 22:02:02 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-f59c5b08-50b3-4af7-be7d-9c2d15bc1038 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Releasing lock "refresh_cache-9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 22:02:02 user nova-compute[74337]: DEBUG nova.compute.manager [None req-f59c5b08-50b3-4af7-be7d-9c2d15bc1038 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] Checking state {{(pid=74337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 22:02:04 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:02:05 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:02:05 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:02:05 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:02:05 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:02:05 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:02:05 user nova-compute[74337]: DEBUG nova.compute.manager [req-02b2107a-53e5-44a9-9783-db6e04a3c665 req-4f3de900-ec8d-4d27-8ce6-7a2ce3af17d2 service nova] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] Received event network-vif-unplugged-28c36a5b-ff7d-4426-9b09-6114a8c43fe5 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:02:05 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-02b2107a-53e5-44a9-9783-db6e04a3c665 req-4f3de900-ec8d-4d27-8ce6-7a2ce3af17d2 service nova] Acquiring lock "9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:02:05 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-02b2107a-53e5-44a9-9783-db6e04a3c665 req-4f3de900-ec8d-4d27-8ce6-7a2ce3af17d2 service nova] Lock "9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:02:05 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-02b2107a-53e5-44a9-9783-db6e04a3c665 req-4f3de900-ec8d-4d27-8ce6-7a2ce3af17d2 service nova] Lock "9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:02:05 user nova-compute[74337]: DEBUG nova.compute.manager [req-02b2107a-53e5-44a9-9783-db6e04a3c665 req-4f3de900-ec8d-4d27-8ce6-7a2ce3af17d2 service nova] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] No waiting events found dispatching network-vif-unplugged-28c36a5b-ff7d-4426-9b09-6114a8c43fe5 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 22:02:05 user nova-compute[74337]: WARNING nova.compute.manager [req-02b2107a-53e5-44a9-9783-db6e04a3c665 req-4f3de900-ec8d-4d27-8ce6-7a2ce3af17d2 service nova] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] Received unexpected event network-vif-unplugged-28c36a5b-ff7d-4426-9b09-6114a8c43fe5 for instance with vm_state active and task_state reboot_started.
Oct 23 22:02:05 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:02:06 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-f59c5b08-50b3-4af7-be7d-9c2d15bc1038 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] Instance shutdown successfully.
Oct 23 22:02:07 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:02:07 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:02:07 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:02:07 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:02:07 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:02:07 user nova-compute[74337]: DEBUG nova.compute.manager [req-d5cb6030-7d96-4fb9-9b15-a75451addd45 req-41ed22b2-0982-4af3-abf5-0be2628d9d5e service nova] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] Received event network-vif-plugged-28c36a5b-ff7d-4426-9b09-6114a8c43fe5 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:02:07 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-d5cb6030-7d96-4fb9-9b15-a75451addd45 req-41ed22b2-0982-4af3-abf5-0be2628d9d5e service nova] Acquiring lock "9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:02:07 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-d5cb6030-7d96-4fb9-9b15-a75451addd45 req-41ed22b2-0982-4af3-abf5-0be2628d9d5e service nova] Lock "9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:02:07 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-d5cb6030-7d96-4fb9-9b15-a75451addd45 req-41ed22b2-0982-4af3-abf5-0be2628d9d5e service nova] Lock "9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:02:07 user nova-compute[74337]: DEBUG nova.compute.manager [req-d5cb6030-7d96-4fb9-9b15-a75451addd45 req-41ed22b2-0982-4af3-abf5-0be2628d9d5e service nova] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] No waiting events found dispatching network-vif-plugged-28c36a5b-ff7d-4426-9b09-6114a8c43fe5 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 22:02:07 user nova-compute[74337]: WARNING nova.compute.manager [req-d5cb6030-7d96-4fb9-9b15-a75451addd45 req-41ed22b2-0982-4af3-abf5-0be2628d9d5e service nova] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] Received unexpected event network-vif-plugged-28c36a5b-ff7d-4426-9b09-6114a8c43fe5 for instance with vm_state active and task_state reboot_started.
Oct 23 22:02:07 user nova-compute[74337]: DEBUG nova.compute.manager [req-d5cb6030-7d96-4fb9-9b15-a75451addd45 req-41ed22b2-0982-4af3-abf5-0be2628d9d5e service nova] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] Received event network-vif-plugged-28c36a5b-ff7d-4426-9b09-6114a8c43fe5 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:02:07 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-d5cb6030-7d96-4fb9-9b15-a75451addd45 req-41ed22b2-0982-4af3-abf5-0be2628d9d5e service nova] Acquiring lock "9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:02:07 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-d5cb6030-7d96-4fb9-9b15-a75451addd45 req-41ed22b2-0982-4af3-abf5-0be2628d9d5e service nova] Lock "9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:02:07 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-d5cb6030-7d96-4fb9-9b15-a75451addd45 req-41ed22b2-0982-4af3-abf5-0be2628d9d5e service nova] Lock "9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:02:07 user nova-compute[74337]: DEBUG nova.compute.manager [req-d5cb6030-7d96-4fb9-9b15-a75451addd45 req-41ed22b2-0982-4af3-abf5-0be2628d9d5e service nova] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] No waiting events found dispatching network-vif-plugged-28c36a5b-ff7d-4426-9b09-6114a8c43fe5 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 22:02:07 user nova-compute[74337]: WARNING nova.compute.manager [req-d5cb6030-7d96-4fb9-9b15-a75451addd45 req-41ed22b2-0982-4af3-abf5-0be2628d9d5e service nova] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] Received unexpected event network-vif-plugged-28c36a5b-ff7d-4426-9b09-6114a8c43fe5 for instance with vm_state active and task_state reboot_started.
Oct 23 22:02:07 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:02:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:02:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:02:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:02:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:02:09 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] Instance running successfully.
Oct 23 22:02:09 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-f59c5b08-50b3-4af7-be7d-9c2d15bc1038 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] Instance soft rebooted successfully.
Oct 23 22:02:09 user nova-compute[74337]: DEBUG nova.compute.manager [None req-f59c5b08-50b3-4af7-be7d-9c2d15bc1038 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] Checking state {{(pid=74337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 22:02:09 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-f59c5b08-50b3-4af7-be7d-9c2d15bc1038 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Lock "9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.547s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:02:09 user nova-compute[74337]: DEBUG nova.compute.manager [req-355cbfe4-929d-4865-8af7-da6881f47b27 req-43b1a883-1a30-4bd6-a215-52323d628e67 service nova] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] Received event network-vif-plugged-28c36a5b-ff7d-4426-9b09-6114a8c43fe5 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:02:09 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-355cbfe4-929d-4865-8af7-da6881f47b27 req-43b1a883-1a30-4bd6-a215-52323d628e67 service nova] Acquiring lock "9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:02:09 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-355cbfe4-929d-4865-8af7-da6881f47b27 req-43b1a883-1a30-4bd6-a215-52323d628e67 service nova] Lock "9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:02:09 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-355cbfe4-929d-4865-8af7-da6881f47b27 req-43b1a883-1a30-4bd6-a215-52323d628e67 service nova] Lock "9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:02:09 user nova-compute[74337]: DEBUG nova.compute.manager [req-355cbfe4-929d-4865-8af7-da6881f47b27 req-43b1a883-1a30-4bd6-a215-52323d628e67 service nova] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] No waiting events found dispatching network-vif-plugged-28c36a5b-ff7d-4426-9b09-6114a8c43fe5 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 22:02:09 user nova-compute[74337]: WARNING nova.compute.manager [req-355cbfe4-929d-4865-8af7-da6881f47b27 req-43b1a883-1a30-4bd6-a215-52323d628e67 service nova] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] Received unexpected event network-vif-plugged-28c36a5b-ff7d-4426-9b09-6114a8c43fe5 for instance with vm_state active and task_state None.
Oct 23 22:02:12 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:02:14 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:02:14 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc5dd975-546e-4b9c-9e7c-eb1bbf78cb2d tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] [instance: 6326434d-56d2-43a0-b171-f0f7bd1de5a8] Calling os-brick to attach iSCSI Volume {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 22:02:14 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5dd975-546e-4b9c-9e7c-eb1bbf78cb2d tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bfde0014-67b1-482f-9e27-dfb3d9c28026', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NZkIgzot', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 22:02:14 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-bc5dd975-546e-4b9c-9e7c-eb1bbf78cb2d tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 22:02:14 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-bc5dd975-546e-4b9c-9e7c-eb1bbf78cb2d tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 22:02:14 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-bc5dd975-546e-4b9c-9e7c-eb1bbf78cb2d tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 22:02:14 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-bc5dd975-546e-4b9c-9e7c-eb1bbf78cb2d tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 22:02:14 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-bc5dd975-546e-4b9c-9e7c-eb1bbf78cb2d tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bfde0014-67b1-482f-9e27-dfb3d9c28026" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 22:02:14 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-bc5dd975-546e-4b9c-9e7c-eb1bbf78cb2d tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bfde0014-67b1-482f-9e27-dfb3d9c28026" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 22:02:14 user nova-compute[74337]: INFO os_brick.initiator.connectors.iscsi [None req-bc5dd975-546e-4b9c-9e7c-eb1bbf78cb2d tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 22:02:14 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfde0014-67b1-482f-9e27-dfb3d9c28026 -p 172.16.0.220:3260 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:02:14 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfde0014-67b1-482f-9e27-dfb3d9c28026 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:02:14 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ea91da2-fc60-4a30-a74a-b1d5d5581873]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:02:14 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5dd975-546e-4b9c-9e7c-eb1bbf78cb2d tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 22:02:14 user nova-compute[74337]:  {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:02:14 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfde0014-67b1-482f-9e27-dfb3d9c28026 -p 172.16.0.220:3260 --interface default --op new {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:02:14 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfde0014-67b1-482f-9e27-dfb3d9c28026 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.030s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:02:14 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[56daa46f-45de-4c58-b279-1dc54ea134f3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bfde0014-67b1-482f-9e27-dfb3d9c28026] added\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:02:14 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5dd975-546e-4b9c-9e7c-eb1bbf78cb2d tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bfde0014-67b1-482f-9e27-dfb3d9c28026] added
Oct 23 22:02:14 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:02:14 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfde0014-67b1-482f-9e27-dfb3d9c28026 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:02:14 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfde0014-67b1-482f-9e27-dfb3d9c28026 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:02:14 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecbb9466-4263-470b-baa6-45a549ca403d]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:02:14 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5dd975-546e-4b9c-9e7c-eb1bbf78cb2d tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:02:14 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfde0014-67b1-482f-9e27-dfb3d9c28026 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:02:14 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfde0014-67b1-482f-9e27-dfb3d9c28026 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:02:14 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d199d870-b318-422d-8772-4077edbbdf2d]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:02:14 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5dd975-546e-4b9c-9e7c-eb1bbf78cb2d tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:02:14 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfde0014-67b1-482f-9e27-dfb3d9c28026 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NZkIgzot {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:02:14 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfde0014-67b1-482f-9e27-dfb3d9c28026 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NZkIgzot" returned: 0 in 0.020s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:02:14 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[394d6030-e97b-4053-ba5e-bc1188ac506a]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:02:14 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5dd975-546e-4b9c-9e7c-eb1bbf78cb2d tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NZkIgzot'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:02:14 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfde0014-67b1-482f-9e27-dfb3d9c28026 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:02:14 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfde0014-67b1-482f-9e27-dfb3d9c28026 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:02:14 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8a443e5-afdc-49de-aab3-72ece96ad4f4]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:02:14 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5dd975-546e-4b9c-9e7c-eb1bbf78cb2d tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:02:14 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:02:14 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:02:14 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b43aeb0-66dd-40a2-8aec-e8212139d5fb]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5916c61-f2d0-4a31-9a25-8257b511640c (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:02:14 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5dd975-546e-4b9c-9e7c-eb1bbf78cb2d tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5916c61-f2d0-4a31-9a25-8257b511640c (non-flash)
Oct 23 22:02:14 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 22:02:14 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5dd975-546e-4b9c-9e7c-eb1bbf78cb2d tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5916c61-f2d0-4a31-9a25-8257b511640c (non-flash)
Oct 23 22:02:14 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 22:02:14 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfde0014-67b1-482f-9e27-dfb3d9c28026 -p 172.16.0.220:3260 --login {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:02:14 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfde0014-67b1-482f-9e27-dfb3d9c28026 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:02:14 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f415740-c3ec-4bf7-90c4-dc12793c6cd7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bfde0014-67b1-482f-9e27-dfb3d9c28026, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bfde0014-67b1-482f-9e27-dfb3d9c28026, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:02:14 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5dd975-546e-4b9c-9e7c-eb1bbf78cb2d tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bfde0014-67b1-482f-9e27-dfb3d9c28026, portal: 172.16.0.220,3260]
Oct 23 22:02:14 user nova-compute[74337]: Login to [iface: default, target: iqn.2010-10.org.openstack:bfde0014-67b1-482f-9e27-dfb3d9c28026, portal: 172.16.0.220,3260] successful.
Oct 23 22:02:14 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:02:14 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfde0014-67b1-482f-9e27-dfb3d9c28026 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:02:14 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfde0014-67b1-482f-9e27-dfb3d9c28026 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.046s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:02:14 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c22ee32-2a2d-49ec-90c7-bd7058b3af9a]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:02:14 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5dd975-546e-4b9c-9e7c-eb1bbf78cb2d tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:02:14 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:02:14 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:02:14 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[1509fc28-2d52-4eab-8bfc-fb5b8bb20758]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5916c61-f2d0-4a31-9a25-8257b511640c (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfde0014-67b1-482f-9e27-dfb3d9c28026 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:02:14 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5dd975-546e-4b9c-9e7c-eb1bbf78cb2d tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5916c61-f2d0-4a31-9a25-8257b511640c (non-flash)
Oct 23 22:02:14 user nova-compute[74337]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfde0014-67b1-482f-9e27-dfb3d9c28026 (non-flash)
Oct 23 22:02:14 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 22:02:14 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5dd975-546e-4b9c-9e7c-eb1bbf78cb2d tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5916c61-f2d0-4a31-9a25-8257b511640c (non-flash)
Oct 23 22:02:14 user nova-compute[74337]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfde0014-67b1-482f-9e27-dfb3d9c28026 (non-flash)
Oct 23 22:02:14 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 22:02:14 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-bc5dd975-546e-4b9c-9e7c-eb1bbf78cb2d tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bfde0014-67b1-482f-9e27-dfb3d9c28026" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.326s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 22:02:14 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5dd975-546e-4b9c-9e7c-eb1bbf78cb2d tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Connected to 172.16.0.220:3260 {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 22:02:14 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-bc5dd975-546e-4b9c-9e7c-eb1bbf78cb2d tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] HCTL ('34', '-', '-', 0) found on session 45 with lun 0 {{(pid=74337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 22:02:14 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-bc5dd975-546e-4b9c-9e7c-eb1bbf78cb2d tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 22:02:14 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:02:14 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:02:14 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cae47db-0209-45d5-97f4-eef675e62a2a]: (4, ('- - 0', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:02:14 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-bc5dd975-546e-4b9c-9e7c-eb1bbf78cb2d tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Searching for a device in session 45 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 22:02:14 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5dd975-546e-4b9c-9e7c-eb1bbf78cb2d tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:bfde0014-67b1-482f-9e27-dfb3d9c28026', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NZkIgzot', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 22:02:15 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-bc5dd975-546e-4b9c-9e7c-eb1bbf78cb2d tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.356s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 22:02:15 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5dd975-546e-4b9c-9e7c-eb1bbf78cb2d tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] <== connect_volume: return (1357ms) {'type': 'block', 'scsi_wwn': '23938396263313437', 'path': '/dev/sdc'} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 22:02:15 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc5dd975-546e-4b9c-9e7c-eb1bbf78cb2d tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] [instance: 6326434d-56d2-43a0-b171-f0f7bd1de5a8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23938396263313437', 'path': '/dev/sdc'} {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 22:02:15 user nova-compute[74337]: DEBUG nova.objects.instance [None req-bc5dd975-546e-4b9c-9e7c-eb1bbf78cb2d tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Lazy-loading 'flavor' on Instance uuid 6326434d-56d2-43a0-b171-f0f7bd1de5a8 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:02:15 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-bc5dd975-546e-4b9c-9e7c-eb1bbf78cb2d tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 22:02:15 user nova-compute[74337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 22:02:15 user nova-compute[74337]:   <source dev="/dev/sdc"/>
Oct 23 22:02:15 user nova-compute[74337]:   <target dev="vdb" bus="virtio"/>
Oct 23 22:02:15 user nova-compute[74337]:   <serial>bfde0014-67b1-482f-9e27-dfb3d9c28026</serial>
Oct 23 22:02:15 user nova-compute[74337]: </disk>
Oct 23 22:02:15 user nova-compute[74337]:  {{(pid=74337) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 22:02:16 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-bc5dd975-546e-4b9c-9e7c-eb1bbf78cb2d tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] No BDM found with device name vda, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 22:02:16 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-bc5dd975-546e-4b9c-9e7c-eb1bbf78cb2d tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 22:02:16 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-bc5dd975-546e-4b9c-9e7c-eb1bbf78cb2d tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] No VIF found with MAC fa:16:3e:06:70:87, not building metadata {{(pid=74337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 22:02:16 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-bc5dd975-546e-4b9c-9e7c-eb1bbf78cb2d tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Lock "6326434d-56d2-43a0-b171-f0f7bd1de5a8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.038s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:02:17 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:02:18 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:02:19 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:02:20 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-6cc09a41-5150-48e7-ae09-526a557dbd91 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Acquiring lock "6326434d-56d2-43a0-b171-f0f7bd1de5a8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:02:20 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-6cc09a41-5150-48e7-ae09-526a557dbd91 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Lock "6326434d-56d2-43a0-b171-f0f7bd1de5a8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:02:20 user nova-compute[74337]: DEBUG nova.objects.instance [None req-6cc09a41-5150-48e7-ae09-526a557dbd91 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Lazy-loading 'flavor' on Instance uuid 6326434d-56d2-43a0-b171-f0f7bd1de5a8 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:02:20 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-6cc09a41-5150-48e7-ae09-526a557dbd91 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Lock "6326434d-56d2-43a0-b171-f0f7bd1de5a8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:02:20 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-6cc09a41-5150-48e7-ae09-526a557dbd91 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Acquiring lock "6326434d-56d2-43a0-b171-f0f7bd1de5a8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:02:20 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-6cc09a41-5150-48e7-ae09-526a557dbd91 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Lock "6326434d-56d2-43a0-b171-f0f7bd1de5a8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:02:20 user nova-compute[74337]: INFO nova.compute.manager [None req-6cc09a41-5150-48e7-ae09-526a557dbd91 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] [instance: 6326434d-56d2-43a0-b171-f0f7bd1de5a8] Attaching volume 0591afae-0943-47b9-bcbe-9a0acee8f665 to /dev/vdc
Oct 23 22:02:20 user nova-compute[74337]: DEBUG os_brick.utils [None req-6cc09a41-5150-48e7-ae09-526a557dbd91 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 22:02:20 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:02:20 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:02:20 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba91ce4-71a2-4f53-a239-f79b28dcde15]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f34011b66e40\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:02:20 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:02:20 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:02:20 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 22:02:20 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:02:20 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[0826a6fb-9327-46ab-be3c-018b0d3e3567]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:02:20 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:02:20 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:02:20 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c48e93b9-6563-4dd6-badf-1e072352b1a5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:02:20 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[835465fb-3aac-488d-a9d0-2eeadc84d8e7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:02:20 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-6cc09a41-5150-48e7-ae09-526a557dbd91 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Running cmd (subprocess): nvme version {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:02:20 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-6cc09a41-5150-48e7-ae09-526a557dbd91 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] 'nvme version' failed. Not Retrying. {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 22:02:20 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6cc09a41-5150-48e7-ae09-526a557dbd91 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] nvme not present on system {{(pid=74337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 22:02:20 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:02:20 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 22:02:20 user nova-compute[74337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 22:02:20 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f4d8713-accc-45e7-ab70-9217e99f6165]: (4, '') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:02:20 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-6cc09a41-5150-48e7-ae09-526a557dbd91 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 22:02:20 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-6cc09a41-5150-48e7-ae09-526a557dbd91 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 22:02:20 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-6cc09a41-5150-48e7-ae09-526a557dbd91 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] LIGHTOS: no hostnqn found. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 22:02:20 user nova-compute[74337]: DEBUG os_brick.utils [None req-6cc09a41-5150-48e7-ae09-526a557dbd91 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f34011b66e40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 22:02:20 user nova-compute[74337]: DEBUG nova.virt.block_device [None req-6cc09a41-5150-48e7-ae09-526a557dbd91 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] [instance: 6326434d-56d2-43a0-b171-f0f7bd1de5a8] Updating existing volume attachment record: 6c8ac5ff-eb83-4966-8702-fe5a808f9ed7 {{(pid=74337) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 22:02:21 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:02:22 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:02:22 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:02:22 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 22:02:22 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 22:02:22 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 22:02:22 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:02:22 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:02:23 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:02:23 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Starting heal instance info cache {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 22:02:23 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "refresh_cache-27710919-a717-42fa-a436-a261d92c1c2a" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 22:02:23 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquired lock "refresh_cache-27710919-a717-42fa-a436-a261d92c1c2a" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 22:02:23 user nova-compute[74337]: DEBUG nova.network.neutron [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 27710919-a717-42fa-a436-a261d92c1c2a] Forcefully refreshing network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 22:02:23 user nova-compute[74337]: DEBUG nova.network.neutron [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 27710919-a717-42fa-a436-a261d92c1c2a] Updating instance_info_cache with network_info: [{"id": "85905b2e-3e09-4236-8fe7-ea6c31324ae6", "address": "fa:16:3e:50:cd:90", "network": {"id": "122fdd20-8bf5-4374-b50c-82e5dc8684db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-81475496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80f79dd6954748e4806a568a4127396f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85905b2e-3e", "ovs_interfaceid": "85905b2e-3e09-4236-8fe7-ea6c31324ae6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 22:02:23 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Releasing lock "refresh_cache-27710919-a717-42fa-a436-a261d92c1c2a" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 22:02:23 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 27710919-a717-42fa-a436-a261d92c1c2a] Updated the network info_cache for instance {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 22:02:24 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:02:25 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:02:25 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:02:25 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:02:25 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:02:25 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:02:25 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Auditing locally available compute resources for user (node: user) {{(pid=74337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 22:02:25 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/999843b2-b757-480b-bd21-bf281954bc46/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:02:25 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/999843b2-b757-480b-bd21-bf281954bc46/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:02:25 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/999843b2-b757-480b-bd21-bf281954bc46/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:02:26 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/999843b2-b757-480b-bd21-bf281954bc46/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:02:26 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6326434d-56d2-43a0-b171-f0f7bd1de5a8/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:02:26 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6326434d-56d2-43a0-b171-f0f7bd1de5a8/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:02:26 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6326434d-56d2-43a0-b171-f0f7bd1de5a8/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:02:26 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6326434d-56d2-43a0-b171-f0f7bd1de5a8/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:02:26 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 22:02:26 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7a67b37-36b4-42d4-a1a3-7e5d9896d948/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:02:26 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7a67b37-36b4-42d4-a1a3-7e5d9896d948/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:02:26 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7a67b37-36b4-42d4-a1a3-7e5d9896d948/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:02:26 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7a67b37-36b4-42d4-a1a3-7e5d9896d948/disk --force-share --output=json" returned: 0 in 0.268s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:02:26 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbad2e14-7b6c-475e-b471-a87cb9e21b7f/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:02:27 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbad2e14-7b6c-475e-b471-a87cb9e21b7f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:02:27 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbad2e14-7b6c-475e-b471-a87cb9e21b7f/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:02:27 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:02:27 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbad2e14-7b6c-475e-b471-a87cb9e21b7f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:02:27 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk.rescue --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:02:27 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:02:27 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk.rescue --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:02:27 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:02:27 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:02:27 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:02:27 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:02:27 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:02:27 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:02:28 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:02:28 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:02:28 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:02:28 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 22:02:28 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b42311a5-4334-42ba-9375-e27bc946d490/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:02:28 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b42311a5-4334-42ba-9375-e27bc946d490/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:02:28 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b42311a5-4334-42ba-9375-e27bc946d490/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:02:28 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b42311a5-4334-42ba-9375-e27bc946d490/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:02:29 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:02:29 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:02:29 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:02:29 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Hypervisor/Node resource view: name=user free_ram=7919MB free_disk=25.111263275146484GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 22:02:29 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:02:29 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:02:29 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 0323b854-c7a1-42e8-ad85-1e929caa6e9d has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Oct 23 22:02:29 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 999843b2-b757-480b-bd21-bf281954bc46 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 22:02:29 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 27710919-a717-42fa-a436-a261d92c1c2a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 22:02:29 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 22:02:29 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 6326434d-56d2-43a0-b171-f0f7bd1de5a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 22:02:29 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance dbad2e14-7b6c-475e-b471-a87cb9e21b7f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 22:02:29 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance b7a67b37-36b4-42d4-a1a3-7e5d9896d948 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 22:02:29 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance b42311a5-4334-42ba-9375-e27bc946d490 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 22:02:29 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 22:02:29 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 22:02:29 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 22:02:29 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 22:02:29 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Compute_service record updated for user:user {{(pid=74337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 22:02:29 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.350s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:02:32 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-8e3e3c23-26d4-4f0d-bde5-df05b1f20b01 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Acquiring lock "dbad2e14-7b6c-475e-b471-a87cb9e21b7f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:02:32 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-8e3e3c23-26d4-4f0d-bde5-df05b1f20b01 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Lock "dbad2e14-7b6c-475e-b471-a87cb9e21b7f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:02:32 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-8e3e3c23-26d4-4f0d-bde5-df05b1f20b01 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Acquiring lock "dbad2e14-7b6c-475e-b471-a87cb9e21b7f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:02:32 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-8e3e3c23-26d4-4f0d-bde5-df05b1f20b01 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Lock "dbad2e14-7b6c-475e-b471-a87cb9e21b7f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:02:32 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-8e3e3c23-26d4-4f0d-bde5-df05b1f20b01 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Lock "dbad2e14-7b6c-475e-b471-a87cb9e21b7f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:02:32 user nova-compute[74337]: INFO nova.compute.manager [None req-8e3e3c23-26d4-4f0d-bde5-df05b1f20b01 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Terminating instance
Oct 23 22:02:32 user nova-compute[74337]: DEBUG nova.compute.manager [None req-8e3e3c23-26d4-4f0d-bde5-df05b1f20b01 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Start destroying the instance on the hypervisor. {{(pid=74337) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 22:02:32 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:02:32 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:02:32 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:02:32 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:02:32 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:02:32 user nova-compute[74337]: DEBUG nova.compute.manager [req-4cf609e9-dd30-46b7-8b6b-e382fff0f166 req-4d6b016d-bca4-44d1-8539-cfaf370a8362 service nova] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Received event network-vif-unplugged-0b516177-6ded-4b79-9f77-84ba1466f259 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:02:32 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-4cf609e9-dd30-46b7-8b6b-e382fff0f166 req-4d6b016d-bca4-44d1-8539-cfaf370a8362 service nova] Acquiring lock "dbad2e14-7b6c-475e-b471-a87cb9e21b7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:02:32 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-4cf609e9-dd30-46b7-8b6b-e382fff0f166 req-4d6b016d-bca4-44d1-8539-cfaf370a8362 service nova] Lock "dbad2e14-7b6c-475e-b471-a87cb9e21b7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:02:32 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-4cf609e9-dd30-46b7-8b6b-e382fff0f166 req-4d6b016d-bca4-44d1-8539-cfaf370a8362 service nova] Lock "dbad2e14-7b6c-475e-b471-a87cb9e21b7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:02:32 user nova-compute[74337]: DEBUG nova.compute.manager [req-4cf609e9-dd30-46b7-8b6b-e382fff0f166 req-4d6b016d-bca4-44d1-8539-cfaf370a8362 service nova] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] No waiting events found dispatching network-vif-unplugged-0b516177-6ded-4b79-9f77-84ba1466f259 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 22:02:32 user nova-compute[74337]: DEBUG nova.compute.manager [req-4cf609e9-dd30-46b7-8b6b-e382fff0f166 req-4d6b016d-bca4-44d1-8539-cfaf370a8362 service nova] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Received event network-vif-unplugged-0b516177-6ded-4b79-9f77-84ba1466f259 for instance with task_state deleting. {{(pid=74337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 22:02:32 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Instance destroyed successfully.
Oct 23 22:02:32 user nova-compute[74337]: DEBUG nova.objects.instance [None req-8e3e3c23-26d4-4f0d-bde5-df05b1f20b01 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Lazy-loading 'resources' on Instance uuid dbad2e14-7b6c-475e-b471-a87cb9e21b7f {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:02:32 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-8e3e3c23-26d4-4f0d-bde5-df05b1f20b01 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-23T21:56:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-871350340',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-871350340',id=39,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHRDalfqxZaW8tFQ9tDoYtCFE78iJYyBQ1ot3CVX7Ji0u7cN5OwvaEEc+VVh5hRl2DfFzm1xzi24XgwVkSIP+Eap1fKERDd4zLGppmS56DXgviGQt7TMPi4e47AawwOGzg==',key_name='tempest-keypair-1238420293',keypairs=<?>,launch_index=0,launched_at=2023-10-23T22:00:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dd8afde978624cf8a2356e8ce8b4d3f2',ramdisk_id='',reservation_id='r-fs4u8r0x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-338191707',owner_user_name='tempest-AttachVolumeShelveTestJSON-338191707-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T22:00:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ddd5c407fbe440e85111213c4c2dd46',uuid=dbad2e14-7b6c-475e-b471-a87cb9e21b7f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0b516177-6ded-4b79-9f77-84ba1466f259", "address": "fa:16:3e:3e:3f:19", "network": {"id": "0feb8c56-c17f-47d0-9796-91d4bd20e81d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1399506675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd8afde978624cf8a2356e8ce8b4d3f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b516177-6d", "ovs_interfaceid": "0b516177-6ded-4b79-9f77-84ba1466f259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 22:02:32 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-8e3e3c23-26d4-4f0d-bde5-df05b1f20b01 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Converting VIF {"id": "0b516177-6ded-4b79-9f77-84ba1466f259", "address": "fa:16:3e:3e:3f:19", "network": {"id": "0feb8c56-c17f-47d0-9796-91d4bd20e81d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1399506675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd8afde978624cf8a2356e8ce8b4d3f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b516177-6d", "ovs_interfaceid": "0b516177-6ded-4b79-9f77-84ba1466f259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 22:02:32 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-8e3e3c23-26d4-4f0d-bde5-df05b1f20b01 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:3f:19,bridge_name='br-int',has_traffic_filtering=True,id=0b516177-6ded-4b79-9f77-84ba1466f259,network=Network(0feb8c56-c17f-47d0-9796-91d4bd20e81d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b516177-6d') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 22:02:32 user nova-compute[74337]: DEBUG os_vif [None req-8e3e3c23-26d4-4f0d-bde5-df05b1f20b01 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:3f:19,bridge_name='br-int',has_traffic_filtering=True,id=0b516177-6ded-4b79-9f77-84ba1466f259,network=Network(0feb8c56-c17f-47d0-9796-91d4bd20e81d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b516177-6d') {{(pid=74337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 22:02:32 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:02:32 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0b516177-6d, bridge=br-int, if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:02:32 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:02:32 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:02:32 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:02:32 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0cca560a-9c2f-4414-87bf-af3a8782ace4) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:02:32 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:02:32 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:02:32 user nova-compute[74337]: INFO os_vif [None req-8e3e3c23-26d4-4f0d-bde5-df05b1f20b01 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:3f:19,bridge_name='br-int',has_traffic_filtering=True,id=0b516177-6ded-4b79-9f77-84ba1466f259,network=Network(0feb8c56-c17f-47d0-9796-91d4bd20e81d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b516177-6d')
Oct 23 22:02:32 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-8e3e3c23-26d4-4f0d-bde5-df05b1f20b01 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Deleting instance files /opt/stack/data/nova/instances/dbad2e14-7b6c-475e-b471-a87cb9e21b7f_del
Oct 23 22:02:33 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-8e3e3c23-26d4-4f0d-bde5-df05b1f20b01 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Deletion of /opt/stack/data/nova/instances/dbad2e14-7b6c-475e-b471-a87cb9e21b7f_del complete
Oct 23 22:02:33 user nova-compute[74337]: INFO nova.compute.manager [None req-8e3e3c23-26d4-4f0d-bde5-df05b1f20b01 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Took 0.91 seconds to destroy the instance on the hypervisor.
Oct 23 22:02:33 user nova-compute[74337]: DEBUG oslo.service.loopingcall [None req-8e3e3c23-26d4-4f0d-bde5-df05b1f20b01 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74337) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 22:02:33 user nova-compute[74337]: DEBUG nova.compute.manager [-] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Deallocating network for instance {{(pid=74337) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 22:02:33 user nova-compute[74337]: DEBUG nova.network.neutron [-] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] deallocate_for_instance() {{(pid=74337) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 22:02:33 user nova-compute[74337]: DEBUG nova.network.neutron [-] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Updating instance_info_cache with network_info: [] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 22:02:33 user nova-compute[74337]: DEBUG nova.compute.manager [req-d4a26876-72d9-4690-b40f-9dbdc118b59f req-e7468331-4780-4f5e-a992-d81eaee1f8a5 service nova] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Received event network-vif-deleted-0b516177-6ded-4b79-9f77-84ba1466f259 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:02:33 user nova-compute[74337]: INFO nova.compute.manager [req-d4a26876-72d9-4690-b40f-9dbdc118b59f req-e7468331-4780-4f5e-a992-d81eaee1f8a5 service nova] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Neutron deleted interface 0b516177-6ded-4b79-9f77-84ba1466f259; detaching it from the instance and deleting it from the info cache
Oct 23 22:02:33 user nova-compute[74337]: DEBUG nova.network.neutron [req-d4a26876-72d9-4690-b40f-9dbdc118b59f req-e7468331-4780-4f5e-a992-d81eaee1f8a5 service nova] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Updating instance_info_cache with network_info: [] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 22:02:33 user nova-compute[74337]: INFO nova.compute.manager [-] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Took 0.92 seconds to deallocate network for instance.
Oct 23 22:02:33 user nova-compute[74337]: DEBUG nova.compute.manager [req-d4a26876-72d9-4690-b40f-9dbdc118b59f req-e7468331-4780-4f5e-a992-d81eaee1f8a5 service nova] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Detach interface failed, port_id=0b516177-6ded-4b79-9f77-84ba1466f259, reason: Instance dbad2e14-7b6c-475e-b471-a87cb9e21b7f could not be found. {{(pid=74337) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 23 22:02:34 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-8e3e3c23-26d4-4f0d-bde5-df05b1f20b01 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:02:34 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-8e3e3c23-26d4-4f0d-bde5-df05b1f20b01 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:02:34 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:02:34 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-8e3e3c23-26d4-4f0d-bde5-df05b1f20b01 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 22:02:34 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-8e3e3c23-26d4-4f0d-bde5-df05b1f20b01 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 22:02:34 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-8e3e3c23-26d4-4f0d-bde5-df05b1f20b01 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.313s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:02:34 user nova-compute[74337]: INFO nova.scheduler.client.report [None req-8e3e3c23-26d4-4f0d-bde5-df05b1f20b01 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Deleted allocations for instance dbad2e14-7b6c-475e-b471-a87cb9e21b7f
Oct 23 22:02:34 user nova-compute[74337]: DEBUG nova.compute.manager [req-a78bb07e-9590-4735-b7ce-fca6b66f1555 req-5d163497-89af-44e8-bf26-cb7d47fabd52 service nova] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Received event network-vif-plugged-0b516177-6ded-4b79-9f77-84ba1466f259 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:02:34 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-a78bb07e-9590-4735-b7ce-fca6b66f1555 req-5d163497-89af-44e8-bf26-cb7d47fabd52 service nova] Acquiring lock "dbad2e14-7b6c-475e-b471-a87cb9e21b7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:02:34 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-a78bb07e-9590-4735-b7ce-fca6b66f1555 req-5d163497-89af-44e8-bf26-cb7d47fabd52 service nova] Lock "dbad2e14-7b6c-475e-b471-a87cb9e21b7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:02:34 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-a78bb07e-9590-4735-b7ce-fca6b66f1555 req-5d163497-89af-44e8-bf26-cb7d47fabd52 service nova] Lock "dbad2e14-7b6c-475e-b471-a87cb9e21b7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:02:34 user nova-compute[74337]: DEBUG nova.compute.manager [req-a78bb07e-9590-4735-b7ce-fca6b66f1555 req-5d163497-89af-44e8-bf26-cb7d47fabd52 service nova] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] No waiting events found dispatching network-vif-plugged-0b516177-6ded-4b79-9f77-84ba1466f259 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 22:02:34 user nova-compute[74337]: WARNING nova.compute.manager [req-a78bb07e-9590-4735-b7ce-fca6b66f1555 req-5d163497-89af-44e8-bf26-cb7d47fabd52 service nova] [instance: dbad2e14-7b6c-475e-b471-a87cb9e21b7f] Received unexpected event network-vif-plugged-0b516177-6ded-4b79-9f77-84ba1466f259 for instance with vm_state deleted and task_state None.
Oct 23 22:02:34 user nova-compute[74337]: DEBUG nova.compute.manager [req-a78bb07e-9590-4735-b7ce-fca6b66f1555 req-5d163497-89af-44e8-bf26-cb7d47fabd52 service nova] [instance: b7a67b37-36b4-42d4-a1a3-7e5d9896d948] Received event network-changed-35fea171-071b-4e56-8bb4-a4185a1e6da3 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:02:34 user nova-compute[74337]: DEBUG nova.compute.manager [req-a78bb07e-9590-4735-b7ce-fca6b66f1555 req-5d163497-89af-44e8-bf26-cb7d47fabd52 service nova] [instance: b7a67b37-36b4-42d4-a1a3-7e5d9896d948] Refreshing instance network info cache due to event network-changed-35fea171-071b-4e56-8bb4-a4185a1e6da3. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 22:02:34 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-a78bb07e-9590-4735-b7ce-fca6b66f1555 req-5d163497-89af-44e8-bf26-cb7d47fabd52 service nova] Acquiring lock "refresh_cache-b7a67b37-36b4-42d4-a1a3-7e5d9896d948" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 22:02:34 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-a78bb07e-9590-4735-b7ce-fca6b66f1555 req-5d163497-89af-44e8-bf26-cb7d47fabd52 service nova] Acquired lock "refresh_cache-b7a67b37-36b4-42d4-a1a3-7e5d9896d948" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 22:02:34 user nova-compute[74337]: DEBUG nova.network.neutron [req-a78bb07e-9590-4735-b7ce-fca6b66f1555 req-5d163497-89af-44e8-bf26-cb7d47fabd52 service nova] [instance: b7a67b37-36b4-42d4-a1a3-7e5d9896d948] Refreshing network info cache for port 35fea171-071b-4e56-8bb4-a4185a1e6da3 {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 22:02:34 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-8e3e3c23-26d4-4f0d-bde5-df05b1f20b01 tempest-AttachVolumeShelveTestJSON-338191707 tempest-AttachVolumeShelveTestJSON-338191707-project-member] Lock "dbad2e14-7b6c-475e-b471-a87cb9e21b7f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.389s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:02:35 user nova-compute[74337]: DEBUG nova.network.neutron [req-a78bb07e-9590-4735-b7ce-fca6b66f1555 req-5d163497-89af-44e8-bf26-cb7d47fabd52 service nova] [instance: b7a67b37-36b4-42d4-a1a3-7e5d9896d948] Updated VIF entry in instance network info cache for port 35fea171-071b-4e56-8bb4-a4185a1e6da3. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 22:02:35 user nova-compute[74337]: DEBUG nova.network.neutron [req-a78bb07e-9590-4735-b7ce-fca6b66f1555 req-5d163497-89af-44e8-bf26-cb7d47fabd52 service nova] [instance: b7a67b37-36b4-42d4-a1a3-7e5d9896d948] Updating instance_info_cache with network_info: [{"id": "35fea171-071b-4e56-8bb4-a4185a1e6da3", "address": "fa:16:3e:d3:de:6c", "network": {"id": "2afac13f-fb75-4d79-ae11-92c0c98e710f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-597086266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b672a253930043eda6ea2b27559f15fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35fea171-07", "ovs_interfaceid": "35fea171-071b-4e56-8bb4-a4185a1e6da3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 22:02:35 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-a78bb07e-9590-4735-b7ce-fca6b66f1555 req-5d163497-89af-44e8-bf26-cb7d47fabd52 service nova] Releasing lock "refresh_cache-b7a67b37-36b4-42d4-a1a3-7e5d9896d948" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 22:02:36 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:02:37 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:02:39 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:02:39 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-8848b1ee-9131-4187-8021-519df1fc5d70 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Acquiring lock "b42311a5-4334-42ba-9375-e27bc946d490" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:02:39 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-8848b1ee-9131-4187-8021-519df1fc5d70 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Lock "b42311a5-4334-42ba-9375-e27bc946d490" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:02:39 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-8848b1ee-9131-4187-8021-519df1fc5d70 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Acquiring lock "b42311a5-4334-42ba-9375-e27bc946d490-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:02:39 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-8848b1ee-9131-4187-8021-519df1fc5d70 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Lock "b42311a5-4334-42ba-9375-e27bc946d490-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:02:39 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-8848b1ee-9131-4187-8021-519df1fc5d70 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Lock "b42311a5-4334-42ba-9375-e27bc946d490-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:02:39 user nova-compute[74337]: INFO nova.compute.manager [None req-8848b1ee-9131-4187-8021-519df1fc5d70 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] [instance: b42311a5-4334-42ba-9375-e27bc946d490] Terminating instance
Oct 23 22:02:39 user nova-compute[74337]: DEBUG nova.compute.manager [None req-8848b1ee-9131-4187-8021-519df1fc5d70 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] [instance: b42311a5-4334-42ba-9375-e27bc946d490] Start destroying the instance on the hypervisor. {{(pid=74337) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 22:02:39 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:02:39 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:02:39 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:02:39 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:02:39 user nova-compute[74337]: DEBUG nova.compute.manager [req-02a413e6-61da-4ccf-988c-1c94503675b3 req-5d669df7-ea99-4cd8-9216-a960416732c0 service nova] [instance: b42311a5-4334-42ba-9375-e27bc946d490] Received event network-vif-unplugged-825ed2da-43b7-4f1e-a078-4a55a3e7ed4f {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:02:39 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-02a413e6-61da-4ccf-988c-1c94503675b3 req-5d669df7-ea99-4cd8-9216-a960416732c0 service nova] Acquiring lock "b42311a5-4334-42ba-9375-e27bc946d490-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:02:39 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-02a413e6-61da-4ccf-988c-1c94503675b3 req-5d669df7-ea99-4cd8-9216-a960416732c0 service nova] Lock "b42311a5-4334-42ba-9375-e27bc946d490-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:02:39 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-02a413e6-61da-4ccf-988c-1c94503675b3 req-5d669df7-ea99-4cd8-9216-a960416732c0 service nova] Lock "b42311a5-4334-42ba-9375-e27bc946d490-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:02:39 user nova-compute[74337]: DEBUG nova.compute.manager [req-02a413e6-61da-4ccf-988c-1c94503675b3 req-5d669df7-ea99-4cd8-9216-a960416732c0 service nova] [instance: b42311a5-4334-42ba-9375-e27bc946d490] No waiting events found dispatching network-vif-unplugged-825ed2da-43b7-4f1e-a078-4a55a3e7ed4f {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 22:02:39 user nova-compute[74337]: DEBUG nova.compute.manager [req-02a413e6-61da-4ccf-988c-1c94503675b3 req-5d669df7-ea99-4cd8-9216-a960416732c0 service nova] [instance: b42311a5-4334-42ba-9375-e27bc946d490] Received event network-vif-unplugged-825ed2da-43b7-4f1e-a078-4a55a3e7ed4f for instance with task_state deleting. {{(pid=74337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 22:02:40 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: b42311a5-4334-42ba-9375-e27bc946d490] Instance destroyed successfully.
Oct 23 22:02:40 user nova-compute[74337]: DEBUG nova.objects.instance [None req-8848b1ee-9131-4187-8021-519df1fc5d70 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Lazy-loading 'resources' on Instance uuid b42311a5-4334-42ba-9375-e27bc946d490 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:02:40 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-8848b1ee-9131-4187-8021-519df1fc5d70 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T22:00:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-850767745',display_name='tempest-VolumesActionsTest-instance-850767745',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-850767745',id=46,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-23T22:00:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='10913ebbab6441bdaa5b0bd97bf1dfb8',ramdisk_id='',reservation_id='r-ltab5cdd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-959580854',owner_user_name='tempest-VolumesActionsTest-959580854-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T22:00:56Z,user_data=None,user_id='112575ac7c2d4409a95aa1844d967afa',uuid=b42311a5-4334-42ba-9375-e27bc946d490,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "825ed2da-43b7-4f1e-a078-4a55a3e7ed4f", "address": "fa:16:3e:33:95:f5", "network": {"id": "89c20314-7bb0-4ea1-b024-d474e5deb03a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-600863519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10913ebbab6441bdaa5b0bd97bf1dfb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap825ed2da-43", "ovs_interfaceid": "825ed2da-43b7-4f1e-a078-4a55a3e7ed4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 22:02:40 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-8848b1ee-9131-4187-8021-519df1fc5d70 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Converting VIF {"id": "825ed2da-43b7-4f1e-a078-4a55a3e7ed4f", "address": "fa:16:3e:33:95:f5", "network": {"id": "89c20314-7bb0-4ea1-b024-d474e5deb03a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-600863519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10913ebbab6441bdaa5b0bd97bf1dfb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap825ed2da-43", "ovs_interfaceid": "825ed2da-43b7-4f1e-a078-4a55a3e7ed4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 22:02:40 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-8848b1ee-9131-4187-8021-519df1fc5d70 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:95:f5,bridge_name='br-int',has_traffic_filtering=True,id=825ed2da-43b7-4f1e-a078-4a55a3e7ed4f,network=Network(89c20314-7bb0-4ea1-b024-d474e5deb03a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap825ed2da-43') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 22:02:40 user nova-compute[74337]: DEBUG os_vif [None req-8848b1ee-9131-4187-8021-519df1fc5d70 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:95:f5,bridge_name='br-int',has_traffic_filtering=True,id=825ed2da-43b7-4f1e-a078-4a55a3e7ed4f,network=Network(89c20314-7bb0-4ea1-b024-d474e5deb03a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap825ed2da-43') {{(pid=74337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 22:02:40 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:02:40 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap825ed2da-43, bridge=br-int, if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:02:40 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:02:40 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:02:40 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:02:40 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5781b8cc-0e10-44f6-a10d-6361c4d740df) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:02:40 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:02:40 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:02:40 user nova-compute[74337]: INFO os_vif [None req-8848b1ee-9131-4187-8021-519df1fc5d70 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:95:f5,bridge_name='br-int',has_traffic_filtering=True,id=825ed2da-43b7-4f1e-a078-4a55a3e7ed4f,network=Network(89c20314-7bb0-4ea1-b024-d474e5deb03a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap825ed2da-43')
Oct 23 22:02:40 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-8848b1ee-9131-4187-8021-519df1fc5d70 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] [instance: b42311a5-4334-42ba-9375-e27bc946d490] Deleting instance files /opt/stack/data/nova/instances/b42311a5-4334-42ba-9375-e27bc946d490_del
Oct 23 22:02:40 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-8848b1ee-9131-4187-8021-519df1fc5d70 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] [instance: b42311a5-4334-42ba-9375-e27bc946d490] Deletion of /opt/stack/data/nova/instances/b42311a5-4334-42ba-9375-e27bc946d490_del complete
Oct 23 22:02:40 user nova-compute[74337]: INFO nova.compute.manager [None req-8848b1ee-9131-4187-8021-519df1fc5d70 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] [instance: b42311a5-4334-42ba-9375-e27bc946d490] Took 0.71 seconds to destroy the instance on the hypervisor.
Oct 23 22:02:40 user nova-compute[74337]: DEBUG oslo.service.loopingcall [None req-8848b1ee-9131-4187-8021-519df1fc5d70 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74337) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 22:02:40 user nova-compute[74337]: DEBUG nova.compute.manager [-] [instance: b42311a5-4334-42ba-9375-e27bc946d490] Deallocating network for instance {{(pid=74337) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 22:02:40 user nova-compute[74337]: DEBUG nova.network.neutron [-] [instance: b42311a5-4334-42ba-9375-e27bc946d490] deallocate_for_instance() {{(pid=74337) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 22:02:40 user nova-compute[74337]: DEBUG nova.network.neutron [-] [instance: b42311a5-4334-42ba-9375-e27bc946d490] Updating instance_info_cache with network_info: [] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 22:02:40 user nova-compute[74337]: INFO nova.compute.manager [-] [instance: b42311a5-4334-42ba-9375-e27bc946d490] Took 0.48 seconds to deallocate network for instance.
Oct 23 22:02:40 user nova-compute[74337]: DEBUG nova.compute.manager [req-d172664b-c35c-488a-b5dc-10be20a341e9 req-eb52618b-6448-46a9-b1a7-a613a5412b1f service nova] [instance: b42311a5-4334-42ba-9375-e27bc946d490] Received event network-vif-deleted-825ed2da-43b7-4f1e-a078-4a55a3e7ed4f {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:02:40 user nova-compute[74337]: INFO nova.compute.manager [req-d172664b-c35c-488a-b5dc-10be20a341e9 req-eb52618b-6448-46a9-b1a7-a613a5412b1f service nova] [instance: b42311a5-4334-42ba-9375-e27bc946d490] Neutron deleted interface 825ed2da-43b7-4f1e-a078-4a55a3e7ed4f; detaching it from the instance and deleting it from the info cache
Oct 23 22:02:40 user nova-compute[74337]: DEBUG nova.network.neutron [req-d172664b-c35c-488a-b5dc-10be20a341e9 req-eb52618b-6448-46a9-b1a7-a613a5412b1f service nova] [instance: b42311a5-4334-42ba-9375-e27bc946d490] Updating instance_info_cache with network_info: [] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 22:02:40 user nova-compute[74337]: DEBUG nova.compute.manager [req-d172664b-c35c-488a-b5dc-10be20a341e9 req-eb52618b-6448-46a9-b1a7-a613a5412b1f service nova] [instance: b42311a5-4334-42ba-9375-e27bc946d490] Detach interface failed, port_id=825ed2da-43b7-4f1e-a078-4a55a3e7ed4f, reason: Instance b42311a5-4334-42ba-9375-e27bc946d490 could not be found. {{(pid=74337) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 23 22:02:40 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-8848b1ee-9131-4187-8021-519df1fc5d70 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:02:40 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-8848b1ee-9131-4187-8021-519df1fc5d70 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:02:41 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-8848b1ee-9131-4187-8021-519df1fc5d70 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 22:02:41 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-8848b1ee-9131-4187-8021-519df1fc5d70 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 22:02:41 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-8848b1ee-9131-4187-8021-519df1fc5d70 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.255s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:02:41 user nova-compute[74337]: INFO nova.scheduler.client.report [None req-8848b1ee-9131-4187-8021-519df1fc5d70 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Deleted allocations for instance b42311a5-4334-42ba-9375-e27bc946d490
Oct 23 22:02:41 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-8848b1ee-9131-4187-8021-519df1fc5d70 tempest-VolumesActionsTest-959580854 tempest-VolumesActionsTest-959580854-project-member] Lock "b42311a5-4334-42ba-9375-e27bc946d490" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.647s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:02:41 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6cc09a41-5150-48e7-ae09-526a557dbd91 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] [instance: 6326434d-56d2-43a0-b171-f0f7bd1de5a8] Calling os-brick to attach iSCSI Volume {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 22:02:41 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc09a41-5150-48e7-ae09-526a557dbd91 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0591afae-0943-47b9-bcbe-9a0acee8f665', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PFGkgYVp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 22:02:41 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-6cc09a41-5150-48e7-ae09-526a557dbd91 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 22:02:41 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-6cc09a41-5150-48e7-ae09-526a557dbd91 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 22:02:41 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-6cc09a41-5150-48e7-ae09-526a557dbd91 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 22:02:41 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-6cc09a41-5150-48e7-ae09-526a557dbd91 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 22:02:41 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-6cc09a41-5150-48e7-ae09-526a557dbd91 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0591afae-0943-47b9-bcbe-9a0acee8f665" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 22:02:41 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-6cc09a41-5150-48e7-ae09-526a557dbd91 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0591afae-0943-47b9-bcbe-9a0acee8f665" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 22:02:41 user nova-compute[74337]: INFO os_brick.initiator.connectors.iscsi [None req-6cc09a41-5150-48e7-ae09-526a557dbd91 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 22:02:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0591afae-0943-47b9-bcbe-9a0acee8f665 -p 172.16.0.220:3260 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:02:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0591afae-0943-47b9-bcbe-9a0acee8f665 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:02:41 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d9d20d-4658-448c-9e60-563d1ed41943]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:02:41 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc09a41-5150-48e7-ae09-526a557dbd91 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 22:02:41 user nova-compute[74337]:  {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:02:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0591afae-0943-47b9-bcbe-9a0acee8f665 -p 172.16.0.220:3260 --interface default --op new {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:02:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0591afae-0943-47b9-bcbe-9a0acee8f665 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:02:41 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e6b395a-60a2-41e3-9b01-811181616c93]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0591afae-0943-47b9-bcbe-9a0acee8f665] added\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:02:41 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc09a41-5150-48e7-ae09-526a557dbd91 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0591afae-0943-47b9-bcbe-9a0acee8f665] added
Oct 23 22:02:41 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:02:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0591afae-0943-47b9-bcbe-9a0acee8f665 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:02:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0591afae-0943-47b9-bcbe-9a0acee8f665 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:02:41 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[12d5710b-3f3f-4208-bbe6-775990aa7276]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:02:41 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc09a41-5150-48e7-ae09-526a557dbd91 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:02:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0591afae-0943-47b9-bcbe-9a0acee8f665 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:02:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0591afae-0943-47b9-bcbe-9a0acee8f665 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:02:41 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b28b798-b939-4c28-b902-e4133546f5f5]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:02:41 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc09a41-5150-48e7-ae09-526a557dbd91 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:02:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0591afae-0943-47b9-bcbe-9a0acee8f665 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PFGkgYVp {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:02:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0591afae-0943-47b9-bcbe-9a0acee8f665 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PFGkgYVp" returned: 0 in 0.025s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:02:41 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[153f2900-e326-45be-bca8-e422c6155508]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:02:41 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc09a41-5150-48e7-ae09-526a557dbd91 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PFGkgYVp'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:02:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0591afae-0943-47b9-bcbe-9a0acee8f665 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:02:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0591afae-0943-47b9-bcbe-9a0acee8f665 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:02:41 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[f22f9626-a187-426c-b734-1f4d564bd37e]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:02:41 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc09a41-5150-48e7-ae09-526a557dbd91 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:02:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:02:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:02:41 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[10603743-4e1b-4d84-92f7-595efc054590]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5916c61-f2d0-4a31-9a25-8257b511640c (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfde0014-67b1-482f-9e27-dfb3d9c28026 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:02:41 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc09a41-5150-48e7-ae09-526a557dbd91 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5916c61-f2d0-4a31-9a25-8257b511640c (non-flash)
Oct 23 22:02:41 user nova-compute[74337]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfde0014-67b1-482f-9e27-dfb3d9c28026 (non-flash)
Oct 23 22:02:41 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 22:02:41 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc09a41-5150-48e7-ae09-526a557dbd91 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5916c61-f2d0-4a31-9a25-8257b511640c (non-flash)
Oct 23 22:02:41 user nova-compute[74337]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfde0014-67b1-482f-9e27-dfb3d9c28026 (non-flash)
Oct 23 22:02:41 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 22:02:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0591afae-0943-47b9-bcbe-9a0acee8f665 -p 172.16.0.220:3260 --login {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:02:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0591afae-0943-47b9-bcbe-9a0acee8f665 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:02:41 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef5ddfe-0901-4db4-823b-c3ffccf93b5d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0591afae-0943-47b9-bcbe-9a0acee8f665, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0591afae-0943-47b9-bcbe-9a0acee8f665, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:02:41 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc09a41-5150-48e7-ae09-526a557dbd91 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0591afae-0943-47b9-bcbe-9a0acee8f665, portal: 172.16.0.220,3260]
Oct 23 22:02:41 user nova-compute[74337]: Login to [iface: default, target: iqn.2010-10.org.openstack:0591afae-0943-47b9-bcbe-9a0acee8f665, portal: 172.16.0.220,3260] successful.
Oct 23 22:02:41 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:02:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0591afae-0943-47b9-bcbe-9a0acee8f665 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:02:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0591afae-0943-47b9-bcbe-9a0acee8f665 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:02:41 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[f76c0cf3-7c93-4c61-bfc1-cec978b70f6f]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:02:41 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc09a41-5150-48e7-ae09-526a557dbd91 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:02:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:02:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:02:41 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed930ad6-2a3d-45bf-885a-fc457e724530]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5916c61-f2d0-4a31-9a25-8257b511640c (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfde0014-67b1-482f-9e27-dfb3d9c28026 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0591afae-0943-47b9-bcbe-9a0acee8f665 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:02:41 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc09a41-5150-48e7-ae09-526a557dbd91 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5916c61-f2d0-4a31-9a25-8257b511640c (non-flash)
Oct 23 22:02:41 user nova-compute[74337]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfde0014-67b1-482f-9e27-dfb3d9c28026 (non-flash)
Oct 23 22:02:41 user nova-compute[74337]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0591afae-0943-47b9-bcbe-9a0acee8f665 (non-flash)
Oct 23 22:02:41 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 22:02:41 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc09a41-5150-48e7-ae09-526a557dbd91 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5916c61-f2d0-4a31-9a25-8257b511640c (non-flash)
Oct 23 22:02:41 user nova-compute[74337]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfde0014-67b1-482f-9e27-dfb3d9c28026 (non-flash)
Oct 23 22:02:41 user nova-compute[74337]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0591afae-0943-47b9-bcbe-9a0acee8f665 (non-flash)
Oct 23 22:02:41 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 22:02:41 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-6cc09a41-5150-48e7-ae09-526a557dbd91 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0591afae-0943-47b9-bcbe-9a0acee8f665" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 22:02:41 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc09a41-5150-48e7-ae09-526a557dbd91 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Connected to 172.16.0.220:3260 {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 22:02:41 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-6cc09a41-5150-48e7-ae09-526a557dbd91 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] HCTL ('35', '-', '-', 0) found on session 46 with lun 0 {{(pid=74337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 22:02:41 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-6cc09a41-5150-48e7-ae09-526a557dbd91 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 22:02:41 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-2fe1d23b-c0f6-4d9c-910a-63c5309d1603 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Acquiring lock "b7a67b37-36b4-42d4-a1a3-7e5d9896d948" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:02:41 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-2fe1d23b-c0f6-4d9c-910a-63c5309d1603 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Lock "b7a67b37-36b4-42d4-a1a3-7e5d9896d948" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:02:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:02:41 user nova-compute[74337]: DEBUG nova.objects.instance [None req-2fe1d23b-c0f6-4d9c-910a-63c5309d1603 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Lazy-loading 'flavor' on Instance uuid b7a67b37-36b4-42d4-a1a3-7e5d9896d948 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:02:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:02:41 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ef5fd2-2424-425e-8e66-b571afcb13b0]: (4, ('- - 0', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:02:41 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-6cc09a41-5150-48e7-ae09-526a557dbd91 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Searching for a device in session 46 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 22:02:41 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc09a41-5150-48e7-ae09-526a557dbd91 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:0591afae-0943-47b9-bcbe-9a0acee8f665', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PFGkgYVp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 22:02:41 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-2fe1d23b-c0f6-4d9c-910a-63c5309d1603 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Lock "b7a67b37-36b4-42d4-a1a3-7e5d9896d948" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.075s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:02:41 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-2fe1d23b-c0f6-4d9c-910a-63c5309d1603 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Acquiring lock "b7a67b37-36b4-42d4-a1a3-7e5d9896d948" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:02:41 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-2fe1d23b-c0f6-4d9c-910a-63c5309d1603 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Lock "b7a67b37-36b4-42d4-a1a3-7e5d9896d948" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:02:41 user nova-compute[74337]: INFO nova.compute.manager [None req-2fe1d23b-c0f6-4d9c-910a-63c5309d1603 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] [instance: b7a67b37-36b4-42d4-a1a3-7e5d9896d948] Attaching volume cf5a2fd9-1f24-4de7-a9eb-467593f66148 to /dev/vdb
Oct 23 22:02:41 user nova-compute[74337]: DEBUG os_brick.utils [None req-2fe1d23b-c0f6-4d9c-910a-63c5309d1603 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 22:02:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:02:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:02:41 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[22389a7b-34bf-49df-ac92-4ab9c4aacfd0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f34011b66e40\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:02:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:02:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:02:42 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[f63ca27c-75b9-4940-b60f-59327c44f35f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:02:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:02:42 user nova-compute[74337]: DEBUG nova.compute.manager [req-a81e3438-4051-4f2d-8038-4b24dba8fdfe req-3d05c726-6f1b-4c30-9b81-e6a31d742764 service nova] [instance: b42311a5-4334-42ba-9375-e27bc946d490] Received event network-vif-plugged-825ed2da-43b7-4f1e-a078-4a55a3e7ed4f {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:02:42 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-a81e3438-4051-4f2d-8038-4b24dba8fdfe req-3d05c726-6f1b-4c30-9b81-e6a31d742764 service nova] Acquiring lock "b42311a5-4334-42ba-9375-e27bc946d490-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:02:42 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-a81e3438-4051-4f2d-8038-4b24dba8fdfe req-3d05c726-6f1b-4c30-9b81-e6a31d742764 service nova] Lock "b42311a5-4334-42ba-9375-e27bc946d490-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:02:42 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-a81e3438-4051-4f2d-8038-4b24dba8fdfe req-3d05c726-6f1b-4c30-9b81-e6a31d742764 service nova] Lock "b42311a5-4334-42ba-9375-e27bc946d490-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:02:42 user nova-compute[74337]: DEBUG nova.compute.manager [req-a81e3438-4051-4f2d-8038-4b24dba8fdfe req-3d05c726-6f1b-4c30-9b81-e6a31d742764 service nova] [instance: b42311a5-4334-42ba-9375-e27bc946d490] No waiting events found dispatching network-vif-plugged-825ed2da-43b7-4f1e-a078-4a55a3e7ed4f {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 22:02:42 user nova-compute[74337]: WARNING nova.compute.manager [req-a81e3438-4051-4f2d-8038-4b24dba8fdfe req-3d05c726-6f1b-4c30-9b81-e6a31d742764 service nova] [instance: b42311a5-4334-42ba-9375-e27bc946d490] Received unexpected event network-vif-plugged-825ed2da-43b7-4f1e-a078-4a55a3e7ed4f for instance with vm_state deleted and task_state None.
Oct 23 22:02:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.030s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:02:42 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[62de868f-3725-48ca-b537-6c114db79a5d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:02:42 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d34ac7-fa9b-4621-9c8f-fa1741d01f9a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:02:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-2fe1d23b-c0f6-4d9c-910a-63c5309d1603 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Running cmd (subprocess): nvme version {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:02:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-2fe1d23b-c0f6-4d9c-910a-63c5309d1603 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] 'nvme version' failed. Not Retrying. {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 22:02:42 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2fe1d23b-c0f6-4d9c-910a-63c5309d1603 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] nvme not present on system {{(pid=74337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 22:02:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:02:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 22:02:42 user nova-compute[74337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 22:02:42 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc05f70d-59e7-4a15-8f76-3998ba0b984e]: (4, '') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:02:42 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-2fe1d23b-c0f6-4d9c-910a-63c5309d1603 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 22:02:42 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-2fe1d23b-c0f6-4d9c-910a-63c5309d1603 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 22:02:42 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-2fe1d23b-c0f6-4d9c-910a-63c5309d1603 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] LIGHTOS: no hostnqn found. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 22:02:42 user nova-compute[74337]: DEBUG os_brick.utils [None req-2fe1d23b-c0f6-4d9c-910a-63c5309d1603 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f34011b66e40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 22:02:42 user nova-compute[74337]: DEBUG nova.virt.block_device [None req-2fe1d23b-c0f6-4d9c-910a-63c5309d1603 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] [instance: b7a67b37-36b4-42d4-a1a3-7e5d9896d948] Updating existing volume attachment record: 810268b2-034a-4d4c-84d7-07ca46be7119 {{(pid=74337) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 22:02:42 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-6cc09a41-5150-48e7-ae09-526a557dbd91 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 22:02:42 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc09a41-5150-48e7-ae09-526a557dbd91 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '23232346135323362', 'path': '/dev/sdd'} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 22:02:42 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6cc09a41-5150-48e7-ae09-526a557dbd91 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] [instance: 6326434d-56d2-43a0-b171-f0f7bd1de5a8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23232346135323362', 'path': '/dev/sdd'} {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 22:02:42 user nova-compute[74337]: DEBUG nova.objects.instance [None req-6cc09a41-5150-48e7-ae09-526a557dbd91 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Lazy-loading 'flavor' on Instance uuid 6326434d-56d2-43a0-b171-f0f7bd1de5a8 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:02:42 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-6cc09a41-5150-48e7-ae09-526a557dbd91 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 22:02:42 user nova-compute[74337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 22:02:42 user nova-compute[74337]:   <source dev="/dev/sdd"/>
Oct 23 22:02:42 user nova-compute[74337]:   <target dev="vdc" bus="virtio"/>
Oct 23 22:02:42 user nova-compute[74337]:   <serial>0591afae-0943-47b9-bcbe-9a0acee8f665</serial>
Oct 23 22:02:42 user nova-compute[74337]: </disk>
Oct 23 22:02:42 user nova-compute[74337]:  {{(pid=74337) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 22:02:43 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-6cc09a41-5150-48e7-ae09-526a557dbd91 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] No BDM found with device name vda, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 22:02:43 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-6cc09a41-5150-48e7-ae09-526a557dbd91 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 22:02:43 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-6cc09a41-5150-48e7-ae09-526a557dbd91 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 22:02:43 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-6cc09a41-5150-48e7-ae09-526a557dbd91 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] No VIF found with MAC fa:16:3e:06:70:87, not building metadata {{(pid=74337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 22:02:43 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-6cc09a41-5150-48e7-ae09-526a557dbd91 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Lock "6326434d-56d2-43a0-b171-f0f7bd1de5a8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.954s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:02:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:02:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-5f814920-0b5d-4fd1-8444-f2c859b279dd tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Acquiring lock "6326434d-56d2-43a0-b171-f0f7bd1de5a8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:02:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-5f814920-0b5d-4fd1-8444-f2c859b279dd tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Lock "6326434d-56d2-43a0-b171-f0f7bd1de5a8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:02:44 user nova-compute[74337]: INFO nova.compute.manager [None req-5f814920-0b5d-4fd1-8444-f2c859b279dd tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] [instance: 6326434d-56d2-43a0-b171-f0f7bd1de5a8] Detaching volume 0591afae-0943-47b9-bcbe-9a0acee8f665
Oct 23 22:02:44 user nova-compute[74337]: INFO nova.virt.block_device [None req-5f814920-0b5d-4fd1-8444-f2c859b279dd tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] [instance: 6326434d-56d2-43a0-b171-f0f7bd1de5a8] Attempting to driver detach volume 0591afae-0943-47b9-bcbe-9a0acee8f665 from mountpoint /dev/vdc
Oct 23 22:02:44 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-5f814920-0b5d-4fd1-8444-f2c859b279dd tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Attempting to detach device vdc from instance 6326434d-56d2-43a0-b171-f0f7bd1de5a8 from the persistent domain config. {{(pid=74337) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 22:02:44 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-5f814920-0b5d-4fd1-8444-f2c859b279dd tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 22:02:44 user nova-compute[74337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 22:02:44 user nova-compute[74337]:   <source dev="/dev/sdd"/>
Oct 23 22:02:44 user nova-compute[74337]:   <target dev="vdc" bus="virtio"/>
Oct 23 22:02:44 user nova-compute[74337]:   <serial>0591afae-0943-47b9-bcbe-9a0acee8f665</serial>
Oct 23 22:02:44 user nova-compute[74337]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 23 22:02:44 user nova-compute[74337]: </disk>
Oct 23 22:02:44 user nova-compute[74337]:  {{(pid=74337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 22:02:44 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-5f814920-0b5d-4fd1-8444-f2c859b279dd tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Successfully detached device vdc from instance 6326434d-56d2-43a0-b171-f0f7bd1de5a8 from the persistent domain config.
Oct 23 22:02:44 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-5f814920-0b5d-4fd1-8444-f2c859b279dd tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 6326434d-56d2-43a0-b171-f0f7bd1de5a8 from the live domain config. {{(pid=74337) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 22:02:44 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-5f814920-0b5d-4fd1-8444-f2c859b279dd tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 22:02:44 user nova-compute[74337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 22:02:44 user nova-compute[74337]:   <source dev="/dev/sdd"/>
Oct 23 22:02:44 user nova-compute[74337]:   <target dev="vdc" bus="virtio"/>
Oct 23 22:02:44 user nova-compute[74337]:   <serial>0591afae-0943-47b9-bcbe-9a0acee8f665</serial>
Oct 23 22:02:44 user nova-compute[74337]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 23 22:02:44 user nova-compute[74337]: </disk>
Oct 23 22:02:44 user nova-compute[74337]:  {{(pid=74337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 22:02:44 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-5f814920-0b5d-4fd1-8444-f2c859b279dd tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 6326434d-56d2-43a0-b171-f0f7bd1de5a8 {{(pid=74337) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 22:02:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:02:50 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:02:50 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:02:50 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 22:02:50 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 22:02:50 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 22:02:50 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:02:54 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:02:55 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:02:59 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2fe1d23b-c0f6-4d9c-910a-63c5309d1603 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] [instance: b7a67b37-36b4-42d4-a1a3-7e5d9896d948] Calling os-brick to attach iSCSI Volume {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 22:02:59 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fe1d23b-c0f6-4d9c-910a-63c5309d1603 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cf5a2fd9-1f24-4de7-a9eb-467593f66148', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DPBdHykl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 22:02:59 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-2fe1d23b-c0f6-4d9c-910a-63c5309d1603 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 22:02:59 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-2fe1d23b-c0f6-4d9c-910a-63c5309d1603 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 22:02:59 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-2fe1d23b-c0f6-4d9c-910a-63c5309d1603 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 22:02:59 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-2fe1d23b-c0f6-4d9c-910a-63c5309d1603 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 22:02:59 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-2fe1d23b-c0f6-4d9c-910a-63c5309d1603 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf5a2fd9-1f24-4de7-a9eb-467593f66148" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 22:02:59 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-2fe1d23b-c0f6-4d9c-910a-63c5309d1603 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf5a2fd9-1f24-4de7-a9eb-467593f66148" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 22:02:59 user nova-compute[74337]: INFO os_brick.initiator.connectors.iscsi [None req-2fe1d23b-c0f6-4d9c-910a-63c5309d1603 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 22:02:59 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf5a2fd9-1f24-4de7-a9eb-467593f66148 -p 172.16.0.220:3260 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:02:59 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf5a2fd9-1f24-4de7-a9eb-467593f66148 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:02:59 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[dda971fa-ce44-4c2a-a492-3889d44d0475]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:02:59 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fe1d23b-c0f6-4d9c-910a-63c5309d1603 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 22:02:59 user nova-compute[74337]:  {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:02:59 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf5a2fd9-1f24-4de7-a9eb-467593f66148 -p 172.16.0.220:3260 --interface default --op new {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:02:59 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf5a2fd9-1f24-4de7-a9eb-467593f66148 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:02:59 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbdc8979-3205-463a-bad3-b2a444f26940]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cf5a2fd9-1f24-4de7-a9eb-467593f66148] added\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:02:59 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fe1d23b-c0f6-4d9c-910a-63c5309d1603 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cf5a2fd9-1f24-4de7-a9eb-467593f66148] added
Oct 23 22:02:59 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:02:59 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf5a2fd9-1f24-4de7-a9eb-467593f66148 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:02:59 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf5a2fd9-1f24-4de7-a9eb-467593f66148 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:02:59 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[49121079-33ee-4212-a0d4-5aa018971727]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:02:59 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fe1d23b-c0f6-4d9c-910a-63c5309d1603 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:02:59 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf5a2fd9-1f24-4de7-a9eb-467593f66148 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:02:59 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf5a2fd9-1f24-4de7-a9eb-467593f66148 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:02:59 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e1a02f-7546-4fd9-a604-61a55362d22d]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:02:59 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fe1d23b-c0f6-4d9c-910a-63c5309d1603 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:02:59 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf5a2fd9-1f24-4de7-a9eb-467593f66148 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DPBdHykl {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:02:59 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf5a2fd9-1f24-4de7-a9eb-467593f66148 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DPBdHykl" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:02:59 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc2a1fa2-52fe-441e-8cda-e300d6624212]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:02:59 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fe1d23b-c0f6-4d9c-910a-63c5309d1603 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DPBdHykl'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:02:59 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf5a2fd9-1f24-4de7-a9eb-467593f66148 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:02:59 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf5a2fd9-1f24-4de7-a9eb-467593f66148 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:02:59 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[716bc760-702b-45d0-b59d-cd7c6ee68b95]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:02:59 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fe1d23b-c0f6-4d9c-910a-63c5309d1603 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:02:59 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:02:59 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:02:59 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d8af3c-9c18-477b-983b-ccdf0c9dec87]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5916c61-f2d0-4a31-9a25-8257b511640c (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfde0014-67b1-482f-9e27-dfb3d9c28026 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0591afae-0943-47b9-bcbe-9a0acee8f665 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:02:59 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fe1d23b-c0f6-4d9c-910a-63c5309d1603 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5916c61-f2d0-4a31-9a25-8257b511640c (non-flash)
Oct 23 22:02:59 user nova-compute[74337]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfde0014-67b1-482f-9e27-dfb3d9c28026 (non-flash)
Oct 23 22:02:59 user nova-compute[74337]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0591afae-0943-47b9-bcbe-9a0acee8f665 (non-flash)
Oct 23 22:02:59 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 22:02:59 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fe1d23b-c0f6-4d9c-910a-63c5309d1603 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5916c61-f2d0-4a31-9a25-8257b511640c (non-flash)
Oct 23 22:02:59 user nova-compute[74337]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfde0014-67b1-482f-9e27-dfb3d9c28026 (non-flash)
Oct 23 22:02:59 user nova-compute[74337]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0591afae-0943-47b9-bcbe-9a0acee8f665 (non-flash)
Oct 23 22:02:59 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 22:02:59 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf5a2fd9-1f24-4de7-a9eb-467593f66148 -p 172.16.0.220:3260 --login {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:02:59 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf5a2fd9-1f24-4de7-a9eb-467593f66148 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:02:59 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ea8e31-083e-4d69-816b-4dcc24aca9eb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cf5a2fd9-1f24-4de7-a9eb-467593f66148, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cf5a2fd9-1f24-4de7-a9eb-467593f66148, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:02:59 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fe1d23b-c0f6-4d9c-910a-63c5309d1603 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cf5a2fd9-1f24-4de7-a9eb-467593f66148, portal: 172.16.0.220,3260]
Oct 23 22:02:59 user nova-compute[74337]: Login to [iface: default, target: iqn.2010-10.org.openstack:cf5a2fd9-1f24-4de7-a9eb-467593f66148, portal: 172.16.0.220,3260] successful.
Oct 23 22:02:59 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:02:59 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf5a2fd9-1f24-4de7-a9eb-467593f66148 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:02:59 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf5a2fd9-1f24-4de7-a9eb-467593f66148 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:02:59 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7584ba5-42c4-478f-9db2-6ad14188d02b]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:02:59 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fe1d23b-c0f6-4d9c-910a-63c5309d1603 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:02:59 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:02:59 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:02:59 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c66cac-f560-48da-b51a-df76dd3e300c]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5916c61-f2d0-4a31-9a25-8257b511640c (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfde0014-67b1-482f-9e27-dfb3d9c28026 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0591afae-0943-47b9-bcbe-9a0acee8f665 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf5a2fd9-1f24-4de7-a9eb-467593f66148 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:02:59 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fe1d23b-c0f6-4d9c-910a-63c5309d1603 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5916c61-f2d0-4a31-9a25-8257b511640c (non-flash)
Oct 23 22:02:59 user nova-compute[74337]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfde0014-67b1-482f-9e27-dfb3d9c28026 (non-flash)
Oct 23 22:02:59 user nova-compute[74337]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0591afae-0943-47b9-bcbe-9a0acee8f665 (non-flash)
Oct 23 22:02:59 user nova-compute[74337]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf5a2fd9-1f24-4de7-a9eb-467593f66148 (non-flash)
Oct 23 22:02:59 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 22:02:59 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fe1d23b-c0f6-4d9c-910a-63c5309d1603 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5916c61-f2d0-4a31-9a25-8257b511640c (non-flash)
Oct 23 22:02:59 user nova-compute[74337]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfde0014-67b1-482f-9e27-dfb3d9c28026 (non-flash)
Oct 23 22:02:59 user nova-compute[74337]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0591afae-0943-47b9-bcbe-9a0acee8f665 (non-flash)
Oct 23 22:02:59 user nova-compute[74337]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf5a2fd9-1f24-4de7-a9eb-467593f66148 (non-flash)
Oct 23 22:02:59 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 22:02:59 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-2fe1d23b-c0f6-4d9c-910a-63c5309d1603 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf5a2fd9-1f24-4de7-a9eb-467593f66148" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 22:02:59 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fe1d23b-c0f6-4d9c-910a-63c5309d1603 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Connected to 172.16.0.220:3260 {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 22:02:59 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-2fe1d23b-c0f6-4d9c-910a-63c5309d1603 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] HCTL ('36', '-', '-', 0) found on session 47 with lun 0 {{(pid=74337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 22:02:59 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-2fe1d23b-c0f6-4d9c-910a-63c5309d1603 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 22:02:59 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:02:59 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:02:59 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[84722468-c624-4b85-a054-a40ed2953935]: (4, ('- - 0', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:02:59 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-2fe1d23b-c0f6-4d9c-910a-63c5309d1603 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Searching for a device in session 47 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 22:02:59 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fe1d23b-c0f6-4d9c-910a-63c5309d1603 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:cf5a2fd9-1f24-4de7-a9eb-467593f66148', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DPBdHykl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 22:03:00 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:03:00 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-2fe1d23b-c0f6-4d9c-910a-63c5309d1603 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 22:03:00 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fe1d23b-c0f6-4d9c-910a-63c5309d1603 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '23030653764343034', 'path': '/dev/sde'} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 22:03:00 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2fe1d23b-c0f6-4d9c-910a-63c5309d1603 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] [instance: b7a67b37-36b4-42d4-a1a3-7e5d9896d948] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23030653764343034', 'path': '/dev/sde'} {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 22:03:00 user nova-compute[74337]: DEBUG nova.objects.instance [None req-2fe1d23b-c0f6-4d9c-910a-63c5309d1603 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Lazy-loading 'flavor' on Instance uuid b7a67b37-36b4-42d4-a1a3-7e5d9896d948 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:03:00 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-2fe1d23b-c0f6-4d9c-910a-63c5309d1603 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 22:03:00 user nova-compute[74337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 22:03:00 user nova-compute[74337]:   <source dev="/dev/sde"/>
Oct 23 22:03:00 user nova-compute[74337]:   <target dev="vdb" bus="virtio"/>
Oct 23 22:03:00 user nova-compute[74337]:   <serial>cf5a2fd9-1f24-4de7-a9eb-467593f66148</serial>
Oct 23 22:03:00 user nova-compute[74337]: </disk>
Oct 23 22:03:00 user nova-compute[74337]:  {{(pid=74337) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 22:03:01 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-2fe1d23b-c0f6-4d9c-910a-63c5309d1603 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] No BDM found with device name vda, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 22:03:01 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-2fe1d23b-c0f6-4d9c-910a-63c5309d1603 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 22:03:01 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-2fe1d23b-c0f6-4d9c-910a-63c5309d1603 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] No VIF found with MAC fa:16:3e:d3:de:6c, not building metadata {{(pid=74337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 22:03:01 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-2fe1d23b-c0f6-4d9c-910a-63c5309d1603 tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Lock "b7a67b37-36b4-42d4-a1a3-7e5d9896d948" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.246s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:03:03 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-7048d6ff-46bb-47e2-83ba-52506eb5fddc tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Acquiring lock "b7a67b37-36b4-42d4-a1a3-7e5d9896d948" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:03:03 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-7048d6ff-46bb-47e2-83ba-52506eb5fddc tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Lock "b7a67b37-36b4-42d4-a1a3-7e5d9896d948" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:03:03 user nova-compute[74337]: INFO nova.compute.manager [None req-7048d6ff-46bb-47e2-83ba-52506eb5fddc tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] [instance: b7a67b37-36b4-42d4-a1a3-7e5d9896d948] Detaching volume cf5a2fd9-1f24-4de7-a9eb-467593f66148
Oct 23 22:03:03 user nova-compute[74337]: INFO nova.virt.block_device [None req-7048d6ff-46bb-47e2-83ba-52506eb5fddc tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] [instance: b7a67b37-36b4-42d4-a1a3-7e5d9896d948] Attempting to driver detach volume cf5a2fd9-1f24-4de7-a9eb-467593f66148 from mountpoint /dev/vdb
Oct 23 22:03:03 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-7048d6ff-46bb-47e2-83ba-52506eb5fddc tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Attempting to detach device vdb from instance b7a67b37-36b4-42d4-a1a3-7e5d9896d948 from the persistent domain config. {{(pid=74337) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 22:03:03 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-7048d6ff-46bb-47e2-83ba-52506eb5fddc tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 22:03:03 user nova-compute[74337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 22:03:03 user nova-compute[74337]:   <source dev="/dev/sde"/>
Oct 23 22:03:03 user nova-compute[74337]:   <target dev="vdb" bus="virtio"/>
Oct 23 22:03:03 user nova-compute[74337]:   <serial>cf5a2fd9-1f24-4de7-a9eb-467593f66148</serial>
Oct 23 22:03:03 user nova-compute[74337]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 22:03:03 user nova-compute[74337]: </disk>
Oct 23 22:03:03 user nova-compute[74337]:  {{(pid=74337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 22:03:03 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-7048d6ff-46bb-47e2-83ba-52506eb5fddc tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Successfully detached device vdb from instance b7a67b37-36b4-42d4-a1a3-7e5d9896d948 from the persistent domain config.
Oct 23 22:03:03 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-7048d6ff-46bb-47e2-83ba-52506eb5fddc tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b7a67b37-36b4-42d4-a1a3-7e5d9896d948 from the live domain config. {{(pid=74337) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 22:03:03 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-7048d6ff-46bb-47e2-83ba-52506eb5fddc tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 22:03:03 user nova-compute[74337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 22:03:03 user nova-compute[74337]:   <source dev="/dev/sde"/>
Oct 23 22:03:03 user nova-compute[74337]:   <target dev="vdb" bus="virtio"/>
Oct 23 22:03:03 user nova-compute[74337]:   <serial>cf5a2fd9-1f24-4de7-a9eb-467593f66148</serial>
Oct 23 22:03:03 user nova-compute[74337]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 22:03:03 user nova-compute[74337]: </disk>
Oct 23 22:03:03 user nova-compute[74337]:  {{(pid=74337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 22:03:03 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-7048d6ff-46bb-47e2-83ba-52506eb5fddc tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b7a67b37-36b4-42d4-a1a3-7e5d9896d948 {{(pid=74337) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 22:03:04 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-5f814920-0b5d-4fd1-8444-f2c859b279dd tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 6326434d-56d2-43a0-b171-f0f7bd1de5a8 is timed out.
Oct 23 22:03:04 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-5f814920-0b5d-4fd1-8444-f2c859b279dd tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Successfully detached device vdc from instance 6326434d-56d2-43a0-b171-f0f7bd1de5a8 from the live domain config.
Oct 23 22:03:04 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f814920-0b5d-4fd1-8444-f2c859b279dd tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] [instance: 6326434d-56d2-43a0-b171-f0f7bd1de5a8] calling os-brick to detach iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 22:03:04 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f814920-0b5d-4fd1-8444-f2c859b279dd tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, {'target_iqn': 'iqn.2010-10.org.openstack:0591afae-0943-47b9-bcbe-9a0acee8f665', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PFGkgYVp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 22:03:04 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-5f814920-0b5d-4fd1-8444-f2c859b279dd tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 22:03:04 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-5f814920-0b5d-4fd1-8444-f2c859b279dd tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 22:03:04 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-5f814920-0b5d-4fd1-8444-f2c859b279dd tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 22:03:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:03:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:03:05 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a707b35f-e8a7-4002-9403-529aad9e6467]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f5916c61-f2d0-4a31-9a25-8257b511640c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0591afae-0943-47b9-bcbe-9a0acee8f665\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bfde0014-67b1-482f-9e27-dfb3d9c28026\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cf5a2fd9-1f24-4de7-a9eb-467593f66148\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:03:05 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f814920-0b5d-4fd1-8444-f2c859b279dd tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 22:03:05 user nova-compute[74337]: No targets found.
Oct 23 22:03:05 user nova-compute[74337]: iSNS:
Oct 23 22:03:05 user nova-compute[74337]: No targets found.
Oct 23 22:03:05 user nova-compute[74337]: STATIC:
Oct 23 22:03:05 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:f5916c61-f2d0-4a31-9a25-8257b511640c
Oct 23 22:03:05 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 22:03:05 user nova-compute[74337]:                 Iface Name: default
Oct 23 22:03:05 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:0591afae-0943-47b9-bcbe-9a0acee8f665
Oct 23 22:03:05 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 22:03:05 user nova-compute[74337]:                 Iface Name: default
Oct 23 22:03:05 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:bfde0014-67b1-482f-9e27-dfb3d9c28026
Oct 23 22:03:05 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 22:03:05 user nova-compute[74337]:                 Iface Name: default
Oct 23 22:03:05 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:cf5a2fd9-1f24-4de7-a9eb-467593f66148
Oct 23 22:03:05 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 22:03:05 user nova-compute[74337]:                 Iface Name: default
Oct 23 22:03:05 user nova-compute[74337]: FIRMWARE:
Oct 23 22:03:05 user nova-compute[74337]: No targets found.
Oct 23 22:03:05 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 22:03:05 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f814920-0b5d-4fd1-8444-f2c859b279dd tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 22:03:05 user nova-compute[74337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 22:03:05 user nova-compute[74337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 22:03:05 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f814920-0b5d-4fd1-8444-f2c859b279dd tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0591afae-0943-47b9-bcbe-9a0acee8f665', 0)] {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 22:03:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:03:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:03:05 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ce5321-b025-4886-b85c-1797b232aa11]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0591afae-0943-47b9-bcbe-9a0acee8f665\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bfde0014-67b1-482f-9e27-dfb3d9c28026\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf5a2fd9-1f24-4de7-a9eb-467593f66148\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5916c61-f2d0-4a31-9a25-8257b511640c\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:03:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:03:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:03:05 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4248efb-2db4-4333-898f-1cbc2d1721e6]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5916c61-f2d0-4a31-9a25-8257b511640c (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfde0014-67b1-482f-9e27-dfb3d9c28026 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0591afae-0943-47b9-bcbe-9a0acee8f665 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf5a2fd9-1f24-4de7-a9eb-467593f66148 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:03:05 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f814920-0b5d-4fd1-8444-f2c859b279dd tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5916c61-f2d0-4a31-9a25-8257b511640c (non-flash)
Oct 23 22:03:05 user nova-compute[74337]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfde0014-67b1-482f-9e27-dfb3d9c28026 (non-flash)
Oct 23 22:03:05 user nova-compute[74337]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0591afae-0943-47b9-bcbe-9a0acee8f665 (non-flash)
Oct 23 22:03:05 user nova-compute[74337]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf5a2fd9-1f24-4de7-a9eb-467593f66148 (non-flash)
Oct 23 22:03:05 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 22:03:05 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f814920-0b5d-4fd1-8444-f2c859b279dd tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5916c61-f2d0-4a31-9a25-8257b511640c (non-flash)
Oct 23 22:03:05 user nova-compute[74337]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfde0014-67b1-482f-9e27-dfb3d9c28026 (non-flash)
Oct 23 22:03:05 user nova-compute[74337]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0591afae-0943-47b9-bcbe-9a0acee8f665 (non-flash)
Oct 23 22:03:05 user nova-compute[74337]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf5a2fd9-1f24-4de7-a9eb-467593f66148 (non-flash)
Oct 23 22:03:05 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 22:03:05 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f814920-0b5d-4fd1-8444-f2c859b279dd tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5ef41476d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0591afae-0943-47b9-bcbe-9a0acee8f665'): ({'sdd'}, set())}) {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 22:03:05 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-5f814920-0b5d-4fd1-8444-f2c859b279dd tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Removing single pathed devices sdd {{(pid=74337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 22:03:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:03:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:03:05 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a51ad540-8650-4288-8452-69c0270788e4]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:03:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:03:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:03:05 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[864c9549-1043-4d3e-a042-0e143d769385]: (4, ('ok\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:03:05 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-5f814920-0b5d-4fd1-8444-f2c859b279dd tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Flushing IO for device /dev/sdd {{(pid=74337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 22:03:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:03:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:03:05 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3f1d1a3-5ad6-443f-93dd-14a07bf6f842]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:03:05 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-5f814920-0b5d-4fd1-8444-f2c859b279dd tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 22:03:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:03:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:03:05 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeca60cc-ed6b-4e68-95ef-827bb31a4d9d]: (4, ('1', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:03:05 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-5f814920-0b5d-4fd1-8444-f2c859b279dd tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 22:03:05 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-5f814920-0b5d-4fd1-8444-f2c859b279dd tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] SCSI volumes sdd have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 22:03:05 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f814920-0b5d-4fd1-8444-f2c859b279dd tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0591afae-0943-47b9-bcbe-9a0acee8f665')] {{(pid=74337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 22:03:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0591afae-0943-47b9-bcbe-9a0acee8f665 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:03:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0591afae-0943-47b9-bcbe-9a0acee8f665 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:03:05 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbbf3270-f886-4925-a432-9f202c35dc94]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:03:05 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f814920-0b5d-4fd1-8444-f2c859b279dd tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:03:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0591afae-0943-47b9-bcbe-9a0acee8f665 -p 172.16.0.220:3260 --logout {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:03:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0591afae-0943-47b9-bcbe-9a0acee8f665 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:03:05 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e624ec-a1a8-416a-a85b-59842973ca40]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:0591afae-0943-47b9-bcbe-9a0acee8f665, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:0591afae-0943-47b9-bcbe-9a0acee8f665, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:03:05 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f814920-0b5d-4fd1-8444-f2c859b279dd tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:0591afae-0943-47b9-bcbe-9a0acee8f665, portal: 172.16.0.220,3260]
Oct 23 22:03:05 user nova-compute[74337]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:0591afae-0943-47b9-bcbe-9a0acee8f665, portal: 172.16.0.220,3260] successful.
Oct 23 22:03:05 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:03:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0591afae-0943-47b9-bcbe-9a0acee8f665 -p 172.16.0.220:3260 --op delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:03:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0591afae-0943-47b9-bcbe-9a0acee8f665 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:03:05 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[5faf0f31-25e6-47ca-8e1a-b751ecf9e488]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:03:05 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f814920-0b5d-4fd1-8444-f2c859b279dd tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:03:05 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-5f814920-0b5d-4fd1-8444-f2c859b279dd tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 22:03:05 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f814920-0b5d-4fd1-8444-f2c859b279dd tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] <== disconnect_volume: return (285ms) None {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 22:03:05 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f814920-0b5d-4fd1-8444-f2c859b279dd tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] [instance: 6326434d-56d2-43a0-b171-f0f7bd1de5a8] Disconnected iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 22:03:05 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:03:06 user nova-compute[74337]: DEBUG nova.objects.instance [None req-5f814920-0b5d-4fd1-8444-f2c859b279dd tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Lazy-loading 'flavor' on Instance uuid 6326434d-56d2-43a0-b171-f0f7bd1de5a8 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:03:06 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-5f814920-0b5d-4fd1-8444-f2c859b279dd tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Lock "6326434d-56d2-43a0-b171-f0f7bd1de5a8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.653s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:03:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:03:10 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:03:15 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:03:15 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:03:15 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 22:03:15 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 22:03:15 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 22:03:15 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:03:18 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:03:20 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:03:20 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:03:20 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 22:03:21 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:03:21 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:03:22 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:03:22 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:03:23 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:03:23 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-7048d6ff-46bb-47e2-83ba-52506eb5fddc tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b7a67b37-36b4-42d4-a1a3-7e5d9896d948 is timed out.
Oct 23 22:03:23 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-7048d6ff-46bb-47e2-83ba-52506eb5fddc tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Successfully detached device vdb from instance b7a67b37-36b4-42d4-a1a3-7e5d9896d948 from the live domain config.
Oct 23 22:03:23 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7048d6ff-46bb-47e2-83ba-52506eb5fddc tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] [instance: b7a67b37-36b4-42d4-a1a3-7e5d9896d948] calling os-brick to detach iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 22:03:23 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-7048d6ff-46bb-47e2-83ba-52506eb5fddc tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, {'target_iqn': 'iqn.2010-10.org.openstack:cf5a2fd9-1f24-4de7-a9eb-467593f66148', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DPBdHykl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 22:03:23 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-7048d6ff-46bb-47e2-83ba-52506eb5fddc tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 22:03:23 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-7048d6ff-46bb-47e2-83ba-52506eb5fddc tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 22:03:23 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-7048d6ff-46bb-47e2-83ba-52506eb5fddc tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 22:03:23 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:03:23 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:03:23 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d23f2f7c-04a7-4008-a43f-76abb2f768ea]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f5916c61-f2d0-4a31-9a25-8257b511640c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bfde0014-67b1-482f-9e27-dfb3d9c28026\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cf5a2fd9-1f24-4de7-a9eb-467593f66148\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:03:23 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-7048d6ff-46bb-47e2-83ba-52506eb5fddc tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 22:03:23 user nova-compute[74337]: No targets found.
Oct 23 22:03:23 user nova-compute[74337]: iSNS:
Oct 23 22:03:23 user nova-compute[74337]: No targets found.
Oct 23 22:03:23 user nova-compute[74337]: STATIC:
Oct 23 22:03:23 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:f5916c61-f2d0-4a31-9a25-8257b511640c
Oct 23 22:03:23 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 22:03:23 user nova-compute[74337]:                 Iface Name: default
Oct 23 22:03:23 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:bfde0014-67b1-482f-9e27-dfb3d9c28026
Oct 23 22:03:23 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 22:03:23 user nova-compute[74337]:                 Iface Name: default
Oct 23 22:03:23 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:cf5a2fd9-1f24-4de7-a9eb-467593f66148
Oct 23 22:03:23 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 22:03:23 user nova-compute[74337]:                 Iface Name: default
Oct 23 22:03:23 user nova-compute[74337]: FIRMWARE:
Oct 23 22:03:23 user nova-compute[74337]: No targets found.
Oct 23 22:03:23 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 22:03:23 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-7048d6ff-46bb-47e2-83ba-52506eb5fddc tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 22:03:23 user nova-compute[74337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 22:03:23 user nova-compute[74337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 22:03:23 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-7048d6ff-46bb-47e2-83ba-52506eb5fddc tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf5a2fd9-1f24-4de7-a9eb-467593f66148', 0)] {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 22:03:23 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:03:23 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:03:23 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[534f7aa7-fd3d-45b2-92bb-296a2194d954]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bfde0014-67b1-482f-9e27-dfb3d9c28026\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf5a2fd9-1f24-4de7-a9eb-467593f66148\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5916c61-f2d0-4a31-9a25-8257b511640c\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:03:23 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:03:23 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:03:23 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea247196-fbcc-4097-b8cd-9f2c811dc7be]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5916c61-f2d0-4a31-9a25-8257b511640c (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfde0014-67b1-482f-9e27-dfb3d9c28026 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf5a2fd9-1f24-4de7-a9eb-467593f66148 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:03:23 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-7048d6ff-46bb-47e2-83ba-52506eb5fddc tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5916c61-f2d0-4a31-9a25-8257b511640c (non-flash)
Oct 23 22:03:23 user nova-compute[74337]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfde0014-67b1-482f-9e27-dfb3d9c28026 (non-flash)
Oct 23 22:03:23 user nova-compute[74337]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf5a2fd9-1f24-4de7-a9eb-467593f66148 (non-flash)
Oct 23 22:03:23 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 22:03:23 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-7048d6ff-46bb-47e2-83ba-52506eb5fddc tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5916c61-f2d0-4a31-9a25-8257b511640c (non-flash)
Oct 23 22:03:23 user nova-compute[74337]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfde0014-67b1-482f-9e27-dfb3d9c28026 (non-flash)
Oct 23 22:03:23 user nova-compute[74337]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf5a2fd9-1f24-4de7-a9eb-467593f66148 (non-flash)
Oct 23 22:03:23 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 22:03:23 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-7048d6ff-46bb-47e2-83ba-52506eb5fddc tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5eec386440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf5a2fd9-1f24-4de7-a9eb-467593f66148'): ({'sde'}, set())}) {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 22:03:23 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-7048d6ff-46bb-47e2-83ba-52506eb5fddc tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Removing single pathed devices sde {{(pid=74337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 22:03:23 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:03:23 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:03:23 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[05f4f5c4-efe1-4a29-a5ea-9f0b19d68691]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:03:23 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:03:23 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:03:23 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fd80883-feab-41c6-94d2-30515730f7e1]: (4, ('ok\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:03:23 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-7048d6ff-46bb-47e2-83ba-52506eb5fddc tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Flushing IO for device /dev/sde {{(pid=74337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 22:03:23 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:03:23 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:03:23 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cab57a5-d3ad-4970-8bb5-a2eb5ee30e56]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:03:23 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-7048d6ff-46bb-47e2-83ba-52506eb5fddc tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 22:03:23 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:03:23 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.032s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:03:23 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[f679c174-1383-48b9-aa6f-8c066d6ef870]: (4, ('1', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:03:23 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-7048d6ff-46bb-47e2-83ba-52506eb5fddc tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 22:03:23 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-7048d6ff-46bb-47e2-83ba-52506eb5fddc tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] SCSI volumes sde have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 22:03:23 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-7048d6ff-46bb-47e2-83ba-52506eb5fddc tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf5a2fd9-1f24-4de7-a9eb-467593f66148')] {{(pid=74337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 22:03:23 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf5a2fd9-1f24-4de7-a9eb-467593f66148 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:03:23 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf5a2fd9-1f24-4de7-a9eb-467593f66148 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:03:23 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d571e9fa-ba4f-478f-b293-fc7b9a3f0cb7]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:03:23 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-7048d6ff-46bb-47e2-83ba-52506eb5fddc tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:03:23 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf5a2fd9-1f24-4de7-a9eb-467593f66148 -p 172.16.0.220:3260 --logout {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:03:23 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf5a2fd9-1f24-4de7-a9eb-467593f66148 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:03:23 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1350689-7c61-4527-9329-8fa1b4ff7b47]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:cf5a2fd9-1f24-4de7-a9eb-467593f66148, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:cf5a2fd9-1f24-4de7-a9eb-467593f66148, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:03:23 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-7048d6ff-46bb-47e2-83ba-52506eb5fddc tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:cf5a2fd9-1f24-4de7-a9eb-467593f66148, portal: 172.16.0.220,3260]
Oct 23 22:03:23 user nova-compute[74337]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:cf5a2fd9-1f24-4de7-a9eb-467593f66148, portal: 172.16.0.220,3260] successful.
Oct 23 22:03:23 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:03:23 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf5a2fd9-1f24-4de7-a9eb-467593f66148 -p 172.16.0.220:3260 --op delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:03:23 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf5a2fd9-1f24-4de7-a9eb-467593f66148 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:03:23 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[36d9b7b5-27a4-4260-94f4-935d7931c08a]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:03:23 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-7048d6ff-46bb-47e2-83ba-52506eb5fddc tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:03:23 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-7048d6ff-46bb-47e2-83ba-52506eb5fddc tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.277s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 22:03:23 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-7048d6ff-46bb-47e2-83ba-52506eb5fddc tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] <== disconnect_volume: return (279ms) None {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 22:03:23 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7048d6ff-46bb-47e2-83ba-52506eb5fddc tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] [instance: b7a67b37-36b4-42d4-a1a3-7e5d9896d948] Disconnected iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 22:03:24 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:03:24 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Starting heal instance info cache {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 22:03:24 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "refresh_cache-9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 22:03:24 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquired lock "refresh_cache-9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 22:03:24 user nova-compute[74337]: DEBUG nova.network.neutron [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] Forcefully refreshing network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 22:03:24 user nova-compute[74337]: DEBUG nova.objects.instance [None req-7048d6ff-46bb-47e2-83ba-52506eb5fddc tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Lazy-loading 'flavor' on Instance uuid b7a67b37-36b4-42d4-a1a3-7e5d9896d948 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:03:24 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-7048d6ff-46bb-47e2-83ba-52506eb5fddc tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Lock "b7a67b37-36b4-42d4-a1a3-7e5d9896d948" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.706s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:03:24 user nova-compute[74337]: DEBUG nova.network.neutron [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] Updating instance_info_cache with network_info: [{"id": "28c36a5b-ff7d-4426-9b09-6114a8c43fe5", "address": "fa:16:3e:df:42:15", "network": {"id": "0b1d82b0-acba-470e-aede-1c57a85a8ed3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1250228933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "965415a9973d4714aa49a64d34b232a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28c36a5b-ff", "ovs_interfaceid": "28c36a5b-ff7d-4426-9b09-6114a8c43fe5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 22:03:24 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Releasing lock "refresh_cache-9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 22:03:24 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] Updated the network info_cache for instance {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 22:03:25 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:03:26 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:03:26 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:03:26 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:03:26 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:03:26 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Auditing locally available compute resources for user (node: user) {{(pid=74337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 22:03:26 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/999843b2-b757-480b-bd21-bf281954bc46/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:03:26 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/999843b2-b757-480b-bd21-bf281954bc46/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:03:26 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/999843b2-b757-480b-bd21-bf281954bc46/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:03:26 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/999843b2-b757-480b-bd21-bf281954bc46/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:03:26 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6326434d-56d2-43a0-b171-f0f7bd1de5a8/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:03:27 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6326434d-56d2-43a0-b171-f0f7bd1de5a8/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:03:27 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6326434d-56d2-43a0-b171-f0f7bd1de5a8/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:03:27 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6326434d-56d2-43a0-b171-f0f7bd1de5a8/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:03:27 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 22:03:27 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7a67b37-36b4-42d4-a1a3-7e5d9896d948/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:03:27 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7a67b37-36b4-42d4-a1a3-7e5d9896d948/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:03:27 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7a67b37-36b4-42d4-a1a3-7e5d9896d948/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:03:27 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7a67b37-36b4-42d4-a1a3-7e5d9896d948/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:03:27 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk.rescue --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:03:27 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:03:27 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk.rescue --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:03:28 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:03:28 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:03:28 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:03:28 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:03:28 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:03:28 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:03:28 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:03:28 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:03:28 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:03:28 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 22:03:29 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:03:29 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:03:29 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Hypervisor/Node resource view: name=user free_ram=8218MB free_disk=25.156986236572266GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 22:03:29 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:03:29 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:03:29 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 0323b854-c7a1-42e8-ad85-1e929caa6e9d has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Oct 23 22:03:29 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 999843b2-b757-480b-bd21-bf281954bc46 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 22:03:29 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 27710919-a717-42fa-a436-a261d92c1c2a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 22:03:29 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 22:03:29 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 6326434d-56d2-43a0-b171-f0f7bd1de5a8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 22:03:29 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance b7a67b37-36b4-42d4-a1a3-7e5d9896d948 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 22:03:29 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 22:03:29 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 22:03:29 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 22:03:29 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 22:03:29 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Compute_service record updated for user:user {{(pid=74337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 22:03:29 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.364s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:03:30 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:03:30 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:03:34 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:03:34 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-3d95ae9e-0fbf-4cec-a108-73b165d7ded5 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Acquiring lock "6326434d-56d2-43a0-b171-f0f7bd1de5a8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:03:34 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-3d95ae9e-0fbf-4cec-a108-73b165d7ded5 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Lock "6326434d-56d2-43a0-b171-f0f7bd1de5a8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:03:35 user nova-compute[74337]: INFO nova.compute.manager [None req-3d95ae9e-0fbf-4cec-a108-73b165d7ded5 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] [instance: 6326434d-56d2-43a0-b171-f0f7bd1de5a8] Detaching volume bfde0014-67b1-482f-9e27-dfb3d9c28026
Oct 23 22:03:35 user nova-compute[74337]: INFO nova.virt.block_device [None req-3d95ae9e-0fbf-4cec-a108-73b165d7ded5 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] [instance: 6326434d-56d2-43a0-b171-f0f7bd1de5a8] Attempting to driver detach volume bfde0014-67b1-482f-9e27-dfb3d9c28026 from mountpoint /dev/vdb
Oct 23 22:03:35 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-3d95ae9e-0fbf-4cec-a108-73b165d7ded5 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Attempting to detach device vdb from instance 6326434d-56d2-43a0-b171-f0f7bd1de5a8 from the persistent domain config. {{(pid=74337) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 22:03:35 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-3d95ae9e-0fbf-4cec-a108-73b165d7ded5 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 22:03:35 user nova-compute[74337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 22:03:35 user nova-compute[74337]:   <source dev="/dev/sdc"/>
Oct 23 22:03:35 user nova-compute[74337]:   <target dev="vdb" bus="virtio"/>
Oct 23 22:03:35 user nova-compute[74337]:   <serial>bfde0014-67b1-482f-9e27-dfb3d9c28026</serial>
Oct 23 22:03:35 user nova-compute[74337]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 22:03:35 user nova-compute[74337]: </disk>
Oct 23 22:03:35 user nova-compute[74337]:  {{(pid=74337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 22:03:35 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-3d95ae9e-0fbf-4cec-a108-73b165d7ded5 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Successfully detached device vdb from instance 6326434d-56d2-43a0-b171-f0f7bd1de5a8 from the persistent domain config.
Oct 23 22:03:35 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-3d95ae9e-0fbf-4cec-a108-73b165d7ded5 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6326434d-56d2-43a0-b171-f0f7bd1de5a8 from the live domain config. {{(pid=74337) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 22:03:35 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-3d95ae9e-0fbf-4cec-a108-73b165d7ded5 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 22:03:35 user nova-compute[74337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 22:03:35 user nova-compute[74337]:   <source dev="/dev/sdc"/>
Oct 23 22:03:35 user nova-compute[74337]:   <target dev="vdb" bus="virtio"/>
Oct 23 22:03:35 user nova-compute[74337]:   <serial>bfde0014-67b1-482f-9e27-dfb3d9c28026</serial>
Oct 23 22:03:35 user nova-compute[74337]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 22:03:35 user nova-compute[74337]: </disk>
Oct 23 22:03:35 user nova-compute[74337]:  {{(pid=74337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 22:03:35 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:03:35 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-3d95ae9e-0fbf-4cec-a108-73b165d7ded5 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6326434d-56d2-43a0-b171-f0f7bd1de5a8 {{(pid=74337) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 22:03:40 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:03:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:03:50 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:03:54 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:03:54 user nova-compute[74337]: DEBUG nova.compute.manager [req-b874db2c-b190-49bc-9950-6ce25d9018c9 req-bfc0bf5c-5c93-4589-96b2-99418b1a64ef service nova] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] Received event network-changed-28c36a5b-ff7d-4426-9b09-6114a8c43fe5 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:03:54 user nova-compute[74337]: DEBUG nova.compute.manager [req-b874db2c-b190-49bc-9950-6ce25d9018c9 req-bfc0bf5c-5c93-4589-96b2-99418b1a64ef service nova] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] Refreshing instance network info cache due to event network-changed-28c36a5b-ff7d-4426-9b09-6114a8c43fe5. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 22:03:54 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-b874db2c-b190-49bc-9950-6ce25d9018c9 req-bfc0bf5c-5c93-4589-96b2-99418b1a64ef service nova] Acquiring lock "refresh_cache-9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 22:03:54 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-b874db2c-b190-49bc-9950-6ce25d9018c9 req-bfc0bf5c-5c93-4589-96b2-99418b1a64ef service nova] Acquired lock "refresh_cache-9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 22:03:54 user nova-compute[74337]: DEBUG nova.network.neutron [req-b874db2c-b190-49bc-9950-6ce25d9018c9 req-bfc0bf5c-5c93-4589-96b2-99418b1a64ef service nova] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] Refreshing network info cache for port 28c36a5b-ff7d-4426-9b09-6114a8c43fe5 {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 22:03:54 user nova-compute[74337]: DEBUG nova.network.neutron [req-b874db2c-b190-49bc-9950-6ce25d9018c9 req-bfc0bf5c-5c93-4589-96b2-99418b1a64ef service nova] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] Updated VIF entry in instance network info cache for port 28c36a5b-ff7d-4426-9b09-6114a8c43fe5. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 22:03:54 user nova-compute[74337]: DEBUG nova.network.neutron [req-b874db2c-b190-49bc-9950-6ce25d9018c9 req-bfc0bf5c-5c93-4589-96b2-99418b1a64ef service nova] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] Updating instance_info_cache with network_info: [{"id": "28c36a5b-ff7d-4426-9b09-6114a8c43fe5", "address": "fa:16:3e:df:42:15", "network": {"id": "0b1d82b0-acba-470e-aede-1c57a85a8ed3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1250228933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "965415a9973d4714aa49a64d34b232a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28c36a5b-ff", "ovs_interfaceid": "28c36a5b-ff7d-4426-9b09-6114a8c43fe5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 22:03:54 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-b874db2c-b190-49bc-9950-6ce25d9018c9 req-bfc0bf5c-5c93-4589-96b2-99418b1a64ef service nova] Releasing lock "refresh_cache-9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 22:03:55 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:03:55 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-e7b66ff0-8be4-49fb-b84b-7152d73b8097 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Acquiring lock "9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:03:55 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-e7b66ff0-8be4-49fb-b84b-7152d73b8097 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Lock "9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:03:55 user nova-compute[74337]: INFO nova.compute.manager [None req-e7b66ff0-8be4-49fb-b84b-7152d73b8097 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] Detaching volume f5916c61-f2d0-4a31-9a25-8257b511640c
Oct 23 22:03:55 user nova-compute[74337]: INFO nova.virt.block_device [None req-e7b66ff0-8be4-49fb-b84b-7152d73b8097 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] Attempting to driver detach volume f5916c61-f2d0-4a31-9a25-8257b511640c from mountpoint /dev/vdb
Oct 23 22:03:55 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-e7b66ff0-8be4-49fb-b84b-7152d73b8097 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Attempting to detach device vdb from instance 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c from the persistent domain config. {{(pid=74337) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 22:03:55 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-e7b66ff0-8be4-49fb-b84b-7152d73b8097 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 22:03:55 user nova-compute[74337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 22:03:55 user nova-compute[74337]:   <source dev="/dev/sdb"/>
Oct 23 22:03:55 user nova-compute[74337]:   <target dev="vdb" bus="virtio"/>
Oct 23 22:03:55 user nova-compute[74337]:   <serial>f5916c61-f2d0-4a31-9a25-8257b511640c</serial>
Oct 23 22:03:55 user nova-compute[74337]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 22:03:55 user nova-compute[74337]: </disk>
Oct 23 22:03:55 user nova-compute[74337]:  {{(pid=74337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 22:03:55 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-e7b66ff0-8be4-49fb-b84b-7152d73b8097 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Successfully detached device vdb from instance 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c from the persistent domain config.
Oct 23 22:03:55 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-e7b66ff0-8be4-49fb-b84b-7152d73b8097 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c from the live domain config. {{(pid=74337) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 22:03:55 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-e7b66ff0-8be4-49fb-b84b-7152d73b8097 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 22:03:55 user nova-compute[74337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 22:03:55 user nova-compute[74337]:   <source dev="/dev/sdb"/>
Oct 23 22:03:55 user nova-compute[74337]:   <target dev="vdb" bus="virtio"/>
Oct 23 22:03:55 user nova-compute[74337]:   <serial>f5916c61-f2d0-4a31-9a25-8257b511640c</serial>
Oct 23 22:03:55 user nova-compute[74337]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 22:03:55 user nova-compute[74337]: </disk>
Oct 23 22:03:55 user nova-compute[74337]:  {{(pid=74337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 22:03:55 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-3d95ae9e-0fbf-4cec-a108-73b165d7ded5 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6326434d-56d2-43a0-b171-f0f7bd1de5a8 is timed out.
Oct 23 22:03:55 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-3d95ae9e-0fbf-4cec-a108-73b165d7ded5 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Successfully detached device vdb from instance 6326434d-56d2-43a0-b171-f0f7bd1de5a8 from the live domain config.
Oct 23 22:03:55 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d95ae9e-0fbf-4cec-a108-73b165d7ded5 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] [instance: 6326434d-56d2-43a0-b171-f0f7bd1de5a8] calling os-brick to detach iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 22:03:55 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d95ae9e-0fbf-4cec-a108-73b165d7ded5 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, {'target_iqn': 'iqn.2010-10.org.openstack:bfde0014-67b1-482f-9e27-dfb3d9c28026', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NZkIgzot', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 22:03:55 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-3d95ae9e-0fbf-4cec-a108-73b165d7ded5 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 22:03:55 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-3d95ae9e-0fbf-4cec-a108-73b165d7ded5 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 22:03:55 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-3d95ae9e-0fbf-4cec-a108-73b165d7ded5 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 22:03:55 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:03:55 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:03:55 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[3411108d-53d8-44d0-be5b-7077a6e3dced]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f5916c61-f2d0-4a31-9a25-8257b511640c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bfde0014-67b1-482f-9e27-dfb3d9c28026\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:03:55 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d95ae9e-0fbf-4cec-a108-73b165d7ded5 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 22:03:55 user nova-compute[74337]: No targets found.
Oct 23 22:03:55 user nova-compute[74337]: iSNS:
Oct 23 22:03:55 user nova-compute[74337]: No targets found.
Oct 23 22:03:55 user nova-compute[74337]: STATIC:
Oct 23 22:03:55 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:f5916c61-f2d0-4a31-9a25-8257b511640c
Oct 23 22:03:55 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 22:03:55 user nova-compute[74337]:                 Iface Name: default
Oct 23 22:03:55 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:bfde0014-67b1-482f-9e27-dfb3d9c28026
Oct 23 22:03:55 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 22:03:55 user nova-compute[74337]:                 Iface Name: default
Oct 23 22:03:55 user nova-compute[74337]: FIRMWARE:
Oct 23 22:03:55 user nova-compute[74337]: No targets found.
Oct 23 22:03:55 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 22:03:55 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d95ae9e-0fbf-4cec-a108-73b165d7ded5 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 22:03:55 user nova-compute[74337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 22:03:55 user nova-compute[74337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 22:03:55 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d95ae9e-0fbf-4cec-a108-73b165d7ded5 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bfde0014-67b1-482f-9e27-dfb3d9c28026', 0)] {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 22:03:55 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:03:55 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:03:55 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b444a999-92c3-498c-9b7c-3b2fe81a4e67]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bfde0014-67b1-482f-9e27-dfb3d9c28026\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5916c61-f2d0-4a31-9a25-8257b511640c\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:03:55 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:03:55 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:03:55 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[8943c5b3-dca6-4b09-84db-9cc790a81fd8]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5916c61-f2d0-4a31-9a25-8257b511640c (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfde0014-67b1-482f-9e27-dfb3d9c28026 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:03:55 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d95ae9e-0fbf-4cec-a108-73b165d7ded5 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5916c61-f2d0-4a31-9a25-8257b511640c (non-flash)
Oct 23 22:03:55 user nova-compute[74337]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfde0014-67b1-482f-9e27-dfb3d9c28026 (non-flash)
Oct 23 22:03:55 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 22:03:55 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d95ae9e-0fbf-4cec-a108-73b165d7ded5 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5916c61-f2d0-4a31-9a25-8257b511640c (non-flash)
Oct 23 22:03:55 user nova-compute[74337]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfde0014-67b1-482f-9e27-dfb3d9c28026 (non-flash)
Oct 23 22:03:55 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 22:03:55 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d95ae9e-0fbf-4cec-a108-73b165d7ded5 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5ef4147640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bfde0014-67b1-482f-9e27-dfb3d9c28026'): ({'sdc'}, set())}) {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 22:03:55 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-3d95ae9e-0fbf-4cec-a108-73b165d7ded5 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Removing single pathed devices sdc {{(pid=74337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 22:03:55 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:03:55 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:03:55 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7c43191-1669-415c-8272-7b2883f4bcf4]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:03:55 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:03:55 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:03:55 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e05b0c-f615-4c5d-8cdd-26c52a2207d1]: (4, ('ok\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:03:55 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-3d95ae9e-0fbf-4cec-a108-73b165d7ded5 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Flushing IO for device /dev/sdc {{(pid=74337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 22:03:55 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:03:55 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:03:55 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2cc8b7f-bced-4a54-b8bd-f3561d308668]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:03:55 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-3d95ae9e-0fbf-4cec-a108-73b165d7ded5 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 22:03:55 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:03:55 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:03:55 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f1f1e3-3256-49f9-85e7-a4fdc461c01f]: (4, ('1', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:03:55 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-3d95ae9e-0fbf-4cec-a108-73b165d7ded5 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 22:03:55 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-3d95ae9e-0fbf-4cec-a108-73b165d7ded5 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] SCSI volumes sdc have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 22:03:55 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d95ae9e-0fbf-4cec-a108-73b165d7ded5 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bfde0014-67b1-482f-9e27-dfb3d9c28026')] {{(pid=74337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 22:03:55 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfde0014-67b1-482f-9e27-dfb3d9c28026 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:03:55 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfde0014-67b1-482f-9e27-dfb3d9c28026 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:03:55 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa7f0d3-0d10-484d-831d-8793589c0239]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:03:55 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d95ae9e-0fbf-4cec-a108-73b165d7ded5 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:03:55 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfde0014-67b1-482f-9e27-dfb3d9c28026 -p 172.16.0.220:3260 --logout {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:03:55 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfde0014-67b1-482f-9e27-dfb3d9c28026 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:03:55 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[add475ec-ed49-41d8-8ec3-d8174a3e5307]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:bfde0014-67b1-482f-9e27-dfb3d9c28026, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:bfde0014-67b1-482f-9e27-dfb3d9c28026, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:03:55 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d95ae9e-0fbf-4cec-a108-73b165d7ded5 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:bfde0014-67b1-482f-9e27-dfb3d9c28026, portal: 172.16.0.220,3260]
Oct 23 22:03:55 user nova-compute[74337]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:bfde0014-67b1-482f-9e27-dfb3d9c28026, portal: 172.16.0.220,3260] successful.
Oct 23 22:03:55 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:03:55 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfde0014-67b1-482f-9e27-dfb3d9c28026 -p 172.16.0.220:3260 --op delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:03:55 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfde0014-67b1-482f-9e27-dfb3d9c28026 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:03:55 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccdd01e3-0054-4cb3-92c1-67b5963de11f]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:03:55 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d95ae9e-0fbf-4cec-a108-73b165d7ded5 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:03:55 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-3d95ae9e-0fbf-4cec-a108-73b165d7ded5 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 22:03:55 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d95ae9e-0fbf-4cec-a108-73b165d7ded5 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] <== disconnect_volume: return (334ms) None {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 22:03:55 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d95ae9e-0fbf-4cec-a108-73b165d7ded5 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] [instance: 6326434d-56d2-43a0-b171-f0f7bd1de5a8] Disconnected iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 22:03:55 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-e7b66ff0-8be4-49fb-b84b-7152d73b8097 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c {{(pid=74337) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 22:03:56 user nova-compute[74337]: DEBUG nova.compute.manager [req-1f85cb83-4e49-4059-a76b-b2692cfc88fa req-4af8440b-678d-4a4e-9401-2fbfa336a852 service nova] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] Received event network-changed-28c36a5b-ff7d-4426-9b09-6114a8c43fe5 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:03:56 user nova-compute[74337]: DEBUG nova.compute.manager [req-1f85cb83-4e49-4059-a76b-b2692cfc88fa req-4af8440b-678d-4a4e-9401-2fbfa336a852 service nova] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] Refreshing instance network info cache due to event network-changed-28c36a5b-ff7d-4426-9b09-6114a8c43fe5. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 22:03:56 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-1f85cb83-4e49-4059-a76b-b2692cfc88fa req-4af8440b-678d-4a4e-9401-2fbfa336a852 service nova] Acquiring lock "refresh_cache-9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 22:03:56 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-1f85cb83-4e49-4059-a76b-b2692cfc88fa req-4af8440b-678d-4a4e-9401-2fbfa336a852 service nova] Acquired lock "refresh_cache-9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 22:03:56 user nova-compute[74337]: DEBUG nova.network.neutron [req-1f85cb83-4e49-4059-a76b-b2692cfc88fa req-4af8440b-678d-4a4e-9401-2fbfa336a852 service nova] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] Refreshing network info cache for port 28c36a5b-ff7d-4426-9b09-6114a8c43fe5 {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 22:03:56 user nova-compute[74337]: DEBUG nova.objects.instance [None req-3d95ae9e-0fbf-4cec-a108-73b165d7ded5 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Lazy-loading 'flavor' on Instance uuid 6326434d-56d2-43a0-b171-f0f7bd1de5a8 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:03:56 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-3d95ae9e-0fbf-4cec-a108-73b165d7ded5 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Lock "6326434d-56d2-43a0-b171-f0f7bd1de5a8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.803s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:03:56 user nova-compute[74337]: DEBUG nova.network.neutron [req-1f85cb83-4e49-4059-a76b-b2692cfc88fa req-4af8440b-678d-4a4e-9401-2fbfa336a852 service nova] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] Updated VIF entry in instance network info cache for port 28c36a5b-ff7d-4426-9b09-6114a8c43fe5. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 22:03:56 user nova-compute[74337]: DEBUG nova.network.neutron [req-1f85cb83-4e49-4059-a76b-b2692cfc88fa req-4af8440b-678d-4a4e-9401-2fbfa336a852 service nova] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] Updating instance_info_cache with network_info: [{"id": "28c36a5b-ff7d-4426-9b09-6114a8c43fe5", "address": "fa:16:3e:df:42:15", "network": {"id": "0b1d82b0-acba-470e-aede-1c57a85a8ed3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1250228933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "965415a9973d4714aa49a64d34b232a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28c36a5b-ff", "ovs_interfaceid": "28c36a5b-ff7d-4426-9b09-6114a8c43fe5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 22:03:56 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-1f85cb83-4e49-4059-a76b-b2692cfc88fa req-4af8440b-678d-4a4e-9401-2fbfa336a852 service nova] Releasing lock "refresh_cache-9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 22:03:58 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:04:00 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:04:05 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:04:05 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-294c7808-eaa0-4766-a322-0b1e7a37af8e tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Acquiring lock "b7a67b37-36b4-42d4-a1a3-7e5d9896d948" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:04:05 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-294c7808-eaa0-4766-a322-0b1e7a37af8e tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Lock "b7a67b37-36b4-42d4-a1a3-7e5d9896d948" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:04:05 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-294c7808-eaa0-4766-a322-0b1e7a37af8e tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Acquiring lock "b7a67b37-36b4-42d4-a1a3-7e5d9896d948-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:04:05 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-294c7808-eaa0-4766-a322-0b1e7a37af8e tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Lock "b7a67b37-36b4-42d4-a1a3-7e5d9896d948-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:04:05 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-294c7808-eaa0-4766-a322-0b1e7a37af8e tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Lock "b7a67b37-36b4-42d4-a1a3-7e5d9896d948-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:04:05 user nova-compute[74337]: INFO nova.compute.manager [None req-294c7808-eaa0-4766-a322-0b1e7a37af8e tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] [instance: b7a67b37-36b4-42d4-a1a3-7e5d9896d948] Terminating instance
Oct 23 22:04:05 user nova-compute[74337]: DEBUG nova.compute.manager [None req-294c7808-eaa0-4766-a322-0b1e7a37af8e tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] [instance: b7a67b37-36b4-42d4-a1a3-7e5d9896d948] Start destroying the instance on the hypervisor. {{(pid=74337) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 22:04:05 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:04:05 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:04:05 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:04:05 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:04:06 user nova-compute[74337]: DEBUG nova.compute.manager [req-969bea44-e216-4c1c-b5b8-6839796592f7 req-d37cc57e-84ec-4cd6-95aa-aa2760b0c756 service nova] [instance: b7a67b37-36b4-42d4-a1a3-7e5d9896d948] Received event network-vif-unplugged-35fea171-071b-4e56-8bb4-a4185a1e6da3 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:04:06 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-969bea44-e216-4c1c-b5b8-6839796592f7 req-d37cc57e-84ec-4cd6-95aa-aa2760b0c756 service nova] Acquiring lock "b7a67b37-36b4-42d4-a1a3-7e5d9896d948-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:04:06 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-969bea44-e216-4c1c-b5b8-6839796592f7 req-d37cc57e-84ec-4cd6-95aa-aa2760b0c756 service nova] Lock "b7a67b37-36b4-42d4-a1a3-7e5d9896d948-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:04:06 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-969bea44-e216-4c1c-b5b8-6839796592f7 req-d37cc57e-84ec-4cd6-95aa-aa2760b0c756 service nova] Lock "b7a67b37-36b4-42d4-a1a3-7e5d9896d948-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:04:06 user nova-compute[74337]: DEBUG nova.compute.manager [req-969bea44-e216-4c1c-b5b8-6839796592f7 req-d37cc57e-84ec-4cd6-95aa-aa2760b0c756 service nova] [instance: b7a67b37-36b4-42d4-a1a3-7e5d9896d948] No waiting events found dispatching network-vif-unplugged-35fea171-071b-4e56-8bb4-a4185a1e6da3 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 22:04:06 user nova-compute[74337]: DEBUG nova.compute.manager [req-969bea44-e216-4c1c-b5b8-6839796592f7 req-d37cc57e-84ec-4cd6-95aa-aa2760b0c756 service nova] [instance: b7a67b37-36b4-42d4-a1a3-7e5d9896d948] Received event network-vif-unplugged-35fea171-071b-4e56-8bb4-a4185a1e6da3 for instance with task_state deleting. {{(pid=74337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 22:04:06 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:04:06 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:04:06 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:04:06 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: b7a67b37-36b4-42d4-a1a3-7e5d9896d948] Instance destroyed successfully.
Oct 23 22:04:06 user nova-compute[74337]: DEBUG nova.objects.instance [None req-294c7808-eaa0-4766-a322-0b1e7a37af8e tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Lazy-loading 'resources' on Instance uuid b7a67b37-36b4-42d4-a1a3-7e5d9896d948 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:04:06 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:04:06 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-294c7808-eaa0-4766-a322-0b1e7a37af8e tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T22:00:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-550311047',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-550311047',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-5503110',id=45,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHlF2PNKbzrW2vMSs7/oFAAPXg77UNXSK1f4N7vZjuT0m5sk7VZ8HztHE49e0R95Q2tXzYgEReuiBKtnYfnPuRKvFSHbTWtDFSVgZqCBA9oR92jZjHDZbzyiVPukN3kTNw==',key_name='tempest-keypair-66739911',keypairs=<?>,launch_index=0,launched_at=2023-10-23T22:00:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b672a253930043eda6ea2b27559f15fb',ramdisk_id='',reservation_id='r-h37c30i0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-878947822',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T22:00:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d005925ecc004b1a9b63d24d9f753256',uuid=b7a67b37-36b4-42d4-a1a3-7e5d9896d948,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "35fea171-071b-4e56-8bb4-a4185a1e6da3", "address": "fa:16:3e:d3:de:6c", "network": {"id": "2afac13f-fb75-4d79-ae11-92c0c98e710f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-597086266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b672a253930043eda6ea2b27559f15fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35fea171-07", "ovs_interfaceid": "35fea171-071b-4e56-8bb4-a4185a1e6da3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 22:04:06 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-294c7808-eaa0-4766-a322-0b1e7a37af8e tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Converting VIF {"id": "35fea171-071b-4e56-8bb4-a4185a1e6da3", "address": "fa:16:3e:d3:de:6c", "network": {"id": "2afac13f-fb75-4d79-ae11-92c0c98e710f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-597086266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b672a253930043eda6ea2b27559f15fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35fea171-07", "ovs_interfaceid": "35fea171-071b-4e56-8bb4-a4185a1e6da3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 22:04:06 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-294c7808-eaa0-4766-a322-0b1e7a37af8e tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d3:de:6c,bridge_name='br-int',has_traffic_filtering=True,id=35fea171-071b-4e56-8bb4-a4185a1e6da3,network=Network(2afac13f-fb75-4d79-ae11-92c0c98e710f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35fea171-07') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 22:04:06 user nova-compute[74337]: DEBUG os_vif [None req-294c7808-eaa0-4766-a322-0b1e7a37af8e tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:de:6c,bridge_name='br-int',has_traffic_filtering=True,id=35fea171-071b-4e56-8bb4-a4185a1e6da3,network=Network(2afac13f-fb75-4d79-ae11-92c0c98e710f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35fea171-07') {{(pid=74337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 22:04:06 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:04:06 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap35fea171-07, bridge=br-int, if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:04:06 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:04:06 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:04:06 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:04:06 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3ebacb63-c131-4216-b8b2-703634da5119) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:04:06 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:04:06 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:04:06 user nova-compute[74337]: INFO os_vif [None req-294c7808-eaa0-4766-a322-0b1e7a37af8e tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:de:6c,bridge_name='br-int',has_traffic_filtering=True,id=35fea171-071b-4e56-8bb4-a4185a1e6da3,network=Network(2afac13f-fb75-4d79-ae11-92c0c98e710f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35fea171-07')
Oct 23 22:04:06 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-294c7808-eaa0-4766-a322-0b1e7a37af8e tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] [instance: b7a67b37-36b4-42d4-a1a3-7e5d9896d948] Deleting instance files /opt/stack/data/nova/instances/b7a67b37-36b4-42d4-a1a3-7e5d9896d948_del
Oct 23 22:04:06 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-294c7808-eaa0-4766-a322-0b1e7a37af8e tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] [instance: b7a67b37-36b4-42d4-a1a3-7e5d9896d948] Deletion of /opt/stack/data/nova/instances/b7a67b37-36b4-42d4-a1a3-7e5d9896d948_del complete
Oct 23 22:04:06 user nova-compute[74337]: INFO nova.compute.manager [None req-294c7808-eaa0-4766-a322-0b1e7a37af8e tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] [instance: b7a67b37-36b4-42d4-a1a3-7e5d9896d948] Took 1.18 seconds to destroy the instance on the hypervisor.
Oct 23 22:04:06 user nova-compute[74337]: DEBUG oslo.service.loopingcall [None req-294c7808-eaa0-4766-a322-0b1e7a37af8e tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74337) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 22:04:06 user nova-compute[74337]: DEBUG nova.compute.manager [-] [instance: b7a67b37-36b4-42d4-a1a3-7e5d9896d948] Deallocating network for instance {{(pid=74337) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 22:04:06 user nova-compute[74337]: DEBUG nova.network.neutron [-] [instance: b7a67b37-36b4-42d4-a1a3-7e5d9896d948] deallocate_for_instance() {{(pid=74337) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 22:04:07 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:04:07 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:04:07 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:04:07 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:04:07 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:04:07 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:04:07 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:04:07 user nova-compute[74337]: DEBUG nova.network.neutron [-] [instance: b7a67b37-36b4-42d4-a1a3-7e5d9896d948] Updating instance_info_cache with network_info: [] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 22:04:07 user nova-compute[74337]: INFO nova.compute.manager [-] [instance: b7a67b37-36b4-42d4-a1a3-7e5d9896d948] Took 1.00 seconds to deallocate network for instance.
Oct 23 22:04:07 user nova-compute[74337]: DEBUG nova.compute.manager [req-d3e6049a-66d7-4617-8505-7af336a2812c req-2a3cf5de-c3b1-4d60-949c-b7185c267064 service nova] [instance: b7a67b37-36b4-42d4-a1a3-7e5d9896d948] Received event network-vif-deleted-35fea171-071b-4e56-8bb4-a4185a1e6da3 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:04:07 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-294c7808-eaa0-4766-a322-0b1e7a37af8e tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:04:07 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-294c7808-eaa0-4766-a322-0b1e7a37af8e tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:04:07 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-294c7808-eaa0-4766-a322-0b1e7a37af8e tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 22:04:07 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-294c7808-eaa0-4766-a322-0b1e7a37af8e tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 22:04:08 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-294c7808-eaa0-4766-a322-0b1e7a37af8e tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.270s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:04:08 user nova-compute[74337]: INFO nova.scheduler.client.report [None req-294c7808-eaa0-4766-a322-0b1e7a37af8e tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Deleted allocations for instance b7a67b37-36b4-42d4-a1a3-7e5d9896d948
Oct 23 22:04:08 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-294c7808-eaa0-4766-a322-0b1e7a37af8e tempest-TestServerVolumeAttachScenarioOldVersion-878947822 tempest-TestServerVolumeAttachScenarioOldVersion-878947822-project-member] Lock "b7a67b37-36b4-42d4-a1a3-7e5d9896d948" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.685s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:04:08 user nova-compute[74337]: DEBUG nova.compute.manager [req-5b777b5e-490e-4821-9df0-e5efeb9e5625 req-0a1ae661-22d5-43b6-882e-1cbc42810f55 service nova] [instance: b7a67b37-36b4-42d4-a1a3-7e5d9896d948] Received event network-vif-plugged-35fea171-071b-4e56-8bb4-a4185a1e6da3 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:04:08 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-5b777b5e-490e-4821-9df0-e5efeb9e5625 req-0a1ae661-22d5-43b6-882e-1cbc42810f55 service nova] Acquiring lock "b7a67b37-36b4-42d4-a1a3-7e5d9896d948-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:04:08 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-5b777b5e-490e-4821-9df0-e5efeb9e5625 req-0a1ae661-22d5-43b6-882e-1cbc42810f55 service nova] Lock "b7a67b37-36b4-42d4-a1a3-7e5d9896d948-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:04:08 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-5b777b5e-490e-4821-9df0-e5efeb9e5625 req-0a1ae661-22d5-43b6-882e-1cbc42810f55 service nova] Lock "b7a67b37-36b4-42d4-a1a3-7e5d9896d948-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:04:08 user nova-compute[74337]: DEBUG nova.compute.manager [req-5b777b5e-490e-4821-9df0-e5efeb9e5625 req-0a1ae661-22d5-43b6-882e-1cbc42810f55 service nova] [instance: b7a67b37-36b4-42d4-a1a3-7e5d9896d948] No waiting events found dispatching network-vif-plugged-35fea171-071b-4e56-8bb4-a4185a1e6da3 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 22:04:08 user nova-compute[74337]: WARNING nova.compute.manager [req-5b777b5e-490e-4821-9df0-e5efeb9e5625 req-0a1ae661-22d5-43b6-882e-1cbc42810f55 service nova] [instance: b7a67b37-36b4-42d4-a1a3-7e5d9896d948] Received unexpected event network-vif-plugged-35fea171-071b-4e56-8bb4-a4185a1e6da3 for instance with vm_state deleted and task_state None.
Oct 23 22:04:11 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:04:12 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:04:15 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-e7b66ff0-8be4-49fb-b84b-7152d73b8097 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c is timed out.
Oct 23 22:04:15 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-e7b66ff0-8be4-49fb-b84b-7152d73b8097 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Successfully detached device vdb from instance 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c from the live domain config.
Oct 23 22:04:15 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7b66ff0-8be4-49fb-b84b-7152d73b8097 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] calling os-brick to detach iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 22:04:15 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7b66ff0-8be4-49fb-b84b-7152d73b8097 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, {'target_iqn': 'iqn.2010-10.org.openstack:f5916c61-f2d0-4a31-9a25-8257b511640c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QovGuwyM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 22:04:15 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-e7b66ff0-8be4-49fb-b84b-7152d73b8097 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 22:04:15 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-e7b66ff0-8be4-49fb-b84b-7152d73b8097 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 22:04:15 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-e7b66ff0-8be4-49fb-b84b-7152d73b8097 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 22:04:15 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:04:16 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:04:16 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b9da2e-2ad6-470a-8594-39a63ff7508e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f5916c61-f2d0-4a31-9a25-8257b511640c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55d30111-9aea-4023-984b-3ff03b9dd0a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:04:16 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7b66ff0-8be4-49fb-b84b-7152d73b8097 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 22:04:16 user nova-compute[74337]: No targets found.
Oct 23 22:04:16 user nova-compute[74337]: iSNS:
Oct 23 22:04:16 user nova-compute[74337]: No targets found.
Oct 23 22:04:16 user nova-compute[74337]: STATIC:
Oct 23 22:04:16 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:f5916c61-f2d0-4a31-9a25-8257b511640c
Oct 23 22:04:16 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 22:04:16 user nova-compute[74337]:                 Iface Name: default
Oct 23 22:04:16 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:55d30111-9aea-4023-984b-3ff03b9dd0a6
Oct 23 22:04:16 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 22:04:16 user nova-compute[74337]:                 Iface Name: default
Oct 23 22:04:16 user nova-compute[74337]: FIRMWARE:
Oct 23 22:04:16 user nova-compute[74337]: No targets found.
Oct 23 22:04:16 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 22:04:16 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7b66ff0-8be4-49fb-b84b-7152d73b8097 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 22:04:16 user nova-compute[74337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 22:04:16 user nova-compute[74337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 22:04:16 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7b66ff0-8be4-49fb-b84b-7152d73b8097 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f5916c61-f2d0-4a31-9a25-8257b511640c', 0)] {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 22:04:16 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:04:16 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:04:16 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a29a959-5fae-450b-99af-be6d9ac19801]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55d30111-9aea-4023-984b-3ff03b9dd0a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5916c61-f2d0-4a31-9a25-8257b511640c\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:04:16 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:04:16 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:04:16 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3403f22-d207-4d05-87ff-489f84655b3c]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5916c61-f2d0-4a31-9a25-8257b511640c (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d30111-9aea-4023-984b-3ff03b9dd0a6 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:04:16 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7b66ff0-8be4-49fb-b84b-7152d73b8097 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5916c61-f2d0-4a31-9a25-8257b511640c (non-flash)
Oct 23 22:04:16 user nova-compute[74337]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d30111-9aea-4023-984b-3ff03b9dd0a6 (non-flash)
Oct 23 22:04:16 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 22:04:16 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7b66ff0-8be4-49fb-b84b-7152d73b8097 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5916c61-f2d0-4a31-9a25-8257b511640c (non-flash)
Oct 23 22:04:16 user nova-compute[74337]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d30111-9aea-4023-984b-3ff03b9dd0a6 (non-flash)
Oct 23 22:04:16 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 22:04:16 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7b66ff0-8be4-49fb-b84b-7152d73b8097 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5ef45b53f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f5916c61-f2d0-4a31-9a25-8257b511640c'): ({'sdb'}, set())}) {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 22:04:16 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-e7b66ff0-8be4-49fb-b84b-7152d73b8097 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Removing single pathed devices sdb {{(pid=74337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 22:04:16 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:04:16 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.079s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:04:16 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[7958fb92-acc0-42cc-9dcf-83874a5e65c1]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:04:16 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:04:16 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:04:16 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e94966de-e95a-4aa6-9c85-a8183fe99d50]: (4, ('ok\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:04:16 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-e7b66ff0-8be4-49fb-b84b-7152d73b8097 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Flushing IO for device /dev/sdb {{(pid=74337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 22:04:16 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:04:16 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.061s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:04:16 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[50bae4fc-af0a-4fa9-96cf-233119cbb45e]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:04:16 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-e7b66ff0-8be4-49fb-b84b-7152d73b8097 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 22:04:16 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:04:16 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.085s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:04:16 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d463733-c04f-4ff5-960f-077eac4d32c8]: (4, ('1', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:04:16 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-e7b66ff0-8be4-49fb-b84b-7152d73b8097 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 22:04:16 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-e7b66ff0-8be4-49fb-b84b-7152d73b8097 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] SCSI volumes sdb have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 22:04:16 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7b66ff0-8be4-49fb-b84b-7152d73b8097 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f5916c61-f2d0-4a31-9a25-8257b511640c')] {{(pid=74337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 22:04:16 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5916c61-f2d0-4a31-9a25-8257b511640c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:04:16 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5916c61-f2d0-4a31-9a25-8257b511640c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:04:16 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bf9910e-02b3-4c5d-9b5f-6cd852558ad7]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:04:16 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7b66ff0-8be4-49fb-b84b-7152d73b8097 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:04:16 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5916c61-f2d0-4a31-9a25-8257b511640c -p 172.16.0.220:3260 --logout {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:04:16 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5916c61-f2d0-4a31-9a25-8257b511640c -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:04:16 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[99fd0f1c-71a9-47fe-86c5-21237d39c50b]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:f5916c61-f2d0-4a31-9a25-8257b511640c, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:f5916c61-f2d0-4a31-9a25-8257b511640c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:04:16 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7b66ff0-8be4-49fb-b84b-7152d73b8097 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:f5916c61-f2d0-4a31-9a25-8257b511640c, portal: 172.16.0.220,3260]
Oct 23 22:04:16 user nova-compute[74337]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:f5916c61-f2d0-4a31-9a25-8257b511640c, portal: 172.16.0.220,3260] successful.
Oct 23 22:04:16 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:04:16 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5916c61-f2d0-4a31-9a25-8257b511640c -p 172.16.0.220:3260 --op delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:04:16 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5916c61-f2d0-4a31-9a25-8257b511640c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:04:16 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[573ddced-b9d5-4f33-89a1-cb34d32a2a18]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:04:16 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7b66ff0-8be4-49fb-b84b-7152d73b8097 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:04:16 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-e7b66ff0-8be4-49fb-b84b-7152d73b8097 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.522s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 22:04:16 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7b66ff0-8be4-49fb-b84b-7152d73b8097 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] <== disconnect_volume: return (524ms) None {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 22:04:16 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7b66ff0-8be4-49fb-b84b-7152d73b8097 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] Disconnected iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 22:04:16 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:04:16 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:04:16 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 22:04:16 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 22:04:16 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 22:04:16 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:04:17 user nova-compute[74337]: DEBUG nova.objects.instance [None req-e7b66ff0-8be4-49fb-b84b-7152d73b8097 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Lazy-loading 'flavor' on Instance uuid 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:04:17 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-e7b66ff0-8be4-49fb-b84b-7152d73b8097 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Lock "9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.277s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:04:19 user nova-compute[74337]: INFO nova.compute.manager [None req-ec791969-dd63-4573-bd67-922c990223aa tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Rescuing
Oct 23 22:04:19 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-ec791969-dd63-4573-bd67-922c990223aa tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Acquiring lock "refresh_cache-999843b2-b757-480b-bd21-bf281954bc46" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 22:04:19 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-ec791969-dd63-4573-bd67-922c990223aa tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Acquired lock "refresh_cache-999843b2-b757-480b-bd21-bf281954bc46" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 22:04:19 user nova-compute[74337]: DEBUG nova.network.neutron [None req-ec791969-dd63-4573-bd67-922c990223aa tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Building network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 22:04:20 user nova-compute[74337]: DEBUG nova.network.neutron [None req-ec791969-dd63-4573-bd67-922c990223aa tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Updating instance_info_cache with network_info: [{"id": "02913be6-773f-402a-a534-d7567aeb5b7a", "address": "fa:16:3e:a2:cd:9d", "network": {"id": "122fdd20-8bf5-4374-b50c-82e5dc8684db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-81475496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80f79dd6954748e4806a568a4127396f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02913be6-77", "ovs_interfaceid": "02913be6-773f-402a-a534-d7567aeb5b7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 22:04:20 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-ec791969-dd63-4573-bd67-922c990223aa tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Releasing lock "refresh_cache-999843b2-b757-480b-bd21-bf281954bc46" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 22:04:20 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:04:20 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:04:20 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:04:20 user nova-compute[74337]: DEBUG nova.compute.manager [req-fec7e574-0e0b-4b0c-82cc-e0cc4f80c537 req-d524ba5a-71af-4b76-8558-95ca89b58f56 service nova] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Received event network-vif-unplugged-02913be6-773f-402a-a534-d7567aeb5b7a {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:04:20 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-fec7e574-0e0b-4b0c-82cc-e0cc4f80c537 req-d524ba5a-71af-4b76-8558-95ca89b58f56 service nova] Acquiring lock "999843b2-b757-480b-bd21-bf281954bc46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:04:20 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-fec7e574-0e0b-4b0c-82cc-e0cc4f80c537 req-d524ba5a-71af-4b76-8558-95ca89b58f56 service nova] Lock "999843b2-b757-480b-bd21-bf281954bc46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:04:20 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-fec7e574-0e0b-4b0c-82cc-e0cc4f80c537 req-d524ba5a-71af-4b76-8558-95ca89b58f56 service nova] Lock "999843b2-b757-480b-bd21-bf281954bc46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:04:20 user nova-compute[74337]: DEBUG nova.compute.manager [req-fec7e574-0e0b-4b0c-82cc-e0cc4f80c537 req-d524ba5a-71af-4b76-8558-95ca89b58f56 service nova] [instance: 999843b2-b757-480b-bd21-bf281954bc46] No waiting events found dispatching network-vif-unplugged-02913be6-773f-402a-a534-d7567aeb5b7a {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 22:04:20 user nova-compute[74337]: WARNING nova.compute.manager [req-fec7e574-0e0b-4b0c-82cc-e0cc4f80c537 req-d524ba5a-71af-4b76-8558-95ca89b58f56 service nova] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Received unexpected event network-vif-unplugged-02913be6-773f-402a-a534-d7567aeb5b7a for instance with vm_state active and task_state rescuing.
Oct 23 22:04:20 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:04:20 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:04:21 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Instance destroyed successfully.
Oct 23 22:04:21 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-ec791969-dd63-4573-bd67-922c990223aa tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Attempting rescue
Oct 23 22:04:21 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-ec791969-dd63-4573-bd67-922c990223aa tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74337) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 23 22:04:21 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-ec791969-dd63-4573-bd67-922c990223aa tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Instance directory exists: not creating {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 23 22:04:21 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-ec791969-dd63-4573-bd67-922c990223aa tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Creating image(s)
Oct 23 22:04:21 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-ec791969-dd63-4573-bd67-922c990223aa tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Acquiring lock "/opt/stack/data/nova/instances/999843b2-b757-480b-bd21-bf281954bc46/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:04:21 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-ec791969-dd63-4573-bd67-922c990223aa tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Lock "/opt/stack/data/nova/instances/999843b2-b757-480b-bd21-bf281954bc46/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:04:21 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-ec791969-dd63-4573-bd67-922c990223aa tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Lock "/opt/stack/data/nova/instances/999843b2-b757-480b-bd21-bf281954bc46/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:04:21 user nova-compute[74337]: DEBUG nova.objects.instance [None req-ec791969-dd63-4573-bd67-922c990223aa tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Lazy-loading 'trusted_certs' on Instance uuid 999843b2-b757-480b-bd21-bf281954bc46 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:04:21 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-ec791969-dd63-4573-bd67-922c990223aa tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Acquiring lock "fc7b140751b8c385de81623e40fb09ce09374ab7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:04:21 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-ec791969-dd63-4573-bd67-922c990223aa tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Lock "fc7b140751b8c385de81623e40fb09ce09374ab7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:04:21 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-ec791969-dd63-4573-bd67-922c990223aa tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:04:21 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:04:21 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-ec791969-dd63-4573-bd67-922c990223aa tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.180s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:04:21 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-ec791969-dd63-4573-bd67-922c990223aa tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7,backing_fmt=raw /opt/stack/data/nova/instances/999843b2-b757-480b-bd21-bf281954bc46/disk.rescue {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:04:21 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:04:21 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-ec791969-dd63-4573-bd67-922c990223aa tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7,backing_fmt=raw /opt/stack/data/nova/instances/999843b2-b757-480b-bd21-bf281954bc46/disk.rescue" returned: 0 in 0.052s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:04:21 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-ec791969-dd63-4573-bd67-922c990223aa tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Lock "fc7b140751b8c385de81623e40fb09ce09374ab7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:04:21 user nova-compute[74337]: DEBUG nova.objects.instance [None req-ec791969-dd63-4573-bd67-922c990223aa tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Lazy-loading 'migration_context' on Instance uuid 999843b2-b757-480b-bd21-bf281954bc46 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:04:21 user nova-compute[74337]: DEBUG nova.objects.base [None req-ec791969-dd63-4573-bd67-922c990223aa tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Object Instance<999843b2-b757-480b-bd21-bf281954bc46> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 22:04:21 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-ec791969-dd63-4573-bd67-922c990223aa tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Created local disks {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 22:04:21 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-ec791969-dd63-4573-bd67-922c990223aa tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Start _get_guest_xml network_info=[{"id": "02913be6-773f-402a-a534-d7567aeb5b7a", "address": "fa:16:3e:a2:cd:9d", "network": {"id": "122fdd20-8bf5-4374-b50c-82e5dc8684db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-81475496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-81475496-network", "vif_mac": "fa:16:3e:a2:cd:9d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80f79dd6954748e4806a568a4127396f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02913be6-77", "ovs_interfaceid": "02913be6-773f-402a-a534-d7567aeb5b7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T21:29:21Z,direct_url=<?>,disk_format='qcow2',id=d859d89d-998d-4109-b26a-0d6e28152932,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ff43462300764979a6cf688444336a56',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T21:29:22Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'd859d89d-998d-4109-b26a-0d6e28152932', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 22:04:21 user nova-compute[74337]: DEBUG nova.objects.instance [None req-ec791969-dd63-4573-bd67-922c990223aa tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Lazy-loading 'resources' on Instance uuid 999843b2-b757-480b-bd21-bf281954bc46 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:04:21 user nova-compute[74337]: DEBUG nova.objects.base [None req-ec791969-dd63-4573-bd67-922c990223aa tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Object Instance<999843b2-b757-480b-bd21-bf281954bc46> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 22:04:21 user nova-compute[74337]: DEBUG nova.objects.instance [None req-ec791969-dd63-4573-bd67-922c990223aa tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Lazy-loading 'numa_topology' on Instance uuid 999843b2-b757-480b-bd21-bf281954bc46 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:04:21 user nova-compute[74337]: DEBUG nova.objects.base [None req-ec791969-dd63-4573-bd67-922c990223aa tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Object Instance<999843b2-b757-480b-bd21-bf281954bc46> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 22:04:21 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-ec791969-dd63-4573-bd67-922c990223aa tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:04:21 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-ec791969-dd63-4573-bd67-922c990223aa tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:04:21 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-ec791969-dd63-4573-bd67-922c990223aa tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 22:04:21 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-ec791969-dd63-4573-bd67-922c990223aa tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] CPU controller missing on host. {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 22:04:21 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-ec791969-dd63-4573-bd67-922c990223aa tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 22:04:21 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-ec791969-dd63-4573-bd67-922c990223aa tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] CPU controller found on host. {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 22:04:21 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-ec791969-dd63-4573-bd67-922c990223aa tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 22:04:21 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-ec791969-dd63-4573-bd67-922c990223aa tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T21:29:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T21:29:21Z,direct_url=<?>,disk_format='qcow2',id=d859d89d-998d-4109-b26a-0d6e28152932,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ff43462300764979a6cf688444336a56',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T21:29:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 22:04:21 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-ec791969-dd63-4573-bd67-922c990223aa tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Flavor limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 22:04:21 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-ec791969-dd63-4573-bd67-922c990223aa tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Image limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 22:04:21 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-ec791969-dd63-4573-bd67-922c990223aa tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Flavor pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 22:04:21 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-ec791969-dd63-4573-bd67-922c990223aa tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Image pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 22:04:21 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-ec791969-dd63-4573-bd67-922c990223aa tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 22:04:21 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-ec791969-dd63-4573-bd67-922c990223aa tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 22:04:21 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-ec791969-dd63-4573-bd67-922c990223aa tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 22:04:21 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-ec791969-dd63-4573-bd67-922c990223aa tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Got 1 possible topologies {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 22:04:21 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-ec791969-dd63-4573-bd67-922c990223aa tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 22:04:21 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-ec791969-dd63-4573-bd67-922c990223aa tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 22:04:21 user nova-compute[74337]: DEBUG nova.objects.instance [None req-ec791969-dd63-4573-bd67-922c990223aa tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Lazy-loading 'vcpu_model' on Instance uuid 999843b2-b757-480b-bd21-bf281954bc46 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:04:21 user nova-compute[74337]: DEBUG nova.objects.base [None req-ec791969-dd63-4573-bd67-922c990223aa tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Object Instance<999843b2-b757-480b-bd21-bf281954bc46> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 22:04:21 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-ec791969-dd63-4573-bd67-922c990223aa tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:59:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1406033408',display_name='tempest-ServerRescueNegativeTestJSON-server-1406033408',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1406033408',id=41,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-23T21:59:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='80f79dd6954748e4806a568a4127396f',ramdisk_id='',reservation_id='r-e3hxkbx8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2089412853',owner_user_name='tempest-ServerRescueNegativeTestJSON-2089412853-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T21:59:39Z,user_data=None,user_id='a0f5c4ec386544e1afd2f0a7d1b1c94f',uuid=999843b2-b757-480b-bd21-bf281954bc46,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "02913be6-773f-402a-a534-d7567aeb5b7a", "address": "fa:16:3e:a2:cd:9d", "network": {"id": "122fdd20-8bf5-4374-b50c-82e5dc8684db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-81475496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-81475496-network", "vif_mac": "fa:16:3e:a2:cd:9d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80f79dd6954748e4806a568a4127396f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02913be6-77", "ovs_interfaceid": "02913be6-773f-402a-a534-d7567aeb5b7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 22:04:21 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-ec791969-dd63-4573-bd67-922c990223aa tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Converting VIF {"id": "02913be6-773f-402a-a534-d7567aeb5b7a", "address": "fa:16:3e:a2:cd:9d", "network": {"id": "122fdd20-8bf5-4374-b50c-82e5dc8684db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-81475496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-81475496-network", "vif_mac": "fa:16:3e:a2:cd:9d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80f79dd6954748e4806a568a4127396f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02913be6-77", "ovs_interfaceid": "02913be6-773f-402a-a534-d7567aeb5b7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 22:04:21 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-ec791969-dd63-4573-bd67-922c990223aa tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a2:cd:9d,bridge_name='br-int',has_traffic_filtering=True,id=02913be6-773f-402a-a534-d7567aeb5b7a,network=Network(122fdd20-8bf5-4374-b50c-82e5dc8684db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02913be6-77') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 22:04:21 user nova-compute[74337]: DEBUG nova.objects.instance [None req-ec791969-dd63-4573-bd67-922c990223aa tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Lazy-loading 'pci_devices' on Instance uuid 999843b2-b757-480b-bd21-bf281954bc46 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:04:21 user nova-compute[74337]: DEBUG nova.objects.base [None req-ec791969-dd63-4573-bd67-922c990223aa tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Object Instance<999843b2-b757-480b-bd21-bf281954bc46> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 22:04:21 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-ec791969-dd63-4573-bd67-922c990223aa tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 999843b2-b757-480b-bd21-bf281954bc46] End _get_guest_xml xml=<domain type="kvm">
Oct 23 22:04:21 user nova-compute[74337]:   <uuid>999843b2-b757-480b-bd21-bf281954bc46</uuid>
Oct 23 22:04:21 user nova-compute[74337]:   <name>instance-00000029</name>
Oct 23 22:04:21 user nova-compute[74337]:   <memory>524288</memory>
Oct 23 22:04:21 user nova-compute[74337]:   <vcpu>1</vcpu>
Oct 23 22:04:21 user nova-compute[74337]:   <metadata>
Oct 23 22:04:21 user nova-compute[74337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 22:04:21 user nova-compute[74337]:       <nova:package version="0.0.0"/>
Oct 23 22:04:21 user nova-compute[74337]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1406033408</nova:name>
Oct 23 22:04:21 user nova-compute[74337]:       <nova:creationTime>2023-10-23 22:04:21</nova:creationTime>
Oct 23 22:04:21 user nova-compute[74337]:       <nova:flavor name="m1.tiny">
Oct 23 22:04:21 user nova-compute[74337]:         <nova:memory>512</nova:memory>
Oct 23 22:04:21 user nova-compute[74337]:         <nova:disk>1</nova:disk>
Oct 23 22:04:21 user nova-compute[74337]:         <nova:swap>0</nova:swap>
Oct 23 22:04:21 user nova-compute[74337]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 22:04:21 user nova-compute[74337]:         <nova:vcpus>1</nova:vcpus>
Oct 23 22:04:21 user nova-compute[74337]:       </nova:flavor>
Oct 23 22:04:21 user nova-compute[74337]:       <nova:owner>
Oct 23 22:04:21 user nova-compute[74337]:         <nova:user uuid="a0f5c4ec386544e1afd2f0a7d1b1c94f">tempest-ServerRescueNegativeTestJSON-2089412853-project-member</nova:user>
Oct 23 22:04:21 user nova-compute[74337]:         <nova:project uuid="80f79dd6954748e4806a568a4127396f">tempest-ServerRescueNegativeTestJSON-2089412853</nova:project>
Oct 23 22:04:21 user nova-compute[74337]:       </nova:owner>
Oct 23 22:04:21 user nova-compute[74337]:       <nova:root type="image" uuid="d859d89d-998d-4109-b26a-0d6e28152932"/>
Oct 23 22:04:21 user nova-compute[74337]:       <nova:ports>
Oct 23 22:04:21 user nova-compute[74337]:         <nova:port uuid="02913be6-773f-402a-a534-d7567aeb5b7a">
Oct 23 22:04:21 user nova-compute[74337]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 23 22:04:21 user nova-compute[74337]:         </nova:port>
Oct 23 22:04:21 user nova-compute[74337]:       </nova:ports>
Oct 23 22:04:21 user nova-compute[74337]:     </nova:instance>
Oct 23 22:04:21 user nova-compute[74337]:   </metadata>
Oct 23 22:04:21 user nova-compute[74337]:   <sysinfo type="smbios">
Oct 23 22:04:21 user nova-compute[74337]:     <system>
Oct 23 22:04:21 user nova-compute[74337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 22:04:21 user nova-compute[74337]:       <entry name="product">OpenStack Nova</entry>
Oct 23 22:04:21 user nova-compute[74337]:       <entry name="version">0.0.0</entry>
Oct 23 22:04:21 user nova-compute[74337]:       <entry name="serial">999843b2-b757-480b-bd21-bf281954bc46</entry>
Oct 23 22:04:21 user nova-compute[74337]:       <entry name="uuid">999843b2-b757-480b-bd21-bf281954bc46</entry>
Oct 23 22:04:21 user nova-compute[74337]:       <entry name="family">Virtual Machine</entry>
Oct 23 22:04:21 user nova-compute[74337]:     </system>
Oct 23 22:04:21 user nova-compute[74337]:   </sysinfo>
Oct 23 22:04:21 user nova-compute[74337]:   <os>
Oct 23 22:04:21 user nova-compute[74337]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 22:04:21 user nova-compute[74337]:     <smbios mode="sysinfo"/>
Oct 23 22:04:21 user nova-compute[74337]:   </os>
Oct 23 22:04:21 user nova-compute[74337]:   <features>
Oct 23 22:04:21 user nova-compute[74337]:     <acpi/>
Oct 23 22:04:21 user nova-compute[74337]:     <apic/>
Oct 23 22:04:21 user nova-compute[74337]:     <vmcoreinfo/>
Oct 23 22:04:21 user nova-compute[74337]:   </features>
Oct 23 22:04:21 user nova-compute[74337]:   <clock offset="utc">
Oct 23 22:04:21 user nova-compute[74337]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 22:04:21 user nova-compute[74337]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 22:04:21 user nova-compute[74337]:     <timer name="hpet" present="no"/>
Oct 23 22:04:21 user nova-compute[74337]:   </clock>
Oct 23 22:04:21 user nova-compute[74337]:   <cpu mode="custom" match="exact">
Oct 23 22:04:21 user nova-compute[74337]:     <model>Nehalem</model>
Oct 23 22:04:21 user nova-compute[74337]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 22:04:21 user nova-compute[74337]:   </cpu>
Oct 23 22:04:21 user nova-compute[74337]:   <devices>
Oct 23 22:04:21 user nova-compute[74337]:     <disk type="file" device="disk">
Oct 23 22:04:21 user nova-compute[74337]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 22:04:21 user nova-compute[74337]:       <source file="/opt/stack/data/nova/instances/999843b2-b757-480b-bd21-bf281954bc46/disk.rescue"/>
Oct 23 22:04:21 user nova-compute[74337]:       <target dev="vda" bus="virtio"/>
Oct 23 22:04:21 user nova-compute[74337]:     </disk>
Oct 23 22:04:21 user nova-compute[74337]:     <disk type="file" device="disk">
Oct 23 22:04:21 user nova-compute[74337]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 22:04:21 user nova-compute[74337]:       <source file="/opt/stack/data/nova/instances/999843b2-b757-480b-bd21-bf281954bc46/disk"/>
Oct 23 22:04:21 user nova-compute[74337]:       <target dev="vdb" bus="virtio"/>
Oct 23 22:04:21 user nova-compute[74337]:     </disk>
Oct 23 22:04:21 user nova-compute[74337]:     <interface type="ethernet">
Oct 23 22:04:21 user nova-compute[74337]:       <mac address="fa:16:3e:a2:cd:9d"/>
Oct 23 22:04:21 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 22:04:21 user nova-compute[74337]:       <mtu size="1442"/>
Oct 23 22:04:21 user nova-compute[74337]:       <target dev="tap02913be6-77"/>
Oct 23 22:04:21 user nova-compute[74337]:     </interface>
Oct 23 22:04:21 user nova-compute[74337]:     <serial type="pty">
Oct 23 22:04:21 user nova-compute[74337]:       <log file="/opt/stack/data/nova/instances/999843b2-b757-480b-bd21-bf281954bc46/console.log" append="off"/>
Oct 23 22:04:21 user nova-compute[74337]:     </serial>
Oct 23 22:04:21 user nova-compute[74337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 22:04:21 user nova-compute[74337]:     <video>
Oct 23 22:04:21 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 22:04:21 user nova-compute[74337]:     </video>
Oct 23 22:04:21 user nova-compute[74337]:     <rng model="virtio">
Oct 23 22:04:21 user nova-compute[74337]:       <backend model="random">/dev/urandom</backend>
Oct 23 22:04:21 user nova-compute[74337]:     </rng>
Oct 23 22:04:21 user nova-compute[74337]:     <controller type="usb" index="0" model="none"/>
Oct 23 22:04:21 user nova-compute[74337]:     <memballoon model="virtio">
Oct 23 22:04:21 user nova-compute[74337]:       <stats period="10"/>
Oct 23 22:04:21 user nova-compute[74337]:     </memballoon>
Oct 23 22:04:21 user nova-compute[74337]:   </devices>
Oct 23 22:04:21 user nova-compute[74337]: </domain>
Oct 23 22:04:21 user nova-compute[74337]:  {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 22:04:21 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Instance destroyed successfully.
Oct 23 22:04:21 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-ec791969-dd63-4573-bd67-922c990223aa tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] No BDM found with device name vda, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 22:04:21 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-ec791969-dd63-4573-bd67-922c990223aa tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 22:04:21 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-ec791969-dd63-4573-bd67-922c990223aa tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] No VIF found with MAC fa:16:3e:a2:cd:9d, not building metadata {{(pid=74337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 22:04:22 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:04:22 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 22:04:22 user nova-compute[74337]: DEBUG nova.compute.manager [req-ed087d72-d650-440b-ac2e-605502d14fa8 req-bfe43c2e-9de5-4ecd-8b8a-ed7ecad4ec6c service nova] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Received event network-vif-plugged-02913be6-773f-402a-a534-d7567aeb5b7a {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:04:22 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ed087d72-d650-440b-ac2e-605502d14fa8 req-bfe43c2e-9de5-4ecd-8b8a-ed7ecad4ec6c service nova] Acquiring lock "999843b2-b757-480b-bd21-bf281954bc46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:04:22 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ed087d72-d650-440b-ac2e-605502d14fa8 req-bfe43c2e-9de5-4ecd-8b8a-ed7ecad4ec6c service nova] Lock "999843b2-b757-480b-bd21-bf281954bc46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:04:22 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ed087d72-d650-440b-ac2e-605502d14fa8 req-bfe43c2e-9de5-4ecd-8b8a-ed7ecad4ec6c service nova] Lock "999843b2-b757-480b-bd21-bf281954bc46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:04:22 user nova-compute[74337]: DEBUG nova.compute.manager [req-ed087d72-d650-440b-ac2e-605502d14fa8 req-bfe43c2e-9de5-4ecd-8b8a-ed7ecad4ec6c service nova] [instance: 999843b2-b757-480b-bd21-bf281954bc46] No waiting events found dispatching network-vif-plugged-02913be6-773f-402a-a534-d7567aeb5b7a {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 22:04:22 user nova-compute[74337]: WARNING nova.compute.manager [req-ed087d72-d650-440b-ac2e-605502d14fa8 req-bfe43c2e-9de5-4ecd-8b8a-ed7ecad4ec6c service nova] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Received unexpected event network-vif-plugged-02913be6-773f-402a-a534-d7567aeb5b7a for instance with vm_state active and task_state rescuing.
Oct 23 22:04:23 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:04:23 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:04:23 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:04:23 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:04:23 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:04:23 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:04:23 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:04:24 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:04:24 user nova-compute[74337]: DEBUG nova.compute.manager [req-50e9f4a0-c8d8-4a5d-b554-a31560c7f367 req-f9622662-370b-4a37-b8b5-5b6b1300d0d4 service nova] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Received event network-vif-plugged-02913be6-773f-402a-a534-d7567aeb5b7a {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:04:24 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-50e9f4a0-c8d8-4a5d-b554-a31560c7f367 req-f9622662-370b-4a37-b8b5-5b6b1300d0d4 service nova] Acquiring lock "999843b2-b757-480b-bd21-bf281954bc46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:04:24 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-50e9f4a0-c8d8-4a5d-b554-a31560c7f367 req-f9622662-370b-4a37-b8b5-5b6b1300d0d4 service nova] Lock "999843b2-b757-480b-bd21-bf281954bc46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:04:24 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-50e9f4a0-c8d8-4a5d-b554-a31560c7f367 req-f9622662-370b-4a37-b8b5-5b6b1300d0d4 service nova] Lock "999843b2-b757-480b-bd21-bf281954bc46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:04:24 user nova-compute[74337]: DEBUG nova.compute.manager [req-50e9f4a0-c8d8-4a5d-b554-a31560c7f367 req-f9622662-370b-4a37-b8b5-5b6b1300d0d4 service nova] [instance: 999843b2-b757-480b-bd21-bf281954bc46] No waiting events found dispatching network-vif-plugged-02913be6-773f-402a-a534-d7567aeb5b7a {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 22:04:24 user nova-compute[74337]: WARNING nova.compute.manager [req-50e9f4a0-c8d8-4a5d-b554-a31560c7f367 req-f9622662-370b-4a37-b8b5-5b6b1300d0d4 service nova] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Received unexpected event network-vif-plugged-02913be6-773f-402a-a534-d7567aeb5b7a for instance with vm_state active and task_state rescuing.
Oct 23 22:04:24 user nova-compute[74337]: DEBUG nova.compute.manager [req-50e9f4a0-c8d8-4a5d-b554-a31560c7f367 req-f9622662-370b-4a37-b8b5-5b6b1300d0d4 service nova] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Received event network-vif-plugged-02913be6-773f-402a-a534-d7567aeb5b7a {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:04:24 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-50e9f4a0-c8d8-4a5d-b554-a31560c7f367 req-f9622662-370b-4a37-b8b5-5b6b1300d0d4 service nova] Acquiring lock "999843b2-b757-480b-bd21-bf281954bc46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:04:24 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-50e9f4a0-c8d8-4a5d-b554-a31560c7f367 req-f9622662-370b-4a37-b8b5-5b6b1300d0d4 service nova] Lock "999843b2-b757-480b-bd21-bf281954bc46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:04:24 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-50e9f4a0-c8d8-4a5d-b554-a31560c7f367 req-f9622662-370b-4a37-b8b5-5b6b1300d0d4 service nova] Lock "999843b2-b757-480b-bd21-bf281954bc46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:04:24 user nova-compute[74337]: DEBUG nova.compute.manager [req-50e9f4a0-c8d8-4a5d-b554-a31560c7f367 req-f9622662-370b-4a37-b8b5-5b6b1300d0d4 service nova] [instance: 999843b2-b757-480b-bd21-bf281954bc46] No waiting events found dispatching network-vif-plugged-02913be6-773f-402a-a534-d7567aeb5b7a {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 22:04:24 user nova-compute[74337]: WARNING nova.compute.manager [req-50e9f4a0-c8d8-4a5d-b554-a31560c7f367 req-f9622662-370b-4a37-b8b5-5b6b1300d0d4 service nova] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Received unexpected event network-vif-plugged-02913be6-773f-402a-a534-d7567aeb5b7a for instance with vm_state active and task_state rescuing.
Oct 23 22:04:25 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-30969113-7ad2-4e34-b0db-6093280d8026 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Acquiring lock "6326434d-56d2-43a0-b171-f0f7bd1de5a8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:04:25 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-30969113-7ad2-4e34-b0db-6093280d8026 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Lock "6326434d-56d2-43a0-b171-f0f7bd1de5a8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:04:25 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-30969113-7ad2-4e34-b0db-6093280d8026 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Acquiring lock "6326434d-56d2-43a0-b171-f0f7bd1de5a8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:04:25 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-30969113-7ad2-4e34-b0db-6093280d8026 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Lock "6326434d-56d2-43a0-b171-f0f7bd1de5a8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:04:25 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-30969113-7ad2-4e34-b0db-6093280d8026 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Lock "6326434d-56d2-43a0-b171-f0f7bd1de5a8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:04:25 user nova-compute[74337]: INFO nova.compute.manager [None req-30969113-7ad2-4e34-b0db-6093280d8026 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] [instance: 6326434d-56d2-43a0-b171-f0f7bd1de5a8] Terminating instance
Oct 23 22:04:25 user nova-compute[74337]: DEBUG nova.compute.manager [None req-30969113-7ad2-4e34-b0db-6093280d8026 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] [instance: 6326434d-56d2-43a0-b171-f0f7bd1de5a8] Start destroying the instance on the hypervisor. {{(pid=74337) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 22:04:25 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:04:25 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:04:25 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:04:25 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:04:25 user nova-compute[74337]: DEBUG nova.compute.manager [None req-ec791969-dd63-4573-bd67-922c990223aa tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Checking state {{(pid=74337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 22:04:25 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:04:25 user nova-compute[74337]: DEBUG nova.compute.manager [req-25accba0-5b98-45b6-89b8-f7a6d871a336 req-4dde43ea-09d1-4305-90b7-83bcc266b8f3 service nova] [instance: 6326434d-56d2-43a0-b171-f0f7bd1de5a8] Received event network-vif-unplugged-2c0d1355-d2c2-4504-82a1-705e29a2d065 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:04:25 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-25accba0-5b98-45b6-89b8-f7a6d871a336 req-4dde43ea-09d1-4305-90b7-83bcc266b8f3 service nova] Acquiring lock "6326434d-56d2-43a0-b171-f0f7bd1de5a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:04:25 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-25accba0-5b98-45b6-89b8-f7a6d871a336 req-4dde43ea-09d1-4305-90b7-83bcc266b8f3 service nova] Lock "6326434d-56d2-43a0-b171-f0f7bd1de5a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:04:25 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-25accba0-5b98-45b6-89b8-f7a6d871a336 req-4dde43ea-09d1-4305-90b7-83bcc266b8f3 service nova] Lock "6326434d-56d2-43a0-b171-f0f7bd1de5a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:04:25 user nova-compute[74337]: DEBUG nova.compute.manager [req-25accba0-5b98-45b6-89b8-f7a6d871a336 req-4dde43ea-09d1-4305-90b7-83bcc266b8f3 service nova] [instance: 6326434d-56d2-43a0-b171-f0f7bd1de5a8] No waiting events found dispatching network-vif-unplugged-2c0d1355-d2c2-4504-82a1-705e29a2d065 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 22:04:25 user nova-compute[74337]: DEBUG nova.compute.manager [req-25accba0-5b98-45b6-89b8-f7a6d871a336 req-4dde43ea-09d1-4305-90b7-83bcc266b8f3 service nova] [instance: 6326434d-56d2-43a0-b171-f0f7bd1de5a8] Received event network-vif-unplugged-2c0d1355-d2c2-4504-82a1-705e29a2d065 for instance with task_state deleting. {{(pid=74337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 22:04:26 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: 6326434d-56d2-43a0-b171-f0f7bd1de5a8] Instance destroyed successfully.
Oct 23 22:04:26 user nova-compute[74337]: DEBUG nova.objects.instance [None req-30969113-7ad2-4e34-b0db-6093280d8026 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Lazy-loading 'resources' on Instance uuid 6326434d-56d2-43a0-b171-f0f7bd1de5a8 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:04:26 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-30969113-7ad2-4e34-b0db-6093280d8026 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T22:00:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-2118885877',display_name='tempest-TestServerVolumeAttachmentScenario-server-2118885877',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-2118885877',id=44,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOlPpRTdCGk73S/8D17g34dxL6zhBVBHh/jBhNVAmyV7YH/pcHQq+lR9RVFeBxv5kS28ecMVZQHX4g06NfynmXoET7yOBu/gz2FTdiyjJoOgJjQCvqCGrUNiiFlSskapqw==',key_name='tempest-keypair-1561680692',keypairs=<?>,launch_index=0,launched_at=2023-10-23T22:00:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f838429412604ad4a6dea808cf3c92b7',ramdisk_id='',reservation_id='r-n8de0hkt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-919428222',owner_user_name='tempest-TestServerVolumeAttachmentScenario-919428222-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T22:00:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='16f96346d5c44132bfc6ed76966c6930',uuid=6326434d-56d2-43a0-b171-f0f7bd1de5a8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2c0d1355-d2c2-4504-82a1-705e29a2d065", "address": "fa:16:3e:06:70:87", "network": {"id": "144e037b-415c-4af4-a16c-081ac621f89b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1182284183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f838429412604ad4a6dea808cf3c92b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c0d1355-d2", "ovs_interfaceid": "2c0d1355-d2c2-4504-82a1-705e29a2d065", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 22:04:26 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-30969113-7ad2-4e34-b0db-6093280d8026 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Converting VIF {"id": "2c0d1355-d2c2-4504-82a1-705e29a2d065", "address": "fa:16:3e:06:70:87", "network": {"id": "144e037b-415c-4af4-a16c-081ac621f89b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1182284183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f838429412604ad4a6dea808cf3c92b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c0d1355-d2", "ovs_interfaceid": "2c0d1355-d2c2-4504-82a1-705e29a2d065", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 22:04:26 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-30969113-7ad2-4e34-b0db-6093280d8026 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:06:70:87,bridge_name='br-int',has_traffic_filtering=True,id=2c0d1355-d2c2-4504-82a1-705e29a2d065,network=Network(144e037b-415c-4af4-a16c-081ac621f89b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c0d1355-d2') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 22:04:26 user nova-compute[74337]: DEBUG os_vif [None req-30969113-7ad2-4e34-b0db-6093280d8026 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:70:87,bridge_name='br-int',has_traffic_filtering=True,id=2c0d1355-d2c2-4504-82a1-705e29a2d065,network=Network(144e037b-415c-4af4-a16c-081ac621f89b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c0d1355-d2') {{(pid=74337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 22:04:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:04:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2c0d1355-d2, bridge=br-int, if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:04:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:04:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:04:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:04:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=90bdb13f-55bc-45d2-9c2f-871a4a72e5ca) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:04:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:04:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:04:26 user nova-compute[74337]: INFO os_vif [None req-30969113-7ad2-4e34-b0db-6093280d8026 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:70:87,bridge_name='br-int',has_traffic_filtering=True,id=2c0d1355-d2c2-4504-82a1-705e29a2d065,network=Network(144e037b-415c-4af4-a16c-081ac621f89b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c0d1355-d2')
Oct 23 22:04:26 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-30969113-7ad2-4e34-b0db-6093280d8026 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] [instance: 6326434d-56d2-43a0-b171-f0f7bd1de5a8] Deleting instance files /opt/stack/data/nova/instances/6326434d-56d2-43a0-b171-f0f7bd1de5a8_del
Oct 23 22:04:26 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-30969113-7ad2-4e34-b0db-6093280d8026 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] [instance: 6326434d-56d2-43a0-b171-f0f7bd1de5a8] Deletion of /opt/stack/data/nova/instances/6326434d-56d2-43a0-b171-f0f7bd1de5a8_del complete
Oct 23 22:04:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:04:26 user nova-compute[74337]: INFO nova.compute.manager [None req-30969113-7ad2-4e34-b0db-6093280d8026 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] [instance: 6326434d-56d2-43a0-b171-f0f7bd1de5a8] Took 1.00 seconds to destroy the instance on the hypervisor.
Oct 23 22:04:26 user nova-compute[74337]: DEBUG oslo.service.loopingcall [None req-30969113-7ad2-4e34-b0db-6093280d8026 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74337) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 22:04:26 user nova-compute[74337]: DEBUG nova.compute.manager [-] [instance: 6326434d-56d2-43a0-b171-f0f7bd1de5a8] Deallocating network for instance {{(pid=74337) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 22:04:26 user nova-compute[74337]: DEBUG nova.network.neutron [-] [instance: 6326434d-56d2-43a0-b171-f0f7bd1de5a8] deallocate_for_instance() {{(pid=74337) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 22:04:26 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:04:26 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Starting heal instance info cache {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 22:04:26 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 6326434d-56d2-43a0-b171-f0f7bd1de5a8] Skipping network cache update for instance because it is being deleted. {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9970}}
Oct 23 22:04:26 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Didn't find any instances for network info cache update. {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 23 22:04:27 user nova-compute[74337]: DEBUG nova.network.neutron [-] [instance: 6326434d-56d2-43a0-b171-f0f7bd1de5a8] Updating instance_info_cache with network_info: [] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 22:04:27 user nova-compute[74337]: INFO nova.compute.manager [-] [instance: 6326434d-56d2-43a0-b171-f0f7bd1de5a8] Took 0.94 seconds to deallocate network for instance.
Oct 23 22:04:27 user nova-compute[74337]: DEBUG nova.compute.manager [req-58858352-516b-4545-b774-c8c93c63c7e7 req-06d66235-9525-4fb1-a5c4-ed97397f5cd0 service nova] [instance: 6326434d-56d2-43a0-b171-f0f7bd1de5a8] Received event network-vif-deleted-2c0d1355-d2c2-4504-82a1-705e29a2d065 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:04:27 user nova-compute[74337]: INFO nova.compute.manager [req-58858352-516b-4545-b774-c8c93c63c7e7 req-06d66235-9525-4fb1-a5c4-ed97397f5cd0 service nova] [instance: 6326434d-56d2-43a0-b171-f0f7bd1de5a8] Neutron deleted interface 2c0d1355-d2c2-4504-82a1-705e29a2d065; detaching it from the instance and deleting it from the info cache
Oct 23 22:04:27 user nova-compute[74337]: DEBUG nova.network.neutron [req-58858352-516b-4545-b774-c8c93c63c7e7 req-06d66235-9525-4fb1-a5c4-ed97397f5cd0 service nova] [instance: 6326434d-56d2-43a0-b171-f0f7bd1de5a8] Updating instance_info_cache with network_info: [] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 22:04:27 user nova-compute[74337]: DEBUG nova.compute.manager [req-58858352-516b-4545-b774-c8c93c63c7e7 req-06d66235-9525-4fb1-a5c4-ed97397f5cd0 service nova] [instance: 6326434d-56d2-43a0-b171-f0f7bd1de5a8] Detach interface failed, port_id=2c0d1355-d2c2-4504-82a1-705e29a2d065, reason: Instance 6326434d-56d2-43a0-b171-f0f7bd1de5a8 could not be found. {{(pid=74337) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 23 22:04:27 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-30969113-7ad2-4e34-b0db-6093280d8026 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:04:27 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-30969113-7ad2-4e34-b0db-6093280d8026 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:04:27 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:04:27 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-30969113-7ad2-4e34-b0db-6093280d8026 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 22:04:27 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-30969113-7ad2-4e34-b0db-6093280d8026 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 22:04:27 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-30969113-7ad2-4e34-b0db-6093280d8026 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.464s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:04:27 user nova-compute[74337]: INFO nova.scheduler.client.report [None req-30969113-7ad2-4e34-b0db-6093280d8026 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Deleted allocations for instance 6326434d-56d2-43a0-b171-f0f7bd1de5a8
Oct 23 22:04:27 user nova-compute[74337]: DEBUG nova.compute.manager [req-4251fb36-88a2-4366-8472-45ba98dd5148 req-a2a8bfa2-b1e9-4f38-82f9-f9414de12d2a service nova] [instance: 6326434d-56d2-43a0-b171-f0f7bd1de5a8] Received event network-vif-plugged-2c0d1355-d2c2-4504-82a1-705e29a2d065 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:04:27 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-4251fb36-88a2-4366-8472-45ba98dd5148 req-a2a8bfa2-b1e9-4f38-82f9-f9414de12d2a service nova] Acquiring lock "6326434d-56d2-43a0-b171-f0f7bd1de5a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:04:27 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-4251fb36-88a2-4366-8472-45ba98dd5148 req-a2a8bfa2-b1e9-4f38-82f9-f9414de12d2a service nova] Lock "6326434d-56d2-43a0-b171-f0f7bd1de5a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:04:27 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-4251fb36-88a2-4366-8472-45ba98dd5148 req-a2a8bfa2-b1e9-4f38-82f9-f9414de12d2a service nova] Lock "6326434d-56d2-43a0-b171-f0f7bd1de5a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:04:27 user nova-compute[74337]: DEBUG nova.compute.manager [req-4251fb36-88a2-4366-8472-45ba98dd5148 req-a2a8bfa2-b1e9-4f38-82f9-f9414de12d2a service nova] [instance: 6326434d-56d2-43a0-b171-f0f7bd1de5a8] No waiting events found dispatching network-vif-plugged-2c0d1355-d2c2-4504-82a1-705e29a2d065 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 22:04:27 user nova-compute[74337]: WARNING nova.compute.manager [req-4251fb36-88a2-4366-8472-45ba98dd5148 req-a2a8bfa2-b1e9-4f38-82f9-f9414de12d2a service nova] [instance: 6326434d-56d2-43a0-b171-f0f7bd1de5a8] Received unexpected event network-vif-plugged-2c0d1355-d2c2-4504-82a1-705e29a2d065 for instance with vm_state deleted and task_state None.
Oct 23 22:04:28 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-30969113-7ad2-4e34-b0db-6093280d8026 tempest-TestServerVolumeAttachmentScenario-919428222 tempest-TestServerVolumeAttachmentScenario-919428222-project-member] Lock "6326434d-56d2-43a0-b171-f0f7bd1de5a8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.635s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:04:28 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:04:28 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:04:28 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:04:28 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:04:28 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Auditing locally available compute resources for user (node: user) {{(pid=74337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 22:04:28 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/999843b2-b757-480b-bd21-bf281954bc46/disk.rescue --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:04:28 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/999843b2-b757-480b-bd21-bf281954bc46/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:04:28 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/999843b2-b757-480b-bd21-bf281954bc46/disk.rescue --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:04:28 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/999843b2-b757-480b-bd21-bf281954bc46/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:04:28 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/999843b2-b757-480b-bd21-bf281954bc46/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:04:29 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/999843b2-b757-480b-bd21-bf281954bc46/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:04:29 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/999843b2-b757-480b-bd21-bf281954bc46/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:04:29 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/999843b2-b757-480b-bd21-bf281954bc46/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:04:29 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk.rescue --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:04:29 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:04:29 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk.rescue --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:04:29 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:04:29 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:04:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:04:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:04:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:04:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:04:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:04:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:04:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:04:31 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:04:31 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:04:31 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Hypervisor/Node resource view: name=user free_ram=8489MB free_disk=25.20888900756836GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 22:04:31 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:04:31 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:04:31 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 0323b854-c7a1-42e8-ad85-1e929caa6e9d has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Oct 23 22:04:31 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 999843b2-b757-480b-bd21-bf281954bc46 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 22:04:31 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 27710919-a717-42fa-a436-a261d92c1c2a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 22:04:31 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 22:04:31 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 22:04:31 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 22:04:31 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 22:04:31 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:04:31 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 22:04:31 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Compute_service record updated for user:user {{(pid=74337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 22:04:31 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.326s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:04:32 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:04:36 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:04:37 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:04:37 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:04:37 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Cleaning up deleted instances {{(pid=74337) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 23 22:04:37 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] There are 0 instances to clean {{(pid=74337) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 23 22:04:41 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:04:42 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:04:42 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74337) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 23 22:04:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:04:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:04:49 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:04:51 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:04:54 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:04:55 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:04:56 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:04:56 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-c3fcbba7-9fdc-4cd5-a2e2-31f7cdd5e2a5 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Acquiring lock "9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:04:56 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-c3fcbba7-9fdc-4cd5-a2e2-31f7cdd5e2a5 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Lock "9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:04:56 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-c3fcbba7-9fdc-4cd5-a2e2-31f7cdd5e2a5 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Acquiring lock "9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:04:56 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-c3fcbba7-9fdc-4cd5-a2e2-31f7cdd5e2a5 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Lock "9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:04:56 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-c3fcbba7-9fdc-4cd5-a2e2-31f7cdd5e2a5 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Lock "9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:04:56 user nova-compute[74337]: INFO nova.compute.manager [None req-c3fcbba7-9fdc-4cd5-a2e2-31f7cdd5e2a5 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] Terminating instance
Oct 23 22:04:56 user nova-compute[74337]: DEBUG nova.compute.manager [None req-c3fcbba7-9fdc-4cd5-a2e2-31f7cdd5e2a5 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] Start destroying the instance on the hypervisor. {{(pid=74337) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 22:04:56 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:04:56 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:04:56 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:04:56 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:04:57 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] Instance destroyed successfully.
Oct 23 22:04:57 user nova-compute[74337]: DEBUG nova.objects.instance [None req-c3fcbba7-9fdc-4cd5-a2e2-31f7cdd5e2a5 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Lazy-loading 'resources' on Instance uuid 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:04:57 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-c3fcbba7-9fdc-4cd5-a2e2-31f7cdd5e2a5 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:59:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1167202695',display_name='tempest-TestMinimumBasicScenario-server-1167202695',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1167202695',id=43,image_ref='b94d675a-138f-488a-92c5-1d5cd6e463aa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFVpJ5DCLjjRrlrv/T1cJBeXMsthHFc4ZrTDVDtD1yr3GsqmWtj3fuqEYSlQrEVV5l2AM4io/VMMPw9pGRFIxmGAWLZ3YLAnw6HBKHE6A4ZxRNdwO/8j8SELlvTPjvuLlA==',key_name='tempest-TestMinimumBasicScenario-919891039',keypairs=<?>,launch_index=0,launched_at=2023-10-23T21:59:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='965415a9973d4714aa49a64d34b232a6',ramdisk_id='',reservation_id='r-vf3jl1zs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b94d675a-138f-488a-92c5-1d5cd6e463aa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-295529967',owner_user_name='tempest-TestMinimumBasicScenario-295529967-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T22:02:10Z,user_data=None,user_id='5a20c05457014209a86f285fcc9dd506',uuid=9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "28c36a5b-ff7d-4426-9b09-6114a8c43fe5", "address": "fa:16:3e:df:42:15", "network": {"id": "0b1d82b0-acba-470e-aede-1c57a85a8ed3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1250228933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "965415a9973d4714aa49a64d34b232a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28c36a5b-ff", "ovs_interfaceid": "28c36a5b-ff7d-4426-9b09-6114a8c43fe5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 22:04:57 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-c3fcbba7-9fdc-4cd5-a2e2-31f7cdd5e2a5 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Converting VIF {"id": "28c36a5b-ff7d-4426-9b09-6114a8c43fe5", "address": "fa:16:3e:df:42:15", "network": {"id": "0b1d82b0-acba-470e-aede-1c57a85a8ed3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1250228933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "965415a9973d4714aa49a64d34b232a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28c36a5b-ff", "ovs_interfaceid": "28c36a5b-ff7d-4426-9b09-6114a8c43fe5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 22:04:57 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-c3fcbba7-9fdc-4cd5-a2e2-31f7cdd5e2a5 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:df:42:15,bridge_name='br-int',has_traffic_filtering=True,id=28c36a5b-ff7d-4426-9b09-6114a8c43fe5,network=Network(0b1d82b0-acba-470e-aede-1c57a85a8ed3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28c36a5b-ff') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 22:04:57 user nova-compute[74337]: DEBUG os_vif [None req-c3fcbba7-9fdc-4cd5-a2e2-31f7cdd5e2a5 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:42:15,bridge_name='br-int',has_traffic_filtering=True,id=28c36a5b-ff7d-4426-9b09-6114a8c43fe5,network=Network(0b1d82b0-acba-470e-aede-1c57a85a8ed3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28c36a5b-ff') {{(pid=74337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 22:04:57 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:04:57 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap28c36a5b-ff, bridge=br-int, if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:04:57 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:04:57 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:04:57 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:04:57 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0bd298cb-54d4-4a20-b8e0-6dca5df911fc) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:04:57 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:04:57 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:04:57 user nova-compute[74337]: INFO os_vif [None req-c3fcbba7-9fdc-4cd5-a2e2-31f7cdd5e2a5 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:42:15,bridge_name='br-int',has_traffic_filtering=True,id=28c36a5b-ff7d-4426-9b09-6114a8c43fe5,network=Network(0b1d82b0-acba-470e-aede-1c57a85a8ed3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28c36a5b-ff')
Oct 23 22:04:57 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-c3fcbba7-9fdc-4cd5-a2e2-31f7cdd5e2a5 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] Deleting instance files /opt/stack/data/nova/instances/9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c_del
Oct 23 22:04:57 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-c3fcbba7-9fdc-4cd5-a2e2-31f7cdd5e2a5 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] Deletion of /opt/stack/data/nova/instances/9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c_del complete
Oct 23 22:04:57 user nova-compute[74337]: INFO nova.compute.manager [None req-c3fcbba7-9fdc-4cd5-a2e2-31f7cdd5e2a5 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] Took 0.88 seconds to destroy the instance on the hypervisor.
Oct 23 22:04:57 user nova-compute[74337]: DEBUG oslo.service.loopingcall [None req-c3fcbba7-9fdc-4cd5-a2e2-31f7cdd5e2a5 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74337) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 22:04:57 user nova-compute[74337]: DEBUG nova.compute.manager [-] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] Deallocating network for instance {{(pid=74337) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 22:04:57 user nova-compute[74337]: DEBUG nova.network.neutron [-] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] deallocate_for_instance() {{(pid=74337) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 22:04:57 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:04:58 user nova-compute[74337]: DEBUG nova.network.neutron [-] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] Updating instance_info_cache with network_info: [] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 22:04:58 user nova-compute[74337]: INFO nova.compute.manager [-] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] Took 0.72 seconds to deallocate network for instance.
Oct 23 22:04:58 user nova-compute[74337]: DEBUG nova.compute.manager [req-039bba54-effd-46ce-915a-854575dd6b88 req-e3d18cd9-eeba-44f9-8b5f-33ec6972cff7 service nova] [instance: 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c] Received event network-vif-deleted-28c36a5b-ff7d-4426-9b09-6114a8c43fe5 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:04:58 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-c3fcbba7-9fdc-4cd5-a2e2-31f7cdd5e2a5 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:04:58 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-c3fcbba7-9fdc-4cd5-a2e2-31f7cdd5e2a5 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:04:58 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-c3fcbba7-9fdc-4cd5-a2e2-31f7cdd5e2a5 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Refreshing inventories for resource provider dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 23 22:04:58 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-c3fcbba7-9fdc-4cd5-a2e2-31f7cdd5e2a5 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Updating ProviderTree inventory for provider dfcf3942-a432-4293-945b-14b86f57d794 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 23 22:04:58 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-c3fcbba7-9fdc-4cd5-a2e2-31f7cdd5e2a5 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Updating inventory in ProviderTree for provider dfcf3942-a432-4293-945b-14b86f57d794 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 23 22:04:58 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-c3fcbba7-9fdc-4cd5-a2e2-31f7cdd5e2a5 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Refreshing aggregate associations for resource provider dfcf3942-a432-4293-945b-14b86f57d794, aggregates: None {{(pid=74337) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 23 22:04:58 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-c3fcbba7-9fdc-4cd5-a2e2-31f7cdd5e2a5 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Refreshing trait associations for resource provider dfcf3942-a432-4293-945b-14b86f57d794, traits: COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE2,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE42,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_EXTEND,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_TRUSTED_CERTS {{(pid=74337) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 23 22:04:58 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-c3fcbba7-9fdc-4cd5-a2e2-31f7cdd5e2a5 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 22:04:58 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-c3fcbba7-9fdc-4cd5-a2e2-31f7cdd5e2a5 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 22:04:58 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-c3fcbba7-9fdc-4cd5-a2e2-31f7cdd5e2a5 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.349s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:04:58 user nova-compute[74337]: INFO nova.scheduler.client.report [None req-c3fcbba7-9fdc-4cd5-a2e2-31f7cdd5e2a5 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Deleted allocations for instance 9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c
Oct 23 22:04:58 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-c3fcbba7-9fdc-4cd5-a2e2-31f7cdd5e2a5 tempest-TestMinimumBasicScenario-295529967 tempest-TestMinimumBasicScenario-295529967-project-member] Lock "9f74ca8f-153c-41d5-9aab-3b3ab2b3e54c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.164s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:04:59 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:04:59 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:05:02 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:05:02 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:05:04 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:05:07 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:05:12 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:05:14 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:05:17 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:05:20 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:05:22 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:05:22 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:05:22 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 22:05:22 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 22:05:22 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 22:05:22 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:05:22 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:05:22 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:05:22 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 22:05:24 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:05:25 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:05:26 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:05:27 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:05:27 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:05:27 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Starting heal instance info cache {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 22:05:27 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Rebuilding the list of instances to heal {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 22:05:27 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "refresh_cache-999843b2-b757-480b-bd21-bf281954bc46" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 22:05:27 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquired lock "refresh_cache-999843b2-b757-480b-bd21-bf281954bc46" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 22:05:27 user nova-compute[74337]: DEBUG nova.network.neutron [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Forcefully refreshing network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 22:05:27 user nova-compute[74337]: DEBUG nova.objects.instance [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lazy-loading 'info_cache' on Instance uuid 999843b2-b757-480b-bd21-bf281954bc46 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:05:27 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-e3c90b85-0950-4176-8a52-665b75545ee1 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Acquiring lock "7c970dae-cf7b-4267-8adc-843d00780e37" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:05:27 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-e3c90b85-0950-4176-8a52-665b75545ee1 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Lock "7c970dae-cf7b-4267-8adc-843d00780e37" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:05:27 user nova-compute[74337]: DEBUG nova.compute.manager [None req-e3c90b85-0950-4176-8a52-665b75545ee1 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] [instance: 7c970dae-cf7b-4267-8adc-843d00780e37] Starting instance... {{(pid=74337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 22:05:27 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-e3c90b85-0950-4176-8a52-665b75545ee1 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:05:27 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-e3c90b85-0950-4176-8a52-665b75545ee1 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:05:27 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-e3c90b85-0950-4176-8a52-665b75545ee1 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 22:05:27 user nova-compute[74337]: INFO nova.compute.claims [None req-e3c90b85-0950-4176-8a52-665b75545ee1 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] [instance: 7c970dae-cf7b-4267-8adc-843d00780e37] Claim successful on node user
Oct 23 22:05:27 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-e3c90b85-0950-4176-8a52-665b75545ee1 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 22:05:27 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-e3c90b85-0950-4176-8a52-665b75545ee1 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 22:05:27 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-e3c90b85-0950-4176-8a52-665b75545ee1 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.292s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:05:27 user nova-compute[74337]: DEBUG nova.compute.manager [None req-e3c90b85-0950-4176-8a52-665b75545ee1 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] [instance: 7c970dae-cf7b-4267-8adc-843d00780e37] Start building networks asynchronously for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 22:05:28 user nova-compute[74337]: DEBUG nova.compute.manager [None req-e3c90b85-0950-4176-8a52-665b75545ee1 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] [instance: 7c970dae-cf7b-4267-8adc-843d00780e37] Allocating IP information in the background. {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 22:05:28 user nova-compute[74337]: DEBUG nova.network.neutron [None req-e3c90b85-0950-4176-8a52-665b75545ee1 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] [instance: 7c970dae-cf7b-4267-8adc-843d00780e37] allocate_for_instance() {{(pid=74337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 22:05:28 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-e3c90b85-0950-4176-8a52-665b75545ee1 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] [instance: 7c970dae-cf7b-4267-8adc-843d00780e37] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 22:05:28 user nova-compute[74337]: DEBUG nova.network.neutron [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Updating instance_info_cache with network_info: [{"id": "02913be6-773f-402a-a534-d7567aeb5b7a", "address": "fa:16:3e:a2:cd:9d", "network": {"id": "122fdd20-8bf5-4374-b50c-82e5dc8684db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-81475496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80f79dd6954748e4806a568a4127396f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02913be6-77", "ovs_interfaceid": "02913be6-773f-402a-a534-d7567aeb5b7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 22:05:28 user nova-compute[74337]: DEBUG nova.compute.manager [None req-e3c90b85-0950-4176-8a52-665b75545ee1 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] [instance: 7c970dae-cf7b-4267-8adc-843d00780e37] Start building block device mappings for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 22:05:28 user nova-compute[74337]: DEBUG nova.policy [None req-e3c90b85-0950-4176-8a52-665b75545ee1 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7932a09ed7a14f249da27a7f1d5326ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799c72bbb3e248b99463567aba2049db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74337) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 22:05:28 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Releasing lock "refresh_cache-999843b2-b757-480b-bd21-bf281954bc46" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 22:05:28 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Updated the network info_cache for instance {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 22:05:28 user nova-compute[74337]: DEBUG nova.compute.manager [None req-e3c90b85-0950-4176-8a52-665b75545ee1 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] [instance: 7c970dae-cf7b-4267-8adc-843d00780e37] Start spawning the instance on the hypervisor. {{(pid=74337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 22:05:28 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-e3c90b85-0950-4176-8a52-665b75545ee1 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] [instance: 7c970dae-cf7b-4267-8adc-843d00780e37] Creating instance directory {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 22:05:28 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-e3c90b85-0950-4176-8a52-665b75545ee1 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] [instance: 7c970dae-cf7b-4267-8adc-843d00780e37] Creating image(s)
Oct 23 22:05:28 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-e3c90b85-0950-4176-8a52-665b75545ee1 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Acquiring lock "/opt/stack/data/nova/instances/7c970dae-cf7b-4267-8adc-843d00780e37/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:05:28 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-e3c90b85-0950-4176-8a52-665b75545ee1 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Lock "/opt/stack/data/nova/instances/7c970dae-cf7b-4267-8adc-843d00780e37/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:05:28 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-e3c90b85-0950-4176-8a52-665b75545ee1 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Lock "/opt/stack/data/nova/instances/7c970dae-cf7b-4267-8adc-843d00780e37/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:05:28 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-e3c90b85-0950-4176-8a52-665b75545ee1 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:05:28 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-e3c90b85-0950-4176-8a52-665b75545ee1 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.199s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:05:28 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-e3c90b85-0950-4176-8a52-665b75545ee1 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Acquiring lock "fc7b140751b8c385de81623e40fb09ce09374ab7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:05:28 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-e3c90b85-0950-4176-8a52-665b75545ee1 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Lock "fc7b140751b8c385de81623e40fb09ce09374ab7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:05:28 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-e3c90b85-0950-4176-8a52-665b75545ee1 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:05:28 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:05:28 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-e3c90b85-0950-4176-8a52-665b75545ee1 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.205s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:05:28 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-e3c90b85-0950-4176-8a52-665b75545ee1 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7,backing_fmt=raw /opt/stack/data/nova/instances/7c970dae-cf7b-4267-8adc-843d00780e37/disk 1073741824 {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:05:28 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-e3c90b85-0950-4176-8a52-665b75545ee1 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7,backing_fmt=raw /opt/stack/data/nova/instances/7c970dae-cf7b-4267-8adc-843d00780e37/disk 1073741824" returned: 0 in 0.063s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:05:28 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-e3c90b85-0950-4176-8a52-665b75545ee1 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Lock "fc7b140751b8c385de81623e40fb09ce09374ab7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.274s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:05:28 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-e3c90b85-0950-4176-8a52-665b75545ee1 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:05:28 user nova-compute[74337]: DEBUG nova.network.neutron [None req-e3c90b85-0950-4176-8a52-665b75545ee1 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] [instance: 7c970dae-cf7b-4267-8adc-843d00780e37] Successfully created port: b465d0fa-4a02-4ad4-bbeb-03723257d328 {{(pid=74337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 22:05:28 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-e3c90b85-0950-4176-8a52-665b75545ee1 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.202s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:05:28 user nova-compute[74337]: DEBUG nova.virt.disk.api [None req-e3c90b85-0950-4176-8a52-665b75545ee1 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7c970dae-cf7b-4267-8adc-843d00780e37/disk. size=1073741824 {{(pid=74337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 22:05:28 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-e3c90b85-0950-4176-8a52-665b75545ee1 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c970dae-cf7b-4267-8adc-843d00780e37/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:05:29 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:05:29 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-e3c90b85-0950-4176-8a52-665b75545ee1 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c970dae-cf7b-4267-8adc-843d00780e37/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:05:29 user nova-compute[74337]: DEBUG nova.virt.disk.api [None req-e3c90b85-0950-4176-8a52-665b75545ee1 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Cannot resize image /opt/stack/data/nova/instances/7c970dae-cf7b-4267-8adc-843d00780e37/disk to a smaller size. {{(pid=74337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 22:05:29 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-e3c90b85-0950-4176-8a52-665b75545ee1 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] [instance: 7c970dae-cf7b-4267-8adc-843d00780e37] Created local disks {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 22:05:29 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-e3c90b85-0950-4176-8a52-665b75545ee1 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] [instance: 7c970dae-cf7b-4267-8adc-843d00780e37] Ensure instance console log exists: /opt/stack/data/nova/instances/7c970dae-cf7b-4267-8adc-843d00780e37/console.log {{(pid=74337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 22:05:29 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-e3c90b85-0950-4176-8a52-665b75545ee1 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:05:29 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-e3c90b85-0950-4176-8a52-665b75545ee1 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:05:29 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-e3c90b85-0950-4176-8a52-665b75545ee1 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:05:29 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:05:29 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:05:29 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:05:29 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:05:29 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:05:29 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Auditing locally available compute resources for user (node: user) {{(pid=74337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 22:05:29 user nova-compute[74337]: DEBUG nova.network.neutron [None req-e3c90b85-0950-4176-8a52-665b75545ee1 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] [instance: 7c970dae-cf7b-4267-8adc-843d00780e37] Successfully updated port: b465d0fa-4a02-4ad4-bbeb-03723257d328 {{(pid=74337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 22:05:29 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-e3c90b85-0950-4176-8a52-665b75545ee1 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Acquiring lock "refresh_cache-7c970dae-cf7b-4267-8adc-843d00780e37" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 22:05:29 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-e3c90b85-0950-4176-8a52-665b75545ee1 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Acquired lock "refresh_cache-7c970dae-cf7b-4267-8adc-843d00780e37" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 22:05:29 user nova-compute[74337]: DEBUG nova.network.neutron [None req-e3c90b85-0950-4176-8a52-665b75545ee1 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] [instance: 7c970dae-cf7b-4267-8adc-843d00780e37] Building network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 22:05:29 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/999843b2-b757-480b-bd21-bf281954bc46/disk.rescue --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:05:29 user nova-compute[74337]: DEBUG nova.network.neutron [None req-e3c90b85-0950-4176-8a52-665b75545ee1 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] [instance: 7c970dae-cf7b-4267-8adc-843d00780e37] Instance cache missing network info. {{(pid=74337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 22:05:29 user nova-compute[74337]: DEBUG nova.compute.manager [req-fb4a31da-157d-46b2-b557-99e6aea00d52 req-4ec03eee-7720-47a4-9cac-fd78f7229924 service nova] [instance: 7c970dae-cf7b-4267-8adc-843d00780e37] Received event network-changed-b465d0fa-4a02-4ad4-bbeb-03723257d328 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:05:29 user nova-compute[74337]: DEBUG nova.compute.manager [req-fb4a31da-157d-46b2-b557-99e6aea00d52 req-4ec03eee-7720-47a4-9cac-fd78f7229924 service nova] [instance: 7c970dae-cf7b-4267-8adc-843d00780e37] Refreshing instance network info cache due to event network-changed-b465d0fa-4a02-4ad4-bbeb-03723257d328. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 22:05:29 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-fb4a31da-157d-46b2-b557-99e6aea00d52 req-4ec03eee-7720-47a4-9cac-fd78f7229924 service nova] Acquiring lock "refresh_cache-7c970dae-cf7b-4267-8adc-843d00780e37" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 22:05:29 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/999843b2-b757-480b-bd21-bf281954bc46/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:05:29 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/999843b2-b757-480b-bd21-bf281954bc46/disk.rescue --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:05:29 user nova-compute[74337]: DEBUG nova.network.neutron [None req-e3c90b85-0950-4176-8a52-665b75545ee1 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] [instance: 7c970dae-cf7b-4267-8adc-843d00780e37] Updating instance_info_cache with network_info: [{"id": "b465d0fa-4a02-4ad4-bbeb-03723257d328", "address": "fa:16:3e:75:a1:dd", "network": {"id": "86669102-0490-4fe4-aba4-8a353e91a763", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1218528793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799c72bbb3e248b99463567aba2049db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb465d0fa-4a", "ovs_interfaceid": "b465d0fa-4a02-4ad4-bbeb-03723257d328", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 22:05:29 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-e3c90b85-0950-4176-8a52-665b75545ee1 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Releasing lock "refresh_cache-7c970dae-cf7b-4267-8adc-843d00780e37" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 22:05:29 user nova-compute[74337]: DEBUG nova.compute.manager [None req-e3c90b85-0950-4176-8a52-665b75545ee1 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] [instance: 7c970dae-cf7b-4267-8adc-843d00780e37] Instance network_info: |[{"id": "b465d0fa-4a02-4ad4-bbeb-03723257d328", "address": "fa:16:3e:75:a1:dd", "network": {"id": "86669102-0490-4fe4-aba4-8a353e91a763", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1218528793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799c72bbb3e248b99463567aba2049db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb465d0fa-4a", "ovs_interfaceid": "b465d0fa-4a02-4ad4-bbeb-03723257d328", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 22:05:29 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-fb4a31da-157d-46b2-b557-99e6aea00d52 req-4ec03eee-7720-47a4-9cac-fd78f7229924 service nova] Acquired lock "refresh_cache-7c970dae-cf7b-4267-8adc-843d00780e37" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 22:05:29 user nova-compute[74337]: DEBUG nova.network.neutron [req-fb4a31da-157d-46b2-b557-99e6aea00d52 req-4ec03eee-7720-47a4-9cac-fd78f7229924 service nova] [instance: 7c970dae-cf7b-4267-8adc-843d00780e37] Refreshing network info cache for port b465d0fa-4a02-4ad4-bbeb-03723257d328 {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 22:05:29 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-e3c90b85-0950-4176-8a52-665b75545ee1 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] [instance: 7c970dae-cf7b-4267-8adc-843d00780e37] Start _get_guest_xml network_info=[{"id": "b465d0fa-4a02-4ad4-bbeb-03723257d328", "address": "fa:16:3e:75:a1:dd", "network": {"id": "86669102-0490-4fe4-aba4-8a353e91a763", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1218528793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799c72bbb3e248b99463567aba2049db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb465d0fa-4a", "ovs_interfaceid": "b465d0fa-4a02-4ad4-bbeb-03723257d328", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T21:29:21Z,direct_url=<?>,disk_format='qcow2',id=d859d89d-998d-4109-b26a-0d6e28152932,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ff43462300764979a6cf688444336a56',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T21:29:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'image_id': 'd859d89d-998d-4109-b26a-0d6e28152932'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 22:05:30 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-e3c90b85-0950-4176-8a52-665b75545ee1 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:05:30 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-e3c90b85-0950-4176-8a52-665b75545ee1 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:05:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/999843b2-b757-480b-bd21-bf281954bc46/disk.rescue --force-share --output=json" returned: 0 in 0.214s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:05:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/999843b2-b757-480b-bd21-bf281954bc46/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:05:30 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-e3c90b85-0950-4176-8a52-665b75545ee1 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 22:05:30 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-e3c90b85-0950-4176-8a52-665b75545ee1 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] CPU controller missing on host. {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 22:05:30 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-e3c90b85-0950-4176-8a52-665b75545ee1 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 22:05:30 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-e3c90b85-0950-4176-8a52-665b75545ee1 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] CPU controller found on host. {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 22:05:30 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-e3c90b85-0950-4176-8a52-665b75545ee1 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 22:05:30 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-e3c90b85-0950-4176-8a52-665b75545ee1 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T21:29:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T21:29:21Z,direct_url=<?>,disk_format='qcow2',id=d859d89d-998d-4109-b26a-0d6e28152932,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ff43462300764979a6cf688444336a56',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T21:29:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 22:05:30 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-e3c90b85-0950-4176-8a52-665b75545ee1 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Flavor limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 22:05:30 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-e3c90b85-0950-4176-8a52-665b75545ee1 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Image limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 22:05:30 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-e3c90b85-0950-4176-8a52-665b75545ee1 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Flavor pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 22:05:30 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-e3c90b85-0950-4176-8a52-665b75545ee1 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Image pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 22:05:30 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-e3c90b85-0950-4176-8a52-665b75545ee1 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 22:05:30 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-e3c90b85-0950-4176-8a52-665b75545ee1 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 22:05:30 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-e3c90b85-0950-4176-8a52-665b75545ee1 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 22:05:30 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-e3c90b85-0950-4176-8a52-665b75545ee1 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Got 1 possible topologies {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 22:05:30 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-e3c90b85-0950-4176-8a52-665b75545ee1 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 22:05:30 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-e3c90b85-0950-4176-8a52-665b75545ee1 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 22:05:30 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-e3c90b85-0950-4176-8a52-665b75545ee1 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T22:05:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1403161224',display_name='tempest-VolumesSnapshotTestJSON-instance-1403161224',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1403161224',id=47,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHOwfn+SOx+F48ytrfXAGyNr4A7HOLHmxzfDTeYN9wuowPLbskDxPazW/ZE8FjpOTe3JDS7OnAASXPAY6NgYsQZJSKqD90ZeMgTNEtYEhHtWA2pXlJebIzaxo3xOqGc46w==',key_name='tempest-keypair-1235602070',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='799c72bbb3e248b99463567aba2049db',ramdisk_id='',reservation_id='r-0fq6bxd4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-389190159',owner_user_name='tempest-VolumesSnapshotTestJSON-389190159-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T22:05:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7932a09ed7a14f249da27a7f1d5326ea',uuid=7c970dae-cf7b-4267-8adc-843d00780e37,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b465d0fa-4a02-4ad4-bbeb-03723257d328", "address": "fa:16:3e:75:a1:dd", "network": {"id": "86669102-0490-4fe4-aba4-8a353e91a763", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1218528793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799c72bbb3e248b99463567aba2049db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb465d0fa-4a", "ovs_interfaceid": "b465d0fa-4a02-4ad4-bbeb-03723257d328", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 22:05:30 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-e3c90b85-0950-4176-8a52-665b75545ee1 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Converting VIF {"id": "b465d0fa-4a02-4ad4-bbeb-03723257d328", "address": "fa:16:3e:75:a1:dd", "network": {"id": "86669102-0490-4fe4-aba4-8a353e91a763", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1218528793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799c72bbb3e248b99463567aba2049db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb465d0fa-4a", "ovs_interfaceid": "b465d0fa-4a02-4ad4-bbeb-03723257d328", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 22:05:30 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-e3c90b85-0950-4176-8a52-665b75545ee1 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:a1:dd,bridge_name='br-int',has_traffic_filtering=True,id=b465d0fa-4a02-4ad4-bbeb-03723257d328,network=Network(86669102-0490-4fe4-aba4-8a353e91a763),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb465d0fa-4a') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 22:05:30 user nova-compute[74337]: DEBUG nova.objects.instance [None req-e3c90b85-0950-4176-8a52-665b75545ee1 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Lazy-loading 'pci_devices' on Instance uuid 7c970dae-cf7b-4267-8adc-843d00780e37 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:05:30 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-e3c90b85-0950-4176-8a52-665b75545ee1 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] [instance: 7c970dae-cf7b-4267-8adc-843d00780e37] End _get_guest_xml xml=<domain type="kvm">
Oct 23 22:05:30 user nova-compute[74337]:   <uuid>7c970dae-cf7b-4267-8adc-843d00780e37</uuid>
Oct 23 22:05:30 user nova-compute[74337]:   <name>instance-0000002f</name>
Oct 23 22:05:30 user nova-compute[74337]:   <memory>524288</memory>
Oct 23 22:05:30 user nova-compute[74337]:   <vcpu>1</vcpu>
Oct 23 22:05:30 user nova-compute[74337]:   <metadata>
Oct 23 22:05:30 user nova-compute[74337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 22:05:30 user nova-compute[74337]:       <nova:package version="0.0.0"/>
Oct 23 22:05:30 user nova-compute[74337]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1403161224</nova:name>
Oct 23 22:05:30 user nova-compute[74337]:       <nova:creationTime>2023-10-23 22:05:30</nova:creationTime>
Oct 23 22:05:30 user nova-compute[74337]:       <nova:flavor name="m1.tiny">
Oct 23 22:05:30 user nova-compute[74337]:         <nova:memory>512</nova:memory>
Oct 23 22:05:30 user nova-compute[74337]:         <nova:disk>1</nova:disk>
Oct 23 22:05:30 user nova-compute[74337]:         <nova:swap>0</nova:swap>
Oct 23 22:05:30 user nova-compute[74337]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 22:05:30 user nova-compute[74337]:         <nova:vcpus>1</nova:vcpus>
Oct 23 22:05:30 user nova-compute[74337]:       </nova:flavor>
Oct 23 22:05:30 user nova-compute[74337]:       <nova:owner>
Oct 23 22:05:30 user nova-compute[74337]:         <nova:user uuid="7932a09ed7a14f249da27a7f1d5326ea">tempest-VolumesSnapshotTestJSON-389190159-project-member</nova:user>
Oct 23 22:05:30 user nova-compute[74337]:         <nova:project uuid="799c72bbb3e248b99463567aba2049db">tempest-VolumesSnapshotTestJSON-389190159</nova:project>
Oct 23 22:05:30 user nova-compute[74337]:       </nova:owner>
Oct 23 22:05:30 user nova-compute[74337]:       <nova:root type="image" uuid="d859d89d-998d-4109-b26a-0d6e28152932"/>
Oct 23 22:05:30 user nova-compute[74337]:       <nova:ports>
Oct 23 22:05:30 user nova-compute[74337]:         <nova:port uuid="b465d0fa-4a02-4ad4-bbeb-03723257d328">
Oct 23 22:05:30 user nova-compute[74337]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 23 22:05:30 user nova-compute[74337]:         </nova:port>
Oct 23 22:05:30 user nova-compute[74337]:       </nova:ports>
Oct 23 22:05:30 user nova-compute[74337]:     </nova:instance>
Oct 23 22:05:30 user nova-compute[74337]:   </metadata>
Oct 23 22:05:30 user nova-compute[74337]:   <sysinfo type="smbios">
Oct 23 22:05:30 user nova-compute[74337]:     <system>
Oct 23 22:05:30 user nova-compute[74337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 22:05:30 user nova-compute[74337]:       <entry name="product">OpenStack Nova</entry>
Oct 23 22:05:30 user nova-compute[74337]:       <entry name="version">0.0.0</entry>
Oct 23 22:05:30 user nova-compute[74337]:       <entry name="serial">7c970dae-cf7b-4267-8adc-843d00780e37</entry>
Oct 23 22:05:30 user nova-compute[74337]:       <entry name="uuid">7c970dae-cf7b-4267-8adc-843d00780e37</entry>
Oct 23 22:05:30 user nova-compute[74337]:       <entry name="family">Virtual Machine</entry>
Oct 23 22:05:30 user nova-compute[74337]:     </system>
Oct 23 22:05:30 user nova-compute[74337]:   </sysinfo>
Oct 23 22:05:30 user nova-compute[74337]:   <os>
Oct 23 22:05:30 user nova-compute[74337]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 22:05:30 user nova-compute[74337]:     <boot dev="hd"/>
Oct 23 22:05:30 user nova-compute[74337]:     <smbios mode="sysinfo"/>
Oct 23 22:05:30 user nova-compute[74337]:   </os>
Oct 23 22:05:30 user nova-compute[74337]:   <features>
Oct 23 22:05:30 user nova-compute[74337]:     <acpi/>
Oct 23 22:05:30 user nova-compute[74337]:     <apic/>
Oct 23 22:05:30 user nova-compute[74337]:     <vmcoreinfo/>
Oct 23 22:05:30 user nova-compute[74337]:   </features>
Oct 23 22:05:30 user nova-compute[74337]:   <clock offset="utc">
Oct 23 22:05:30 user nova-compute[74337]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 22:05:30 user nova-compute[74337]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 22:05:30 user nova-compute[74337]:     <timer name="hpet" present="no"/>
Oct 23 22:05:30 user nova-compute[74337]:   </clock>
Oct 23 22:05:30 user nova-compute[74337]:   <cpu mode="custom" match="exact">
Oct 23 22:05:30 user nova-compute[74337]:     <model>Nehalem</model>
Oct 23 22:05:30 user nova-compute[74337]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 22:05:30 user nova-compute[74337]:   </cpu>
Oct 23 22:05:30 user nova-compute[74337]:   <devices>
Oct 23 22:05:30 user nova-compute[74337]:     <disk type="file" device="disk">
Oct 23 22:05:30 user nova-compute[74337]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 22:05:30 user nova-compute[74337]:       <source file="/opt/stack/data/nova/instances/7c970dae-cf7b-4267-8adc-843d00780e37/disk"/>
Oct 23 22:05:30 user nova-compute[74337]:       <target dev="vda" bus="virtio"/>
Oct 23 22:05:30 user nova-compute[74337]:     </disk>
Oct 23 22:05:30 user nova-compute[74337]:     <interface type="ethernet">
Oct 23 22:05:30 user nova-compute[74337]:       <mac address="fa:16:3e:75:a1:dd"/>
Oct 23 22:05:30 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 22:05:30 user nova-compute[74337]:       <mtu size="1442"/>
Oct 23 22:05:30 user nova-compute[74337]:       <target dev="tapb465d0fa-4a"/>
Oct 23 22:05:30 user nova-compute[74337]:     </interface>
Oct 23 22:05:30 user nova-compute[74337]:     <serial type="pty">
Oct 23 22:05:30 user nova-compute[74337]:       <log file="/opt/stack/data/nova/instances/7c970dae-cf7b-4267-8adc-843d00780e37/console.log" append="off"/>
Oct 23 22:05:30 user nova-compute[74337]:     </serial>
Oct 23 22:05:30 user nova-compute[74337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 22:05:30 user nova-compute[74337]:     <video>
Oct 23 22:05:30 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 22:05:30 user nova-compute[74337]:     </video>
Oct 23 22:05:30 user nova-compute[74337]:     <rng model="virtio">
Oct 23 22:05:30 user nova-compute[74337]:       <backend model="random">/dev/urandom</backend>
Oct 23 22:05:30 user nova-compute[74337]:     </rng>
Oct 23 22:05:30 user nova-compute[74337]:     <controller type="usb" index="0" model="none"/>
Oct 23 22:05:30 user nova-compute[74337]:     <memballoon model="virtio">
Oct 23 22:05:30 user nova-compute[74337]:       <stats period="10"/>
Oct 23 22:05:30 user nova-compute[74337]:     </memballoon>
Oct 23 22:05:30 user nova-compute[74337]:   </devices>
Oct 23 22:05:30 user nova-compute[74337]: </domain>
Oct 23 22:05:30 user nova-compute[74337]:  {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 22:05:30 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-e3c90b85-0950-4176-8a52-665b75545ee1 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T22:05:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1403161224',display_name='tempest-VolumesSnapshotTestJSON-instance-1403161224',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1403161224',id=47,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHOwfn+SOx+F48ytrfXAGyNr4A7HOLHmxzfDTeYN9wuowPLbskDxPazW/ZE8FjpOTe3JDS7OnAASXPAY6NgYsQZJSKqD90ZeMgTNEtYEhHtWA2pXlJebIzaxo3xOqGc46w==',key_name='tempest-keypair-1235602070',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='799c72bbb3e248b99463567aba2049db',ramdisk_id='',reservation_id='r-0fq6bxd4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-389190159',owner_user_name='tempest-VolumesSnapshotTestJSON-389190159-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T22:05:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7932a09ed7a14f249da27a7f1d5326ea',uuid=7c970dae-cf7b-4267-8adc-843d00780e37,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b465d0fa-4a02-4ad4-bbeb-03723257d328", "address": "fa:16:3e:75:a1:dd", "network": {"id": "86669102-0490-4fe4-aba4-8a353e91a763", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1218528793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799c72bbb3e248b99463567aba2049db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb465d0fa-4a", "ovs_interfaceid": "b465d0fa-4a02-4ad4-bbeb-03723257d328", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 22:05:30 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-e3c90b85-0950-4176-8a52-665b75545ee1 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Converting VIF {"id": "b465d0fa-4a02-4ad4-bbeb-03723257d328", "address": "fa:16:3e:75:a1:dd", "network": {"id": "86669102-0490-4fe4-aba4-8a353e91a763", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1218528793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799c72bbb3e248b99463567aba2049db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb465d0fa-4a", "ovs_interfaceid": "b465d0fa-4a02-4ad4-bbeb-03723257d328", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 22:05:30 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-e3c90b85-0950-4176-8a52-665b75545ee1 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:a1:dd,bridge_name='br-int',has_traffic_filtering=True,id=b465d0fa-4a02-4ad4-bbeb-03723257d328,network=Network(86669102-0490-4fe4-aba4-8a353e91a763),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb465d0fa-4a') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 22:05:30 user nova-compute[74337]: DEBUG os_vif [None req-e3c90b85-0950-4176-8a52-665b75545ee1 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:a1:dd,bridge_name='br-int',has_traffic_filtering=True,id=b465d0fa-4a02-4ad4-bbeb-03723257d328,network=Network(86669102-0490-4fe4-aba4-8a353e91a763),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb465d0fa-4a') {{(pid=74337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 22:05:30 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:05:30 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:05:30 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 22:05:30 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:05:30 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'beb9d79e-9a9d-5c8d-be7f-2ffac8fb9509', '_type': 'linux-noop'}}, row=False) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:05:30 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:05:30 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:05:30 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:05:30 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb465d0fa-4a, may_exist=True, interface_attrs={}) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:05:30 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb465d0fa-4a, col_values=(('qos', UUID('95dcd072-5741-461a-9ea7-9ce40c0afc44')),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:05:30 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb465d0fa-4a, col_values=(('external_ids', {'iface-id': 'b465d0fa-4a02-4ad4-bbeb-03723257d328', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:75:a1:dd', 'vm-uuid': '7c970dae-cf7b-4267-8adc-843d00780e37'}),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:05:30 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:05:30 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:05:30 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:05:30 user nova-compute[74337]: INFO os_vif [None req-e3c90b85-0950-4176-8a52-665b75545ee1 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:a1:dd,bridge_name='br-int',has_traffic_filtering=True,id=b465d0fa-4a02-4ad4-bbeb-03723257d328,network=Network(86669102-0490-4fe4-aba4-8a353e91a763),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb465d0fa-4a')
Oct 23 22:05:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/999843b2-b757-480b-bd21-bf281954bc46/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:05:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/999843b2-b757-480b-bd21-bf281954bc46/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:05:30 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-e3c90b85-0950-4176-8a52-665b75545ee1 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] No BDM found with device name vda, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 22:05:30 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-e3c90b85-0950-4176-8a52-665b75545ee1 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] No VIF found with MAC fa:16:3e:75:a1:dd, not building metadata {{(pid=74337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 22:05:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/999843b2-b757-480b-bd21-bf281954bc46/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:05:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk.rescue --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:05:30 user nova-compute[74337]: DEBUG nova.network.neutron [req-fb4a31da-157d-46b2-b557-99e6aea00d52 req-4ec03eee-7720-47a4-9cac-fd78f7229924 service nova] [instance: 7c970dae-cf7b-4267-8adc-843d00780e37] Updated VIF entry in instance network info cache for port b465d0fa-4a02-4ad4-bbeb-03723257d328. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 22:05:30 user nova-compute[74337]: DEBUG nova.network.neutron [req-fb4a31da-157d-46b2-b557-99e6aea00d52 req-4ec03eee-7720-47a4-9cac-fd78f7229924 service nova] [instance: 7c970dae-cf7b-4267-8adc-843d00780e37] Updating instance_info_cache with network_info: [{"id": "b465d0fa-4a02-4ad4-bbeb-03723257d328", "address": "fa:16:3e:75:a1:dd", "network": {"id": "86669102-0490-4fe4-aba4-8a353e91a763", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1218528793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799c72bbb3e248b99463567aba2049db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb465d0fa-4a", "ovs_interfaceid": "b465d0fa-4a02-4ad4-bbeb-03723257d328", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 22:05:30 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-fb4a31da-157d-46b2-b557-99e6aea00d52 req-4ec03eee-7720-47a4-9cac-fd78f7229924 service nova] Releasing lock "refresh_cache-7c970dae-cf7b-4267-8adc-843d00780e37" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 22:05:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk.rescue --force-share --output=json" returned: 0 in 0.210s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:05:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk.rescue --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:05:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:05:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:05:31 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:05:31 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:05:31 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:05:34 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:05:34 user nova-compute[74337]: DEBUG nova.compute.manager [None req-e3c90b85-0950-4176-8a52-665b75545ee1 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] [instance: 7c970dae-cf7b-4267-8adc-843d00780e37] Instance event wait completed in 0 seconds for  {{(pid=74337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 22:05:34 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-e3c90b85-0950-4176-8a52-665b75545ee1 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] [instance: 7c970dae-cf7b-4267-8adc-843d00780e37] Guest created on hypervisor {{(pid=74337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 22:05:34 user nova-compute[74337]: DEBUG nova.compute.manager [req-ad8dcdbb-a4a5-4c5d-b1f6-ea417641c34c req-0ce189dc-b9df-4a1f-bb44-31eebef0d17c service nova] [instance: 7c970dae-cf7b-4267-8adc-843d00780e37] Received event network-vif-plugged-b465d0fa-4a02-4ad4-bbeb-03723257d328 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:05:34 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ad8dcdbb-a4a5-4c5d-b1f6-ea417641c34c req-0ce189dc-b9df-4a1f-bb44-31eebef0d17c service nova] Acquiring lock "7c970dae-cf7b-4267-8adc-843d00780e37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:05:34 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ad8dcdbb-a4a5-4c5d-b1f6-ea417641c34c req-0ce189dc-b9df-4a1f-bb44-31eebef0d17c service nova] Lock "7c970dae-cf7b-4267-8adc-843d00780e37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:05:34 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ad8dcdbb-a4a5-4c5d-b1f6-ea417641c34c req-0ce189dc-b9df-4a1f-bb44-31eebef0d17c service nova] Lock "7c970dae-cf7b-4267-8adc-843d00780e37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:05:34 user nova-compute[74337]: DEBUG nova.compute.manager [req-ad8dcdbb-a4a5-4c5d-b1f6-ea417641c34c req-0ce189dc-b9df-4a1f-bb44-31eebef0d17c service nova] [instance: 7c970dae-cf7b-4267-8adc-843d00780e37] No waiting events found dispatching network-vif-plugged-b465d0fa-4a02-4ad4-bbeb-03723257d328 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 22:05:34 user nova-compute[74337]: WARNING nova.compute.manager [req-ad8dcdbb-a4a5-4c5d-b1f6-ea417641c34c req-0ce189dc-b9df-4a1f-bb44-31eebef0d17c service nova] [instance: 7c970dae-cf7b-4267-8adc-843d00780e37] Received unexpected event network-vif-plugged-b465d0fa-4a02-4ad4-bbeb-03723257d328 for instance with vm_state building and task_state spawning.
Oct 23 22:05:34 user nova-compute[74337]: DEBUG nova.compute.manager [req-e59e64ce-30a9-4b99-b992-5e8500f58998 req-7450c7d4-e143-47ea-8af5-0b61c078964d service nova] [instance: 7c970dae-cf7b-4267-8adc-843d00780e37] Received event network-vif-plugged-b465d0fa-4a02-4ad4-bbeb-03723257d328 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:05:34 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-e59e64ce-30a9-4b99-b992-5e8500f58998 req-7450c7d4-e143-47ea-8af5-0b61c078964d service nova] Acquiring lock "7c970dae-cf7b-4267-8adc-843d00780e37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:05:34 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-e59e64ce-30a9-4b99-b992-5e8500f58998 req-7450c7d4-e143-47ea-8af5-0b61c078964d service nova] Lock "7c970dae-cf7b-4267-8adc-843d00780e37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:05:34 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-e59e64ce-30a9-4b99-b992-5e8500f58998 req-7450c7d4-e143-47ea-8af5-0b61c078964d service nova] Lock "7c970dae-cf7b-4267-8adc-843d00780e37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:05:34 user nova-compute[74337]: DEBUG nova.compute.manager [req-e59e64ce-30a9-4b99-b992-5e8500f58998 req-7450c7d4-e143-47ea-8af5-0b61c078964d service nova] [instance: 7c970dae-cf7b-4267-8adc-843d00780e37] No waiting events found dispatching network-vif-plugged-b465d0fa-4a02-4ad4-bbeb-03723257d328 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 22:05:34 user nova-compute[74337]: WARNING nova.compute.manager [req-e59e64ce-30a9-4b99-b992-5e8500f58998 req-7450c7d4-e143-47ea-8af5-0b61c078964d service nova] [instance: 7c970dae-cf7b-4267-8adc-843d00780e37] Received unexpected event network-vif-plugged-b465d0fa-4a02-4ad4-bbeb-03723257d328 for instance with vm_state building and task_state spawning.
Oct 23 22:05:34 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:05:34 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:05:34 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Hypervisor/Node resource view: name=user free_ram=8531MB free_disk=25.224143981933594GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 22:05:34 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:05:34 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:05:34 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: 7c970dae-cf7b-4267-8adc-843d00780e37] Instance spawned successfully.
Oct 23 22:05:34 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-e3c90b85-0950-4176-8a52-665b75545ee1 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] [instance: 7c970dae-cf7b-4267-8adc-843d00780e37] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 22:05:34 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-e3c90b85-0950-4176-8a52-665b75545ee1 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] [instance: 7c970dae-cf7b-4267-8adc-843d00780e37] Found default for hw_cdrom_bus of ide {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 22:05:34 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-e3c90b85-0950-4176-8a52-665b75545ee1 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] [instance: 7c970dae-cf7b-4267-8adc-843d00780e37] Found default for hw_disk_bus of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 22:05:34 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-e3c90b85-0950-4176-8a52-665b75545ee1 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] [instance: 7c970dae-cf7b-4267-8adc-843d00780e37] Found default for hw_input_bus of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 22:05:34 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-e3c90b85-0950-4176-8a52-665b75545ee1 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] [instance: 7c970dae-cf7b-4267-8adc-843d00780e37] Found default for hw_pointer_model of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 22:05:34 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-e3c90b85-0950-4176-8a52-665b75545ee1 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] [instance: 7c970dae-cf7b-4267-8adc-843d00780e37] Found default for hw_video_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 22:05:34 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-e3c90b85-0950-4176-8a52-665b75545ee1 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] [instance: 7c970dae-cf7b-4267-8adc-843d00780e37] Found default for hw_vif_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 22:05:34 user nova-compute[74337]: INFO nova.compute.manager [None req-e3c90b85-0950-4176-8a52-665b75545ee1 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] [instance: 7c970dae-cf7b-4267-8adc-843d00780e37] Took 6.17 seconds to spawn the instance on the hypervisor.
Oct 23 22:05:34 user nova-compute[74337]: DEBUG nova.compute.manager [None req-e3c90b85-0950-4176-8a52-665b75545ee1 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] [instance: 7c970dae-cf7b-4267-8adc-843d00780e37] Checking state {{(pid=74337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 22:05:34 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 0323b854-c7a1-42e8-ad85-1e929caa6e9d has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Oct 23 22:05:34 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 999843b2-b757-480b-bd21-bf281954bc46 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 22:05:34 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 27710919-a717-42fa-a436-a261d92c1c2a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 22:05:34 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 7c970dae-cf7b-4267-8adc-843d00780e37 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 22:05:34 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 22:05:34 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 22:05:34 user nova-compute[74337]: INFO nova.compute.manager [None req-e3c90b85-0950-4176-8a52-665b75545ee1 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] [instance: 7c970dae-cf7b-4267-8adc-843d00780e37] Took 6.94 seconds to build instance.
Oct 23 22:05:34 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-e3c90b85-0950-4176-8a52-665b75545ee1 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Lock "7c970dae-cf7b-4267-8adc-843d00780e37" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.052s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:05:34 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 22:05:34 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 22:05:34 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Compute_service record updated for user:user {{(pid=74337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 22:05:34 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.330s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:05:35 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:05:39 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:05:40 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:05:41 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:05:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:05:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:05:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 22:05:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 22:05:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 22:05:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:05:49 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:05:49 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:05:50 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:05:51 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:05:53 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:05:54 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:05:54 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:05:55 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:05:59 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:06:00 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:06:04 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:06:05 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:06:10 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:06:10 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:06:10 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 22:06:10 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 22:06:10 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 22:06:10 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:06:11 user nova-compute[74337]: INFO nova.compute.manager [None req-c74c6d97-c8f9-40e5-b263-55975a23d843 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Unrescuing
Oct 23 22:06:11 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-c74c6d97-c8f9-40e5-b263-55975a23d843 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Acquiring lock "refresh_cache-999843b2-b757-480b-bd21-bf281954bc46" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 22:06:11 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-c74c6d97-c8f9-40e5-b263-55975a23d843 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Acquired lock "refresh_cache-999843b2-b757-480b-bd21-bf281954bc46" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 22:06:11 user nova-compute[74337]: DEBUG nova.network.neutron [None req-c74c6d97-c8f9-40e5-b263-55975a23d843 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Building network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 22:06:11 user nova-compute[74337]: DEBUG nova.network.neutron [None req-c74c6d97-c8f9-40e5-b263-55975a23d843 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Updating instance_info_cache with network_info: [{"id": "02913be6-773f-402a-a534-d7567aeb5b7a", "address": "fa:16:3e:a2:cd:9d", "network": {"id": "122fdd20-8bf5-4374-b50c-82e5dc8684db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-81475496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80f79dd6954748e4806a568a4127396f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02913be6-77", "ovs_interfaceid": "02913be6-773f-402a-a534-d7567aeb5b7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 22:06:11 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-c74c6d97-c8f9-40e5-b263-55975a23d843 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Releasing lock "refresh_cache-999843b2-b757-480b-bd21-bf281954bc46" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 22:06:11 user nova-compute[74337]: DEBUG nova.objects.instance [None req-c74c6d97-c8f9-40e5-b263-55975a23d843 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Lazy-loading 'flavor' on Instance uuid 999843b2-b757-480b-bd21-bf281954bc46 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:06:11 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:06:11 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:06:12 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:06:12 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:06:12 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:06:12 user nova-compute[74337]: DEBUG nova.compute.manager [req-2aba367f-cf20-4a29-8eb8-00a1ab088435 req-c05399b0-d469-479d-a0ca-862faacf123f service nova] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Received event network-vif-unplugged-02913be6-773f-402a-a534-d7567aeb5b7a {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:06:12 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-2aba367f-cf20-4a29-8eb8-00a1ab088435 req-c05399b0-d469-479d-a0ca-862faacf123f service nova] Acquiring lock "999843b2-b757-480b-bd21-bf281954bc46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:06:12 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-2aba367f-cf20-4a29-8eb8-00a1ab088435 req-c05399b0-d469-479d-a0ca-862faacf123f service nova] Lock "999843b2-b757-480b-bd21-bf281954bc46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:06:12 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-2aba367f-cf20-4a29-8eb8-00a1ab088435 req-c05399b0-d469-479d-a0ca-862faacf123f service nova] Lock "999843b2-b757-480b-bd21-bf281954bc46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:06:12 user nova-compute[74337]: DEBUG nova.compute.manager [req-2aba367f-cf20-4a29-8eb8-00a1ab088435 req-c05399b0-d469-479d-a0ca-862faacf123f service nova] [instance: 999843b2-b757-480b-bd21-bf281954bc46] No waiting events found dispatching network-vif-unplugged-02913be6-773f-402a-a534-d7567aeb5b7a {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 22:06:12 user nova-compute[74337]: WARNING nova.compute.manager [req-2aba367f-cf20-4a29-8eb8-00a1ab088435 req-c05399b0-d469-479d-a0ca-862faacf123f service nova] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Received unexpected event network-vif-unplugged-02913be6-773f-402a-a534-d7567aeb5b7a for instance with vm_state rescued and task_state unrescuing.
Oct 23 22:06:12 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Instance destroyed successfully.
Oct 23 22:06:13 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:06:13 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:06:13 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:06:13 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:06:14 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:06:14 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:06:14 user nova-compute[74337]: DEBUG nova.compute.manager [req-bd073395-7781-4936-a813-427719eff3d7 req-5188c9df-bc65-479b-ab4c-64a9057e334d service nova] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Received event network-vif-plugged-02913be6-773f-402a-a534-d7567aeb5b7a {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:06:14 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-bd073395-7781-4936-a813-427719eff3d7 req-5188c9df-bc65-479b-ab4c-64a9057e334d service nova] Acquiring lock "999843b2-b757-480b-bd21-bf281954bc46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:06:14 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-bd073395-7781-4936-a813-427719eff3d7 req-5188c9df-bc65-479b-ab4c-64a9057e334d service nova] Lock "999843b2-b757-480b-bd21-bf281954bc46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:06:14 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-bd073395-7781-4936-a813-427719eff3d7 req-5188c9df-bc65-479b-ab4c-64a9057e334d service nova] Lock "999843b2-b757-480b-bd21-bf281954bc46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:06:14 user nova-compute[74337]: DEBUG nova.compute.manager [req-bd073395-7781-4936-a813-427719eff3d7 req-5188c9df-bc65-479b-ab4c-64a9057e334d service nova] [instance: 999843b2-b757-480b-bd21-bf281954bc46] No waiting events found dispatching network-vif-plugged-02913be6-773f-402a-a534-d7567aeb5b7a {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 22:06:14 user nova-compute[74337]: WARNING nova.compute.manager [req-bd073395-7781-4936-a813-427719eff3d7 req-5188c9df-bc65-479b-ab4c-64a9057e334d service nova] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Received unexpected event network-vif-plugged-02913be6-773f-402a-a534-d7567aeb5b7a for instance with vm_state rescued and task_state unrescuing.
Oct 23 22:06:14 user nova-compute[74337]: DEBUG nova.compute.manager [req-bd073395-7781-4936-a813-427719eff3d7 req-5188c9df-bc65-479b-ab4c-64a9057e334d service nova] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Received event network-vif-plugged-02913be6-773f-402a-a534-d7567aeb5b7a {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:06:14 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-bd073395-7781-4936-a813-427719eff3d7 req-5188c9df-bc65-479b-ab4c-64a9057e334d service nova] Acquiring lock "999843b2-b757-480b-bd21-bf281954bc46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:06:14 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-bd073395-7781-4936-a813-427719eff3d7 req-5188c9df-bc65-479b-ab4c-64a9057e334d service nova] Lock "999843b2-b757-480b-bd21-bf281954bc46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:06:14 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-bd073395-7781-4936-a813-427719eff3d7 req-5188c9df-bc65-479b-ab4c-64a9057e334d service nova] Lock "999843b2-b757-480b-bd21-bf281954bc46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:06:14 user nova-compute[74337]: DEBUG nova.compute.manager [req-bd073395-7781-4936-a813-427719eff3d7 req-5188c9df-bc65-479b-ab4c-64a9057e334d service nova] [instance: 999843b2-b757-480b-bd21-bf281954bc46] No waiting events found dispatching network-vif-plugged-02913be6-773f-402a-a534-d7567aeb5b7a {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 22:06:14 user nova-compute[74337]: WARNING nova.compute.manager [req-bd073395-7781-4936-a813-427719eff3d7 req-5188c9df-bc65-479b-ab4c-64a9057e334d service nova] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Received unexpected event network-vif-plugged-02913be6-773f-402a-a534-d7567aeb5b7a for instance with vm_state rescued and task_state unrescuing.
Oct 23 22:06:14 user nova-compute[74337]: DEBUG nova.compute.manager [req-bd073395-7781-4936-a813-427719eff3d7 req-5188c9df-bc65-479b-ab4c-64a9057e334d service nova] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Received event network-vif-plugged-02913be6-773f-402a-a534-d7567aeb5b7a {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:06:14 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-bd073395-7781-4936-a813-427719eff3d7 req-5188c9df-bc65-479b-ab4c-64a9057e334d service nova] Acquiring lock "999843b2-b757-480b-bd21-bf281954bc46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:06:14 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-bd073395-7781-4936-a813-427719eff3d7 req-5188c9df-bc65-479b-ab4c-64a9057e334d service nova] Lock "999843b2-b757-480b-bd21-bf281954bc46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:06:14 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-bd073395-7781-4936-a813-427719eff3d7 req-5188c9df-bc65-479b-ab4c-64a9057e334d service nova] Lock "999843b2-b757-480b-bd21-bf281954bc46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:06:14 user nova-compute[74337]: DEBUG nova.compute.manager [req-bd073395-7781-4936-a813-427719eff3d7 req-5188c9df-bc65-479b-ab4c-64a9057e334d service nova] [instance: 999843b2-b757-480b-bd21-bf281954bc46] No waiting events found dispatching network-vif-plugged-02913be6-773f-402a-a534-d7567aeb5b7a {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 22:06:14 user nova-compute[74337]: WARNING nova.compute.manager [req-bd073395-7781-4936-a813-427719eff3d7 req-5188c9df-bc65-479b-ab4c-64a9057e334d service nova] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Received unexpected event network-vif-plugged-02913be6-773f-402a-a534-d7567aeb5b7a for instance with vm_state rescued and task_state unrescuing.
Oct 23 22:06:15 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:06:15 user nova-compute[74337]: DEBUG nova.compute.manager [None req-c74c6d97-c8f9-40e5-b263-55975a23d843 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Checking state {{(pid=74337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 22:06:19 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:06:20 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:06:21 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:06:22 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:06:22 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 22:06:24 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:06:24 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:06:25 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:06:25 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:06:25 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 22:06:25 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 22:06:25 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 22:06:25 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:06:26 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:06:29 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:06:29 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Starting heal instance info cache {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 22:06:29 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "refresh_cache-27710919-a717-42fa-a436-a261d92c1c2a" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 22:06:29 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquired lock "refresh_cache-27710919-a717-42fa-a436-a261d92c1c2a" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 22:06:29 user nova-compute[74337]: DEBUG nova.network.neutron [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 27710919-a717-42fa-a436-a261d92c1c2a] Forcefully refreshing network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 22:06:29 user nova-compute[74337]: DEBUG nova.network.neutron [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 27710919-a717-42fa-a436-a261d92c1c2a] Updating instance_info_cache with network_info: [{"id": "85905b2e-3e09-4236-8fe7-ea6c31324ae6", "address": "fa:16:3e:50:cd:90", "network": {"id": "122fdd20-8bf5-4374-b50c-82e5dc8684db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-81475496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80f79dd6954748e4806a568a4127396f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85905b2e-3e", "ovs_interfaceid": "85905b2e-3e09-4236-8fe7-ea6c31324ae6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 22:06:29 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Releasing lock "refresh_cache-27710919-a717-42fa-a436-a261d92c1c2a" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 22:06:29 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 27710919-a717-42fa-a436-a261d92c1c2a] Updated the network info_cache for instance {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 22:06:29 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:06:29 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:06:29 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:06:29 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:06:29 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Auditing locally available compute resources for user (node: user) {{(pid=74337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 22:06:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/999843b2-b757-480b-bd21-bf281954bc46/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:06:30 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:06:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/999843b2-b757-480b-bd21-bf281954bc46/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:06:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/999843b2-b757-480b-bd21-bf281954bc46/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:06:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/999843b2-b757-480b-bd21-bf281954bc46/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:06:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c970dae-cf7b-4267-8adc-843d00780e37/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:06:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c970dae-cf7b-4267-8adc-843d00780e37/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:06:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c970dae-cf7b-4267-8adc-843d00780e37/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:06:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c970dae-cf7b-4267-8adc-843d00780e37/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:06:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk.rescue --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:06:31 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:06:31 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk.rescue --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:06:31 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:06:31 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:06:31 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:06:31 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:06:31 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:06:31 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:06:31 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:06:31 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Hypervisor/Node resource view: name=user free_ram=8462MB free_disk=25.22399139404297GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 22:06:31 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:06:31 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:06:32 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 0323b854-c7a1-42e8-ad85-1e929caa6e9d has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Oct 23 22:06:32 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 999843b2-b757-480b-bd21-bf281954bc46 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 22:06:32 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 27710919-a717-42fa-a436-a261d92c1c2a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 22:06:32 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 7c970dae-cf7b-4267-8adc-843d00780e37 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 22:06:32 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 22:06:32 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 22:06:32 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 22:06:32 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 22:06:32 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Compute_service record updated for user:user {{(pid=74337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 22:06:32 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.299s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:06:32 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:06:34 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:06:35 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:06:36 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:06:37 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:06:39 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:06:40 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:06:40 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:06:43 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:06:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:06:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:06:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:06:49 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:06:49 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-0fc3e250-057e-4646-94ec-fb22a862cdae tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Acquiring lock "106da458-caec-4114-8904-0411ec0ea903" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:06:49 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-0fc3e250-057e-4646-94ec-fb22a862cdae tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Lock "106da458-caec-4114-8904-0411ec0ea903" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:06:49 user nova-compute[74337]: DEBUG nova.compute.manager [None req-0fc3e250-057e-4646-94ec-fb22a862cdae tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] [instance: 106da458-caec-4114-8904-0411ec0ea903] Starting instance... {{(pid=74337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 22:06:49 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-0fc3e250-057e-4646-94ec-fb22a862cdae tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:06:49 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-0fc3e250-057e-4646-94ec-fb22a862cdae tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:06:49 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-0fc3e250-057e-4646-94ec-fb22a862cdae tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 22:06:49 user nova-compute[74337]: INFO nova.compute.claims [None req-0fc3e250-057e-4646-94ec-fb22a862cdae tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] [instance: 106da458-caec-4114-8904-0411ec0ea903] Claim successful on node user
Oct 23 22:06:49 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-0fc3e250-057e-4646-94ec-fb22a862cdae tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 22:06:49 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-0fc3e250-057e-4646-94ec-fb22a862cdae tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 22:06:49 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-0fc3e250-057e-4646-94ec-fb22a862cdae tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.267s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:06:49 user nova-compute[74337]: DEBUG nova.compute.manager [None req-0fc3e250-057e-4646-94ec-fb22a862cdae tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] [instance: 106da458-caec-4114-8904-0411ec0ea903] Start building networks asynchronously for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 22:06:49 user nova-compute[74337]: DEBUG nova.compute.manager [None req-0fc3e250-057e-4646-94ec-fb22a862cdae tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] [instance: 106da458-caec-4114-8904-0411ec0ea903] Allocating IP information in the background. {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 22:06:49 user nova-compute[74337]: DEBUG nova.network.neutron [None req-0fc3e250-057e-4646-94ec-fb22a862cdae tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] [instance: 106da458-caec-4114-8904-0411ec0ea903] allocate_for_instance() {{(pid=74337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 22:06:49 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-0fc3e250-057e-4646-94ec-fb22a862cdae tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] [instance: 106da458-caec-4114-8904-0411ec0ea903] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 22:06:49 user nova-compute[74337]: DEBUG nova.compute.manager [None req-0fc3e250-057e-4646-94ec-fb22a862cdae tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] [instance: 106da458-caec-4114-8904-0411ec0ea903] Start building block device mappings for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 22:06:49 user nova-compute[74337]: DEBUG nova.policy [None req-0fc3e250-057e-4646-94ec-fb22a862cdae tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a96a8803687f4b7db06e29b5b736ade1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc044020751d475b94e96fcedb97b86c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74337) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 22:06:49 user nova-compute[74337]: DEBUG nova.compute.manager [None req-0fc3e250-057e-4646-94ec-fb22a862cdae tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] [instance: 106da458-caec-4114-8904-0411ec0ea903] Start spawning the instance on the hypervisor. {{(pid=74337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 22:06:49 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-0fc3e250-057e-4646-94ec-fb22a862cdae tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] [instance: 106da458-caec-4114-8904-0411ec0ea903] Creating instance directory {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 22:06:49 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-0fc3e250-057e-4646-94ec-fb22a862cdae tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] [instance: 106da458-caec-4114-8904-0411ec0ea903] Creating image(s)
Oct 23 22:06:49 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-0fc3e250-057e-4646-94ec-fb22a862cdae tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Acquiring lock "/opt/stack/data/nova/instances/106da458-caec-4114-8904-0411ec0ea903/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:06:49 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-0fc3e250-057e-4646-94ec-fb22a862cdae tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Lock "/opt/stack/data/nova/instances/106da458-caec-4114-8904-0411ec0ea903/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:06:49 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-0fc3e250-057e-4646-94ec-fb22a862cdae tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Lock "/opt/stack/data/nova/instances/106da458-caec-4114-8904-0411ec0ea903/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:06:49 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-0fc3e250-057e-4646-94ec-fb22a862cdae tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:06:50 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-0fc3e250-057e-4646-94ec-fb22a862cdae tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.192s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:06:50 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-0fc3e250-057e-4646-94ec-fb22a862cdae tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Acquiring lock "fc7b140751b8c385de81623e40fb09ce09374ab7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:06:50 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-0fc3e250-057e-4646-94ec-fb22a862cdae tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Lock "fc7b140751b8c385de81623e40fb09ce09374ab7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:06:50 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-0fc3e250-057e-4646-94ec-fb22a862cdae tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:06:50 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:06:50 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-0fc3e250-057e-4646-94ec-fb22a862cdae tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.178s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:06:50 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-0fc3e250-057e-4646-94ec-fb22a862cdae tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7,backing_fmt=raw /opt/stack/data/nova/instances/106da458-caec-4114-8904-0411ec0ea903/disk 1073741824 {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:06:50 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-0fc3e250-057e-4646-94ec-fb22a862cdae tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7,backing_fmt=raw /opt/stack/data/nova/instances/106da458-caec-4114-8904-0411ec0ea903/disk 1073741824" returned: 0 in 0.054s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:06:50 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-0fc3e250-057e-4646-94ec-fb22a862cdae tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Lock "fc7b140751b8c385de81623e40fb09ce09374ab7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:06:50 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-0fc3e250-057e-4646-94ec-fb22a862cdae tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:06:50 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-0fc3e250-057e-4646-94ec-fb22a862cdae tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.180s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:06:50 user nova-compute[74337]: DEBUG nova.virt.disk.api [None req-0fc3e250-057e-4646-94ec-fb22a862cdae tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Checking if we can resize image /opt/stack/data/nova/instances/106da458-caec-4114-8904-0411ec0ea903/disk. size=1073741824 {{(pid=74337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 22:06:50 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-0fc3e250-057e-4646-94ec-fb22a862cdae tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/106da458-caec-4114-8904-0411ec0ea903/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:06:50 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-0fc3e250-057e-4646-94ec-fb22a862cdae tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/106da458-caec-4114-8904-0411ec0ea903/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:06:50 user nova-compute[74337]: DEBUG nova.virt.disk.api [None req-0fc3e250-057e-4646-94ec-fb22a862cdae tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Cannot resize image /opt/stack/data/nova/instances/106da458-caec-4114-8904-0411ec0ea903/disk to a smaller size. {{(pid=74337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 22:06:50 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-0fc3e250-057e-4646-94ec-fb22a862cdae tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] [instance: 106da458-caec-4114-8904-0411ec0ea903] Created local disks {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 22:06:50 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-0fc3e250-057e-4646-94ec-fb22a862cdae tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] [instance: 106da458-caec-4114-8904-0411ec0ea903] Ensure instance console log exists: /opt/stack/data/nova/instances/106da458-caec-4114-8904-0411ec0ea903/console.log {{(pid=74337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 22:06:50 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-0fc3e250-057e-4646-94ec-fb22a862cdae tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:06:50 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-0fc3e250-057e-4646-94ec-fb22a862cdae tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:06:50 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-0fc3e250-057e-4646-94ec-fb22a862cdae tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:06:50 user nova-compute[74337]: DEBUG nova.network.neutron [None req-0fc3e250-057e-4646-94ec-fb22a862cdae tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] [instance: 106da458-caec-4114-8904-0411ec0ea903] Successfully created port: 7a60434b-7f31-4b05-a494-97e58e72a5c1 {{(pid=74337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 22:06:51 user nova-compute[74337]: DEBUG nova.network.neutron [None req-0fc3e250-057e-4646-94ec-fb22a862cdae tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] [instance: 106da458-caec-4114-8904-0411ec0ea903] Successfully updated port: 7a60434b-7f31-4b05-a494-97e58e72a5c1 {{(pid=74337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 22:06:51 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-0fc3e250-057e-4646-94ec-fb22a862cdae tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Acquiring lock "refresh_cache-106da458-caec-4114-8904-0411ec0ea903" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 22:06:51 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-0fc3e250-057e-4646-94ec-fb22a862cdae tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Acquired lock "refresh_cache-106da458-caec-4114-8904-0411ec0ea903" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 22:06:51 user nova-compute[74337]: DEBUG nova.network.neutron [None req-0fc3e250-057e-4646-94ec-fb22a862cdae tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] [instance: 106da458-caec-4114-8904-0411ec0ea903] Building network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 22:06:51 user nova-compute[74337]: DEBUG nova.compute.manager [req-98867e0b-4895-4174-9e40-c71c6ff8f196 req-ea6ece07-527e-4aac-b9d7-3315fa191665 service nova] [instance: 106da458-caec-4114-8904-0411ec0ea903] Received event network-changed-7a60434b-7f31-4b05-a494-97e58e72a5c1 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:06:51 user nova-compute[74337]: DEBUG nova.compute.manager [req-98867e0b-4895-4174-9e40-c71c6ff8f196 req-ea6ece07-527e-4aac-b9d7-3315fa191665 service nova] [instance: 106da458-caec-4114-8904-0411ec0ea903] Refreshing instance network info cache due to event network-changed-7a60434b-7f31-4b05-a494-97e58e72a5c1. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 22:06:51 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-98867e0b-4895-4174-9e40-c71c6ff8f196 req-ea6ece07-527e-4aac-b9d7-3315fa191665 service nova] Acquiring lock "refresh_cache-106da458-caec-4114-8904-0411ec0ea903" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 22:06:51 user nova-compute[74337]: DEBUG nova.network.neutron [None req-0fc3e250-057e-4646-94ec-fb22a862cdae tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] [instance: 106da458-caec-4114-8904-0411ec0ea903] Instance cache missing network info. {{(pid=74337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 22:06:51 user nova-compute[74337]: DEBUG nova.network.neutron [None req-0fc3e250-057e-4646-94ec-fb22a862cdae tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] [instance: 106da458-caec-4114-8904-0411ec0ea903] Updating instance_info_cache with network_info: [{"id": "7a60434b-7f31-4b05-a494-97e58e72a5c1", "address": "fa:16:3e:ea:23:b1", "network": {"id": "09783701-f9c4-4d08-8523-6e363a558ec0", "bridge": "br-int", "label": "tempest-TestStampPattern-974584378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc044020751d475b94e96fcedb97b86c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a60434b-7f", "ovs_interfaceid": "7a60434b-7f31-4b05-a494-97e58e72a5c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 22:06:51 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-0fc3e250-057e-4646-94ec-fb22a862cdae tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Releasing lock "refresh_cache-106da458-caec-4114-8904-0411ec0ea903" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 22:06:51 user nova-compute[74337]: DEBUG nova.compute.manager [None req-0fc3e250-057e-4646-94ec-fb22a862cdae tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] [instance: 106da458-caec-4114-8904-0411ec0ea903] Instance network_info: |[{"id": "7a60434b-7f31-4b05-a494-97e58e72a5c1", "address": "fa:16:3e:ea:23:b1", "network": {"id": "09783701-f9c4-4d08-8523-6e363a558ec0", "bridge": "br-int", "label": "tempest-TestStampPattern-974584378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc044020751d475b94e96fcedb97b86c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a60434b-7f", "ovs_interfaceid": "7a60434b-7f31-4b05-a494-97e58e72a5c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 22:06:51 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-98867e0b-4895-4174-9e40-c71c6ff8f196 req-ea6ece07-527e-4aac-b9d7-3315fa191665 service nova] Acquired lock "refresh_cache-106da458-caec-4114-8904-0411ec0ea903" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 22:06:51 user nova-compute[74337]: DEBUG nova.network.neutron [req-98867e0b-4895-4174-9e40-c71c6ff8f196 req-ea6ece07-527e-4aac-b9d7-3315fa191665 service nova] [instance: 106da458-caec-4114-8904-0411ec0ea903] Refreshing network info cache for port 7a60434b-7f31-4b05-a494-97e58e72a5c1 {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 22:06:51 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-0fc3e250-057e-4646-94ec-fb22a862cdae tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] [instance: 106da458-caec-4114-8904-0411ec0ea903] Start _get_guest_xml network_info=[{"id": "7a60434b-7f31-4b05-a494-97e58e72a5c1", "address": "fa:16:3e:ea:23:b1", "network": {"id": "09783701-f9c4-4d08-8523-6e363a558ec0", "bridge": "br-int", "label": "tempest-TestStampPattern-974584378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc044020751d475b94e96fcedb97b86c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a60434b-7f", "ovs_interfaceid": "7a60434b-7f31-4b05-a494-97e58e72a5c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T21:29:21Z,direct_url=<?>,disk_format='qcow2',id=d859d89d-998d-4109-b26a-0d6e28152932,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ff43462300764979a6cf688444336a56',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T21:29:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'image_id': 'd859d89d-998d-4109-b26a-0d6e28152932'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 22:06:51 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-0fc3e250-057e-4646-94ec-fb22a862cdae tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:06:51 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-0fc3e250-057e-4646-94ec-fb22a862cdae tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:06:51 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-0fc3e250-057e-4646-94ec-fb22a862cdae tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 22:06:51 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-0fc3e250-057e-4646-94ec-fb22a862cdae tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] CPU controller missing on host. {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 22:06:51 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-0fc3e250-057e-4646-94ec-fb22a862cdae tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 22:06:51 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-0fc3e250-057e-4646-94ec-fb22a862cdae tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] CPU controller found on host. {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 22:06:51 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-0fc3e250-057e-4646-94ec-fb22a862cdae tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 22:06:51 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-0fc3e250-057e-4646-94ec-fb22a862cdae tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T21:29:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T21:29:21Z,direct_url=<?>,disk_format='qcow2',id=d859d89d-998d-4109-b26a-0d6e28152932,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ff43462300764979a6cf688444336a56',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T21:29:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 22:06:51 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-0fc3e250-057e-4646-94ec-fb22a862cdae tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Flavor limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 22:06:51 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-0fc3e250-057e-4646-94ec-fb22a862cdae tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Image limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 22:06:51 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-0fc3e250-057e-4646-94ec-fb22a862cdae tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Flavor pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 22:06:51 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-0fc3e250-057e-4646-94ec-fb22a862cdae tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Image pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 22:06:51 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-0fc3e250-057e-4646-94ec-fb22a862cdae tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 22:06:51 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-0fc3e250-057e-4646-94ec-fb22a862cdae tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 22:06:51 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-0fc3e250-057e-4646-94ec-fb22a862cdae tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 22:06:51 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-0fc3e250-057e-4646-94ec-fb22a862cdae tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Got 1 possible topologies {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 22:06:51 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-0fc3e250-057e-4646-94ec-fb22a862cdae tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 22:06:51 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-0fc3e250-057e-4646-94ec-fb22a862cdae tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 22:06:51 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-0fc3e250-057e-4646-94ec-fb22a862cdae tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T22:06:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-317244420',display_name='tempest-TestStampPattern-server-317244420',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-317244420',id=48,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM/w5IxSPpZmfXwphA/Co4/hp2D6fAjEAT72VAt3V+4E9LsYzs0Ns5n7Z6WZABZZJFZarcd4Py5ieFgN0v3D5Oi+9O8evYRVN2/Q9FEiDD/ZoEa6QuGDQ0iF55PrsWzQHw==',key_name='tempest-TestStampPattern-561385519',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bc044020751d475b94e96fcedb97b86c',ramdisk_id='',reservation_id='r-7d6d42jk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-955971620',owner_user_name='tempest-TestStampPattern-955971620-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T22:06:50Z,user_data=None,user_id='a96a8803687f4b7db06e29b5b736ade1',uuid=106da458-caec-4114-8904-0411ec0ea903,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a60434b-7f31-4b05-a494-97e58e72a5c1", "address": "fa:16:3e:ea:23:b1", "network": {"id": "09783701-f9c4-4d08-8523-6e363a558ec0", "bridge": "br-int", "label": "tempest-TestStampPattern-974584378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc044020751d475b94e96fcedb97b86c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a60434b-7f", "ovs_interfaceid": "7a60434b-7f31-4b05-a494-97e58e72a5c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 22:06:51 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-0fc3e250-057e-4646-94ec-fb22a862cdae tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Converting VIF {"id": "7a60434b-7f31-4b05-a494-97e58e72a5c1", "address": "fa:16:3e:ea:23:b1", "network": {"id": "09783701-f9c4-4d08-8523-6e363a558ec0", "bridge": "br-int", "label": "tempest-TestStampPattern-974584378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc044020751d475b94e96fcedb97b86c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a60434b-7f", "ovs_interfaceid": "7a60434b-7f31-4b05-a494-97e58e72a5c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 22:06:51 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-0fc3e250-057e-4646-94ec-fb22a862cdae tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:23:b1,bridge_name='br-int',has_traffic_filtering=True,id=7a60434b-7f31-4b05-a494-97e58e72a5c1,network=Network(09783701-f9c4-4d08-8523-6e363a558ec0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a60434b-7f') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 22:06:51 user nova-compute[74337]: DEBUG nova.objects.instance [None req-0fc3e250-057e-4646-94ec-fb22a862cdae tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Lazy-loading 'pci_devices' on Instance uuid 106da458-caec-4114-8904-0411ec0ea903 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:06:51 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-0fc3e250-057e-4646-94ec-fb22a862cdae tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] [instance: 106da458-caec-4114-8904-0411ec0ea903] End _get_guest_xml xml=<domain type="kvm">
Oct 23 22:06:51 user nova-compute[74337]:   <uuid>106da458-caec-4114-8904-0411ec0ea903</uuid>
Oct 23 22:06:51 user nova-compute[74337]:   <name>instance-00000030</name>
Oct 23 22:06:51 user nova-compute[74337]:   <memory>524288</memory>
Oct 23 22:06:51 user nova-compute[74337]:   <vcpu>1</vcpu>
Oct 23 22:06:51 user nova-compute[74337]:   <metadata>
Oct 23 22:06:51 user nova-compute[74337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 22:06:51 user nova-compute[74337]:       <nova:package version="0.0.0"/>
Oct 23 22:06:51 user nova-compute[74337]:       <nova:name>tempest-TestStampPattern-server-317244420</nova:name>
Oct 23 22:06:51 user nova-compute[74337]:       <nova:creationTime>2023-10-23 22:06:51</nova:creationTime>
Oct 23 22:06:51 user nova-compute[74337]:       <nova:flavor name="m1.tiny">
Oct 23 22:06:51 user nova-compute[74337]:         <nova:memory>512</nova:memory>
Oct 23 22:06:51 user nova-compute[74337]:         <nova:disk>1</nova:disk>
Oct 23 22:06:51 user nova-compute[74337]:         <nova:swap>0</nova:swap>
Oct 23 22:06:51 user nova-compute[74337]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 22:06:51 user nova-compute[74337]:         <nova:vcpus>1</nova:vcpus>
Oct 23 22:06:51 user nova-compute[74337]:       </nova:flavor>
Oct 23 22:06:51 user nova-compute[74337]:       <nova:owner>
Oct 23 22:06:51 user nova-compute[74337]:         <nova:user uuid="a96a8803687f4b7db06e29b5b736ade1">tempest-TestStampPattern-955971620-project-member</nova:user>
Oct 23 22:06:51 user nova-compute[74337]:         <nova:project uuid="bc044020751d475b94e96fcedb97b86c">tempest-TestStampPattern-955971620</nova:project>
Oct 23 22:06:51 user nova-compute[74337]:       </nova:owner>
Oct 23 22:06:51 user nova-compute[74337]:       <nova:root type="image" uuid="d859d89d-998d-4109-b26a-0d6e28152932"/>
Oct 23 22:06:51 user nova-compute[74337]:       <nova:ports>
Oct 23 22:06:51 user nova-compute[74337]:         <nova:port uuid="7a60434b-7f31-4b05-a494-97e58e72a5c1">
Oct 23 22:06:51 user nova-compute[74337]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 23 22:06:51 user nova-compute[74337]:         </nova:port>
Oct 23 22:06:51 user nova-compute[74337]:       </nova:ports>
Oct 23 22:06:51 user nova-compute[74337]:     </nova:instance>
Oct 23 22:06:51 user nova-compute[74337]:   </metadata>
Oct 23 22:06:51 user nova-compute[74337]:   <sysinfo type="smbios">
Oct 23 22:06:51 user nova-compute[74337]:     <system>
Oct 23 22:06:51 user nova-compute[74337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 22:06:51 user nova-compute[74337]:       <entry name="product">OpenStack Nova</entry>
Oct 23 22:06:51 user nova-compute[74337]:       <entry name="version">0.0.0</entry>
Oct 23 22:06:51 user nova-compute[74337]:       <entry name="serial">106da458-caec-4114-8904-0411ec0ea903</entry>
Oct 23 22:06:51 user nova-compute[74337]:       <entry name="uuid">106da458-caec-4114-8904-0411ec0ea903</entry>
Oct 23 22:06:51 user nova-compute[74337]:       <entry name="family">Virtual Machine</entry>
Oct 23 22:06:51 user nova-compute[74337]:     </system>
Oct 23 22:06:51 user nova-compute[74337]:   </sysinfo>
Oct 23 22:06:51 user nova-compute[74337]:   <os>
Oct 23 22:06:51 user nova-compute[74337]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 22:06:51 user nova-compute[74337]:     <boot dev="hd"/>
Oct 23 22:06:51 user nova-compute[74337]:     <smbios mode="sysinfo"/>
Oct 23 22:06:51 user nova-compute[74337]:   </os>
Oct 23 22:06:51 user nova-compute[74337]:   <features>
Oct 23 22:06:51 user nova-compute[74337]:     <acpi/>
Oct 23 22:06:51 user nova-compute[74337]:     <apic/>
Oct 23 22:06:51 user nova-compute[74337]:     <vmcoreinfo/>
Oct 23 22:06:51 user nova-compute[74337]:   </features>
Oct 23 22:06:51 user nova-compute[74337]:   <clock offset="utc">
Oct 23 22:06:51 user nova-compute[74337]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 22:06:51 user nova-compute[74337]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 22:06:51 user nova-compute[74337]:     <timer name="hpet" present="no"/>
Oct 23 22:06:51 user nova-compute[74337]:   </clock>
Oct 23 22:06:51 user nova-compute[74337]:   <cpu mode="custom" match="exact">
Oct 23 22:06:51 user nova-compute[74337]:     <model>Nehalem</model>
Oct 23 22:06:51 user nova-compute[74337]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 22:06:51 user nova-compute[74337]:   </cpu>
Oct 23 22:06:51 user nova-compute[74337]:   <devices>
Oct 23 22:06:51 user nova-compute[74337]:     <disk type="file" device="disk">
Oct 23 22:06:51 user nova-compute[74337]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 22:06:51 user nova-compute[74337]:       <source file="/opt/stack/data/nova/instances/106da458-caec-4114-8904-0411ec0ea903/disk"/>
Oct 23 22:06:51 user nova-compute[74337]:       <target dev="vda" bus="virtio"/>
Oct 23 22:06:51 user nova-compute[74337]:     </disk>
Oct 23 22:06:51 user nova-compute[74337]:     <interface type="ethernet">
Oct 23 22:06:51 user nova-compute[74337]:       <mac address="fa:16:3e:ea:23:b1"/>
Oct 23 22:06:51 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 22:06:51 user nova-compute[74337]:       <mtu size="1442"/>
Oct 23 22:06:51 user nova-compute[74337]:       <target dev="tap7a60434b-7f"/>
Oct 23 22:06:51 user nova-compute[74337]:     </interface>
Oct 23 22:06:51 user nova-compute[74337]:     <serial type="pty">
Oct 23 22:06:51 user nova-compute[74337]:       <log file="/opt/stack/data/nova/instances/106da458-caec-4114-8904-0411ec0ea903/console.log" append="off"/>
Oct 23 22:06:51 user nova-compute[74337]:     </serial>
Oct 23 22:06:51 user nova-compute[74337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 22:06:51 user nova-compute[74337]:     <video>
Oct 23 22:06:51 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 22:06:51 user nova-compute[74337]:     </video>
Oct 23 22:06:51 user nova-compute[74337]:     <rng model="virtio">
Oct 23 22:06:51 user nova-compute[74337]:       <backend model="random">/dev/urandom</backend>
Oct 23 22:06:51 user nova-compute[74337]:     </rng>
Oct 23 22:06:51 user nova-compute[74337]:     <controller type="usb" index="0" model="none"/>
Oct 23 22:06:51 user nova-compute[74337]:     <memballoon model="virtio">
Oct 23 22:06:51 user nova-compute[74337]:       <stats period="10"/>
Oct 23 22:06:51 user nova-compute[74337]:     </memballoon>
Oct 23 22:06:51 user nova-compute[74337]:   </devices>
Oct 23 22:06:51 user nova-compute[74337]: </domain>
Oct 23 22:06:51 user nova-compute[74337]:  {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 22:06:51 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-0fc3e250-057e-4646-94ec-fb22a862cdae tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T22:06:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-317244420',display_name='tempest-TestStampPattern-server-317244420',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-317244420',id=48,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM/w5IxSPpZmfXwphA/Co4/hp2D6fAjEAT72VAt3V+4E9LsYzs0Ns5n7Z6WZABZZJFZarcd4Py5ieFgN0v3D5Oi+9O8evYRVN2/Q9FEiDD/ZoEa6QuGDQ0iF55PrsWzQHw==',key_name='tempest-TestStampPattern-561385519',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bc044020751d475b94e96fcedb97b86c',ramdisk_id='',reservation_id='r-7d6d42jk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-955971620',owner_user_name='tempest-TestStampPattern-955971620-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T22:06:50Z,user_data=None,user_id='a96a8803687f4b7db06e29b5b736ade1',uuid=106da458-caec-4114-8904-0411ec0ea903,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a60434b-7f31-4b05-a494-97e58e72a5c1", "address": "fa:16:3e:ea:23:b1", "network": {"id": "09783701-f9c4-4d08-8523-6e363a558ec0", "bridge": "br-int", "label": "tempest-TestStampPattern-974584378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc044020751d475b94e96fcedb97b86c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a60434b-7f", "ovs_interfaceid": "7a60434b-7f31-4b05-a494-97e58e72a5c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 22:06:51 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-0fc3e250-057e-4646-94ec-fb22a862cdae tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Converting VIF {"id": "7a60434b-7f31-4b05-a494-97e58e72a5c1", "address": "fa:16:3e:ea:23:b1", "network": {"id": "09783701-f9c4-4d08-8523-6e363a558ec0", "bridge": "br-int", "label": "tempest-TestStampPattern-974584378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc044020751d475b94e96fcedb97b86c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a60434b-7f", "ovs_interfaceid": "7a60434b-7f31-4b05-a494-97e58e72a5c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 22:06:51 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-0fc3e250-057e-4646-94ec-fb22a862cdae tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:23:b1,bridge_name='br-int',has_traffic_filtering=True,id=7a60434b-7f31-4b05-a494-97e58e72a5c1,network=Network(09783701-f9c4-4d08-8523-6e363a558ec0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a60434b-7f') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 22:06:51 user nova-compute[74337]: DEBUG os_vif [None req-0fc3e250-057e-4646-94ec-fb22a862cdae tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:23:b1,bridge_name='br-int',has_traffic_filtering=True,id=7a60434b-7f31-4b05-a494-97e58e72a5c1,network=Network(09783701-f9c4-4d08-8523-6e363a558ec0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a60434b-7f') {{(pid=74337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 22:06:51 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:06:51 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:06:51 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 22:06:51 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:06:51 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cd6a9998-7ccb-5c4f-889f-9bb736eb420e', '_type': 'linux-noop'}}, row=False) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:06:51 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:06:51 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:06:51 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:06:51 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7a60434b-7f, may_exist=True, interface_attrs={}) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:06:51 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7a60434b-7f, col_values=(('qos', UUID('a8958136-50c0-4c20-bb9c-ec10d0b622cf')),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:06:51 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7a60434b-7f, col_values=(('external_ids', {'iface-id': '7a60434b-7f31-4b05-a494-97e58e72a5c1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ea:23:b1', 'vm-uuid': '106da458-caec-4114-8904-0411ec0ea903'}),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:06:51 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:06:51 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:06:51 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:06:51 user nova-compute[74337]: INFO os_vif [None req-0fc3e250-057e-4646-94ec-fb22a862cdae tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:23:b1,bridge_name='br-int',has_traffic_filtering=True,id=7a60434b-7f31-4b05-a494-97e58e72a5c1,network=Network(09783701-f9c4-4d08-8523-6e363a558ec0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a60434b-7f')
Oct 23 22:06:52 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-0fc3e250-057e-4646-94ec-fb22a862cdae tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] No BDM found with device name vda, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 22:06:52 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-0fc3e250-057e-4646-94ec-fb22a862cdae tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] No VIF found with MAC fa:16:3e:ea:23:b1, not building metadata {{(pid=74337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 22:06:52 user nova-compute[74337]: DEBUG nova.network.neutron [req-98867e0b-4895-4174-9e40-c71c6ff8f196 req-ea6ece07-527e-4aac-b9d7-3315fa191665 service nova] [instance: 106da458-caec-4114-8904-0411ec0ea903] Updated VIF entry in instance network info cache for port 7a60434b-7f31-4b05-a494-97e58e72a5c1. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 22:06:52 user nova-compute[74337]: DEBUG nova.network.neutron [req-98867e0b-4895-4174-9e40-c71c6ff8f196 req-ea6ece07-527e-4aac-b9d7-3315fa191665 service nova] [instance: 106da458-caec-4114-8904-0411ec0ea903] Updating instance_info_cache with network_info: [{"id": "7a60434b-7f31-4b05-a494-97e58e72a5c1", "address": "fa:16:3e:ea:23:b1", "network": {"id": "09783701-f9c4-4d08-8523-6e363a558ec0", "bridge": "br-int", "label": "tempest-TestStampPattern-974584378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc044020751d475b94e96fcedb97b86c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a60434b-7f", "ovs_interfaceid": "7a60434b-7f31-4b05-a494-97e58e72a5c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 22:06:52 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-98867e0b-4895-4174-9e40-c71c6ff8f196 req-ea6ece07-527e-4aac-b9d7-3315fa191665 service nova] Releasing lock "refresh_cache-106da458-caec-4114-8904-0411ec0ea903" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 22:06:53 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:06:53 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:06:53 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:06:53 user nova-compute[74337]: DEBUG nova.compute.manager [req-ce2676db-a6df-4061-b5eb-431110a618e2 req-3215af93-39f1-4828-9435-b4e9503674c5 service nova] [instance: 106da458-caec-4114-8904-0411ec0ea903] Received event network-vif-plugged-7a60434b-7f31-4b05-a494-97e58e72a5c1 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:06:53 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ce2676db-a6df-4061-b5eb-431110a618e2 req-3215af93-39f1-4828-9435-b4e9503674c5 service nova] Acquiring lock "106da458-caec-4114-8904-0411ec0ea903-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:06:53 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ce2676db-a6df-4061-b5eb-431110a618e2 req-3215af93-39f1-4828-9435-b4e9503674c5 service nova] Lock "106da458-caec-4114-8904-0411ec0ea903-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:06:53 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ce2676db-a6df-4061-b5eb-431110a618e2 req-3215af93-39f1-4828-9435-b4e9503674c5 service nova] Lock "106da458-caec-4114-8904-0411ec0ea903-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:06:53 user nova-compute[74337]: DEBUG nova.compute.manager [req-ce2676db-a6df-4061-b5eb-431110a618e2 req-3215af93-39f1-4828-9435-b4e9503674c5 service nova] [instance: 106da458-caec-4114-8904-0411ec0ea903] No waiting events found dispatching network-vif-plugged-7a60434b-7f31-4b05-a494-97e58e72a5c1 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 22:06:53 user nova-compute[74337]: WARNING nova.compute.manager [req-ce2676db-a6df-4061-b5eb-431110a618e2 req-3215af93-39f1-4828-9435-b4e9503674c5 service nova] [instance: 106da458-caec-4114-8904-0411ec0ea903] Received unexpected event network-vif-plugged-7a60434b-7f31-4b05-a494-97e58e72a5c1 for instance with vm_state building and task_state spawning.
Oct 23 22:06:53 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:06:53 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:06:53 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:06:54 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:06:55 user nova-compute[74337]: DEBUG nova.compute.manager [None req-0fc3e250-057e-4646-94ec-fb22a862cdae tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] [instance: 106da458-caec-4114-8904-0411ec0ea903] Instance event wait completed in 0 seconds for  {{(pid=74337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 22:06:55 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-0fc3e250-057e-4646-94ec-fb22a862cdae tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] [instance: 106da458-caec-4114-8904-0411ec0ea903] Guest created on hypervisor {{(pid=74337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 22:06:55 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: 106da458-caec-4114-8904-0411ec0ea903] Instance spawned successfully.
Oct 23 22:06:55 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-0fc3e250-057e-4646-94ec-fb22a862cdae tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] [instance: 106da458-caec-4114-8904-0411ec0ea903] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 22:06:55 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-0fc3e250-057e-4646-94ec-fb22a862cdae tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] [instance: 106da458-caec-4114-8904-0411ec0ea903] Found default for hw_cdrom_bus of ide {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 22:06:55 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-0fc3e250-057e-4646-94ec-fb22a862cdae tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] [instance: 106da458-caec-4114-8904-0411ec0ea903] Found default for hw_disk_bus of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 22:06:55 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-0fc3e250-057e-4646-94ec-fb22a862cdae tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] [instance: 106da458-caec-4114-8904-0411ec0ea903] Found default for hw_input_bus of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 22:06:55 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-0fc3e250-057e-4646-94ec-fb22a862cdae tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] [instance: 106da458-caec-4114-8904-0411ec0ea903] Found default for hw_pointer_model of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 22:06:55 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-0fc3e250-057e-4646-94ec-fb22a862cdae tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] [instance: 106da458-caec-4114-8904-0411ec0ea903] Found default for hw_video_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 22:06:55 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-0fc3e250-057e-4646-94ec-fb22a862cdae tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] [instance: 106da458-caec-4114-8904-0411ec0ea903] Found default for hw_vif_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 22:06:55 user nova-compute[74337]: INFO nova.compute.manager [None req-0fc3e250-057e-4646-94ec-fb22a862cdae tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] [instance: 106da458-caec-4114-8904-0411ec0ea903] Took 5.62 seconds to spawn the instance on the hypervisor.
Oct 23 22:06:55 user nova-compute[74337]: DEBUG nova.compute.manager [None req-0fc3e250-057e-4646-94ec-fb22a862cdae tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] [instance: 106da458-caec-4114-8904-0411ec0ea903] Checking state {{(pid=74337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 22:06:55 user nova-compute[74337]: INFO nova.compute.manager [None req-0fc3e250-057e-4646-94ec-fb22a862cdae tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] [instance: 106da458-caec-4114-8904-0411ec0ea903] Took 6.25 seconds to build instance.
Oct 23 22:06:55 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-0fc3e250-057e-4646-94ec-fb22a862cdae tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Lock "106da458-caec-4114-8904-0411ec0ea903" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.366s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:06:55 user nova-compute[74337]: DEBUG nova.compute.manager [req-397b4868-3a80-476d-9fef-51dc26846d68 req-865baca0-65a0-4c7d-bbfc-c40eda693a96 service nova] [instance: 106da458-caec-4114-8904-0411ec0ea903] Received event network-vif-plugged-7a60434b-7f31-4b05-a494-97e58e72a5c1 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:06:55 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-397b4868-3a80-476d-9fef-51dc26846d68 req-865baca0-65a0-4c7d-bbfc-c40eda693a96 service nova] Acquiring lock "106da458-caec-4114-8904-0411ec0ea903-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:06:55 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-397b4868-3a80-476d-9fef-51dc26846d68 req-865baca0-65a0-4c7d-bbfc-c40eda693a96 service nova] Lock "106da458-caec-4114-8904-0411ec0ea903-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:06:55 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-397b4868-3a80-476d-9fef-51dc26846d68 req-865baca0-65a0-4c7d-bbfc-c40eda693a96 service nova] Lock "106da458-caec-4114-8904-0411ec0ea903-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:06:55 user nova-compute[74337]: DEBUG nova.compute.manager [req-397b4868-3a80-476d-9fef-51dc26846d68 req-865baca0-65a0-4c7d-bbfc-c40eda693a96 service nova] [instance: 106da458-caec-4114-8904-0411ec0ea903] No waiting events found dispatching network-vif-plugged-7a60434b-7f31-4b05-a494-97e58e72a5c1 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 22:06:55 user nova-compute[74337]: WARNING nova.compute.manager [req-397b4868-3a80-476d-9fef-51dc26846d68 req-865baca0-65a0-4c7d-bbfc-c40eda693a96 service nova] [instance: 106da458-caec-4114-8904-0411ec0ea903] Received unexpected event network-vif-plugged-7a60434b-7f31-4b05-a494-97e58e72a5c1 for instance with vm_state active and task_state None.
Oct 23 22:06:56 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:06:59 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:07:01 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:07:06 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:07:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:07:11 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:07:14 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:07:16 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:07:18 user nova-compute[74337]: DEBUG nova.compute.manager [req-7975f36a-b856-4810-986e-499de3bb9c2f req-d3d16a6e-6a1a-4190-9820-05d3f73030e2 service nova] [instance: 7c970dae-cf7b-4267-8adc-843d00780e37] Received event network-changed-b465d0fa-4a02-4ad4-bbeb-03723257d328 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:07:18 user nova-compute[74337]: DEBUG nova.compute.manager [req-7975f36a-b856-4810-986e-499de3bb9c2f req-d3d16a6e-6a1a-4190-9820-05d3f73030e2 service nova] [instance: 7c970dae-cf7b-4267-8adc-843d00780e37] Refreshing instance network info cache due to event network-changed-b465d0fa-4a02-4ad4-bbeb-03723257d328. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 22:07:18 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-7975f36a-b856-4810-986e-499de3bb9c2f req-d3d16a6e-6a1a-4190-9820-05d3f73030e2 service nova] Acquiring lock "refresh_cache-7c970dae-cf7b-4267-8adc-843d00780e37" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 22:07:18 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-7975f36a-b856-4810-986e-499de3bb9c2f req-d3d16a6e-6a1a-4190-9820-05d3f73030e2 service nova] Acquired lock "refresh_cache-7c970dae-cf7b-4267-8adc-843d00780e37" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 22:07:18 user nova-compute[74337]: DEBUG nova.network.neutron [req-7975f36a-b856-4810-986e-499de3bb9c2f req-d3d16a6e-6a1a-4190-9820-05d3f73030e2 service nova] [instance: 7c970dae-cf7b-4267-8adc-843d00780e37] Refreshing network info cache for port b465d0fa-4a02-4ad4-bbeb-03723257d328 {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 22:07:18 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-10473c82-1b37-42d4-adfb-a25e220a15d6 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Acquiring lock "7c970dae-cf7b-4267-8adc-843d00780e37" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:07:18 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-10473c82-1b37-42d4-adfb-a25e220a15d6 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Lock "7c970dae-cf7b-4267-8adc-843d00780e37" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:07:18 user nova-compute[74337]: DEBUG nova.objects.instance [None req-10473c82-1b37-42d4-adfb-a25e220a15d6 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Lazy-loading 'flavor' on Instance uuid 7c970dae-cf7b-4267-8adc-843d00780e37 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:07:18 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-10473c82-1b37-42d4-adfb-a25e220a15d6 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] [instance: 7c970dae-cf7b-4267-8adc-843d00780e37] Ignoring supplied device name: /dev/vdb
Oct 23 22:07:18 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-10473c82-1b37-42d4-adfb-a25e220a15d6 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Lock "7c970dae-cf7b-4267-8adc-843d00780e37" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:07:18 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-10473c82-1b37-42d4-adfb-a25e220a15d6 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Acquiring lock "7c970dae-cf7b-4267-8adc-843d00780e37" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:07:18 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-10473c82-1b37-42d4-adfb-a25e220a15d6 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Lock "7c970dae-cf7b-4267-8adc-843d00780e37" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:07:18 user nova-compute[74337]: INFO nova.compute.manager [None req-10473c82-1b37-42d4-adfb-a25e220a15d6 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] [instance: 7c970dae-cf7b-4267-8adc-843d00780e37] Attaching volume 4fc862d1-6342-4d99-9f0b-25ccdbdcf96f to /dev/vdb
Oct 23 22:07:19 user nova-compute[74337]: DEBUG nova.network.neutron [req-7975f36a-b856-4810-986e-499de3bb9c2f req-d3d16a6e-6a1a-4190-9820-05d3f73030e2 service nova] [instance: 7c970dae-cf7b-4267-8adc-843d00780e37] Updated VIF entry in instance network info cache for port b465d0fa-4a02-4ad4-bbeb-03723257d328. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 22:07:19 user nova-compute[74337]: DEBUG nova.network.neutron [req-7975f36a-b856-4810-986e-499de3bb9c2f req-d3d16a6e-6a1a-4190-9820-05d3f73030e2 service nova] [instance: 7c970dae-cf7b-4267-8adc-843d00780e37] Updating instance_info_cache with network_info: [{"id": "b465d0fa-4a02-4ad4-bbeb-03723257d328", "address": "fa:16:3e:75:a1:dd", "network": {"id": "86669102-0490-4fe4-aba4-8a353e91a763", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1218528793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799c72bbb3e248b99463567aba2049db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb465d0fa-4a", "ovs_interfaceid": "b465d0fa-4a02-4ad4-bbeb-03723257d328", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 22:07:19 user nova-compute[74337]: DEBUG os_brick.utils [None req-10473c82-1b37-42d4-adfb-a25e220a15d6 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 22:07:19 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:07:19 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-7975f36a-b856-4810-986e-499de3bb9c2f req-d3d16a6e-6a1a-4190-9820-05d3f73030e2 service nova] Releasing lock "refresh_cache-7c970dae-cf7b-4267-8adc-843d00780e37" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 22:07:19 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:07:19 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[4889a753-3372-461e-b75a-60bb0346707a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f34011b66e40\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:07:19 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:07:19 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:07:19 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c5a7648-e4b8-4a56-a55d-010d1f3896d5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:07:19 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:07:19 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:07:19 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa5c07e-e594-47f7-aa95-5a1be5dea5b0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:07:19 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbf967e4-9d52-4f82-8e75-69b81f76894b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:07:19 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-10473c82-1b37-42d4-adfb-a25e220a15d6 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Running cmd (subprocess): nvme version {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:07:19 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-10473c82-1b37-42d4-adfb-a25e220a15d6 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] 'nvme version' failed. Not Retrying. {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 22:07:19 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-10473c82-1b37-42d4-adfb-a25e220a15d6 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] nvme not present on system {{(pid=74337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 22:07:19 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:07:19 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 22:07:19 user nova-compute[74337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 22:07:19 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5de7d1d-96a9-4589-80f9-2076da161fcf]: (4, '') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:07:19 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-10473c82-1b37-42d4-adfb-a25e220a15d6 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 22:07:19 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-10473c82-1b37-42d4-adfb-a25e220a15d6 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 22:07:19 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-10473c82-1b37-42d4-adfb-a25e220a15d6 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] LIGHTOS: no hostnqn found. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 22:07:19 user nova-compute[74337]: DEBUG os_brick.utils [None req-10473c82-1b37-42d4-adfb-a25e220a15d6 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f34011b66e40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 22:07:19 user nova-compute[74337]: DEBUG nova.virt.block_device [None req-10473c82-1b37-42d4-adfb-a25e220a15d6 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] [instance: 7c970dae-cf7b-4267-8adc-843d00780e37] Updating existing volume attachment record: edc5b74c-5234-4403-abed-b2a2d47c954f {{(pid=74337) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 22:07:19 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:07:21 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:07:22 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:07:22 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:07:22 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 22:07:22 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:07:24 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:07:24 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:07:26 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:07:26 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:07:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:07:28 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:07:29 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:07:29 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:07:29 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Starting heal instance info cache {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 22:07:29 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Rebuilding the list of instances to heal {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 22:07:29 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "refresh_cache-999843b2-b757-480b-bd21-bf281954bc46" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 22:07:29 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquired lock "refresh_cache-999843b2-b757-480b-bd21-bf281954bc46" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 22:07:29 user nova-compute[74337]: DEBUG nova.network.neutron [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Forcefully refreshing network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 22:07:29 user nova-compute[74337]: DEBUG nova.objects.instance [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lazy-loading 'info_cache' on Instance uuid 999843b2-b757-480b-bd21-bf281954bc46 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:07:29 user nova-compute[74337]: DEBUG nova.network.neutron [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Updating instance_info_cache with network_info: [{"id": "02913be6-773f-402a-a534-d7567aeb5b7a", "address": "fa:16:3e:a2:cd:9d", "network": {"id": "122fdd20-8bf5-4374-b50c-82e5dc8684db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-81475496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80f79dd6954748e4806a568a4127396f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02913be6-77", "ovs_interfaceid": "02913be6-773f-402a-a534-d7567aeb5b7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 22:07:30 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Releasing lock "refresh_cache-999843b2-b757-480b-bd21-bf281954bc46" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 22:07:30 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Updated the network info_cache for instance {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 22:07:30 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:07:30 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:07:30 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:07:30 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:07:30 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Auditing locally available compute resources for user (node: user) {{(pid=74337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 22:07:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/999843b2-b757-480b-bd21-bf281954bc46/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:07:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/999843b2-b757-480b-bd21-bf281954bc46/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:07:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/999843b2-b757-480b-bd21-bf281954bc46/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:07:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/999843b2-b757-480b-bd21-bf281954bc46/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:07:30 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c970dae-cf7b-4267-8adc-843d00780e37/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:07:31 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c970dae-cf7b-4267-8adc-843d00780e37/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:07:31 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c970dae-cf7b-4267-8adc-843d00780e37/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:07:31 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c970dae-cf7b-4267-8adc-843d00780e37/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:07:31 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/106da458-caec-4114-8904-0411ec0ea903/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:07:31 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/106da458-caec-4114-8904-0411ec0ea903/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:07:31 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/106da458-caec-4114-8904-0411ec0ea903/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:07:31 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/106da458-caec-4114-8904-0411ec0ea903/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:07:31 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk.rescue --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:07:31 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:07:31 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk.rescue --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:07:31 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:07:32 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:07:32 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:07:32 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:07:32 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:07:32 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:07:32 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:07:32 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:07:32 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Hypervisor/Node resource view: name=user free_ram=8420MB free_disk=25.192138671875GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 22:07:32 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:07:32 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:07:32 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 0323b854-c7a1-42e8-ad85-1e929caa6e9d has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Oct 23 22:07:32 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 999843b2-b757-480b-bd21-bf281954bc46 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 22:07:32 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 27710919-a717-42fa-a436-a261d92c1c2a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 22:07:32 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 7c970dae-cf7b-4267-8adc-843d00780e37 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 22:07:32 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 106da458-caec-4114-8904-0411ec0ea903 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 22:07:32 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 22:07:32 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 22:07:33 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 22:07:33 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 22:07:33 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Compute_service record updated for user:user {{(pid=74337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 22:07:33 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.326s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:07:34 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:07:34 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:07:35 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10473c82-1b37-42d4-adfb-a25e220a15d6 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] [instance: 7c970dae-cf7b-4267-8adc-843d00780e37] Calling os-brick to attach iSCSI Volume {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 22:07:35 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-10473c82-1b37-42d4-adfb-a25e220a15d6 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4fc862d1-6342-4d99-9f0b-25ccdbdcf96f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LDXqjCfS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 22:07:35 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-10473c82-1b37-42d4-adfb-a25e220a15d6 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 22:07:35 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-10473c82-1b37-42d4-adfb-a25e220a15d6 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 22:07:35 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-10473c82-1b37-42d4-adfb-a25e220a15d6 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 22:07:35 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-10473c82-1b37-42d4-adfb-a25e220a15d6 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 22:07:35 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-10473c82-1b37-42d4-adfb-a25e220a15d6 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4fc862d1-6342-4d99-9f0b-25ccdbdcf96f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 22:07:35 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-10473c82-1b37-42d4-adfb-a25e220a15d6 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4fc862d1-6342-4d99-9f0b-25ccdbdcf96f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 22:07:35 user nova-compute[74337]: INFO os_brick.initiator.connectors.iscsi [None req-10473c82-1b37-42d4-adfb-a25e220a15d6 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 22:07:35 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fc862d1-6342-4d99-9f0b-25ccdbdcf96f -p 172.16.0.220:3260 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:07:35 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fc862d1-6342-4d99-9f0b-25ccdbdcf96f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:07:35 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c496062f-e5e2-431e-9e66-7db52ca1af59]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:07:35 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-10473c82-1b37-42d4-adfb-a25e220a15d6 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 22:07:35 user nova-compute[74337]:  {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:07:35 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fc862d1-6342-4d99-9f0b-25ccdbdcf96f -p 172.16.0.220:3260 --interface default --op new {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:07:35 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fc862d1-6342-4d99-9f0b-25ccdbdcf96f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:07:35 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd75adf7-1d2f-4ed1-92d4-2eabefab6c16]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4fc862d1-6342-4d99-9f0b-25ccdbdcf96f] added\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:07:35 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-10473c82-1b37-42d4-adfb-a25e220a15d6 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4fc862d1-6342-4d99-9f0b-25ccdbdcf96f] added
Oct 23 22:07:35 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:07:35 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fc862d1-6342-4d99-9f0b-25ccdbdcf96f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:07:35 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fc862d1-6342-4d99-9f0b-25ccdbdcf96f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:07:35 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[79b6fad1-0c36-4bde-bb26-ca45c5672f6b]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:07:35 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-10473c82-1b37-42d4-adfb-a25e220a15d6 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:07:35 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fc862d1-6342-4d99-9f0b-25ccdbdcf96f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:07:35 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fc862d1-6342-4d99-9f0b-25ccdbdcf96f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:07:35 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f39ecb6-5827-4efc-8e6b-733b51315cb4]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:07:35 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-10473c82-1b37-42d4-adfb-a25e220a15d6 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:07:35 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fc862d1-6342-4d99-9f0b-25ccdbdcf96f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LDXqjCfS {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:07:35 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fc862d1-6342-4d99-9f0b-25ccdbdcf96f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LDXqjCfS" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:07:35 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[79c7660b-c61c-49f2-bcf8-a77f36c911ad]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:07:35 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-10473c82-1b37-42d4-adfb-a25e220a15d6 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LDXqjCfS'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:07:35 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fc862d1-6342-4d99-9f0b-25ccdbdcf96f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:07:35 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fc862d1-6342-4d99-9f0b-25ccdbdcf96f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:07:35 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b90a185c-884c-4d9b-abe1-4bf2140389f5]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:07:35 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-10473c82-1b37-42d4-adfb-a25e220a15d6 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:07:35 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:07:35 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:07:35 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d6e75b1-4811-401e-aeef-00f3ed437ada]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:07:35 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-10473c82-1b37-42d4-adfb-a25e220a15d6 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 23 22:07:35 user nova-compute[74337]:  {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 22:07:35 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-10473c82-1b37-42d4-adfb-a25e220a15d6 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 23 22:07:35 user nova-compute[74337]:  {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 22:07:35 user nova-compute[74337]: WARNING os_brick.initiator.connectors.iscsi [None req-10473c82-1b37-42d4-adfb-a25e220a15d6 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 23 22:07:35 user nova-compute[74337]: 
Oct 23 22:07:35 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fc862d1-6342-4d99-9f0b-25ccdbdcf96f -p 172.16.0.220:3260 --login {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:07:35 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fc862d1-6342-4d99-9f0b-25ccdbdcf96f -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:07:35 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[31ca5c63-dca9-4359-8f96-27bfedb1cf17]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4fc862d1-6342-4d99-9f0b-25ccdbdcf96f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4fc862d1-6342-4d99-9f0b-25ccdbdcf96f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:07:35 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-10473c82-1b37-42d4-adfb-a25e220a15d6 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4fc862d1-6342-4d99-9f0b-25ccdbdcf96f, portal: 172.16.0.220,3260]
Oct 23 22:07:35 user nova-compute[74337]: Login to [iface: default, target: iqn.2010-10.org.openstack:4fc862d1-6342-4d99-9f0b-25ccdbdcf96f, portal: 172.16.0.220,3260] successful.
Oct 23 22:07:35 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:07:35 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fc862d1-6342-4d99-9f0b-25ccdbdcf96f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:07:35 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fc862d1-6342-4d99-9f0b-25ccdbdcf96f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:07:35 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e86ee950-c2eb-412e-ae0c-b471cc9e653c]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:07:35 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-10473c82-1b37-42d4-adfb-a25e220a15d6 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:07:35 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:07:35 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:07:35 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[5849af8c-529d-4088-bdf6-a45d85271cc8]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fc862d1-6342-4d99-9f0b-25ccdbdcf96f (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:07:35 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-10473c82-1b37-42d4-adfb-a25e220a15d6 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fc862d1-6342-4d99-9f0b-25ccdbdcf96f (non-flash)
Oct 23 22:07:35 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 22:07:35 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-10473c82-1b37-42d4-adfb-a25e220a15d6 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fc862d1-6342-4d99-9f0b-25ccdbdcf96f (non-flash)
Oct 23 22:07:35 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 22:07:35 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-10473c82-1b37-42d4-adfb-a25e220a15d6 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4fc862d1-6342-4d99-9f0b-25ccdbdcf96f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.250s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 22:07:35 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-10473c82-1b37-42d4-adfb-a25e220a15d6 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Connected to 172.16.0.220:3260 {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 22:07:35 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-10473c82-1b37-42d4-adfb-a25e220a15d6 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=74337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 22:07:35 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-10473c82-1b37-42d4-adfb-a25e220a15d6 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 22:07:35 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:07:35 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:07:35 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[92edbfed-0840-4f66-8a55-a1c64bc73c60]: (4, ('- - 0', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:07:35 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-10473c82-1b37-42d4-adfb-a25e220a15d6 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: None {{(pid=74337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 22:07:36 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:07:36 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-10473c82-1b37-42d4-adfb-a25e220a15d6 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 22:07:36 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-10473c82-1b37-42d4-adfb-a25e220a15d6 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:4fc862d1-6342-4d99-9f0b-25ccdbdcf96f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LDXqjCfS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 22:07:36 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-10473c82-1b37-42d4-adfb-a25e220a15d6 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.281s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 22:07:36 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-10473c82-1b37-42d4-adfb-a25e220a15d6 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] <== connect_volume: return (1282ms) {'type': 'block', 'scsi_wwn': '26538646133346236', 'path': '/dev/sdb'} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 22:07:36 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10473c82-1b37-42d4-adfb-a25e220a15d6 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] [instance: 7c970dae-cf7b-4267-8adc-843d00780e37] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26538646133346236', 'path': '/dev/sdb'} {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 22:07:36 user nova-compute[74337]: DEBUG nova.objects.instance [None req-10473c82-1b37-42d4-adfb-a25e220a15d6 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Lazy-loading 'flavor' on Instance uuid 7c970dae-cf7b-4267-8adc-843d00780e37 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:07:36 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-10473c82-1b37-42d4-adfb-a25e220a15d6 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 22:07:36 user nova-compute[74337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 22:07:36 user nova-compute[74337]:   <source dev="/dev/sdb"/>
Oct 23 22:07:36 user nova-compute[74337]:   <target dev="vdb" bus="virtio"/>
Oct 23 22:07:36 user nova-compute[74337]:   <serial>4fc862d1-6342-4d99-9f0b-25ccdbdcf96f</serial>
Oct 23 22:07:36 user nova-compute[74337]: </disk>
Oct 23 22:07:36 user nova-compute[74337]:  {{(pid=74337) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 22:07:36 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:07:37 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-10473c82-1b37-42d4-adfb-a25e220a15d6 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] No BDM found with device name vda, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 22:07:37 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-10473c82-1b37-42d4-adfb-a25e220a15d6 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 22:07:37 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-10473c82-1b37-42d4-adfb-a25e220a15d6 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] No VIF found with MAC fa:16:3e:75:a1:dd, not building metadata {{(pid=74337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 22:07:37 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-10473c82-1b37-42d4-adfb-a25e220a15d6 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Lock "7c970dae-cf7b-4267-8adc-843d00780e37" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.240s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:07:42 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:07:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:07:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:07:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 22:07:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 22:07:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 22:07:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:07:49 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:07:52 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:07:57 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:08:02 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:08:07 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:08:07 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:08:07 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 22:08:07 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 22:08:07 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 22:08:07 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:08:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:08:10 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-67a6fa85-f01d-4efd-b286-50141782007b tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Acquiring lock "61fe098a-5958-4ad1-8f92-4592809299b7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:08:10 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-67a6fa85-f01d-4efd-b286-50141782007b tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Lock "61fe098a-5958-4ad1-8f92-4592809299b7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:08:10 user nova-compute[74337]: DEBUG nova.compute.manager [None req-67a6fa85-f01d-4efd-b286-50141782007b tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Starting instance... {{(pid=74337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 22:08:10 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-67a6fa85-f01d-4efd-b286-50141782007b tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:08:10 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-67a6fa85-f01d-4efd-b286-50141782007b tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:08:10 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-67a6fa85-f01d-4efd-b286-50141782007b tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 22:08:10 user nova-compute[74337]: INFO nova.compute.claims [None req-67a6fa85-f01d-4efd-b286-50141782007b tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Claim successful on node user
Oct 23 22:08:10 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-67a6fa85-f01d-4efd-b286-50141782007b tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 22:08:10 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-67a6fa85-f01d-4efd-b286-50141782007b tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 22:08:10 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-67a6fa85-f01d-4efd-b286-50141782007b tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.315s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:08:10 user nova-compute[74337]: DEBUG nova.compute.manager [None req-67a6fa85-f01d-4efd-b286-50141782007b tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Start building networks asynchronously for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 22:08:10 user nova-compute[74337]: DEBUG nova.compute.manager [None req-67a6fa85-f01d-4efd-b286-50141782007b tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Allocating IP information in the background. {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 22:08:10 user nova-compute[74337]: DEBUG nova.network.neutron [None req-67a6fa85-f01d-4efd-b286-50141782007b tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] allocate_for_instance() {{(pid=74337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 22:08:10 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-67a6fa85-f01d-4efd-b286-50141782007b tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 22:08:10 user nova-compute[74337]: DEBUG nova.compute.manager [None req-67a6fa85-f01d-4efd-b286-50141782007b tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Start building block device mappings for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 22:08:10 user nova-compute[74337]: DEBUG nova.policy [None req-67a6fa85-f01d-4efd-b286-50141782007b tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a0f5c4ec386544e1afd2f0a7d1b1c94f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80f79dd6954748e4806a568a4127396f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74337) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 22:08:10 user nova-compute[74337]: DEBUG nova.compute.manager [None req-67a6fa85-f01d-4efd-b286-50141782007b tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Start spawning the instance on the hypervisor. {{(pid=74337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 22:08:10 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-67a6fa85-f01d-4efd-b286-50141782007b tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Creating instance directory {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 22:08:10 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-67a6fa85-f01d-4efd-b286-50141782007b tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Creating image(s)
Oct 23 22:08:10 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-67a6fa85-f01d-4efd-b286-50141782007b tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Acquiring lock "/opt/stack/data/nova/instances/61fe098a-5958-4ad1-8f92-4592809299b7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:08:10 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-67a6fa85-f01d-4efd-b286-50141782007b tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Lock "/opt/stack/data/nova/instances/61fe098a-5958-4ad1-8f92-4592809299b7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:08:10 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-67a6fa85-f01d-4efd-b286-50141782007b tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Lock "/opt/stack/data/nova/instances/61fe098a-5958-4ad1-8f92-4592809299b7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:08:10 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-67a6fa85-f01d-4efd-b286-50141782007b tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:08:10 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-67a6fa85-f01d-4efd-b286-50141782007b tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.190s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:08:10 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-67a6fa85-f01d-4efd-b286-50141782007b tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Acquiring lock "fc7b140751b8c385de81623e40fb09ce09374ab7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:08:10 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-67a6fa85-f01d-4efd-b286-50141782007b tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Lock "fc7b140751b8c385de81623e40fb09ce09374ab7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:08:10 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-67a6fa85-f01d-4efd-b286-50141782007b tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:08:11 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-67a6fa85-f01d-4efd-b286-50141782007b tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.176s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:08:11 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-67a6fa85-f01d-4efd-b286-50141782007b tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7,backing_fmt=raw /opt/stack/data/nova/instances/61fe098a-5958-4ad1-8f92-4592809299b7/disk 1073741824 {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:08:11 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-67a6fa85-f01d-4efd-b286-50141782007b tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7,backing_fmt=raw /opt/stack/data/nova/instances/61fe098a-5958-4ad1-8f92-4592809299b7/disk 1073741824" returned: 0 in 0.063s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:08:11 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-67a6fa85-f01d-4efd-b286-50141782007b tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Lock "fc7b140751b8c385de81623e40fb09ce09374ab7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:08:11 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-67a6fa85-f01d-4efd-b286-50141782007b tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:08:11 user nova-compute[74337]: DEBUG nova.network.neutron [None req-67a6fa85-f01d-4efd-b286-50141782007b tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Successfully created port: 496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74 {{(pid=74337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 22:08:11 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-67a6fa85-f01d-4efd-b286-50141782007b tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.192s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:08:11 user nova-compute[74337]: DEBUG nova.virt.disk.api [None req-67a6fa85-f01d-4efd-b286-50141782007b tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Checking if we can resize image /opt/stack/data/nova/instances/61fe098a-5958-4ad1-8f92-4592809299b7/disk. size=1073741824 {{(pid=74337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 22:08:11 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-67a6fa85-f01d-4efd-b286-50141782007b tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61fe098a-5958-4ad1-8f92-4592809299b7/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:08:11 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-67a6fa85-f01d-4efd-b286-50141782007b tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61fe098a-5958-4ad1-8f92-4592809299b7/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:08:11 user nova-compute[74337]: DEBUG nova.virt.disk.api [None req-67a6fa85-f01d-4efd-b286-50141782007b tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Cannot resize image /opt/stack/data/nova/instances/61fe098a-5958-4ad1-8f92-4592809299b7/disk to a smaller size. {{(pid=74337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 22:08:11 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-67a6fa85-f01d-4efd-b286-50141782007b tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Created local disks {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 22:08:11 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-67a6fa85-f01d-4efd-b286-50141782007b tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Ensure instance console log exists: /opt/stack/data/nova/instances/61fe098a-5958-4ad1-8f92-4592809299b7/console.log {{(pid=74337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 22:08:11 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-67a6fa85-f01d-4efd-b286-50141782007b tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:08:11 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-67a6fa85-f01d-4efd-b286-50141782007b tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:08:11 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-67a6fa85-f01d-4efd-b286-50141782007b tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:08:12 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:08:12 user nova-compute[74337]: DEBUG nova.network.neutron [None req-67a6fa85-f01d-4efd-b286-50141782007b tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Successfully updated port: 496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74 {{(pid=74337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 22:08:12 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-67a6fa85-f01d-4efd-b286-50141782007b tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Acquiring lock "refresh_cache-61fe098a-5958-4ad1-8f92-4592809299b7" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 22:08:12 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-67a6fa85-f01d-4efd-b286-50141782007b tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Acquired lock "refresh_cache-61fe098a-5958-4ad1-8f92-4592809299b7" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 22:08:12 user nova-compute[74337]: DEBUG nova.network.neutron [None req-67a6fa85-f01d-4efd-b286-50141782007b tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Building network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 22:08:12 user nova-compute[74337]: DEBUG nova.compute.manager [req-64ffaddb-1c32-4cdd-88db-991a738bc423 req-f687332a-6d11-4dbd-bc38-34f0be30b621 service nova] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Received event network-changed-496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:08:12 user nova-compute[74337]: DEBUG nova.compute.manager [req-64ffaddb-1c32-4cdd-88db-991a738bc423 req-f687332a-6d11-4dbd-bc38-34f0be30b621 service nova] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Refreshing instance network info cache due to event network-changed-496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 22:08:12 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-64ffaddb-1c32-4cdd-88db-991a738bc423 req-f687332a-6d11-4dbd-bc38-34f0be30b621 service nova] Acquiring lock "refresh_cache-61fe098a-5958-4ad1-8f92-4592809299b7" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 22:08:12 user nova-compute[74337]: DEBUG nova.network.neutron [None req-67a6fa85-f01d-4efd-b286-50141782007b tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Instance cache missing network info. {{(pid=74337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 22:08:12 user nova-compute[74337]: DEBUG nova.network.neutron [None req-67a6fa85-f01d-4efd-b286-50141782007b tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Updating instance_info_cache with network_info: [{"id": "496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74", "address": "fa:16:3e:68:65:1a", "network": {"id": "122fdd20-8bf5-4374-b50c-82e5dc8684db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-81475496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80f79dd6954748e4806a568a4127396f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap496ce3c5-18", "ovs_interfaceid": "496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 22:08:12 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-67a6fa85-f01d-4efd-b286-50141782007b tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Releasing lock "refresh_cache-61fe098a-5958-4ad1-8f92-4592809299b7" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 22:08:12 user nova-compute[74337]: DEBUG nova.compute.manager [None req-67a6fa85-f01d-4efd-b286-50141782007b tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Instance network_info: |[{"id": "496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74", "address": "fa:16:3e:68:65:1a", "network": {"id": "122fdd20-8bf5-4374-b50c-82e5dc8684db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-81475496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80f79dd6954748e4806a568a4127396f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap496ce3c5-18", "ovs_interfaceid": "496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 22:08:12 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-64ffaddb-1c32-4cdd-88db-991a738bc423 req-f687332a-6d11-4dbd-bc38-34f0be30b621 service nova] Acquired lock "refresh_cache-61fe098a-5958-4ad1-8f92-4592809299b7" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 22:08:12 user nova-compute[74337]: DEBUG nova.network.neutron [req-64ffaddb-1c32-4cdd-88db-991a738bc423 req-f687332a-6d11-4dbd-bc38-34f0be30b621 service nova] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Refreshing network info cache for port 496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74 {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 22:08:12 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-67a6fa85-f01d-4efd-b286-50141782007b tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Start _get_guest_xml network_info=[{"id": "496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74", "address": "fa:16:3e:68:65:1a", "network": {"id": "122fdd20-8bf5-4374-b50c-82e5dc8684db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-81475496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80f79dd6954748e4806a568a4127396f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap496ce3c5-18", "ovs_interfaceid": "496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T21:29:21Z,direct_url=<?>,disk_format='qcow2',id=d859d89d-998d-4109-b26a-0d6e28152932,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ff43462300764979a6cf688444336a56',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T21:29:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'image_id': 'd859d89d-998d-4109-b26a-0d6e28152932'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 22:08:12 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-67a6fa85-f01d-4efd-b286-50141782007b tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:08:12 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-67a6fa85-f01d-4efd-b286-50141782007b tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:08:12 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-67a6fa85-f01d-4efd-b286-50141782007b tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 22:08:12 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-67a6fa85-f01d-4efd-b286-50141782007b tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] CPU controller missing on host. {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 22:08:12 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-67a6fa85-f01d-4efd-b286-50141782007b tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 22:08:12 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-67a6fa85-f01d-4efd-b286-50141782007b tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] CPU controller found on host. {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 22:08:12 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-67a6fa85-f01d-4efd-b286-50141782007b tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 22:08:12 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-67a6fa85-f01d-4efd-b286-50141782007b tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T21:29:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T21:29:21Z,direct_url=<?>,disk_format='qcow2',id=d859d89d-998d-4109-b26a-0d6e28152932,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ff43462300764979a6cf688444336a56',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T21:29:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 22:08:12 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-67a6fa85-f01d-4efd-b286-50141782007b tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Flavor limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 22:08:12 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-67a6fa85-f01d-4efd-b286-50141782007b tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Image limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 22:08:12 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-67a6fa85-f01d-4efd-b286-50141782007b tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Flavor pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 22:08:12 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-67a6fa85-f01d-4efd-b286-50141782007b tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Image pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 22:08:12 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-67a6fa85-f01d-4efd-b286-50141782007b tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 22:08:12 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-67a6fa85-f01d-4efd-b286-50141782007b tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 22:08:12 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-67a6fa85-f01d-4efd-b286-50141782007b tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 22:08:12 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-67a6fa85-f01d-4efd-b286-50141782007b tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Got 1 possible topologies {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 22:08:12 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-67a6fa85-f01d-4efd-b286-50141782007b tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 22:08:12 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-67a6fa85-f01d-4efd-b286-50141782007b tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 22:08:12 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-67a6fa85-f01d-4efd-b286-50141782007b tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T22:08:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-304244242',display_name='tempest-ServerRescueNegativeTestJSON-server-304244242',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-304244242',id=49,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHAcn+lLjOkIvykUlFztTMs08y2PxFnR7VYNivrfRgQdTZ3Fh25r9lJLsxrN7NFbZG+ODLyw1l+MPPzgV0N2Zq+awnrJEM4oA1Yu0mPfvb90MvOI3M2oZILyN6yuviVcmA==',key_name='tempest-keypair-723189200',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='80f79dd6954748e4806a568a4127396f',ramdisk_id='',reservation_id='r-67hxw7ij',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2089412853',owner_user_name='tempest-ServerRescueNegativeTestJSON-2089412853-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T22:08:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0f5c4ec386544e1afd2f0a7d1b1c94f',uuid=61fe098a-5958-4ad1-8f92-4592809299b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74", "address": "fa:16:3e:68:65:1a", "network": {"id": "122fdd20-8bf5-4374-b50c-82e5dc8684db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-81475496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80f79dd6954748e4806a568a4127396f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap496ce3c5-18", "ovs_interfaceid": "496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 22:08:12 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-67a6fa85-f01d-4efd-b286-50141782007b tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Converting VIF {"id": "496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74", "address": "fa:16:3e:68:65:1a", "network": {"id": "122fdd20-8bf5-4374-b50c-82e5dc8684db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-81475496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80f79dd6954748e4806a568a4127396f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap496ce3c5-18", "ovs_interfaceid": "496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 22:08:12 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-67a6fa85-f01d-4efd-b286-50141782007b tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:65:1a,bridge_name='br-int',has_traffic_filtering=True,id=496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74,network=Network(122fdd20-8bf5-4374-b50c-82e5dc8684db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap496ce3c5-18') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 22:08:12 user nova-compute[74337]: DEBUG nova.objects.instance [None req-67a6fa85-f01d-4efd-b286-50141782007b tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Lazy-loading 'pci_devices' on Instance uuid 61fe098a-5958-4ad1-8f92-4592809299b7 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:08:12 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-67a6fa85-f01d-4efd-b286-50141782007b tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] End _get_guest_xml xml=<domain type="kvm">
Oct 23 22:08:12 user nova-compute[74337]:   <uuid>61fe098a-5958-4ad1-8f92-4592809299b7</uuid>
Oct 23 22:08:12 user nova-compute[74337]:   <name>instance-00000031</name>
Oct 23 22:08:12 user nova-compute[74337]:   <memory>524288</memory>
Oct 23 22:08:12 user nova-compute[74337]:   <vcpu>1</vcpu>
Oct 23 22:08:12 user nova-compute[74337]:   <metadata>
Oct 23 22:08:12 user nova-compute[74337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 22:08:12 user nova-compute[74337]:       <nova:package version="0.0.0"/>
Oct 23 22:08:12 user nova-compute[74337]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-304244242</nova:name>
Oct 23 22:08:12 user nova-compute[74337]:       <nova:creationTime>2023-10-23 22:08:12</nova:creationTime>
Oct 23 22:08:12 user nova-compute[74337]:       <nova:flavor name="m1.tiny">
Oct 23 22:08:12 user nova-compute[74337]:         <nova:memory>512</nova:memory>
Oct 23 22:08:12 user nova-compute[74337]:         <nova:disk>1</nova:disk>
Oct 23 22:08:12 user nova-compute[74337]:         <nova:swap>0</nova:swap>
Oct 23 22:08:12 user nova-compute[74337]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 22:08:12 user nova-compute[74337]:         <nova:vcpus>1</nova:vcpus>
Oct 23 22:08:12 user nova-compute[74337]:       </nova:flavor>
Oct 23 22:08:12 user nova-compute[74337]:       <nova:owner>
Oct 23 22:08:12 user nova-compute[74337]:         <nova:user uuid="a0f5c4ec386544e1afd2f0a7d1b1c94f">tempest-ServerRescueNegativeTestJSON-2089412853-project-member</nova:user>
Oct 23 22:08:12 user nova-compute[74337]:         <nova:project uuid="80f79dd6954748e4806a568a4127396f">tempest-ServerRescueNegativeTestJSON-2089412853</nova:project>
Oct 23 22:08:12 user nova-compute[74337]:       </nova:owner>
Oct 23 22:08:12 user nova-compute[74337]:       <nova:root type="image" uuid="d859d89d-998d-4109-b26a-0d6e28152932"/>
Oct 23 22:08:12 user nova-compute[74337]:       <nova:ports>
Oct 23 22:08:12 user nova-compute[74337]:         <nova:port uuid="496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74">
Oct 23 22:08:12 user nova-compute[74337]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 23 22:08:12 user nova-compute[74337]:         </nova:port>
Oct 23 22:08:12 user nova-compute[74337]:       </nova:ports>
Oct 23 22:08:12 user nova-compute[74337]:     </nova:instance>
Oct 23 22:08:12 user nova-compute[74337]:   </metadata>
Oct 23 22:08:12 user nova-compute[74337]:   <sysinfo type="smbios">
Oct 23 22:08:12 user nova-compute[74337]:     <system>
Oct 23 22:08:12 user nova-compute[74337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 22:08:12 user nova-compute[74337]:       <entry name="product">OpenStack Nova</entry>
Oct 23 22:08:12 user nova-compute[74337]:       <entry name="version">0.0.0</entry>
Oct 23 22:08:12 user nova-compute[74337]:       <entry name="serial">61fe098a-5958-4ad1-8f92-4592809299b7</entry>
Oct 23 22:08:12 user nova-compute[74337]:       <entry name="uuid">61fe098a-5958-4ad1-8f92-4592809299b7</entry>
Oct 23 22:08:12 user nova-compute[74337]:       <entry name="family">Virtual Machine</entry>
Oct 23 22:08:12 user nova-compute[74337]:     </system>
Oct 23 22:08:12 user nova-compute[74337]:   </sysinfo>
Oct 23 22:08:12 user nova-compute[74337]:   <os>
Oct 23 22:08:12 user nova-compute[74337]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 22:08:12 user nova-compute[74337]:     <boot dev="hd"/>
Oct 23 22:08:12 user nova-compute[74337]:     <smbios mode="sysinfo"/>
Oct 23 22:08:12 user nova-compute[74337]:   </os>
Oct 23 22:08:12 user nova-compute[74337]:   <features>
Oct 23 22:08:12 user nova-compute[74337]:     <acpi/>
Oct 23 22:08:12 user nova-compute[74337]:     <apic/>
Oct 23 22:08:12 user nova-compute[74337]:     <vmcoreinfo/>
Oct 23 22:08:12 user nova-compute[74337]:   </features>
Oct 23 22:08:12 user nova-compute[74337]:   <clock offset="utc">
Oct 23 22:08:12 user nova-compute[74337]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 22:08:12 user nova-compute[74337]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 22:08:12 user nova-compute[74337]:     <timer name="hpet" present="no"/>
Oct 23 22:08:12 user nova-compute[74337]:   </clock>
Oct 23 22:08:12 user nova-compute[74337]:   <cpu mode="custom" match="exact">
Oct 23 22:08:12 user nova-compute[74337]:     <model>Nehalem</model>
Oct 23 22:08:12 user nova-compute[74337]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 22:08:12 user nova-compute[74337]:   </cpu>
Oct 23 22:08:12 user nova-compute[74337]:   <devices>
Oct 23 22:08:12 user nova-compute[74337]:     <disk type="file" device="disk">
Oct 23 22:08:12 user nova-compute[74337]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 22:08:12 user nova-compute[74337]:       <source file="/opt/stack/data/nova/instances/61fe098a-5958-4ad1-8f92-4592809299b7/disk"/>
Oct 23 22:08:12 user nova-compute[74337]:       <target dev="vda" bus="virtio"/>
Oct 23 22:08:12 user nova-compute[74337]:     </disk>
Oct 23 22:08:12 user nova-compute[74337]:     <interface type="ethernet">
Oct 23 22:08:12 user nova-compute[74337]:       <mac address="fa:16:3e:68:65:1a"/>
Oct 23 22:08:12 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 22:08:12 user nova-compute[74337]:       <mtu size="1442"/>
Oct 23 22:08:12 user nova-compute[74337]:       <target dev="tap496ce3c5-18"/>
Oct 23 22:08:12 user nova-compute[74337]:     </interface>
Oct 23 22:08:12 user nova-compute[74337]:     <serial type="pty">
Oct 23 22:08:12 user nova-compute[74337]:       <log file="/opt/stack/data/nova/instances/61fe098a-5958-4ad1-8f92-4592809299b7/console.log" append="off"/>
Oct 23 22:08:12 user nova-compute[74337]:     </serial>
Oct 23 22:08:12 user nova-compute[74337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 22:08:12 user nova-compute[74337]:     <video>
Oct 23 22:08:12 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 22:08:12 user nova-compute[74337]:     </video>
Oct 23 22:08:12 user nova-compute[74337]:     <rng model="virtio">
Oct 23 22:08:12 user nova-compute[74337]:       <backend model="random">/dev/urandom</backend>
Oct 23 22:08:12 user nova-compute[74337]:     </rng>
Oct 23 22:08:12 user nova-compute[74337]:     <controller type="usb" index="0" model="none"/>
Oct 23 22:08:12 user nova-compute[74337]:     <memballoon model="virtio">
Oct 23 22:08:12 user nova-compute[74337]:       <stats period="10"/>
Oct 23 22:08:12 user nova-compute[74337]:     </memballoon>
Oct 23 22:08:12 user nova-compute[74337]:   </devices>
Oct 23 22:08:12 user nova-compute[74337]: </domain>
Oct 23 22:08:12 user nova-compute[74337]:  {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 22:08:12 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-67a6fa85-f01d-4efd-b286-50141782007b tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T22:08:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-304244242',display_name='tempest-ServerRescueNegativeTestJSON-server-304244242',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-304244242',id=49,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHAcn+lLjOkIvykUlFztTMs08y2PxFnR7VYNivrfRgQdTZ3Fh25r9lJLsxrN7NFbZG+ODLyw1l+MPPzgV0N2Zq+awnrJEM4oA1Yu0mPfvb90MvOI3M2oZILyN6yuviVcmA==',key_name='tempest-keypair-723189200',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='80f79dd6954748e4806a568a4127396f',ramdisk_id='',reservation_id='r-67hxw7ij',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2089412853',owner_user_name='tempest-ServerRescueNegativeTestJSON-2089412853-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T22:08:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0f5c4ec386544e1afd2f0a7d1b1c94f',uuid=61fe098a-5958-4ad1-8f92-4592809299b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74", "address": "fa:16:3e:68:65:1a", "network": {"id": "122fdd20-8bf5-4374-b50c-82e5dc8684db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-81475496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80f79dd6954748e4806a568a4127396f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap496ce3c5-18", "ovs_interfaceid": "496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 22:08:12 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-67a6fa85-f01d-4efd-b286-50141782007b tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Converting VIF {"id": "496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74", "address": "fa:16:3e:68:65:1a", "network": {"id": "122fdd20-8bf5-4374-b50c-82e5dc8684db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-81475496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80f79dd6954748e4806a568a4127396f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap496ce3c5-18", "ovs_interfaceid": "496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 22:08:12 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-67a6fa85-f01d-4efd-b286-50141782007b tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:65:1a,bridge_name='br-int',has_traffic_filtering=True,id=496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74,network=Network(122fdd20-8bf5-4374-b50c-82e5dc8684db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap496ce3c5-18') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 22:08:12 user nova-compute[74337]: DEBUG os_vif [None req-67a6fa85-f01d-4efd-b286-50141782007b tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:65:1a,bridge_name='br-int',has_traffic_filtering=True,id=496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74,network=Network(122fdd20-8bf5-4374-b50c-82e5dc8684db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap496ce3c5-18') {{(pid=74337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 22:08:12 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:08:12 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:08:12 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 22:08:12 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:08:12 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1ea500fd-59ca-5372-b6b7-a36a5769946a', '_type': 'linux-noop'}}, row=False) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:08:12 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:08:12 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:08:12 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:08:12 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap496ce3c5-18, may_exist=True, interface_attrs={}) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:08:12 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap496ce3c5-18, col_values=(('qos', UUID('b11932bb-e10f-45a6-8596-b74d80ed11be')),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:08:12 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap496ce3c5-18, col_values=(('external_ids', {'iface-id': '496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:68:65:1a', 'vm-uuid': '61fe098a-5958-4ad1-8f92-4592809299b7'}),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:08:12 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:08:12 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:08:12 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:08:12 user nova-compute[74337]: INFO os_vif [None req-67a6fa85-f01d-4efd-b286-50141782007b tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:65:1a,bridge_name='br-int',has_traffic_filtering=True,id=496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74,network=Network(122fdd20-8bf5-4374-b50c-82e5dc8684db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap496ce3c5-18')
Oct 23 22:08:12 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-67a6fa85-f01d-4efd-b286-50141782007b tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] No BDM found with device name vda, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 22:08:12 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-67a6fa85-f01d-4efd-b286-50141782007b tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] No VIF found with MAC fa:16:3e:68:65:1a, not building metadata {{(pid=74337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 22:08:12 user nova-compute[74337]: DEBUG nova.network.neutron [req-64ffaddb-1c32-4cdd-88db-991a738bc423 req-f687332a-6d11-4dbd-bc38-34f0be30b621 service nova] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Updated VIF entry in instance network info cache for port 496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 22:08:12 user nova-compute[74337]: DEBUG nova.network.neutron [req-64ffaddb-1c32-4cdd-88db-991a738bc423 req-f687332a-6d11-4dbd-bc38-34f0be30b621 service nova] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Updating instance_info_cache with network_info: [{"id": "496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74", "address": "fa:16:3e:68:65:1a", "network": {"id": "122fdd20-8bf5-4374-b50c-82e5dc8684db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-81475496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80f79dd6954748e4806a568a4127396f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap496ce3c5-18", "ovs_interfaceid": "496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 22:08:12 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-64ffaddb-1c32-4cdd-88db-991a738bc423 req-f687332a-6d11-4dbd-bc38-34f0be30b621 service nova] Releasing lock "refresh_cache-61fe098a-5958-4ad1-8f92-4592809299b7" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 22:08:13 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:08:13 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:08:13 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:08:14 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:08:14 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:08:14 user nova-compute[74337]: DEBUG nova.compute.manager [req-b4c75257-d0d5-4270-a9a2-c72c9ed1968d req-e2013e21-54cf-4fe5-a8a1-7678c22002e9 service nova] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Received event network-vif-plugged-496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:08:14 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-b4c75257-d0d5-4270-a9a2-c72c9ed1968d req-e2013e21-54cf-4fe5-a8a1-7678c22002e9 service nova] Acquiring lock "61fe098a-5958-4ad1-8f92-4592809299b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:08:14 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-b4c75257-d0d5-4270-a9a2-c72c9ed1968d req-e2013e21-54cf-4fe5-a8a1-7678c22002e9 service nova] Lock "61fe098a-5958-4ad1-8f92-4592809299b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:08:14 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-b4c75257-d0d5-4270-a9a2-c72c9ed1968d req-e2013e21-54cf-4fe5-a8a1-7678c22002e9 service nova] Lock "61fe098a-5958-4ad1-8f92-4592809299b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:08:14 user nova-compute[74337]: DEBUG nova.compute.manager [req-b4c75257-d0d5-4270-a9a2-c72c9ed1968d req-e2013e21-54cf-4fe5-a8a1-7678c22002e9 service nova] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] No waiting events found dispatching network-vif-plugged-496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 22:08:14 user nova-compute[74337]: WARNING nova.compute.manager [req-b4c75257-d0d5-4270-a9a2-c72c9ed1968d req-e2013e21-54cf-4fe5-a8a1-7678c22002e9 service nova] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Received unexpected event network-vif-plugged-496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74 for instance with vm_state building and task_state spawning.
Oct 23 22:08:16 user nova-compute[74337]: DEBUG nova.compute.manager [None req-67a6fa85-f01d-4efd-b286-50141782007b tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Instance event wait completed in 0 seconds for  {{(pid=74337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 22:08:16 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-67a6fa85-f01d-4efd-b286-50141782007b tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Guest created on hypervisor {{(pid=74337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 22:08:16 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Instance spawned successfully.
Oct 23 22:08:16 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-67a6fa85-f01d-4efd-b286-50141782007b tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 22:08:16 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-67a6fa85-f01d-4efd-b286-50141782007b tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Found default for hw_cdrom_bus of ide {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 22:08:16 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-67a6fa85-f01d-4efd-b286-50141782007b tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Found default for hw_disk_bus of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 22:08:16 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-67a6fa85-f01d-4efd-b286-50141782007b tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Found default for hw_input_bus of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 22:08:16 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-67a6fa85-f01d-4efd-b286-50141782007b tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Found default for hw_pointer_model of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 22:08:16 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-67a6fa85-f01d-4efd-b286-50141782007b tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Found default for hw_video_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 22:08:16 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-67a6fa85-f01d-4efd-b286-50141782007b tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Found default for hw_vif_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 22:08:16 user nova-compute[74337]: INFO nova.compute.manager [None req-67a6fa85-f01d-4efd-b286-50141782007b tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Took 5.35 seconds to spawn the instance on the hypervisor.
Oct 23 22:08:16 user nova-compute[74337]: DEBUG nova.compute.manager [None req-67a6fa85-f01d-4efd-b286-50141782007b tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Checking state {{(pid=74337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 22:08:16 user nova-compute[74337]: DEBUG nova.compute.manager [req-ef6c39eb-1b73-4ec1-b2f5-e940204792e2 req-d3db6a33-cc88-4bd0-8080-0f17fe67c142 service nova] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Received event network-vif-plugged-496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:08:16 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ef6c39eb-1b73-4ec1-b2f5-e940204792e2 req-d3db6a33-cc88-4bd0-8080-0f17fe67c142 service nova] Acquiring lock "61fe098a-5958-4ad1-8f92-4592809299b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:08:16 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ef6c39eb-1b73-4ec1-b2f5-e940204792e2 req-d3db6a33-cc88-4bd0-8080-0f17fe67c142 service nova] Lock "61fe098a-5958-4ad1-8f92-4592809299b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:08:16 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ef6c39eb-1b73-4ec1-b2f5-e940204792e2 req-d3db6a33-cc88-4bd0-8080-0f17fe67c142 service nova] Lock "61fe098a-5958-4ad1-8f92-4592809299b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:08:16 user nova-compute[74337]: DEBUG nova.compute.manager [req-ef6c39eb-1b73-4ec1-b2f5-e940204792e2 req-d3db6a33-cc88-4bd0-8080-0f17fe67c142 service nova] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] No waiting events found dispatching network-vif-plugged-496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 22:08:16 user nova-compute[74337]: WARNING nova.compute.manager [req-ef6c39eb-1b73-4ec1-b2f5-e940204792e2 req-d3db6a33-cc88-4bd0-8080-0f17fe67c142 service nova] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Received unexpected event network-vif-plugged-496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74 for instance with vm_state building and task_state spawning.
Oct 23 22:08:16 user nova-compute[74337]: INFO nova.compute.manager [None req-67a6fa85-f01d-4efd-b286-50141782007b tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Took 6.01 seconds to build instance.
Oct 23 22:08:16 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-67a6fa85-f01d-4efd-b286-50141782007b tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Lock "61fe098a-5958-4ad1-8f92-4592809299b7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.106s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:08:17 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:08:19 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:08:22 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:08:22 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 22:08:22 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:08:24 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:08:26 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:08:27 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:08:27 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:08:27 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:08:27 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 22:08:27 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 22:08:27 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 22:08:27 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:08:28 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:08:30 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:08:30 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Starting heal instance info cache {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 22:08:30 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "refresh_cache-27710919-a717-42fa-a436-a261d92c1c2a" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 22:08:30 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquired lock "refresh_cache-27710919-a717-42fa-a436-a261d92c1c2a" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 22:08:30 user nova-compute[74337]: DEBUG nova.network.neutron [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 27710919-a717-42fa-a436-a261d92c1c2a] Forcefully refreshing network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 22:08:31 user nova-compute[74337]: DEBUG nova.network.neutron [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 27710919-a717-42fa-a436-a261d92c1c2a] Updating instance_info_cache with network_info: [{"id": "85905b2e-3e09-4236-8fe7-ea6c31324ae6", "address": "fa:16:3e:50:cd:90", "network": {"id": "122fdd20-8bf5-4374-b50c-82e5dc8684db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-81475496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80f79dd6954748e4806a568a4127396f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85905b2e-3e", "ovs_interfaceid": "85905b2e-3e09-4236-8fe7-ea6c31324ae6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 22:08:31 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Releasing lock "refresh_cache-27710919-a717-42fa-a436-a261d92c1c2a" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 22:08:31 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 27710919-a717-42fa-a436-a261d92c1c2a] Updated the network info_cache for instance {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 22:08:31 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:08:31 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:08:31 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:08:31 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:08:31 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:08:31 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Auditing locally available compute resources for user (node: user) {{(pid=74337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 22:08:31 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/999843b2-b757-480b-bd21-bf281954bc46/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:08:31 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/999843b2-b757-480b-bd21-bf281954bc46/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:08:31 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/999843b2-b757-480b-bd21-bf281954bc46/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:08:31 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/999843b2-b757-480b-bd21-bf281954bc46/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:08:31 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c970dae-cf7b-4267-8adc-843d00780e37/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:08:32 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c970dae-cf7b-4267-8adc-843d00780e37/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:08:32 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c970dae-cf7b-4267-8adc-843d00780e37/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:08:32 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c970dae-cf7b-4267-8adc-843d00780e37/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:08:32 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 22:08:32 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61fe098a-5958-4ad1-8f92-4592809299b7/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:08:32 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:08:32 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61fe098a-5958-4ad1-8f92-4592809299b7/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:08:32 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61fe098a-5958-4ad1-8f92-4592809299b7/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:08:32 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61fe098a-5958-4ad1-8f92-4592809299b7/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:08:32 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/106da458-caec-4114-8904-0411ec0ea903/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:08:32 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/106da458-caec-4114-8904-0411ec0ea903/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:08:32 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/106da458-caec-4114-8904-0411ec0ea903/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:08:33 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/106da458-caec-4114-8904-0411ec0ea903/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:08:33 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk.rescue --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:08:33 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:08:33 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk.rescue --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:08:33 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:08:33 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:08:33 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:08:33 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:08:33 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:08:34 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:08:34 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:08:34 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:08:34 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Hypervisor/Node resource view: name=user free_ram=8269MB free_disk=25.15521240234375GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 22:08:34 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:08:34 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:08:34 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 0323b854-c7a1-42e8-ad85-1e929caa6e9d has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Oct 23 22:08:34 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 999843b2-b757-480b-bd21-bf281954bc46 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 22:08:34 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 27710919-a717-42fa-a436-a261d92c1c2a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 22:08:34 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 7c970dae-cf7b-4267-8adc-843d00780e37 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 22:08:34 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 106da458-caec-4114-8904-0411ec0ea903 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 22:08:34 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 61fe098a-5958-4ad1-8f92-4592809299b7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 22:08:34 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 22:08:34 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 22:08:34 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 22:08:34 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 22:08:34 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Compute_service record updated for user:user {{(pid=74337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 22:08:34 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.395s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:08:36 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-3c9a393a-01cf-4422-b603-a93b473a663b tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Acquiring lock "7c970dae-cf7b-4267-8adc-843d00780e37" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:08:36 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-3c9a393a-01cf-4422-b603-a93b473a663b tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Lock "7c970dae-cf7b-4267-8adc-843d00780e37" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:08:36 user nova-compute[74337]: INFO nova.compute.manager [None req-3c9a393a-01cf-4422-b603-a93b473a663b tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] [instance: 7c970dae-cf7b-4267-8adc-843d00780e37] Detaching volume 4fc862d1-6342-4d99-9f0b-25ccdbdcf96f
Oct 23 22:08:36 user nova-compute[74337]: INFO nova.virt.block_device [None req-3c9a393a-01cf-4422-b603-a93b473a663b tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] [instance: 7c970dae-cf7b-4267-8adc-843d00780e37] Attempting to driver detach volume 4fc862d1-6342-4d99-9f0b-25ccdbdcf96f from mountpoint /dev/vdb
Oct 23 22:08:36 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-3c9a393a-01cf-4422-b603-a93b473a663b tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Attempting to detach device vdb from instance 7c970dae-cf7b-4267-8adc-843d00780e37 from the persistent domain config. {{(pid=74337) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 22:08:36 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-3c9a393a-01cf-4422-b603-a93b473a663b tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 22:08:36 user nova-compute[74337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 22:08:36 user nova-compute[74337]:   <source dev="/dev/sdb"/>
Oct 23 22:08:36 user nova-compute[74337]:   <target dev="vdb" bus="virtio"/>
Oct 23 22:08:36 user nova-compute[74337]:   <serial>4fc862d1-6342-4d99-9f0b-25ccdbdcf96f</serial>
Oct 23 22:08:36 user nova-compute[74337]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 22:08:36 user nova-compute[74337]: </disk>
Oct 23 22:08:36 user nova-compute[74337]:  {{(pid=74337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 22:08:36 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-3c9a393a-01cf-4422-b603-a93b473a663b tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Successfully detached device vdb from instance 7c970dae-cf7b-4267-8adc-843d00780e37 from the persistent domain config.
Oct 23 22:08:36 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-3c9a393a-01cf-4422-b603-a93b473a663b tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7c970dae-cf7b-4267-8adc-843d00780e37 from the live domain config. {{(pid=74337) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 22:08:36 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-3c9a393a-01cf-4422-b603-a93b473a663b tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 22:08:36 user nova-compute[74337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 22:08:36 user nova-compute[74337]:   <source dev="/dev/sdb"/>
Oct 23 22:08:36 user nova-compute[74337]:   <target dev="vdb" bus="virtio"/>
Oct 23 22:08:36 user nova-compute[74337]:   <serial>4fc862d1-6342-4d99-9f0b-25ccdbdcf96f</serial>
Oct 23 22:08:36 user nova-compute[74337]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 22:08:36 user nova-compute[74337]: </disk>
Oct 23 22:08:36 user nova-compute[74337]:  {{(pid=74337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 22:08:36 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-ccecfd76-1c3c-4e65-9752-39a77460a6b9 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Acquiring lock "7c970dae-cf7b-4267-8adc-843d00780e37" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:08:36 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-3c9a393a-01cf-4422-b603-a93b473a663b tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7c970dae-cf7b-4267-8adc-843d00780e37 {{(pid=74337) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 22:08:37 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:08:39 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:08:41 user nova-compute[74337]: DEBUG nova.compute.manager [req-4cd07089-4d6e-4312-b91a-053f88778a5c req-9f790de0-e7ba-4581-a55f-e076866e60da service nova] [instance: 106da458-caec-4114-8904-0411ec0ea903] Received event network-changed-7a60434b-7f31-4b05-a494-97e58e72a5c1 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:08:41 user nova-compute[74337]: DEBUG nova.compute.manager [req-4cd07089-4d6e-4312-b91a-053f88778a5c req-9f790de0-e7ba-4581-a55f-e076866e60da service nova] [instance: 106da458-caec-4114-8904-0411ec0ea903] Refreshing instance network info cache due to event network-changed-7a60434b-7f31-4b05-a494-97e58e72a5c1. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 22:08:41 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-4cd07089-4d6e-4312-b91a-053f88778a5c req-9f790de0-e7ba-4581-a55f-e076866e60da service nova] Acquiring lock "refresh_cache-106da458-caec-4114-8904-0411ec0ea903" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 22:08:41 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-4cd07089-4d6e-4312-b91a-053f88778a5c req-9f790de0-e7ba-4581-a55f-e076866e60da service nova] Acquired lock "refresh_cache-106da458-caec-4114-8904-0411ec0ea903" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 22:08:41 user nova-compute[74337]: DEBUG nova.network.neutron [req-4cd07089-4d6e-4312-b91a-053f88778a5c req-9f790de0-e7ba-4581-a55f-e076866e60da service nova] [instance: 106da458-caec-4114-8904-0411ec0ea903] Refreshing network info cache for port 7a60434b-7f31-4b05-a494-97e58e72a5c1 {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 22:08:41 user nova-compute[74337]: DEBUG nova.network.neutron [req-4cd07089-4d6e-4312-b91a-053f88778a5c req-9f790de0-e7ba-4581-a55f-e076866e60da service nova] [instance: 106da458-caec-4114-8904-0411ec0ea903] Updated VIF entry in instance network info cache for port 7a60434b-7f31-4b05-a494-97e58e72a5c1. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 22:08:41 user nova-compute[74337]: DEBUG nova.network.neutron [req-4cd07089-4d6e-4312-b91a-053f88778a5c req-9f790de0-e7ba-4581-a55f-e076866e60da service nova] [instance: 106da458-caec-4114-8904-0411ec0ea903] Updating instance_info_cache with network_info: [{"id": "7a60434b-7f31-4b05-a494-97e58e72a5c1", "address": "fa:16:3e:ea:23:b1", "network": {"id": "09783701-f9c4-4d08-8523-6e363a558ec0", "bridge": "br-int", "label": "tempest-TestStampPattern-974584378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc044020751d475b94e96fcedb97b86c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a60434b-7f", "ovs_interfaceid": "7a60434b-7f31-4b05-a494-97e58e72a5c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 22:08:41 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-c7248924-1c11-4f4e-8771-ecb99f3424c0 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Acquiring lock "106da458-caec-4114-8904-0411ec0ea903" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:08:41 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-c7248924-1c11-4f4e-8771-ecb99f3424c0 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Lock "106da458-caec-4114-8904-0411ec0ea903" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:08:41 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-4cd07089-4d6e-4312-b91a-053f88778a5c req-9f790de0-e7ba-4581-a55f-e076866e60da service nova] Releasing lock "refresh_cache-106da458-caec-4114-8904-0411ec0ea903" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 22:08:41 user nova-compute[74337]: DEBUG nova.objects.instance [None req-c7248924-1c11-4f4e-8771-ecb99f3424c0 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Lazy-loading 'flavor' on Instance uuid 106da458-caec-4114-8904-0411ec0ea903 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:08:41 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-c7248924-1c11-4f4e-8771-ecb99f3424c0 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Lock "106da458-caec-4114-8904-0411ec0ea903" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:08:41 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:08:41 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-c7248924-1c11-4f4e-8771-ecb99f3424c0 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Acquiring lock "106da458-caec-4114-8904-0411ec0ea903" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:08:41 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-c7248924-1c11-4f4e-8771-ecb99f3424c0 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Lock "106da458-caec-4114-8904-0411ec0ea903" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:08:41 user nova-compute[74337]: INFO nova.compute.manager [None req-c7248924-1c11-4f4e-8771-ecb99f3424c0 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] [instance: 106da458-caec-4114-8904-0411ec0ea903] Attaching volume 183b7880-5ac3-46f6-b663-0dfbc2a9b510 to /dev/vdb
Oct 23 22:08:41 user nova-compute[74337]: DEBUG os_brick.utils [None req-c7248924-1c11-4f4e-8771-ecb99f3424c0 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 22:08:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:08:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:08:41 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5c45514-c82d-4c54-9349-a3e2b4a9e222]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f34011b66e40\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:08:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:08:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:08:41 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[195084c6-fba5-4737-9557-79495d7783eb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:08:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:08:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:08:41 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc3c14e8-0d3a-4a23-888d-b6e6354a69a9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:08:41 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0492fbe-6b8d-4494-bd96-8732dc459667]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:08:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-c7248924-1c11-4f4e-8771-ecb99f3424c0 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Running cmd (subprocess): nvme version {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:08:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-c7248924-1c11-4f4e-8771-ecb99f3424c0 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] 'nvme version' failed. Not Retrying. {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 22:08:41 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c7248924-1c11-4f4e-8771-ecb99f3424c0 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] nvme not present on system {{(pid=74337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 22:08:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:08:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 22:08:42 user nova-compute[74337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 22:08:42 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa5434a8-7605-4218-9973-333505799359]: (4, '') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:08:42 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-c7248924-1c11-4f4e-8771-ecb99f3424c0 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 22:08:42 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-c7248924-1c11-4f4e-8771-ecb99f3424c0 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 22:08:42 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-c7248924-1c11-4f4e-8771-ecb99f3424c0 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] LIGHTOS: no hostnqn found. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 22:08:42 user nova-compute[74337]: DEBUG os_brick.utils [None req-c7248924-1c11-4f4e-8771-ecb99f3424c0 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f34011b66e40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 22:08:42 user nova-compute[74337]: DEBUG nova.virt.block_device [None req-c7248924-1c11-4f4e-8771-ecb99f3424c0 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] [instance: 106da458-caec-4114-8904-0411ec0ea903] Updating existing volume attachment record: cad01b2b-62af-41d0-87b9-15c3ce86b216 {{(pid=74337) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 22:08:42 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:08:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:08:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:08:49 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:08:52 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:08:52 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:08:52 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:08:52 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:08:52 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:08:52 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:08:52 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:08:52 user nova-compute[74337]: DEBUG nova.virt.libvirt.imagecache [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Verify base images {{(pid=74337) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Oct 23 22:08:52 user nova-compute[74337]: DEBUG nova.virt.libvirt.imagecache [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Image id d859d89d-998d-4109-b26a-0d6e28152932 yields fingerprint fc7b140751b8c385de81623e40fb09ce09374ab7 {{(pid=74337) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Oct 23 22:08:52 user nova-compute[74337]: INFO nova.virt.libvirt.imagecache [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] image d859d89d-998d-4109-b26a-0d6e28152932 at (/opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7): checking
Oct 23 22:08:52 user nova-compute[74337]: DEBUG nova.virt.libvirt.imagecache [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] image d859d89d-998d-4109-b26a-0d6e28152932 at (/opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7): image is in use {{(pid=74337) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Oct 23 22:08:52 user nova-compute[74337]: DEBUG nova.virt.libvirt.imagecache [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=74337) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Oct 23 22:08:52 user nova-compute[74337]: DEBUG nova.virt.libvirt.imagecache [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] 106da458-caec-4114-8904-0411ec0ea903 is a valid instance name {{(pid=74337) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Oct 23 22:08:52 user nova-compute[74337]: DEBUG nova.virt.libvirt.imagecache [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] 106da458-caec-4114-8904-0411ec0ea903 has a disk file {{(pid=74337) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Oct 23 22:08:52 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/106da458-caec-4114-8904-0411ec0ea903/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:08:52 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:08:52 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/106da458-caec-4114-8904-0411ec0ea903/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:08:52 user nova-compute[74337]: DEBUG nova.virt.libvirt.imagecache [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 106da458-caec-4114-8904-0411ec0ea903 is backed by fc7b140751b8c385de81623e40fb09ce09374ab7 {{(pid=74337) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Oct 23 22:08:52 user nova-compute[74337]: DEBUG nova.virt.libvirt.imagecache [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] 999843b2-b757-480b-bd21-bf281954bc46 is a valid instance name {{(pid=74337) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Oct 23 22:08:52 user nova-compute[74337]: DEBUG nova.virt.libvirt.imagecache [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] 999843b2-b757-480b-bd21-bf281954bc46 has a disk file {{(pid=74337) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Oct 23 22:08:52 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/999843b2-b757-480b-bd21-bf281954bc46/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:08:52 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/999843b2-b757-480b-bd21-bf281954bc46/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:08:52 user nova-compute[74337]: DEBUG nova.virt.libvirt.imagecache [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 999843b2-b757-480b-bd21-bf281954bc46 is backed by fc7b140751b8c385de81623e40fb09ce09374ab7 {{(pid=74337) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Oct 23 22:08:52 user nova-compute[74337]: DEBUG nova.virt.libvirt.imagecache [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] 27710919-a717-42fa-a436-a261d92c1c2a is a valid instance name {{(pid=74337) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Oct 23 22:08:52 user nova-compute[74337]: DEBUG nova.virt.libvirt.imagecache [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] 27710919-a717-42fa-a436-a261d92c1c2a has a disk file {{(pid=74337) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Oct 23 22:08:52 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:08:53 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:08:53 user nova-compute[74337]: DEBUG nova.virt.libvirt.imagecache [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 27710919-a717-42fa-a436-a261d92c1c2a is backed by fc7b140751b8c385de81623e40fb09ce09374ab7 {{(pid=74337) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Oct 23 22:08:53 user nova-compute[74337]: DEBUG nova.virt.libvirt.imagecache [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] 61fe098a-5958-4ad1-8f92-4592809299b7 is a valid instance name {{(pid=74337) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Oct 23 22:08:53 user nova-compute[74337]: DEBUG nova.virt.libvirt.imagecache [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] 61fe098a-5958-4ad1-8f92-4592809299b7 has a disk file {{(pid=74337) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Oct 23 22:08:53 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61fe098a-5958-4ad1-8f92-4592809299b7/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:08:53 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61fe098a-5958-4ad1-8f92-4592809299b7/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:08:53 user nova-compute[74337]: DEBUG nova.virt.libvirt.imagecache [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 61fe098a-5958-4ad1-8f92-4592809299b7 is backed by fc7b140751b8c385de81623e40fb09ce09374ab7 {{(pid=74337) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Oct 23 22:08:53 user nova-compute[74337]: DEBUG nova.virt.libvirt.imagecache [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] 7c970dae-cf7b-4267-8adc-843d00780e37 is a valid instance name {{(pid=74337) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Oct 23 22:08:53 user nova-compute[74337]: DEBUG nova.virt.libvirt.imagecache [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] 7c970dae-cf7b-4267-8adc-843d00780e37 has a disk file {{(pid=74337) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Oct 23 22:08:53 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c970dae-cf7b-4267-8adc-843d00780e37/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:08:53 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c970dae-cf7b-4267-8adc-843d00780e37/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:08:53 user nova-compute[74337]: DEBUG nova.virt.libvirt.imagecache [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 7c970dae-cf7b-4267-8adc-843d00780e37 is backed by fc7b140751b8c385de81623e40fb09ce09374ab7 {{(pid=74337) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Oct 23 22:08:53 user nova-compute[74337]: WARNING nova.virt.libvirt.imagecache [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Unknown base file: /opt/stack/data/nova/instances/_base/4df1f4d694a04a22836d8ad5e5885ca56403f198
Oct 23 22:08:53 user nova-compute[74337]: WARNING nova.virt.libvirt.imagecache [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Unknown base file: /opt/stack/data/nova/instances/_base/746adc44036d2a3e69d18431dbb1bdef949c3377
Oct 23 22:08:53 user nova-compute[74337]: WARNING nova.virt.libvirt.imagecache [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Unknown base file: /opt/stack/data/nova/instances/_base/beb91e538b7d20de7d02330d4c518759cd6c43c3
Oct 23 22:08:53 user nova-compute[74337]: WARNING nova.virt.libvirt.imagecache [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Unknown base file: /opt/stack/data/nova/instances/_base/28680da52240c940085d2156dc603d09ed4cfa61
Oct 23 22:08:53 user nova-compute[74337]: WARNING nova.virt.libvirt.imagecache [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Unknown base file: /opt/stack/data/nova/instances/_base/39aa0a5e56f1f3c05de609dc55fafb3bfc8559b9
Oct 23 22:08:53 user nova-compute[74337]: WARNING nova.virt.libvirt.imagecache [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Unknown base file: /opt/stack/data/nova/instances/_base/e9997274d7c27ef78f57166543564fb929aa06fd
Oct 23 22:08:53 user nova-compute[74337]: INFO nova.virt.libvirt.imagecache [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Active base files: /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7
Oct 23 22:08:53 user nova-compute[74337]: INFO nova.virt.libvirt.imagecache [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Removable base files: /opt/stack/data/nova/instances/_base/4df1f4d694a04a22836d8ad5e5885ca56403f198 /opt/stack/data/nova/instances/_base/746adc44036d2a3e69d18431dbb1bdef949c3377 /opt/stack/data/nova/instances/_base/beb91e538b7d20de7d02330d4c518759cd6c43c3 /opt/stack/data/nova/instances/_base/28680da52240c940085d2156dc603d09ed4cfa61 /opt/stack/data/nova/instances/_base/39aa0a5e56f1f3c05de609dc55fafb3bfc8559b9 /opt/stack/data/nova/instances/_base/e9997274d7c27ef78f57166543564fb929aa06fd
Oct 23 22:08:53 user nova-compute[74337]: INFO nova.virt.libvirt.imagecache [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/4df1f4d694a04a22836d8ad5e5885ca56403f198
Oct 23 22:08:53 user nova-compute[74337]: INFO nova.virt.libvirt.imagecache [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/746adc44036d2a3e69d18431dbb1bdef949c3377
Oct 23 22:08:53 user nova-compute[74337]: INFO nova.virt.libvirt.imagecache [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/beb91e538b7d20de7d02330d4c518759cd6c43c3
Oct 23 22:08:53 user nova-compute[74337]: INFO nova.virt.libvirt.imagecache [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/28680da52240c940085d2156dc603d09ed4cfa61
Oct 23 22:08:53 user nova-compute[74337]: INFO nova.virt.libvirt.imagecache [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/39aa0a5e56f1f3c05de609dc55fafb3bfc8559b9
Oct 23 22:08:53 user nova-compute[74337]: INFO nova.virt.libvirt.imagecache [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/e9997274d7c27ef78f57166543564fb929aa06fd
Oct 23 22:08:53 user nova-compute[74337]: DEBUG nova.virt.libvirt.imagecache [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Verification complete {{(pid=74337) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Oct 23 22:08:53 user nova-compute[74337]: DEBUG nova.virt.libvirt.imagecache [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Verify swap images {{(pid=74337) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Oct 23 22:08:53 user nova-compute[74337]: DEBUG nova.virt.libvirt.imagecache [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Verify ephemeral images {{(pid=74337) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Oct 23 22:08:56 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-3c9a393a-01cf-4422-b603-a93b473a663b tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7c970dae-cf7b-4267-8adc-843d00780e37 is timed out.
Oct 23 22:08:56 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-3c9a393a-01cf-4422-b603-a93b473a663b tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Successfully detached device vdb from instance 7c970dae-cf7b-4267-8adc-843d00780e37 from the live domain config.
Oct 23 22:08:56 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c9a393a-01cf-4422-b603-a93b473a663b tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] [instance: 7c970dae-cf7b-4267-8adc-843d00780e37] calling os-brick to detach iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 22:08:56 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c9a393a-01cf-4422-b603-a93b473a663b tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, {'target_iqn': 'iqn.2010-10.org.openstack:4fc862d1-6342-4d99-9f0b-25ccdbdcf96f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LDXqjCfS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 22:08:56 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-3c9a393a-01cf-4422-b603-a93b473a663b tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 22:08:56 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-3c9a393a-01cf-4422-b603-a93b473a663b tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 22:08:56 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-3c9a393a-01cf-4422-b603-a93b473a663b tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 22:08:56 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:08:56 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:08:56 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[391b865a-0b5b-420c-92fa-90bb80664a1d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4fc862d1-6342-4d99-9f0b-25ccdbdcf96f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:08:56 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c9a393a-01cf-4422-b603-a93b473a663b tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 22:08:56 user nova-compute[74337]: No targets found.
Oct 23 22:08:56 user nova-compute[74337]: iSNS:
Oct 23 22:08:56 user nova-compute[74337]: No targets found.
Oct 23 22:08:56 user nova-compute[74337]: STATIC:
Oct 23 22:08:56 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:4fc862d1-6342-4d99-9f0b-25ccdbdcf96f
Oct 23 22:08:56 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 22:08:56 user nova-compute[74337]:                 Iface Name: default
Oct 23 22:08:56 user nova-compute[74337]: FIRMWARE:
Oct 23 22:08:56 user nova-compute[74337]: No targets found.
Oct 23 22:08:56 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 22:08:56 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c9a393a-01cf-4422-b603-a93b473a663b tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 22:08:56 user nova-compute[74337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 22:08:56 user nova-compute[74337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 22:08:56 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c9a393a-01cf-4422-b603-a93b473a663b tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4fc862d1-6342-4d99-9f0b-25ccdbdcf96f', 0)] {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 22:08:56 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:08:56 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:08:56 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e266b82-07e6-40cf-985e-51a7dd9c8ca4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4fc862d1-6342-4d99-9f0b-25ccdbdcf96f\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:08:57 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:08:57 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:08:57 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a4b0b50-8faf-49c7-af05-6759b30a4608]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fc862d1-6342-4d99-9f0b-25ccdbdcf96f (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:08:57 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c9a393a-01cf-4422-b603-a93b473a663b tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fc862d1-6342-4d99-9f0b-25ccdbdcf96f (non-flash)
Oct 23 22:08:57 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 22:08:57 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c9a393a-01cf-4422-b603-a93b473a663b tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fc862d1-6342-4d99-9f0b-25ccdbdcf96f (non-flash)
Oct 23 22:08:57 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 22:08:57 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c9a393a-01cf-4422-b603-a93b473a663b tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5eec3b96c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4fc862d1-6342-4d99-9f0b-25ccdbdcf96f'): ({'sdb'}, set())}) {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 22:08:57 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-3c9a393a-01cf-4422-b603-a93b473a663b tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Removing single pathed devices sdb {{(pid=74337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 22:08:57 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:08:57 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:08:57 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e32a0d3f-a381-48be-845b-d7627390be83]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:08:57 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:08:57 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:08:57 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0741d14-420a-44ba-ad42-c11b97b86c30]: (4, ('ok\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:08:57 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-3c9a393a-01cf-4422-b603-a93b473a663b tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Flushing IO for device /dev/sdb {{(pid=74337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 22:08:57 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:08:57 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:08:57 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd3aaaa2-30d0-42e1-a5d0-b1acb13f32e7]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:08:57 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-3c9a393a-01cf-4422-b603-a93b473a663b tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 22:08:57 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:08:57 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:08:57 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[49db659f-fc8f-4078-950f-e0ebdeed07f3]: (4, ('1', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:08:57 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-3c9a393a-01cf-4422-b603-a93b473a663b tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 22:08:57 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-3c9a393a-01cf-4422-b603-a93b473a663b tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] SCSI volumes sdb have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 22:08:57 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c9a393a-01cf-4422-b603-a93b473a663b tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4fc862d1-6342-4d99-9f0b-25ccdbdcf96f')] {{(pid=74337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 22:08:57 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fc862d1-6342-4d99-9f0b-25ccdbdcf96f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:08:57 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fc862d1-6342-4d99-9f0b-25ccdbdcf96f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:08:57 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d04e0992-a7b9-4fe3-b4eb-2b5797074672]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:08:57 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c9a393a-01cf-4422-b603-a93b473a663b tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:08:57 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fc862d1-6342-4d99-9f0b-25ccdbdcf96f -p 172.16.0.220:3260 --logout {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:08:57 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fc862d1-6342-4d99-9f0b-25ccdbdcf96f -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:08:57 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc8e3cbd-3e17-4afa-9d2a-d7040000986a]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:4fc862d1-6342-4d99-9f0b-25ccdbdcf96f, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:4fc862d1-6342-4d99-9f0b-25ccdbdcf96f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:08:57 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c9a393a-01cf-4422-b603-a93b473a663b tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:4fc862d1-6342-4d99-9f0b-25ccdbdcf96f, portal: 172.16.0.220,3260]
Oct 23 22:08:57 user nova-compute[74337]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:4fc862d1-6342-4d99-9f0b-25ccdbdcf96f, portal: 172.16.0.220,3260] successful.
Oct 23 22:08:57 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:08:57 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fc862d1-6342-4d99-9f0b-25ccdbdcf96f -p 172.16.0.220:3260 --op delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:08:57 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fc862d1-6342-4d99-9f0b-25ccdbdcf96f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:08:57 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e765f154-38a4-4bea-8286-971a8823123b]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:08:57 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c9a393a-01cf-4422-b603-a93b473a663b tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:08:57 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-3c9a393a-01cf-4422-b603-a93b473a663b tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 22:08:57 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c9a393a-01cf-4422-b603-a93b473a663b tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] <== disconnect_volume: return (309ms) None {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 22:08:57 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c9a393a-01cf-4422-b603-a93b473a663b tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] [instance: 7c970dae-cf7b-4267-8adc-843d00780e37] Disconnected iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 22:08:57 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:08:57 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:08:57 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 22:08:57 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 22:08:57 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 22:08:57 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:08:59 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7248924-1c11-4f4e-8771-ecb99f3424c0 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] [instance: 106da458-caec-4114-8904-0411ec0ea903] Calling os-brick to attach iSCSI Volume {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 22:08:59 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7248924-1c11-4f4e-8771-ecb99f3424c0 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:183b7880-5ac3-46f6-b663-0dfbc2a9b510', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eDmRjnuL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 22:08:59 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-c7248924-1c11-4f4e-8771-ecb99f3424c0 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 22:08:59 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-c7248924-1c11-4f4e-8771-ecb99f3424c0 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 22:08:59 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-c7248924-1c11-4f4e-8771-ecb99f3424c0 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 22:08:59 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-c7248924-1c11-4f4e-8771-ecb99f3424c0 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 22:08:59 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-c7248924-1c11-4f4e-8771-ecb99f3424c0 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:183b7880-5ac3-46f6-b663-0dfbc2a9b510" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 22:08:59 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-c7248924-1c11-4f4e-8771-ecb99f3424c0 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:183b7880-5ac3-46f6-b663-0dfbc2a9b510" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 22:08:59 user nova-compute[74337]: INFO os_brick.initiator.connectors.iscsi [None req-c7248924-1c11-4f4e-8771-ecb99f3424c0 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 22:08:59 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:183b7880-5ac3-46f6-b663-0dfbc2a9b510 -p 172.16.0.220:3260 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:08:59 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:183b7880-5ac3-46f6-b663-0dfbc2a9b510 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:08:59 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[49f3cc19-2efe-41dd-97b7-4cbc24ccb5de]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:08:59 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7248924-1c11-4f4e-8771-ecb99f3424c0 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 22:08:59 user nova-compute[74337]:  {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:08:59 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:183b7880-5ac3-46f6-b663-0dfbc2a9b510 -p 172.16.0.220:3260 --interface default --op new {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:08:59 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:183b7880-5ac3-46f6-b663-0dfbc2a9b510 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:08:59 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[36fd2f4d-3e96-4e82-a57e-c7ff509f41e5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:183b7880-5ac3-46f6-b663-0dfbc2a9b510] added\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:08:59 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7248924-1c11-4f4e-8771-ecb99f3424c0 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:183b7880-5ac3-46f6-b663-0dfbc2a9b510] added
Oct 23 22:08:59 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:08:59 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:183b7880-5ac3-46f6-b663-0dfbc2a9b510 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:08:59 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:183b7880-5ac3-46f6-b663-0dfbc2a9b510 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:08:59 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a82546-edae-44d6-b1c2-82ed6f5501b7]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:08:59 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7248924-1c11-4f4e-8771-ecb99f3424c0 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:08:59 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:183b7880-5ac3-46f6-b663-0dfbc2a9b510 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:08:59 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:183b7880-5ac3-46f6-b663-0dfbc2a9b510 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:08:59 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f6ef88-aac7-4e5d-ba09-a2bf6072bfbc]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:08:59 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7248924-1c11-4f4e-8771-ecb99f3424c0 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:08:59 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:183b7880-5ac3-46f6-b663-0dfbc2a9b510 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eDmRjnuL {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:08:59 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:183b7880-5ac3-46f6-b663-0dfbc2a9b510 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eDmRjnuL" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:08:59 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1885110-0b21-4d53-8cca-ca5019ef9226]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:08:59 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7248924-1c11-4f4e-8771-ecb99f3424c0 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eDmRjnuL'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:08:59 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:183b7880-5ac3-46f6-b663-0dfbc2a9b510 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:08:59 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:183b7880-5ac3-46f6-b663-0dfbc2a9b510 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:08:59 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[3859a580-1410-49b7-b4cb-c13e139307b5]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:08:59 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7248924-1c11-4f4e-8771-ecb99f3424c0 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:08:59 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:08:59 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:08:59 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:08:59 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b9e585-1fba-4774-8e3b-783c3a4a4aba]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:08:59 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7248924-1c11-4f4e-8771-ecb99f3424c0 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 23 22:08:59 user nova-compute[74337]:  {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 22:08:59 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7248924-1c11-4f4e-8771-ecb99f3424c0 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 23 22:08:59 user nova-compute[74337]:  {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 22:08:59 user nova-compute[74337]: WARNING os_brick.initiator.connectors.iscsi [None req-c7248924-1c11-4f4e-8771-ecb99f3424c0 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 23 22:08:59 user nova-compute[74337]: 
Oct 23 22:08:59 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:183b7880-5ac3-46f6-b663-0dfbc2a9b510 -p 172.16.0.220:3260 --login {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:08:59 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:183b7880-5ac3-46f6-b663-0dfbc2a9b510 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:08:59 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a21a3d-fc9f-497f-99f3-bc72b9e4fbea]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:183b7880-5ac3-46f6-b663-0dfbc2a9b510, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:183b7880-5ac3-46f6-b663-0dfbc2a9b510, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:08:59 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7248924-1c11-4f4e-8771-ecb99f3424c0 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:183b7880-5ac3-46f6-b663-0dfbc2a9b510, portal: 172.16.0.220,3260]
Oct 23 22:08:59 user nova-compute[74337]: Login to [iface: default, target: iqn.2010-10.org.openstack:183b7880-5ac3-46f6-b663-0dfbc2a9b510, portal: 172.16.0.220,3260] successful.
Oct 23 22:08:59 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:08:59 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:183b7880-5ac3-46f6-b663-0dfbc2a9b510 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:08:59 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:183b7880-5ac3-46f6-b663-0dfbc2a9b510 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:08:59 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dc2b9ab-d543-4ebd-ae6a-0491309f6872]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:08:59 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7248924-1c11-4f4e-8771-ecb99f3424c0 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:08:59 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:08:59 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:08:59 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba5af0e-aece-4fc8-b345-a313fc91347e]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:183b7880-5ac3-46f6-b663-0dfbc2a9b510 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:08:59 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7248924-1c11-4f4e-8771-ecb99f3424c0 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:183b7880-5ac3-46f6-b663-0dfbc2a9b510 (non-flash)
Oct 23 22:08:59 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 22:08:59 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7248924-1c11-4f4e-8771-ecb99f3424c0 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:183b7880-5ac3-46f6-b663-0dfbc2a9b510 (non-flash)
Oct 23 22:08:59 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 22:08:59 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-c7248924-1c11-4f4e-8771-ecb99f3424c0 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:183b7880-5ac3-46f6-b663-0dfbc2a9b510" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.251s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 22:08:59 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7248924-1c11-4f4e-8771-ecb99f3424c0 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Connected to 172.16.0.220:3260 {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 22:08:59 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-c7248924-1c11-4f4e-8771-ecb99f3424c0 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=74337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 22:08:59 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-c7248924-1c11-4f4e-8771-ecb99f3424c0 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 22:08:59 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:08:59 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:08:59 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[22394704-46e1-487c-bd70-11fdffd2447f]: (4, ('- - 0', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:08:59 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-c7248924-1c11-4f4e-8771-ecb99f3424c0 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: None {{(pid=74337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 22:09:00 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-c7248924-1c11-4f4e-8771-ecb99f3424c0 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 22:09:00 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7248924-1c11-4f4e-8771-ecb99f3424c0 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:183b7880-5ac3-46f6-b663-0dfbc2a9b510', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eDmRjnuL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 22:09:00 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-c7248924-1c11-4f4e-8771-ecb99f3424c0 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.280s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 22:09:00 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7248924-1c11-4f4e-8771-ecb99f3424c0 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] <== connect_volume: return (1282ms) {'type': 'block', 'scsi_wwn': '23663636338323030', 'path': '/dev/sdb'} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 22:09:00 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7248924-1c11-4f4e-8771-ecb99f3424c0 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] [instance: 106da458-caec-4114-8904-0411ec0ea903] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23663636338323030', 'path': '/dev/sdb'} {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 22:09:00 user nova-compute[74337]: DEBUG nova.objects.instance [None req-c7248924-1c11-4f4e-8771-ecb99f3424c0 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Lazy-loading 'flavor' on Instance uuid 106da458-caec-4114-8904-0411ec0ea903 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:09:00 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-c7248924-1c11-4f4e-8771-ecb99f3424c0 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 22:09:00 user nova-compute[74337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 22:09:00 user nova-compute[74337]:   <source dev="/dev/sdb"/>
Oct 23 22:09:00 user nova-compute[74337]:   <target dev="vdb" bus="virtio"/>
Oct 23 22:09:00 user nova-compute[74337]:   <serial>183b7880-5ac3-46f6-b663-0dfbc2a9b510</serial>
Oct 23 22:09:00 user nova-compute[74337]: </disk>
Oct 23 22:09:00 user nova-compute[74337]:  {{(pid=74337) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 22:09:00 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-c7248924-1c11-4f4e-8771-ecb99f3424c0 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] No BDM found with device name vda, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 22:09:00 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-c7248924-1c11-4f4e-8771-ecb99f3424c0 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 22:09:00 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-c7248924-1c11-4f4e-8771-ecb99f3424c0 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] No VIF found with MAC fa:16:3e:ea:23:b1, not building metadata {{(pid=74337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 22:09:00 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-c7248924-1c11-4f4e-8771-ecb99f3424c0 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Lock "106da458-caec-4114-8904-0411ec0ea903" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.168s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:09:02 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:09:02 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-614baf89-4ba7-42b2-a5d7-2307174e3bf1 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Acquiring lock "106da458-caec-4114-8904-0411ec0ea903" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:09:02 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-614baf89-4ba7-42b2-a5d7-2307174e3bf1 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Lock "106da458-caec-4114-8904-0411ec0ea903" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:09:02 user nova-compute[74337]: INFO nova.compute.manager [None req-614baf89-4ba7-42b2-a5d7-2307174e3bf1 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] [instance: 106da458-caec-4114-8904-0411ec0ea903] Detaching volume 183b7880-5ac3-46f6-b663-0dfbc2a9b510
Oct 23 22:09:03 user nova-compute[74337]: INFO nova.virt.block_device [None req-614baf89-4ba7-42b2-a5d7-2307174e3bf1 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] [instance: 106da458-caec-4114-8904-0411ec0ea903] Attempting to driver detach volume 183b7880-5ac3-46f6-b663-0dfbc2a9b510 from mountpoint /dev/vdb
Oct 23 22:09:03 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-614baf89-4ba7-42b2-a5d7-2307174e3bf1 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Attempting to detach device vdb from instance 106da458-caec-4114-8904-0411ec0ea903 from the persistent domain config. {{(pid=74337) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 22:09:03 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-614baf89-4ba7-42b2-a5d7-2307174e3bf1 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 22:09:03 user nova-compute[74337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 22:09:03 user nova-compute[74337]:   <source dev="/dev/sdb"/>
Oct 23 22:09:03 user nova-compute[74337]:   <target dev="vdb" bus="virtio"/>
Oct 23 22:09:03 user nova-compute[74337]:   <serial>183b7880-5ac3-46f6-b663-0dfbc2a9b510</serial>
Oct 23 22:09:03 user nova-compute[74337]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 22:09:03 user nova-compute[74337]: </disk>
Oct 23 22:09:03 user nova-compute[74337]:  {{(pid=74337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 22:09:03 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-614baf89-4ba7-42b2-a5d7-2307174e3bf1 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Successfully detached device vdb from instance 106da458-caec-4114-8904-0411ec0ea903 from the persistent domain config.
Oct 23 22:09:03 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-614baf89-4ba7-42b2-a5d7-2307174e3bf1 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 106da458-caec-4114-8904-0411ec0ea903 from the live domain config. {{(pid=74337) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 22:09:03 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-614baf89-4ba7-42b2-a5d7-2307174e3bf1 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 22:09:03 user nova-compute[74337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 22:09:03 user nova-compute[74337]:   <source dev="/dev/sdb"/>
Oct 23 22:09:03 user nova-compute[74337]:   <target dev="vdb" bus="virtio"/>
Oct 23 22:09:03 user nova-compute[74337]:   <serial>183b7880-5ac3-46f6-b663-0dfbc2a9b510</serial>
Oct 23 22:09:03 user nova-compute[74337]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 22:09:03 user nova-compute[74337]: </disk>
Oct 23 22:09:03 user nova-compute[74337]:  {{(pid=74337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 22:09:03 user nova-compute[74337]: DEBUG nova.objects.instance [None req-3c9a393a-01cf-4422-b603-a93b473a663b tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Lazy-loading 'flavor' on Instance uuid 7c970dae-cf7b-4267-8adc-843d00780e37 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:09:03 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-3c9a393a-01cf-4422-b603-a93b473a663b tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Lock "7c970dae-cf7b-4267-8adc-843d00780e37" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 27.026s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:09:03 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-ccecfd76-1c3c-4e65-9752-39a77460a6b9 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Lock "7c970dae-cf7b-4267-8adc-843d00780e37" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 26.873s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:09:03 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-ccecfd76-1c3c-4e65-9752-39a77460a6b9 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Acquiring lock "7c970dae-cf7b-4267-8adc-843d00780e37-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:09:03 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-ccecfd76-1c3c-4e65-9752-39a77460a6b9 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Lock "7c970dae-cf7b-4267-8adc-843d00780e37-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:09:03 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-ccecfd76-1c3c-4e65-9752-39a77460a6b9 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Lock "7c970dae-cf7b-4267-8adc-843d00780e37-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:09:03 user nova-compute[74337]: INFO nova.compute.manager [None req-ccecfd76-1c3c-4e65-9752-39a77460a6b9 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] [instance: 7c970dae-cf7b-4267-8adc-843d00780e37] Terminating instance
Oct 23 22:09:03 user nova-compute[74337]: DEBUG nova.compute.manager [None req-ccecfd76-1c3c-4e65-9752-39a77460a6b9 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] [instance: 7c970dae-cf7b-4267-8adc-843d00780e37] Start destroying the instance on the hypervisor. {{(pid=74337) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 22:09:03 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:09:03 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:09:03 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:09:03 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:09:03 user nova-compute[74337]: DEBUG nova.compute.manager [req-9f90d1d1-fbfb-4e10-b86f-c065aa7b64a2 req-0f5f0587-05e0-407e-8c59-74927546c5e4 service nova] [instance: 7c970dae-cf7b-4267-8adc-843d00780e37] Received event network-vif-unplugged-b465d0fa-4a02-4ad4-bbeb-03723257d328 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:09:03 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-9f90d1d1-fbfb-4e10-b86f-c065aa7b64a2 req-0f5f0587-05e0-407e-8c59-74927546c5e4 service nova] Acquiring lock "7c970dae-cf7b-4267-8adc-843d00780e37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:09:03 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-9f90d1d1-fbfb-4e10-b86f-c065aa7b64a2 req-0f5f0587-05e0-407e-8c59-74927546c5e4 service nova] Lock "7c970dae-cf7b-4267-8adc-843d00780e37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:09:03 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-9f90d1d1-fbfb-4e10-b86f-c065aa7b64a2 req-0f5f0587-05e0-407e-8c59-74927546c5e4 service nova] Lock "7c970dae-cf7b-4267-8adc-843d00780e37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:09:03 user nova-compute[74337]: DEBUG nova.compute.manager [req-9f90d1d1-fbfb-4e10-b86f-c065aa7b64a2 req-0f5f0587-05e0-407e-8c59-74927546c5e4 service nova] [instance: 7c970dae-cf7b-4267-8adc-843d00780e37] No waiting events found dispatching network-vif-unplugged-b465d0fa-4a02-4ad4-bbeb-03723257d328 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 22:09:03 user nova-compute[74337]: DEBUG nova.compute.manager [req-9f90d1d1-fbfb-4e10-b86f-c065aa7b64a2 req-0f5f0587-05e0-407e-8c59-74927546c5e4 service nova] [instance: 7c970dae-cf7b-4267-8adc-843d00780e37] Received event network-vif-unplugged-b465d0fa-4a02-4ad4-bbeb-03723257d328 for instance with task_state deleting. {{(pid=74337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 22:09:03 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-614baf89-4ba7-42b2-a5d7-2307174e3bf1 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 106da458-caec-4114-8904-0411ec0ea903 {{(pid=74337) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 22:09:04 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: 7c970dae-cf7b-4267-8adc-843d00780e37] Instance destroyed successfully.
Oct 23 22:09:04 user nova-compute[74337]: DEBUG nova.objects.instance [None req-ccecfd76-1c3c-4e65-9752-39a77460a6b9 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Lazy-loading 'resources' on Instance uuid 7c970dae-cf7b-4267-8adc-843d00780e37 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:09:04 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-ccecfd76-1c3c-4e65-9752-39a77460a6b9 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T22:05:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1403161224',display_name='tempest-VolumesSnapshotTestJSON-instance-1403161224',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1403161224',id=47,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHOwfn+SOx+F48ytrfXAGyNr4A7HOLHmxzfDTeYN9wuowPLbskDxPazW/ZE8FjpOTe3JDS7OnAASXPAY6NgYsQZJSKqD90ZeMgTNEtYEhHtWA2pXlJebIzaxo3xOqGc46w==',key_name='tempest-keypair-1235602070',keypairs=<?>,launch_index=0,launched_at=2023-10-23T22:05:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='799c72bbb3e248b99463567aba2049db',ramdisk_id='',reservation_id='r-0fq6bxd4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-389190159',owner_user_name='tempest-VolumesSnapshotTestJSON-389190159-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T22:05:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7932a09ed7a14f249da27a7f1d5326ea',uuid=7c970dae-cf7b-4267-8adc-843d00780e37,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b465d0fa-4a02-4ad4-bbeb-03723257d328", "address": "fa:16:3e:75:a1:dd", "network": {"id": "86669102-0490-4fe4-aba4-8a353e91a763", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1218528793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799c72bbb3e248b99463567aba2049db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb465d0fa-4a", "ovs_interfaceid": "b465d0fa-4a02-4ad4-bbeb-03723257d328", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 22:09:04 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-ccecfd76-1c3c-4e65-9752-39a77460a6b9 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Converting VIF {"id": "b465d0fa-4a02-4ad4-bbeb-03723257d328", "address": "fa:16:3e:75:a1:dd", "network": {"id": "86669102-0490-4fe4-aba4-8a353e91a763", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1218528793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799c72bbb3e248b99463567aba2049db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb465d0fa-4a", "ovs_interfaceid": "b465d0fa-4a02-4ad4-bbeb-03723257d328", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 22:09:04 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-ccecfd76-1c3c-4e65-9752-39a77460a6b9 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:75:a1:dd,bridge_name='br-int',has_traffic_filtering=True,id=b465d0fa-4a02-4ad4-bbeb-03723257d328,network=Network(86669102-0490-4fe4-aba4-8a353e91a763),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb465d0fa-4a') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 22:09:04 user nova-compute[74337]: DEBUG os_vif [None req-ccecfd76-1c3c-4e65-9752-39a77460a6b9 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:a1:dd,bridge_name='br-int',has_traffic_filtering=True,id=b465d0fa-4a02-4ad4-bbeb-03723257d328,network=Network(86669102-0490-4fe4-aba4-8a353e91a763),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb465d0fa-4a') {{(pid=74337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 22:09:04 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:09:04 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb465d0fa-4a, bridge=br-int, if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:09:04 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:09:04 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:09:04 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:09:04 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=95dcd072-5741-461a-9ea7-9ce40c0afc44) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:09:04 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:09:04 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:09:04 user nova-compute[74337]: INFO os_vif [None req-ccecfd76-1c3c-4e65-9752-39a77460a6b9 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:a1:dd,bridge_name='br-int',has_traffic_filtering=True,id=b465d0fa-4a02-4ad4-bbeb-03723257d328,network=Network(86669102-0490-4fe4-aba4-8a353e91a763),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb465d0fa-4a')
Oct 23 22:09:04 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ccecfd76-1c3c-4e65-9752-39a77460a6b9 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] [instance: 7c970dae-cf7b-4267-8adc-843d00780e37] calling os-brick to detach iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 22:09:04 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccecfd76-1c3c-4e65-9752-39a77460a6b9 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, {'target_iqn': 'iqn.2010-10.org.openstack:4fc862d1-6342-4d99-9f0b-25ccdbdcf96f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LDXqjCfS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 22:09:04 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-ccecfd76-1c3c-4e65-9752-39a77460a6b9 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 22:09:04 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-ccecfd76-1c3c-4e65-9752-39a77460a6b9 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 22:09:04 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-ccecfd76-1c3c-4e65-9752-39a77460a6b9 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 22:09:04 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:09:04 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:09:04 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e18f611d-67e6-4c2e-8159-832ff4565c95]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:183b7880-5ac3-46f6-b663-0dfbc2a9b510\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:09:04 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccecfd76-1c3c-4e65-9752-39a77460a6b9 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 22:09:04 user nova-compute[74337]: No targets found.
Oct 23 22:09:04 user nova-compute[74337]: iSNS:
Oct 23 22:09:04 user nova-compute[74337]: No targets found.
Oct 23 22:09:04 user nova-compute[74337]: STATIC:
Oct 23 22:09:04 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:183b7880-5ac3-46f6-b663-0dfbc2a9b510
Oct 23 22:09:04 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 22:09:04 user nova-compute[74337]:                 Iface Name: default
Oct 23 22:09:04 user nova-compute[74337]: FIRMWARE:
Oct 23 22:09:04 user nova-compute[74337]: No targets found.
Oct 23 22:09:04 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 22:09:04 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccecfd76-1c3c-4e65-9752-39a77460a6b9 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 22:09:04 user nova-compute[74337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 22:09:04 user nova-compute[74337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 22:09:04 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccecfd76-1c3c-4e65-9752-39a77460a6b9 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4fc862d1-6342-4d99-9f0b-25ccdbdcf96f', 0)] {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 22:09:04 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:09:04 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:09:04 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[f99b6ff6-5102-4a15-b753-5679c2a13777]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:183b7880-5ac3-46f6-b663-0dfbc2a9b510\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:09:04 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:09:04 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:09:04 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7a4d340-70e1-40b0-8443-58d6e8ac98a9]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:183b7880-5ac3-46f6-b663-0dfbc2a9b510 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:09:04 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccecfd76-1c3c-4e65-9752-39a77460a6b9 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:183b7880-5ac3-46f6-b663-0dfbc2a9b510 (non-flash)
Oct 23 22:09:04 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 22:09:04 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccecfd76-1c3c-4e65-9752-39a77460a6b9 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:183b7880-5ac3-46f6-b663-0dfbc2a9b510 (non-flash)
Oct 23 22:09:04 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 22:09:04 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccecfd76-1c3c-4e65-9752-39a77460a6b9 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5ef42895a0>, {}) {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 22:09:04 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccecfd76-1c3c-4e65-9752-39a77460a6b9 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Disconnecting from: [] {{(pid=74337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 22:09:04 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-ccecfd76-1c3c-4e65-9752-39a77460a6b9 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.068s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 22:09:04 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccecfd76-1c3c-4e65-9752-39a77460a6b9 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] <== disconnect_volume: return (70ms) None {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 22:09:04 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ccecfd76-1c3c-4e65-9752-39a77460a6b9 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] [instance: 7c970dae-cf7b-4267-8adc-843d00780e37] Disconnected iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 22:09:04 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-ccecfd76-1c3c-4e65-9752-39a77460a6b9 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] [instance: 7c970dae-cf7b-4267-8adc-843d00780e37] Deleting instance files /opt/stack/data/nova/instances/7c970dae-cf7b-4267-8adc-843d00780e37_del
Oct 23 22:09:04 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-ccecfd76-1c3c-4e65-9752-39a77460a6b9 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] [instance: 7c970dae-cf7b-4267-8adc-843d00780e37] Deletion of /opt/stack/data/nova/instances/7c970dae-cf7b-4267-8adc-843d00780e37_del complete
Oct 23 22:09:04 user nova-compute[74337]: INFO nova.compute.manager [None req-ccecfd76-1c3c-4e65-9752-39a77460a6b9 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] [instance: 7c970dae-cf7b-4267-8adc-843d00780e37] Took 0.91 seconds to destroy the instance on the hypervisor.
Oct 23 22:09:04 user nova-compute[74337]: DEBUG oslo.service.loopingcall [None req-ccecfd76-1c3c-4e65-9752-39a77460a6b9 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74337) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 22:09:04 user nova-compute[74337]: DEBUG nova.compute.manager [-] [instance: 7c970dae-cf7b-4267-8adc-843d00780e37] Deallocating network for instance {{(pid=74337) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 22:09:04 user nova-compute[74337]: DEBUG nova.network.neutron [-] [instance: 7c970dae-cf7b-4267-8adc-843d00780e37] deallocate_for_instance() {{(pid=74337) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 22:09:04 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:09:04 user nova-compute[74337]: DEBUG nova.network.neutron [-] [instance: 7c970dae-cf7b-4267-8adc-843d00780e37] Updating instance_info_cache with network_info: [] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 22:09:04 user nova-compute[74337]: INFO nova.compute.manager [-] [instance: 7c970dae-cf7b-4267-8adc-843d00780e37] Took 0.67 seconds to deallocate network for instance.
Oct 23 22:09:04 user nova-compute[74337]: WARNING nova.volume.cinder [None req-ccecfd76-1c3c-4e65-9752-39a77460a6b9 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Attachment edc5b74c-5234-4403-abed-b2a2d47c954f does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = edc5b74c-5234-4403-abed-b2a2d47c954f. (HTTP 404) (Request-ID: req-6fa5767f-2a94-4eea-a3d5-379dca582982)
Oct 23 22:09:04 user nova-compute[74337]: INFO nova.compute.manager [None req-ccecfd76-1c3c-4e65-9752-39a77460a6b9 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] [instance: 7c970dae-cf7b-4267-8adc-843d00780e37] Took 0.02 seconds to detach 1 volumes for instance.
Oct 23 22:09:04 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-ccecfd76-1c3c-4e65-9752-39a77460a6b9 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:09:04 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-ccecfd76-1c3c-4e65-9752-39a77460a6b9 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:09:05 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-ccecfd76-1c3c-4e65-9752-39a77460a6b9 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 22:09:05 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-ccecfd76-1c3c-4e65-9752-39a77460a6b9 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 22:09:05 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-ccecfd76-1c3c-4e65-9752-39a77460a6b9 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.242s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:09:05 user nova-compute[74337]: INFO nova.scheduler.client.report [None req-ccecfd76-1c3c-4e65-9752-39a77460a6b9 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Deleted allocations for instance 7c970dae-cf7b-4267-8adc-843d00780e37
Oct 23 22:09:05 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-ccecfd76-1c3c-4e65-9752-39a77460a6b9 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Lock "7c970dae-cf7b-4267-8adc-843d00780e37" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.017s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:09:05 user nova-compute[74337]: DEBUG nova.compute.manager [req-38946373-c529-4679-a2b7-3d410f76de41 req-528783ad-7dae-4330-b8ce-f04be648057e service nova] [instance: 7c970dae-cf7b-4267-8adc-843d00780e37] Received event network-vif-plugged-b465d0fa-4a02-4ad4-bbeb-03723257d328 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:09:05 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-38946373-c529-4679-a2b7-3d410f76de41 req-528783ad-7dae-4330-b8ce-f04be648057e service nova] Acquiring lock "7c970dae-cf7b-4267-8adc-843d00780e37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:09:05 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-38946373-c529-4679-a2b7-3d410f76de41 req-528783ad-7dae-4330-b8ce-f04be648057e service nova] Lock "7c970dae-cf7b-4267-8adc-843d00780e37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:09:05 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-38946373-c529-4679-a2b7-3d410f76de41 req-528783ad-7dae-4330-b8ce-f04be648057e service nova] Lock "7c970dae-cf7b-4267-8adc-843d00780e37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:09:05 user nova-compute[74337]: DEBUG nova.compute.manager [req-38946373-c529-4679-a2b7-3d410f76de41 req-528783ad-7dae-4330-b8ce-f04be648057e service nova] [instance: 7c970dae-cf7b-4267-8adc-843d00780e37] No waiting events found dispatching network-vif-plugged-b465d0fa-4a02-4ad4-bbeb-03723257d328 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 22:09:05 user nova-compute[74337]: WARNING nova.compute.manager [req-38946373-c529-4679-a2b7-3d410f76de41 req-528783ad-7dae-4330-b8ce-f04be648057e service nova] [instance: 7c970dae-cf7b-4267-8adc-843d00780e37] Received unexpected event network-vif-plugged-b465d0fa-4a02-4ad4-bbeb-03723257d328 for instance with vm_state deleted and task_state None.
Oct 23 22:09:05 user nova-compute[74337]: DEBUG nova.compute.manager [req-38946373-c529-4679-a2b7-3d410f76de41 req-528783ad-7dae-4330-b8ce-f04be648057e service nova] [instance: 7c970dae-cf7b-4267-8adc-843d00780e37] Received event network-vif-deleted-b465d0fa-4a02-4ad4-bbeb-03723257d328 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:09:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:09:14 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:09:14 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:09:14 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 22:09:14 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 22:09:14 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 22:09:14 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:09:14 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:09:19 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:09:22 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:09:23 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:09:23 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 22:09:23 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-614baf89-4ba7-42b2-a5d7-2307174e3bf1 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 106da458-caec-4114-8904-0411ec0ea903 is timed out.
Oct 23 22:09:23 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-614baf89-4ba7-42b2-a5d7-2307174e3bf1 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Successfully detached device vdb from instance 106da458-caec-4114-8904-0411ec0ea903 from the live domain config.
Oct 23 22:09:23 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-614baf89-4ba7-42b2-a5d7-2307174e3bf1 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] [instance: 106da458-caec-4114-8904-0411ec0ea903] calling os-brick to detach iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 22:09:23 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-614baf89-4ba7-42b2-a5d7-2307174e3bf1 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, {'target_iqn': 'iqn.2010-10.org.openstack:183b7880-5ac3-46f6-b663-0dfbc2a9b510', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eDmRjnuL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 22:09:23 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-614baf89-4ba7-42b2-a5d7-2307174e3bf1 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 22:09:23 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-614baf89-4ba7-42b2-a5d7-2307174e3bf1 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 22:09:23 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-614baf89-4ba7-42b2-a5d7-2307174e3bf1 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 22:09:23 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:09:23 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:09:23 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c973521-a0d8-4d70-ac17-c5c9e54272be]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:183b7880-5ac3-46f6-b663-0dfbc2a9b510\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:09:23 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-614baf89-4ba7-42b2-a5d7-2307174e3bf1 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 22:09:23 user nova-compute[74337]: No targets found.
Oct 23 22:09:23 user nova-compute[74337]: iSNS:
Oct 23 22:09:23 user nova-compute[74337]: No targets found.
Oct 23 22:09:23 user nova-compute[74337]: STATIC:
Oct 23 22:09:23 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:183b7880-5ac3-46f6-b663-0dfbc2a9b510
Oct 23 22:09:23 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 22:09:23 user nova-compute[74337]:                 Iface Name: default
Oct 23 22:09:23 user nova-compute[74337]: FIRMWARE:
Oct 23 22:09:23 user nova-compute[74337]: No targets found.
Oct 23 22:09:23 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 22:09:23 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-614baf89-4ba7-42b2-a5d7-2307174e3bf1 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 22:09:23 user nova-compute[74337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 22:09:23 user nova-compute[74337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 22:09:23 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-614baf89-4ba7-42b2-a5d7-2307174e3bf1 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:183b7880-5ac3-46f6-b663-0dfbc2a9b510', 0)] {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 22:09:23 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:09:23 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:09:23 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca24efcc-ae5e-406e-89c2-61ceeea65596]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:183b7880-5ac3-46f6-b663-0dfbc2a9b510\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:09:23 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:09:23 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:09:23 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff0bc931-2e6b-4932-9d28-b113df311cf9]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:183b7880-5ac3-46f6-b663-0dfbc2a9b510 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:09:23 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-614baf89-4ba7-42b2-a5d7-2307174e3bf1 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:183b7880-5ac3-46f6-b663-0dfbc2a9b510 (non-flash)
Oct 23 22:09:23 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 22:09:23 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-614baf89-4ba7-42b2-a5d7-2307174e3bf1 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:183b7880-5ac3-46f6-b663-0dfbc2a9b510 (non-flash)
Oct 23 22:09:23 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 22:09:23 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-614baf89-4ba7-42b2-a5d7-2307174e3bf1 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5ec8758160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:183b7880-5ac3-46f6-b663-0dfbc2a9b510'): ({'sdb'}, set())}) {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 22:09:23 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-614baf89-4ba7-42b2-a5d7-2307174e3bf1 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Removing single pathed devices sdb {{(pid=74337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 22:09:23 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:09:23 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:09:23 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d04f6c75-4762-4e78-875f-cfc01ac610b8]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:09:23 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:09:23 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:09:23 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8468839-8c96-4519-a5bf-a8f0ec1a3615]: (4, ('ok\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:09:23 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-614baf89-4ba7-42b2-a5d7-2307174e3bf1 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Flushing IO for device /dev/sdb {{(pid=74337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 22:09:23 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:09:23 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:09:23 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac29f39-6c15-4889-85ad-b6c1ad0bb93a]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:09:23 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-614baf89-4ba7-42b2-a5d7-2307174e3bf1 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 22:09:23 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:09:23 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:09:23 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc089edc-8953-463f-b05b-1556cb446636]: (4, ('1', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:09:23 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-614baf89-4ba7-42b2-a5d7-2307174e3bf1 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 22:09:23 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-614baf89-4ba7-42b2-a5d7-2307174e3bf1 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] SCSI volumes sdb have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 22:09:23 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-614baf89-4ba7-42b2-a5d7-2307174e3bf1 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:183b7880-5ac3-46f6-b663-0dfbc2a9b510')] {{(pid=74337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 22:09:23 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:183b7880-5ac3-46f6-b663-0dfbc2a9b510 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:09:23 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:183b7880-5ac3-46f6-b663-0dfbc2a9b510 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:09:23 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[cabe5dba-3e55-4572-adb3-865d1684e881]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:09:23 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-614baf89-4ba7-42b2-a5d7-2307174e3bf1 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:09:23 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:183b7880-5ac3-46f6-b663-0dfbc2a9b510 -p 172.16.0.220:3260 --logout {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:09:23 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:183b7880-5ac3-46f6-b663-0dfbc2a9b510 -p 172.16.0.220:3260 --logout" returned: 0 in 0.040s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:09:23 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[13f5573c-08b1-4209-9019-79876f53c26c]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:183b7880-5ac3-46f6-b663-0dfbc2a9b510, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:183b7880-5ac3-46f6-b663-0dfbc2a9b510, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:09:23 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-614baf89-4ba7-42b2-a5d7-2307174e3bf1 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:183b7880-5ac3-46f6-b663-0dfbc2a9b510, portal: 172.16.0.220,3260]
Oct 23 22:09:23 user nova-compute[74337]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:183b7880-5ac3-46f6-b663-0dfbc2a9b510, portal: 172.16.0.220,3260] successful.
Oct 23 22:09:23 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:09:23 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:183b7880-5ac3-46f6-b663-0dfbc2a9b510 -p 172.16.0.220:3260 --op delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:09:23 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:183b7880-5ac3-46f6-b663-0dfbc2a9b510 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:09:23 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[55850b93-6df7-48ea-b17f-cacea77181cb]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:09:23 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-614baf89-4ba7-42b2-a5d7-2307174e3bf1 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:09:23 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-614baf89-4ba7-42b2-a5d7-2307174e3bf1 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.270s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 22:09:23 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-614baf89-4ba7-42b2-a5d7-2307174e3bf1 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] <== disconnect_volume: return (270ms) None {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 22:09:23 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-614baf89-4ba7-42b2-a5d7-2307174e3bf1 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] [instance: 106da458-caec-4114-8904-0411ec0ea903] Disconnected iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 22:09:24 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:09:25 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:09:27 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:09:28 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:09:28 user nova-compute[74337]: DEBUG nova.objects.instance [None req-614baf89-4ba7-42b2-a5d7-2307174e3bf1 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Lazy-loading 'flavor' on Instance uuid 106da458-caec-4114-8904-0411ec0ea903 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:09:28 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-614baf89-4ba7-42b2-a5d7-2307174e3bf1 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Lock "106da458-caec-4114-8904-0411ec0ea903" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 25.634s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:09:29 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:09:29 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:09:30 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:09:30 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:09:31 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:09:31 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Starting heal instance info cache {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 22:09:31 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "refresh_cache-106da458-caec-4114-8904-0411ec0ea903" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 22:09:31 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquired lock "refresh_cache-106da458-caec-4114-8904-0411ec0ea903" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 22:09:31 user nova-compute[74337]: DEBUG nova.network.neutron [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 106da458-caec-4114-8904-0411ec0ea903] Forcefully refreshing network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 22:09:32 user nova-compute[74337]: DEBUG nova.network.neutron [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 106da458-caec-4114-8904-0411ec0ea903] Updating instance_info_cache with network_info: [{"id": "7a60434b-7f31-4b05-a494-97e58e72a5c1", "address": "fa:16:3e:ea:23:b1", "network": {"id": "09783701-f9c4-4d08-8523-6e363a558ec0", "bridge": "br-int", "label": "tempest-TestStampPattern-974584378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc044020751d475b94e96fcedb97b86c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a60434b-7f", "ovs_interfaceid": "7a60434b-7f31-4b05-a494-97e58e72a5c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 22:09:32 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Releasing lock "refresh_cache-106da458-caec-4114-8904-0411ec0ea903" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 22:09:32 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 106da458-caec-4114-8904-0411ec0ea903] Updated the network info_cache for instance {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 22:09:32 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:09:33 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:09:33 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:09:33 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:09:33 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:09:33 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Auditing locally available compute resources for user (node: user) {{(pid=74337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 22:09:33 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/999843b2-b757-480b-bd21-bf281954bc46/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:09:33 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/999843b2-b757-480b-bd21-bf281954bc46/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:09:33 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/999843b2-b757-480b-bd21-bf281954bc46/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:09:33 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/999843b2-b757-480b-bd21-bf281954bc46/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:09:33 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61fe098a-5958-4ad1-8f92-4592809299b7/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:09:34 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:09:34 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61fe098a-5958-4ad1-8f92-4592809299b7/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:09:34 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61fe098a-5958-4ad1-8f92-4592809299b7/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:09:34 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61fe098a-5958-4ad1-8f92-4592809299b7/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:09:34 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/106da458-caec-4114-8904-0411ec0ea903/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:09:34 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/106da458-caec-4114-8904-0411ec0ea903/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:09:34 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/106da458-caec-4114-8904-0411ec0ea903/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:09:34 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/106da458-caec-4114-8904-0411ec0ea903/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:09:34 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk.rescue --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:09:34 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:09:34 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk.rescue --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:09:35 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:09:35 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:09:35 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:09:35 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:09:35 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:09:35 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:09:35 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:09:35 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Hypervisor/Node resource view: name=user free_ram=8462MB free_disk=25.179012298583984GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 22:09:35 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:09:35 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:09:36 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 0323b854-c7a1-42e8-ad85-1e929caa6e9d has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Oct 23 22:09:36 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 999843b2-b757-480b-bd21-bf281954bc46 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 22:09:36 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 27710919-a717-42fa-a436-a261d92c1c2a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 22:09:36 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 106da458-caec-4114-8904-0411ec0ea903 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 22:09:36 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 61fe098a-5958-4ad1-8f92-4592809299b7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 22:09:36 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 22:09:36 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 22:09:36 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 22:09:36 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 22:09:36 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Compute_service record updated for user:user {{(pid=74337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 22:09:36 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.538s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:09:39 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:09:41 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:09:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:09:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:09:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 22:09:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 22:09:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 22:09:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:09:48 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:09:48 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74337) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 23 22:09:49 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:09:50 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:09:50 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Cleaning up deleted instances {{(pid=74337) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 23 22:09:50 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] There are 0 instances to clean {{(pid=74337) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 23 22:09:54 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:09:59 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:10:01 user nova-compute[74337]: DEBUG nova.compute.manager [req-4df0ab1a-efaa-409e-8ed3-59ea88cb1f29 req-b7208fdd-11ac-41ab-9be9-1a089f477a6e service nova] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Received event network-changed-496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:10:01 user nova-compute[74337]: DEBUG nova.compute.manager [req-4df0ab1a-efaa-409e-8ed3-59ea88cb1f29 req-b7208fdd-11ac-41ab-9be9-1a089f477a6e service nova] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Refreshing instance network info cache due to event network-changed-496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 22:10:01 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-4df0ab1a-efaa-409e-8ed3-59ea88cb1f29 req-b7208fdd-11ac-41ab-9be9-1a089f477a6e service nova] Acquiring lock "refresh_cache-61fe098a-5958-4ad1-8f92-4592809299b7" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 22:10:01 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-4df0ab1a-efaa-409e-8ed3-59ea88cb1f29 req-b7208fdd-11ac-41ab-9be9-1a089f477a6e service nova] Acquired lock "refresh_cache-61fe098a-5958-4ad1-8f92-4592809299b7" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 22:10:01 user nova-compute[74337]: DEBUG nova.network.neutron [req-4df0ab1a-efaa-409e-8ed3-59ea88cb1f29 req-b7208fdd-11ac-41ab-9be9-1a089f477a6e service nova] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Refreshing network info cache for port 496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74 {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 22:10:01 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-f9ed072e-4d24-445d-8d6e-a7606eca8da3 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Acquiring lock "61fe098a-5958-4ad1-8f92-4592809299b7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:10:01 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-f9ed072e-4d24-445d-8d6e-a7606eca8da3 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Lock "61fe098a-5958-4ad1-8f92-4592809299b7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:10:01 user nova-compute[74337]: DEBUG nova.objects.instance [None req-f9ed072e-4d24-445d-8d6e-a7606eca8da3 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Lazy-loading 'flavor' on Instance uuid 61fe098a-5958-4ad1-8f92-4592809299b7 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:10:01 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-f9ed072e-4d24-445d-8d6e-a7606eca8da3 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Lock "61fe098a-5958-4ad1-8f92-4592809299b7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:10:01 user nova-compute[74337]: DEBUG nova.network.neutron [req-4df0ab1a-efaa-409e-8ed3-59ea88cb1f29 req-b7208fdd-11ac-41ab-9be9-1a089f477a6e service nova] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Updated VIF entry in instance network info cache for port 496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 22:10:01 user nova-compute[74337]: DEBUG nova.network.neutron [req-4df0ab1a-efaa-409e-8ed3-59ea88cb1f29 req-b7208fdd-11ac-41ab-9be9-1a089f477a6e service nova] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Updating instance_info_cache with network_info: [{"id": "496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74", "address": "fa:16:3e:68:65:1a", "network": {"id": "122fdd20-8bf5-4374-b50c-82e5dc8684db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-81475496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80f79dd6954748e4806a568a4127396f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap496ce3c5-18", "ovs_interfaceid": "496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 22:10:01 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-f9ed072e-4d24-445d-8d6e-a7606eca8da3 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Acquiring lock "61fe098a-5958-4ad1-8f92-4592809299b7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:10:01 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-f9ed072e-4d24-445d-8d6e-a7606eca8da3 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Lock "61fe098a-5958-4ad1-8f92-4592809299b7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:10:01 user nova-compute[74337]: INFO nova.compute.manager [None req-f9ed072e-4d24-445d-8d6e-a7606eca8da3 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Attaching volume 485637f5-7429-4020-83b7-1156be9d013f to /dev/vdb
Oct 23 22:10:01 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-4df0ab1a-efaa-409e-8ed3-59ea88cb1f29 req-b7208fdd-11ac-41ab-9be9-1a089f477a6e service nova] Releasing lock "refresh_cache-61fe098a-5958-4ad1-8f92-4592809299b7" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 22:10:01 user nova-compute[74337]: DEBUG os_brick.utils [None req-f9ed072e-4d24-445d-8d6e-a7606eca8da3 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 22:10:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:10:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:10:01 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[104b1bbe-2685-4835-b1c9-77092ed11038]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f34011b66e40\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:10:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:10:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:10:01 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e3ac74-5dae-4417-ae0e-e067f7b26ccd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:10:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:10:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:10:01 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd67f11-9382-4b52-a314-f87af87d5d6c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:10:01 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[4faae5d0-6ad2-4619-8525-3b4996661570]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:10:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-f9ed072e-4d24-445d-8d6e-a7606eca8da3 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Running cmd (subprocess): nvme version {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:10:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-f9ed072e-4d24-445d-8d6e-a7606eca8da3 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] 'nvme version' failed. Not Retrying. {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 22:10:01 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f9ed072e-4d24-445d-8d6e-a7606eca8da3 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] nvme not present on system {{(pid=74337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 22:10:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:10:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 22:10:01 user nova-compute[74337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 22:10:01 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[8872fd50-ba96-4711-b67a-89690f0e41eb]: (4, '') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:10:01 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-f9ed072e-4d24-445d-8d6e-a7606eca8da3 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 22:10:01 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-f9ed072e-4d24-445d-8d6e-a7606eca8da3 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 22:10:01 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-f9ed072e-4d24-445d-8d6e-a7606eca8da3 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] LIGHTOS: no hostnqn found. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 22:10:01 user nova-compute[74337]: DEBUG os_brick.utils [None req-f9ed072e-4d24-445d-8d6e-a7606eca8da3 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f34011b66e40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 22:10:01 user nova-compute[74337]: DEBUG nova.virt.block_device [None req-f9ed072e-4d24-445d-8d6e-a7606eca8da3 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Updating existing volume attachment record: 01feac20-8a76-44e9-a8e7-3d9ef14c9f14 {{(pid=74337) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 22:10:03 user nova-compute[74337]: DEBUG nova.compute.manager [None req-62c15546-000c-463b-9977-84c5f8a01481 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] [instance: 106da458-caec-4114-8904-0411ec0ea903] Checking state {{(pid=74337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 22:10:03 user nova-compute[74337]: INFO nova.compute.manager [None req-62c15546-000c-463b-9977-84c5f8a01481 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] [instance: 106da458-caec-4114-8904-0411ec0ea903] instance snapshotting
Oct 23 22:10:03 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-62c15546-000c-463b-9977-84c5f8a01481 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] [instance: 106da458-caec-4114-8904-0411ec0ea903] Beginning live snapshot process
Oct 23 22:10:03 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-62c15546-000c-463b-9977-84c5f8a01481 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/106da458-caec-4114-8904-0411ec0ea903/disk --force-share --output=json -f qcow2 {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:10:04 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-62c15546-000c-463b-9977-84c5f8a01481 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/106da458-caec-4114-8904-0411ec0ea903/disk --force-share --output=json -f qcow2" returned: 0 in 0.186s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:10:04 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-62c15546-000c-463b-9977-84c5f8a01481 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/106da458-caec-4114-8904-0411ec0ea903/disk --force-share --output=json -f qcow2 {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:10:04 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:10:04 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-62c15546-000c-463b-9977-84c5f8a01481 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/106da458-caec-4114-8904-0411ec0ea903/disk --force-share --output=json -f qcow2" returned: 0 in 0.170s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:10:04 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-62c15546-000c-463b-9977-84c5f8a01481 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:10:04 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:10:04 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-62c15546-000c-463b-9977-84c5f8a01481 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.188s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:10:04 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-62c15546-000c-463b-9977-84c5f8a01481 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpe4ker4tu/4e9473df96584a38af98342b73e208ea.delta 1073741824 {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:10:04 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-62c15546-000c-463b-9977-84c5f8a01481 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpe4ker4tu/4e9473df96584a38af98342b73e208ea.delta 1073741824" returned: 0 in 0.052s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:10:04 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-62c15546-000c-463b-9977-84c5f8a01481 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] [instance: 106da458-caec-4114-8904-0411ec0ea903] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 23 22:10:05 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-62c15546-000c-463b-9977-84c5f8a01481 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=74337) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 22:10:05 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-62c15546-000c-463b-9977-84c5f8a01481 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=74337) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 23 22:10:05 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-62c15546-000c-463b-9977-84c5f8a01481 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] [instance: 106da458-caec-4114-8904-0411ec0ea903] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 23 22:10:05 user nova-compute[74337]: DEBUG nova.privsep.utils [None req-62c15546-000c-463b-9977-84c5f8a01481 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74337) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 23 22:10:05 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-62c15546-000c-463b-9977-84c5f8a01481 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpe4ker4tu/4e9473df96584a38af98342b73e208ea.delta /opt/stack/data/nova/instances/snapshots/tmpe4ker4tu/4e9473df96584a38af98342b73e208ea {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:10:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-62c15546-000c-463b-9977-84c5f8a01481 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpe4ker4tu/4e9473df96584a38af98342b73e208ea.delta /opt/stack/data/nova/instances/snapshots/tmpe4ker4tu/4e9473df96584a38af98342b73e208ea" returned: 0 in 0.886s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:10:06 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-62c15546-000c-463b-9977-84c5f8a01481 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] [instance: 106da458-caec-4114-8904-0411ec0ea903] Snapshot extracted, beginning image upload
Oct 23 22:10:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:10:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:10:09 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-62c15546-000c-463b-9977-84c5f8a01481 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] [instance: 106da458-caec-4114-8904-0411ec0ea903] Snapshot image upload complete
Oct 23 22:10:09 user nova-compute[74337]: INFO nova.compute.manager [None req-62c15546-000c-463b-9977-84c5f8a01481 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] [instance: 106da458-caec-4114-8904-0411ec0ea903] Took 5.76 seconds to snapshot the instance on the hypervisor.
Oct 23 22:10:11 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-02da6173-4e5b-4e3c-a137-2a80e3a678dd tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Acquiring lock "a6aee021-df0b-4ada-9f82-8df7486dc869" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:10:11 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-02da6173-4e5b-4e3c-a137-2a80e3a678dd tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Lock "a6aee021-df0b-4ada-9f82-8df7486dc869" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:10:11 user nova-compute[74337]: DEBUG nova.compute.manager [None req-02da6173-4e5b-4e3c-a137-2a80e3a678dd tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] [instance: a6aee021-df0b-4ada-9f82-8df7486dc869] Starting instance... {{(pid=74337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 22:10:11 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-02da6173-4e5b-4e3c-a137-2a80e3a678dd tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:10:11 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-02da6173-4e5b-4e3c-a137-2a80e3a678dd tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:10:11 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-02da6173-4e5b-4e3c-a137-2a80e3a678dd tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 22:10:11 user nova-compute[74337]: INFO nova.compute.claims [None req-02da6173-4e5b-4e3c-a137-2a80e3a678dd tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] [instance: a6aee021-df0b-4ada-9f82-8df7486dc869] Claim successful on node user
Oct 23 22:10:11 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-02da6173-4e5b-4e3c-a137-2a80e3a678dd tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Refreshing inventories for resource provider dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 23 22:10:11 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-02da6173-4e5b-4e3c-a137-2a80e3a678dd tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Updating ProviderTree inventory for provider dfcf3942-a432-4293-945b-14b86f57d794 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 23 22:10:11 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-02da6173-4e5b-4e3c-a137-2a80e3a678dd tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Updating inventory in ProviderTree for provider dfcf3942-a432-4293-945b-14b86f57d794 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 23 22:10:11 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-02da6173-4e5b-4e3c-a137-2a80e3a678dd tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Refreshing aggregate associations for resource provider dfcf3942-a432-4293-945b-14b86f57d794, aggregates: None {{(pid=74337) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 23 22:10:11 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-02da6173-4e5b-4e3c-a137-2a80e3a678dd tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Refreshing trait associations for resource provider dfcf3942-a432-4293-945b-14b86f57d794, traits: COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE2,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE42,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_EXTEND,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_TRUSTED_CERTS {{(pid=74337) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 23 22:10:11 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-02da6173-4e5b-4e3c-a137-2a80e3a678dd tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 22:10:11 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-02da6173-4e5b-4e3c-a137-2a80e3a678dd tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 22:10:11 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-02da6173-4e5b-4e3c-a137-2a80e3a678dd tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.418s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:10:11 user nova-compute[74337]: DEBUG nova.compute.manager [None req-02da6173-4e5b-4e3c-a137-2a80e3a678dd tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] [instance: a6aee021-df0b-4ada-9f82-8df7486dc869] Start building networks asynchronously for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 22:10:12 user nova-compute[74337]: DEBUG nova.compute.manager [None req-02da6173-4e5b-4e3c-a137-2a80e3a678dd tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] [instance: a6aee021-df0b-4ada-9f82-8df7486dc869] Allocating IP information in the background. {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 22:10:12 user nova-compute[74337]: DEBUG nova.network.neutron [None req-02da6173-4e5b-4e3c-a137-2a80e3a678dd tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] [instance: a6aee021-df0b-4ada-9f82-8df7486dc869] allocate_for_instance() {{(pid=74337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 22:10:12 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-02da6173-4e5b-4e3c-a137-2a80e3a678dd tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] [instance: a6aee021-df0b-4ada-9f82-8df7486dc869] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 22:10:12 user nova-compute[74337]: DEBUG nova.compute.manager [None req-02da6173-4e5b-4e3c-a137-2a80e3a678dd tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] [instance: a6aee021-df0b-4ada-9f82-8df7486dc869] Start building block device mappings for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 22:10:12 user nova-compute[74337]: DEBUG nova.policy [None req-02da6173-4e5b-4e3c-a137-2a80e3a678dd tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a96a8803687f4b7db06e29b5b736ade1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc044020751d475b94e96fcedb97b86c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74337) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 22:10:12 user nova-compute[74337]: DEBUG nova.compute.manager [None req-02da6173-4e5b-4e3c-a137-2a80e3a678dd tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] [instance: a6aee021-df0b-4ada-9f82-8df7486dc869] Start spawning the instance on the hypervisor. {{(pid=74337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 22:10:12 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-02da6173-4e5b-4e3c-a137-2a80e3a678dd tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] [instance: a6aee021-df0b-4ada-9f82-8df7486dc869] Creating instance directory {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 22:10:12 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-02da6173-4e5b-4e3c-a137-2a80e3a678dd tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] [instance: a6aee021-df0b-4ada-9f82-8df7486dc869] Creating image(s)
Oct 23 22:10:12 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-02da6173-4e5b-4e3c-a137-2a80e3a678dd tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Acquiring lock "/opt/stack/data/nova/instances/a6aee021-df0b-4ada-9f82-8df7486dc869/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:10:12 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-02da6173-4e5b-4e3c-a137-2a80e3a678dd tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Lock "/opt/stack/data/nova/instances/a6aee021-df0b-4ada-9f82-8df7486dc869/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:10:12 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-02da6173-4e5b-4e3c-a137-2a80e3a678dd tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Lock "/opt/stack/data/nova/instances/a6aee021-df0b-4ada-9f82-8df7486dc869/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:10:12 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-02da6173-4e5b-4e3c-a137-2a80e3a678dd tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Acquiring lock "b2a66099795385948ead6f083c164cf8a565228b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:10:12 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-02da6173-4e5b-4e3c-a137-2a80e3a678dd tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Lock "b2a66099795385948ead6f083c164cf8a565228b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:10:13 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-02da6173-4e5b-4e3c-a137-2a80e3a678dd tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b2a66099795385948ead6f083c164cf8a565228b.part --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:10:13 user nova-compute[74337]: DEBUG nova.network.neutron [None req-02da6173-4e5b-4e3c-a137-2a80e3a678dd tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] [instance: a6aee021-df0b-4ada-9f82-8df7486dc869] Successfully created port: 7de2dfea-ae8f-4aab-8f6c-06eb8a86f1ec {{(pid=74337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 22:10:13 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-02da6173-4e5b-4e3c-a137-2a80e3a678dd tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b2a66099795385948ead6f083c164cf8a565228b.part --force-share --output=json" returned: 0 in 0.180s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:10:13 user nova-compute[74337]: DEBUG nova.virt.images [None req-02da6173-4e5b-4e3c-a137-2a80e3a678dd tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] c918a5be-6ec8-487d-8d27-bc65ab3219ae was qcow2, converting to raw {{(pid=74337) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 23 22:10:13 user nova-compute[74337]: DEBUG nova.privsep.utils [None req-02da6173-4e5b-4e3c-a137-2a80e3a678dd tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74337) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 23 22:10:13 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-02da6173-4e5b-4e3c-a137-2a80e3a678dd tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b2a66099795385948ead6f083c164cf8a565228b.part /opt/stack/data/nova/instances/_base/b2a66099795385948ead6f083c164cf8a565228b.converted {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:10:13 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-02da6173-4e5b-4e3c-a137-2a80e3a678dd tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b2a66099795385948ead6f083c164cf8a565228b.part /opt/stack/data/nova/instances/_base/b2a66099795385948ead6f083c164cf8a565228b.converted" returned: 0 in 0.460s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:10:13 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-02da6173-4e5b-4e3c-a137-2a80e3a678dd tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b2a66099795385948ead6f083c164cf8a565228b.converted --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:10:14 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-02da6173-4e5b-4e3c-a137-2a80e3a678dd tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b2a66099795385948ead6f083c164cf8a565228b.converted --force-share --output=json" returned: 0 in 0.245s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:10:14 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-02da6173-4e5b-4e3c-a137-2a80e3a678dd tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Lock "b2a66099795385948ead6f083c164cf8a565228b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.833s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:10:14 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-02da6173-4e5b-4e3c-a137-2a80e3a678dd tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b2a66099795385948ead6f083c164cf8a565228b --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:10:14 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:10:14 user nova-compute[74337]: DEBUG nova.network.neutron [None req-02da6173-4e5b-4e3c-a137-2a80e3a678dd tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] [instance: a6aee021-df0b-4ada-9f82-8df7486dc869] Successfully updated port: 7de2dfea-ae8f-4aab-8f6c-06eb8a86f1ec {{(pid=74337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 22:10:14 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-02da6173-4e5b-4e3c-a137-2a80e3a678dd tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Acquiring lock "refresh_cache-a6aee021-df0b-4ada-9f82-8df7486dc869" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 22:10:14 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-02da6173-4e5b-4e3c-a137-2a80e3a678dd tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Acquired lock "refresh_cache-a6aee021-df0b-4ada-9f82-8df7486dc869" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 22:10:14 user nova-compute[74337]: DEBUG nova.network.neutron [None req-02da6173-4e5b-4e3c-a137-2a80e3a678dd tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] [instance: a6aee021-df0b-4ada-9f82-8df7486dc869] Building network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 22:10:14 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-02da6173-4e5b-4e3c-a137-2a80e3a678dd tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b2a66099795385948ead6f083c164cf8a565228b --force-share --output=json" returned: 0 in 0.174s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:10:14 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-02da6173-4e5b-4e3c-a137-2a80e3a678dd tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Acquiring lock "b2a66099795385948ead6f083c164cf8a565228b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:10:14 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-02da6173-4e5b-4e3c-a137-2a80e3a678dd tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Lock "b2a66099795385948ead6f083c164cf8a565228b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:10:14 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-02da6173-4e5b-4e3c-a137-2a80e3a678dd tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b2a66099795385948ead6f083c164cf8a565228b --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:10:14 user nova-compute[74337]: DEBUG nova.compute.manager [req-49ecfe2d-d63b-4522-9c6e-a3a78c9a9aa9 req-218b73cd-1425-443e-8cb6-1cf90f41bc13 service nova] [instance: a6aee021-df0b-4ada-9f82-8df7486dc869] Received event network-changed-7de2dfea-ae8f-4aab-8f6c-06eb8a86f1ec {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:10:14 user nova-compute[74337]: DEBUG nova.compute.manager [req-49ecfe2d-d63b-4522-9c6e-a3a78c9a9aa9 req-218b73cd-1425-443e-8cb6-1cf90f41bc13 service nova] [instance: a6aee021-df0b-4ada-9f82-8df7486dc869] Refreshing instance network info cache due to event network-changed-7de2dfea-ae8f-4aab-8f6c-06eb8a86f1ec. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 22:10:14 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-49ecfe2d-d63b-4522-9c6e-a3a78c9a9aa9 req-218b73cd-1425-443e-8cb6-1cf90f41bc13 service nova] Acquiring lock "refresh_cache-a6aee021-df0b-4ada-9f82-8df7486dc869" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 22:10:14 user nova-compute[74337]: DEBUG nova.network.neutron [None req-02da6173-4e5b-4e3c-a137-2a80e3a678dd tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] [instance: a6aee021-df0b-4ada-9f82-8df7486dc869] Instance cache missing network info. {{(pid=74337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 22:10:14 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-02da6173-4e5b-4e3c-a137-2a80e3a678dd tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b2a66099795385948ead6f083c164cf8a565228b --force-share --output=json" returned: 0 in 0.168s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:10:14 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-02da6173-4e5b-4e3c-a137-2a80e3a678dd tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b2a66099795385948ead6f083c164cf8a565228b,backing_fmt=raw /opt/stack/data/nova/instances/a6aee021-df0b-4ada-9f82-8df7486dc869/disk 1073741824 {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:10:14 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-02da6173-4e5b-4e3c-a137-2a80e3a678dd tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b2a66099795385948ead6f083c164cf8a565228b,backing_fmt=raw /opt/stack/data/nova/instances/a6aee021-df0b-4ada-9f82-8df7486dc869/disk 1073741824" returned: 0 in 0.053s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:10:14 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-02da6173-4e5b-4e3c-a137-2a80e3a678dd tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Lock "b2a66099795385948ead6f083c164cf8a565228b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:10:14 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-02da6173-4e5b-4e3c-a137-2a80e3a678dd tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b2a66099795385948ead6f083c164cf8a565228b --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:10:14 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-02da6173-4e5b-4e3c-a137-2a80e3a678dd tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b2a66099795385948ead6f083c164cf8a565228b --force-share --output=json" returned: 0 in 0.168s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:10:14 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-02da6173-4e5b-4e3c-a137-2a80e3a678dd tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] [instance: a6aee021-df0b-4ada-9f82-8df7486dc869] Created local disks {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 22:10:14 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-02da6173-4e5b-4e3c-a137-2a80e3a678dd tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] [instance: a6aee021-df0b-4ada-9f82-8df7486dc869] Ensure instance console log exists: /opt/stack/data/nova/instances/a6aee021-df0b-4ada-9f82-8df7486dc869/console.log {{(pid=74337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 22:10:14 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-02da6173-4e5b-4e3c-a137-2a80e3a678dd tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:10:14 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-02da6173-4e5b-4e3c-a137-2a80e3a678dd tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:10:14 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-02da6173-4e5b-4e3c-a137-2a80e3a678dd tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:10:14 user nova-compute[74337]: DEBUG nova.network.neutron [None req-02da6173-4e5b-4e3c-a137-2a80e3a678dd tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] [instance: a6aee021-df0b-4ada-9f82-8df7486dc869] Updating instance_info_cache with network_info: [{"id": "7de2dfea-ae8f-4aab-8f6c-06eb8a86f1ec", "address": "fa:16:3e:41:c4:f2", "network": {"id": "09783701-f9c4-4d08-8523-6e363a558ec0", "bridge": "br-int", "label": "tempest-TestStampPattern-974584378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc044020751d475b94e96fcedb97b86c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7de2dfea-ae", "ovs_interfaceid": "7de2dfea-ae8f-4aab-8f6c-06eb8a86f1ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 22:10:14 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-02da6173-4e5b-4e3c-a137-2a80e3a678dd tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Releasing lock "refresh_cache-a6aee021-df0b-4ada-9f82-8df7486dc869" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 22:10:14 user nova-compute[74337]: DEBUG nova.compute.manager [None req-02da6173-4e5b-4e3c-a137-2a80e3a678dd tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] [instance: a6aee021-df0b-4ada-9f82-8df7486dc869] Instance network_info: |[{"id": "7de2dfea-ae8f-4aab-8f6c-06eb8a86f1ec", "address": "fa:16:3e:41:c4:f2", "network": {"id": "09783701-f9c4-4d08-8523-6e363a558ec0", "bridge": "br-int", "label": "tempest-TestStampPattern-974584378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc044020751d475b94e96fcedb97b86c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7de2dfea-ae", "ovs_interfaceid": "7de2dfea-ae8f-4aab-8f6c-06eb8a86f1ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 22:10:14 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-49ecfe2d-d63b-4522-9c6e-a3a78c9a9aa9 req-218b73cd-1425-443e-8cb6-1cf90f41bc13 service nova] Acquired lock "refresh_cache-a6aee021-df0b-4ada-9f82-8df7486dc869" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 22:10:14 user nova-compute[74337]: DEBUG nova.network.neutron [req-49ecfe2d-d63b-4522-9c6e-a3a78c9a9aa9 req-218b73cd-1425-443e-8cb6-1cf90f41bc13 service nova] [instance: a6aee021-df0b-4ada-9f82-8df7486dc869] Refreshing network info cache for port 7de2dfea-ae8f-4aab-8f6c-06eb8a86f1ec {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 22:10:14 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-02da6173-4e5b-4e3c-a137-2a80e3a678dd tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] [instance: a6aee021-df0b-4ada-9f82-8df7486dc869] Start _get_guest_xml network_info=[{"id": "7de2dfea-ae8f-4aab-8f6c-06eb8a86f1ec", "address": "fa:16:3e:41:c4:f2", "network": {"id": "09783701-f9c4-4d08-8523-6e363a558ec0", "bridge": "br-int", "label": "tempest-TestStampPattern-974584378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc044020751d475b94e96fcedb97b86c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7de2dfea-ae", "ovs_interfaceid": "7de2dfea-ae8f-4aab-8f6c-06eb8a86f1ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='be793ebb3ecb7dd35481291e110b90cc',container_format='bare',created_at=2023-10-23T22:10:03Z,direct_url=<?>,disk_format='qcow2',id=c918a5be-6ec8-487d-8d27-bc65ab3219ae,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-670449293',owner='bc044020751d475b94e96fcedb97b86c',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-23T22:10:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'image_id': 'c918a5be-6ec8-487d-8d27-bc65ab3219ae'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 22:10:14 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-02da6173-4e5b-4e3c-a137-2a80e3a678dd tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:10:14 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-02da6173-4e5b-4e3c-a137-2a80e3a678dd tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:10:14 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-02da6173-4e5b-4e3c-a137-2a80e3a678dd tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 22:10:14 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-02da6173-4e5b-4e3c-a137-2a80e3a678dd tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] CPU controller missing on host. {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 22:10:14 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-02da6173-4e5b-4e3c-a137-2a80e3a678dd tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 22:10:14 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-02da6173-4e5b-4e3c-a137-2a80e3a678dd tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] CPU controller found on host. {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 22:10:14 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-02da6173-4e5b-4e3c-a137-2a80e3a678dd tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 22:10:14 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-02da6173-4e5b-4e3c-a137-2a80e3a678dd tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T21:29:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='be793ebb3ecb7dd35481291e110b90cc',container_format='bare',created_at=2023-10-23T22:10:03Z,direct_url=<?>,disk_format='qcow2',id=c918a5be-6ec8-487d-8d27-bc65ab3219ae,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-670449293',owner='bc044020751d475b94e96fcedb97b86c',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-23T22:10:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 22:10:14 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-02da6173-4e5b-4e3c-a137-2a80e3a678dd tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Flavor limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 22:10:14 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-02da6173-4e5b-4e3c-a137-2a80e3a678dd tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Image limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 22:10:14 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-02da6173-4e5b-4e3c-a137-2a80e3a678dd tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Flavor pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 22:10:14 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-02da6173-4e5b-4e3c-a137-2a80e3a678dd tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Image pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 22:10:14 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-02da6173-4e5b-4e3c-a137-2a80e3a678dd tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 22:10:14 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-02da6173-4e5b-4e3c-a137-2a80e3a678dd tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 22:10:14 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-02da6173-4e5b-4e3c-a137-2a80e3a678dd tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 22:10:14 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-02da6173-4e5b-4e3c-a137-2a80e3a678dd tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Got 1 possible topologies {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 22:10:14 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-02da6173-4e5b-4e3c-a137-2a80e3a678dd tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 22:10:14 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-02da6173-4e5b-4e3c-a137-2a80e3a678dd tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 22:10:14 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-02da6173-4e5b-4e3c-a137-2a80e3a678dd tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T22:10:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1278263266',display_name='tempest-TestStampPattern-server-1278263266',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1278263266',id=50,image_ref='c918a5be-6ec8-487d-8d27-bc65ab3219ae',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM/w5IxSPpZmfXwphA/Co4/hp2D6fAjEAT72VAt3V+4E9LsYzs0Ns5n7Z6WZABZZJFZarcd4Py5ieFgN0v3D5Oi+9O8evYRVN2/Q9FEiDD/ZoEa6QuGDQ0iF55PrsWzQHw==',key_name='tempest-TestStampPattern-561385519',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bc044020751d475b94e96fcedb97b86c',ramdisk_id='',reservation_id='r-gqd2jsd0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='106da458-caec-4114-8904-0411ec0ea903',image_min_disk='1',image_min_ram='0',image_owner_id='bc044020751d475b94e96fcedb97b86c',image_owner_project_name='tempest-TestStampPattern-955971620',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-955971620-project-member',image_user_id='a96a8803687f4b7db06e29b5b736ade1',network_allocated='True',owner_project_name='tempest-TestStampPattern-955971620',owner_user_name='tempest-TestStampPattern-955971620-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T22:10:12Z,user_data=None,user_id='a96a8803687f4b7db06e29b5b736ade1',uuid=a6aee021-df0b-4ada-9f82-8df7486dc869,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7de2dfea-ae8f-4aab-8f6c-06eb8a86f1ec", "address": "fa:16:3e:41:c4:f2", "network": {"id": "09783701-f9c4-4d08-8523-6e363a558ec0", "bridge": "br-int", "label": "tempest-TestStampPattern-974584378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc044020751d475b94e96fcedb97b86c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7de2dfea-ae", "ovs_interfaceid": "7de2dfea-ae8f-4aab-8f6c-06eb8a86f1ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 22:10:14 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-02da6173-4e5b-4e3c-a137-2a80e3a678dd tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Converting VIF {"id": "7de2dfea-ae8f-4aab-8f6c-06eb8a86f1ec", "address": "fa:16:3e:41:c4:f2", "network": {"id": "09783701-f9c4-4d08-8523-6e363a558ec0", "bridge": "br-int", "label": "tempest-TestStampPattern-974584378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc044020751d475b94e96fcedb97b86c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7de2dfea-ae", "ovs_interfaceid": "7de2dfea-ae8f-4aab-8f6c-06eb8a86f1ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 22:10:14 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-02da6173-4e5b-4e3c-a137-2a80e3a678dd tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:c4:f2,bridge_name='br-int',has_traffic_filtering=True,id=7de2dfea-ae8f-4aab-8f6c-06eb8a86f1ec,network=Network(09783701-f9c4-4d08-8523-6e363a558ec0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7de2dfea-ae') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 22:10:14 user nova-compute[74337]: DEBUG nova.objects.instance [None req-02da6173-4e5b-4e3c-a137-2a80e3a678dd tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Lazy-loading 'pci_devices' on Instance uuid a6aee021-df0b-4ada-9f82-8df7486dc869 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:10:14 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-02da6173-4e5b-4e3c-a137-2a80e3a678dd tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] [instance: a6aee021-df0b-4ada-9f82-8df7486dc869] End _get_guest_xml xml=<domain type="kvm">
Oct 23 22:10:14 user nova-compute[74337]:   <uuid>a6aee021-df0b-4ada-9f82-8df7486dc869</uuid>
Oct 23 22:10:14 user nova-compute[74337]:   <name>instance-00000032</name>
Oct 23 22:10:14 user nova-compute[74337]:   <memory>524288</memory>
Oct 23 22:10:14 user nova-compute[74337]:   <vcpu>1</vcpu>
Oct 23 22:10:14 user nova-compute[74337]:   <metadata>
Oct 23 22:10:14 user nova-compute[74337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 22:10:14 user nova-compute[74337]:       <nova:package version="0.0.0"/>
Oct 23 22:10:14 user nova-compute[74337]:       <nova:name>tempest-TestStampPattern-server-1278263266</nova:name>
Oct 23 22:10:14 user nova-compute[74337]:       <nova:creationTime>2023-10-23 22:10:14</nova:creationTime>
Oct 23 22:10:14 user nova-compute[74337]:       <nova:flavor name="m1.tiny">
Oct 23 22:10:14 user nova-compute[74337]:         <nova:memory>512</nova:memory>
Oct 23 22:10:14 user nova-compute[74337]:         <nova:disk>1</nova:disk>
Oct 23 22:10:14 user nova-compute[74337]:         <nova:swap>0</nova:swap>
Oct 23 22:10:14 user nova-compute[74337]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 22:10:14 user nova-compute[74337]:         <nova:vcpus>1</nova:vcpus>
Oct 23 22:10:14 user nova-compute[74337]:       </nova:flavor>
Oct 23 22:10:14 user nova-compute[74337]:       <nova:owner>
Oct 23 22:10:14 user nova-compute[74337]:         <nova:user uuid="a96a8803687f4b7db06e29b5b736ade1">tempest-TestStampPattern-955971620-project-member</nova:user>
Oct 23 22:10:14 user nova-compute[74337]:         <nova:project uuid="bc044020751d475b94e96fcedb97b86c">tempest-TestStampPattern-955971620</nova:project>
Oct 23 22:10:14 user nova-compute[74337]:       </nova:owner>
Oct 23 22:10:14 user nova-compute[74337]:       <nova:root type="image" uuid="c918a5be-6ec8-487d-8d27-bc65ab3219ae"/>
Oct 23 22:10:14 user nova-compute[74337]:       <nova:ports>
Oct 23 22:10:14 user nova-compute[74337]:         <nova:port uuid="7de2dfea-ae8f-4aab-8f6c-06eb8a86f1ec">
Oct 23 22:10:14 user nova-compute[74337]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 23 22:10:14 user nova-compute[74337]:         </nova:port>
Oct 23 22:10:14 user nova-compute[74337]:       </nova:ports>
Oct 23 22:10:14 user nova-compute[74337]:     </nova:instance>
Oct 23 22:10:14 user nova-compute[74337]:   </metadata>
Oct 23 22:10:14 user nova-compute[74337]:   <sysinfo type="smbios">
Oct 23 22:10:14 user nova-compute[74337]:     <system>
Oct 23 22:10:14 user nova-compute[74337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 22:10:14 user nova-compute[74337]:       <entry name="product">OpenStack Nova</entry>
Oct 23 22:10:14 user nova-compute[74337]:       <entry name="version">0.0.0</entry>
Oct 23 22:10:14 user nova-compute[74337]:       <entry name="serial">a6aee021-df0b-4ada-9f82-8df7486dc869</entry>
Oct 23 22:10:14 user nova-compute[74337]:       <entry name="uuid">a6aee021-df0b-4ada-9f82-8df7486dc869</entry>
Oct 23 22:10:14 user nova-compute[74337]:       <entry name="family">Virtual Machine</entry>
Oct 23 22:10:14 user nova-compute[74337]:     </system>
Oct 23 22:10:14 user nova-compute[74337]:   </sysinfo>
Oct 23 22:10:14 user nova-compute[74337]:   <os>
Oct 23 22:10:14 user nova-compute[74337]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 22:10:14 user nova-compute[74337]:     <boot dev="hd"/>
Oct 23 22:10:14 user nova-compute[74337]:     <smbios mode="sysinfo"/>
Oct 23 22:10:14 user nova-compute[74337]:   </os>
Oct 23 22:10:14 user nova-compute[74337]:   <features>
Oct 23 22:10:14 user nova-compute[74337]:     <acpi/>
Oct 23 22:10:14 user nova-compute[74337]:     <apic/>
Oct 23 22:10:14 user nova-compute[74337]:     <vmcoreinfo/>
Oct 23 22:10:14 user nova-compute[74337]:   </features>
Oct 23 22:10:14 user nova-compute[74337]:   <clock offset="utc">
Oct 23 22:10:14 user nova-compute[74337]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 22:10:14 user nova-compute[74337]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 22:10:14 user nova-compute[74337]:     <timer name="hpet" present="no"/>
Oct 23 22:10:14 user nova-compute[74337]:   </clock>
Oct 23 22:10:14 user nova-compute[74337]:   <cpu mode="custom" match="exact">
Oct 23 22:10:14 user nova-compute[74337]:     <model>Nehalem</model>
Oct 23 22:10:14 user nova-compute[74337]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 22:10:14 user nova-compute[74337]:   </cpu>
Oct 23 22:10:14 user nova-compute[74337]:   <devices>
Oct 23 22:10:14 user nova-compute[74337]:     <disk type="file" device="disk">
Oct 23 22:10:14 user nova-compute[74337]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 22:10:14 user nova-compute[74337]:       <source file="/opt/stack/data/nova/instances/a6aee021-df0b-4ada-9f82-8df7486dc869/disk"/>
Oct 23 22:10:14 user nova-compute[74337]:       <target dev="vda" bus="virtio"/>
Oct 23 22:10:14 user nova-compute[74337]:     </disk>
Oct 23 22:10:14 user nova-compute[74337]:     <interface type="ethernet">
Oct 23 22:10:14 user nova-compute[74337]:       <mac address="fa:16:3e:41:c4:f2"/>
Oct 23 22:10:14 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 22:10:14 user nova-compute[74337]:       <mtu size="1442"/>
Oct 23 22:10:14 user nova-compute[74337]:       <target dev="tap7de2dfea-ae"/>
Oct 23 22:10:14 user nova-compute[74337]:     </interface>
Oct 23 22:10:14 user nova-compute[74337]:     <serial type="pty">
Oct 23 22:10:14 user nova-compute[74337]:       <log file="/opt/stack/data/nova/instances/a6aee021-df0b-4ada-9f82-8df7486dc869/console.log" append="off"/>
Oct 23 22:10:14 user nova-compute[74337]:     </serial>
Oct 23 22:10:14 user nova-compute[74337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 22:10:14 user nova-compute[74337]:     <video>
Oct 23 22:10:14 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 22:10:14 user nova-compute[74337]:     </video>
Oct 23 22:10:14 user nova-compute[74337]:     <rng model="virtio">
Oct 23 22:10:14 user nova-compute[74337]:       <backend model="random">/dev/urandom</backend>
Oct 23 22:10:14 user nova-compute[74337]:     </rng>
Oct 23 22:10:14 user nova-compute[74337]:     <controller type="usb" index="0" model="none"/>
Oct 23 22:10:14 user nova-compute[74337]:     <memballoon model="virtio">
Oct 23 22:10:14 user nova-compute[74337]:       <stats period="10"/>
Oct 23 22:10:14 user nova-compute[74337]:     </memballoon>
Oct 23 22:10:14 user nova-compute[74337]:   </devices>
Oct 23 22:10:14 user nova-compute[74337]: </domain>
Oct 23 22:10:14 user nova-compute[74337]:  {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 22:10:14 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-02da6173-4e5b-4e3c-a137-2a80e3a678dd tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T22:10:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1278263266',display_name='tempest-TestStampPattern-server-1278263266',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1278263266',id=50,image_ref='c918a5be-6ec8-487d-8d27-bc65ab3219ae',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM/w5IxSPpZmfXwphA/Co4/hp2D6fAjEAT72VAt3V+4E9LsYzs0Ns5n7Z6WZABZZJFZarcd4Py5ieFgN0v3D5Oi+9O8evYRVN2/Q9FEiDD/ZoEa6QuGDQ0iF55PrsWzQHw==',key_name='tempest-TestStampPattern-561385519',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bc044020751d475b94e96fcedb97b86c',ramdisk_id='',reservation_id='r-gqd2jsd0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='106da458-caec-4114-8904-0411ec0ea903',image_min_disk='1',image_min_ram='0',image_owner_id='bc044020751d475b94e96fcedb97b86c',image_owner_project_name='tempest-TestStampPattern-955971620',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-955971620-project-member',image_user_id='a96a8803687f4b7db06e29b5b736ade1',network_allocated='True',owner_project_name='tempest-TestStampPattern-955971620',owner_user_name='tempest-TestStampPattern-955971620-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T22:10:12Z,user_data=None,user_id='a96a8803687f4b7db06e29b5b736ade1',uuid=a6aee021-df0b-4ada-9f82-8df7486dc869,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7de2dfea-ae8f-4aab-8f6c-06eb8a86f1ec", "address": "fa:16:3e:41:c4:f2", "network": {"id": "09783701-f9c4-4d08-8523-6e363a558ec0", "bridge": "br-int", "label": "tempest-TestStampPattern-974584378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc044020751d475b94e96fcedb97b86c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7de2dfea-ae", "ovs_interfaceid": "7de2dfea-ae8f-4aab-8f6c-06eb8a86f1ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 22:10:14 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-02da6173-4e5b-4e3c-a137-2a80e3a678dd tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Converting VIF {"id": "7de2dfea-ae8f-4aab-8f6c-06eb8a86f1ec", "address": "fa:16:3e:41:c4:f2", "network": {"id": "09783701-f9c4-4d08-8523-6e363a558ec0", "bridge": "br-int", "label": "tempest-TestStampPattern-974584378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc044020751d475b94e96fcedb97b86c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7de2dfea-ae", "ovs_interfaceid": "7de2dfea-ae8f-4aab-8f6c-06eb8a86f1ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 22:10:14 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-02da6173-4e5b-4e3c-a137-2a80e3a678dd tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:c4:f2,bridge_name='br-int',has_traffic_filtering=True,id=7de2dfea-ae8f-4aab-8f6c-06eb8a86f1ec,network=Network(09783701-f9c4-4d08-8523-6e363a558ec0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7de2dfea-ae') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 22:10:14 user nova-compute[74337]: DEBUG os_vif [None req-02da6173-4e5b-4e3c-a137-2a80e3a678dd tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:c4:f2,bridge_name='br-int',has_traffic_filtering=True,id=7de2dfea-ae8f-4aab-8f6c-06eb8a86f1ec,network=Network(09783701-f9c4-4d08-8523-6e363a558ec0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7de2dfea-ae') {{(pid=74337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 22:10:14 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:10:14 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:10:14 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 22:10:14 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:10:14 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '36d6aacb-b98d-54ae-b7d5-8c819ef02a69', '_type': 'linux-noop'}}, row=False) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:10:14 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:10:14 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:10:14 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:10:14 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7de2dfea-ae, may_exist=True, interface_attrs={}) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:10:14 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7de2dfea-ae, col_values=(('qos', UUID('4772d751-f5c4-4be6-8b40-f019b8e4468f')),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:10:14 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7de2dfea-ae, col_values=(('external_ids', {'iface-id': '7de2dfea-ae8f-4aab-8f6c-06eb8a86f1ec', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:41:c4:f2', 'vm-uuid': 'a6aee021-df0b-4ada-9f82-8df7486dc869'}),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:10:14 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:10:14 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:10:14 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:10:14 user nova-compute[74337]: INFO os_vif [None req-02da6173-4e5b-4e3c-a137-2a80e3a678dd tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:c4:f2,bridge_name='br-int',has_traffic_filtering=True,id=7de2dfea-ae8f-4aab-8f6c-06eb8a86f1ec,network=Network(09783701-f9c4-4d08-8523-6e363a558ec0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7de2dfea-ae')
Oct 23 22:10:14 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-02da6173-4e5b-4e3c-a137-2a80e3a678dd tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] No BDM found with device name vda, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 22:10:14 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-02da6173-4e5b-4e3c-a137-2a80e3a678dd tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] No VIF found with MAC fa:16:3e:41:c4:f2, not building metadata {{(pid=74337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 22:10:15 user nova-compute[74337]: DEBUG nova.network.neutron [req-49ecfe2d-d63b-4522-9c6e-a3a78c9a9aa9 req-218b73cd-1425-443e-8cb6-1cf90f41bc13 service nova] [instance: a6aee021-df0b-4ada-9f82-8df7486dc869] Updated VIF entry in instance network info cache for port 7de2dfea-ae8f-4aab-8f6c-06eb8a86f1ec. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 22:10:15 user nova-compute[74337]: DEBUG nova.network.neutron [req-49ecfe2d-d63b-4522-9c6e-a3a78c9a9aa9 req-218b73cd-1425-443e-8cb6-1cf90f41bc13 service nova] [instance: a6aee021-df0b-4ada-9f82-8df7486dc869] Updating instance_info_cache with network_info: [{"id": "7de2dfea-ae8f-4aab-8f6c-06eb8a86f1ec", "address": "fa:16:3e:41:c4:f2", "network": {"id": "09783701-f9c4-4d08-8523-6e363a558ec0", "bridge": "br-int", "label": "tempest-TestStampPattern-974584378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc044020751d475b94e96fcedb97b86c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7de2dfea-ae", "ovs_interfaceid": "7de2dfea-ae8f-4aab-8f6c-06eb8a86f1ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 22:10:15 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-49ecfe2d-d63b-4522-9c6e-a3a78c9a9aa9 req-218b73cd-1425-443e-8cb6-1cf90f41bc13 service nova] Releasing lock "refresh_cache-a6aee021-df0b-4ada-9f82-8df7486dc869" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 22:10:16 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:10:16 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:10:16 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:10:16 user nova-compute[74337]: DEBUG nova.compute.manager [req-fcd6c43b-948e-41c3-991c-f5c9d8c39246 req-228895fb-c5fb-45f9-8489-a7948b19cf60 service nova] [instance: a6aee021-df0b-4ada-9f82-8df7486dc869] Received event network-vif-plugged-7de2dfea-ae8f-4aab-8f6c-06eb8a86f1ec {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:10:16 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-fcd6c43b-948e-41c3-991c-f5c9d8c39246 req-228895fb-c5fb-45f9-8489-a7948b19cf60 service nova] Acquiring lock "a6aee021-df0b-4ada-9f82-8df7486dc869-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:10:16 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-fcd6c43b-948e-41c3-991c-f5c9d8c39246 req-228895fb-c5fb-45f9-8489-a7948b19cf60 service nova] Lock "a6aee021-df0b-4ada-9f82-8df7486dc869-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:10:16 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-fcd6c43b-948e-41c3-991c-f5c9d8c39246 req-228895fb-c5fb-45f9-8489-a7948b19cf60 service nova] Lock "a6aee021-df0b-4ada-9f82-8df7486dc869-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:10:16 user nova-compute[74337]: DEBUG nova.compute.manager [req-fcd6c43b-948e-41c3-991c-f5c9d8c39246 req-228895fb-c5fb-45f9-8489-a7948b19cf60 service nova] [instance: a6aee021-df0b-4ada-9f82-8df7486dc869] No waiting events found dispatching network-vif-plugged-7de2dfea-ae8f-4aab-8f6c-06eb8a86f1ec {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 22:10:16 user nova-compute[74337]: WARNING nova.compute.manager [req-fcd6c43b-948e-41c3-991c-f5c9d8c39246 req-228895fb-c5fb-45f9-8489-a7948b19cf60 service nova] [instance: a6aee021-df0b-4ada-9f82-8df7486dc869] Received unexpected event network-vif-plugged-7de2dfea-ae8f-4aab-8f6c-06eb8a86f1ec for instance with vm_state building and task_state spawning.
Oct 23 22:10:16 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:10:16 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:10:18 user nova-compute[74337]: DEBUG nova.compute.manager [None req-02da6173-4e5b-4e3c-a137-2a80e3a678dd tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] [instance: a6aee021-df0b-4ada-9f82-8df7486dc869] Instance event wait completed in 0 seconds for  {{(pid=74337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 22:10:18 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-02da6173-4e5b-4e3c-a137-2a80e3a678dd tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] [instance: a6aee021-df0b-4ada-9f82-8df7486dc869] Guest created on hypervisor {{(pid=74337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 22:10:18 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: a6aee021-df0b-4ada-9f82-8df7486dc869] Instance spawned successfully.
Oct 23 22:10:18 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-02da6173-4e5b-4e3c-a137-2a80e3a678dd tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] [instance: a6aee021-df0b-4ada-9f82-8df7486dc869] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 22:10:18 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-02da6173-4e5b-4e3c-a137-2a80e3a678dd tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] [instance: a6aee021-df0b-4ada-9f82-8df7486dc869] Found default for hw_input_bus of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 22:10:18 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-02da6173-4e5b-4e3c-a137-2a80e3a678dd tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] [instance: a6aee021-df0b-4ada-9f82-8df7486dc869] Found default for hw_pointer_model of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 22:10:18 user nova-compute[74337]: DEBUG nova.compute.manager [req-95d6a2fa-74f5-402c-aabc-73fe38b6389f req-c44eb353-fa40-4f1b-8e10-c80d41b18e2d service nova] [instance: a6aee021-df0b-4ada-9f82-8df7486dc869] Received event network-vif-plugged-7de2dfea-ae8f-4aab-8f6c-06eb8a86f1ec {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:10:18 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-95d6a2fa-74f5-402c-aabc-73fe38b6389f req-c44eb353-fa40-4f1b-8e10-c80d41b18e2d service nova] Acquiring lock "a6aee021-df0b-4ada-9f82-8df7486dc869-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:10:18 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-95d6a2fa-74f5-402c-aabc-73fe38b6389f req-c44eb353-fa40-4f1b-8e10-c80d41b18e2d service nova] Lock "a6aee021-df0b-4ada-9f82-8df7486dc869-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:10:18 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-95d6a2fa-74f5-402c-aabc-73fe38b6389f req-c44eb353-fa40-4f1b-8e10-c80d41b18e2d service nova] Lock "a6aee021-df0b-4ada-9f82-8df7486dc869-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:10:18 user nova-compute[74337]: DEBUG nova.compute.manager [req-95d6a2fa-74f5-402c-aabc-73fe38b6389f req-c44eb353-fa40-4f1b-8e10-c80d41b18e2d service nova] [instance: a6aee021-df0b-4ada-9f82-8df7486dc869] No waiting events found dispatching network-vif-plugged-7de2dfea-ae8f-4aab-8f6c-06eb8a86f1ec {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 22:10:18 user nova-compute[74337]: WARNING nova.compute.manager [req-95d6a2fa-74f5-402c-aabc-73fe38b6389f req-c44eb353-fa40-4f1b-8e10-c80d41b18e2d service nova] [instance: a6aee021-df0b-4ada-9f82-8df7486dc869] Received unexpected event network-vif-plugged-7de2dfea-ae8f-4aab-8f6c-06eb8a86f1ec for instance with vm_state building and task_state spawning.
Oct 23 22:10:18 user nova-compute[74337]: INFO nova.compute.manager [None req-02da6173-4e5b-4e3c-a137-2a80e3a678dd tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] [instance: a6aee021-df0b-4ada-9f82-8df7486dc869] Took 6.33 seconds to spawn the instance on the hypervisor.
Oct 23 22:10:18 user nova-compute[74337]: DEBUG nova.compute.manager [None req-02da6173-4e5b-4e3c-a137-2a80e3a678dd tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] [instance: a6aee021-df0b-4ada-9f82-8df7486dc869] Checking state {{(pid=74337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 22:10:18 user nova-compute[74337]: INFO nova.compute.manager [None req-02da6173-4e5b-4e3c-a137-2a80e3a678dd tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] [instance: a6aee021-df0b-4ada-9f82-8df7486dc869] Took 7.18 seconds to build instance.
Oct 23 22:10:18 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-02da6173-4e5b-4e3c-a137-2a80e3a678dd tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Lock "a6aee021-df0b-4ada-9f82-8df7486dc869" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.300s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:10:18 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9ed072e-4d24-445d-8d6e-a7606eca8da3 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Calling os-brick to attach iSCSI Volume {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 22:10:18 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9ed072e-4d24-445d-8d6e-a7606eca8da3 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:485637f5-7429-4020-83b7-1156be9d013f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KfErMRax', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 22:10:18 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-f9ed072e-4d24-445d-8d6e-a7606eca8da3 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 22:10:18 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-f9ed072e-4d24-445d-8d6e-a7606eca8da3 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 22:10:18 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-f9ed072e-4d24-445d-8d6e-a7606eca8da3 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 22:10:18 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-f9ed072e-4d24-445d-8d6e-a7606eca8da3 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 22:10:18 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-f9ed072e-4d24-445d-8d6e-a7606eca8da3 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:485637f5-7429-4020-83b7-1156be9d013f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 22:10:18 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-f9ed072e-4d24-445d-8d6e-a7606eca8da3 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:485637f5-7429-4020-83b7-1156be9d013f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 22:10:18 user nova-compute[74337]: INFO os_brick.initiator.connectors.iscsi [None req-f9ed072e-4d24-445d-8d6e-a7606eca8da3 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 22:10:18 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:485637f5-7429-4020-83b7-1156be9d013f -p 172.16.0.220:3260 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:10:19 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:485637f5-7429-4020-83b7-1156be9d013f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:10:19 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[f08f1f90-047a-4344-91e9-6714b47eefbf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:10:19 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9ed072e-4d24-445d-8d6e-a7606eca8da3 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 22:10:19 user nova-compute[74337]:  {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:10:19 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:485637f5-7429-4020-83b7-1156be9d013f -p 172.16.0.220:3260 --interface default --op new {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:10:19 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:485637f5-7429-4020-83b7-1156be9d013f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:10:19 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[405ae928-d85e-48a9-b3f0-27d6bcc98289]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:485637f5-7429-4020-83b7-1156be9d013f] added\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:10:19 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9ed072e-4d24-445d-8d6e-a7606eca8da3 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:485637f5-7429-4020-83b7-1156be9d013f] added
Oct 23 22:10:19 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:10:19 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:485637f5-7429-4020-83b7-1156be9d013f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:10:19 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:485637f5-7429-4020-83b7-1156be9d013f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:10:19 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[bedb3b49-b056-468a-a0ef-51723ba79d9e]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:10:19 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9ed072e-4d24-445d-8d6e-a7606eca8da3 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:10:19 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:485637f5-7429-4020-83b7-1156be9d013f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:10:19 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:485637f5-7429-4020-83b7-1156be9d013f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:10:19 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[42bc7da8-3838-4649-a859-4109143a6ead]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:10:19 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9ed072e-4d24-445d-8d6e-a7606eca8da3 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:10:19 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:485637f5-7429-4020-83b7-1156be9d013f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KfErMRax {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:10:19 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:485637f5-7429-4020-83b7-1156be9d013f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KfErMRax" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:10:19 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb3729b-73a5-4567-b0f7-e2467626a91e]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:10:19 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9ed072e-4d24-445d-8d6e-a7606eca8da3 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KfErMRax'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:10:19 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:485637f5-7429-4020-83b7-1156be9d013f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:10:19 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:485637f5-7429-4020-83b7-1156be9d013f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:10:19 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2ae12b4-ef71-4bb9-9a32-aee837cb36d6]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:10:19 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9ed072e-4d24-445d-8d6e-a7606eca8da3 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:10:19 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:10:19 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:10:19 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[17410dbe-e766-46b5-8a18-25dfdfe733fc]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:10:19 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9ed072e-4d24-445d-8d6e-a7606eca8da3 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 23 22:10:19 user nova-compute[74337]:  {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 22:10:19 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9ed072e-4d24-445d-8d6e-a7606eca8da3 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 23 22:10:19 user nova-compute[74337]:  {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 22:10:19 user nova-compute[74337]: WARNING os_brick.initiator.connectors.iscsi [None req-f9ed072e-4d24-445d-8d6e-a7606eca8da3 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 23 22:10:19 user nova-compute[74337]: 
Oct 23 22:10:19 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:485637f5-7429-4020-83b7-1156be9d013f -p 172.16.0.220:3260 --login {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:10:19 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:485637f5-7429-4020-83b7-1156be9d013f -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:10:19 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cdfdebb-ab2c-42e3-b393-8ac99848276d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:485637f5-7429-4020-83b7-1156be9d013f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:485637f5-7429-4020-83b7-1156be9d013f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:10:19 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9ed072e-4d24-445d-8d6e-a7606eca8da3 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:485637f5-7429-4020-83b7-1156be9d013f, portal: 172.16.0.220,3260]
Oct 23 22:10:19 user nova-compute[74337]: Login to [iface: default, target: iqn.2010-10.org.openstack:485637f5-7429-4020-83b7-1156be9d013f, portal: 172.16.0.220,3260] successful.
Oct 23 22:10:19 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:10:19 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:485637f5-7429-4020-83b7-1156be9d013f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:10:19 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:485637f5-7429-4020-83b7-1156be9d013f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:10:19 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed6c4e47-d127-4203-b197-1565c0541b0c]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:10:19 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9ed072e-4d24-445d-8d6e-a7606eca8da3 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:10:19 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:10:19 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:10:19 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.116s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:10:19 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6024b72-d9d5-418d-989a-9d13c56a7316]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485637f5-7429-4020-83b7-1156be9d013f (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:10:19 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9ed072e-4d24-445d-8d6e-a7606eca8da3 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485637f5-7429-4020-83b7-1156be9d013f (non-flash)
Oct 23 22:10:19 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 22:10:19 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9ed072e-4d24-445d-8d6e-a7606eca8da3 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485637f5-7429-4020-83b7-1156be9d013f (non-flash)
Oct 23 22:10:19 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 22:10:19 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-f9ed072e-4d24-445d-8d6e-a7606eca8da3 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:485637f5-7429-4020-83b7-1156be9d013f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.388s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 22:10:19 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9ed072e-4d24-445d-8d6e-a7606eca8da3 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Connected to 172.16.0.220:3260 {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 22:10:19 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-f9ed072e-4d24-445d-8d6e-a7606eca8da3 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=74337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 22:10:19 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-f9ed072e-4d24-445d-8d6e-a7606eca8da3 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 22:10:19 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:10:19 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.032s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:10:19 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b65e72d-b7dd-4e4b-80bf-4045b842ff86]: (4, ('- - 0', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:10:19 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-f9ed072e-4d24-445d-8d6e-a7606eca8da3 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 22:10:19 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9ed072e-4d24-445d-8d6e-a7606eca8da3 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:485637f5-7429-4020-83b7-1156be9d013f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KfErMRax', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 22:10:19 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:10:20 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-f9ed072e-4d24-445d-8d6e-a7606eca8da3 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.441s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 22:10:20 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9ed072e-4d24-445d-8d6e-a7606eca8da3 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] <== connect_volume: return (1444ms) {'type': 'block', 'scsi_wwn': '23134613761336566', 'path': '/dev/sdb'} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 22:10:20 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9ed072e-4d24-445d-8d6e-a7606eca8da3 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23134613761336566', 'path': '/dev/sdb'} {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 22:10:20 user nova-compute[74337]: DEBUG nova.objects.instance [None req-f9ed072e-4d24-445d-8d6e-a7606eca8da3 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Lazy-loading 'flavor' on Instance uuid 61fe098a-5958-4ad1-8f92-4592809299b7 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:10:20 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-f9ed072e-4d24-445d-8d6e-a7606eca8da3 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 22:10:20 user nova-compute[74337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 22:10:20 user nova-compute[74337]:   <source dev="/dev/sdb"/>
Oct 23 22:10:20 user nova-compute[74337]:   <target dev="vdb" bus="virtio"/>
Oct 23 22:10:20 user nova-compute[74337]:   <serial>485637f5-7429-4020-83b7-1156be9d013f</serial>
Oct 23 22:10:20 user nova-compute[74337]: </disk>
Oct 23 22:10:20 user nova-compute[74337]:  {{(pid=74337) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 22:10:20 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-f9ed072e-4d24-445d-8d6e-a7606eca8da3 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] No BDM found with device name vda, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 22:10:20 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-f9ed072e-4d24-445d-8d6e-a7606eca8da3 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 22:10:20 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-f9ed072e-4d24-445d-8d6e-a7606eca8da3 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] No VIF found with MAC fa:16:3e:68:65:1a, not building metadata {{(pid=74337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 22:10:21 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-f9ed072e-4d24-445d-8d6e-a7606eca8da3 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Lock "61fe098a-5958-4ad1-8f92-4592809299b7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.426s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:10:22 user nova-compute[74337]: INFO nova.compute.manager [None req-e9760be7-3229-47db-9224-fd3bc2c6b6fe tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Rescuing
Oct 23 22:10:22 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-e9760be7-3229-47db-9224-fd3bc2c6b6fe tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Acquiring lock "refresh_cache-61fe098a-5958-4ad1-8f92-4592809299b7" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 22:10:22 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-e9760be7-3229-47db-9224-fd3bc2c6b6fe tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Acquired lock "refresh_cache-61fe098a-5958-4ad1-8f92-4592809299b7" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 22:10:22 user nova-compute[74337]: DEBUG nova.network.neutron [None req-e9760be7-3229-47db-9224-fd3bc2c6b6fe tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Building network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 22:10:23 user nova-compute[74337]: DEBUG nova.network.neutron [None req-e9760be7-3229-47db-9224-fd3bc2c6b6fe tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Updating instance_info_cache with network_info: [{"id": "496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74", "address": "fa:16:3e:68:65:1a", "network": {"id": "122fdd20-8bf5-4374-b50c-82e5dc8684db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-81475496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80f79dd6954748e4806a568a4127396f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap496ce3c5-18", "ovs_interfaceid": "496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 22:10:23 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-e9760be7-3229-47db-9224-fd3bc2c6b6fe tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Releasing lock "refresh_cache-61fe098a-5958-4ad1-8f92-4592809299b7" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 22:10:23 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:10:23 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:10:23 user nova-compute[74337]: DEBUG nova.compute.manager [req-d754f366-2c22-482a-bf31-1fe304a5d693 req-2870d3ce-28c6-4d0f-a89e-cac646b9d52a service nova] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Received event network-vif-unplugged-496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:10:23 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-d754f366-2c22-482a-bf31-1fe304a5d693 req-2870d3ce-28c6-4d0f-a89e-cac646b9d52a service nova] Acquiring lock "61fe098a-5958-4ad1-8f92-4592809299b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:10:23 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-d754f366-2c22-482a-bf31-1fe304a5d693 req-2870d3ce-28c6-4d0f-a89e-cac646b9d52a service nova] Lock "61fe098a-5958-4ad1-8f92-4592809299b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:10:23 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-d754f366-2c22-482a-bf31-1fe304a5d693 req-2870d3ce-28c6-4d0f-a89e-cac646b9d52a service nova] Lock "61fe098a-5958-4ad1-8f92-4592809299b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:10:23 user nova-compute[74337]: DEBUG nova.compute.manager [req-d754f366-2c22-482a-bf31-1fe304a5d693 req-2870d3ce-28c6-4d0f-a89e-cac646b9d52a service nova] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] No waiting events found dispatching network-vif-unplugged-496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 22:10:23 user nova-compute[74337]: WARNING nova.compute.manager [req-d754f366-2c22-482a-bf31-1fe304a5d693 req-2870d3ce-28c6-4d0f-a89e-cac646b9d52a service nova] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Received unexpected event network-vif-unplugged-496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74 for instance with vm_state active and task_state rescuing.
Oct 23 22:10:23 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:10:23 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:10:23 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Instance destroyed successfully.
Oct 23 22:10:23 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-e9760be7-3229-47db-9224-fd3bc2c6b6fe tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Attempting rescue
Oct 23 22:10:23 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-e9760be7-3229-47db-9224-fd3bc2c6b6fe tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74337) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 23 22:10:23 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-e9760be7-3229-47db-9224-fd3bc2c6b6fe tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Instance directory exists: not creating {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 23 22:10:23 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-e9760be7-3229-47db-9224-fd3bc2c6b6fe tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Creating image(s)
Oct 23 22:10:23 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-e9760be7-3229-47db-9224-fd3bc2c6b6fe tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Acquiring lock "/opt/stack/data/nova/instances/61fe098a-5958-4ad1-8f92-4592809299b7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:10:23 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-e9760be7-3229-47db-9224-fd3bc2c6b6fe tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Lock "/opt/stack/data/nova/instances/61fe098a-5958-4ad1-8f92-4592809299b7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:10:23 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-e9760be7-3229-47db-9224-fd3bc2c6b6fe tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Lock "/opt/stack/data/nova/instances/61fe098a-5958-4ad1-8f92-4592809299b7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:10:23 user nova-compute[74337]: DEBUG nova.objects.instance [None req-e9760be7-3229-47db-9224-fd3bc2c6b6fe tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Lazy-loading 'trusted_certs' on Instance uuid 61fe098a-5958-4ad1-8f92-4592809299b7 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:10:23 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-e9760be7-3229-47db-9224-fd3bc2c6b6fe tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Acquiring lock "fc7b140751b8c385de81623e40fb09ce09374ab7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:10:23 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-e9760be7-3229-47db-9224-fd3bc2c6b6fe tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Lock "fc7b140751b8c385de81623e40fb09ce09374ab7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:10:23 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-e9760be7-3229-47db-9224-fd3bc2c6b6fe tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:10:24 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-e9760be7-3229-47db-9224-fd3bc2c6b6fe tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.211s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:10:24 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-e9760be7-3229-47db-9224-fd3bc2c6b6fe tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7,backing_fmt=raw /opt/stack/data/nova/instances/61fe098a-5958-4ad1-8f92-4592809299b7/disk.rescue {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:10:24 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-e9760be7-3229-47db-9224-fd3bc2c6b6fe tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7,backing_fmt=raw /opt/stack/data/nova/instances/61fe098a-5958-4ad1-8f92-4592809299b7/disk.rescue" returned: 0 in 0.051s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:10:24 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-e9760be7-3229-47db-9224-fd3bc2c6b6fe tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Lock "fc7b140751b8c385de81623e40fb09ce09374ab7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.271s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:10:24 user nova-compute[74337]: DEBUG nova.objects.instance [None req-e9760be7-3229-47db-9224-fd3bc2c6b6fe tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Lazy-loading 'migration_context' on Instance uuid 61fe098a-5958-4ad1-8f92-4592809299b7 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:10:24 user nova-compute[74337]: DEBUG nova.objects.base [None req-e9760be7-3229-47db-9224-fd3bc2c6b6fe tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Object Instance<61fe098a-5958-4ad1-8f92-4592809299b7> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 22:10:24 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-e9760be7-3229-47db-9224-fd3bc2c6b6fe tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Created local disks {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 22:10:24 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-e9760be7-3229-47db-9224-fd3bc2c6b6fe tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Start _get_guest_xml network_info=[{"id": "496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74", "address": "fa:16:3e:68:65:1a", "network": {"id": "122fdd20-8bf5-4374-b50c-82e5dc8684db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-81475496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-81475496-network", "vif_mac": "fa:16:3e:68:65:1a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80f79dd6954748e4806a568a4127396f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap496ce3c5-18", "ovs_interfaceid": "496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T21:29:21Z,direct_url=<?>,disk_format='qcow2',id=d859d89d-998d-4109-b26a-0d6e28152932,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ff43462300764979a6cf688444336a56',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T21:29:22Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'd859d89d-998d-4109-b26a-0d6e28152932', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 22:10:24 user nova-compute[74337]: DEBUG nova.objects.instance [None req-e9760be7-3229-47db-9224-fd3bc2c6b6fe tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Lazy-loading 'resources' on Instance uuid 61fe098a-5958-4ad1-8f92-4592809299b7 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:10:24 user nova-compute[74337]: DEBUG nova.objects.base [None req-e9760be7-3229-47db-9224-fd3bc2c6b6fe tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Object Instance<61fe098a-5958-4ad1-8f92-4592809299b7> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 22:10:24 user nova-compute[74337]: DEBUG nova.objects.instance [None req-e9760be7-3229-47db-9224-fd3bc2c6b6fe tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Lazy-loading 'numa_topology' on Instance uuid 61fe098a-5958-4ad1-8f92-4592809299b7 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:10:24 user nova-compute[74337]: DEBUG nova.objects.base [None req-e9760be7-3229-47db-9224-fd3bc2c6b6fe tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Object Instance<61fe098a-5958-4ad1-8f92-4592809299b7> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 22:10:24 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-e9760be7-3229-47db-9224-fd3bc2c6b6fe tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:10:24 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-e9760be7-3229-47db-9224-fd3bc2c6b6fe tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:10:24 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-e9760be7-3229-47db-9224-fd3bc2c6b6fe tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 22:10:24 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-e9760be7-3229-47db-9224-fd3bc2c6b6fe tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] CPU controller missing on host. {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 22:10:24 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-e9760be7-3229-47db-9224-fd3bc2c6b6fe tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 22:10:24 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-e9760be7-3229-47db-9224-fd3bc2c6b6fe tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] CPU controller found on host. {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 22:10:24 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-e9760be7-3229-47db-9224-fd3bc2c6b6fe tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 22:10:24 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-e9760be7-3229-47db-9224-fd3bc2c6b6fe tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T21:29:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T21:29:21Z,direct_url=<?>,disk_format='qcow2',id=d859d89d-998d-4109-b26a-0d6e28152932,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ff43462300764979a6cf688444336a56',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T21:29:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 22:10:24 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-e9760be7-3229-47db-9224-fd3bc2c6b6fe tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Flavor limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 22:10:24 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-e9760be7-3229-47db-9224-fd3bc2c6b6fe tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Image limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 22:10:24 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-e9760be7-3229-47db-9224-fd3bc2c6b6fe tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Flavor pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 22:10:24 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-e9760be7-3229-47db-9224-fd3bc2c6b6fe tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Image pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 22:10:24 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-e9760be7-3229-47db-9224-fd3bc2c6b6fe tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 22:10:24 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-e9760be7-3229-47db-9224-fd3bc2c6b6fe tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 22:10:24 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-e9760be7-3229-47db-9224-fd3bc2c6b6fe tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 22:10:24 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-e9760be7-3229-47db-9224-fd3bc2c6b6fe tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Got 1 possible topologies {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 22:10:24 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-e9760be7-3229-47db-9224-fd3bc2c6b6fe tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 22:10:24 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-e9760be7-3229-47db-9224-fd3bc2c6b6fe tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 22:10:24 user nova-compute[74337]: DEBUG nova.objects.instance [None req-e9760be7-3229-47db-9224-fd3bc2c6b6fe tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Lazy-loading 'vcpu_model' on Instance uuid 61fe098a-5958-4ad1-8f92-4592809299b7 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:10:24 user nova-compute[74337]: DEBUG nova.objects.base [None req-e9760be7-3229-47db-9224-fd3bc2c6b6fe tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Object Instance<61fe098a-5958-4ad1-8f92-4592809299b7> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 22:10:24 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-e9760be7-3229-47db-9224-fd3bc2c6b6fe tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T22:08:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-304244242',display_name='tempest-ServerRescueNegativeTestJSON-server-304244242',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-304244242',id=49,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHAcn+lLjOkIvykUlFztTMs08y2PxFnR7VYNivrfRgQdTZ3Fh25r9lJLsxrN7NFbZG+ODLyw1l+MPPzgV0N2Zq+awnrJEM4oA1Yu0mPfvb90MvOI3M2oZILyN6yuviVcmA==',key_name='tempest-keypair-723189200',keypairs=<?>,launch_index=0,launched_at=2023-10-23T22:08:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='80f79dd6954748e4806a568a4127396f',ramdisk_id='',reservation_id='r-67hxw7ij',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2089412853',owner_user_name='tempest-ServerRescueNegativeTestJSON-2089412853-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T22:08:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0f5c4ec386544e1afd2f0a7d1b1c94f',uuid=61fe098a-5958-4ad1-8f92-4592809299b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74", "address": "fa:16:3e:68:65:1a", "network": {"id": "122fdd20-8bf5-4374-b50c-82e5dc8684db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-81475496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-81475496-network", "vif_mac": "fa:16:3e:68:65:1a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80f79dd6954748e4806a568a4127396f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap496ce3c5-18", "ovs_interfaceid": "496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 22:10:24 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-e9760be7-3229-47db-9224-fd3bc2c6b6fe tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Converting VIF {"id": "496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74", "address": "fa:16:3e:68:65:1a", "network": {"id": "122fdd20-8bf5-4374-b50c-82e5dc8684db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-81475496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-81475496-network", "vif_mac": "fa:16:3e:68:65:1a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80f79dd6954748e4806a568a4127396f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap496ce3c5-18", "ovs_interfaceid": "496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 22:10:24 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-e9760be7-3229-47db-9224-fd3bc2c6b6fe tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:68:65:1a,bridge_name='br-int',has_traffic_filtering=True,id=496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74,network=Network(122fdd20-8bf5-4374-b50c-82e5dc8684db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap496ce3c5-18') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 22:10:24 user nova-compute[74337]: DEBUG nova.objects.instance [None req-e9760be7-3229-47db-9224-fd3bc2c6b6fe tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Lazy-loading 'pci_devices' on Instance uuid 61fe098a-5958-4ad1-8f92-4592809299b7 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:10:24 user nova-compute[74337]: DEBUG nova.objects.base [None req-e9760be7-3229-47db-9224-fd3bc2c6b6fe tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Object Instance<61fe098a-5958-4ad1-8f92-4592809299b7> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74337) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 23 22:10:24 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-e9760be7-3229-47db-9224-fd3bc2c6b6fe tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] End _get_guest_xml xml=<domain type="kvm">
Oct 23 22:10:24 user nova-compute[74337]:   <uuid>61fe098a-5958-4ad1-8f92-4592809299b7</uuid>
Oct 23 22:10:24 user nova-compute[74337]:   <name>instance-00000031</name>
Oct 23 22:10:24 user nova-compute[74337]:   <memory>524288</memory>
Oct 23 22:10:24 user nova-compute[74337]:   <vcpu>1</vcpu>
Oct 23 22:10:24 user nova-compute[74337]:   <metadata>
Oct 23 22:10:24 user nova-compute[74337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 22:10:24 user nova-compute[74337]:       <nova:package version="0.0.0"/>
Oct 23 22:10:24 user nova-compute[74337]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-304244242</nova:name>
Oct 23 22:10:24 user nova-compute[74337]:       <nova:creationTime>2023-10-23 22:10:24</nova:creationTime>
Oct 23 22:10:24 user nova-compute[74337]:       <nova:flavor name="m1.tiny">
Oct 23 22:10:24 user nova-compute[74337]:         <nova:memory>512</nova:memory>
Oct 23 22:10:24 user nova-compute[74337]:         <nova:disk>1</nova:disk>
Oct 23 22:10:24 user nova-compute[74337]:         <nova:swap>0</nova:swap>
Oct 23 22:10:24 user nova-compute[74337]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 22:10:24 user nova-compute[74337]:         <nova:vcpus>1</nova:vcpus>
Oct 23 22:10:24 user nova-compute[74337]:       </nova:flavor>
Oct 23 22:10:24 user nova-compute[74337]:       <nova:owner>
Oct 23 22:10:24 user nova-compute[74337]:         <nova:user uuid="a0f5c4ec386544e1afd2f0a7d1b1c94f">tempest-ServerRescueNegativeTestJSON-2089412853-project-member</nova:user>
Oct 23 22:10:24 user nova-compute[74337]:         <nova:project uuid="80f79dd6954748e4806a568a4127396f">tempest-ServerRescueNegativeTestJSON-2089412853</nova:project>
Oct 23 22:10:24 user nova-compute[74337]:       </nova:owner>
Oct 23 22:10:24 user nova-compute[74337]:       <nova:root type="image" uuid="d859d89d-998d-4109-b26a-0d6e28152932"/>
Oct 23 22:10:24 user nova-compute[74337]:       <nova:ports>
Oct 23 22:10:24 user nova-compute[74337]:         <nova:port uuid="496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74">
Oct 23 22:10:24 user nova-compute[74337]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 23 22:10:24 user nova-compute[74337]:         </nova:port>
Oct 23 22:10:24 user nova-compute[74337]:       </nova:ports>
Oct 23 22:10:24 user nova-compute[74337]:     </nova:instance>
Oct 23 22:10:24 user nova-compute[74337]:   </metadata>
Oct 23 22:10:24 user nova-compute[74337]:   <sysinfo type="smbios">
Oct 23 22:10:24 user nova-compute[74337]:     <system>
Oct 23 22:10:24 user nova-compute[74337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 22:10:24 user nova-compute[74337]:       <entry name="product">OpenStack Nova</entry>
Oct 23 22:10:24 user nova-compute[74337]:       <entry name="version">0.0.0</entry>
Oct 23 22:10:24 user nova-compute[74337]:       <entry name="serial">61fe098a-5958-4ad1-8f92-4592809299b7</entry>
Oct 23 22:10:24 user nova-compute[74337]:       <entry name="uuid">61fe098a-5958-4ad1-8f92-4592809299b7</entry>
Oct 23 22:10:24 user nova-compute[74337]:       <entry name="family">Virtual Machine</entry>
Oct 23 22:10:24 user nova-compute[74337]:     </system>
Oct 23 22:10:24 user nova-compute[74337]:   </sysinfo>
Oct 23 22:10:24 user nova-compute[74337]:   <os>
Oct 23 22:10:24 user nova-compute[74337]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 22:10:24 user nova-compute[74337]:     <smbios mode="sysinfo"/>
Oct 23 22:10:24 user nova-compute[74337]:   </os>
Oct 23 22:10:24 user nova-compute[74337]:   <features>
Oct 23 22:10:24 user nova-compute[74337]:     <acpi/>
Oct 23 22:10:24 user nova-compute[74337]:     <apic/>
Oct 23 22:10:24 user nova-compute[74337]:     <vmcoreinfo/>
Oct 23 22:10:24 user nova-compute[74337]:   </features>
Oct 23 22:10:24 user nova-compute[74337]:   <clock offset="utc">
Oct 23 22:10:24 user nova-compute[74337]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 22:10:24 user nova-compute[74337]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 22:10:24 user nova-compute[74337]:     <timer name="hpet" present="no"/>
Oct 23 22:10:24 user nova-compute[74337]:   </clock>
Oct 23 22:10:24 user nova-compute[74337]:   <cpu mode="custom" match="exact">
Oct 23 22:10:24 user nova-compute[74337]:     <model>Nehalem</model>
Oct 23 22:10:24 user nova-compute[74337]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 22:10:24 user nova-compute[74337]:   </cpu>
Oct 23 22:10:24 user nova-compute[74337]:   <devices>
Oct 23 22:10:24 user nova-compute[74337]:     <disk type="file" device="disk">
Oct 23 22:10:24 user nova-compute[74337]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 22:10:24 user nova-compute[74337]:       <source file="/opt/stack/data/nova/instances/61fe098a-5958-4ad1-8f92-4592809299b7/disk.rescue"/>
Oct 23 22:10:24 user nova-compute[74337]:       <target dev="vda" bus="virtio"/>
Oct 23 22:10:24 user nova-compute[74337]:     </disk>
Oct 23 22:10:24 user nova-compute[74337]:     <disk type="file" device="disk">
Oct 23 22:10:24 user nova-compute[74337]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 22:10:24 user nova-compute[74337]:       <source file="/opt/stack/data/nova/instances/61fe098a-5958-4ad1-8f92-4592809299b7/disk"/>
Oct 23 22:10:24 user nova-compute[74337]:       <target dev="vdb" bus="virtio"/>
Oct 23 22:10:24 user nova-compute[74337]:     </disk>
Oct 23 22:10:24 user nova-compute[74337]:     <interface type="ethernet">
Oct 23 22:10:24 user nova-compute[74337]:       <mac address="fa:16:3e:68:65:1a"/>
Oct 23 22:10:24 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 22:10:24 user nova-compute[74337]:       <mtu size="1442"/>
Oct 23 22:10:24 user nova-compute[74337]:       <target dev="tap496ce3c5-18"/>
Oct 23 22:10:24 user nova-compute[74337]:     </interface>
Oct 23 22:10:24 user nova-compute[74337]:     <serial type="pty">
Oct 23 22:10:24 user nova-compute[74337]:       <log file="/opt/stack/data/nova/instances/61fe098a-5958-4ad1-8f92-4592809299b7/console.log" append="off"/>
Oct 23 22:10:24 user nova-compute[74337]:     </serial>
Oct 23 22:10:24 user nova-compute[74337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 22:10:24 user nova-compute[74337]:     <video>
Oct 23 22:10:24 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 22:10:24 user nova-compute[74337]:     </video>
Oct 23 22:10:24 user nova-compute[74337]:     <rng model="virtio">
Oct 23 22:10:24 user nova-compute[74337]:       <backend model="random">/dev/urandom</backend>
Oct 23 22:10:24 user nova-compute[74337]:     </rng>
Oct 23 22:10:24 user nova-compute[74337]:     <controller type="usb" index="0" model="none"/>
Oct 23 22:10:24 user nova-compute[74337]:     <memballoon model="virtio">
Oct 23 22:10:24 user nova-compute[74337]:       <stats period="10"/>
Oct 23 22:10:24 user nova-compute[74337]:     </memballoon>
Oct 23 22:10:24 user nova-compute[74337]:   </devices>
Oct 23 22:10:24 user nova-compute[74337]: </domain>
Oct 23 22:10:24 user nova-compute[74337]:  {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 22:10:24 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Instance destroyed successfully.
Oct 23 22:10:24 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:10:24 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 22:10:24 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-e9760be7-3229-47db-9224-fd3bc2c6b6fe tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] No BDM found with device name vda, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 22:10:24 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-e9760be7-3229-47db-9224-fd3bc2c6b6fe tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 22:10:24 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-e9760be7-3229-47db-9224-fd3bc2c6b6fe tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] No VIF found with MAC fa:16:3e:68:65:1a, not building metadata {{(pid=74337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 22:10:24 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:10:25 user nova-compute[74337]: DEBUG nova.compute.manager [req-213eff72-1e27-4ea5-aa3c-9f9e8e31254c req-68911adb-72df-4ab6-aed8-0d84143e6f94 service nova] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Received event network-vif-plugged-496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:10:25 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-213eff72-1e27-4ea5-aa3c-9f9e8e31254c req-68911adb-72df-4ab6-aed8-0d84143e6f94 service nova] Acquiring lock "61fe098a-5958-4ad1-8f92-4592809299b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:10:25 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-213eff72-1e27-4ea5-aa3c-9f9e8e31254c req-68911adb-72df-4ab6-aed8-0d84143e6f94 service nova] Lock "61fe098a-5958-4ad1-8f92-4592809299b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:10:25 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-213eff72-1e27-4ea5-aa3c-9f9e8e31254c req-68911adb-72df-4ab6-aed8-0d84143e6f94 service nova] Lock "61fe098a-5958-4ad1-8f92-4592809299b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:10:25 user nova-compute[74337]: DEBUG nova.compute.manager [req-213eff72-1e27-4ea5-aa3c-9f9e8e31254c req-68911adb-72df-4ab6-aed8-0d84143e6f94 service nova] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] No waiting events found dispatching network-vif-plugged-496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 22:10:25 user nova-compute[74337]: WARNING nova.compute.manager [req-213eff72-1e27-4ea5-aa3c-9f9e8e31254c req-68911adb-72df-4ab6-aed8-0d84143e6f94 service nova] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Received unexpected event network-vif-plugged-496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74 for instance with vm_state active and task_state rescuing.
Oct 23 22:10:25 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:10:25 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:10:25 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:10:25 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:10:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:10:27 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:10:27 user nova-compute[74337]: DEBUG nova.compute.manager [req-97985f84-f238-448d-896b-7b68f85651ab req-71a0a741-ad9c-48e0-9c18-b693f2360947 service nova] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Received event network-vif-plugged-496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:10:27 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-97985f84-f238-448d-896b-7b68f85651ab req-71a0a741-ad9c-48e0-9c18-b693f2360947 service nova] Acquiring lock "61fe098a-5958-4ad1-8f92-4592809299b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:10:27 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-97985f84-f238-448d-896b-7b68f85651ab req-71a0a741-ad9c-48e0-9c18-b693f2360947 service nova] Lock "61fe098a-5958-4ad1-8f92-4592809299b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:10:27 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-97985f84-f238-448d-896b-7b68f85651ab req-71a0a741-ad9c-48e0-9c18-b693f2360947 service nova] Lock "61fe098a-5958-4ad1-8f92-4592809299b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:10:27 user nova-compute[74337]: DEBUG nova.compute.manager [req-97985f84-f238-448d-896b-7b68f85651ab req-71a0a741-ad9c-48e0-9c18-b693f2360947 service nova] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] No waiting events found dispatching network-vif-plugged-496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 22:10:27 user nova-compute[74337]: WARNING nova.compute.manager [req-97985f84-f238-448d-896b-7b68f85651ab req-71a0a741-ad9c-48e0-9c18-b693f2360947 service nova] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Received unexpected event network-vif-plugged-496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74 for instance with vm_state active and task_state rescuing.
Oct 23 22:10:27 user nova-compute[74337]: DEBUG nova.compute.manager [req-97985f84-f238-448d-896b-7b68f85651ab req-71a0a741-ad9c-48e0-9c18-b693f2360947 service nova] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Received event network-vif-plugged-496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:10:27 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-97985f84-f238-448d-896b-7b68f85651ab req-71a0a741-ad9c-48e0-9c18-b693f2360947 service nova] Acquiring lock "61fe098a-5958-4ad1-8f92-4592809299b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:10:27 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-97985f84-f238-448d-896b-7b68f85651ab req-71a0a741-ad9c-48e0-9c18-b693f2360947 service nova] Lock "61fe098a-5958-4ad1-8f92-4592809299b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:10:27 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-97985f84-f238-448d-896b-7b68f85651ab req-71a0a741-ad9c-48e0-9c18-b693f2360947 service nova] Lock "61fe098a-5958-4ad1-8f92-4592809299b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:10:27 user nova-compute[74337]: DEBUG nova.compute.manager [req-97985f84-f238-448d-896b-7b68f85651ab req-71a0a741-ad9c-48e0-9c18-b693f2360947 service nova] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] No waiting events found dispatching network-vif-plugged-496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 22:10:27 user nova-compute[74337]: WARNING nova.compute.manager [req-97985f84-f238-448d-896b-7b68f85651ab req-71a0a741-ad9c-48e0-9c18-b693f2360947 service nova] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Received unexpected event network-vif-plugged-496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74 for instance with vm_state active and task_state rescuing.
Oct 23 22:10:28 user nova-compute[74337]: DEBUG nova.compute.manager [None req-e9760be7-3229-47db-9224-fd3bc2c6b6fe tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Checking state {{(pid=74337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 22:10:28 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:10:28 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Triggering sync for uuid 999843b2-b757-480b-bd21-bf281954bc46 {{(pid=74337) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 23 22:10:28 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Triggering sync for uuid 27710919-a717-42fa-a436-a261d92c1c2a {{(pid=74337) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 23 22:10:28 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Triggering sync for uuid 106da458-caec-4114-8904-0411ec0ea903 {{(pid=74337) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 23 22:10:28 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Triggering sync for uuid 61fe098a-5958-4ad1-8f92-4592809299b7 {{(pid=74337) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 23 22:10:28 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Triggering sync for uuid a6aee021-df0b-4ada-9f82-8df7486dc869 {{(pid=74337) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 23 22:10:28 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "999843b2-b757-480b-bd21-bf281954bc46" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:10:28 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "999843b2-b757-480b-bd21-bf281954bc46" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:10:28 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "27710919-a717-42fa-a436-a261d92c1c2a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:10:28 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "27710919-a717-42fa-a436-a261d92c1c2a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:10:28 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "106da458-caec-4114-8904-0411ec0ea903" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:10:28 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "106da458-caec-4114-8904-0411ec0ea903" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:10:28 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "61fe098a-5958-4ad1-8f92-4592809299b7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:10:28 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "61fe098a-5958-4ad1-8f92-4592809299b7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:10:28 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "a6aee021-df0b-4ada-9f82-8df7486dc869" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:10:28 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "a6aee021-df0b-4ada-9f82-8df7486dc869" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:10:28 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "999843b2-b757-480b-bd21-bf281954bc46" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.039s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:10:28 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "27710919-a717-42fa-a436-a261d92c1c2a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.041s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:10:28 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "106da458-caec-4114-8904-0411ec0ea903" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.044s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:10:28 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "61fe098a-5958-4ad1-8f92-4592809299b7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.043s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:10:28 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "a6aee021-df0b-4ada-9f82-8df7486dc869" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.055s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:10:28 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:10:29 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:10:29 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:10:29 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:10:30 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:10:31 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-82e9ecf1-36bc-4ea3-8f05-f26ef21e8164 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Acquiring lock "38bdf4aa-052a-4638-ac28-757c835aef04" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:10:31 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-82e9ecf1-36bc-4ea3-8f05-f26ef21e8164 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Lock "38bdf4aa-052a-4638-ac28-757c835aef04" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:10:31 user nova-compute[74337]: DEBUG nova.compute.manager [None req-82e9ecf1-36bc-4ea3-8f05-f26ef21e8164 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] [instance: 38bdf4aa-052a-4638-ac28-757c835aef04] Starting instance... {{(pid=74337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 22:10:31 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-82e9ecf1-36bc-4ea3-8f05-f26ef21e8164 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:10:31 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-82e9ecf1-36bc-4ea3-8f05-f26ef21e8164 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:10:31 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-82e9ecf1-36bc-4ea3-8f05-f26ef21e8164 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 22:10:31 user nova-compute[74337]: INFO nova.compute.claims [None req-82e9ecf1-36bc-4ea3-8f05-f26ef21e8164 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] [instance: 38bdf4aa-052a-4638-ac28-757c835aef04] Claim successful on node user
Oct 23 22:10:31 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:10:31 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-82e9ecf1-36bc-4ea3-8f05-f26ef21e8164 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 22:10:31 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-82e9ecf1-36bc-4ea3-8f05-f26ef21e8164 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 22:10:31 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-82e9ecf1-36bc-4ea3-8f05-f26ef21e8164 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.335s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:10:31 user nova-compute[74337]: DEBUG nova.compute.manager [None req-82e9ecf1-36bc-4ea3-8f05-f26ef21e8164 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] [instance: 38bdf4aa-052a-4638-ac28-757c835aef04] Start building networks asynchronously for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 22:10:31 user nova-compute[74337]: DEBUG nova.compute.manager [None req-82e9ecf1-36bc-4ea3-8f05-f26ef21e8164 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] [instance: 38bdf4aa-052a-4638-ac28-757c835aef04] Allocating IP information in the background. {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 22:10:31 user nova-compute[74337]: DEBUG nova.network.neutron [None req-82e9ecf1-36bc-4ea3-8f05-f26ef21e8164 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] [instance: 38bdf4aa-052a-4638-ac28-757c835aef04] allocate_for_instance() {{(pid=74337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 22:10:31 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-82e9ecf1-36bc-4ea3-8f05-f26ef21e8164 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] [instance: 38bdf4aa-052a-4638-ac28-757c835aef04] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 22:10:31 user nova-compute[74337]: DEBUG nova.compute.manager [None req-82e9ecf1-36bc-4ea3-8f05-f26ef21e8164 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] [instance: 38bdf4aa-052a-4638-ac28-757c835aef04] Start building block device mappings for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 22:10:31 user nova-compute[74337]: DEBUG nova.policy [None req-82e9ecf1-36bc-4ea3-8f05-f26ef21e8164 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7932a09ed7a14f249da27a7f1d5326ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799c72bbb3e248b99463567aba2049db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74337) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 22:10:31 user nova-compute[74337]: DEBUG nova.compute.manager [None req-82e9ecf1-36bc-4ea3-8f05-f26ef21e8164 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] [instance: 38bdf4aa-052a-4638-ac28-757c835aef04] Start spawning the instance on the hypervisor. {{(pid=74337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 22:10:31 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-82e9ecf1-36bc-4ea3-8f05-f26ef21e8164 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] [instance: 38bdf4aa-052a-4638-ac28-757c835aef04] Creating instance directory {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 22:10:31 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-82e9ecf1-36bc-4ea3-8f05-f26ef21e8164 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] [instance: 38bdf4aa-052a-4638-ac28-757c835aef04] Creating image(s)
Oct 23 22:10:31 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-82e9ecf1-36bc-4ea3-8f05-f26ef21e8164 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Acquiring lock "/opt/stack/data/nova/instances/38bdf4aa-052a-4638-ac28-757c835aef04/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:10:31 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-82e9ecf1-36bc-4ea3-8f05-f26ef21e8164 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Lock "/opt/stack/data/nova/instances/38bdf4aa-052a-4638-ac28-757c835aef04/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:10:31 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-82e9ecf1-36bc-4ea3-8f05-f26ef21e8164 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Lock "/opt/stack/data/nova/instances/38bdf4aa-052a-4638-ac28-757c835aef04/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:10:31 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-82e9ecf1-36bc-4ea3-8f05-f26ef21e8164 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:10:31 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-82e9ecf1-36bc-4ea3-8f05-f26ef21e8164 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.181s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:10:31 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-82e9ecf1-36bc-4ea3-8f05-f26ef21e8164 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Acquiring lock "fc7b140751b8c385de81623e40fb09ce09374ab7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:10:31 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-82e9ecf1-36bc-4ea3-8f05-f26ef21e8164 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Lock "fc7b140751b8c385de81623e40fb09ce09374ab7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:10:31 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-82e9ecf1-36bc-4ea3-8f05-f26ef21e8164 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:10:32 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-82e9ecf1-36bc-4ea3-8f05-f26ef21e8164 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.183s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:10:32 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-82e9ecf1-36bc-4ea3-8f05-f26ef21e8164 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7,backing_fmt=raw /opt/stack/data/nova/instances/38bdf4aa-052a-4638-ac28-757c835aef04/disk 1073741824 {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:10:32 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-82e9ecf1-36bc-4ea3-8f05-f26ef21e8164 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7,backing_fmt=raw /opt/stack/data/nova/instances/38bdf4aa-052a-4638-ac28-757c835aef04/disk 1073741824" returned: 0 in 0.052s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:10:32 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-82e9ecf1-36bc-4ea3-8f05-f26ef21e8164 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Lock "fc7b140751b8c385de81623e40fb09ce09374ab7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:10:32 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-82e9ecf1-36bc-4ea3-8f05-f26ef21e8164 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:10:32 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-82e9ecf1-36bc-4ea3-8f05-f26ef21e8164 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.201s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:10:32 user nova-compute[74337]: DEBUG nova.virt.disk.api [None req-82e9ecf1-36bc-4ea3-8f05-f26ef21e8164 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Checking if we can resize image /opt/stack/data/nova/instances/38bdf4aa-052a-4638-ac28-757c835aef04/disk. size=1073741824 {{(pid=74337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 22:10:32 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-82e9ecf1-36bc-4ea3-8f05-f26ef21e8164 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38bdf4aa-052a-4638-ac28-757c835aef04/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:10:32 user nova-compute[74337]: DEBUG nova.network.neutron [None req-82e9ecf1-36bc-4ea3-8f05-f26ef21e8164 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] [instance: 38bdf4aa-052a-4638-ac28-757c835aef04] Successfully created port: 9de01666-1235-499a-9a57-a6e4a7ca6291 {{(pid=74337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 22:10:32 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:10:32 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-82e9ecf1-36bc-4ea3-8f05-f26ef21e8164 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38bdf4aa-052a-4638-ac28-757c835aef04/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:10:32 user nova-compute[74337]: DEBUG nova.virt.disk.api [None req-82e9ecf1-36bc-4ea3-8f05-f26ef21e8164 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Cannot resize image /opt/stack/data/nova/instances/38bdf4aa-052a-4638-ac28-757c835aef04/disk to a smaller size. {{(pid=74337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 22:10:32 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-82e9ecf1-36bc-4ea3-8f05-f26ef21e8164 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] [instance: 38bdf4aa-052a-4638-ac28-757c835aef04] Created local disks {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 22:10:32 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-82e9ecf1-36bc-4ea3-8f05-f26ef21e8164 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] [instance: 38bdf4aa-052a-4638-ac28-757c835aef04] Ensure instance console log exists: /opt/stack/data/nova/instances/38bdf4aa-052a-4638-ac28-757c835aef04/console.log {{(pid=74337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 22:10:32 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-82e9ecf1-36bc-4ea3-8f05-f26ef21e8164 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:10:32 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-82e9ecf1-36bc-4ea3-8f05-f26ef21e8164 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:10:32 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-82e9ecf1-36bc-4ea3-8f05-f26ef21e8164 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:10:33 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:10:33 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Starting heal instance info cache {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 22:10:33 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Rebuilding the list of instances to heal {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 22:10:33 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 38bdf4aa-052a-4638-ac28-757c835aef04] Skipping network cache update for instance because it is Building. {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 23 22:10:33 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "refresh_cache-999843b2-b757-480b-bd21-bf281954bc46" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 22:10:33 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquired lock "refresh_cache-999843b2-b757-480b-bd21-bf281954bc46" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 22:10:33 user nova-compute[74337]: DEBUG nova.network.neutron [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Forcefully refreshing network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 22:10:33 user nova-compute[74337]: DEBUG nova.objects.instance [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lazy-loading 'info_cache' on Instance uuid 999843b2-b757-480b-bd21-bf281954bc46 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:10:33 user nova-compute[74337]: DEBUG nova.network.neutron [None req-82e9ecf1-36bc-4ea3-8f05-f26ef21e8164 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] [instance: 38bdf4aa-052a-4638-ac28-757c835aef04] Successfully updated port: 9de01666-1235-499a-9a57-a6e4a7ca6291 {{(pid=74337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 22:10:33 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-82e9ecf1-36bc-4ea3-8f05-f26ef21e8164 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Acquiring lock "refresh_cache-38bdf4aa-052a-4638-ac28-757c835aef04" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 22:10:33 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-82e9ecf1-36bc-4ea3-8f05-f26ef21e8164 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Acquired lock "refresh_cache-38bdf4aa-052a-4638-ac28-757c835aef04" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 22:10:33 user nova-compute[74337]: DEBUG nova.network.neutron [None req-82e9ecf1-36bc-4ea3-8f05-f26ef21e8164 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] [instance: 38bdf4aa-052a-4638-ac28-757c835aef04] Building network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 22:10:33 user nova-compute[74337]: DEBUG nova.network.neutron [None req-82e9ecf1-36bc-4ea3-8f05-f26ef21e8164 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] [instance: 38bdf4aa-052a-4638-ac28-757c835aef04] Instance cache missing network info. {{(pid=74337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 22:10:33 user nova-compute[74337]: DEBUG nova.compute.manager [req-1a408383-962d-4500-b389-4ccf280b6322 req-d93b915d-2dba-4373-9ad2-73d67121d71a service nova] [instance: 38bdf4aa-052a-4638-ac28-757c835aef04] Received event network-changed-9de01666-1235-499a-9a57-a6e4a7ca6291 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:10:33 user nova-compute[74337]: DEBUG nova.compute.manager [req-1a408383-962d-4500-b389-4ccf280b6322 req-d93b915d-2dba-4373-9ad2-73d67121d71a service nova] [instance: 38bdf4aa-052a-4638-ac28-757c835aef04] Refreshing instance network info cache due to event network-changed-9de01666-1235-499a-9a57-a6e4a7ca6291. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 22:10:33 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-1a408383-962d-4500-b389-4ccf280b6322 req-d93b915d-2dba-4373-9ad2-73d67121d71a service nova] Acquiring lock "refresh_cache-38bdf4aa-052a-4638-ac28-757c835aef04" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 22:10:33 user nova-compute[74337]: DEBUG nova.network.neutron [None req-82e9ecf1-36bc-4ea3-8f05-f26ef21e8164 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] [instance: 38bdf4aa-052a-4638-ac28-757c835aef04] Updating instance_info_cache with network_info: [{"id": "9de01666-1235-499a-9a57-a6e4a7ca6291", "address": "fa:16:3e:04:b1:de", "network": {"id": "86669102-0490-4fe4-aba4-8a353e91a763", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1218528793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799c72bbb3e248b99463567aba2049db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9de01666-12", "ovs_interfaceid": "9de01666-1235-499a-9a57-a6e4a7ca6291", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 22:10:33 user nova-compute[74337]: DEBUG nova.network.neutron [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Updating instance_info_cache with network_info: [{"id": "02913be6-773f-402a-a534-d7567aeb5b7a", "address": "fa:16:3e:a2:cd:9d", "network": {"id": "122fdd20-8bf5-4374-b50c-82e5dc8684db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-81475496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80f79dd6954748e4806a568a4127396f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02913be6-77", "ovs_interfaceid": "02913be6-773f-402a-a534-d7567aeb5b7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 22:10:33 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-82e9ecf1-36bc-4ea3-8f05-f26ef21e8164 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Releasing lock "refresh_cache-38bdf4aa-052a-4638-ac28-757c835aef04" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 22:10:33 user nova-compute[74337]: DEBUG nova.compute.manager [None req-82e9ecf1-36bc-4ea3-8f05-f26ef21e8164 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] [instance: 38bdf4aa-052a-4638-ac28-757c835aef04] Instance network_info: |[{"id": "9de01666-1235-499a-9a57-a6e4a7ca6291", "address": "fa:16:3e:04:b1:de", "network": {"id": "86669102-0490-4fe4-aba4-8a353e91a763", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1218528793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799c72bbb3e248b99463567aba2049db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9de01666-12", "ovs_interfaceid": "9de01666-1235-499a-9a57-a6e4a7ca6291", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 22:10:33 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-1a408383-962d-4500-b389-4ccf280b6322 req-d93b915d-2dba-4373-9ad2-73d67121d71a service nova] Acquired lock "refresh_cache-38bdf4aa-052a-4638-ac28-757c835aef04" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 22:10:33 user nova-compute[74337]: DEBUG nova.network.neutron [req-1a408383-962d-4500-b389-4ccf280b6322 req-d93b915d-2dba-4373-9ad2-73d67121d71a service nova] [instance: 38bdf4aa-052a-4638-ac28-757c835aef04] Refreshing network info cache for port 9de01666-1235-499a-9a57-a6e4a7ca6291 {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 22:10:33 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-82e9ecf1-36bc-4ea3-8f05-f26ef21e8164 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] [instance: 38bdf4aa-052a-4638-ac28-757c835aef04] Start _get_guest_xml network_info=[{"id": "9de01666-1235-499a-9a57-a6e4a7ca6291", "address": "fa:16:3e:04:b1:de", "network": {"id": "86669102-0490-4fe4-aba4-8a353e91a763", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1218528793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799c72bbb3e248b99463567aba2049db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9de01666-12", "ovs_interfaceid": "9de01666-1235-499a-9a57-a6e4a7ca6291", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T21:29:21Z,direct_url=<?>,disk_format='qcow2',id=d859d89d-998d-4109-b26a-0d6e28152932,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ff43462300764979a6cf688444336a56',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T21:29:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'image_id': 'd859d89d-998d-4109-b26a-0d6e28152932'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 22:10:34 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Releasing lock "refresh_cache-999843b2-b757-480b-bd21-bf281954bc46" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 22:10:34 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Updated the network info_cache for instance {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 22:10:34 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-82e9ecf1-36bc-4ea3-8f05-f26ef21e8164 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:10:34 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-82e9ecf1-36bc-4ea3-8f05-f26ef21e8164 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:10:34 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-82e9ecf1-36bc-4ea3-8f05-f26ef21e8164 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 22:10:34 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-82e9ecf1-36bc-4ea3-8f05-f26ef21e8164 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] CPU controller missing on host. {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 22:10:34 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-82e9ecf1-36bc-4ea3-8f05-f26ef21e8164 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 22:10:34 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-82e9ecf1-36bc-4ea3-8f05-f26ef21e8164 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] CPU controller found on host. {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 22:10:34 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-82e9ecf1-36bc-4ea3-8f05-f26ef21e8164 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 22:10:34 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-82e9ecf1-36bc-4ea3-8f05-f26ef21e8164 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T21:29:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T21:29:21Z,direct_url=<?>,disk_format='qcow2',id=d859d89d-998d-4109-b26a-0d6e28152932,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ff43462300764979a6cf688444336a56',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T21:29:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 22:10:34 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-82e9ecf1-36bc-4ea3-8f05-f26ef21e8164 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Flavor limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 22:10:34 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-82e9ecf1-36bc-4ea3-8f05-f26ef21e8164 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Image limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 22:10:34 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-82e9ecf1-36bc-4ea3-8f05-f26ef21e8164 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Flavor pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 22:10:34 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-82e9ecf1-36bc-4ea3-8f05-f26ef21e8164 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Image pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 22:10:34 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-82e9ecf1-36bc-4ea3-8f05-f26ef21e8164 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 22:10:34 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-82e9ecf1-36bc-4ea3-8f05-f26ef21e8164 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 22:10:34 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-82e9ecf1-36bc-4ea3-8f05-f26ef21e8164 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 22:10:34 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-82e9ecf1-36bc-4ea3-8f05-f26ef21e8164 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Got 1 possible topologies {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 22:10:34 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-82e9ecf1-36bc-4ea3-8f05-f26ef21e8164 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 22:10:34 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-82e9ecf1-36bc-4ea3-8f05-f26ef21e8164 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 22:10:34 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-82e9ecf1-36bc-4ea3-8f05-f26ef21e8164 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T22:10:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-385011222',display_name='tempest-VolumesSnapshotTestJSON-instance-385011222',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-385011222',id=51,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL/aI4VXCwwXQIFxIXMZr9/S5ZK0P9G25OFBXDIpNNOZTHusIDKG/YCwZBzMTkUAO14OI/hJqZGpxH/Be0SaG5dZyoFDe3dM74pPLO4aIRcHny9hsCYnjuXwYDoi2vgzFQ==',key_name='tempest-keypair-1338348537',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='799c72bbb3e248b99463567aba2049db',ramdisk_id='',reservation_id='r-em35tty9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-389190159',owner_user_name='tempest-VolumesSnapshotTestJSON-389190159-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T22:10:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7932a09ed7a14f249da27a7f1d5326ea',uuid=38bdf4aa-052a-4638-ac28-757c835aef04,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9de01666-1235-499a-9a57-a6e4a7ca6291", "address": "fa:16:3e:04:b1:de", "network": {"id": "86669102-0490-4fe4-aba4-8a353e91a763", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1218528793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799c72bbb3e248b99463567aba2049db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9de01666-12", "ovs_interfaceid": "9de01666-1235-499a-9a57-a6e4a7ca6291", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 22:10:34 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-82e9ecf1-36bc-4ea3-8f05-f26ef21e8164 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Converting VIF {"id": "9de01666-1235-499a-9a57-a6e4a7ca6291", "address": "fa:16:3e:04:b1:de", "network": {"id": "86669102-0490-4fe4-aba4-8a353e91a763", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1218528793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799c72bbb3e248b99463567aba2049db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9de01666-12", "ovs_interfaceid": "9de01666-1235-499a-9a57-a6e4a7ca6291", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 22:10:34 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-82e9ecf1-36bc-4ea3-8f05-f26ef21e8164 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:b1:de,bridge_name='br-int',has_traffic_filtering=True,id=9de01666-1235-499a-9a57-a6e4a7ca6291,network=Network(86669102-0490-4fe4-aba4-8a353e91a763),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9de01666-12') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 22:10:34 user nova-compute[74337]: DEBUG nova.objects.instance [None req-82e9ecf1-36bc-4ea3-8f05-f26ef21e8164 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Lazy-loading 'pci_devices' on Instance uuid 38bdf4aa-052a-4638-ac28-757c835aef04 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:10:34 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-82e9ecf1-36bc-4ea3-8f05-f26ef21e8164 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] [instance: 38bdf4aa-052a-4638-ac28-757c835aef04] End _get_guest_xml xml=<domain type="kvm">
Oct 23 22:10:34 user nova-compute[74337]:   <uuid>38bdf4aa-052a-4638-ac28-757c835aef04</uuid>
Oct 23 22:10:34 user nova-compute[74337]:   <name>instance-00000033</name>
Oct 23 22:10:34 user nova-compute[74337]:   <memory>524288</memory>
Oct 23 22:10:34 user nova-compute[74337]:   <vcpu>1</vcpu>
Oct 23 22:10:34 user nova-compute[74337]:   <metadata>
Oct 23 22:10:34 user nova-compute[74337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 22:10:34 user nova-compute[74337]:       <nova:package version="0.0.0"/>
Oct 23 22:10:34 user nova-compute[74337]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-385011222</nova:name>
Oct 23 22:10:34 user nova-compute[74337]:       <nova:creationTime>2023-10-23 22:10:34</nova:creationTime>
Oct 23 22:10:34 user nova-compute[74337]:       <nova:flavor name="m1.tiny">
Oct 23 22:10:34 user nova-compute[74337]:         <nova:memory>512</nova:memory>
Oct 23 22:10:34 user nova-compute[74337]:         <nova:disk>1</nova:disk>
Oct 23 22:10:34 user nova-compute[74337]:         <nova:swap>0</nova:swap>
Oct 23 22:10:34 user nova-compute[74337]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 22:10:34 user nova-compute[74337]:         <nova:vcpus>1</nova:vcpus>
Oct 23 22:10:34 user nova-compute[74337]:       </nova:flavor>
Oct 23 22:10:34 user nova-compute[74337]:       <nova:owner>
Oct 23 22:10:34 user nova-compute[74337]:         <nova:user uuid="7932a09ed7a14f249da27a7f1d5326ea">tempest-VolumesSnapshotTestJSON-389190159-project-member</nova:user>
Oct 23 22:10:34 user nova-compute[74337]:         <nova:project uuid="799c72bbb3e248b99463567aba2049db">tempest-VolumesSnapshotTestJSON-389190159</nova:project>
Oct 23 22:10:34 user nova-compute[74337]:       </nova:owner>
Oct 23 22:10:34 user nova-compute[74337]:       <nova:root type="image" uuid="d859d89d-998d-4109-b26a-0d6e28152932"/>
Oct 23 22:10:34 user nova-compute[74337]:       <nova:ports>
Oct 23 22:10:34 user nova-compute[74337]:         <nova:port uuid="9de01666-1235-499a-9a57-a6e4a7ca6291">
Oct 23 22:10:34 user nova-compute[74337]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 23 22:10:34 user nova-compute[74337]:         </nova:port>
Oct 23 22:10:34 user nova-compute[74337]:       </nova:ports>
Oct 23 22:10:34 user nova-compute[74337]:     </nova:instance>
Oct 23 22:10:34 user nova-compute[74337]:   </metadata>
Oct 23 22:10:34 user nova-compute[74337]:   <sysinfo type="smbios">
Oct 23 22:10:34 user nova-compute[74337]:     <system>
Oct 23 22:10:34 user nova-compute[74337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 22:10:34 user nova-compute[74337]:       <entry name="product">OpenStack Nova</entry>
Oct 23 22:10:34 user nova-compute[74337]:       <entry name="version">0.0.0</entry>
Oct 23 22:10:34 user nova-compute[74337]:       <entry name="serial">38bdf4aa-052a-4638-ac28-757c835aef04</entry>
Oct 23 22:10:34 user nova-compute[74337]:       <entry name="uuid">38bdf4aa-052a-4638-ac28-757c835aef04</entry>
Oct 23 22:10:34 user nova-compute[74337]:       <entry name="family">Virtual Machine</entry>
Oct 23 22:10:34 user nova-compute[74337]:     </system>
Oct 23 22:10:34 user nova-compute[74337]:   </sysinfo>
Oct 23 22:10:34 user nova-compute[74337]:   <os>
Oct 23 22:10:34 user nova-compute[74337]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 22:10:34 user nova-compute[74337]:     <boot dev="hd"/>
Oct 23 22:10:34 user nova-compute[74337]:     <smbios mode="sysinfo"/>
Oct 23 22:10:34 user nova-compute[74337]:   </os>
Oct 23 22:10:34 user nova-compute[74337]:   <features>
Oct 23 22:10:34 user nova-compute[74337]:     <acpi/>
Oct 23 22:10:34 user nova-compute[74337]:     <apic/>
Oct 23 22:10:34 user nova-compute[74337]:     <vmcoreinfo/>
Oct 23 22:10:34 user nova-compute[74337]:   </features>
Oct 23 22:10:34 user nova-compute[74337]:   <clock offset="utc">
Oct 23 22:10:34 user nova-compute[74337]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 22:10:34 user nova-compute[74337]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 22:10:34 user nova-compute[74337]:     <timer name="hpet" present="no"/>
Oct 23 22:10:34 user nova-compute[74337]:   </clock>
Oct 23 22:10:34 user nova-compute[74337]:   <cpu mode="custom" match="exact">
Oct 23 22:10:34 user nova-compute[74337]:     <model>Nehalem</model>
Oct 23 22:10:34 user nova-compute[74337]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 22:10:34 user nova-compute[74337]:   </cpu>
Oct 23 22:10:34 user nova-compute[74337]:   <devices>
Oct 23 22:10:34 user nova-compute[74337]:     <disk type="file" device="disk">
Oct 23 22:10:34 user nova-compute[74337]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 22:10:34 user nova-compute[74337]:       <source file="/opt/stack/data/nova/instances/38bdf4aa-052a-4638-ac28-757c835aef04/disk"/>
Oct 23 22:10:34 user nova-compute[74337]:       <target dev="vda" bus="virtio"/>
Oct 23 22:10:34 user nova-compute[74337]:     </disk>
Oct 23 22:10:34 user nova-compute[74337]:     <interface type="ethernet">
Oct 23 22:10:34 user nova-compute[74337]:       <mac address="fa:16:3e:04:b1:de"/>
Oct 23 22:10:34 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 22:10:34 user nova-compute[74337]:       <mtu size="1442"/>
Oct 23 22:10:34 user nova-compute[74337]:       <target dev="tap9de01666-12"/>
Oct 23 22:10:34 user nova-compute[74337]:     </interface>
Oct 23 22:10:34 user nova-compute[74337]:     <serial type="pty">
Oct 23 22:10:34 user nova-compute[74337]:       <log file="/opt/stack/data/nova/instances/38bdf4aa-052a-4638-ac28-757c835aef04/console.log" append="off"/>
Oct 23 22:10:34 user nova-compute[74337]:     </serial>
Oct 23 22:10:34 user nova-compute[74337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 22:10:34 user nova-compute[74337]:     <video>
Oct 23 22:10:34 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 22:10:34 user nova-compute[74337]:     </video>
Oct 23 22:10:34 user nova-compute[74337]:     <rng model="virtio">
Oct 23 22:10:34 user nova-compute[74337]:       <backend model="random">/dev/urandom</backend>
Oct 23 22:10:34 user nova-compute[74337]:     </rng>
Oct 23 22:10:34 user nova-compute[74337]:     <controller type="usb" index="0" model="none"/>
Oct 23 22:10:34 user nova-compute[74337]:     <memballoon model="virtio">
Oct 23 22:10:34 user nova-compute[74337]:       <stats period="10"/>
Oct 23 22:10:34 user nova-compute[74337]:     </memballoon>
Oct 23 22:10:34 user nova-compute[74337]:   </devices>
Oct 23 22:10:34 user nova-compute[74337]: </domain>
Oct 23 22:10:34 user nova-compute[74337]:  {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 22:10:34 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-82e9ecf1-36bc-4ea3-8f05-f26ef21e8164 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T22:10:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-385011222',display_name='tempest-VolumesSnapshotTestJSON-instance-385011222',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-385011222',id=51,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL/aI4VXCwwXQIFxIXMZr9/S5ZK0P9G25OFBXDIpNNOZTHusIDKG/YCwZBzMTkUAO14OI/hJqZGpxH/Be0SaG5dZyoFDe3dM74pPLO4aIRcHny9hsCYnjuXwYDoi2vgzFQ==',key_name='tempest-keypair-1338348537',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='799c72bbb3e248b99463567aba2049db',ramdisk_id='',reservation_id='r-em35tty9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-389190159',owner_user_name='tempest-VolumesSnapshotTestJSON-389190159-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T22:10:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7932a09ed7a14f249da27a7f1d5326ea',uuid=38bdf4aa-052a-4638-ac28-757c835aef04,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9de01666-1235-499a-9a57-a6e4a7ca6291", "address": "fa:16:3e:04:b1:de", "network": {"id": "86669102-0490-4fe4-aba4-8a353e91a763", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1218528793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799c72bbb3e248b99463567aba2049db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9de01666-12", "ovs_interfaceid": "9de01666-1235-499a-9a57-a6e4a7ca6291", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 22:10:34 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-82e9ecf1-36bc-4ea3-8f05-f26ef21e8164 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Converting VIF {"id": "9de01666-1235-499a-9a57-a6e4a7ca6291", "address": "fa:16:3e:04:b1:de", "network": {"id": "86669102-0490-4fe4-aba4-8a353e91a763", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1218528793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799c72bbb3e248b99463567aba2049db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9de01666-12", "ovs_interfaceid": "9de01666-1235-499a-9a57-a6e4a7ca6291", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 22:10:34 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-82e9ecf1-36bc-4ea3-8f05-f26ef21e8164 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:b1:de,bridge_name='br-int',has_traffic_filtering=True,id=9de01666-1235-499a-9a57-a6e4a7ca6291,network=Network(86669102-0490-4fe4-aba4-8a353e91a763),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9de01666-12') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 22:10:34 user nova-compute[74337]: DEBUG os_vif [None req-82e9ecf1-36bc-4ea3-8f05-f26ef21e8164 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:b1:de,bridge_name='br-int',has_traffic_filtering=True,id=9de01666-1235-499a-9a57-a6e4a7ca6291,network=Network(86669102-0490-4fe4-aba4-8a353e91a763),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9de01666-12') {{(pid=74337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 22:10:34 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:10:34 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:10:34 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 22:10:34 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:10:34 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'aee2e324-8e46-5d3f-94c3-e0167d51790b', '_type': 'linux-noop'}}, row=False) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:10:34 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:10:34 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:10:34 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:10:34 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9de01666-12, may_exist=True, interface_attrs={}) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:10:34 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9de01666-12, col_values=(('qos', UUID('9b8697a2-f9c5-49d2-ad05-8da6391b1c6b')),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:10:34 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9de01666-12, col_values=(('external_ids', {'iface-id': '9de01666-1235-499a-9a57-a6e4a7ca6291', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:04:b1:de', 'vm-uuid': '38bdf4aa-052a-4638-ac28-757c835aef04'}),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:10:34 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:10:34 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:10:34 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:10:34 user nova-compute[74337]: INFO os_vif [None req-82e9ecf1-36bc-4ea3-8f05-f26ef21e8164 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:b1:de,bridge_name='br-int',has_traffic_filtering=True,id=9de01666-1235-499a-9a57-a6e4a7ca6291,network=Network(86669102-0490-4fe4-aba4-8a353e91a763),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9de01666-12')
Oct 23 22:10:34 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-82e9ecf1-36bc-4ea3-8f05-f26ef21e8164 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] No BDM found with device name vda, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 22:10:34 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-82e9ecf1-36bc-4ea3-8f05-f26ef21e8164 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] No VIF found with MAC fa:16:3e:04:b1:de, not building metadata {{(pid=74337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 22:10:34 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:10:34 user nova-compute[74337]: DEBUG nova.network.neutron [req-1a408383-962d-4500-b389-4ccf280b6322 req-d93b915d-2dba-4373-9ad2-73d67121d71a service nova] [instance: 38bdf4aa-052a-4638-ac28-757c835aef04] Updated VIF entry in instance network info cache for port 9de01666-1235-499a-9a57-a6e4a7ca6291. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 22:10:34 user nova-compute[74337]: DEBUG nova.network.neutron [req-1a408383-962d-4500-b389-4ccf280b6322 req-d93b915d-2dba-4373-9ad2-73d67121d71a service nova] [instance: 38bdf4aa-052a-4638-ac28-757c835aef04] Updating instance_info_cache with network_info: [{"id": "9de01666-1235-499a-9a57-a6e4a7ca6291", "address": "fa:16:3e:04:b1:de", "network": {"id": "86669102-0490-4fe4-aba4-8a353e91a763", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1218528793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799c72bbb3e248b99463567aba2049db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9de01666-12", "ovs_interfaceid": "9de01666-1235-499a-9a57-a6e4a7ca6291", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 22:10:34 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-1a408383-962d-4500-b389-4ccf280b6322 req-d93b915d-2dba-4373-9ad2-73d67121d71a service nova] Releasing lock "refresh_cache-38bdf4aa-052a-4638-ac28-757c835aef04" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 22:10:34 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:10:34 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:10:34 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:10:34 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:10:34 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Auditing locally available compute resources for user (node: user) {{(pid=74337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 22:10:35 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:10:35 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:10:35 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:10:35 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:10:35 user nova-compute[74337]: DEBUG nova.compute.manager [req-b9b12ae0-584b-4873-9a8c-f87d21936ac5 req-52313c83-0295-4f72-a1ab-f105cd6829b5 service nova] [instance: 38bdf4aa-052a-4638-ac28-757c835aef04] Received event network-vif-plugged-9de01666-1235-499a-9a57-a6e4a7ca6291 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:10:35 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-b9b12ae0-584b-4873-9a8c-f87d21936ac5 req-52313c83-0295-4f72-a1ab-f105cd6829b5 service nova] Acquiring lock "38bdf4aa-052a-4638-ac28-757c835aef04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:10:35 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-b9b12ae0-584b-4873-9a8c-f87d21936ac5 req-52313c83-0295-4f72-a1ab-f105cd6829b5 service nova] Lock "38bdf4aa-052a-4638-ac28-757c835aef04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:10:35 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-b9b12ae0-584b-4873-9a8c-f87d21936ac5 req-52313c83-0295-4f72-a1ab-f105cd6829b5 service nova] Lock "38bdf4aa-052a-4638-ac28-757c835aef04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:10:35 user nova-compute[74337]: DEBUG nova.compute.manager [req-b9b12ae0-584b-4873-9a8c-f87d21936ac5 req-52313c83-0295-4f72-a1ab-f105cd6829b5 service nova] [instance: 38bdf4aa-052a-4638-ac28-757c835aef04] No waiting events found dispatching network-vif-plugged-9de01666-1235-499a-9a57-a6e4a7ca6291 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 22:10:35 user nova-compute[74337]: WARNING nova.compute.manager [req-b9b12ae0-584b-4873-9a8c-f87d21936ac5 req-52313c83-0295-4f72-a1ab-f105cd6829b5 service nova] [instance: 38bdf4aa-052a-4638-ac28-757c835aef04] Received unexpected event network-vif-plugged-9de01666-1235-499a-9a57-a6e4a7ca6291 for instance with vm_state building and task_state spawning.
Oct 23 22:10:35 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/999843b2-b757-480b-bd21-bf281954bc46/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:10:36 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:10:36 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:10:36 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:10:36 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/999843b2-b757-480b-bd21-bf281954bc46/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:10:36 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/999843b2-b757-480b-bd21-bf281954bc46/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:10:36 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/999843b2-b757-480b-bd21-bf281954bc46/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:10:36 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6aee021-df0b-4ada-9f82-8df7486dc869/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:10:36 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6aee021-df0b-4ada-9f82-8df7486dc869/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:10:36 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6aee021-df0b-4ada-9f82-8df7486dc869/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:10:36 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6aee021-df0b-4ada-9f82-8df7486dc869/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:10:36 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61fe098a-5958-4ad1-8f92-4592809299b7/disk.rescue --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:10:36 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61fe098a-5958-4ad1-8f92-4592809299b7/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:10:36 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61fe098a-5958-4ad1-8f92-4592809299b7/disk.rescue --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:10:37 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61fe098a-5958-4ad1-8f92-4592809299b7/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:10:37 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] skipping disk /opt/stack/data/nova/instances/61fe098a-5958-4ad1-8f92-4592809299b7/disk (vdb) as it is a volume {{(pid=74337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 22:10:37 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/106da458-caec-4114-8904-0411ec0ea903/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:10:37 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/106da458-caec-4114-8904-0411ec0ea903/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:10:37 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/106da458-caec-4114-8904-0411ec0ea903/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:10:37 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/106da458-caec-4114-8904-0411ec0ea903/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:10:37 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk.rescue --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:10:37 user nova-compute[74337]: DEBUG nova.compute.manager [req-52feb5a0-f256-4439-8426-935ca47524be req-0daa9ac6-d662-4e1e-ac1e-5923936fc5b8 service nova] [instance: 38bdf4aa-052a-4638-ac28-757c835aef04] Received event network-vif-plugged-9de01666-1235-499a-9a57-a6e4a7ca6291 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:10:37 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-52feb5a0-f256-4439-8426-935ca47524be req-0daa9ac6-d662-4e1e-ac1e-5923936fc5b8 service nova] Acquiring lock "38bdf4aa-052a-4638-ac28-757c835aef04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:10:37 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-52feb5a0-f256-4439-8426-935ca47524be req-0daa9ac6-d662-4e1e-ac1e-5923936fc5b8 service nova] Lock "38bdf4aa-052a-4638-ac28-757c835aef04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:10:37 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-52feb5a0-f256-4439-8426-935ca47524be req-0daa9ac6-d662-4e1e-ac1e-5923936fc5b8 service nova] Lock "38bdf4aa-052a-4638-ac28-757c835aef04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:10:37 user nova-compute[74337]: DEBUG nova.compute.manager [req-52feb5a0-f256-4439-8426-935ca47524be req-0daa9ac6-d662-4e1e-ac1e-5923936fc5b8 service nova] [instance: 38bdf4aa-052a-4638-ac28-757c835aef04] No waiting events found dispatching network-vif-plugged-9de01666-1235-499a-9a57-a6e4a7ca6291 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 22:10:37 user nova-compute[74337]: WARNING nova.compute.manager [req-52feb5a0-f256-4439-8426-935ca47524be req-0daa9ac6-d662-4e1e-ac1e-5923936fc5b8 service nova] [instance: 38bdf4aa-052a-4638-ac28-757c835aef04] Received unexpected event network-vif-plugged-9de01666-1235-499a-9a57-a6e4a7ca6291 for instance with vm_state building and task_state spawning.
Oct 23 22:10:37 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:10:37 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk.rescue --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:10:37 user nova-compute[74337]: DEBUG nova.compute.manager [None req-82e9ecf1-36bc-4ea3-8f05-f26ef21e8164 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] [instance: 38bdf4aa-052a-4638-ac28-757c835aef04] Instance event wait completed in 0 seconds for  {{(pid=74337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 22:10:37 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-82e9ecf1-36bc-4ea3-8f05-f26ef21e8164 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] [instance: 38bdf4aa-052a-4638-ac28-757c835aef04] Guest created on hypervisor {{(pid=74337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 22:10:37 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: 38bdf4aa-052a-4638-ac28-757c835aef04] Instance spawned successfully.
Oct 23 22:10:37 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-82e9ecf1-36bc-4ea3-8f05-f26ef21e8164 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] [instance: 38bdf4aa-052a-4638-ac28-757c835aef04] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 22:10:37 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-82e9ecf1-36bc-4ea3-8f05-f26ef21e8164 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] [instance: 38bdf4aa-052a-4638-ac28-757c835aef04] Found default for hw_cdrom_bus of ide {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 22:10:37 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-82e9ecf1-36bc-4ea3-8f05-f26ef21e8164 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] [instance: 38bdf4aa-052a-4638-ac28-757c835aef04] Found default for hw_disk_bus of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 22:10:37 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-82e9ecf1-36bc-4ea3-8f05-f26ef21e8164 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] [instance: 38bdf4aa-052a-4638-ac28-757c835aef04] Found default for hw_input_bus of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 22:10:37 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-82e9ecf1-36bc-4ea3-8f05-f26ef21e8164 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] [instance: 38bdf4aa-052a-4638-ac28-757c835aef04] Found default for hw_pointer_model of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 22:10:37 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-82e9ecf1-36bc-4ea3-8f05-f26ef21e8164 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] [instance: 38bdf4aa-052a-4638-ac28-757c835aef04] Found default for hw_video_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 22:10:37 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-82e9ecf1-36bc-4ea3-8f05-f26ef21e8164 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] [instance: 38bdf4aa-052a-4638-ac28-757c835aef04] Found default for hw_vif_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 22:10:37 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk.rescue --force-share --output=json" returned: 0 in 0.223s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:10:37 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:10:37 user nova-compute[74337]: INFO nova.compute.manager [None req-82e9ecf1-36bc-4ea3-8f05-f26ef21e8164 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] [instance: 38bdf4aa-052a-4638-ac28-757c835aef04] Took 6.16 seconds to spawn the instance on the hypervisor.
Oct 23 22:10:37 user nova-compute[74337]: DEBUG nova.compute.manager [None req-82e9ecf1-36bc-4ea3-8f05-f26ef21e8164 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] [instance: 38bdf4aa-052a-4638-ac28-757c835aef04] Checking state {{(pid=74337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 22:10:38 user nova-compute[74337]: INFO nova.compute.manager [None req-82e9ecf1-36bc-4ea3-8f05-f26ef21e8164 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] [instance: 38bdf4aa-052a-4638-ac28-757c835aef04] Took 6.90 seconds to build instance.
Oct 23 22:10:38 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-82e9ecf1-36bc-4ea3-8f05-f26ef21e8164 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Lock "38bdf4aa-052a-4638-ac28-757c835aef04" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.018s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:10:38 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:10:38 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:10:38 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:10:38 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38bdf4aa-052a-4638-ac28-757c835aef04/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:10:38 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38bdf4aa-052a-4638-ac28-757c835aef04/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:10:38 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38bdf4aa-052a-4638-ac28-757c835aef04/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:10:38 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38bdf4aa-052a-4638-ac28-757c835aef04/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:10:39 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:10:39 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:10:39 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:10:39 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Hypervisor/Node resource view: name=user free_ram=8265MB free_disk=25.030410766601562GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 22:10:39 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:10:39 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.005s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:10:39 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:10:39 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 0323b854-c7a1-42e8-ad85-1e929caa6e9d has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Oct 23 22:10:39 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 999843b2-b757-480b-bd21-bf281954bc46 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 22:10:39 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 27710919-a717-42fa-a436-a261d92c1c2a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 22:10:39 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 106da458-caec-4114-8904-0411ec0ea903 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 22:10:39 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 61fe098a-5958-4ad1-8f92-4592809299b7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 22:10:39 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance a6aee021-df0b-4ada-9f82-8df7486dc869 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 22:10:39 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 38bdf4aa-052a-4638-ac28-757c835aef04 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 22:10:39 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 22:10:39 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 22:10:39 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 22:10:39 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 22:10:39 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Compute_service record updated for user:user {{(pid=74337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 22:10:39 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.501s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:10:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:10:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:10:44 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:10:49 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:10:49 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:10:54 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:10:54 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:10:59 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:10:59 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:11:04 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:11:04 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:11:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:11:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:11:14 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:11:19 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:11:24 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:11:24 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:11:24 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 22:11:28 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:11:29 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:11:29 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:11:29 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 22:11:29 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 22:11:29 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 22:11:29 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:11:29 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:11:30 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:11:32 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:11:33 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:11:34 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:11:34 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:11:34 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Starting heal instance info cache {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 22:11:34 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "refresh_cache-27710919-a717-42fa-a436-a261d92c1c2a" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 22:11:34 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquired lock "refresh_cache-27710919-a717-42fa-a436-a261d92c1c2a" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 22:11:34 user nova-compute[74337]: DEBUG nova.network.neutron [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 27710919-a717-42fa-a436-a261d92c1c2a] Forcefully refreshing network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 22:11:34 user nova-compute[74337]: DEBUG nova.network.neutron [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 27710919-a717-42fa-a436-a261d92c1c2a] Updating instance_info_cache with network_info: [{"id": "85905b2e-3e09-4236-8fe7-ea6c31324ae6", "address": "fa:16:3e:50:cd:90", "network": {"id": "122fdd20-8bf5-4374-b50c-82e5dc8684db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-81475496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80f79dd6954748e4806a568a4127396f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85905b2e-3e", "ovs_interfaceid": "85905b2e-3e09-4236-8fe7-ea6c31324ae6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 22:11:34 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Releasing lock "refresh_cache-27710919-a717-42fa-a436-a261d92c1c2a" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 22:11:34 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 27710919-a717-42fa-a436-a261d92c1c2a] Updated the network info_cache for instance {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 22:11:35 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:11:35 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:11:35 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:11:35 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:11:35 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:11:35 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Auditing locally available compute resources for user (node: user) {{(pid=74337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 22:11:35 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/999843b2-b757-480b-bd21-bf281954bc46/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:11:35 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/999843b2-b757-480b-bd21-bf281954bc46/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:11:35 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/999843b2-b757-480b-bd21-bf281954bc46/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:11:35 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/999843b2-b757-480b-bd21-bf281954bc46/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:11:35 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6aee021-df0b-4ada-9f82-8df7486dc869/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:11:36 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6aee021-df0b-4ada-9f82-8df7486dc869/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:11:36 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6aee021-df0b-4ada-9f82-8df7486dc869/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:11:36 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6aee021-df0b-4ada-9f82-8df7486dc869/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:11:36 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61fe098a-5958-4ad1-8f92-4592809299b7/disk.rescue --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:11:36 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61fe098a-5958-4ad1-8f92-4592809299b7/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:11:36 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61fe098a-5958-4ad1-8f92-4592809299b7/disk.rescue --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:11:36 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61fe098a-5958-4ad1-8f92-4592809299b7/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:11:36 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] skipping disk /opt/stack/data/nova/instances/61fe098a-5958-4ad1-8f92-4592809299b7/disk (vdb) as it is a volume {{(pid=74337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 22:11:36 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/106da458-caec-4114-8904-0411ec0ea903/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:11:36 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/106da458-caec-4114-8904-0411ec0ea903/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:11:36 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/106da458-caec-4114-8904-0411ec0ea903/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:11:37 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/106da458-caec-4114-8904-0411ec0ea903/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:11:37 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk.rescue --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:11:37 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:11:37 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk.rescue --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:11:37 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:11:37 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:11:37 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:11:37 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:11:37 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:11:37 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38bdf4aa-052a-4638-ac28-757c835aef04/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:11:38 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38bdf4aa-052a-4638-ac28-757c835aef04/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:11:38 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38bdf4aa-052a-4638-ac28-757c835aef04/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:11:38 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38bdf4aa-052a-4638-ac28-757c835aef04/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:11:38 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:11:38 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:11:38 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Hypervisor/Node resource view: name=user free_ram=8275MB free_disk=24.992908477783203GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 22:11:38 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:11:38 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:11:38 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 0323b854-c7a1-42e8-ad85-1e929caa6e9d has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Oct 23 22:11:38 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 999843b2-b757-480b-bd21-bf281954bc46 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 22:11:38 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 27710919-a717-42fa-a436-a261d92c1c2a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 22:11:38 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 106da458-caec-4114-8904-0411ec0ea903 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 22:11:38 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 61fe098a-5958-4ad1-8f92-4592809299b7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 22:11:38 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance a6aee021-df0b-4ada-9f82-8df7486dc869 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 22:11:38 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 38bdf4aa-052a-4638-ac28-757c835aef04 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 22:11:38 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 22:11:38 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 22:11:39 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 22:11:39 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 22:11:39 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Compute_service record updated for user:user {{(pid=74337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 22:11:39 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.377s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:11:39 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:11:43 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:11:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:11:49 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:11:54 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:11:54 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:11:54 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 22:11:54 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 22:11:54 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 22:11:54 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:11:59 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:12:02 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:12:03 user nova-compute[74337]: DEBUG nova.compute.manager [req-398e55d3-8216-44c4-9357-4035554468b1 req-c9761908-d54e-4598-873d-c21fd9f6ed67 service nova] [instance: a6aee021-df0b-4ada-9f82-8df7486dc869] Received event network-changed-7de2dfea-ae8f-4aab-8f6c-06eb8a86f1ec {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:12:03 user nova-compute[74337]: DEBUG nova.compute.manager [req-398e55d3-8216-44c4-9357-4035554468b1 req-c9761908-d54e-4598-873d-c21fd9f6ed67 service nova] [instance: a6aee021-df0b-4ada-9f82-8df7486dc869] Refreshing instance network info cache due to event network-changed-7de2dfea-ae8f-4aab-8f6c-06eb8a86f1ec. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 22:12:03 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-398e55d3-8216-44c4-9357-4035554468b1 req-c9761908-d54e-4598-873d-c21fd9f6ed67 service nova] Acquiring lock "refresh_cache-a6aee021-df0b-4ada-9f82-8df7486dc869" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 22:12:03 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-398e55d3-8216-44c4-9357-4035554468b1 req-c9761908-d54e-4598-873d-c21fd9f6ed67 service nova] Acquired lock "refresh_cache-a6aee021-df0b-4ada-9f82-8df7486dc869" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 22:12:03 user nova-compute[74337]: DEBUG nova.network.neutron [req-398e55d3-8216-44c4-9357-4035554468b1 req-c9761908-d54e-4598-873d-c21fd9f6ed67 service nova] [instance: a6aee021-df0b-4ada-9f82-8df7486dc869] Refreshing network info cache for port 7de2dfea-ae8f-4aab-8f6c-06eb8a86f1ec {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 22:12:03 user nova-compute[74337]: DEBUG nova.network.neutron [req-398e55d3-8216-44c4-9357-4035554468b1 req-c9761908-d54e-4598-873d-c21fd9f6ed67 service nova] [instance: a6aee021-df0b-4ada-9f82-8df7486dc869] Updated VIF entry in instance network info cache for port 7de2dfea-ae8f-4aab-8f6c-06eb8a86f1ec. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 22:12:03 user nova-compute[74337]: DEBUG nova.network.neutron [req-398e55d3-8216-44c4-9357-4035554468b1 req-c9761908-d54e-4598-873d-c21fd9f6ed67 service nova] [instance: a6aee021-df0b-4ada-9f82-8df7486dc869] Updating instance_info_cache with network_info: [{"id": "7de2dfea-ae8f-4aab-8f6c-06eb8a86f1ec", "address": "fa:16:3e:41:c4:f2", "network": {"id": "09783701-f9c4-4d08-8523-6e363a558ec0", "bridge": "br-int", "label": "tempest-TestStampPattern-974584378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc044020751d475b94e96fcedb97b86c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7de2dfea-ae", "ovs_interfaceid": "7de2dfea-ae8f-4aab-8f6c-06eb8a86f1ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 22:12:03 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-398e55d3-8216-44c4-9357-4035554468b1 req-c9761908-d54e-4598-873d-c21fd9f6ed67 service nova] Releasing lock "refresh_cache-a6aee021-df0b-4ada-9f82-8df7486dc869" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 22:12:03 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-fa569324-c348-4e4c-adef-c086733682df tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Acquiring lock "a6aee021-df0b-4ada-9f82-8df7486dc869" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:12:03 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-fa569324-c348-4e4c-adef-c086733682df tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Lock "a6aee021-df0b-4ada-9f82-8df7486dc869" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:12:03 user nova-compute[74337]: DEBUG nova.objects.instance [None req-fa569324-c348-4e4c-adef-c086733682df tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Lazy-loading 'flavor' on Instance uuid a6aee021-df0b-4ada-9f82-8df7486dc869 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:12:03 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-fa569324-c348-4e4c-adef-c086733682df tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Lock "a6aee021-df0b-4ada-9f82-8df7486dc869" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:12:04 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-fa569324-c348-4e4c-adef-c086733682df tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Acquiring lock "a6aee021-df0b-4ada-9f82-8df7486dc869" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:12:04 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-fa569324-c348-4e4c-adef-c086733682df tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Lock "a6aee021-df0b-4ada-9f82-8df7486dc869" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:12:04 user nova-compute[74337]: INFO nova.compute.manager [None req-fa569324-c348-4e4c-adef-c086733682df tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] [instance: a6aee021-df0b-4ada-9f82-8df7486dc869] Attaching volume 611c6e03-d496-441e-9535-d9f51ebd8824 to /dev/vdb
Oct 23 22:12:04 user nova-compute[74337]: DEBUG os_brick.utils [None req-fa569324-c348-4e4c-adef-c086733682df tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 22:12:04 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:12:04 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:12:04 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[36213f3e-6293-4e2d-b9f0-3ce83cbdb2ef]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f34011b66e40\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:12:04 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:12:04 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:12:04 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ffe78ab-d3de-4f6a-8819-0046739dc64e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:12:04 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:12:04 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:12:04 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[584328a1-6dfb-44f1-95de-6f1cfbc13787]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:12:04 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdfd7dca-e1b0-40b7-8014-9475bd346d5a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:12:04 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-fa569324-c348-4e4c-adef-c086733682df tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Running cmd (subprocess): nvme version {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:12:04 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-fa569324-c348-4e4c-adef-c086733682df tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] 'nvme version' failed. Not Retrying. {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 22:12:04 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fa569324-c348-4e4c-adef-c086733682df tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] nvme not present on system {{(pid=74337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 22:12:04 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:12:04 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 22:12:04 user nova-compute[74337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 22:12:04 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f7efc3b-3bfa-436d-a676-589f989d63f7]: (4, '') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:12:04 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-fa569324-c348-4e4c-adef-c086733682df tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 22:12:04 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-fa569324-c348-4e4c-adef-c086733682df tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 22:12:04 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-fa569324-c348-4e4c-adef-c086733682df tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] LIGHTOS: no hostnqn found. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 22:12:04 user nova-compute[74337]: DEBUG os_brick.utils [None req-fa569324-c348-4e4c-adef-c086733682df tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f34011b66e40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 22:12:04 user nova-compute[74337]: DEBUG nova.virt.block_device [None req-fa569324-c348-4e4c-adef-c086733682df tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] [instance: a6aee021-df0b-4ada-9f82-8df7486dc869] Updating existing volume attachment record: 02169404-f776-494b-9d18-1db1da6bbb85 {{(pid=74337) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 22:12:04 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:12:04 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:12:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:12:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:12:13 user nova-compute[74337]: INFO nova.compute.manager [None req-c93b2530-b7f4-483f-890b-a27b36fd89a1 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Unrescuing
Oct 23 22:12:13 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-c93b2530-b7f4-483f-890b-a27b36fd89a1 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Acquiring lock "refresh_cache-61fe098a-5958-4ad1-8f92-4592809299b7" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 22:12:13 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-c93b2530-b7f4-483f-890b-a27b36fd89a1 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Acquired lock "refresh_cache-61fe098a-5958-4ad1-8f92-4592809299b7" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 22:12:13 user nova-compute[74337]: DEBUG nova.network.neutron [None req-c93b2530-b7f4-483f-890b-a27b36fd89a1 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Building network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 22:12:13 user nova-compute[74337]: DEBUG nova.network.neutron [None req-c93b2530-b7f4-483f-890b-a27b36fd89a1 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Updating instance_info_cache with network_info: [{"id": "496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74", "address": "fa:16:3e:68:65:1a", "network": {"id": "122fdd20-8bf5-4374-b50c-82e5dc8684db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-81475496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80f79dd6954748e4806a568a4127396f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap496ce3c5-18", "ovs_interfaceid": "496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 22:12:13 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-c93b2530-b7f4-483f-890b-a27b36fd89a1 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Releasing lock "refresh_cache-61fe098a-5958-4ad1-8f92-4592809299b7" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 22:12:13 user nova-compute[74337]: DEBUG nova.objects.instance [None req-c93b2530-b7f4-483f-890b-a27b36fd89a1 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Lazy-loading 'flavor' on Instance uuid 61fe098a-5958-4ad1-8f92-4592809299b7 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:12:14 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:12:14 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:12:14 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:12:14 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:12:14 user nova-compute[74337]: DEBUG nova.compute.manager [req-03022afa-3925-49c5-86e4-e98ec7cfbeeb req-82d90477-3056-4d30-bf3e-05ee396558ad service nova] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Received event network-vif-unplugged-496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:12:14 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-03022afa-3925-49c5-86e4-e98ec7cfbeeb req-82d90477-3056-4d30-bf3e-05ee396558ad service nova] Acquiring lock "61fe098a-5958-4ad1-8f92-4592809299b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:12:14 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-03022afa-3925-49c5-86e4-e98ec7cfbeeb req-82d90477-3056-4d30-bf3e-05ee396558ad service nova] Lock "61fe098a-5958-4ad1-8f92-4592809299b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:12:14 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-03022afa-3925-49c5-86e4-e98ec7cfbeeb req-82d90477-3056-4d30-bf3e-05ee396558ad service nova] Lock "61fe098a-5958-4ad1-8f92-4592809299b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:12:14 user nova-compute[74337]: DEBUG nova.compute.manager [req-03022afa-3925-49c5-86e4-e98ec7cfbeeb req-82d90477-3056-4d30-bf3e-05ee396558ad service nova] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] No waiting events found dispatching network-vif-unplugged-496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 22:12:14 user nova-compute[74337]: WARNING nova.compute.manager [req-03022afa-3925-49c5-86e4-e98ec7cfbeeb req-82d90477-3056-4d30-bf3e-05ee396558ad service nova] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Received unexpected event network-vif-unplugged-496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74 for instance with vm_state rescued and task_state unrescuing.
Oct 23 22:12:14 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:12:14 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:12:14 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Instance destroyed successfully.
Oct 23 22:12:15 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:12:15 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:12:16 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:12:16 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:12:16 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:12:16 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:12:16 user nova-compute[74337]: DEBUG nova.compute.manager [req-23e9c8ac-a1f9-4c5c-a0ab-9a9d28e944d0 req-8dc32af3-17d1-4be3-a3f0-2762db625ff0 service nova] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Received event network-vif-plugged-496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:12:16 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-23e9c8ac-a1f9-4c5c-a0ab-9a9d28e944d0 req-8dc32af3-17d1-4be3-a3f0-2762db625ff0 service nova] Acquiring lock "61fe098a-5958-4ad1-8f92-4592809299b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:12:16 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-23e9c8ac-a1f9-4c5c-a0ab-9a9d28e944d0 req-8dc32af3-17d1-4be3-a3f0-2762db625ff0 service nova] Lock "61fe098a-5958-4ad1-8f92-4592809299b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:12:16 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-23e9c8ac-a1f9-4c5c-a0ab-9a9d28e944d0 req-8dc32af3-17d1-4be3-a3f0-2762db625ff0 service nova] Lock "61fe098a-5958-4ad1-8f92-4592809299b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:12:16 user nova-compute[74337]: DEBUG nova.compute.manager [req-23e9c8ac-a1f9-4c5c-a0ab-9a9d28e944d0 req-8dc32af3-17d1-4be3-a3f0-2762db625ff0 service nova] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] No waiting events found dispatching network-vif-plugged-496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 22:12:16 user nova-compute[74337]: WARNING nova.compute.manager [req-23e9c8ac-a1f9-4c5c-a0ab-9a9d28e944d0 req-8dc32af3-17d1-4be3-a3f0-2762db625ff0 service nova] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Received unexpected event network-vif-plugged-496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74 for instance with vm_state rescued and task_state unrescuing.
Oct 23 22:12:16 user nova-compute[74337]: DEBUG nova.compute.manager [req-23e9c8ac-a1f9-4c5c-a0ab-9a9d28e944d0 req-8dc32af3-17d1-4be3-a3f0-2762db625ff0 service nova] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Received event network-vif-plugged-496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:12:16 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-23e9c8ac-a1f9-4c5c-a0ab-9a9d28e944d0 req-8dc32af3-17d1-4be3-a3f0-2762db625ff0 service nova] Acquiring lock "61fe098a-5958-4ad1-8f92-4592809299b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:12:16 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-23e9c8ac-a1f9-4c5c-a0ab-9a9d28e944d0 req-8dc32af3-17d1-4be3-a3f0-2762db625ff0 service nova] Lock "61fe098a-5958-4ad1-8f92-4592809299b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:12:16 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-23e9c8ac-a1f9-4c5c-a0ab-9a9d28e944d0 req-8dc32af3-17d1-4be3-a3f0-2762db625ff0 service nova] Lock "61fe098a-5958-4ad1-8f92-4592809299b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:12:16 user nova-compute[74337]: DEBUG nova.compute.manager [req-23e9c8ac-a1f9-4c5c-a0ab-9a9d28e944d0 req-8dc32af3-17d1-4be3-a3f0-2762db625ff0 service nova] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] No waiting events found dispatching network-vif-plugged-496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 22:12:16 user nova-compute[74337]: WARNING nova.compute.manager [req-23e9c8ac-a1f9-4c5c-a0ab-9a9d28e944d0 req-8dc32af3-17d1-4be3-a3f0-2762db625ff0 service nova] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Received unexpected event network-vif-plugged-496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74 for instance with vm_state rescued and task_state unrescuing.
Oct 23 22:12:16 user nova-compute[74337]: DEBUG nova.compute.manager [req-23e9c8ac-a1f9-4c5c-a0ab-9a9d28e944d0 req-8dc32af3-17d1-4be3-a3f0-2762db625ff0 service nova] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Received event network-vif-plugged-496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:12:16 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-23e9c8ac-a1f9-4c5c-a0ab-9a9d28e944d0 req-8dc32af3-17d1-4be3-a3f0-2762db625ff0 service nova] Acquiring lock "61fe098a-5958-4ad1-8f92-4592809299b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:12:16 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-23e9c8ac-a1f9-4c5c-a0ab-9a9d28e944d0 req-8dc32af3-17d1-4be3-a3f0-2762db625ff0 service nova] Lock "61fe098a-5958-4ad1-8f92-4592809299b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:12:16 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-23e9c8ac-a1f9-4c5c-a0ab-9a9d28e944d0 req-8dc32af3-17d1-4be3-a3f0-2762db625ff0 service nova] Lock "61fe098a-5958-4ad1-8f92-4592809299b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:12:16 user nova-compute[74337]: DEBUG nova.compute.manager [req-23e9c8ac-a1f9-4c5c-a0ab-9a9d28e944d0 req-8dc32af3-17d1-4be3-a3f0-2762db625ff0 service nova] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] No waiting events found dispatching network-vif-plugged-496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 22:12:16 user nova-compute[74337]: WARNING nova.compute.manager [req-23e9c8ac-a1f9-4c5c-a0ab-9a9d28e944d0 req-8dc32af3-17d1-4be3-a3f0-2762db625ff0 service nova] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Received unexpected event network-vif-plugged-496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74 for instance with vm_state rescued and task_state unrescuing.
Oct 23 22:12:18 user nova-compute[74337]: DEBUG nova.compute.manager [None req-c93b2530-b7f4-483f-890b-a27b36fd89a1 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Checking state {{(pid=74337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 22:12:19 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:12:19 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:12:20 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa569324-c348-4e4c-adef-c086733682df tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] [instance: a6aee021-df0b-4ada-9f82-8df7486dc869] Calling os-brick to attach iSCSI Volume {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 22:12:20 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa569324-c348-4e4c-adef-c086733682df tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:611c6e03-d496-441e-9535-d9f51ebd8824', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PyNsRuOF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 22:12:20 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-fa569324-c348-4e4c-adef-c086733682df tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 22:12:20 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-fa569324-c348-4e4c-adef-c086733682df tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 22:12:20 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-fa569324-c348-4e4c-adef-c086733682df tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 22:12:20 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-fa569324-c348-4e4c-adef-c086733682df tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 22:12:20 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-fa569324-c348-4e4c-adef-c086733682df tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:611c6e03-d496-441e-9535-d9f51ebd8824" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 22:12:20 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-fa569324-c348-4e4c-adef-c086733682df tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:611c6e03-d496-441e-9535-d9f51ebd8824" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 22:12:20 user nova-compute[74337]: INFO os_brick.initiator.connectors.iscsi [None req-fa569324-c348-4e4c-adef-c086733682df tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 22:12:20 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:611c6e03-d496-441e-9535-d9f51ebd8824 -p 172.16.0.220:3260 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:12:20 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:611c6e03-d496-441e-9535-d9f51ebd8824 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:12:20 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a07c8079-63d3-4b66-9c90-3df7d3bd4315]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:12:20 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa569324-c348-4e4c-adef-c086733682df tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 22:12:20 user nova-compute[74337]:  {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:12:20 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:611c6e03-d496-441e-9535-d9f51ebd8824 -p 172.16.0.220:3260 --interface default --op new {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:12:20 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:611c6e03-d496-441e-9535-d9f51ebd8824 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:12:20 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e609403-5c07-45a7-81f7-ba580d4b454c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:611c6e03-d496-441e-9535-d9f51ebd8824] added\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:12:20 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa569324-c348-4e4c-adef-c086733682df tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:611c6e03-d496-441e-9535-d9f51ebd8824] added
Oct 23 22:12:20 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:12:20 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:611c6e03-d496-441e-9535-d9f51ebd8824 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:12:20 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:611c6e03-d496-441e-9535-d9f51ebd8824 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:12:20 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d455154e-d4e3-46cd-9141-a01bfbf607b8]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:12:20 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa569324-c348-4e4c-adef-c086733682df tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:12:20 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:611c6e03-d496-441e-9535-d9f51ebd8824 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:12:20 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:611c6e03-d496-441e-9535-d9f51ebd8824 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:12:20 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1f89f87-9cf6-4a77-96e2-c344ad49aa20]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:12:20 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa569324-c348-4e4c-adef-c086733682df tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:12:20 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:611c6e03-d496-441e-9535-d9f51ebd8824 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PyNsRuOF {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:12:20 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:611c6e03-d496-441e-9535-d9f51ebd8824 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PyNsRuOF" returned: 0 in 0.022s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:12:20 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b499108b-b2d8-4cad-bf87-54ba83ace58b]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:12:20 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa569324-c348-4e4c-adef-c086733682df tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PyNsRuOF'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:12:20 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:611c6e03-d496-441e-9535-d9f51ebd8824 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:12:20 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:611c6e03-d496-441e-9535-d9f51ebd8824 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:12:20 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e92e42-fe63-4791-b6cf-7339cd4740df]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:12:20 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa569324-c348-4e4c-adef-c086733682df tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:12:20 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:12:20 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:12:20 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a77300d-99b1-4e8f-88a5-371f54f2b72d]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485637f5-7429-4020-83b7-1156be9d013f (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:12:20 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa569324-c348-4e4c-adef-c086733682df tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485637f5-7429-4020-83b7-1156be9d013f (non-flash)
Oct 23 22:12:20 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 22:12:20 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa569324-c348-4e4c-adef-c086733682df tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485637f5-7429-4020-83b7-1156be9d013f (non-flash)
Oct 23 22:12:20 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 22:12:20 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:611c6e03-d496-441e-9535-d9f51ebd8824 -p 172.16.0.220:3260 --login {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:12:21 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:611c6e03-d496-441e-9535-d9f51ebd8824 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:12:21 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[92947121-0426-4e04-858d-af6481fc855a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:611c6e03-d496-441e-9535-d9f51ebd8824, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:611c6e03-d496-441e-9535-d9f51ebd8824, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:12:21 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa569324-c348-4e4c-adef-c086733682df tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:611c6e03-d496-441e-9535-d9f51ebd8824, portal: 172.16.0.220,3260]
Oct 23 22:12:21 user nova-compute[74337]: Login to [iface: default, target: iqn.2010-10.org.openstack:611c6e03-d496-441e-9535-d9f51ebd8824, portal: 172.16.0.220,3260] successful.
Oct 23 22:12:21 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:12:21 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:611c6e03-d496-441e-9535-d9f51ebd8824 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:12:21 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:611c6e03-d496-441e-9535-d9f51ebd8824 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:12:21 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ab85f8-b444-45ca-8171-df6e8d106016]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:12:21 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa569324-c348-4e4c-adef-c086733682df tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:12:21 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:12:21 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:12:21 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e3f52d1-bedb-40bd-9030-6a06a28429f7]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485637f5-7429-4020-83b7-1156be9d013f (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611c6e03-d496-441e-9535-d9f51ebd8824 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:12:21 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa569324-c348-4e4c-adef-c086733682df tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485637f5-7429-4020-83b7-1156be9d013f (non-flash)
Oct 23 22:12:21 user nova-compute[74337]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611c6e03-d496-441e-9535-d9f51ebd8824 (non-flash)
Oct 23 22:12:21 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 22:12:21 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa569324-c348-4e4c-adef-c086733682df tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485637f5-7429-4020-83b7-1156be9d013f (non-flash)
Oct 23 22:12:21 user nova-compute[74337]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611c6e03-d496-441e-9535-d9f51ebd8824 (non-flash)
Oct 23 22:12:21 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 22:12:21 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-fa569324-c348-4e4c-adef-c086733682df tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:611c6e03-d496-441e-9535-d9f51ebd8824" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 22:12:21 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa569324-c348-4e4c-adef-c086733682df tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Connected to 172.16.0.220:3260 {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 22:12:21 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-fa569324-c348-4e4c-adef-c086733682df tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] HCTL ('34', '-', '-', 0) found on session 55 with lun 0 {{(pid=74337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 22:12:21 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-fa569324-c348-4e4c-adef-c086733682df tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 22:12:21 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:12:21 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:12:21 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c08287b-5d53-46bf-9e50-37a0542a3f83]: (4, ('- - 0', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:12:21 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-fa569324-c348-4e4c-adef-c086733682df tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Searching for a device in session 55 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 22:12:21 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa569324-c348-4e4c-adef-c086733682df tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:611c6e03-d496-441e-9535-d9f51ebd8824', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PyNsRuOF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 22:12:22 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-fa569324-c348-4e4c-adef-c086733682df tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 22:12:22 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa569324-c348-4e4c-adef-c086733682df tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '23037666533303865', 'path': '/dev/sdc'} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 22:12:22 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa569324-c348-4e4c-adef-c086733682df tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] [instance: a6aee021-df0b-4ada-9f82-8df7486dc869] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23037666533303865', 'path': '/dev/sdc'} {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 22:12:22 user nova-compute[74337]: DEBUG nova.objects.instance [None req-fa569324-c348-4e4c-adef-c086733682df tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Lazy-loading 'flavor' on Instance uuid a6aee021-df0b-4ada-9f82-8df7486dc869 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:12:22 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-fa569324-c348-4e4c-adef-c086733682df tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 22:12:22 user nova-compute[74337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 22:12:22 user nova-compute[74337]:   <source dev="/dev/sdc"/>
Oct 23 22:12:22 user nova-compute[74337]:   <target dev="vdb" bus="virtio"/>
Oct 23 22:12:22 user nova-compute[74337]:   <serial>611c6e03-d496-441e-9535-d9f51ebd8824</serial>
Oct 23 22:12:22 user nova-compute[74337]: </disk>
Oct 23 22:12:22 user nova-compute[74337]:  {{(pid=74337) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 22:12:22 user nova-compute[74337]: DEBUG nova.compute.manager [req-09ef0cfd-4d5b-471d-852e-907b121de748 req-5df37c1d-375a-4324-b110-e0f3fac7f439 service nova] [instance: 38bdf4aa-052a-4638-ac28-757c835aef04] Received event network-changed-9de01666-1235-499a-9a57-a6e4a7ca6291 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:12:22 user nova-compute[74337]: DEBUG nova.compute.manager [req-09ef0cfd-4d5b-471d-852e-907b121de748 req-5df37c1d-375a-4324-b110-e0f3fac7f439 service nova] [instance: 38bdf4aa-052a-4638-ac28-757c835aef04] Refreshing instance network info cache due to event network-changed-9de01666-1235-499a-9a57-a6e4a7ca6291. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 22:12:22 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-09ef0cfd-4d5b-471d-852e-907b121de748 req-5df37c1d-375a-4324-b110-e0f3fac7f439 service nova] Acquiring lock "refresh_cache-38bdf4aa-052a-4638-ac28-757c835aef04" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 22:12:22 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-09ef0cfd-4d5b-471d-852e-907b121de748 req-5df37c1d-375a-4324-b110-e0f3fac7f439 service nova] Acquired lock "refresh_cache-38bdf4aa-052a-4638-ac28-757c835aef04" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 22:12:22 user nova-compute[74337]: DEBUG nova.network.neutron [req-09ef0cfd-4d5b-471d-852e-907b121de748 req-5df37c1d-375a-4324-b110-e0f3fac7f439 service nova] [instance: 38bdf4aa-052a-4638-ac28-757c835aef04] Refreshing network info cache for port 9de01666-1235-499a-9a57-a6e4a7ca6291 {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 22:12:22 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-c07558c6-4c20-41c9-a0e2-8a15fdaa384d tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Acquiring lock "38bdf4aa-052a-4638-ac28-757c835aef04" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:12:22 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-c07558c6-4c20-41c9-a0e2-8a15fdaa384d tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Lock "38bdf4aa-052a-4638-ac28-757c835aef04" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:12:22 user nova-compute[74337]: DEBUG nova.objects.instance [None req-c07558c6-4c20-41c9-a0e2-8a15fdaa384d tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Lazy-loading 'flavor' on Instance uuid 38bdf4aa-052a-4638-ac28-757c835aef04 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:12:22 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-c07558c6-4c20-41c9-a0e2-8a15fdaa384d tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] [instance: 38bdf4aa-052a-4638-ac28-757c835aef04] Ignoring supplied device name: /dev/vdb
Oct 23 22:12:22 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-c07558c6-4c20-41c9-a0e2-8a15fdaa384d tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Lock "38bdf4aa-052a-4638-ac28-757c835aef04" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:12:22 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-fa569324-c348-4e4c-adef-c086733682df tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] No BDM found with device name vda, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 22:12:22 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-fa569324-c348-4e4c-adef-c086733682df tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 22:12:22 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-fa569324-c348-4e4c-adef-c086733682df tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] No VIF found with MAC fa:16:3e:41:c4:f2, not building metadata {{(pid=74337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 22:12:22 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-c07558c6-4c20-41c9-a0e2-8a15fdaa384d tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Acquiring lock "38bdf4aa-052a-4638-ac28-757c835aef04" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:12:22 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-c07558c6-4c20-41c9-a0e2-8a15fdaa384d tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Lock "38bdf4aa-052a-4638-ac28-757c835aef04" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:12:22 user nova-compute[74337]: INFO nova.compute.manager [None req-c07558c6-4c20-41c9-a0e2-8a15fdaa384d tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] [instance: 38bdf4aa-052a-4638-ac28-757c835aef04] Attaching volume 7302c940-8b88-4869-a483-e46ab7371e89 to /dev/vdb
Oct 23 22:12:22 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-fa569324-c348-4e4c-adef-c086733682df tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Lock "a6aee021-df0b-4ada-9f82-8df7486dc869" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.847s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:12:22 user nova-compute[74337]: DEBUG os_brick.utils [None req-c07558c6-4c20-41c9-a0e2-8a15fdaa384d tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 22:12:22 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:12:22 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:12:22 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd2696a-2273-4dd3-bc3a-90baaa99cb50]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f34011b66e40\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:12:22 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:12:22 user nova-compute[74337]: DEBUG nova.network.neutron [req-09ef0cfd-4d5b-471d-852e-907b121de748 req-5df37c1d-375a-4324-b110-e0f3fac7f439 service nova] [instance: 38bdf4aa-052a-4638-ac28-757c835aef04] Updated VIF entry in instance network info cache for port 9de01666-1235-499a-9a57-a6e4a7ca6291. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 22:12:22 user nova-compute[74337]: DEBUG nova.network.neutron [req-09ef0cfd-4d5b-471d-852e-907b121de748 req-5df37c1d-375a-4324-b110-e0f3fac7f439 service nova] [instance: 38bdf4aa-052a-4638-ac28-757c835aef04] Updating instance_info_cache with network_info: [{"id": "9de01666-1235-499a-9a57-a6e4a7ca6291", "address": "fa:16:3e:04:b1:de", "network": {"id": "86669102-0490-4fe4-aba4-8a353e91a763", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1218528793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799c72bbb3e248b99463567aba2049db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9de01666-12", "ovs_interfaceid": "9de01666-1235-499a-9a57-a6e4a7ca6291", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 22:12:22 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:12:22 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[98449b24-d186-4ede-9a91-a01c18c72cad]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:12:22 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:12:22 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:12:22 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[7611bf11-8fe8-4ee9-9609-84a28608cd2f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:12:22 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-09ef0cfd-4d5b-471d-852e-907b121de748 req-5df37c1d-375a-4324-b110-e0f3fac7f439 service nova] Releasing lock "refresh_cache-38bdf4aa-052a-4638-ac28-757c835aef04" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 22:12:22 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[42fc823a-09d6-4635-b9de-4f4e70c8c0d2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:12:22 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-c07558c6-4c20-41c9-a0e2-8a15fdaa384d tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Running cmd (subprocess): nvme version {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:12:22 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-c07558c6-4c20-41c9-a0e2-8a15fdaa384d tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] 'nvme version' failed. Not Retrying. {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 22:12:22 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c07558c6-4c20-41c9-a0e2-8a15fdaa384d tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] nvme not present on system {{(pid=74337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 22:12:22 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:12:23 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 22:12:23 user nova-compute[74337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 22:12:23 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f78ae82-fbe4-471d-a619-34ba835ff199]: (4, '') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:12:23 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-c07558c6-4c20-41c9-a0e2-8a15fdaa384d tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 22:12:23 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-c07558c6-4c20-41c9-a0e2-8a15fdaa384d tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 22:12:23 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-c07558c6-4c20-41c9-a0e2-8a15fdaa384d tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] LIGHTOS: no hostnqn found. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 22:12:23 user nova-compute[74337]: DEBUG os_brick.utils [None req-c07558c6-4c20-41c9-a0e2-8a15fdaa384d tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f34011b66e40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 22:12:23 user nova-compute[74337]: DEBUG nova.virt.block_device [None req-c07558c6-4c20-41c9-a0e2-8a15fdaa384d tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] [instance: 38bdf4aa-052a-4638-ac28-757c835aef04] Updating existing volume attachment record: b56e2a1d-7c9e-456b-b973-7491e5c7144a {{(pid=74337) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 22:12:24 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:12:24 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:12:24 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-0118039a-c1b3-4967-ba2a-f6893c845c6e tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Acquiring lock "a6aee021-df0b-4ada-9f82-8df7486dc869" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:12:24 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-0118039a-c1b3-4967-ba2a-f6893c845c6e tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Lock "a6aee021-df0b-4ada-9f82-8df7486dc869" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:12:24 user nova-compute[74337]: INFO nova.compute.manager [None req-0118039a-c1b3-4967-ba2a-f6893c845c6e tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] [instance: a6aee021-df0b-4ada-9f82-8df7486dc869] Detaching volume 611c6e03-d496-441e-9535-d9f51ebd8824
Oct 23 22:12:24 user nova-compute[74337]: INFO nova.virt.block_device [None req-0118039a-c1b3-4967-ba2a-f6893c845c6e tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] [instance: a6aee021-df0b-4ada-9f82-8df7486dc869] Attempting to driver detach volume 611c6e03-d496-441e-9535-d9f51ebd8824 from mountpoint /dev/vdb
Oct 23 22:12:24 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-0118039a-c1b3-4967-ba2a-f6893c845c6e tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Attempting to detach device vdb from instance a6aee021-df0b-4ada-9f82-8df7486dc869 from the persistent domain config. {{(pid=74337) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 22:12:24 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-0118039a-c1b3-4967-ba2a-f6893c845c6e tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 22:12:24 user nova-compute[74337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 22:12:24 user nova-compute[74337]:   <source dev="/dev/sdc"/>
Oct 23 22:12:24 user nova-compute[74337]:   <target dev="vdb" bus="virtio"/>
Oct 23 22:12:24 user nova-compute[74337]:   <serial>611c6e03-d496-441e-9535-d9f51ebd8824</serial>
Oct 23 22:12:24 user nova-compute[74337]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 22:12:24 user nova-compute[74337]: </disk>
Oct 23 22:12:24 user nova-compute[74337]:  {{(pid=74337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 22:12:24 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-0118039a-c1b3-4967-ba2a-f6893c845c6e tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Successfully detached device vdb from instance a6aee021-df0b-4ada-9f82-8df7486dc869 from the persistent domain config.
Oct 23 22:12:24 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-0118039a-c1b3-4967-ba2a-f6893c845c6e tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a6aee021-df0b-4ada-9f82-8df7486dc869 from the live domain config. {{(pid=74337) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 22:12:24 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-0118039a-c1b3-4967-ba2a-f6893c845c6e tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 22:12:24 user nova-compute[74337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 22:12:24 user nova-compute[74337]:   <source dev="/dev/sdc"/>
Oct 23 22:12:24 user nova-compute[74337]:   <target dev="vdb" bus="virtio"/>
Oct 23 22:12:24 user nova-compute[74337]:   <serial>611c6e03-d496-441e-9535-d9f51ebd8824</serial>
Oct 23 22:12:24 user nova-compute[74337]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 22:12:24 user nova-compute[74337]: </disk>
Oct 23 22:12:24 user nova-compute[74337]:  {{(pid=74337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 22:12:25 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-0118039a-c1b3-4967-ba2a-f6893c845c6e tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a6aee021-df0b-4ada-9f82-8df7486dc869 {{(pid=74337) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 22:12:26 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:12:26 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 22:12:29 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:12:29 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:12:29 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:12:29 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:12:32 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:12:33 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:12:33 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:12:34 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:12:34 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:12:35 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:12:35 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:12:35 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:12:35 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:12:35 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Auditing locally available compute resources for user (node: user) {{(pid=74337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 22:12:35 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/999843b2-b757-480b-bd21-bf281954bc46/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:12:35 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/999843b2-b757-480b-bd21-bf281954bc46/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:12:35 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/999843b2-b757-480b-bd21-bf281954bc46/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:12:35 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/999843b2-b757-480b-bd21-bf281954bc46/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:12:35 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6aee021-df0b-4ada-9f82-8df7486dc869/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:12:36 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6aee021-df0b-4ada-9f82-8df7486dc869/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:12:36 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6aee021-df0b-4ada-9f82-8df7486dc869/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:12:36 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6aee021-df0b-4ada-9f82-8df7486dc869/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:12:36 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61fe098a-5958-4ad1-8f92-4592809299b7/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:12:36 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61fe098a-5958-4ad1-8f92-4592809299b7/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:12:36 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61fe098a-5958-4ad1-8f92-4592809299b7/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:12:36 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61fe098a-5958-4ad1-8f92-4592809299b7/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:12:36 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 22:12:36 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/106da458-caec-4114-8904-0411ec0ea903/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:12:36 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/106da458-caec-4114-8904-0411ec0ea903/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:12:36 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/106da458-caec-4114-8904-0411ec0ea903/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:12:37 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/106da458-caec-4114-8904-0411ec0ea903/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:12:37 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk.rescue --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:12:37 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:12:37 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk.rescue --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:12:37 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk.rescue --force-share --output=json" returned: 0 in 0.212s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:12:37 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:12:37 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:12:37 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:12:37 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:12:37 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38bdf4aa-052a-4638-ac28-757c835aef04/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:12:38 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38bdf4aa-052a-4638-ac28-757c835aef04/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:12:38 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38bdf4aa-052a-4638-ac28-757c835aef04/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:12:38 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38bdf4aa-052a-4638-ac28-757c835aef04/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:12:38 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:12:38 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:12:38 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Hypervisor/Node resource view: name=user free_ram=8340MB free_disk=24.991165161132812GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 22:12:38 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:12:38 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:12:38 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 0323b854-c7a1-42e8-ad85-1e929caa6e9d has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Oct 23 22:12:38 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 999843b2-b757-480b-bd21-bf281954bc46 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 22:12:38 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 27710919-a717-42fa-a436-a261d92c1c2a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 22:12:38 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 106da458-caec-4114-8904-0411ec0ea903 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 22:12:38 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 61fe098a-5958-4ad1-8f92-4592809299b7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 22:12:38 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance a6aee021-df0b-4ada-9f82-8df7486dc869 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 22:12:38 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 38bdf4aa-052a-4638-ac28-757c835aef04 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 22:12:38 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 22:12:38 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 22:12:39 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 22:12:39 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 22:12:39 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Compute_service record updated for user:user {{(pid=74337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 22:12:39 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.380s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:12:39 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:12:39 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:12:39 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c07558c6-4c20-41c9-a0e2-8a15fdaa384d tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] [instance: 38bdf4aa-052a-4638-ac28-757c835aef04] Calling os-brick to attach iSCSI Volume {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 22:12:39 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c07558c6-4c20-41c9-a0e2-8a15fdaa384d tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7302c940-8b88-4869-a483-e46ab7371e89', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vCqYiTaB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 22:12:39 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-c07558c6-4c20-41c9-a0e2-8a15fdaa384d tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 22:12:39 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-c07558c6-4c20-41c9-a0e2-8a15fdaa384d tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 22:12:39 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-c07558c6-4c20-41c9-a0e2-8a15fdaa384d tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 22:12:39 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-c07558c6-4c20-41c9-a0e2-8a15fdaa384d tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 22:12:39 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-c07558c6-4c20-41c9-a0e2-8a15fdaa384d tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7302c940-8b88-4869-a483-e46ab7371e89" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 22:12:39 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-c07558c6-4c20-41c9-a0e2-8a15fdaa384d tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7302c940-8b88-4869-a483-e46ab7371e89" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 22:12:39 user nova-compute[74337]: INFO os_brick.initiator.connectors.iscsi [None req-c07558c6-4c20-41c9-a0e2-8a15fdaa384d tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 22:12:39 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7302c940-8b88-4869-a483-e46ab7371e89 -p 172.16.0.220:3260 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:12:39 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7302c940-8b88-4869-a483-e46ab7371e89 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:12:39 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8fc6365-1ae8-40f6-a43c-66ba148c624c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:12:39 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c07558c6-4c20-41c9-a0e2-8a15fdaa384d tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 22:12:39 user nova-compute[74337]:  {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:12:39 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7302c940-8b88-4869-a483-e46ab7371e89 -p 172.16.0.220:3260 --interface default --op new {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:12:39 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7302c940-8b88-4869-a483-e46ab7371e89 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:12:39 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c390284e-5768-4ba9-8b59-111b8eb1f377]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7302c940-8b88-4869-a483-e46ab7371e89] added\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:12:39 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c07558c6-4c20-41c9-a0e2-8a15fdaa384d tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7302c940-8b88-4869-a483-e46ab7371e89] added
Oct 23 22:12:39 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:12:39 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7302c940-8b88-4869-a483-e46ab7371e89 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:12:39 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7302c940-8b88-4869-a483-e46ab7371e89 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:12:39 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d892d3c-6385-49f8-8644-39dc36e6db74]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:12:39 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c07558c6-4c20-41c9-a0e2-8a15fdaa384d tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:12:39 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7302c940-8b88-4869-a483-e46ab7371e89 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:12:39 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7302c940-8b88-4869-a483-e46ab7371e89 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:12:39 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b7c963-f2de-4aee-84cc-054d41dc8031]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:12:39 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c07558c6-4c20-41c9-a0e2-8a15fdaa384d tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:12:39 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7302c940-8b88-4869-a483-e46ab7371e89 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vCqYiTaB {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:12:39 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7302c940-8b88-4869-a483-e46ab7371e89 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vCqYiTaB" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:12:39 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ee6084-ab97-479c-9e26-7f2d202a29d1]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:12:39 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c07558c6-4c20-41c9-a0e2-8a15fdaa384d tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vCqYiTaB'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:12:39 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7302c940-8b88-4869-a483-e46ab7371e89 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:12:39 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7302c940-8b88-4869-a483-e46ab7371e89 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:12:39 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[72fa8e33-98f3-4e3b-bb0b-be9a26f51ae5]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:12:39 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c07558c6-4c20-41c9-a0e2-8a15fdaa384d tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:12:39 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:12:39 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:12:39 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4c7e40f-41de-461f-a6ef-3ab936d2caaf]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485637f5-7429-4020-83b7-1156be9d013f (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611c6e03-d496-441e-9535-d9f51ebd8824 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:12:39 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c07558c6-4c20-41c9-a0e2-8a15fdaa384d tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485637f5-7429-4020-83b7-1156be9d013f (non-flash)
Oct 23 22:12:39 user nova-compute[74337]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611c6e03-d496-441e-9535-d9f51ebd8824 (non-flash)
Oct 23 22:12:39 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 22:12:39 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c07558c6-4c20-41c9-a0e2-8a15fdaa384d tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485637f5-7429-4020-83b7-1156be9d013f (non-flash)
Oct 23 22:12:39 user nova-compute[74337]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611c6e03-d496-441e-9535-d9f51ebd8824 (non-flash)
Oct 23 22:12:39 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 22:12:39 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7302c940-8b88-4869-a483-e46ab7371e89 -p 172.16.0.220:3260 --login {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:12:40 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7302c940-8b88-4869-a483-e46ab7371e89 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:12:40 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[f68f7762-71ed-4e24-bb91-be7ece914e67]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7302c940-8b88-4869-a483-e46ab7371e89, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7302c940-8b88-4869-a483-e46ab7371e89, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:12:40 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c07558c6-4c20-41c9-a0e2-8a15fdaa384d tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7302c940-8b88-4869-a483-e46ab7371e89, portal: 172.16.0.220,3260]
Oct 23 22:12:40 user nova-compute[74337]: Login to [iface: default, target: iqn.2010-10.org.openstack:7302c940-8b88-4869-a483-e46ab7371e89, portal: 172.16.0.220,3260] successful.
Oct 23 22:12:40 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:12:40 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7302c940-8b88-4869-a483-e46ab7371e89 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:12:40 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7302c940-8b88-4869-a483-e46ab7371e89 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:12:40 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e53413cf-7178-42fd-84b0-3a6bca2f2e6d]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:12:40 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c07558c6-4c20-41c9-a0e2-8a15fdaa384d tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:12:40 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:12:40 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:12:40 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[1879075f-c7c6-4a6a-95ce-f0801f6b744e]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485637f5-7429-4020-83b7-1156be9d013f (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611c6e03-d496-441e-9535-d9f51ebd8824 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7302c940-8b88-4869-a483-e46ab7371e89 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:12:40 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c07558c6-4c20-41c9-a0e2-8a15fdaa384d tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485637f5-7429-4020-83b7-1156be9d013f (non-flash)
Oct 23 22:12:40 user nova-compute[74337]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611c6e03-d496-441e-9535-d9f51ebd8824 (non-flash)
Oct 23 22:12:40 user nova-compute[74337]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7302c940-8b88-4869-a483-e46ab7371e89 (non-flash)
Oct 23 22:12:40 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 22:12:40 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c07558c6-4c20-41c9-a0e2-8a15fdaa384d tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485637f5-7429-4020-83b7-1156be9d013f (non-flash)
Oct 23 22:12:40 user nova-compute[74337]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611c6e03-d496-441e-9535-d9f51ebd8824 (non-flash)
Oct 23 22:12:40 user nova-compute[74337]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7302c940-8b88-4869-a483-e46ab7371e89 (non-flash)
Oct 23 22:12:40 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 22:12:40 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-c07558c6-4c20-41c9-a0e2-8a15fdaa384d tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7302c940-8b88-4869-a483-e46ab7371e89" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 22:12:40 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c07558c6-4c20-41c9-a0e2-8a15fdaa384d tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Connected to 172.16.0.220:3260 {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 22:12:40 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-c07558c6-4c20-41c9-a0e2-8a15fdaa384d tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] HCTL ('35', '-', '-', 0) found on session 56 with lun 0 {{(pid=74337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 22:12:40 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-c07558c6-4c20-41c9-a0e2-8a15fdaa384d tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 22:12:40 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:12:40 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:12:40 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[651b559a-b507-4ffe-813d-f8b53f0e081e]: (4, ('- - 0', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:12:40 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-c07558c6-4c20-41c9-a0e2-8a15fdaa384d tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Searching for a device in session 56 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 22:12:40 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c07558c6-4c20-41c9-a0e2-8a15fdaa384d tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:7302c940-8b88-4869-a483-e46ab7371e89', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vCqYiTaB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 22:12:40 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:12:40 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:12:40 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Starting heal instance info cache {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 22:12:40 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "refresh_cache-106da458-caec-4114-8904-0411ec0ea903" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 22:12:40 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquired lock "refresh_cache-106da458-caec-4114-8904-0411ec0ea903" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 22:12:40 user nova-compute[74337]: DEBUG nova.network.neutron [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 106da458-caec-4114-8904-0411ec0ea903] Forcefully refreshing network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 22:12:40 user nova-compute[74337]: DEBUG nova.network.neutron [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 106da458-caec-4114-8904-0411ec0ea903] Updating instance_info_cache with network_info: [{"id": "7a60434b-7f31-4b05-a494-97e58e72a5c1", "address": "fa:16:3e:ea:23:b1", "network": {"id": "09783701-f9c4-4d08-8523-6e363a558ec0", "bridge": "br-int", "label": "tempest-TestStampPattern-974584378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc044020751d475b94e96fcedb97b86c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a60434b-7f", "ovs_interfaceid": "7a60434b-7f31-4b05-a494-97e58e72a5c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 22:12:40 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Releasing lock "refresh_cache-106da458-caec-4114-8904-0411ec0ea903" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 22:12:40 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 106da458-caec-4114-8904-0411ec0ea903] Updated the network info_cache for instance {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 22:12:41 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-c07558c6-4c20-41c9-a0e2-8a15fdaa384d tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 22:12:41 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-c07558c6-4c20-41c9-a0e2-8a15fdaa384d tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '23264313134333564', 'path': '/dev/sdd'} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 22:12:41 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c07558c6-4c20-41c9-a0e2-8a15fdaa384d tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] [instance: 38bdf4aa-052a-4638-ac28-757c835aef04] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23264313134333564', 'path': '/dev/sdd'} {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 22:12:41 user nova-compute[74337]: DEBUG nova.objects.instance [None req-c07558c6-4c20-41c9-a0e2-8a15fdaa384d tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Lazy-loading 'flavor' on Instance uuid 38bdf4aa-052a-4638-ac28-757c835aef04 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:12:41 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-c07558c6-4c20-41c9-a0e2-8a15fdaa384d tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 22:12:41 user nova-compute[74337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 22:12:41 user nova-compute[74337]:   <source dev="/dev/sdd"/>
Oct 23 22:12:41 user nova-compute[74337]:   <target dev="vdb" bus="virtio"/>
Oct 23 22:12:41 user nova-compute[74337]:   <serial>7302c940-8b88-4869-a483-e46ab7371e89</serial>
Oct 23 22:12:41 user nova-compute[74337]: </disk>
Oct 23 22:12:41 user nova-compute[74337]:  {{(pid=74337) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 22:12:41 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-c07558c6-4c20-41c9-a0e2-8a15fdaa384d tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] No BDM found with device name vda, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 22:12:41 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-c07558c6-4c20-41c9-a0e2-8a15fdaa384d tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 22:12:41 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-c07558c6-4c20-41c9-a0e2-8a15fdaa384d tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] No VIF found with MAC fa:16:3e:04:b1:de, not building metadata {{(pid=74337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 22:12:41 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-c07558c6-4c20-41c9-a0e2-8a15fdaa384d tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Lock "38bdf4aa-052a-4638-ac28-757c835aef04" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.879s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:12:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:12:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:12:45 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-0118039a-c1b3-4967-ba2a-f6893c845c6e tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a6aee021-df0b-4ada-9f82-8df7486dc869 is timed out.
Oct 23 22:12:45 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-0118039a-c1b3-4967-ba2a-f6893c845c6e tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Successfully detached device vdb from instance a6aee021-df0b-4ada-9f82-8df7486dc869 from the live domain config.
Oct 23 22:12:45 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0118039a-c1b3-4967-ba2a-f6893c845c6e tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] [instance: a6aee021-df0b-4ada-9f82-8df7486dc869] calling os-brick to detach iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 22:12:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0118039a-c1b3-4967-ba2a-f6893c845c6e tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, {'target_iqn': 'iqn.2010-10.org.openstack:611c6e03-d496-441e-9535-d9f51ebd8824', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PyNsRuOF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 22:12:45 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-0118039a-c1b3-4967-ba2a-f6893c845c6e tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 22:12:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-0118039a-c1b3-4967-ba2a-f6893c845c6e tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 22:12:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-0118039a-c1b3-4967-ba2a-f6893c845c6e tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 22:12:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:12:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:12:45 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[55b68fad-d09a-45e1-9b55-06e2a6a183a4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:485637f5-7429-4020-83b7-1156be9d013f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7302c940-8b88-4869-a483-e46ab7371e89\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:611c6e03-d496-441e-9535-d9f51ebd8824\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:12:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0118039a-c1b3-4967-ba2a-f6893c845c6e tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 22:12:45 user nova-compute[74337]: No targets found.
Oct 23 22:12:45 user nova-compute[74337]: iSNS:
Oct 23 22:12:45 user nova-compute[74337]: No targets found.
Oct 23 22:12:45 user nova-compute[74337]: STATIC:
Oct 23 22:12:45 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:485637f5-7429-4020-83b7-1156be9d013f
Oct 23 22:12:45 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 22:12:45 user nova-compute[74337]:                 Iface Name: default
Oct 23 22:12:45 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:7302c940-8b88-4869-a483-e46ab7371e89
Oct 23 22:12:45 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 22:12:45 user nova-compute[74337]:                 Iface Name: default
Oct 23 22:12:45 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:611c6e03-d496-441e-9535-d9f51ebd8824
Oct 23 22:12:45 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 22:12:45 user nova-compute[74337]:                 Iface Name: default
Oct 23 22:12:45 user nova-compute[74337]: FIRMWARE:
Oct 23 22:12:45 user nova-compute[74337]: No targets found.
Oct 23 22:12:45 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 22:12:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0118039a-c1b3-4967-ba2a-f6893c845c6e tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 22:12:45 user nova-compute[74337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 22:12:45 user nova-compute[74337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 22:12:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0118039a-c1b3-4967-ba2a-f6893c845c6e tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:611c6e03-d496-441e-9535-d9f51ebd8824', 0)] {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 22:12:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:12:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:12:45 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[16546077-26eb-406b-8fff-0b0aa2789656]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:485637f5-7429-4020-83b7-1156be9d013f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:611c6e03-d496-441e-9535-d9f51ebd8824\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7302c940-8b88-4869-a483-e46ab7371e89\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:12:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:12:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:12:45 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[7409fba4-e9bc-4b39-b3c3-f83019fabfbe]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485637f5-7429-4020-83b7-1156be9d013f (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611c6e03-d496-441e-9535-d9f51ebd8824 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7302c940-8b88-4869-a483-e46ab7371e89 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:12:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0118039a-c1b3-4967-ba2a-f6893c845c6e tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485637f5-7429-4020-83b7-1156be9d013f (non-flash)
Oct 23 22:12:45 user nova-compute[74337]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611c6e03-d496-441e-9535-d9f51ebd8824 (non-flash)
Oct 23 22:12:45 user nova-compute[74337]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7302c940-8b88-4869-a483-e46ab7371e89 (non-flash)
Oct 23 22:12:45 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 22:12:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0118039a-c1b3-4967-ba2a-f6893c845c6e tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485637f5-7429-4020-83b7-1156be9d013f (non-flash)
Oct 23 22:12:45 user nova-compute[74337]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611c6e03-d496-441e-9535-d9f51ebd8824 (non-flash)
Oct 23 22:12:45 user nova-compute[74337]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7302c940-8b88-4869-a483-e46ab7371e89 (non-flash)
Oct 23 22:12:45 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 22:12:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0118039a-c1b3-4967-ba2a-f6893c845c6e tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5eec1ba0e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:611c6e03-d496-441e-9535-d9f51ebd8824'): ({'sdc'}, set())}) {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 22:12:45 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-0118039a-c1b3-4967-ba2a-f6893c845c6e tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Removing single pathed devices sdc {{(pid=74337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 22:12:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:12:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:12:45 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b93b4a99-870f-4049-b050-def5aee3b502]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:12:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:12:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:12:45 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ea7465c-4d4c-40ed-85ed-79825333f2a7]: (4, ('ok\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:12:45 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-0118039a-c1b3-4967-ba2a-f6893c845c6e tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Flushing IO for device /dev/sdc {{(pid=74337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 22:12:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:12:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:12:45 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[488707de-0e2d-4769-9756-1a3993d5eee3]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:12:45 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-0118039a-c1b3-4967-ba2a-f6893c845c6e tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 22:12:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:12:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:12:45 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[90957ab9-6d8d-49e1-a53c-6c134d5f951f]: (4, ('1', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:12:45 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-0118039a-c1b3-4967-ba2a-f6893c845c6e tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 22:12:45 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-0118039a-c1b3-4967-ba2a-f6893c845c6e tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] SCSI volumes sdc have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 22:12:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0118039a-c1b3-4967-ba2a-f6893c845c6e tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:611c6e03-d496-441e-9535-d9f51ebd8824')] {{(pid=74337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 22:12:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:611c6e03-d496-441e-9535-d9f51ebd8824 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:12:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:611c6e03-d496-441e-9535-d9f51ebd8824 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:12:45 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[982a5aa0-a8a4-4857-a394-75ff1cc75317]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:12:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0118039a-c1b3-4967-ba2a-f6893c845c6e tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:12:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:611c6e03-d496-441e-9535-d9f51ebd8824 -p 172.16.0.220:3260 --logout {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:12:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:611c6e03-d496-441e-9535-d9f51ebd8824 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:12:45 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[29aca135-c24d-493a-8954-37eb7bdff927]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:611c6e03-d496-441e-9535-d9f51ebd8824, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:611c6e03-d496-441e-9535-d9f51ebd8824, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:12:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0118039a-c1b3-4967-ba2a-f6893c845c6e tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:611c6e03-d496-441e-9535-d9f51ebd8824, portal: 172.16.0.220,3260]
Oct 23 22:12:45 user nova-compute[74337]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:611c6e03-d496-441e-9535-d9f51ebd8824, portal: 172.16.0.220,3260] successful.
Oct 23 22:12:45 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:12:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:611c6e03-d496-441e-9535-d9f51ebd8824 -p 172.16.0.220:3260 --op delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:12:45 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:611c6e03-d496-441e-9535-d9f51ebd8824 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:12:45 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[8923c130-6016-4105-924f-986ba199261f]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:12:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0118039a-c1b3-4967-ba2a-f6893c845c6e tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:12:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-0118039a-c1b3-4967-ba2a-f6893c845c6e tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 22:12:45 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-0118039a-c1b3-4967-ba2a-f6893c845c6e tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] <== disconnect_volume: return (314ms) None {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 22:12:45 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0118039a-c1b3-4967-ba2a-f6893c845c6e tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] [instance: a6aee021-df0b-4ada-9f82-8df7486dc869] Disconnected iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 22:12:49 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:12:49 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:12:51 user nova-compute[74337]: DEBUG nova.objects.instance [None req-0118039a-c1b3-4967-ba2a-f6893c845c6e tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Lazy-loading 'flavor' on Instance uuid a6aee021-df0b-4ada-9f82-8df7486dc869 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:12:51 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-0118039a-c1b3-4967-ba2a-f6893c845c6e tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Lock "a6aee021-df0b-4ada-9f82-8df7486dc869" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 27.167s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:12:54 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:12:54 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:12:59 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:13:04 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:13:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:13:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:13:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 22:13:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 22:13:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 22:13:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:13:14 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:13:15 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:13:15 user nova-compute[74337]: DEBUG nova.compute.manager [req-576b7873-6999-444f-8339-a78590be067d req-d91b1ae3-3847-4d70-8c64-a50ea12b2653 service nova] [instance: a6aee021-df0b-4ada-9f82-8df7486dc869] Received event network-changed-7de2dfea-ae8f-4aab-8f6c-06eb8a86f1ec {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:13:15 user nova-compute[74337]: DEBUG nova.compute.manager [req-576b7873-6999-444f-8339-a78590be067d req-d91b1ae3-3847-4d70-8c64-a50ea12b2653 service nova] [instance: a6aee021-df0b-4ada-9f82-8df7486dc869] Refreshing instance network info cache due to event network-changed-7de2dfea-ae8f-4aab-8f6c-06eb8a86f1ec. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 22:13:15 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-576b7873-6999-444f-8339-a78590be067d req-d91b1ae3-3847-4d70-8c64-a50ea12b2653 service nova] Acquiring lock "refresh_cache-a6aee021-df0b-4ada-9f82-8df7486dc869" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 22:13:15 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-576b7873-6999-444f-8339-a78590be067d req-d91b1ae3-3847-4d70-8c64-a50ea12b2653 service nova] Acquired lock "refresh_cache-a6aee021-df0b-4ada-9f82-8df7486dc869" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 22:13:15 user nova-compute[74337]: DEBUG nova.network.neutron [req-576b7873-6999-444f-8339-a78590be067d req-d91b1ae3-3847-4d70-8c64-a50ea12b2653 service nova] [instance: a6aee021-df0b-4ada-9f82-8df7486dc869] Refreshing network info cache for port 7de2dfea-ae8f-4aab-8f6c-06eb8a86f1ec {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 22:13:15 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-38a2895a-78ee-46d6-99ba-63936bad3a61 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Acquiring lock "a6aee021-df0b-4ada-9f82-8df7486dc869" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:13:15 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-38a2895a-78ee-46d6-99ba-63936bad3a61 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Lock "a6aee021-df0b-4ada-9f82-8df7486dc869" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:13:15 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-38a2895a-78ee-46d6-99ba-63936bad3a61 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Acquiring lock "a6aee021-df0b-4ada-9f82-8df7486dc869-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:13:15 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-38a2895a-78ee-46d6-99ba-63936bad3a61 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Lock "a6aee021-df0b-4ada-9f82-8df7486dc869-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:13:15 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-38a2895a-78ee-46d6-99ba-63936bad3a61 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Lock "a6aee021-df0b-4ada-9f82-8df7486dc869-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:13:15 user nova-compute[74337]: INFO nova.compute.manager [None req-38a2895a-78ee-46d6-99ba-63936bad3a61 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] [instance: a6aee021-df0b-4ada-9f82-8df7486dc869] Terminating instance
Oct 23 22:13:15 user nova-compute[74337]: DEBUG nova.compute.manager [None req-38a2895a-78ee-46d6-99ba-63936bad3a61 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] [instance: a6aee021-df0b-4ada-9f82-8df7486dc869] Start destroying the instance on the hypervisor. {{(pid=74337) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 22:13:15 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:13:15 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:13:15 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:13:15 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:13:16 user nova-compute[74337]: DEBUG nova.compute.manager [req-f960193a-0215-479d-b265-9befa42766aa req-250253f9-f114-43b9-a35c-d32d31a171c7 service nova] [instance: a6aee021-df0b-4ada-9f82-8df7486dc869] Received event network-vif-unplugged-7de2dfea-ae8f-4aab-8f6c-06eb8a86f1ec {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:13:16 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-f960193a-0215-479d-b265-9befa42766aa req-250253f9-f114-43b9-a35c-d32d31a171c7 service nova] Acquiring lock "a6aee021-df0b-4ada-9f82-8df7486dc869-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:13:16 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-f960193a-0215-479d-b265-9befa42766aa req-250253f9-f114-43b9-a35c-d32d31a171c7 service nova] Lock "a6aee021-df0b-4ada-9f82-8df7486dc869-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:13:16 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-f960193a-0215-479d-b265-9befa42766aa req-250253f9-f114-43b9-a35c-d32d31a171c7 service nova] Lock "a6aee021-df0b-4ada-9f82-8df7486dc869-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:13:16 user nova-compute[74337]: DEBUG nova.compute.manager [req-f960193a-0215-479d-b265-9befa42766aa req-250253f9-f114-43b9-a35c-d32d31a171c7 service nova] [instance: a6aee021-df0b-4ada-9f82-8df7486dc869] No waiting events found dispatching network-vif-unplugged-7de2dfea-ae8f-4aab-8f6c-06eb8a86f1ec {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 22:13:16 user nova-compute[74337]: DEBUG nova.compute.manager [req-f960193a-0215-479d-b265-9befa42766aa req-250253f9-f114-43b9-a35c-d32d31a171c7 service nova] [instance: a6aee021-df0b-4ada-9f82-8df7486dc869] Received event network-vif-unplugged-7de2dfea-ae8f-4aab-8f6c-06eb8a86f1ec for instance with task_state deleting. {{(pid=74337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 22:13:16 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:13:16 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:13:16 user nova-compute[74337]: DEBUG nova.network.neutron [req-576b7873-6999-444f-8339-a78590be067d req-d91b1ae3-3847-4d70-8c64-a50ea12b2653 service nova] [instance: a6aee021-df0b-4ada-9f82-8df7486dc869] Updated VIF entry in instance network info cache for port 7de2dfea-ae8f-4aab-8f6c-06eb8a86f1ec. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 22:13:16 user nova-compute[74337]: DEBUG nova.network.neutron [req-576b7873-6999-444f-8339-a78590be067d req-d91b1ae3-3847-4d70-8c64-a50ea12b2653 service nova] [instance: a6aee021-df0b-4ada-9f82-8df7486dc869] Updating instance_info_cache with network_info: [{"id": "7de2dfea-ae8f-4aab-8f6c-06eb8a86f1ec", "address": "fa:16:3e:41:c4:f2", "network": {"id": "09783701-f9c4-4d08-8523-6e363a558ec0", "bridge": "br-int", "label": "tempest-TestStampPattern-974584378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc044020751d475b94e96fcedb97b86c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7de2dfea-ae", "ovs_interfaceid": "7de2dfea-ae8f-4aab-8f6c-06eb8a86f1ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 22:13:16 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:13:16 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-576b7873-6999-444f-8339-a78590be067d req-d91b1ae3-3847-4d70-8c64-a50ea12b2653 service nova] Releasing lock "refresh_cache-a6aee021-df0b-4ada-9f82-8df7486dc869" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 22:13:16 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: a6aee021-df0b-4ada-9f82-8df7486dc869] Instance destroyed successfully.
Oct 23 22:13:16 user nova-compute[74337]: DEBUG nova.objects.instance [None req-38a2895a-78ee-46d6-99ba-63936bad3a61 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Lazy-loading 'resources' on Instance uuid a6aee021-df0b-4ada-9f82-8df7486dc869 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:13:16 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-38a2895a-78ee-46d6-99ba-63936bad3a61 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T22:10:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1278263266',display_name='tempest-TestStampPattern-server-1278263266',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1278263266',id=50,image_ref='c918a5be-6ec8-487d-8d27-bc65ab3219ae',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM/w5IxSPpZmfXwphA/Co4/hp2D6fAjEAT72VAt3V+4E9LsYzs0Ns5n7Z6WZABZZJFZarcd4Py5ieFgN0v3D5Oi+9O8evYRVN2/Q9FEiDD/ZoEa6QuGDQ0iF55PrsWzQHw==',key_name='tempest-TestStampPattern-561385519',keypairs=<?>,launch_index=0,launched_at=2023-10-23T22:10:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bc044020751d475b94e96fcedb97b86c',ramdisk_id='',reservation_id='r-gqd2jsd0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='106da458-caec-4114-8904-0411ec0ea903',image_min_disk='1',image_min_ram='0',image_owner_id='bc044020751d475b94e96fcedb97b86c',image_owner_project_name='tempest-TestStampPattern-955971620',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-955971620-project-member',image_user_id='a96a8803687f4b7db06e29b5b736ade1',owner_project_name='tempest-TestStampPattern-955971620',owner_user_name='tempest-TestStampPattern-955971620-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T22:10:19Z,user_data=None,user_id='a96a8803687f4b7db06e29b5b736ade1',uuid=a6aee021-df0b-4ada-9f82-8df7486dc869,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7de2dfea-ae8f-4aab-8f6c-06eb8a86f1ec", "address": "fa:16:3e:41:c4:f2", "network": {"id": "09783701-f9c4-4d08-8523-6e363a558ec0", "bridge": "br-int", "label": "tempest-TestStampPattern-974584378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc044020751d475b94e96fcedb97b86c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7de2dfea-ae", "ovs_interfaceid": "7de2dfea-ae8f-4aab-8f6c-06eb8a86f1ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 22:13:16 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-38a2895a-78ee-46d6-99ba-63936bad3a61 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Converting VIF {"id": "7de2dfea-ae8f-4aab-8f6c-06eb8a86f1ec", "address": "fa:16:3e:41:c4:f2", "network": {"id": "09783701-f9c4-4d08-8523-6e363a558ec0", "bridge": "br-int", "label": "tempest-TestStampPattern-974584378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc044020751d475b94e96fcedb97b86c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7de2dfea-ae", "ovs_interfaceid": "7de2dfea-ae8f-4aab-8f6c-06eb8a86f1ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 22:13:16 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-38a2895a-78ee-46d6-99ba-63936bad3a61 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:41:c4:f2,bridge_name='br-int',has_traffic_filtering=True,id=7de2dfea-ae8f-4aab-8f6c-06eb8a86f1ec,network=Network(09783701-f9c4-4d08-8523-6e363a558ec0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7de2dfea-ae') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 22:13:16 user nova-compute[74337]: DEBUG os_vif [None req-38a2895a-78ee-46d6-99ba-63936bad3a61 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:c4:f2,bridge_name='br-int',has_traffic_filtering=True,id=7de2dfea-ae8f-4aab-8f6c-06eb8a86f1ec,network=Network(09783701-f9c4-4d08-8523-6e363a558ec0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7de2dfea-ae') {{(pid=74337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 22:13:16 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:13:16 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7de2dfea-ae, bridge=br-int, if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:13:16 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:13:16 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:13:16 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:13:16 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:13:16 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4772d751-f5c4-4be6-8b40-f019b8e4468f) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:13:16 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:13:16 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:13:16 user nova-compute[74337]: INFO os_vif [None req-38a2895a-78ee-46d6-99ba-63936bad3a61 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:c4:f2,bridge_name='br-int',has_traffic_filtering=True,id=7de2dfea-ae8f-4aab-8f6c-06eb8a86f1ec,network=Network(09783701-f9c4-4d08-8523-6e363a558ec0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7de2dfea-ae')
Oct 23 22:13:16 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-38a2895a-78ee-46d6-99ba-63936bad3a61 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] [instance: a6aee021-df0b-4ada-9f82-8df7486dc869] Deleting instance files /opt/stack/data/nova/instances/a6aee021-df0b-4ada-9f82-8df7486dc869_del
Oct 23 22:13:16 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-38a2895a-78ee-46d6-99ba-63936bad3a61 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] [instance: a6aee021-df0b-4ada-9f82-8df7486dc869] Deletion of /opt/stack/data/nova/instances/a6aee021-df0b-4ada-9f82-8df7486dc869_del complete
Oct 23 22:13:16 user nova-compute[74337]: INFO nova.compute.manager [None req-38a2895a-78ee-46d6-99ba-63936bad3a61 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] [instance: a6aee021-df0b-4ada-9f82-8df7486dc869] Took 0.91 seconds to destroy the instance on the hypervisor.
Oct 23 22:13:16 user nova-compute[74337]: DEBUG oslo.service.loopingcall [None req-38a2895a-78ee-46d6-99ba-63936bad3a61 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74337) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 22:13:16 user nova-compute[74337]: DEBUG nova.compute.manager [-] [instance: a6aee021-df0b-4ada-9f82-8df7486dc869] Deallocating network for instance {{(pid=74337) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 22:13:16 user nova-compute[74337]: DEBUG nova.network.neutron [-] [instance: a6aee021-df0b-4ada-9f82-8df7486dc869] deallocate_for_instance() {{(pid=74337) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 22:13:16 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:13:16 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:13:16 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:13:17 user nova-compute[74337]: DEBUG nova.network.neutron [-] [instance: a6aee021-df0b-4ada-9f82-8df7486dc869] Updating instance_info_cache with network_info: [] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 22:13:17 user nova-compute[74337]: INFO nova.compute.manager [-] [instance: a6aee021-df0b-4ada-9f82-8df7486dc869] Took 0.75 seconds to deallocate network for instance.
Oct 23 22:13:17 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-38a2895a-78ee-46d6-99ba-63936bad3a61 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:13:17 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-38a2895a-78ee-46d6-99ba-63936bad3a61 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:13:17 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-38a2895a-78ee-46d6-99ba-63936bad3a61 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 22:13:17 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-38a2895a-78ee-46d6-99ba-63936bad3a61 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 22:13:17 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-38a2895a-78ee-46d6-99ba-63936bad3a61 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.294s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:13:17 user nova-compute[74337]: INFO nova.scheduler.client.report [None req-38a2895a-78ee-46d6-99ba-63936bad3a61 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Deleted allocations for instance a6aee021-df0b-4ada-9f82-8df7486dc869
Oct 23 22:13:17 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-38a2895a-78ee-46d6-99ba-63936bad3a61 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Lock "a6aee021-df0b-4ada-9f82-8df7486dc869" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.388s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:13:18 user nova-compute[74337]: DEBUG nova.compute.manager [req-ed7c4669-7f7c-4888-a9e2-97f3cc188e39 req-037eda7e-f713-4a08-80f9-099034a911a1 service nova] [instance: a6aee021-df0b-4ada-9f82-8df7486dc869] Received event network-vif-plugged-7de2dfea-ae8f-4aab-8f6c-06eb8a86f1ec {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:13:18 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ed7c4669-7f7c-4888-a9e2-97f3cc188e39 req-037eda7e-f713-4a08-80f9-099034a911a1 service nova] Acquiring lock "a6aee021-df0b-4ada-9f82-8df7486dc869-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:13:18 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ed7c4669-7f7c-4888-a9e2-97f3cc188e39 req-037eda7e-f713-4a08-80f9-099034a911a1 service nova] Lock "a6aee021-df0b-4ada-9f82-8df7486dc869-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:13:18 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ed7c4669-7f7c-4888-a9e2-97f3cc188e39 req-037eda7e-f713-4a08-80f9-099034a911a1 service nova] Lock "a6aee021-df0b-4ada-9f82-8df7486dc869-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:13:18 user nova-compute[74337]: DEBUG nova.compute.manager [req-ed7c4669-7f7c-4888-a9e2-97f3cc188e39 req-037eda7e-f713-4a08-80f9-099034a911a1 service nova] [instance: a6aee021-df0b-4ada-9f82-8df7486dc869] No waiting events found dispatching network-vif-plugged-7de2dfea-ae8f-4aab-8f6c-06eb8a86f1ec {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 22:13:18 user nova-compute[74337]: WARNING nova.compute.manager [req-ed7c4669-7f7c-4888-a9e2-97f3cc188e39 req-037eda7e-f713-4a08-80f9-099034a911a1 service nova] [instance: a6aee021-df0b-4ada-9f82-8df7486dc869] Received unexpected event network-vif-plugged-7de2dfea-ae8f-4aab-8f6c-06eb8a86f1ec for instance with vm_state deleted and task_state None.
Oct 23 22:13:18 user nova-compute[74337]: DEBUG nova.compute.manager [req-ed7c4669-7f7c-4888-a9e2-97f3cc188e39 req-037eda7e-f713-4a08-80f9-099034a911a1 service nova] [instance: a6aee021-df0b-4ada-9f82-8df7486dc869] Received event network-vif-plugged-7de2dfea-ae8f-4aab-8f6c-06eb8a86f1ec {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:13:18 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ed7c4669-7f7c-4888-a9e2-97f3cc188e39 req-037eda7e-f713-4a08-80f9-099034a911a1 service nova] Acquiring lock "a6aee021-df0b-4ada-9f82-8df7486dc869-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:13:18 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ed7c4669-7f7c-4888-a9e2-97f3cc188e39 req-037eda7e-f713-4a08-80f9-099034a911a1 service nova] Lock "a6aee021-df0b-4ada-9f82-8df7486dc869-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:13:18 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ed7c4669-7f7c-4888-a9e2-97f3cc188e39 req-037eda7e-f713-4a08-80f9-099034a911a1 service nova] Lock "a6aee021-df0b-4ada-9f82-8df7486dc869-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:13:18 user nova-compute[74337]: DEBUG nova.compute.manager [req-ed7c4669-7f7c-4888-a9e2-97f3cc188e39 req-037eda7e-f713-4a08-80f9-099034a911a1 service nova] [instance: a6aee021-df0b-4ada-9f82-8df7486dc869] No waiting events found dispatching network-vif-plugged-7de2dfea-ae8f-4aab-8f6c-06eb8a86f1ec {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 22:13:18 user nova-compute[74337]: WARNING nova.compute.manager [req-ed7c4669-7f7c-4888-a9e2-97f3cc188e39 req-037eda7e-f713-4a08-80f9-099034a911a1 service nova] [instance: a6aee021-df0b-4ada-9f82-8df7486dc869] Received unexpected event network-vif-plugged-7de2dfea-ae8f-4aab-8f6c-06eb8a86f1ec for instance with vm_state deleted and task_state None.
Oct 23 22:13:18 user nova-compute[74337]: DEBUG nova.compute.manager [req-ed7c4669-7f7c-4888-a9e2-97f3cc188e39 req-037eda7e-f713-4a08-80f9-099034a911a1 service nova] [instance: a6aee021-df0b-4ada-9f82-8df7486dc869] Received event network-vif-plugged-7de2dfea-ae8f-4aab-8f6c-06eb8a86f1ec {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:13:18 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ed7c4669-7f7c-4888-a9e2-97f3cc188e39 req-037eda7e-f713-4a08-80f9-099034a911a1 service nova] Acquiring lock "a6aee021-df0b-4ada-9f82-8df7486dc869-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:13:18 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ed7c4669-7f7c-4888-a9e2-97f3cc188e39 req-037eda7e-f713-4a08-80f9-099034a911a1 service nova] Lock "a6aee021-df0b-4ada-9f82-8df7486dc869-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:13:18 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-ed7c4669-7f7c-4888-a9e2-97f3cc188e39 req-037eda7e-f713-4a08-80f9-099034a911a1 service nova] Lock "a6aee021-df0b-4ada-9f82-8df7486dc869-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:13:18 user nova-compute[74337]: DEBUG nova.compute.manager [req-ed7c4669-7f7c-4888-a9e2-97f3cc188e39 req-037eda7e-f713-4a08-80f9-099034a911a1 service nova] [instance: a6aee021-df0b-4ada-9f82-8df7486dc869] No waiting events found dispatching network-vif-plugged-7de2dfea-ae8f-4aab-8f6c-06eb8a86f1ec {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 22:13:18 user nova-compute[74337]: WARNING nova.compute.manager [req-ed7c4669-7f7c-4888-a9e2-97f3cc188e39 req-037eda7e-f713-4a08-80f9-099034a911a1 service nova] [instance: a6aee021-df0b-4ada-9f82-8df7486dc869] Received unexpected event network-vif-plugged-7de2dfea-ae8f-4aab-8f6c-06eb8a86f1ec for instance with vm_state deleted and task_state None.
Oct 23 22:13:18 user nova-compute[74337]: DEBUG nova.compute.manager [req-ed7c4669-7f7c-4888-a9e2-97f3cc188e39 req-037eda7e-f713-4a08-80f9-099034a911a1 service nova] [instance: a6aee021-df0b-4ada-9f82-8df7486dc869] Received event network-vif-deleted-7de2dfea-ae8f-4aab-8f6c-06eb8a86f1ec {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:13:21 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:13:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:13:28 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:13:28 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 22:13:29 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:13:30 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-9c7d642f-36fa-4b1c-b368-6ae84b326eae tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Acquiring lock "38bdf4aa-052a-4638-ac28-757c835aef04" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:13:30 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-9c7d642f-36fa-4b1c-b368-6ae84b326eae tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Lock "38bdf4aa-052a-4638-ac28-757c835aef04" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:13:30 user nova-compute[74337]: INFO nova.compute.manager [None req-9c7d642f-36fa-4b1c-b368-6ae84b326eae tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] [instance: 38bdf4aa-052a-4638-ac28-757c835aef04] Detaching volume 7302c940-8b88-4869-a483-e46ab7371e89
Oct 23 22:13:30 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:13:30 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-ab8e5e1e-7556-4a0c-87fb-c886327621d2 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Acquiring lock "38bdf4aa-052a-4638-ac28-757c835aef04" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:13:30 user nova-compute[74337]: INFO nova.virt.block_device [None req-9c7d642f-36fa-4b1c-b368-6ae84b326eae tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] [instance: 38bdf4aa-052a-4638-ac28-757c835aef04] Attempting to driver detach volume 7302c940-8b88-4869-a483-e46ab7371e89 from mountpoint /dev/vdb
Oct 23 22:13:30 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-9c7d642f-36fa-4b1c-b368-6ae84b326eae tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Attempting to detach device vdb from instance 38bdf4aa-052a-4638-ac28-757c835aef04 from the persistent domain config. {{(pid=74337) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 22:13:30 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-9c7d642f-36fa-4b1c-b368-6ae84b326eae tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 22:13:30 user nova-compute[74337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 22:13:30 user nova-compute[74337]:   <source dev="/dev/sdd"/>
Oct 23 22:13:30 user nova-compute[74337]:   <target dev="vdb" bus="virtio"/>
Oct 23 22:13:30 user nova-compute[74337]:   <serial>7302c940-8b88-4869-a483-e46ab7371e89</serial>
Oct 23 22:13:30 user nova-compute[74337]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 22:13:30 user nova-compute[74337]: </disk>
Oct 23 22:13:30 user nova-compute[74337]:  {{(pid=74337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 22:13:30 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-9c7d642f-36fa-4b1c-b368-6ae84b326eae tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Successfully detached device vdb from instance 38bdf4aa-052a-4638-ac28-757c835aef04 from the persistent domain config.
Oct 23 22:13:30 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-9c7d642f-36fa-4b1c-b368-6ae84b326eae tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 38bdf4aa-052a-4638-ac28-757c835aef04 from the live domain config. {{(pid=74337) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 22:13:30 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-9c7d642f-36fa-4b1c-b368-6ae84b326eae tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 22:13:30 user nova-compute[74337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 22:13:30 user nova-compute[74337]:   <source dev="/dev/sdd"/>
Oct 23 22:13:30 user nova-compute[74337]:   <target dev="vdb" bus="virtio"/>
Oct 23 22:13:30 user nova-compute[74337]:   <serial>7302c940-8b88-4869-a483-e46ab7371e89</serial>
Oct 23 22:13:30 user nova-compute[74337]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 22:13:30 user nova-compute[74337]: </disk>
Oct 23 22:13:30 user nova-compute[74337]:  {{(pid=74337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 22:13:31 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-9c7d642f-36fa-4b1c-b368-6ae84b326eae tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 38bdf4aa-052a-4638-ac28-757c835aef04 {{(pid=74337) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 22:13:31 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:13:31 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:13:31 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 22:13:31 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 22:13:31 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 22:13:31 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:13:33 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:13:33 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:13:33 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:13:35 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:13:35 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:13:35 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:13:35 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:13:35 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Auditing locally available compute resources for user (node: user) {{(pid=74337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 22:13:35 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/999843b2-b757-480b-bd21-bf281954bc46/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:13:35 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/999843b2-b757-480b-bd21-bf281954bc46/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:13:35 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/999843b2-b757-480b-bd21-bf281954bc46/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:13:35 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/999843b2-b757-480b-bd21-bf281954bc46/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:13:35 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61fe098a-5958-4ad1-8f92-4592809299b7/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:13:36 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61fe098a-5958-4ad1-8f92-4592809299b7/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:13:36 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61fe098a-5958-4ad1-8f92-4592809299b7/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:13:36 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:13:36 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61fe098a-5958-4ad1-8f92-4592809299b7/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:13:36 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74337) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 23 22:13:36 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/106da458-caec-4114-8904-0411ec0ea903/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:13:36 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/106da458-caec-4114-8904-0411ec0ea903/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:13:36 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/106da458-caec-4114-8904-0411ec0ea903/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:13:36 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/106da458-caec-4114-8904-0411ec0ea903/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:13:36 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk.rescue --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:13:36 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk.rescue --force-share --output=json" returned: 0 in 0.166s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:13:36 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk.rescue --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:13:37 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:13:37 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:13:37 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:13:37 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:13:37 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:13:37 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38bdf4aa-052a-4638-ac28-757c835aef04/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:13:37 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38bdf4aa-052a-4638-ac28-757c835aef04/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:13:37 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38bdf4aa-052a-4638-ac28-757c835aef04/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:13:37 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38bdf4aa-052a-4638-ac28-757c835aef04/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:13:38 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:13:38 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:13:38 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Hypervisor/Node resource view: name=user free_ram=8408MB free_disk=24.99078369140625GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 22:13:38 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:13:38 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:13:38 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 0323b854-c7a1-42e8-ad85-1e929caa6e9d has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Oct 23 22:13:38 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 999843b2-b757-480b-bd21-bf281954bc46 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 22:13:38 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 27710919-a717-42fa-a436-a261d92c1c2a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 22:13:38 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 106da458-caec-4114-8904-0411ec0ea903 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 22:13:38 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 61fe098a-5958-4ad1-8f92-4592809299b7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 22:13:38 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 38bdf4aa-052a-4638-ac28-757c835aef04 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 22:13:38 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 22:13:38 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 22:13:38 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 22:13:38 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 22:13:38 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Compute_service record updated for user:user {{(pid=74337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 22:13:38 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.460s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:13:41 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:13:41 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:13:41 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:13:41 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:13:41 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Starting heal instance info cache {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 22:13:41 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "refresh_cache-61fe098a-5958-4ad1-8f92-4592809299b7" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 22:13:41 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquired lock "refresh_cache-61fe098a-5958-4ad1-8f92-4592809299b7" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 22:13:41 user nova-compute[74337]: DEBUG nova.network.neutron [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Forcefully refreshing network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 22:13:42 user nova-compute[74337]: DEBUG nova.network.neutron [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Updating instance_info_cache with network_info: [{"id": "496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74", "address": "fa:16:3e:68:65:1a", "network": {"id": "122fdd20-8bf5-4374-b50c-82e5dc8684db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-81475496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80f79dd6954748e4806a568a4127396f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap496ce3c5-18", "ovs_interfaceid": "496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 22:13:42 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Releasing lock "refresh_cache-61fe098a-5958-4ad1-8f92-4592809299b7" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 22:13:42 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Updated the network info_cache for instance {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 22:13:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:13:51 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-9c7d642f-36fa-4b1c-b368-6ae84b326eae tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 38bdf4aa-052a-4638-ac28-757c835aef04 is timed out.
Oct 23 22:13:51 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-9c7d642f-36fa-4b1c-b368-6ae84b326eae tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Successfully detached device vdb from instance 38bdf4aa-052a-4638-ac28-757c835aef04 from the live domain config.
Oct 23 22:13:51 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c7d642f-36fa-4b1c-b368-6ae84b326eae tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] [instance: 38bdf4aa-052a-4638-ac28-757c835aef04] calling os-brick to detach iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 22:13:51 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c7d642f-36fa-4b1c-b368-6ae84b326eae tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, {'target_iqn': 'iqn.2010-10.org.openstack:7302c940-8b88-4869-a483-e46ab7371e89', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vCqYiTaB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 22:13:51 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-9c7d642f-36fa-4b1c-b368-6ae84b326eae tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 22:13:51 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-9c7d642f-36fa-4b1c-b368-6ae84b326eae tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 22:13:51 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-9c7d642f-36fa-4b1c-b368-6ae84b326eae tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 22:13:51 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:13:51 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:13:51 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bcb71b2-c5d4-48f2-9544-880b8b479587]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:485637f5-7429-4020-83b7-1156be9d013f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7302c940-8b88-4869-a483-e46ab7371e89\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:13:51 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c7d642f-36fa-4b1c-b368-6ae84b326eae tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 22:13:51 user nova-compute[74337]: No targets found.
Oct 23 22:13:51 user nova-compute[74337]: iSNS:
Oct 23 22:13:51 user nova-compute[74337]: No targets found.
Oct 23 22:13:51 user nova-compute[74337]: STATIC:
Oct 23 22:13:51 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:485637f5-7429-4020-83b7-1156be9d013f
Oct 23 22:13:51 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 22:13:51 user nova-compute[74337]:                 Iface Name: default
Oct 23 22:13:51 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:7302c940-8b88-4869-a483-e46ab7371e89
Oct 23 22:13:51 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 22:13:51 user nova-compute[74337]:                 Iface Name: default
Oct 23 22:13:51 user nova-compute[74337]: FIRMWARE:
Oct 23 22:13:51 user nova-compute[74337]: No targets found.
Oct 23 22:13:51 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 22:13:51 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c7d642f-36fa-4b1c-b368-6ae84b326eae tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 22:13:51 user nova-compute[74337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 22:13:51 user nova-compute[74337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 22:13:51 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c7d642f-36fa-4b1c-b368-6ae84b326eae tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7302c940-8b88-4869-a483-e46ab7371e89', 0)] {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 22:13:51 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:13:51 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:13:51 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a67eb80e-502b-4421-9d9d-28d704339d84]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:485637f5-7429-4020-83b7-1156be9d013f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7302c940-8b88-4869-a483-e46ab7371e89\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:13:51 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:13:51 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:13:51 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc68297-9f26-42a1-848e-78b48d4621fd]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485637f5-7429-4020-83b7-1156be9d013f (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7302c940-8b88-4869-a483-e46ab7371e89 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:13:51 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c7d642f-36fa-4b1c-b368-6ae84b326eae tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485637f5-7429-4020-83b7-1156be9d013f (non-flash)
Oct 23 22:13:51 user nova-compute[74337]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7302c940-8b88-4869-a483-e46ab7371e89 (non-flash)
Oct 23 22:13:51 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 22:13:51 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c7d642f-36fa-4b1c-b368-6ae84b326eae tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485637f5-7429-4020-83b7-1156be9d013f (non-flash)
Oct 23 22:13:51 user nova-compute[74337]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7302c940-8b88-4869-a483-e46ab7371e89 (non-flash)
Oct 23 22:13:51 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 22:13:51 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c7d642f-36fa-4b1c-b368-6ae84b326eae tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5eec2971c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7302c940-8b88-4869-a483-e46ab7371e89'): ({'sdd'}, set())}) {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 22:13:51 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-9c7d642f-36fa-4b1c-b368-6ae84b326eae tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Removing single pathed devices sdd {{(pid=74337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 22:13:51 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:13:51 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:13:51 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeaac773-38d8-48de-bce8-2c3f78d9ee8f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:13:51 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:13:51 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:13:51 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5109239-aab4-4628-a7e2-ceab4fbea358]: (4, ('ok\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:13:51 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-9c7d642f-36fa-4b1c-b368-6ae84b326eae tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Flushing IO for device /dev/sdd {{(pid=74337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 22:13:51 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:13:51 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:13:51 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b89ec012-9eda-4a3e-96c6-6bc742ca5cad]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:13:51 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-9c7d642f-36fa-4b1c-b368-6ae84b326eae tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 22:13:51 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:13:51 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.039s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:13:51 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe164b0-69b0-49a7-8b4d-04dae9315545]: (4, ('1', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:13:51 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-9c7d642f-36fa-4b1c-b368-6ae84b326eae tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 22:13:51 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-9c7d642f-36fa-4b1c-b368-6ae84b326eae tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] SCSI volumes sdd have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 22:13:51 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c7d642f-36fa-4b1c-b368-6ae84b326eae tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7302c940-8b88-4869-a483-e46ab7371e89')] {{(pid=74337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 22:13:51 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7302c940-8b88-4869-a483-e46ab7371e89 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:13:51 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7302c940-8b88-4869-a483-e46ab7371e89 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:13:51 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df2191f-b005-4d70-b813-5daf095d369d]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:13:51 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c7d642f-36fa-4b1c-b368-6ae84b326eae tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:13:51 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7302c940-8b88-4869-a483-e46ab7371e89 -p 172.16.0.220:3260 --logout {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:13:51 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:13:51 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:13:51 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 22:13:51 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 22:13:51 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 22:13:51 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:13:51 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7302c940-8b88-4869-a483-e46ab7371e89 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:13:51 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd100f3c-8fc7-4f47-902b-6b4c662598ff]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:7302c940-8b88-4869-a483-e46ab7371e89, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:7302c940-8b88-4869-a483-e46ab7371e89, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:13:51 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c7d642f-36fa-4b1c-b368-6ae84b326eae tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:7302c940-8b88-4869-a483-e46ab7371e89, portal: 172.16.0.220,3260]
Oct 23 22:13:51 user nova-compute[74337]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:7302c940-8b88-4869-a483-e46ab7371e89, portal: 172.16.0.220,3260] successful.
Oct 23 22:13:51 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:13:51 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7302c940-8b88-4869-a483-e46ab7371e89 -p 172.16.0.220:3260 --op delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:13:51 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7302c940-8b88-4869-a483-e46ab7371e89 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:13:51 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9ab81e7-dca9-45da-8264-9ba571c94e01]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:13:51 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c7d642f-36fa-4b1c-b368-6ae84b326eae tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:13:51 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-9c7d642f-36fa-4b1c-b368-6ae84b326eae tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 22:13:51 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c7d642f-36fa-4b1c-b368-6ae84b326eae tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] <== disconnect_volume: return (280ms) None {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 22:13:51 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c7d642f-36fa-4b1c-b368-6ae84b326eae tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] [instance: 38bdf4aa-052a-4638-ac28-757c835aef04] Disconnected iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 22:13:52 user nova-compute[74337]: DEBUG nova.objects.instance [None req-9c7d642f-36fa-4b1c-b368-6ae84b326eae tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Lazy-loading 'flavor' on Instance uuid 38bdf4aa-052a-4638-ac28-757c835aef04 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:13:52 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-9c7d642f-36fa-4b1c-b368-6ae84b326eae tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Lock "38bdf4aa-052a-4638-ac28-757c835aef04" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.928s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:13:52 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-ab8e5e1e-7556-4a0c-87fb-c886327621d2 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Lock "38bdf4aa-052a-4638-ac28-757c835aef04" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.793s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:13:52 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-ab8e5e1e-7556-4a0c-87fb-c886327621d2 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Acquiring lock "38bdf4aa-052a-4638-ac28-757c835aef04-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:13:52 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-ab8e5e1e-7556-4a0c-87fb-c886327621d2 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Lock "38bdf4aa-052a-4638-ac28-757c835aef04-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:13:52 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-ab8e5e1e-7556-4a0c-87fb-c886327621d2 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Lock "38bdf4aa-052a-4638-ac28-757c835aef04-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:13:52 user nova-compute[74337]: INFO nova.compute.manager [None req-ab8e5e1e-7556-4a0c-87fb-c886327621d2 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] [instance: 38bdf4aa-052a-4638-ac28-757c835aef04] Terminating instance
Oct 23 22:13:52 user nova-compute[74337]: DEBUG nova.compute.manager [None req-ab8e5e1e-7556-4a0c-87fb-c886327621d2 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] [instance: 38bdf4aa-052a-4638-ac28-757c835aef04] Start destroying the instance on the hypervisor. {{(pid=74337) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 22:13:52 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:13:52 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:13:52 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:13:52 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:13:52 user nova-compute[74337]: DEBUG nova.compute.manager [req-13b16979-7f67-48b7-9a71-7e177119a2d9 req-61d5c326-cd12-4de1-92fc-ce5c56511761 service nova] [instance: 38bdf4aa-052a-4638-ac28-757c835aef04] Received event network-vif-unplugged-9de01666-1235-499a-9a57-a6e4a7ca6291 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:13:52 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-13b16979-7f67-48b7-9a71-7e177119a2d9 req-61d5c326-cd12-4de1-92fc-ce5c56511761 service nova] Acquiring lock "38bdf4aa-052a-4638-ac28-757c835aef04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:13:52 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-13b16979-7f67-48b7-9a71-7e177119a2d9 req-61d5c326-cd12-4de1-92fc-ce5c56511761 service nova] Lock "38bdf4aa-052a-4638-ac28-757c835aef04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:13:52 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-13b16979-7f67-48b7-9a71-7e177119a2d9 req-61d5c326-cd12-4de1-92fc-ce5c56511761 service nova] Lock "38bdf4aa-052a-4638-ac28-757c835aef04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:13:52 user nova-compute[74337]: DEBUG nova.compute.manager [req-13b16979-7f67-48b7-9a71-7e177119a2d9 req-61d5c326-cd12-4de1-92fc-ce5c56511761 service nova] [instance: 38bdf4aa-052a-4638-ac28-757c835aef04] No waiting events found dispatching network-vif-unplugged-9de01666-1235-499a-9a57-a6e4a7ca6291 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 22:13:52 user nova-compute[74337]: DEBUG nova.compute.manager [req-13b16979-7f67-48b7-9a71-7e177119a2d9 req-61d5c326-cd12-4de1-92fc-ce5c56511761 service nova] [instance: 38bdf4aa-052a-4638-ac28-757c835aef04] Received event network-vif-unplugged-9de01666-1235-499a-9a57-a6e4a7ca6291 for instance with task_state deleting. {{(pid=74337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 22:13:52 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:13:53 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: 38bdf4aa-052a-4638-ac28-757c835aef04] Instance destroyed successfully.
Oct 23 22:13:53 user nova-compute[74337]: DEBUG nova.objects.instance [None req-ab8e5e1e-7556-4a0c-87fb-c886327621d2 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Lazy-loading 'resources' on Instance uuid 38bdf4aa-052a-4638-ac28-757c835aef04 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:13:53 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-ab8e5e1e-7556-4a0c-87fb-c886327621d2 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T22:10:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-385011222',display_name='tempest-VolumesSnapshotTestJSON-instance-385011222',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-385011222',id=51,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL/aI4VXCwwXQIFxIXMZr9/S5ZK0P9G25OFBXDIpNNOZTHusIDKG/YCwZBzMTkUAO14OI/hJqZGpxH/Be0SaG5dZyoFDe3dM74pPLO4aIRcHny9hsCYnjuXwYDoi2vgzFQ==',key_name='tempest-keypair-1338348537',keypairs=<?>,launch_index=0,launched_at=2023-10-23T22:10:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='799c72bbb3e248b99463567aba2049db',ramdisk_id='',reservation_id='r-em35tty9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-389190159',owner_user_name='tempest-VolumesSnapshotTestJSON-389190159-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T22:10:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7932a09ed7a14f249da27a7f1d5326ea',uuid=38bdf4aa-052a-4638-ac28-757c835aef04,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9de01666-1235-499a-9a57-a6e4a7ca6291", "address": "fa:16:3e:04:b1:de", "network": {"id": "86669102-0490-4fe4-aba4-8a353e91a763", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1218528793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799c72bbb3e248b99463567aba2049db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9de01666-12", "ovs_interfaceid": "9de01666-1235-499a-9a57-a6e4a7ca6291", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 22:13:53 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-ab8e5e1e-7556-4a0c-87fb-c886327621d2 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Converting VIF {"id": "9de01666-1235-499a-9a57-a6e4a7ca6291", "address": "fa:16:3e:04:b1:de", "network": {"id": "86669102-0490-4fe4-aba4-8a353e91a763", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1218528793-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799c72bbb3e248b99463567aba2049db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9de01666-12", "ovs_interfaceid": "9de01666-1235-499a-9a57-a6e4a7ca6291", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 22:13:53 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-ab8e5e1e-7556-4a0c-87fb-c886327621d2 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:04:b1:de,bridge_name='br-int',has_traffic_filtering=True,id=9de01666-1235-499a-9a57-a6e4a7ca6291,network=Network(86669102-0490-4fe4-aba4-8a353e91a763),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9de01666-12') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 22:13:53 user nova-compute[74337]: DEBUG os_vif [None req-ab8e5e1e-7556-4a0c-87fb-c886327621d2 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:b1:de,bridge_name='br-int',has_traffic_filtering=True,id=9de01666-1235-499a-9a57-a6e4a7ca6291,network=Network(86669102-0490-4fe4-aba4-8a353e91a763),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9de01666-12') {{(pid=74337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 22:13:53 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:13:53 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9de01666-12, bridge=br-int, if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:13:53 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:13:53 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:13:53 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:13:53 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9b8697a2-f9c5-49d2-ad05-8da6391b1c6b) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:13:53 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:13:53 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:13:53 user nova-compute[74337]: INFO os_vif [None req-ab8e5e1e-7556-4a0c-87fb-c886327621d2 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:b1:de,bridge_name='br-int',has_traffic_filtering=True,id=9de01666-1235-499a-9a57-a6e4a7ca6291,network=Network(86669102-0490-4fe4-aba4-8a353e91a763),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9de01666-12')
Oct 23 22:13:53 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab8e5e1e-7556-4a0c-87fb-c886327621d2 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] [instance: 38bdf4aa-052a-4638-ac28-757c835aef04] calling os-brick to detach iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 22:13:53 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab8e5e1e-7556-4a0c-87fb-c886327621d2 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, {'target_iqn': 'iqn.2010-10.org.openstack:7302c940-8b88-4869-a483-e46ab7371e89', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vCqYiTaB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 22:13:53 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-ab8e5e1e-7556-4a0c-87fb-c886327621d2 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 22:13:53 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-ab8e5e1e-7556-4a0c-87fb-c886327621d2 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 22:13:53 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-ab8e5e1e-7556-4a0c-87fb-c886327621d2 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 22:13:53 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:13:53 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:13:53 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[32287baf-d876-4c2c-bd94-c900ab3a4cad]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:485637f5-7429-4020-83b7-1156be9d013f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:13:53 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab8e5e1e-7556-4a0c-87fb-c886327621d2 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 22:13:53 user nova-compute[74337]: No targets found.
Oct 23 22:13:53 user nova-compute[74337]: iSNS:
Oct 23 22:13:53 user nova-compute[74337]: No targets found.
Oct 23 22:13:53 user nova-compute[74337]: STATIC:
Oct 23 22:13:53 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:485637f5-7429-4020-83b7-1156be9d013f
Oct 23 22:13:53 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 22:13:53 user nova-compute[74337]:                 Iface Name: default
Oct 23 22:13:53 user nova-compute[74337]: FIRMWARE:
Oct 23 22:13:53 user nova-compute[74337]: No targets found.
Oct 23 22:13:53 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 22:13:53 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab8e5e1e-7556-4a0c-87fb-c886327621d2 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 22:13:53 user nova-compute[74337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 22:13:53 user nova-compute[74337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 22:13:53 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab8e5e1e-7556-4a0c-87fb-c886327621d2 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7302c940-8b88-4869-a483-e46ab7371e89', 0)] {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 22:13:53 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:13:53 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:13:53 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c58a0a-b2e8-4add-b264-abc54b5ee860]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:485637f5-7429-4020-83b7-1156be9d013f\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:13:53 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:13:53 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:13:53 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd12e105-1e2b-4658-b075-17e5c625e56b]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485637f5-7429-4020-83b7-1156be9d013f (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:13:53 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab8e5e1e-7556-4a0c-87fb-c886327621d2 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485637f5-7429-4020-83b7-1156be9d013f (non-flash)
Oct 23 22:13:53 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 22:13:53 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab8e5e1e-7556-4a0c-87fb-c886327621d2 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485637f5-7429-4020-83b7-1156be9d013f (non-flash)
Oct 23 22:13:53 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 22:13:53 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab8e5e1e-7556-4a0c-87fb-c886327621d2 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5ef4438b80>, {}) {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 22:13:53 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab8e5e1e-7556-4a0c-87fb-c886327621d2 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Disconnecting from: [] {{(pid=74337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 22:13:53 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-ab8e5e1e-7556-4a0c-87fb-c886327621d2 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.072s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 22:13:53 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab8e5e1e-7556-4a0c-87fb-c886327621d2 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] <== disconnect_volume: return (73ms) None {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 22:13:53 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab8e5e1e-7556-4a0c-87fb-c886327621d2 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] [instance: 38bdf4aa-052a-4638-ac28-757c835aef04] Disconnected iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 22:13:53 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-ab8e5e1e-7556-4a0c-87fb-c886327621d2 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] [instance: 38bdf4aa-052a-4638-ac28-757c835aef04] Deleting instance files /opt/stack/data/nova/instances/38bdf4aa-052a-4638-ac28-757c835aef04_del
Oct 23 22:13:53 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-ab8e5e1e-7556-4a0c-87fb-c886327621d2 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] [instance: 38bdf4aa-052a-4638-ac28-757c835aef04] Deletion of /opt/stack/data/nova/instances/38bdf4aa-052a-4638-ac28-757c835aef04_del complete
Oct 23 22:13:53 user nova-compute[74337]: INFO nova.compute.manager [None req-ab8e5e1e-7556-4a0c-87fb-c886327621d2 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] [instance: 38bdf4aa-052a-4638-ac28-757c835aef04] Took 0.92 seconds to destroy the instance on the hypervisor.
Oct 23 22:13:53 user nova-compute[74337]: DEBUG oslo.service.loopingcall [None req-ab8e5e1e-7556-4a0c-87fb-c886327621d2 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74337) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 22:13:53 user nova-compute[74337]: DEBUG nova.compute.manager [-] [instance: 38bdf4aa-052a-4638-ac28-757c835aef04] Deallocating network for instance {{(pid=74337) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 22:13:53 user nova-compute[74337]: DEBUG nova.network.neutron [-] [instance: 38bdf4aa-052a-4638-ac28-757c835aef04] deallocate_for_instance() {{(pid=74337) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 22:13:54 user nova-compute[74337]: DEBUG nova.compute.manager [req-56fb96cb-78bc-4fe9-9cc9-93386d4f5f88 req-1797e90d-4884-4751-afec-92a538d8e3a1 service nova] [instance: 38bdf4aa-052a-4638-ac28-757c835aef04] Received event network-vif-plugged-9de01666-1235-499a-9a57-a6e4a7ca6291 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:13:54 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-56fb96cb-78bc-4fe9-9cc9-93386d4f5f88 req-1797e90d-4884-4751-afec-92a538d8e3a1 service nova] Acquiring lock "38bdf4aa-052a-4638-ac28-757c835aef04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:13:54 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-56fb96cb-78bc-4fe9-9cc9-93386d4f5f88 req-1797e90d-4884-4751-afec-92a538d8e3a1 service nova] Lock "38bdf4aa-052a-4638-ac28-757c835aef04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:13:54 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-56fb96cb-78bc-4fe9-9cc9-93386d4f5f88 req-1797e90d-4884-4751-afec-92a538d8e3a1 service nova] Lock "38bdf4aa-052a-4638-ac28-757c835aef04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:13:54 user nova-compute[74337]: DEBUG nova.compute.manager [req-56fb96cb-78bc-4fe9-9cc9-93386d4f5f88 req-1797e90d-4884-4751-afec-92a538d8e3a1 service nova] [instance: 38bdf4aa-052a-4638-ac28-757c835aef04] No waiting events found dispatching network-vif-plugged-9de01666-1235-499a-9a57-a6e4a7ca6291 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 22:13:54 user nova-compute[74337]: WARNING nova.compute.manager [req-56fb96cb-78bc-4fe9-9cc9-93386d4f5f88 req-1797e90d-4884-4751-afec-92a538d8e3a1 service nova] [instance: 38bdf4aa-052a-4638-ac28-757c835aef04] Received unexpected event network-vif-plugged-9de01666-1235-499a-9a57-a6e4a7ca6291 for instance with vm_state active and task_state deleting.
Oct 23 22:13:54 user nova-compute[74337]: DEBUG nova.network.neutron [-] [instance: 38bdf4aa-052a-4638-ac28-757c835aef04] Updating instance_info_cache with network_info: [] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 22:13:54 user nova-compute[74337]: INFO nova.compute.manager [-] [instance: 38bdf4aa-052a-4638-ac28-757c835aef04] Took 1.50 seconds to deallocate network for instance.
Oct 23 22:13:54 user nova-compute[74337]: WARNING nova.volume.cinder [None req-ab8e5e1e-7556-4a0c-87fb-c886327621d2 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Attachment b56e2a1d-7c9e-456b-b973-7491e5c7144a does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = b56e2a1d-7c9e-456b-b973-7491e5c7144a. (HTTP 404) (Request-ID: req-ded41ed0-a112-4e7f-aa6d-2ec321fb9715)
Oct 23 22:13:54 user nova-compute[74337]: INFO nova.compute.manager [None req-ab8e5e1e-7556-4a0c-87fb-c886327621d2 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] [instance: 38bdf4aa-052a-4638-ac28-757c835aef04] Took 0.02 seconds to detach 1 volumes for instance.
Oct 23 22:13:54 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-ab8e5e1e-7556-4a0c-87fb-c886327621d2 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:13:54 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-ab8e5e1e-7556-4a0c-87fb-c886327621d2 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:13:55 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-ab8e5e1e-7556-4a0c-87fb-c886327621d2 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 22:13:55 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-ab8e5e1e-7556-4a0c-87fb-c886327621d2 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 22:13:55 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-ab8e5e1e-7556-4a0c-87fb-c886327621d2 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.229s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:13:55 user nova-compute[74337]: INFO nova.scheduler.client.report [None req-ab8e5e1e-7556-4a0c-87fb-c886327621d2 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Deleted allocations for instance 38bdf4aa-052a-4638-ac28-757c835aef04
Oct 23 22:13:55 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-ab8e5e1e-7556-4a0c-87fb-c886327621d2 tempest-VolumesSnapshotTestJSON-389190159 tempest-VolumesSnapshotTestJSON-389190159-project-member] Lock "38bdf4aa-052a-4638-ac28-757c835aef04" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.089s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:13:56 user nova-compute[74337]: DEBUG nova.compute.manager [req-e06cc7c7-4f4b-42ae-9746-d265d152c8da req-d95ac749-4306-4cb7-b3c7-809fa97e1978 service nova] [instance: 38bdf4aa-052a-4638-ac28-757c835aef04] Received event network-vif-deleted-9de01666-1235-499a-9a57-a6e4a7ca6291 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:13:58 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:13:58 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:14:00 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:14:03 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:14:05 user nova-compute[74337]: DEBUG nova.compute.manager [req-f66b77a4-8d8c-41e3-8855-fac2f2178fd6 req-35cc3e02-08d0-4820-8a88-20b5ab3fb3b5 service nova] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Received event network-changed-496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:14:05 user nova-compute[74337]: DEBUG nova.compute.manager [req-f66b77a4-8d8c-41e3-8855-fac2f2178fd6 req-35cc3e02-08d0-4820-8a88-20b5ab3fb3b5 service nova] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Refreshing instance network info cache due to event network-changed-496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 22:14:05 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-f66b77a4-8d8c-41e3-8855-fac2f2178fd6 req-35cc3e02-08d0-4820-8a88-20b5ab3fb3b5 service nova] Acquiring lock "refresh_cache-61fe098a-5958-4ad1-8f92-4592809299b7" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 22:14:05 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-f66b77a4-8d8c-41e3-8855-fac2f2178fd6 req-35cc3e02-08d0-4820-8a88-20b5ab3fb3b5 service nova] Acquired lock "refresh_cache-61fe098a-5958-4ad1-8f92-4592809299b7" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 22:14:05 user nova-compute[74337]: DEBUG nova.network.neutron [req-f66b77a4-8d8c-41e3-8855-fac2f2178fd6 req-35cc3e02-08d0-4820-8a88-20b5ab3fb3b5 service nova] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Refreshing network info cache for port 496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74 {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 22:14:05 user nova-compute[74337]: DEBUG nova.network.neutron [req-f66b77a4-8d8c-41e3-8855-fac2f2178fd6 req-35cc3e02-08d0-4820-8a88-20b5ab3fb3b5 service nova] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Updated VIF entry in instance network info cache for port 496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 22:14:05 user nova-compute[74337]: DEBUG nova.network.neutron [req-f66b77a4-8d8c-41e3-8855-fac2f2178fd6 req-35cc3e02-08d0-4820-8a88-20b5ab3fb3b5 service nova] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Updating instance_info_cache with network_info: [{"id": "496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74", "address": "fa:16:3e:68:65:1a", "network": {"id": "122fdd20-8bf5-4374-b50c-82e5dc8684db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-81475496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80f79dd6954748e4806a568a4127396f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap496ce3c5-18", "ovs_interfaceid": "496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 22:14:05 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-f66b77a4-8d8c-41e3-8855-fac2f2178fd6 req-35cc3e02-08d0-4820-8a88-20b5ab3fb3b5 service nova] Releasing lock "refresh_cache-61fe098a-5958-4ad1-8f92-4592809299b7" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 22:14:05 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-11eec6a3-baeb-4db2-9b43-6f4316794dec tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Acquiring lock "61fe098a-5958-4ad1-8f92-4592809299b7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:14:05 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-11eec6a3-baeb-4db2-9b43-6f4316794dec tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Lock "61fe098a-5958-4ad1-8f92-4592809299b7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:14:05 user nova-compute[74337]: INFO nova.compute.manager [None req-11eec6a3-baeb-4db2-9b43-6f4316794dec tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Detaching volume 485637f5-7429-4020-83b7-1156be9d013f
Oct 23 22:14:05 user nova-compute[74337]: INFO nova.virt.block_device [None req-11eec6a3-baeb-4db2-9b43-6f4316794dec tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Attempting to driver detach volume 485637f5-7429-4020-83b7-1156be9d013f from mountpoint /dev/vdb
Oct 23 22:14:05 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-11eec6a3-baeb-4db2-9b43-6f4316794dec tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Attempting to detach device vdb from instance 61fe098a-5958-4ad1-8f92-4592809299b7 from the persistent domain config. {{(pid=74337) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 22:14:05 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-11eec6a3-baeb-4db2-9b43-6f4316794dec tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 22:14:05 user nova-compute[74337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 22:14:05 user nova-compute[74337]:   <source dev="/dev/sdb"/>
Oct 23 22:14:05 user nova-compute[74337]:   <target dev="vdb" bus="virtio"/>
Oct 23 22:14:05 user nova-compute[74337]:   <serial>485637f5-7429-4020-83b7-1156be9d013f</serial>
Oct 23 22:14:05 user nova-compute[74337]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 22:14:05 user nova-compute[74337]: </disk>
Oct 23 22:14:05 user nova-compute[74337]:  {{(pid=74337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 22:14:05 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-11eec6a3-baeb-4db2-9b43-6f4316794dec tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Successfully detached device vdb from instance 61fe098a-5958-4ad1-8f92-4592809299b7 from the persistent domain config.
Oct 23 22:14:05 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-11eec6a3-baeb-4db2-9b43-6f4316794dec tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 61fe098a-5958-4ad1-8f92-4592809299b7 from the live domain config. {{(pid=74337) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 22:14:05 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-11eec6a3-baeb-4db2-9b43-6f4316794dec tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 22:14:05 user nova-compute[74337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 22:14:05 user nova-compute[74337]:   <source dev="/dev/sdb"/>
Oct 23 22:14:05 user nova-compute[74337]:   <target dev="vdb" bus="virtio"/>
Oct 23 22:14:05 user nova-compute[74337]:   <serial>485637f5-7429-4020-83b7-1156be9d013f</serial>
Oct 23 22:14:05 user nova-compute[74337]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 22:14:05 user nova-compute[74337]: </disk>
Oct 23 22:14:05 user nova-compute[74337]:  {{(pid=74337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 22:14:06 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-11eec6a3-baeb-4db2-9b43-6f4316794dec tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 61fe098a-5958-4ad1-8f92-4592809299b7 {{(pid=74337) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 22:14:07 user nova-compute[74337]: DEBUG nova.compute.manager [req-b56a8bb4-c478-4ca5-8d5d-04215c43a935 req-2ebd553e-1336-42a9-8f96-84eed6e19b90 service nova] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Received event network-changed-496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:14:07 user nova-compute[74337]: DEBUG nova.compute.manager [req-b56a8bb4-c478-4ca5-8d5d-04215c43a935 req-2ebd553e-1336-42a9-8f96-84eed6e19b90 service nova] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Refreshing instance network info cache due to event network-changed-496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 22:14:07 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-b56a8bb4-c478-4ca5-8d5d-04215c43a935 req-2ebd553e-1336-42a9-8f96-84eed6e19b90 service nova] Acquiring lock "refresh_cache-61fe098a-5958-4ad1-8f92-4592809299b7" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 22:14:07 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-b56a8bb4-c478-4ca5-8d5d-04215c43a935 req-2ebd553e-1336-42a9-8f96-84eed6e19b90 service nova] Acquired lock "refresh_cache-61fe098a-5958-4ad1-8f92-4592809299b7" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 22:14:07 user nova-compute[74337]: DEBUG nova.network.neutron [req-b56a8bb4-c478-4ca5-8d5d-04215c43a935 req-2ebd553e-1336-42a9-8f96-84eed6e19b90 service nova] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Refreshing network info cache for port 496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74 {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 22:14:07 user nova-compute[74337]: DEBUG nova.network.neutron [req-b56a8bb4-c478-4ca5-8d5d-04215c43a935 req-2ebd553e-1336-42a9-8f96-84eed6e19b90 service nova] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Updated VIF entry in instance network info cache for port 496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 22:14:07 user nova-compute[74337]: DEBUG nova.network.neutron [req-b56a8bb4-c478-4ca5-8d5d-04215c43a935 req-2ebd553e-1336-42a9-8f96-84eed6e19b90 service nova] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Updating instance_info_cache with network_info: [{"id": "496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74", "address": "fa:16:3e:68:65:1a", "network": {"id": "122fdd20-8bf5-4374-b50c-82e5dc8684db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-81475496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80f79dd6954748e4806a568a4127396f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap496ce3c5-18", "ovs_interfaceid": "496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 22:14:07 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-b56a8bb4-c478-4ca5-8d5d-04215c43a935 req-2ebd553e-1336-42a9-8f96-84eed6e19b90 service nova] Releasing lock "refresh_cache-61fe098a-5958-4ad1-8f92-4592809299b7" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 22:14:08 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:14:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:14:13 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:14:18 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:14:18 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:14:18 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 22:14:18 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 22:14:18 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 22:14:18 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:14:23 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:14:26 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-11eec6a3-baeb-4db2-9b43-6f4316794dec tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 61fe098a-5958-4ad1-8f92-4592809299b7 is timed out.
Oct 23 22:14:26 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-11eec6a3-baeb-4db2-9b43-6f4316794dec tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Successfully detached device vdb from instance 61fe098a-5958-4ad1-8f92-4592809299b7 from the live domain config.
Oct 23 22:14:26 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11eec6a3-baeb-4db2-9b43-6f4316794dec tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] calling os-brick to detach iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 22:14:26 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-11eec6a3-baeb-4db2-9b43-6f4316794dec tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, {'target_iqn': 'iqn.2010-10.org.openstack:485637f5-7429-4020-83b7-1156be9d013f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KfErMRax', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 22:14:26 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-11eec6a3-baeb-4db2-9b43-6f4316794dec tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 22:14:26 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-11eec6a3-baeb-4db2-9b43-6f4316794dec tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 22:14:26 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-11eec6a3-baeb-4db2-9b43-6f4316794dec tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 22:14:26 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:14:26 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:14:26 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[455cbcce-a261-448d-91a6-1c2d73b16aec]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:485637f5-7429-4020-83b7-1156be9d013f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:14:26 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-11eec6a3-baeb-4db2-9b43-6f4316794dec tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 22:14:26 user nova-compute[74337]: No targets found.
Oct 23 22:14:26 user nova-compute[74337]: iSNS:
Oct 23 22:14:26 user nova-compute[74337]: No targets found.
Oct 23 22:14:26 user nova-compute[74337]: STATIC:
Oct 23 22:14:26 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:485637f5-7429-4020-83b7-1156be9d013f
Oct 23 22:14:26 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 22:14:26 user nova-compute[74337]:                 Iface Name: default
Oct 23 22:14:26 user nova-compute[74337]: FIRMWARE:
Oct 23 22:14:26 user nova-compute[74337]: No targets found.
Oct 23 22:14:26 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 22:14:26 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-11eec6a3-baeb-4db2-9b43-6f4316794dec tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 22:14:26 user nova-compute[74337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 22:14:26 user nova-compute[74337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 22:14:26 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-11eec6a3-baeb-4db2-9b43-6f4316794dec tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:485637f5-7429-4020-83b7-1156be9d013f', 0)] {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 22:14:26 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:14:26 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:14:26 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b491399a-0379-41a3-b14f-46615739df58]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:485637f5-7429-4020-83b7-1156be9d013f\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:14:26 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:14:26 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:14:26 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[21abdf27-b836-4b36-bcab-d2eda509d3c8]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485637f5-7429-4020-83b7-1156be9d013f (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:14:26 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-11eec6a3-baeb-4db2-9b43-6f4316794dec tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485637f5-7429-4020-83b7-1156be9d013f (non-flash)
Oct 23 22:14:26 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 22:14:26 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-11eec6a3-baeb-4db2-9b43-6f4316794dec tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485637f5-7429-4020-83b7-1156be9d013f (non-flash)
Oct 23 22:14:26 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 22:14:26 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-11eec6a3-baeb-4db2-9b43-6f4316794dec tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5ec87dd750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:485637f5-7429-4020-83b7-1156be9d013f'): ({'sdb'}, set())}) {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 22:14:26 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-11eec6a3-baeb-4db2-9b43-6f4316794dec tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Removing single pathed devices sdb {{(pid=74337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 22:14:26 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:14:26 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:14:26 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[85914db4-355d-4819-a9fc-0b8709833716]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:14:26 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:14:26 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:14:26 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4361db8-16aa-4b64-a1a8-c3713885fc6c]: (4, ('ok\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:14:26 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-11eec6a3-baeb-4db2-9b43-6f4316794dec tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Flushing IO for device /dev/sdb {{(pid=74337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 22:14:26 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:14:26 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:14:26 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[7401d0ca-295e-45a7-a045-75b7a378088d]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:14:26 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-11eec6a3-baeb-4db2-9b43-6f4316794dec tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 22:14:26 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:14:26 user nova-compute[74337]: DEBUG nova.compute.manager [req-e16dc793-e3df-44a6-b284-2a8a0ab86d06 req-01100cd6-3045-4be6-83ed-4900dddcd5f6 service nova] [instance: 106da458-caec-4114-8904-0411ec0ea903] Received event network-changed-7a60434b-7f31-4b05-a494-97e58e72a5c1 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:14:26 user nova-compute[74337]: DEBUG nova.compute.manager [req-e16dc793-e3df-44a6-b284-2a8a0ab86d06 req-01100cd6-3045-4be6-83ed-4900dddcd5f6 service nova] [instance: 106da458-caec-4114-8904-0411ec0ea903] Refreshing instance network info cache due to event network-changed-7a60434b-7f31-4b05-a494-97e58e72a5c1. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 22:14:26 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-e16dc793-e3df-44a6-b284-2a8a0ab86d06 req-01100cd6-3045-4be6-83ed-4900dddcd5f6 service nova] Acquiring lock "refresh_cache-106da458-caec-4114-8904-0411ec0ea903" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 22:14:26 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-e16dc793-e3df-44a6-b284-2a8a0ab86d06 req-01100cd6-3045-4be6-83ed-4900dddcd5f6 service nova] Acquired lock "refresh_cache-106da458-caec-4114-8904-0411ec0ea903" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 22:14:26 user nova-compute[74337]: DEBUG nova.network.neutron [req-e16dc793-e3df-44a6-b284-2a8a0ab86d06 req-01100cd6-3045-4be6-83ed-4900dddcd5f6 service nova] [instance: 106da458-caec-4114-8904-0411ec0ea903] Refreshing network info cache for port 7a60434b-7f31-4b05-a494-97e58e72a5c1 {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 22:14:26 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:14:26 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1606ca9-9259-4527-83a4-8a7af031489e]: (4, ('1', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:14:26 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-11eec6a3-baeb-4db2-9b43-6f4316794dec tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 22:14:26 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-11eec6a3-baeb-4db2-9b43-6f4316794dec tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] SCSI volumes sdb have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 22:14:26 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-11eec6a3-baeb-4db2-9b43-6f4316794dec tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:485637f5-7429-4020-83b7-1156be9d013f')] {{(pid=74337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 22:14:26 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:485637f5-7429-4020-83b7-1156be9d013f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:14:26 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:485637f5-7429-4020-83b7-1156be9d013f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:14:26 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d65334c-5f84-4b0a-b4f6-c9180c5820b0]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:14:26 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-11eec6a3-baeb-4db2-9b43-6f4316794dec tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:14:26 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:485637f5-7429-4020-83b7-1156be9d013f -p 172.16.0.220:3260 --logout {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:14:26 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:485637f5-7429-4020-83b7-1156be9d013f -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:14:26 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[749c921b-f739-49e4-ae0a-a369098273d9]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:485637f5-7429-4020-83b7-1156be9d013f, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:485637f5-7429-4020-83b7-1156be9d013f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:14:26 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-11eec6a3-baeb-4db2-9b43-6f4316794dec tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:485637f5-7429-4020-83b7-1156be9d013f, portal: 172.16.0.220,3260]
Oct 23 22:14:26 user nova-compute[74337]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:485637f5-7429-4020-83b7-1156be9d013f, portal: 172.16.0.220,3260] successful.
Oct 23 22:14:26 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:14:26 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-100e2a3c-3a73-4178-be1b-2858e560de46 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Acquiring lock "106da458-caec-4114-8904-0411ec0ea903" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:14:26 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-100e2a3c-3a73-4178-be1b-2858e560de46 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Lock "106da458-caec-4114-8904-0411ec0ea903" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:14:26 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-100e2a3c-3a73-4178-be1b-2858e560de46 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Acquiring lock "106da458-caec-4114-8904-0411ec0ea903-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:14:26 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-100e2a3c-3a73-4178-be1b-2858e560de46 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Lock "106da458-caec-4114-8904-0411ec0ea903-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:14:26 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-100e2a3c-3a73-4178-be1b-2858e560de46 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Lock "106da458-caec-4114-8904-0411ec0ea903-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:14:26 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:485637f5-7429-4020-83b7-1156be9d013f -p 172.16.0.220:3260 --op delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:14:26 user nova-compute[74337]: INFO nova.compute.manager [None req-100e2a3c-3a73-4178-be1b-2858e560de46 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] [instance: 106da458-caec-4114-8904-0411ec0ea903] Terminating instance
Oct 23 22:14:26 user nova-compute[74337]: DEBUG nova.compute.manager [None req-100e2a3c-3a73-4178-be1b-2858e560de46 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] [instance: 106da458-caec-4114-8904-0411ec0ea903] Start destroying the instance on the hypervisor. {{(pid=74337) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 22:14:26 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:485637f5-7429-4020-83b7-1156be9d013f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:14:26 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[60bb51f6-8607-4bb8-b566-39c3d8457238]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:14:26 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-11eec6a3-baeb-4db2-9b43-6f4316794dec tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:14:26 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-11eec6a3-baeb-4db2-9b43-6f4316794dec tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 22:14:26 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-11eec6a3-baeb-4db2-9b43-6f4316794dec tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] <== disconnect_volume: return (303ms) None {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 22:14:26 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11eec6a3-baeb-4db2-9b43-6f4316794dec tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Disconnected iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 22:14:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:14:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:14:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:14:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:14:27 user nova-compute[74337]: DEBUG nova.compute.manager [req-02262a84-7d6e-4b10-8ea8-9820804fc91d req-2d4c6241-c9eb-4cb3-b4ab-1b0989a2ccb5 service nova] [instance: 106da458-caec-4114-8904-0411ec0ea903] Received event network-vif-unplugged-7a60434b-7f31-4b05-a494-97e58e72a5c1 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:14:27 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-02262a84-7d6e-4b10-8ea8-9820804fc91d req-2d4c6241-c9eb-4cb3-b4ab-1b0989a2ccb5 service nova] Acquiring lock "106da458-caec-4114-8904-0411ec0ea903-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:14:27 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-02262a84-7d6e-4b10-8ea8-9820804fc91d req-2d4c6241-c9eb-4cb3-b4ab-1b0989a2ccb5 service nova] Lock "106da458-caec-4114-8904-0411ec0ea903-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:14:27 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-02262a84-7d6e-4b10-8ea8-9820804fc91d req-2d4c6241-c9eb-4cb3-b4ab-1b0989a2ccb5 service nova] Lock "106da458-caec-4114-8904-0411ec0ea903-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:14:27 user nova-compute[74337]: DEBUG nova.compute.manager [req-02262a84-7d6e-4b10-8ea8-9820804fc91d req-2d4c6241-c9eb-4cb3-b4ab-1b0989a2ccb5 service nova] [instance: 106da458-caec-4114-8904-0411ec0ea903] No waiting events found dispatching network-vif-unplugged-7a60434b-7f31-4b05-a494-97e58e72a5c1 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 22:14:27 user nova-compute[74337]: DEBUG nova.compute.manager [req-02262a84-7d6e-4b10-8ea8-9820804fc91d req-2d4c6241-c9eb-4cb3-b4ab-1b0989a2ccb5 service nova] [instance: 106da458-caec-4114-8904-0411ec0ea903] Received event network-vif-unplugged-7a60434b-7f31-4b05-a494-97e58e72a5c1 for instance with task_state deleting. {{(pid=74337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 22:14:27 user nova-compute[74337]: DEBUG nova.network.neutron [req-e16dc793-e3df-44a6-b284-2a8a0ab86d06 req-01100cd6-3045-4be6-83ed-4900dddcd5f6 service nova] [instance: 106da458-caec-4114-8904-0411ec0ea903] Updated VIF entry in instance network info cache for port 7a60434b-7f31-4b05-a494-97e58e72a5c1. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 22:14:27 user nova-compute[74337]: DEBUG nova.network.neutron [req-e16dc793-e3df-44a6-b284-2a8a0ab86d06 req-01100cd6-3045-4be6-83ed-4900dddcd5f6 service nova] [instance: 106da458-caec-4114-8904-0411ec0ea903] Updating instance_info_cache with network_info: [{"id": "7a60434b-7f31-4b05-a494-97e58e72a5c1", "address": "fa:16:3e:ea:23:b1", "network": {"id": "09783701-f9c4-4d08-8523-6e363a558ec0", "bridge": "br-int", "label": "tempest-TestStampPattern-974584378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc044020751d475b94e96fcedb97b86c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a60434b-7f", "ovs_interfaceid": "7a60434b-7f31-4b05-a494-97e58e72a5c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 22:14:27 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-e16dc793-e3df-44a6-b284-2a8a0ab86d06 req-01100cd6-3045-4be6-83ed-4900dddcd5f6 service nova] Releasing lock "refresh_cache-106da458-caec-4114-8904-0411ec0ea903" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 22:14:27 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: 106da458-caec-4114-8904-0411ec0ea903] Instance destroyed successfully.
Oct 23 22:14:27 user nova-compute[74337]: DEBUG nova.objects.instance [None req-100e2a3c-3a73-4178-be1b-2858e560de46 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Lazy-loading 'resources' on Instance uuid 106da458-caec-4114-8904-0411ec0ea903 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:14:27 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-100e2a3c-3a73-4178-be1b-2858e560de46 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T22:06:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-317244420',display_name='tempest-TestStampPattern-server-317244420',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-317244420',id=48,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM/w5IxSPpZmfXwphA/Co4/hp2D6fAjEAT72VAt3V+4E9LsYzs0Ns5n7Z6WZABZZJFZarcd4Py5ieFgN0v3D5Oi+9O8evYRVN2/Q9FEiDD/ZoEa6QuGDQ0iF55PrsWzQHw==',key_name='tempest-TestStampPattern-561385519',keypairs=<?>,launch_index=0,launched_at=2023-10-23T22:06:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bc044020751d475b94e96fcedb97b86c',ramdisk_id='',reservation_id='r-7d6d42jk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-955971620',owner_user_name='tempest-TestStampPattern-955971620-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T22:10:09Z,user_data=None,user_id='a96a8803687f4b7db06e29b5b736ade1',uuid=106da458-caec-4114-8904-0411ec0ea903,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7a60434b-7f31-4b05-a494-97e58e72a5c1", "address": "fa:16:3e:ea:23:b1", "network": {"id": "09783701-f9c4-4d08-8523-6e363a558ec0", "bridge": "br-int", "label": "tempest-TestStampPattern-974584378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc044020751d475b94e96fcedb97b86c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a60434b-7f", "ovs_interfaceid": "7a60434b-7f31-4b05-a494-97e58e72a5c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 22:14:27 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-100e2a3c-3a73-4178-be1b-2858e560de46 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Converting VIF {"id": "7a60434b-7f31-4b05-a494-97e58e72a5c1", "address": "fa:16:3e:ea:23:b1", "network": {"id": "09783701-f9c4-4d08-8523-6e363a558ec0", "bridge": "br-int", "label": "tempest-TestStampPattern-974584378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc044020751d475b94e96fcedb97b86c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a60434b-7f", "ovs_interfaceid": "7a60434b-7f31-4b05-a494-97e58e72a5c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 22:14:27 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-100e2a3c-3a73-4178-be1b-2858e560de46 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ea:23:b1,bridge_name='br-int',has_traffic_filtering=True,id=7a60434b-7f31-4b05-a494-97e58e72a5c1,network=Network(09783701-f9c4-4d08-8523-6e363a558ec0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a60434b-7f') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 22:14:27 user nova-compute[74337]: DEBUG os_vif [None req-100e2a3c-3a73-4178-be1b-2858e560de46 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:23:b1,bridge_name='br-int',has_traffic_filtering=True,id=7a60434b-7f31-4b05-a494-97e58e72a5c1,network=Network(09783701-f9c4-4d08-8523-6e363a558ec0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a60434b-7f') {{(pid=74337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 22:14:27 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:14:27 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7a60434b-7f, bridge=br-int, if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:14:27 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:14:27 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:14:27 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:14:27 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a8958136-50c0-4c20-bb9c-ec10d0b622cf) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:14:27 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:14:27 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:14:27 user nova-compute[74337]: INFO os_vif [None req-100e2a3c-3a73-4178-be1b-2858e560de46 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:23:b1,bridge_name='br-int',has_traffic_filtering=True,id=7a60434b-7f31-4b05-a494-97e58e72a5c1,network=Network(09783701-f9c4-4d08-8523-6e363a558ec0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a60434b-7f')
Oct 23 22:14:27 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-100e2a3c-3a73-4178-be1b-2858e560de46 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] [instance: 106da458-caec-4114-8904-0411ec0ea903] Deleting instance files /opt/stack/data/nova/instances/106da458-caec-4114-8904-0411ec0ea903_del
Oct 23 22:14:27 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-100e2a3c-3a73-4178-be1b-2858e560de46 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] [instance: 106da458-caec-4114-8904-0411ec0ea903] Deletion of /opt/stack/data/nova/instances/106da458-caec-4114-8904-0411ec0ea903_del complete
Oct 23 22:14:27 user nova-compute[74337]: INFO nova.compute.manager [None req-100e2a3c-3a73-4178-be1b-2858e560de46 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] [instance: 106da458-caec-4114-8904-0411ec0ea903] Took 0.89 seconds to destroy the instance on the hypervisor.
Oct 23 22:14:27 user nova-compute[74337]: DEBUG oslo.service.loopingcall [None req-100e2a3c-3a73-4178-be1b-2858e560de46 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74337) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 22:14:27 user nova-compute[74337]: DEBUG nova.compute.manager [-] [instance: 106da458-caec-4114-8904-0411ec0ea903] Deallocating network for instance {{(pid=74337) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 22:14:27 user nova-compute[74337]: DEBUG nova.network.neutron [-] [instance: 106da458-caec-4114-8904-0411ec0ea903] deallocate_for_instance() {{(pid=74337) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 22:14:27 user nova-compute[74337]: DEBUG nova.objects.instance [None req-11eec6a3-baeb-4db2-9b43-6f4316794dec tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Lazy-loading 'flavor' on Instance uuid 61fe098a-5958-4ad1-8f92-4592809299b7 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:14:27 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-11eec6a3-baeb-4db2-9b43-6f4316794dec tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Lock "61fe098a-5958-4ad1-8f92-4592809299b7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.857s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:14:28 user nova-compute[74337]: DEBUG nova.network.neutron [-] [instance: 106da458-caec-4114-8904-0411ec0ea903] Updating instance_info_cache with network_info: [] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 22:14:28 user nova-compute[74337]: INFO nova.compute.manager [-] [instance: 106da458-caec-4114-8904-0411ec0ea903] Took 0.69 seconds to deallocate network for instance.
Oct 23 22:14:28 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-100e2a3c-3a73-4178-be1b-2858e560de46 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:14:28 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-100e2a3c-3a73-4178-be1b-2858e560de46 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:14:28 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-100e2a3c-3a73-4178-be1b-2858e560de46 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 22:14:28 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-100e2a3c-3a73-4178-be1b-2858e560de46 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 22:14:28 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-100e2a3c-3a73-4178-be1b-2858e560de46 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.216s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:14:28 user nova-compute[74337]: INFO nova.scheduler.client.report [None req-100e2a3c-3a73-4178-be1b-2858e560de46 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Deleted allocations for instance 106da458-caec-4114-8904-0411ec0ea903
Oct 23 22:14:28 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-100e2a3c-3a73-4178-be1b-2858e560de46 tempest-TestStampPattern-955971620 tempest-TestStampPattern-955971620-project-member] Lock "106da458-caec-4114-8904-0411ec0ea903" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.017s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:14:29 user nova-compute[74337]: DEBUG nova.compute.manager [req-a605158c-1b6a-451e-ba2a-116104b9eef1 req-0c4a8334-810a-454d-bbd9-f7dad14489d8 service nova] [instance: 106da458-caec-4114-8904-0411ec0ea903] Received event network-vif-plugged-7a60434b-7f31-4b05-a494-97e58e72a5c1 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:14:29 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-a605158c-1b6a-451e-ba2a-116104b9eef1 req-0c4a8334-810a-454d-bbd9-f7dad14489d8 service nova] Acquiring lock "106da458-caec-4114-8904-0411ec0ea903-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:14:29 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-a605158c-1b6a-451e-ba2a-116104b9eef1 req-0c4a8334-810a-454d-bbd9-f7dad14489d8 service nova] Lock "106da458-caec-4114-8904-0411ec0ea903-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:14:29 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-a605158c-1b6a-451e-ba2a-116104b9eef1 req-0c4a8334-810a-454d-bbd9-f7dad14489d8 service nova] Lock "106da458-caec-4114-8904-0411ec0ea903-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:14:29 user nova-compute[74337]: DEBUG nova.compute.manager [req-a605158c-1b6a-451e-ba2a-116104b9eef1 req-0c4a8334-810a-454d-bbd9-f7dad14489d8 service nova] [instance: 106da458-caec-4114-8904-0411ec0ea903] No waiting events found dispatching network-vif-plugged-7a60434b-7f31-4b05-a494-97e58e72a5c1 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 22:14:29 user nova-compute[74337]: WARNING nova.compute.manager [req-a605158c-1b6a-451e-ba2a-116104b9eef1 req-0c4a8334-810a-454d-bbd9-f7dad14489d8 service nova] [instance: 106da458-caec-4114-8904-0411ec0ea903] Received unexpected event network-vif-plugged-7a60434b-7f31-4b05-a494-97e58e72a5c1 for instance with vm_state deleted and task_state None.
Oct 23 22:14:29 user nova-compute[74337]: DEBUG nova.compute.manager [req-a605158c-1b6a-451e-ba2a-116104b9eef1 req-0c4a8334-810a-454d-bbd9-f7dad14489d8 service nova] [instance: 106da458-caec-4114-8904-0411ec0ea903] Received event network-vif-deleted-7a60434b-7f31-4b05-a494-97e58e72a5c1 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:14:29 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:14:29 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:14:29 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 22:14:32 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:14:32 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:14:33 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:14:33 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:14:33 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:14:35 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:14:36 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:14:36 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:14:36 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:14:36 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:14:36 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Auditing locally available compute resources for user (node: user) {{(pid=74337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 22:14:36 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/999843b2-b757-480b-bd21-bf281954bc46/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:14:36 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/999843b2-b757-480b-bd21-bf281954bc46/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:14:36 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/999843b2-b757-480b-bd21-bf281954bc46/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:14:37 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/999843b2-b757-480b-bd21-bf281954bc46/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:14:37 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61fe098a-5958-4ad1-8f92-4592809299b7/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:14:37 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61fe098a-5958-4ad1-8f92-4592809299b7/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:14:37 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61fe098a-5958-4ad1-8f92-4592809299b7/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:14:37 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61fe098a-5958-4ad1-8f92-4592809299b7/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:14:37 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk.rescue --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:14:37 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:14:37 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:14:37 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk.rescue --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:14:37 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk.rescue --force-share --output=json" returned: 0 in 0.232s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:14:37 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:14:38 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:14:38 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:14:38 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:14:38 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:14:38 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:14:38 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Hypervisor/Node resource view: name=user free_ram=8643MB free_disk=25.140995025634766GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 22:14:38 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:14:38 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:14:38 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 999843b2-b757-480b-bd21-bf281954bc46 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 22:14:38 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 27710919-a717-42fa-a436-a261d92c1c2a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 22:14:38 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 61fe098a-5958-4ad1-8f92-4592809299b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 22:14:38 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 22:14:38 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 22:14:39 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 22:14:39 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 22:14:39 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Compute_service record updated for user:user {{(pid=74337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 22:14:39 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.492s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:14:41 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:14:41 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:14:41 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Starting heal instance info cache {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 22:14:41 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Didn't find any instances for network info cache update. {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 23 22:14:42 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:14:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:14:52 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:14:52 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:14:52 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 22:14:52 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 22:14:52 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 22:14:52 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:14:54 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:14:54 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Cleaning up deleted instances {{(pid=74337) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 23 22:14:54 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] There are 0 instances to clean {{(pid=74337) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 23 22:14:56 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4c7f7e09-3aa7-4070-831e-9e2e6795d215 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Acquiring lock "61fe098a-5958-4ad1-8f92-4592809299b7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:14:56 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4c7f7e09-3aa7-4070-831e-9e2e6795d215 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Lock "61fe098a-5958-4ad1-8f92-4592809299b7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:14:56 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4c7f7e09-3aa7-4070-831e-9e2e6795d215 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Acquiring lock "61fe098a-5958-4ad1-8f92-4592809299b7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:14:56 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4c7f7e09-3aa7-4070-831e-9e2e6795d215 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Lock "61fe098a-5958-4ad1-8f92-4592809299b7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:14:56 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4c7f7e09-3aa7-4070-831e-9e2e6795d215 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Lock "61fe098a-5958-4ad1-8f92-4592809299b7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:14:56 user nova-compute[74337]: INFO nova.compute.manager [None req-4c7f7e09-3aa7-4070-831e-9e2e6795d215 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Terminating instance
Oct 23 22:14:56 user nova-compute[74337]: DEBUG nova.compute.manager [None req-4c7f7e09-3aa7-4070-831e-9e2e6795d215 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Start destroying the instance on the hypervisor. {{(pid=74337) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 22:14:56 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:14:56 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:14:56 user nova-compute[74337]: DEBUG nova.compute.manager [req-f5b60b50-aaf4-4a9e-8ed2-089327fea8d8 req-a95fca7a-b3c8-4fbe-9f37-dc1f33d24e1a service nova] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Received event network-vif-unplugged-496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:14:56 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-f5b60b50-aaf4-4a9e-8ed2-089327fea8d8 req-a95fca7a-b3c8-4fbe-9f37-dc1f33d24e1a service nova] Acquiring lock "61fe098a-5958-4ad1-8f92-4592809299b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:14:56 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-f5b60b50-aaf4-4a9e-8ed2-089327fea8d8 req-a95fca7a-b3c8-4fbe-9f37-dc1f33d24e1a service nova] Lock "61fe098a-5958-4ad1-8f92-4592809299b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:14:56 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-f5b60b50-aaf4-4a9e-8ed2-089327fea8d8 req-a95fca7a-b3c8-4fbe-9f37-dc1f33d24e1a service nova] Lock "61fe098a-5958-4ad1-8f92-4592809299b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:14:56 user nova-compute[74337]: DEBUG nova.compute.manager [req-f5b60b50-aaf4-4a9e-8ed2-089327fea8d8 req-a95fca7a-b3c8-4fbe-9f37-dc1f33d24e1a service nova] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] No waiting events found dispatching network-vif-unplugged-496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 22:14:56 user nova-compute[74337]: DEBUG nova.compute.manager [req-f5b60b50-aaf4-4a9e-8ed2-089327fea8d8 req-a95fca7a-b3c8-4fbe-9f37-dc1f33d24e1a service nova] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Received event network-vif-unplugged-496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74 for instance with task_state deleting. {{(pid=74337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 22:14:56 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:14:56 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:14:56 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:14:56 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Instance destroyed successfully.
Oct 23 22:14:56 user nova-compute[74337]: DEBUG nova.objects.instance [None req-4c7f7e09-3aa7-4070-831e-9e2e6795d215 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Lazy-loading 'resources' on Instance uuid 61fe098a-5958-4ad1-8f92-4592809299b7 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:14:56 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-4c7f7e09-3aa7-4070-831e-9e2e6795d215 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T22:08:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-304244242',display_name='tempest-ServerRescueNegativeTestJSON-server-304244242',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-304244242',id=49,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHAcn+lLjOkIvykUlFztTMs08y2PxFnR7VYNivrfRgQdTZ3Fh25r9lJLsxrN7NFbZG+ODLyw1l+MPPzgV0N2Zq+awnrJEM4oA1Yu0mPfvb90MvOI3M2oZILyN6yuviVcmA==',key_name='tempest-keypair-723189200',keypairs=<?>,launch_index=0,launched_at=2023-10-23T22:10:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='80f79dd6954748e4806a568a4127396f',ramdisk_id='',reservation_id='r-67hxw7ij',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2089412853',owner_user_name='tempest-ServerRescueNegativeTestJSON-2089412853-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T22:12:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0f5c4ec386544e1afd2f0a7d1b1c94f',uuid=61fe098a-5958-4ad1-8f92-4592809299b7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74", "address": "fa:16:3e:68:65:1a", "network": {"id": "122fdd20-8bf5-4374-b50c-82e5dc8684db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-81475496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80f79dd6954748e4806a568a4127396f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap496ce3c5-18", "ovs_interfaceid": "496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 22:14:56 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-4c7f7e09-3aa7-4070-831e-9e2e6795d215 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Converting VIF {"id": "496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74", "address": "fa:16:3e:68:65:1a", "network": {"id": "122fdd20-8bf5-4374-b50c-82e5dc8684db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-81475496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80f79dd6954748e4806a568a4127396f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap496ce3c5-18", "ovs_interfaceid": "496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 22:14:56 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-4c7f7e09-3aa7-4070-831e-9e2e6795d215 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:68:65:1a,bridge_name='br-int',has_traffic_filtering=True,id=496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74,network=Network(122fdd20-8bf5-4374-b50c-82e5dc8684db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap496ce3c5-18') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 22:14:56 user nova-compute[74337]: DEBUG os_vif [None req-4c7f7e09-3aa7-4070-831e-9e2e6795d215 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:65:1a,bridge_name='br-int',has_traffic_filtering=True,id=496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74,network=Network(122fdd20-8bf5-4374-b50c-82e5dc8684db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap496ce3c5-18') {{(pid=74337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 22:14:56 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:14:56 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap496ce3c5-18, bridge=br-int, if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:14:56 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:14:56 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:14:56 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:14:56 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b11932bb-e10f-45a6-8596-b74d80ed11be) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:14:56 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:14:56 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:14:56 user nova-compute[74337]: INFO os_vif [None req-4c7f7e09-3aa7-4070-831e-9e2e6795d215 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:65:1a,bridge_name='br-int',has_traffic_filtering=True,id=496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74,network=Network(122fdd20-8bf5-4374-b50c-82e5dc8684db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap496ce3c5-18')
Oct 23 22:14:56 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-4c7f7e09-3aa7-4070-831e-9e2e6795d215 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Deleting instance files /opt/stack/data/nova/instances/61fe098a-5958-4ad1-8f92-4592809299b7_del
Oct 23 22:14:56 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-4c7f7e09-3aa7-4070-831e-9e2e6795d215 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Deletion of /opt/stack/data/nova/instances/61fe098a-5958-4ad1-8f92-4592809299b7_del complete
Oct 23 22:14:57 user nova-compute[74337]: INFO nova.compute.manager [None req-4c7f7e09-3aa7-4070-831e-9e2e6795d215 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Took 0.89 seconds to destroy the instance on the hypervisor.
Oct 23 22:14:57 user nova-compute[74337]: DEBUG oslo.service.loopingcall [None req-4c7f7e09-3aa7-4070-831e-9e2e6795d215 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74337) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 22:14:57 user nova-compute[74337]: DEBUG nova.compute.manager [-] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Deallocating network for instance {{(pid=74337) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 22:14:57 user nova-compute[74337]: DEBUG nova.network.neutron [-] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] deallocate_for_instance() {{(pid=74337) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 22:14:57 user nova-compute[74337]: DEBUG nova.network.neutron [-] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Updating instance_info_cache with network_info: [] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 22:14:57 user nova-compute[74337]: INFO nova.compute.manager [-] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Took 0.73 seconds to deallocate network for instance.
Oct 23 22:14:57 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4c7f7e09-3aa7-4070-831e-9e2e6795d215 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:14:57 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4c7f7e09-3aa7-4070-831e-9e2e6795d215 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:14:57 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-4c7f7e09-3aa7-4070-831e-9e2e6795d215 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 22:14:57 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-4c7f7e09-3aa7-4070-831e-9e2e6795d215 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 22:14:57 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4c7f7e09-3aa7-4070-831e-9e2e6795d215 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.145s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:14:57 user nova-compute[74337]: INFO nova.scheduler.client.report [None req-4c7f7e09-3aa7-4070-831e-9e2e6795d215 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Deleted allocations for instance 61fe098a-5958-4ad1-8f92-4592809299b7
Oct 23 22:14:58 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4c7f7e09-3aa7-4070-831e-9e2e6795d215 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Lock "61fe098a-5958-4ad1-8f92-4592809299b7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.922s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:14:58 user nova-compute[74337]: DEBUG nova.compute.manager [req-be74fc9f-da3a-4d58-a97f-a868aa6e64ab req-ab2ab140-3e9b-496c-97c5-0d3eee2349fd service nova] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Received event network-vif-plugged-496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:14:58 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-be74fc9f-da3a-4d58-a97f-a868aa6e64ab req-ab2ab140-3e9b-496c-97c5-0d3eee2349fd service nova] Acquiring lock "61fe098a-5958-4ad1-8f92-4592809299b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:14:58 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-be74fc9f-da3a-4d58-a97f-a868aa6e64ab req-ab2ab140-3e9b-496c-97c5-0d3eee2349fd service nova] Lock "61fe098a-5958-4ad1-8f92-4592809299b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:14:58 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-be74fc9f-da3a-4d58-a97f-a868aa6e64ab req-ab2ab140-3e9b-496c-97c5-0d3eee2349fd service nova] Lock "61fe098a-5958-4ad1-8f92-4592809299b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:14:58 user nova-compute[74337]: DEBUG nova.compute.manager [req-be74fc9f-da3a-4d58-a97f-a868aa6e64ab req-ab2ab140-3e9b-496c-97c5-0d3eee2349fd service nova] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] No waiting events found dispatching network-vif-plugged-496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 22:14:58 user nova-compute[74337]: WARNING nova.compute.manager [req-be74fc9f-da3a-4d58-a97f-a868aa6e64ab req-ab2ab140-3e9b-496c-97c5-0d3eee2349fd service nova] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Received unexpected event network-vif-plugged-496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74 for instance with vm_state deleted and task_state None.
Oct 23 22:14:58 user nova-compute[74337]: DEBUG nova.compute.manager [req-be74fc9f-da3a-4d58-a97f-a868aa6e64ab req-ab2ab140-3e9b-496c-97c5-0d3eee2349fd service nova] [instance: 61fe098a-5958-4ad1-8f92-4592809299b7] Received event network-vif-deleted-496ce3c5-18e7-43d7-9a7e-2ab40cbe6c74 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:14:59 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:14:59 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74337) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 23 22:15:01 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:15:06 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:15:06 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:15:06 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 22:15:06 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 22:15:06 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 22:15:06 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:15:11 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:15:16 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:15:18 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:15:21 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:15:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:15:29 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:15:29 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:15:29 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 22:15:30 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:15:31 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:15:33 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:15:33 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:15:34 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:15:35 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:15:36 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:15:36 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:15:36 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:15:36 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:15:36 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:15:36 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Auditing locally available compute resources for user (node: user) {{(pid=74337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 22:15:36 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/999843b2-b757-480b-bd21-bf281954bc46/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:15:36 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/999843b2-b757-480b-bd21-bf281954bc46/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:15:36 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/999843b2-b757-480b-bd21-bf281954bc46/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:15:36 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:15:36 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/999843b2-b757-480b-bd21-bf281954bc46/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:15:36 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk.rescue --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:15:37 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:15:37 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk.rescue --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:15:37 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:15:37 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:15:37 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:15:37 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:15:37 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:15:38 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:15:38 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:15:38 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Hypervisor/Node resource view: name=user free_ram=8787MB free_disk=25.158557891845703GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 22:15:38 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:15:38 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:15:38 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 999843b2-b757-480b-bd21-bf281954bc46 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 22:15:38 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 27710919-a717-42fa-a436-a261d92c1c2a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 22:15:38 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 22:15:38 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 22:15:38 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Refreshing inventories for resource provider dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 23 22:15:38 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Updating ProviderTree inventory for provider dfcf3942-a432-4293-945b-14b86f57d794 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 23 22:15:38 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Updating inventory in ProviderTree for provider dfcf3942-a432-4293-945b-14b86f57d794 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 23 22:15:38 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Refreshing aggregate associations for resource provider dfcf3942-a432-4293-945b-14b86f57d794, aggregates: None {{(pid=74337) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 23 22:15:38 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Refreshing trait associations for resource provider dfcf3942-a432-4293-945b-14b86f57d794, traits: COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE2,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE42,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_EXTEND,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_TRUSTED_CERTS {{(pid=74337) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 23 22:15:38 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 22:15:38 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 22:15:38 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Compute_service record updated for user:user {{(pid=74337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 22:15:38 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.407s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:15:39 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:15:41 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:15:41 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:15:41 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Starting heal instance info cache {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 22:15:41 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Rebuilding the list of instances to heal {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 22:15:41 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:15:41 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "refresh_cache-999843b2-b757-480b-bd21-bf281954bc46" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 22:15:41 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquired lock "refresh_cache-999843b2-b757-480b-bd21-bf281954bc46" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 22:15:41 user nova-compute[74337]: DEBUG nova.network.neutron [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Forcefully refreshing network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 22:15:41 user nova-compute[74337]: DEBUG nova.objects.instance [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lazy-loading 'info_cache' on Instance uuid 999843b2-b757-480b-bd21-bf281954bc46 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:15:41 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:15:42 user nova-compute[74337]: DEBUG nova.network.neutron [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Updating instance_info_cache with network_info: [{"id": "02913be6-773f-402a-a534-d7567aeb5b7a", "address": "fa:16:3e:a2:cd:9d", "network": {"id": "122fdd20-8bf5-4374-b50c-82e5dc8684db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-81475496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80f79dd6954748e4806a568a4127396f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02913be6-77", "ovs_interfaceid": "02913be6-773f-402a-a534-d7567aeb5b7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 22:15:42 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Releasing lock "refresh_cache-999843b2-b757-480b-bd21-bf281954bc46" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 22:15:42 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Updated the network info_cache for instance {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 22:15:44 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:15:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:15:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:15:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:15:47 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:15:49 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:15:51 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:15:52 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-802bac7d-e04f-451e-8cfa-d889c8517e1b tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Acquiring lock "40c79805-6e80-4c44-90ca-27a2af6be3bd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:15:52 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-802bac7d-e04f-451e-8cfa-d889c8517e1b tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Lock "40c79805-6e80-4c44-90ca-27a2af6be3bd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:15:52 user nova-compute[74337]: DEBUG nova.compute.manager [None req-802bac7d-e04f-451e-8cfa-d889c8517e1b tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Starting instance... {{(pid=74337) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 23 22:15:52 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-802bac7d-e04f-451e-8cfa-d889c8517e1b tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:15:52 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-802bac7d-e04f-451e-8cfa-d889c8517e1b tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:15:52 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-802bac7d-e04f-451e-8cfa-d889c8517e1b tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74337) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 23 22:15:52 user nova-compute[74337]: INFO nova.compute.claims [None req-802bac7d-e04f-451e-8cfa-d889c8517e1b tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Claim successful on node user
Oct 23 22:15:53 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-802bac7d-e04f-451e-8cfa-d889c8517e1b tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 22:15:53 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-802bac7d-e04f-451e-8cfa-d889c8517e1b tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 22:15:53 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-802bac7d-e04f-451e-8cfa-d889c8517e1b tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.298s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:15:53 user nova-compute[74337]: DEBUG nova.compute.manager [None req-802bac7d-e04f-451e-8cfa-d889c8517e1b tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Start building networks asynchronously for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 23 22:15:53 user nova-compute[74337]: DEBUG nova.compute.manager [None req-802bac7d-e04f-451e-8cfa-d889c8517e1b tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Allocating IP information in the background. {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 23 22:15:53 user nova-compute[74337]: DEBUG nova.network.neutron [None req-802bac7d-e04f-451e-8cfa-d889c8517e1b tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] allocate_for_instance() {{(pid=74337) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 23 22:15:53 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-802bac7d-e04f-451e-8cfa-d889c8517e1b tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 23 22:15:53 user nova-compute[74337]: DEBUG nova.compute.manager [None req-802bac7d-e04f-451e-8cfa-d889c8517e1b tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Start building block device mappings for instance. {{(pid=74337) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 23 22:15:53 user nova-compute[74337]: DEBUG nova.policy [None req-802bac7d-e04f-451e-8cfa-d889c8517e1b tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fca6fd7d79d64b6085bfccaaff8a1dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650cb403fcd142f485bd9b3fad1e0bd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74337) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 23 22:15:53 user nova-compute[74337]: DEBUG nova.compute.manager [None req-802bac7d-e04f-451e-8cfa-d889c8517e1b tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Start spawning the instance on the hypervisor. {{(pid=74337) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 23 22:15:53 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-802bac7d-e04f-451e-8cfa-d889c8517e1b tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Creating instance directory {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 23 22:15:53 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-802bac7d-e04f-451e-8cfa-d889c8517e1b tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Creating image(s)
Oct 23 22:15:53 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-802bac7d-e04f-451e-8cfa-d889c8517e1b tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Acquiring lock "/opt/stack/data/nova/instances/40c79805-6e80-4c44-90ca-27a2af6be3bd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:15:53 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-802bac7d-e04f-451e-8cfa-d889c8517e1b tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Lock "/opt/stack/data/nova/instances/40c79805-6e80-4c44-90ca-27a2af6be3bd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:15:53 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-802bac7d-e04f-451e-8cfa-d889c8517e1b tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Lock "/opt/stack/data/nova/instances/40c79805-6e80-4c44-90ca-27a2af6be3bd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:15:53 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-802bac7d-e04f-451e-8cfa-d889c8517e1b tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:15:53 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-802bac7d-e04f-451e-8cfa-d889c8517e1b tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.209s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:15:53 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-802bac7d-e04f-451e-8cfa-d889c8517e1b tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Acquiring lock "fc7b140751b8c385de81623e40fb09ce09374ab7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:15:53 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-802bac7d-e04f-451e-8cfa-d889c8517e1b tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Lock "fc7b140751b8c385de81623e40fb09ce09374ab7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:15:53 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-802bac7d-e04f-451e-8cfa-d889c8517e1b tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:15:53 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-802bac7d-e04f-451e-8cfa-d889c8517e1b tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.189s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:15:53 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-802bac7d-e04f-451e-8cfa-d889c8517e1b tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7,backing_fmt=raw /opt/stack/data/nova/instances/40c79805-6e80-4c44-90ca-27a2af6be3bd/disk 1073741824 {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:15:54 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-802bac7d-e04f-451e-8cfa-d889c8517e1b tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7,backing_fmt=raw /opt/stack/data/nova/instances/40c79805-6e80-4c44-90ca-27a2af6be3bd/disk 1073741824" returned: 0 in 0.050s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:15:54 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-802bac7d-e04f-451e-8cfa-d889c8517e1b tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Lock "fc7b140751b8c385de81623e40fb09ce09374ab7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:15:54 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-802bac7d-e04f-451e-8cfa-d889c8517e1b tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:15:54 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-802bac7d-e04f-451e-8cfa-d889c8517e1b tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7b140751b8c385de81623e40fb09ce09374ab7 --force-share --output=json" returned: 0 in 0.176s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:15:54 user nova-compute[74337]: DEBUG nova.virt.disk.api [None req-802bac7d-e04f-451e-8cfa-d889c8517e1b tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Checking if we can resize image /opt/stack/data/nova/instances/40c79805-6e80-4c44-90ca-27a2af6be3bd/disk. size=1073741824 {{(pid=74337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 23 22:15:54 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-802bac7d-e04f-451e-8cfa-d889c8517e1b tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c79805-6e80-4c44-90ca-27a2af6be3bd/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:15:54 user nova-compute[74337]: DEBUG nova.network.neutron [None req-802bac7d-e04f-451e-8cfa-d889c8517e1b tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Successfully created port: c754233d-824c-40ec-bae1-c4ed5a90b392 {{(pid=74337) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 23 22:15:54 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-802bac7d-e04f-451e-8cfa-d889c8517e1b tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c79805-6e80-4c44-90ca-27a2af6be3bd/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:15:54 user nova-compute[74337]: DEBUG nova.virt.disk.api [None req-802bac7d-e04f-451e-8cfa-d889c8517e1b tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Cannot resize image /opt/stack/data/nova/instances/40c79805-6e80-4c44-90ca-27a2af6be3bd/disk to a smaller size. {{(pid=74337) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 23 22:15:54 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-802bac7d-e04f-451e-8cfa-d889c8517e1b tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Created local disks {{(pid=74337) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 23 22:15:54 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-802bac7d-e04f-451e-8cfa-d889c8517e1b tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Ensure instance console log exists: /opt/stack/data/nova/instances/40c79805-6e80-4c44-90ca-27a2af6be3bd/console.log {{(pid=74337) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 23 22:15:54 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-802bac7d-e04f-451e-8cfa-d889c8517e1b tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:15:54 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-802bac7d-e04f-451e-8cfa-d889c8517e1b tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:15:54 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-802bac7d-e04f-451e-8cfa-d889c8517e1b tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:15:54 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:15:55 user nova-compute[74337]: DEBUG nova.network.neutron [None req-802bac7d-e04f-451e-8cfa-d889c8517e1b tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Successfully updated port: c754233d-824c-40ec-bae1-c4ed5a90b392 {{(pid=74337) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 23 22:15:55 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-802bac7d-e04f-451e-8cfa-d889c8517e1b tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Acquiring lock "refresh_cache-40c79805-6e80-4c44-90ca-27a2af6be3bd" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 22:15:55 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-802bac7d-e04f-451e-8cfa-d889c8517e1b tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Acquired lock "refresh_cache-40c79805-6e80-4c44-90ca-27a2af6be3bd" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 22:15:55 user nova-compute[74337]: DEBUG nova.network.neutron [None req-802bac7d-e04f-451e-8cfa-d889c8517e1b tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Building network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 23 22:15:55 user nova-compute[74337]: DEBUG nova.network.neutron [None req-802bac7d-e04f-451e-8cfa-d889c8517e1b tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Instance cache missing network info. {{(pid=74337) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 23 22:15:55 user nova-compute[74337]: DEBUG nova.compute.manager [req-be0d1d56-795b-49a2-8627-3223fcc7d69b req-4c81d657-6232-404c-b2fb-e5788070321d service nova] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Received event network-changed-c754233d-824c-40ec-bae1-c4ed5a90b392 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:15:55 user nova-compute[74337]: DEBUG nova.compute.manager [req-be0d1d56-795b-49a2-8627-3223fcc7d69b req-4c81d657-6232-404c-b2fb-e5788070321d service nova] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Refreshing instance network info cache due to event network-changed-c754233d-824c-40ec-bae1-c4ed5a90b392. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 22:15:55 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-be0d1d56-795b-49a2-8627-3223fcc7d69b req-4c81d657-6232-404c-b2fb-e5788070321d service nova] Acquiring lock "refresh_cache-40c79805-6e80-4c44-90ca-27a2af6be3bd" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 22:15:55 user nova-compute[74337]: DEBUG nova.network.neutron [None req-802bac7d-e04f-451e-8cfa-d889c8517e1b tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Updating instance_info_cache with network_info: [{"id": "c754233d-824c-40ec-bae1-c4ed5a90b392", "address": "fa:16:3e:28:38:e6", "network": {"id": "0110d432-0607-428c-b97f-68c5431cecea", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-718986578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "650cb403fcd142f485bd9b3fad1e0bd7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc754233d-82", "ovs_interfaceid": "c754233d-824c-40ec-bae1-c4ed5a90b392", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 22:15:55 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-802bac7d-e04f-451e-8cfa-d889c8517e1b tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Releasing lock "refresh_cache-40c79805-6e80-4c44-90ca-27a2af6be3bd" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 22:15:55 user nova-compute[74337]: DEBUG nova.compute.manager [None req-802bac7d-e04f-451e-8cfa-d889c8517e1b tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Instance network_info: |[{"id": "c754233d-824c-40ec-bae1-c4ed5a90b392", "address": "fa:16:3e:28:38:e6", "network": {"id": "0110d432-0607-428c-b97f-68c5431cecea", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-718986578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "650cb403fcd142f485bd9b3fad1e0bd7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc754233d-82", "ovs_interfaceid": "c754233d-824c-40ec-bae1-c4ed5a90b392", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74337) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 23 22:15:55 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-be0d1d56-795b-49a2-8627-3223fcc7d69b req-4c81d657-6232-404c-b2fb-e5788070321d service nova] Acquired lock "refresh_cache-40c79805-6e80-4c44-90ca-27a2af6be3bd" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 22:15:55 user nova-compute[74337]: DEBUG nova.network.neutron [req-be0d1d56-795b-49a2-8627-3223fcc7d69b req-4c81d657-6232-404c-b2fb-e5788070321d service nova] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Refreshing network info cache for port c754233d-824c-40ec-bae1-c4ed5a90b392 {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 22:15:55 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-802bac7d-e04f-451e-8cfa-d889c8517e1b tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Start _get_guest_xml network_info=[{"id": "c754233d-824c-40ec-bae1-c4ed5a90b392", "address": "fa:16:3e:28:38:e6", "network": {"id": "0110d432-0607-428c-b97f-68c5431cecea", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-718986578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "650cb403fcd142f485bd9b3fad1e0bd7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc754233d-82", "ovs_interfaceid": "c754233d-824c-40ec-bae1-c4ed5a90b392", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T21:29:21Z,direct_url=<?>,disk_format='qcow2',id=d859d89d-998d-4109-b26a-0d6e28152932,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ff43462300764979a6cf688444336a56',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T21:29:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'device_type': 'disk', 'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_options': None, 'image_id': 'd859d89d-998d-4109-b26a-0d6e28152932'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 23 22:15:55 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-802bac7d-e04f-451e-8cfa-d889c8517e1b tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:15:55 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-802bac7d-e04f-451e-8cfa-d889c8517e1b tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:15:55 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-802bac7d-e04f-451e-8cfa-d889c8517e1b tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 23 22:15:55 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-802bac7d-e04f-451e-8cfa-d889c8517e1b tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] CPU controller missing on host. {{(pid=74337) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 23 22:15:55 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-802bac7d-e04f-451e-8cfa-d889c8517e1b tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 23 22:15:55 user nova-compute[74337]: DEBUG nova.virt.libvirt.host [None req-802bac7d-e04f-451e-8cfa-d889c8517e1b tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] CPU controller found on host. {{(pid=74337) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 23 22:15:55 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-802bac7d-e04f-451e-8cfa-d889c8517e1b tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74337) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 23 22:15:55 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-802bac7d-e04f-451e-8cfa-d889c8517e1b tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-23T21:29:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-23T21:29:21Z,direct_url=<?>,disk_format='qcow2',id=d859d89d-998d-4109-b26a-0d6e28152932,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ff43462300764979a6cf688444336a56',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-23T21:29:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 23 22:15:55 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-802bac7d-e04f-451e-8cfa-d889c8517e1b tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Flavor limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 23 22:15:55 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-802bac7d-e04f-451e-8cfa-d889c8517e1b tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Image limits 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 23 22:15:55 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-802bac7d-e04f-451e-8cfa-d889c8517e1b tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Flavor pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 23 22:15:55 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-802bac7d-e04f-451e-8cfa-d889c8517e1b tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Image pref 0:0:0 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 23 22:15:55 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-802bac7d-e04f-451e-8cfa-d889c8517e1b tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74337) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 23 22:15:55 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-802bac7d-e04f-451e-8cfa-d889c8517e1b tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 23 22:15:55 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-802bac7d-e04f-451e-8cfa-d889c8517e1b tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 23 22:15:55 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-802bac7d-e04f-451e-8cfa-d889c8517e1b tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Got 1 possible topologies {{(pid=74337) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 23 22:15:55 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-802bac7d-e04f-451e-8cfa-d889c8517e1b tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 23 22:15:55 user nova-compute[74337]: DEBUG nova.virt.hardware [None req-802bac7d-e04f-451e-8cfa-d889c8517e1b tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74337) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 23 22:15:55 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-802bac7d-e04f-451e-8cfa-d889c8517e1b tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T22:15:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1080142120',display_name='tempest-SnapshotDataIntegrityTests-server-1080142120',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1080142120',id=52,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD0ZJ66/SS0QXICHfTuUYGPEF1OyTOZ8zgWMFGkWENzxXlkyHD7iJZjOlCf4M5DKWR0W6PhAS88D+FzAsNS+5TRAhLnCeF2D3URL5PVZe1Ml4toSg0GHyLrkFxpXwlhxnQ==',key_name='tempest-keypair-81986919',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='650cb403fcd142f485bd9b3fad1e0bd7',ramdisk_id='',reservation_id='r-tnxyd5kp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1345308748',owner_user_name='tempest-SnapshotDataIntegrityTests-1345308748-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T22:15:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fca6fd7d79d64b6085bfccaaff8a1dc4',uuid=40c79805-6e80-4c44-90ca-27a2af6be3bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c754233d-824c-40ec-bae1-c4ed5a90b392", "address": "fa:16:3e:28:38:e6", "network": {"id": "0110d432-0607-428c-b97f-68c5431cecea", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-718986578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "650cb403fcd142f485bd9b3fad1e0bd7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc754233d-82", "ovs_interfaceid": "c754233d-824c-40ec-bae1-c4ed5a90b392", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74337) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 23 22:15:55 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-802bac7d-e04f-451e-8cfa-d889c8517e1b tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Converting VIF {"id": "c754233d-824c-40ec-bae1-c4ed5a90b392", "address": "fa:16:3e:28:38:e6", "network": {"id": "0110d432-0607-428c-b97f-68c5431cecea", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-718986578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "650cb403fcd142f485bd9b3fad1e0bd7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc754233d-82", "ovs_interfaceid": "c754233d-824c-40ec-bae1-c4ed5a90b392", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 22:15:55 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-802bac7d-e04f-451e-8cfa-d889c8517e1b tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:38:e6,bridge_name='br-int',has_traffic_filtering=True,id=c754233d-824c-40ec-bae1-c4ed5a90b392,network=Network(0110d432-0607-428c-b97f-68c5431cecea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc754233d-82') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 22:15:55 user nova-compute[74337]: DEBUG nova.objects.instance [None req-802bac7d-e04f-451e-8cfa-d889c8517e1b tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Lazy-loading 'pci_devices' on Instance uuid 40c79805-6e80-4c44-90ca-27a2af6be3bd {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:15:55 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-802bac7d-e04f-451e-8cfa-d889c8517e1b tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] End _get_guest_xml xml=<domain type="kvm">
Oct 23 22:15:55 user nova-compute[74337]:   <uuid>40c79805-6e80-4c44-90ca-27a2af6be3bd</uuid>
Oct 23 22:15:55 user nova-compute[74337]:   <name>instance-00000034</name>
Oct 23 22:15:55 user nova-compute[74337]:   <memory>524288</memory>
Oct 23 22:15:55 user nova-compute[74337]:   <vcpu>1</vcpu>
Oct 23 22:15:55 user nova-compute[74337]:   <metadata>
Oct 23 22:15:55 user nova-compute[74337]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 23 22:15:55 user nova-compute[74337]:       <nova:package version="0.0.0"/>
Oct 23 22:15:55 user nova-compute[74337]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1080142120</nova:name>
Oct 23 22:15:55 user nova-compute[74337]:       <nova:creationTime>2023-10-23 22:15:55</nova:creationTime>
Oct 23 22:15:55 user nova-compute[74337]:       <nova:flavor name="m1.tiny">
Oct 23 22:15:55 user nova-compute[74337]:         <nova:memory>512</nova:memory>
Oct 23 22:15:55 user nova-compute[74337]:         <nova:disk>1</nova:disk>
Oct 23 22:15:55 user nova-compute[74337]:         <nova:swap>0</nova:swap>
Oct 23 22:15:55 user nova-compute[74337]:         <nova:ephemeral>0</nova:ephemeral>
Oct 23 22:15:55 user nova-compute[74337]:         <nova:vcpus>1</nova:vcpus>
Oct 23 22:15:55 user nova-compute[74337]:       </nova:flavor>
Oct 23 22:15:55 user nova-compute[74337]:       <nova:owner>
Oct 23 22:15:55 user nova-compute[74337]:         <nova:user uuid="fca6fd7d79d64b6085bfccaaff8a1dc4">tempest-SnapshotDataIntegrityTests-1345308748-project-member</nova:user>
Oct 23 22:15:55 user nova-compute[74337]:         <nova:project uuid="650cb403fcd142f485bd9b3fad1e0bd7">tempest-SnapshotDataIntegrityTests-1345308748</nova:project>
Oct 23 22:15:55 user nova-compute[74337]:       </nova:owner>
Oct 23 22:15:55 user nova-compute[74337]:       <nova:root type="image" uuid="d859d89d-998d-4109-b26a-0d6e28152932"/>
Oct 23 22:15:55 user nova-compute[74337]:       <nova:ports>
Oct 23 22:15:55 user nova-compute[74337]:         <nova:port uuid="c754233d-824c-40ec-bae1-c4ed5a90b392">
Oct 23 22:15:55 user nova-compute[74337]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 23 22:15:55 user nova-compute[74337]:         </nova:port>
Oct 23 22:15:55 user nova-compute[74337]:       </nova:ports>
Oct 23 22:15:55 user nova-compute[74337]:     </nova:instance>
Oct 23 22:15:55 user nova-compute[74337]:   </metadata>
Oct 23 22:15:55 user nova-compute[74337]:   <sysinfo type="smbios">
Oct 23 22:15:55 user nova-compute[74337]:     <system>
Oct 23 22:15:55 user nova-compute[74337]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 23 22:15:55 user nova-compute[74337]:       <entry name="product">OpenStack Nova</entry>
Oct 23 22:15:55 user nova-compute[74337]:       <entry name="version">0.0.0</entry>
Oct 23 22:15:55 user nova-compute[74337]:       <entry name="serial">40c79805-6e80-4c44-90ca-27a2af6be3bd</entry>
Oct 23 22:15:55 user nova-compute[74337]:       <entry name="uuid">40c79805-6e80-4c44-90ca-27a2af6be3bd</entry>
Oct 23 22:15:55 user nova-compute[74337]:       <entry name="family">Virtual Machine</entry>
Oct 23 22:15:55 user nova-compute[74337]:     </system>
Oct 23 22:15:55 user nova-compute[74337]:   </sysinfo>
Oct 23 22:15:55 user nova-compute[74337]:   <os>
Oct 23 22:15:55 user nova-compute[74337]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 23 22:15:55 user nova-compute[74337]:     <boot dev="hd"/>
Oct 23 22:15:55 user nova-compute[74337]:     <smbios mode="sysinfo"/>
Oct 23 22:15:55 user nova-compute[74337]:   </os>
Oct 23 22:15:55 user nova-compute[74337]:   <features>
Oct 23 22:15:55 user nova-compute[74337]:     <acpi/>
Oct 23 22:15:55 user nova-compute[74337]:     <apic/>
Oct 23 22:15:55 user nova-compute[74337]:     <vmcoreinfo/>
Oct 23 22:15:55 user nova-compute[74337]:   </features>
Oct 23 22:15:55 user nova-compute[74337]:   <clock offset="utc">
Oct 23 22:15:55 user nova-compute[74337]:     <timer name="pit" tickpolicy="delay"/>
Oct 23 22:15:55 user nova-compute[74337]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 23 22:15:55 user nova-compute[74337]:     <timer name="hpet" present="no"/>
Oct 23 22:15:55 user nova-compute[74337]:   </clock>
Oct 23 22:15:55 user nova-compute[74337]:   <cpu mode="custom" match="exact">
Oct 23 22:15:55 user nova-compute[74337]:     <model>Nehalem</model>
Oct 23 22:15:55 user nova-compute[74337]:     <topology sockets="1" cores="1" threads="1"/>
Oct 23 22:15:55 user nova-compute[74337]:   </cpu>
Oct 23 22:15:55 user nova-compute[74337]:   <devices>
Oct 23 22:15:55 user nova-compute[74337]:     <disk type="file" device="disk">
Oct 23 22:15:55 user nova-compute[74337]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 23 22:15:55 user nova-compute[74337]:       <source file="/opt/stack/data/nova/instances/40c79805-6e80-4c44-90ca-27a2af6be3bd/disk"/>
Oct 23 22:15:55 user nova-compute[74337]:       <target dev="vda" bus="virtio"/>
Oct 23 22:15:55 user nova-compute[74337]:     </disk>
Oct 23 22:15:55 user nova-compute[74337]:     <interface type="ethernet">
Oct 23 22:15:55 user nova-compute[74337]:       <mac address="fa:16:3e:28:38:e6"/>
Oct 23 22:15:55 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 22:15:55 user nova-compute[74337]:       <mtu size="1442"/>
Oct 23 22:15:55 user nova-compute[74337]:       <target dev="tapc754233d-82"/>
Oct 23 22:15:55 user nova-compute[74337]:     </interface>
Oct 23 22:15:55 user nova-compute[74337]:     <serial type="pty">
Oct 23 22:15:55 user nova-compute[74337]:       <log file="/opt/stack/data/nova/instances/40c79805-6e80-4c44-90ca-27a2af6be3bd/console.log" append="off"/>
Oct 23 22:15:55 user nova-compute[74337]:     </serial>
Oct 23 22:15:55 user nova-compute[74337]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 23 22:15:55 user nova-compute[74337]:     <video>
Oct 23 22:15:55 user nova-compute[74337]:       <model type="virtio"/>
Oct 23 22:15:55 user nova-compute[74337]:     </video>
Oct 23 22:15:55 user nova-compute[74337]:     <rng model="virtio">
Oct 23 22:15:55 user nova-compute[74337]:       <backend model="random">/dev/urandom</backend>
Oct 23 22:15:55 user nova-compute[74337]:     </rng>
Oct 23 22:15:55 user nova-compute[74337]:     <controller type="usb" index="0" model="none"/>
Oct 23 22:15:55 user nova-compute[74337]:     <memballoon model="virtio">
Oct 23 22:15:55 user nova-compute[74337]:       <stats period="10"/>
Oct 23 22:15:55 user nova-compute[74337]:     </memballoon>
Oct 23 22:15:55 user nova-compute[74337]:   </devices>
Oct 23 22:15:55 user nova-compute[74337]: </domain>
Oct 23 22:15:55 user nova-compute[74337]:  {{(pid=74337) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 23 22:15:55 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-802bac7d-e04f-451e-8cfa-d889c8517e1b tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T22:15:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1080142120',display_name='tempest-SnapshotDataIntegrityTests-server-1080142120',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1080142120',id=52,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD0ZJ66/SS0QXICHfTuUYGPEF1OyTOZ8zgWMFGkWENzxXlkyHD7iJZjOlCf4M5DKWR0W6PhAS88D+FzAsNS+5TRAhLnCeF2D3URL5PVZe1Ml4toSg0GHyLrkFxpXwlhxnQ==',key_name='tempest-keypair-81986919',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='650cb403fcd142f485bd9b3fad1e0bd7',ramdisk_id='',reservation_id='r-tnxyd5kp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1345308748',owner_user_name='tempest-SnapshotDataIntegrityTests-1345308748-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-23T22:15:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fca6fd7d79d64b6085bfccaaff8a1dc4',uuid=40c79805-6e80-4c44-90ca-27a2af6be3bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c754233d-824c-40ec-bae1-c4ed5a90b392", "address": "fa:16:3e:28:38:e6", "network": {"id": "0110d432-0607-428c-b97f-68c5431cecea", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-718986578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "650cb403fcd142f485bd9b3fad1e0bd7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc754233d-82", "ovs_interfaceid": "c754233d-824c-40ec-bae1-c4ed5a90b392", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 23 22:15:55 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-802bac7d-e04f-451e-8cfa-d889c8517e1b tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Converting VIF {"id": "c754233d-824c-40ec-bae1-c4ed5a90b392", "address": "fa:16:3e:28:38:e6", "network": {"id": "0110d432-0607-428c-b97f-68c5431cecea", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-718986578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "650cb403fcd142f485bd9b3fad1e0bd7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc754233d-82", "ovs_interfaceid": "c754233d-824c-40ec-bae1-c4ed5a90b392", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 22:15:55 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-802bac7d-e04f-451e-8cfa-d889c8517e1b tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:38:e6,bridge_name='br-int',has_traffic_filtering=True,id=c754233d-824c-40ec-bae1-c4ed5a90b392,network=Network(0110d432-0607-428c-b97f-68c5431cecea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc754233d-82') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 22:15:55 user nova-compute[74337]: DEBUG os_vif [None req-802bac7d-e04f-451e-8cfa-d889c8517e1b tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:38:e6,bridge_name='br-int',has_traffic_filtering=True,id=c754233d-824c-40ec-bae1-c4ed5a90b392,network=Network(0110d432-0607-428c-b97f-68c5431cecea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc754233d-82') {{(pid=74337) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 23 22:15:55 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:15:55 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:15:55 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 23 22:15:55 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:15:55 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e0edb6bb-5ee0-5b85-8e76-3af99403c5e4', '_type': 'linux-noop'}}, row=False) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:15:55 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:15:55 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:15:55 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:15:55 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc754233d-82, may_exist=True, interface_attrs={}) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:15:55 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc754233d-82, col_values=(('qos', UUID('05f67b07-3078-4a7c-b616-8d96a8420bb0')),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:15:55 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc754233d-82, col_values=(('external_ids', {'iface-id': 'c754233d-824c-40ec-bae1-c4ed5a90b392', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:38:e6', 'vm-uuid': '40c79805-6e80-4c44-90ca-27a2af6be3bd'}),), if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:15:55 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:15:55 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:15:55 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:15:55 user nova-compute[74337]: INFO os_vif [None req-802bac7d-e04f-451e-8cfa-d889c8517e1b tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:38:e6,bridge_name='br-int',has_traffic_filtering=True,id=c754233d-824c-40ec-bae1-c4ed5a90b392,network=Network(0110d432-0607-428c-b97f-68c5431cecea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc754233d-82')
Oct 23 22:15:55 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-802bac7d-e04f-451e-8cfa-d889c8517e1b tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] No BDM found with device name vda, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 22:15:55 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-802bac7d-e04f-451e-8cfa-d889c8517e1b tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] No VIF found with MAC fa:16:3e:28:38:e6, not building metadata {{(pid=74337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 22:15:55 user nova-compute[74337]: DEBUG nova.network.neutron [req-be0d1d56-795b-49a2-8627-3223fcc7d69b req-4c81d657-6232-404c-b2fb-e5788070321d service nova] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Updated VIF entry in instance network info cache for port c754233d-824c-40ec-bae1-c4ed5a90b392. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 22:15:55 user nova-compute[74337]: DEBUG nova.network.neutron [req-be0d1d56-795b-49a2-8627-3223fcc7d69b req-4c81d657-6232-404c-b2fb-e5788070321d service nova] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Updating instance_info_cache with network_info: [{"id": "c754233d-824c-40ec-bae1-c4ed5a90b392", "address": "fa:16:3e:28:38:e6", "network": {"id": "0110d432-0607-428c-b97f-68c5431cecea", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-718986578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "650cb403fcd142f485bd9b3fad1e0bd7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc754233d-82", "ovs_interfaceid": "c754233d-824c-40ec-bae1-c4ed5a90b392", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 22:15:55 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-be0d1d56-795b-49a2-8627-3223fcc7d69b req-4c81d657-6232-404c-b2fb-e5788070321d service nova] Releasing lock "refresh_cache-40c79805-6e80-4c44-90ca-27a2af6be3bd" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 22:15:56 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:15:56 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:15:56 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:15:57 user nova-compute[74337]: DEBUG nova.compute.manager [req-4d046dbb-2072-42d9-9afe-c5b6154252a1 req-75941ba7-b947-415a-b6a0-b09647ac23ab service nova] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Received event network-vif-plugged-c754233d-824c-40ec-bae1-c4ed5a90b392 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:15:57 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-4d046dbb-2072-42d9-9afe-c5b6154252a1 req-75941ba7-b947-415a-b6a0-b09647ac23ab service nova] Acquiring lock "40c79805-6e80-4c44-90ca-27a2af6be3bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:15:57 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-4d046dbb-2072-42d9-9afe-c5b6154252a1 req-75941ba7-b947-415a-b6a0-b09647ac23ab service nova] Lock "40c79805-6e80-4c44-90ca-27a2af6be3bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:15:57 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-4d046dbb-2072-42d9-9afe-c5b6154252a1 req-75941ba7-b947-415a-b6a0-b09647ac23ab service nova] Lock "40c79805-6e80-4c44-90ca-27a2af6be3bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:15:57 user nova-compute[74337]: DEBUG nova.compute.manager [req-4d046dbb-2072-42d9-9afe-c5b6154252a1 req-75941ba7-b947-415a-b6a0-b09647ac23ab service nova] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] No waiting events found dispatching network-vif-plugged-c754233d-824c-40ec-bae1-c4ed5a90b392 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 22:15:57 user nova-compute[74337]: WARNING nova.compute.manager [req-4d046dbb-2072-42d9-9afe-c5b6154252a1 req-75941ba7-b947-415a-b6a0-b09647ac23ab service nova] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Received unexpected event network-vif-plugged-c754233d-824c-40ec-bae1-c4ed5a90b392 for instance with vm_state building and task_state spawning.
Oct 23 22:15:57 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:15:57 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:15:57 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:15:58 user nova-compute[74337]: DEBUG nova.compute.manager [None req-802bac7d-e04f-451e-8cfa-d889c8517e1b tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Instance event wait completed in 0 seconds for  {{(pid=74337) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 23 22:15:58 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-802bac7d-e04f-451e-8cfa-d889c8517e1b tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Guest created on hypervisor {{(pid=74337) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 23 22:15:58 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Instance spawned successfully.
Oct 23 22:15:58 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-802bac7d-e04f-451e-8cfa-d889c8517e1b tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 23 22:15:58 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-802bac7d-e04f-451e-8cfa-d889c8517e1b tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Found default for hw_cdrom_bus of ide {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 22:15:58 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-802bac7d-e04f-451e-8cfa-d889c8517e1b tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Found default for hw_disk_bus of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 22:15:58 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-802bac7d-e04f-451e-8cfa-d889c8517e1b tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Found default for hw_input_bus of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 22:15:58 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-802bac7d-e04f-451e-8cfa-d889c8517e1b tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Found default for hw_pointer_model of None {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 22:15:58 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-802bac7d-e04f-451e-8cfa-d889c8517e1b tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Found default for hw_video_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 22:15:58 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-802bac7d-e04f-451e-8cfa-d889c8517e1b tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Found default for hw_vif_model of virtio {{(pid=74337) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 23 22:15:59 user nova-compute[74337]: INFO nova.compute.manager [None req-802bac7d-e04f-451e-8cfa-d889c8517e1b tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Took 5.52 seconds to spawn the instance on the hypervisor.
Oct 23 22:15:59 user nova-compute[74337]: DEBUG nova.compute.manager [None req-802bac7d-e04f-451e-8cfa-d889c8517e1b tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Checking state {{(pid=74337) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 23 22:15:59 user nova-compute[74337]: DEBUG nova.compute.manager [req-9e2fe734-5476-4730-95a3-57505493877e req-9fc350a0-4149-4785-a780-188709020c23 service nova] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Received event network-vif-plugged-c754233d-824c-40ec-bae1-c4ed5a90b392 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:15:59 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-9e2fe734-5476-4730-95a3-57505493877e req-9fc350a0-4149-4785-a780-188709020c23 service nova] Acquiring lock "40c79805-6e80-4c44-90ca-27a2af6be3bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:15:59 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-9e2fe734-5476-4730-95a3-57505493877e req-9fc350a0-4149-4785-a780-188709020c23 service nova] Lock "40c79805-6e80-4c44-90ca-27a2af6be3bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:15:59 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-9e2fe734-5476-4730-95a3-57505493877e req-9fc350a0-4149-4785-a780-188709020c23 service nova] Lock "40c79805-6e80-4c44-90ca-27a2af6be3bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:15:59 user nova-compute[74337]: DEBUG nova.compute.manager [req-9e2fe734-5476-4730-95a3-57505493877e req-9fc350a0-4149-4785-a780-188709020c23 service nova] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] No waiting events found dispatching network-vif-plugged-c754233d-824c-40ec-bae1-c4ed5a90b392 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 22:15:59 user nova-compute[74337]: WARNING nova.compute.manager [req-9e2fe734-5476-4730-95a3-57505493877e req-9fc350a0-4149-4785-a780-188709020c23 service nova] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Received unexpected event network-vif-plugged-c754233d-824c-40ec-bae1-c4ed5a90b392 for instance with vm_state building and task_state spawning.
Oct 23 22:15:59 user nova-compute[74337]: INFO nova.compute.manager [None req-802bac7d-e04f-451e-8cfa-d889c8517e1b tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Took 6.36 seconds to build instance.
Oct 23 22:15:59 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-802bac7d-e04f-451e-8cfa-d889c8517e1b tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Lock "40c79805-6e80-4c44-90ca-27a2af6be3bd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.468s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:15:59 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:16:00 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:16:04 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:16:05 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:16:10 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:16:10 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:16:10 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 22:16:10 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 22:16:10 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 22:16:10 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:16:14 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:16:15 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:16:19 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:16:20 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-a2caf03e-da47-49ab-a610-adab875ddb14 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Acquiring lock "27710919-a717-42fa-a436-a261d92c1c2a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:16:20 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-a2caf03e-da47-49ab-a610-adab875ddb14 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Lock "27710919-a717-42fa-a436-a261d92c1c2a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:16:20 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-a2caf03e-da47-49ab-a610-adab875ddb14 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Acquiring lock "27710919-a717-42fa-a436-a261d92c1c2a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:16:20 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-a2caf03e-da47-49ab-a610-adab875ddb14 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Lock "27710919-a717-42fa-a436-a261d92c1c2a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:16:20 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-a2caf03e-da47-49ab-a610-adab875ddb14 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Lock "27710919-a717-42fa-a436-a261d92c1c2a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:16:20 user nova-compute[74337]: INFO nova.compute.manager [None req-a2caf03e-da47-49ab-a610-adab875ddb14 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 27710919-a717-42fa-a436-a261d92c1c2a] Terminating instance
Oct 23 22:16:20 user nova-compute[74337]: DEBUG nova.compute.manager [None req-a2caf03e-da47-49ab-a610-adab875ddb14 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 27710919-a717-42fa-a436-a261d92c1c2a] Start destroying the instance on the hypervisor. {{(pid=74337) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 22:16:20 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:16:20 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:16:20 user nova-compute[74337]: DEBUG nova.compute.manager [req-e349ab73-4b28-4ef4-b9bc-08abf33bdedb req-f86d4533-d849-441a-aabf-437ce6f63d87 service nova] [instance: 27710919-a717-42fa-a436-a261d92c1c2a] Received event network-vif-unplugged-85905b2e-3e09-4236-8fe7-ea6c31324ae6 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:16:20 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-e349ab73-4b28-4ef4-b9bc-08abf33bdedb req-f86d4533-d849-441a-aabf-437ce6f63d87 service nova] Acquiring lock "27710919-a717-42fa-a436-a261d92c1c2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:16:20 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-e349ab73-4b28-4ef4-b9bc-08abf33bdedb req-f86d4533-d849-441a-aabf-437ce6f63d87 service nova] Lock "27710919-a717-42fa-a436-a261d92c1c2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:16:20 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-e349ab73-4b28-4ef4-b9bc-08abf33bdedb req-f86d4533-d849-441a-aabf-437ce6f63d87 service nova] Lock "27710919-a717-42fa-a436-a261d92c1c2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:16:20 user nova-compute[74337]: DEBUG nova.compute.manager [req-e349ab73-4b28-4ef4-b9bc-08abf33bdedb req-f86d4533-d849-441a-aabf-437ce6f63d87 service nova] [instance: 27710919-a717-42fa-a436-a261d92c1c2a] No waiting events found dispatching network-vif-unplugged-85905b2e-3e09-4236-8fe7-ea6c31324ae6 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 22:16:20 user nova-compute[74337]: DEBUG nova.compute.manager [req-e349ab73-4b28-4ef4-b9bc-08abf33bdedb req-f86d4533-d849-441a-aabf-437ce6f63d87 service nova] [instance: 27710919-a717-42fa-a436-a261d92c1c2a] Received event network-vif-unplugged-85905b2e-3e09-4236-8fe7-ea6c31324ae6 for instance with task_state deleting. {{(pid=74337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 22:16:20 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:16:20 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:16:20 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:16:20 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:16:20 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: 27710919-a717-42fa-a436-a261d92c1c2a] Instance destroyed successfully.
Oct 23 22:16:20 user nova-compute[74337]: DEBUG nova.objects.instance [None req-a2caf03e-da47-49ab-a610-adab875ddb14 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Lazy-loading 'resources' on Instance uuid 27710919-a717-42fa-a436-a261d92c1c2a {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:16:20 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-a2caf03e-da47-49ab-a610-adab875ddb14 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:59:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-728469709',display_name='tempest-ServerRescueNegativeTestJSON-server-728469709',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-728469709',id=42,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-23T22:01:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='80f79dd6954748e4806a568a4127396f',ramdisk_id='',reservation_id='r-s6fq6tqs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2089412853',owner_user_name='tempest-ServerRescueNegativeTestJSON-2089412853-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T22:01:28Z,user_data=None,user_id='a0f5c4ec386544e1afd2f0a7d1b1c94f',uuid=27710919-a717-42fa-a436-a261d92c1c2a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "85905b2e-3e09-4236-8fe7-ea6c31324ae6", "address": "fa:16:3e:50:cd:90", "network": {"id": "122fdd20-8bf5-4374-b50c-82e5dc8684db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-81475496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80f79dd6954748e4806a568a4127396f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85905b2e-3e", "ovs_interfaceid": "85905b2e-3e09-4236-8fe7-ea6c31324ae6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 22:16:20 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-a2caf03e-da47-49ab-a610-adab875ddb14 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Converting VIF {"id": "85905b2e-3e09-4236-8fe7-ea6c31324ae6", "address": "fa:16:3e:50:cd:90", "network": {"id": "122fdd20-8bf5-4374-b50c-82e5dc8684db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-81475496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80f79dd6954748e4806a568a4127396f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85905b2e-3e", "ovs_interfaceid": "85905b2e-3e09-4236-8fe7-ea6c31324ae6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 22:16:20 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-a2caf03e-da47-49ab-a610-adab875ddb14 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:50:cd:90,bridge_name='br-int',has_traffic_filtering=True,id=85905b2e-3e09-4236-8fe7-ea6c31324ae6,network=Network(122fdd20-8bf5-4374-b50c-82e5dc8684db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85905b2e-3e') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 22:16:20 user nova-compute[74337]: DEBUG os_vif [None req-a2caf03e-da47-49ab-a610-adab875ddb14 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:50:cd:90,bridge_name='br-int',has_traffic_filtering=True,id=85905b2e-3e09-4236-8fe7-ea6c31324ae6,network=Network(122fdd20-8bf5-4374-b50c-82e5dc8684db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85905b2e-3e') {{(pid=74337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 22:16:20 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:16:20 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap85905b2e-3e, bridge=br-int, if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:16:20 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:16:20 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:16:20 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:16:20 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ea13b280-0c26-4a52-9211-6e8b5f0b5b57) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:16:20 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:16:20 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:16:20 user nova-compute[74337]: INFO os_vif [None req-a2caf03e-da47-49ab-a610-adab875ddb14 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:50:cd:90,bridge_name='br-int',has_traffic_filtering=True,id=85905b2e-3e09-4236-8fe7-ea6c31324ae6,network=Network(122fdd20-8bf5-4374-b50c-82e5dc8684db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85905b2e-3e')
Oct 23 22:16:20 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-a2caf03e-da47-49ab-a610-adab875ddb14 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 27710919-a717-42fa-a436-a261d92c1c2a] Deleting instance files /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a_del
Oct 23 22:16:20 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-a2caf03e-da47-49ab-a610-adab875ddb14 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 27710919-a717-42fa-a436-a261d92c1c2a] Deletion of /opt/stack/data/nova/instances/27710919-a717-42fa-a436-a261d92c1c2a_del complete
Oct 23 22:16:20 user nova-compute[74337]: INFO nova.compute.manager [None req-a2caf03e-da47-49ab-a610-adab875ddb14 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 27710919-a717-42fa-a436-a261d92c1c2a] Took 0.90 seconds to destroy the instance on the hypervisor.
Oct 23 22:16:20 user nova-compute[74337]: DEBUG oslo.service.loopingcall [None req-a2caf03e-da47-49ab-a610-adab875ddb14 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74337) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 22:16:20 user nova-compute[74337]: DEBUG nova.compute.manager [-] [instance: 27710919-a717-42fa-a436-a261d92c1c2a] Deallocating network for instance {{(pid=74337) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 22:16:20 user nova-compute[74337]: DEBUG nova.network.neutron [-] [instance: 27710919-a717-42fa-a436-a261d92c1c2a] deallocate_for_instance() {{(pid=74337) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 22:16:21 user nova-compute[74337]: DEBUG nova.network.neutron [-] [instance: 27710919-a717-42fa-a436-a261d92c1c2a] Updating instance_info_cache with network_info: [] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 22:16:21 user nova-compute[74337]: INFO nova.compute.manager [-] [instance: 27710919-a717-42fa-a436-a261d92c1c2a] Took 0.80 seconds to deallocate network for instance.
Oct 23 22:16:21 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-a2caf03e-da47-49ab-a610-adab875ddb14 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:16:21 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-a2caf03e-da47-49ab-a610-adab875ddb14 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:16:21 user nova-compute[74337]: DEBUG nova.compute.manager [req-320bdcd3-6579-4255-a018-783e6787bc66 req-d6a93484-01a3-464e-98d6-c68d3385afd3 service nova] [instance: 27710919-a717-42fa-a436-a261d92c1c2a] Received event network-vif-deleted-85905b2e-3e09-4236-8fe7-ea6c31324ae6 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:16:21 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-a2caf03e-da47-49ab-a610-adab875ddb14 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 22:16:21 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-a2caf03e-da47-49ab-a610-adab875ddb14 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 22:16:21 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-a2caf03e-da47-49ab-a610-adab875ddb14 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.157s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:16:21 user nova-compute[74337]: INFO nova.scheduler.client.report [None req-a2caf03e-da47-49ab-a610-adab875ddb14 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Deleted allocations for instance 27710919-a717-42fa-a436-a261d92c1c2a
Oct 23 22:16:22 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-a2caf03e-da47-49ab-a610-adab875ddb14 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Lock "27710919-a717-42fa-a436-a261d92c1c2a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.048s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:16:22 user nova-compute[74337]: DEBUG nova.compute.manager [req-1320f771-bf44-440b-ab28-854149f15d43 req-4b87fb77-51d5-4bb8-bee4-ec0a1fa56b15 service nova] [instance: 27710919-a717-42fa-a436-a261d92c1c2a] Received event network-vif-plugged-85905b2e-3e09-4236-8fe7-ea6c31324ae6 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:16:22 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-1320f771-bf44-440b-ab28-854149f15d43 req-4b87fb77-51d5-4bb8-bee4-ec0a1fa56b15 service nova] Acquiring lock "27710919-a717-42fa-a436-a261d92c1c2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:16:22 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-1320f771-bf44-440b-ab28-854149f15d43 req-4b87fb77-51d5-4bb8-bee4-ec0a1fa56b15 service nova] Lock "27710919-a717-42fa-a436-a261d92c1c2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:16:22 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-1320f771-bf44-440b-ab28-854149f15d43 req-4b87fb77-51d5-4bb8-bee4-ec0a1fa56b15 service nova] Lock "27710919-a717-42fa-a436-a261d92c1c2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:16:22 user nova-compute[74337]: DEBUG nova.compute.manager [req-1320f771-bf44-440b-ab28-854149f15d43 req-4b87fb77-51d5-4bb8-bee4-ec0a1fa56b15 service nova] [instance: 27710919-a717-42fa-a436-a261d92c1c2a] No waiting events found dispatching network-vif-plugged-85905b2e-3e09-4236-8fe7-ea6c31324ae6 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 22:16:22 user nova-compute[74337]: WARNING nova.compute.manager [req-1320f771-bf44-440b-ab28-854149f15d43 req-4b87fb77-51d5-4bb8-bee4-ec0a1fa56b15 service nova] [instance: 27710919-a717-42fa-a436-a261d92c1c2a] Received unexpected event network-vif-plugged-85905b2e-3e09-4236-8fe7-ea6c31324ae6 for instance with vm_state deleted and task_state None.
Oct 23 22:16:24 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:16:25 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:16:29 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:16:29 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:16:30 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:16:30 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 22:16:30 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:16:31 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:16:33 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:16:35 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:16:35 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:16:36 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:16:37 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:16:37 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:16:37 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:16:37 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:16:37 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:16:37 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Auditing locally available compute resources for user (node: user) {{(pid=74337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 22:16:37 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/999843b2-b757-480b-bd21-bf281954bc46/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:16:37 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/999843b2-b757-480b-bd21-bf281954bc46/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:16:37 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/999843b2-b757-480b-bd21-bf281954bc46/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:16:38 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/999843b2-b757-480b-bd21-bf281954bc46/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:16:38 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c79805-6e80-4c44-90ca-27a2af6be3bd/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:16:38 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c79805-6e80-4c44-90ca-27a2af6be3bd/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:16:38 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c79805-6e80-4c44-90ca-27a2af6be3bd/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:16:38 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c79805-6e80-4c44-90ca-27a2af6be3bd/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:16:38 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:16:38 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:16:38 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Hypervisor/Node resource view: name=user free_ram=8794MB free_disk=25.155216217041016GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 22:16:38 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:16:38 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:16:39 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 999843b2-b757-480b-bd21-bf281954bc46 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 22:16:39 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 40c79805-6e80-4c44-90ca-27a2af6be3bd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 22:16:39 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 22:16:39 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 22:16:39 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 22:16:39 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 22:16:39 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Compute_service record updated for user:user {{(pid=74337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 22:16:39 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.365s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:16:40 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:16:42 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:16:42 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Starting heal instance info cache {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 22:16:42 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Didn't find any instances for network info cache update. {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 23 22:16:42 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:16:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:16:50 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:16:55 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:16:55 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:16:55 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 22:16:55 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 22:16:55 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 22:16:55 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:17:00 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:17:05 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:17:10 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-77b078d8-37f8-4d77-b1aa-2c80e476b6e7 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Acquiring lock "999843b2-b757-480b-bd21-bf281954bc46" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:17:10 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-77b078d8-37f8-4d77-b1aa-2c80e476b6e7 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Lock "999843b2-b757-480b-bd21-bf281954bc46" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:17:10 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-77b078d8-37f8-4d77-b1aa-2c80e476b6e7 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Acquiring lock "999843b2-b757-480b-bd21-bf281954bc46-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:17:10 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-77b078d8-37f8-4d77-b1aa-2c80e476b6e7 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Lock "999843b2-b757-480b-bd21-bf281954bc46-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:17:10 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-77b078d8-37f8-4d77-b1aa-2c80e476b6e7 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Lock "999843b2-b757-480b-bd21-bf281954bc46-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:17:10 user nova-compute[74337]: INFO nova.compute.manager [None req-77b078d8-37f8-4d77-b1aa-2c80e476b6e7 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Terminating instance
Oct 23 22:17:10 user nova-compute[74337]: DEBUG nova.compute.manager [None req-77b078d8-37f8-4d77-b1aa-2c80e476b6e7 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Start destroying the instance on the hypervisor. {{(pid=74337) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 22:17:10 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:17:10 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:17:10 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:17:10 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:17:10 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:17:11 user nova-compute[74337]: DEBUG nova.compute.manager [req-1c1f04c4-4571-4806-a831-b6372acb4de4 req-565e977b-5231-45cd-9a0e-747bfc908f90 service nova] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Received event network-vif-unplugged-02913be6-773f-402a-a534-d7567aeb5b7a {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:17:11 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-1c1f04c4-4571-4806-a831-b6372acb4de4 req-565e977b-5231-45cd-9a0e-747bfc908f90 service nova] Acquiring lock "999843b2-b757-480b-bd21-bf281954bc46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:17:11 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-1c1f04c4-4571-4806-a831-b6372acb4de4 req-565e977b-5231-45cd-9a0e-747bfc908f90 service nova] Lock "999843b2-b757-480b-bd21-bf281954bc46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:17:11 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-1c1f04c4-4571-4806-a831-b6372acb4de4 req-565e977b-5231-45cd-9a0e-747bfc908f90 service nova] Lock "999843b2-b757-480b-bd21-bf281954bc46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:17:11 user nova-compute[74337]: DEBUG nova.compute.manager [req-1c1f04c4-4571-4806-a831-b6372acb4de4 req-565e977b-5231-45cd-9a0e-747bfc908f90 service nova] [instance: 999843b2-b757-480b-bd21-bf281954bc46] No waiting events found dispatching network-vif-unplugged-02913be6-773f-402a-a534-d7567aeb5b7a {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 22:17:11 user nova-compute[74337]: DEBUG nova.compute.manager [req-1c1f04c4-4571-4806-a831-b6372acb4de4 req-565e977b-5231-45cd-9a0e-747bfc908f90 service nova] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Received event network-vif-unplugged-02913be6-773f-402a-a534-d7567aeb5b7a for instance with task_state deleting. {{(pid=74337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 22:17:11 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:17:11 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:17:11 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:17:11 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:17:11 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Instance destroyed successfully.
Oct 23 22:17:11 user nova-compute[74337]: DEBUG nova.objects.instance [None req-77b078d8-37f8-4d77-b1aa-2c80e476b6e7 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Lazy-loading 'resources' on Instance uuid 999843b2-b757-480b-bd21-bf281954bc46 {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:17:11 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-77b078d8-37f8-4d77-b1aa-2c80e476b6e7 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T21:59:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1406033408',display_name='tempest-ServerRescueNegativeTestJSON-server-1406033408',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1406033408',id=41,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-23T22:04:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='80f79dd6954748e4806a568a4127396f',ramdisk_id='',reservation_id='r-e3hxkbx8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2089412853',owner_user_name='tempest-ServerRescueNegativeTestJSON-2089412853-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T22:06:16Z,user_data=None,user_id='a0f5c4ec386544e1afd2f0a7d1b1c94f',uuid=999843b2-b757-480b-bd21-bf281954bc46,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "02913be6-773f-402a-a534-d7567aeb5b7a", "address": "fa:16:3e:a2:cd:9d", "network": {"id": "122fdd20-8bf5-4374-b50c-82e5dc8684db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-81475496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80f79dd6954748e4806a568a4127396f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02913be6-77", "ovs_interfaceid": "02913be6-773f-402a-a534-d7567aeb5b7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 22:17:11 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-77b078d8-37f8-4d77-b1aa-2c80e476b6e7 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Converting VIF {"id": "02913be6-773f-402a-a534-d7567aeb5b7a", "address": "fa:16:3e:a2:cd:9d", "network": {"id": "122fdd20-8bf5-4374-b50c-82e5dc8684db", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-81475496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80f79dd6954748e4806a568a4127396f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02913be6-77", "ovs_interfaceid": "02913be6-773f-402a-a534-d7567aeb5b7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 22:17:11 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-77b078d8-37f8-4d77-b1aa-2c80e476b6e7 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a2:cd:9d,bridge_name='br-int',has_traffic_filtering=True,id=02913be6-773f-402a-a534-d7567aeb5b7a,network=Network(122fdd20-8bf5-4374-b50c-82e5dc8684db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02913be6-77') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 22:17:11 user nova-compute[74337]: DEBUG os_vif [None req-77b078d8-37f8-4d77-b1aa-2c80e476b6e7 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:cd:9d,bridge_name='br-int',has_traffic_filtering=True,id=02913be6-773f-402a-a534-d7567aeb5b7a,network=Network(122fdd20-8bf5-4374-b50c-82e5dc8684db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02913be6-77') {{(pid=74337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 22:17:11 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:17:11 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap02913be6-77, bridge=br-int, if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:17:11 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:17:11 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:17:11 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:17:11 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2959809b-3ca9-4e01-9fa7-78deec3d5499) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:17:11 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:17:11 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:17:11 user nova-compute[74337]: INFO os_vif [None req-77b078d8-37f8-4d77-b1aa-2c80e476b6e7 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:cd:9d,bridge_name='br-int',has_traffic_filtering=True,id=02913be6-773f-402a-a534-d7567aeb5b7a,network=Network(122fdd20-8bf5-4374-b50c-82e5dc8684db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02913be6-77')
Oct 23 22:17:11 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-77b078d8-37f8-4d77-b1aa-2c80e476b6e7 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Deleting instance files /opt/stack/data/nova/instances/999843b2-b757-480b-bd21-bf281954bc46_del
Oct 23 22:17:11 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-77b078d8-37f8-4d77-b1aa-2c80e476b6e7 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Deletion of /opt/stack/data/nova/instances/999843b2-b757-480b-bd21-bf281954bc46_del complete
Oct 23 22:17:11 user nova-compute[74337]: INFO nova.compute.manager [None req-77b078d8-37f8-4d77-b1aa-2c80e476b6e7 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Took 0.88 seconds to destroy the instance on the hypervisor.
Oct 23 22:17:11 user nova-compute[74337]: DEBUG oslo.service.loopingcall [None req-77b078d8-37f8-4d77-b1aa-2c80e476b6e7 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74337) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 22:17:11 user nova-compute[74337]: DEBUG nova.compute.manager [-] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Deallocating network for instance {{(pid=74337) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 22:17:11 user nova-compute[74337]: DEBUG nova.network.neutron [-] [instance: 999843b2-b757-480b-bd21-bf281954bc46] deallocate_for_instance() {{(pid=74337) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 22:17:11 user nova-compute[74337]: DEBUG nova.compute.manager [req-b19bdfb9-4570-49d8-b5ee-5559bbbcde29 req-337ff88f-3ba7-46a4-9cef-110208576dda service nova] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Received event network-vif-deleted-02913be6-773f-402a-a534-d7567aeb5b7a {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:17:11 user nova-compute[74337]: INFO nova.compute.manager [req-b19bdfb9-4570-49d8-b5ee-5559bbbcde29 req-337ff88f-3ba7-46a4-9cef-110208576dda service nova] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Neutron deleted interface 02913be6-773f-402a-a534-d7567aeb5b7a; detaching it from the instance and deleting it from the info cache
Oct 23 22:17:11 user nova-compute[74337]: DEBUG nova.network.neutron [req-b19bdfb9-4570-49d8-b5ee-5559bbbcde29 req-337ff88f-3ba7-46a4-9cef-110208576dda service nova] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Updating instance_info_cache with network_info: [] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 22:17:11 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:17:11 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:17:11 user nova-compute[74337]: DEBUG nova.compute.manager [req-b19bdfb9-4570-49d8-b5ee-5559bbbcde29 req-337ff88f-3ba7-46a4-9cef-110208576dda service nova] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Detach interface failed, port_id=02913be6-773f-402a-a534-d7567aeb5b7a, reason: Instance 999843b2-b757-480b-bd21-bf281954bc46 could not be found. {{(pid=74337) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 23 22:17:11 user nova-compute[74337]: DEBUG nova.network.neutron [-] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Updating instance_info_cache with network_info: [] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 22:17:11 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:17:11 user nova-compute[74337]: INFO nova.compute.manager [-] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Took 0.49 seconds to deallocate network for instance.
Oct 23 22:17:12 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:17:12 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-77b078d8-37f8-4d77-b1aa-2c80e476b6e7 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:17:12 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-77b078d8-37f8-4d77-b1aa-2c80e476b6e7 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:17:12 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:17:12 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-77b078d8-37f8-4d77-b1aa-2c80e476b6e7 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 22:17:12 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-77b078d8-37f8-4d77-b1aa-2c80e476b6e7 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 22:17:12 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-77b078d8-37f8-4d77-b1aa-2c80e476b6e7 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.188s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:17:12 user nova-compute[74337]: INFO nova.scheduler.client.report [None req-77b078d8-37f8-4d77-b1aa-2c80e476b6e7 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Deleted allocations for instance 999843b2-b757-480b-bd21-bf281954bc46
Oct 23 22:17:12 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-77b078d8-37f8-4d77-b1aa-2c80e476b6e7 tempest-ServerRescueNegativeTestJSON-2089412853 tempest-ServerRescueNegativeTestJSON-2089412853-project-member] Lock "999843b2-b757-480b-bd21-bf281954bc46" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.755s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:17:13 user nova-compute[74337]: DEBUG nova.compute.manager [req-a6ebbce1-f67a-4b67-9f01-d353b3d8764f req-04a01ba0-5694-46e1-9b0f-88d3e4254803 service nova] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Received event network-vif-plugged-02913be6-773f-402a-a534-d7567aeb5b7a {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:17:13 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-a6ebbce1-f67a-4b67-9f01-d353b3d8764f req-04a01ba0-5694-46e1-9b0f-88d3e4254803 service nova] Acquiring lock "999843b2-b757-480b-bd21-bf281954bc46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:17:13 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-a6ebbce1-f67a-4b67-9f01-d353b3d8764f req-04a01ba0-5694-46e1-9b0f-88d3e4254803 service nova] Lock "999843b2-b757-480b-bd21-bf281954bc46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:17:13 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-a6ebbce1-f67a-4b67-9f01-d353b3d8764f req-04a01ba0-5694-46e1-9b0f-88d3e4254803 service nova] Lock "999843b2-b757-480b-bd21-bf281954bc46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:17:13 user nova-compute[74337]: DEBUG nova.compute.manager [req-a6ebbce1-f67a-4b67-9f01-d353b3d8764f req-04a01ba0-5694-46e1-9b0f-88d3e4254803 service nova] [instance: 999843b2-b757-480b-bd21-bf281954bc46] No waiting events found dispatching network-vif-plugged-02913be6-773f-402a-a534-d7567aeb5b7a {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 22:17:13 user nova-compute[74337]: WARNING nova.compute.manager [req-a6ebbce1-f67a-4b67-9f01-d353b3d8764f req-04a01ba0-5694-46e1-9b0f-88d3e4254803 service nova] [instance: 999843b2-b757-480b-bd21-bf281954bc46] Received unexpected event network-vif-plugged-02913be6-773f-402a-a534-d7567aeb5b7a for instance with vm_state deleted and task_state None.
Oct 23 22:17:16 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:17:21 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:17:21 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:17:21 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 22:17:21 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 22:17:21 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 22:17:21 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:17:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:17:31 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:17:31 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:17:31 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 22:17:31 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 22:17:31 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 22:17:31 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:17:31 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:17:32 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:17:32 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 22:17:33 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:17:35 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:17:36 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:17:36 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:17:37 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:17:39 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:17:39 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:17:39 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:17:39 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:17:39 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Auditing locally available compute resources for user (node: user) {{(pid=74337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 22:17:39 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c79805-6e80-4c44-90ca-27a2af6be3bd/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:17:39 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c79805-6e80-4c44-90ca-27a2af6be3bd/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:17:39 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c79805-6e80-4c44-90ca-27a2af6be3bd/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:17:39 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c79805-6e80-4c44-90ca-27a2af6be3bd/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:17:40 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:17:40 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:17:40 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Hypervisor/Node resource view: name=user free_ram=8892MB free_disk=25.182628631591797GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 22:17:40 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:17:40 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:17:40 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 40c79805-6e80-4c44-90ca-27a2af6be3bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 22:17:40 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 22:17:40 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 22:17:40 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 22:17:40 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 22:17:40 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Compute_service record updated for user:user {{(pid=74337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 22:17:40 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.188s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:17:41 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:17:43 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:17:43 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:17:43 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Starting heal instance info cache {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 22:17:43 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Rebuilding the list of instances to heal {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 22:17:43 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "refresh_cache-40c79805-6e80-4c44-90ca-27a2af6be3bd" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 22:17:43 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquired lock "refresh_cache-40c79805-6e80-4c44-90ca-27a2af6be3bd" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 22:17:43 user nova-compute[74337]: DEBUG nova.network.neutron [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Forcefully refreshing network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 22:17:43 user nova-compute[74337]: DEBUG nova.objects.instance [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lazy-loading 'info_cache' on Instance uuid 40c79805-6e80-4c44-90ca-27a2af6be3bd {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:17:43 user nova-compute[74337]: DEBUG nova.compute.manager [req-57ab131c-fadb-4586-b7e2-a091abdf6d83 req-bf15cf0a-c02c-4949-bfde-7dda65e3a14b service nova] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Received event network-changed-c754233d-824c-40ec-bae1-c4ed5a90b392 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:17:43 user nova-compute[74337]: DEBUG nova.compute.manager [req-57ab131c-fadb-4586-b7e2-a091abdf6d83 req-bf15cf0a-c02c-4949-bfde-7dda65e3a14b service nova] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Refreshing instance network info cache due to event network-changed-c754233d-824c-40ec-bae1-c4ed5a90b392. {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 23 22:17:43 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-57ab131c-fadb-4586-b7e2-a091abdf6d83 req-bf15cf0a-c02c-4949-bfde-7dda65e3a14b service nova] Acquiring lock "refresh_cache-40c79805-6e80-4c44-90ca-27a2af6be3bd" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 22:17:43 user nova-compute[74337]: DEBUG nova.network.neutron [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Updating instance_info_cache with network_info: [{"id": "c754233d-824c-40ec-bae1-c4ed5a90b392", "address": "fa:16:3e:28:38:e6", "network": {"id": "0110d432-0607-428c-b97f-68c5431cecea", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-718986578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "650cb403fcd142f485bd9b3fad1e0bd7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc754233d-82", "ovs_interfaceid": "c754233d-824c-40ec-bae1-c4ed5a90b392", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 22:17:43 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Releasing lock "refresh_cache-40c79805-6e80-4c44-90ca-27a2af6be3bd" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 22:17:43 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Updated the network info_cache for instance {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 22:17:43 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-57ab131c-fadb-4586-b7e2-a091abdf6d83 req-bf15cf0a-c02c-4949-bfde-7dda65e3a14b service nova] Acquired lock "refresh_cache-40c79805-6e80-4c44-90ca-27a2af6be3bd" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 22:17:43 user nova-compute[74337]: DEBUG nova.network.neutron [req-57ab131c-fadb-4586-b7e2-a091abdf6d83 req-bf15cf0a-c02c-4949-bfde-7dda65e3a14b service nova] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Refreshing network info cache for port c754233d-824c-40ec-bae1-c4ed5a90b392 {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 23 22:17:44 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:17:44 user nova-compute[74337]: DEBUG nova.network.neutron [req-57ab131c-fadb-4586-b7e2-a091abdf6d83 req-bf15cf0a-c02c-4949-bfde-7dda65e3a14b service nova] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Updated VIF entry in instance network info cache for port c754233d-824c-40ec-bae1-c4ed5a90b392. {{(pid=74337) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 23 22:17:44 user nova-compute[74337]: DEBUG nova.network.neutron [req-57ab131c-fadb-4586-b7e2-a091abdf6d83 req-bf15cf0a-c02c-4949-bfde-7dda65e3a14b service nova] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Updating instance_info_cache with network_info: [{"id": "c754233d-824c-40ec-bae1-c4ed5a90b392", "address": "fa:16:3e:28:38:e6", "network": {"id": "0110d432-0607-428c-b97f-68c5431cecea", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-718986578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "650cb403fcd142f485bd9b3fad1e0bd7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc754233d-82", "ovs_interfaceid": "c754233d-824c-40ec-bae1-c4ed5a90b392", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 22:17:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-57ab131c-fadb-4586-b7e2-a091abdf6d83 req-bf15cf0a-c02c-4949-bfde-7dda65e3a14b service nova] Releasing lock "refresh_cache-40c79805-6e80-4c44-90ca-27a2af6be3bd" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 22:17:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:17:46 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:17:49 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:17:49 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-6d69f1b0-35dc-44f2-9dbe-fc2d930b7577 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Acquiring lock "40c79805-6e80-4c44-90ca-27a2af6be3bd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:17:49 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-6d69f1b0-35dc-44f2-9dbe-fc2d930b7577 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Lock "40c79805-6e80-4c44-90ca-27a2af6be3bd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:17:49 user nova-compute[74337]: DEBUG nova.objects.instance [None req-6d69f1b0-35dc-44f2-9dbe-fc2d930b7577 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Lazy-loading 'flavor' on Instance uuid 40c79805-6e80-4c44-90ca-27a2af6be3bd {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:17:49 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-6d69f1b0-35dc-44f2-9dbe-fc2d930b7577 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Lock "40c79805-6e80-4c44-90ca-27a2af6be3bd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:17:49 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-6d69f1b0-35dc-44f2-9dbe-fc2d930b7577 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Acquiring lock "40c79805-6e80-4c44-90ca-27a2af6be3bd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:17:49 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-6d69f1b0-35dc-44f2-9dbe-fc2d930b7577 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Lock "40c79805-6e80-4c44-90ca-27a2af6be3bd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:17:49 user nova-compute[74337]: INFO nova.compute.manager [None req-6d69f1b0-35dc-44f2-9dbe-fc2d930b7577 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Attaching volume ad04124f-6ba0-4778-8a41-16472163e701 to /dev/vdb
Oct 23 22:17:50 user nova-compute[74337]: DEBUG os_brick.utils [None req-6d69f1b0-35dc-44f2-9dbe-fc2d930b7577 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 22:17:50 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:17:50 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:17:50 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe2dc847-081d-4127-a3c3-cea1c397f1eb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f34011b66e40\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:17:50 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:17:50 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:17:50 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6042f0ac-9b63-4549-b342-ec2c11fddecc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:17:50 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:17:50 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:17:50 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b735925-bd4b-4cfd-bc05-af9cf4bf8503]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:17:50 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e11ebe2d-2d8f-4079-a7ce-2aa86f52d190]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:17:50 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-6d69f1b0-35dc-44f2-9dbe-fc2d930b7577 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Running cmd (subprocess): nvme version {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:17:50 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-6d69f1b0-35dc-44f2-9dbe-fc2d930b7577 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] 'nvme version' failed. Not Retrying. {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 22:17:50 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6d69f1b0-35dc-44f2-9dbe-fc2d930b7577 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] nvme not present on system {{(pid=74337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 22:17:50 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:17:50 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 22:17:50 user nova-compute[74337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 22:17:50 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[140d3783-7b77-4cf8-b429-36ec6665f69a]: (4, '') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:17:50 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-6d69f1b0-35dc-44f2-9dbe-fc2d930b7577 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 22:17:50 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-6d69f1b0-35dc-44f2-9dbe-fc2d930b7577 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 22:17:50 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-6d69f1b0-35dc-44f2-9dbe-fc2d930b7577 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] LIGHTOS: no hostnqn found. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 22:17:50 user nova-compute[74337]: DEBUG os_brick.utils [None req-6d69f1b0-35dc-44f2-9dbe-fc2d930b7577 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f34011b66e40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 22:17:50 user nova-compute[74337]: DEBUG nova.virt.block_device [None req-6d69f1b0-35dc-44f2-9dbe-fc2d930b7577 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Updating existing volume attachment record: 60122962-b720-4c6a-a299-2cce2f0a110c {{(pid=74337) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 22:17:51 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:17:54 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:17:56 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:17:59 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:18:01 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:18:01 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:18:03 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:18:06 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d69f1b0-35dc-44f2-9dbe-fc2d930b7577 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Calling os-brick to attach iSCSI Volume {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 22:18:06 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d69f1b0-35dc-44f2-9dbe-fc2d930b7577 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ad04124f-6ba0-4778-8a41-16472163e701', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YPDIRlxe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 22:18:06 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-6d69f1b0-35dc-44f2-9dbe-fc2d930b7577 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 22:18:06 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-6d69f1b0-35dc-44f2-9dbe-fc2d930b7577 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 22:18:06 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-6d69f1b0-35dc-44f2-9dbe-fc2d930b7577 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 22:18:06 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-6d69f1b0-35dc-44f2-9dbe-fc2d930b7577 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 22:18:06 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-6d69f1b0-35dc-44f2-9dbe-fc2d930b7577 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad04124f-6ba0-4778-8a41-16472163e701" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 22:18:06 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-6d69f1b0-35dc-44f2-9dbe-fc2d930b7577 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad04124f-6ba0-4778-8a41-16472163e701" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 22:18:06 user nova-compute[74337]: INFO os_brick.initiator.connectors.iscsi [None req-6d69f1b0-35dc-44f2-9dbe-fc2d930b7577 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 22:18:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad04124f-6ba0-4778-8a41-16472163e701 -p 172.16.0.220:3260 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:18:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad04124f-6ba0-4778-8a41-16472163e701 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:18:06 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[48a97569-059e-47d9-8c0a-6e924e2d6a26]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:18:06 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d69f1b0-35dc-44f2-9dbe-fc2d930b7577 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 22:18:06 user nova-compute[74337]:  {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:18:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad04124f-6ba0-4778-8a41-16472163e701 -p 172.16.0.220:3260 --interface default --op new {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:18:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad04124f-6ba0-4778-8a41-16472163e701 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:18:06 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc8cdbe-19ba-46dc-b6b5-b01489243e95]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ad04124f-6ba0-4778-8a41-16472163e701] added\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:18:06 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d69f1b0-35dc-44f2-9dbe-fc2d930b7577 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ad04124f-6ba0-4778-8a41-16472163e701] added
Oct 23 22:18:06 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:18:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad04124f-6ba0-4778-8a41-16472163e701 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:18:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad04124f-6ba0-4778-8a41-16472163e701 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:18:06 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c33acbcf-c3ed-40a1-a413-22b2ef82cd06]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:18:06 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d69f1b0-35dc-44f2-9dbe-fc2d930b7577 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:18:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad04124f-6ba0-4778-8a41-16472163e701 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:18:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad04124f-6ba0-4778-8a41-16472163e701 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:18:06 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d3f0fee-3636-4bfc-adad-4277d1ba6fd2]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:18:06 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d69f1b0-35dc-44f2-9dbe-fc2d930b7577 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:18:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad04124f-6ba0-4778-8a41-16472163e701 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YPDIRlxe {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:18:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad04124f-6ba0-4778-8a41-16472163e701 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YPDIRlxe" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:18:06 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eff2861-037a-4d3e-959a-94583a84c674]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:18:06 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d69f1b0-35dc-44f2-9dbe-fc2d930b7577 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YPDIRlxe'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:18:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad04124f-6ba0-4778-8a41-16472163e701 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:18:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad04124f-6ba0-4778-8a41-16472163e701 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:18:06 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae0efb84-6e29-4bfd-8def-980ca540b28c]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:18:06 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d69f1b0-35dc-44f2-9dbe-fc2d930b7577 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:18:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:18:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.028s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:18:06 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f41e993-e839-4c6c-b8fc-a78d47ea1d54]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:18:06 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d69f1b0-35dc-44f2-9dbe-fc2d930b7577 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 23 22:18:06 user nova-compute[74337]:  {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 22:18:06 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d69f1b0-35dc-44f2-9dbe-fc2d930b7577 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 23 22:18:06 user nova-compute[74337]:  {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 22:18:06 user nova-compute[74337]: WARNING os_brick.initiator.connectors.iscsi [None req-6d69f1b0-35dc-44f2-9dbe-fc2d930b7577 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 23 22:18:06 user nova-compute[74337]: 
Oct 23 22:18:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad04124f-6ba0-4778-8a41-16472163e701 -p 172.16.0.220:3260 --login {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:18:06 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:18:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad04124f-6ba0-4778-8a41-16472163e701 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:18:06 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[18aacbaf-63c6-4adc-a913-d9bb73eee944]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ad04124f-6ba0-4778-8a41-16472163e701, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ad04124f-6ba0-4778-8a41-16472163e701, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:18:06 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d69f1b0-35dc-44f2-9dbe-fc2d930b7577 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ad04124f-6ba0-4778-8a41-16472163e701, portal: 172.16.0.220,3260]
Oct 23 22:18:06 user nova-compute[74337]: Login to [iface: default, target: iqn.2010-10.org.openstack:ad04124f-6ba0-4778-8a41-16472163e701, portal: 172.16.0.220,3260] successful.
Oct 23 22:18:06 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:18:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad04124f-6ba0-4778-8a41-16472163e701 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:18:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad04124f-6ba0-4778-8a41-16472163e701 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:18:06 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb41041-52a8-4d4c-9f23-340e99ed5d3f]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:18:06 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d69f1b0-35dc-44f2-9dbe-fc2d930b7577 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:18:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:18:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:18:06 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[68303210-dd62-4eae-bc28-11b12378b0bf]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad04124f-6ba0-4778-8a41-16472163e701 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:18:06 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d69f1b0-35dc-44f2-9dbe-fc2d930b7577 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad04124f-6ba0-4778-8a41-16472163e701 (non-flash)
Oct 23 22:18:06 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 22:18:06 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d69f1b0-35dc-44f2-9dbe-fc2d930b7577 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad04124f-6ba0-4778-8a41-16472163e701 (non-flash)
Oct 23 22:18:06 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 22:18:06 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-6d69f1b0-35dc-44f2-9dbe-fc2d930b7577 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad04124f-6ba0-4778-8a41-16472163e701" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 22:18:06 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d69f1b0-35dc-44f2-9dbe-fc2d930b7577 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Connected to 172.16.0.220:3260 {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 22:18:06 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-6d69f1b0-35dc-44f2-9dbe-fc2d930b7577 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=74337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 22:18:06 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-6d69f1b0-35dc-44f2-9dbe-fc2d930b7577 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 22:18:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:18:06 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:18:06 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[2879e04b-0035-4cff-9331-6bbe43958bec]: (4, ('- - 0', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:18:06 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-6d69f1b0-35dc-44f2-9dbe-fc2d930b7577 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: None {{(pid=74337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 22:18:07 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-6d69f1b0-35dc-44f2-9dbe-fc2d930b7577 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 22:18:07 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d69f1b0-35dc-44f2-9dbe-fc2d930b7577 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ad04124f-6ba0-4778-8a41-16472163e701', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YPDIRlxe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 22:18:07 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-6d69f1b0-35dc-44f2-9dbe-fc2d930b7577 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 22:18:07 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d69f1b0-35dc-44f2-9dbe-fc2d930b7577 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '23061663162333862', 'path': '/dev/sdb'} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 22:18:07 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d69f1b0-35dc-44f2-9dbe-fc2d930b7577 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23061663162333862', 'path': '/dev/sdb'} {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 22:18:07 user nova-compute[74337]: DEBUG nova.objects.instance [None req-6d69f1b0-35dc-44f2-9dbe-fc2d930b7577 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Lazy-loading 'flavor' on Instance uuid 40c79805-6e80-4c44-90ca-27a2af6be3bd {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:18:07 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-6d69f1b0-35dc-44f2-9dbe-fc2d930b7577 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 22:18:07 user nova-compute[74337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 22:18:07 user nova-compute[74337]:   <source dev="/dev/sdb"/>
Oct 23 22:18:07 user nova-compute[74337]:   <target dev="vdb" bus="virtio"/>
Oct 23 22:18:07 user nova-compute[74337]:   <serial>ad04124f-6ba0-4778-8a41-16472163e701</serial>
Oct 23 22:18:07 user nova-compute[74337]: </disk>
Oct 23 22:18:07 user nova-compute[74337]:  {{(pid=74337) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 22:18:08 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-6d69f1b0-35dc-44f2-9dbe-fc2d930b7577 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] No BDM found with device name vda, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 22:18:08 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-6d69f1b0-35dc-44f2-9dbe-fc2d930b7577 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 22:18:08 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-6d69f1b0-35dc-44f2-9dbe-fc2d930b7577 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] No VIF found with MAC fa:16:3e:28:38:e6, not building metadata {{(pid=74337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 22:18:08 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-6d69f1b0-35dc-44f2-9dbe-fc2d930b7577 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Lock "40c79805-6e80-4c44-90ca-27a2af6be3bd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.182s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:18:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:18:11 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:18:14 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:18:16 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:18:21 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:18:24 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:18:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:18:31 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:18:32 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:18:32 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:18:32 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 22:18:33 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:18:34 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:18:35 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:18:36 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:18:37 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:18:38 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:18:41 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-e5915dc6-e70e-4fcc-9eda-05458917f60a tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Acquiring lock "40c79805-6e80-4c44-90ca-27a2af6be3bd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:18:41 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-e5915dc6-e70e-4fcc-9eda-05458917f60a tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Lock "40c79805-6e80-4c44-90ca-27a2af6be3bd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:18:41 user nova-compute[74337]: INFO nova.compute.manager [None req-e5915dc6-e70e-4fcc-9eda-05458917f60a tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Detaching volume ad04124f-6ba0-4778-8a41-16472163e701
Oct 23 22:18:41 user nova-compute[74337]: INFO nova.virt.block_device [None req-e5915dc6-e70e-4fcc-9eda-05458917f60a tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Attempting to driver detach volume ad04124f-6ba0-4778-8a41-16472163e701 from mountpoint /dev/vdb
Oct 23 22:18:41 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-e5915dc6-e70e-4fcc-9eda-05458917f60a tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Attempting to detach device vdb from instance 40c79805-6e80-4c44-90ca-27a2af6be3bd from the persistent domain config. {{(pid=74337) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 22:18:41 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-e5915dc6-e70e-4fcc-9eda-05458917f60a tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 22:18:41 user nova-compute[74337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 22:18:41 user nova-compute[74337]:   <source dev="/dev/sdb"/>
Oct 23 22:18:41 user nova-compute[74337]:   <target dev="vdb" bus="virtio"/>
Oct 23 22:18:41 user nova-compute[74337]:   <serial>ad04124f-6ba0-4778-8a41-16472163e701</serial>
Oct 23 22:18:41 user nova-compute[74337]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 22:18:41 user nova-compute[74337]: </disk>
Oct 23 22:18:41 user nova-compute[74337]:  {{(pid=74337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 22:18:41 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-e5915dc6-e70e-4fcc-9eda-05458917f60a tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Successfully detached device vdb from instance 40c79805-6e80-4c44-90ca-27a2af6be3bd from the persistent domain config.
Oct 23 22:18:41 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-e5915dc6-e70e-4fcc-9eda-05458917f60a tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 40c79805-6e80-4c44-90ca-27a2af6be3bd from the live domain config. {{(pid=74337) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 22:18:41 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-e5915dc6-e70e-4fcc-9eda-05458917f60a tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 22:18:41 user nova-compute[74337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 22:18:41 user nova-compute[74337]:   <source dev="/dev/sdb"/>
Oct 23 22:18:41 user nova-compute[74337]:   <target dev="vdb" bus="virtio"/>
Oct 23 22:18:41 user nova-compute[74337]:   <serial>ad04124f-6ba0-4778-8a41-16472163e701</serial>
Oct 23 22:18:41 user nova-compute[74337]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 22:18:41 user nova-compute[74337]: </disk>
Oct 23 22:18:41 user nova-compute[74337]:  {{(pid=74337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 22:18:41 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:18:41 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:18:41 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:18:41 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:18:41 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Auditing locally available compute resources for user (node: user) {{(pid=74337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 22:18:41 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:18:41 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-e5915dc6-e70e-4fcc-9eda-05458917f60a tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 40c79805-6e80-4c44-90ca-27a2af6be3bd {{(pid=74337) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 22:18:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c79805-6e80-4c44-90ca-27a2af6be3bd/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:18:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c79805-6e80-4c44-90ca-27a2af6be3bd/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:18:41 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c79805-6e80-4c44-90ca-27a2af6be3bd/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:18:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c79805-6e80-4c44-90ca-27a2af6be3bd/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:18:42 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:18:42 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:18:42 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Hypervisor/Node resource view: name=user free_ram=8890MB free_disk=25.180004119873047GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 22:18:42 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:18:42 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:18:42 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 40c79805-6e80-4c44-90ca-27a2af6be3bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 22:18:42 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 22:18:42 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 22:18:42 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 22:18:42 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 22:18:42 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Compute_service record updated for user:user {{(pid=74337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 22:18:42 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.176s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:18:44 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:18:44 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:18:44 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Starting heal instance info cache {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 22:18:44 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Rebuilding the list of instances to heal {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 22:18:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "refresh_cache-40c79805-6e80-4c44-90ca-27a2af6be3bd" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 22:18:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquired lock "refresh_cache-40c79805-6e80-4c44-90ca-27a2af6be3bd" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 22:18:44 user nova-compute[74337]: DEBUG nova.network.neutron [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Forcefully refreshing network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 22:18:44 user nova-compute[74337]: DEBUG nova.objects.instance [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lazy-loading 'info_cache' on Instance uuid 40c79805-6e80-4c44-90ca-27a2af6be3bd {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:18:45 user nova-compute[74337]: DEBUG nova.network.neutron [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Updating instance_info_cache with network_info: [{"id": "c754233d-824c-40ec-bae1-c4ed5a90b392", "address": "fa:16:3e:28:38:e6", "network": {"id": "0110d432-0607-428c-b97f-68c5431cecea", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-718986578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "650cb403fcd142f485bd9b3fad1e0bd7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc754233d-82", "ovs_interfaceid": "c754233d-824c-40ec-bae1-c4ed5a90b392", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 22:18:45 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Releasing lock "refresh_cache-40c79805-6e80-4c44-90ca-27a2af6be3bd" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 22:18:45 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Updated the network info_cache for instance {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 22:18:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:18:51 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:18:56 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:19:01 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:19:01 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:19:01 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 22:19:01 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 22:19:01 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 22:19:01 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:19:01 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-e5915dc6-e70e-4fcc-9eda-05458917f60a tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 40c79805-6e80-4c44-90ca-27a2af6be3bd is timed out.
Oct 23 22:19:01 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-e5915dc6-e70e-4fcc-9eda-05458917f60a tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Successfully detached device vdb from instance 40c79805-6e80-4c44-90ca-27a2af6be3bd from the live domain config.
Oct 23 22:19:01 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5915dc6-e70e-4fcc-9eda-05458917f60a tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] calling os-brick to detach iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 22:19:01 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5915dc6-e70e-4fcc-9eda-05458917f60a tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, {'target_iqn': 'iqn.2010-10.org.openstack:ad04124f-6ba0-4778-8a41-16472163e701', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YPDIRlxe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 22:19:01 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-e5915dc6-e70e-4fcc-9eda-05458917f60a tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 22:19:01 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-e5915dc6-e70e-4fcc-9eda-05458917f60a tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 22:19:01 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-e5915dc6-e70e-4fcc-9eda-05458917f60a tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 22:19:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:19:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:19:01 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[5386be7f-3ccd-48c4-8982-70166256e94c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ad04124f-6ba0-4778-8a41-16472163e701\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:19:01 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5915dc6-e70e-4fcc-9eda-05458917f60a tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 22:19:01 user nova-compute[74337]: No targets found.
Oct 23 22:19:01 user nova-compute[74337]: iSNS:
Oct 23 22:19:01 user nova-compute[74337]: No targets found.
Oct 23 22:19:01 user nova-compute[74337]: STATIC:
Oct 23 22:19:01 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:ad04124f-6ba0-4778-8a41-16472163e701
Oct 23 22:19:01 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 22:19:01 user nova-compute[74337]:                 Iface Name: default
Oct 23 22:19:01 user nova-compute[74337]: FIRMWARE:
Oct 23 22:19:01 user nova-compute[74337]: No targets found.
Oct 23 22:19:01 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 22:19:01 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5915dc6-e70e-4fcc-9eda-05458917f60a tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 22:19:01 user nova-compute[74337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 22:19:01 user nova-compute[74337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 22:19:01 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5915dc6-e70e-4fcc-9eda-05458917f60a tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad04124f-6ba0-4778-8a41-16472163e701', 0)] {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 22:19:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:19:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:19:01 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[94bc2159-4331-47d7-9ddb-e70619cdde1e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad04124f-6ba0-4778-8a41-16472163e701\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:19:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:19:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:19:01 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bec8b7b-84df-4ff1-9dca-19f8dabf6d6c]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad04124f-6ba0-4778-8a41-16472163e701 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:19:01 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5915dc6-e70e-4fcc-9eda-05458917f60a tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad04124f-6ba0-4778-8a41-16472163e701 (non-flash)
Oct 23 22:19:01 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 22:19:01 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5915dc6-e70e-4fcc-9eda-05458917f60a tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad04124f-6ba0-4778-8a41-16472163e701 (non-flash)
Oct 23 22:19:01 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 22:19:01 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5915dc6-e70e-4fcc-9eda-05458917f60a tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5ec871a320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad04124f-6ba0-4778-8a41-16472163e701'): ({'sdb'}, set())}) {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 22:19:01 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-e5915dc6-e70e-4fcc-9eda-05458917f60a tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Removing single pathed devices sdb {{(pid=74337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 22:19:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:19:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:19:01 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c973b3-1699-444a-a10a-9a23b7166f5a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:19:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:19:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:19:01 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a317c7-055e-46a0-9071-81441b1fdcaa]: (4, ('ok\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:19:01 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-e5915dc6-e70e-4fcc-9eda-05458917f60a tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Flushing IO for device /dev/sdb {{(pid=74337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 22:19:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:19:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:19:01 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[660a02db-c0a5-457e-8aca-8a1ea5f1151d]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:19:01 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-e5915dc6-e70e-4fcc-9eda-05458917f60a tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 22:19:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:19:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:19:01 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f2efc9d-412a-4993-a14d-a8849008fb4b]: (4, ('1', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:19:01 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-e5915dc6-e70e-4fcc-9eda-05458917f60a tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 22:19:01 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-e5915dc6-e70e-4fcc-9eda-05458917f60a tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] SCSI volumes sdb have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 22:19:01 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5915dc6-e70e-4fcc-9eda-05458917f60a tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad04124f-6ba0-4778-8a41-16472163e701')] {{(pid=74337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 22:19:01 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad04124f-6ba0-4778-8a41-16472163e701 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:19:02 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad04124f-6ba0-4778-8a41-16472163e701 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.124s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:19:02 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9632fd9-32a8-4e0c-9809-c856960a110e]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:19:02 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5915dc6-e70e-4fcc-9eda-05458917f60a tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:19:02 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad04124f-6ba0-4778-8a41-16472163e701 -p 172.16.0.220:3260 --logout {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:19:02 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad04124f-6ba0-4778-8a41-16472163e701 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:19:02 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e3e63b-b1cf-487c-bde3-f0efcdc002c7]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:ad04124f-6ba0-4778-8a41-16472163e701, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:ad04124f-6ba0-4778-8a41-16472163e701, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:19:02 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5915dc6-e70e-4fcc-9eda-05458917f60a tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:ad04124f-6ba0-4778-8a41-16472163e701, portal: 172.16.0.220,3260]
Oct 23 22:19:02 user nova-compute[74337]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:ad04124f-6ba0-4778-8a41-16472163e701, portal: 172.16.0.220,3260] successful.
Oct 23 22:19:02 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:19:02 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad04124f-6ba0-4778-8a41-16472163e701 -p 172.16.0.220:3260 --op delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:19:02 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad04124f-6ba0-4778-8a41-16472163e701 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:19:02 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[2797b425-801e-45c7-af11-5f17573e6846]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:19:02 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5915dc6-e70e-4fcc-9eda-05458917f60a tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:19:02 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-e5915dc6-e70e-4fcc-9eda-05458917f60a tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.418s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 22:19:02 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5915dc6-e70e-4fcc-9eda-05458917f60a tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] <== disconnect_volume: return (420ms) None {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 22:19:02 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5915dc6-e70e-4fcc-9eda-05458917f60a tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Disconnected iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 22:19:02 user nova-compute[74337]: DEBUG nova.objects.instance [None req-e5915dc6-e70e-4fcc-9eda-05458917f60a tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Lazy-loading 'flavor' on Instance uuid 40c79805-6e80-4c44-90ca-27a2af6be3bd {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:19:02 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-e5915dc6-e70e-4fcc-9eda-05458917f60a tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Lock "40c79805-6e80-4c44-90ca-27a2af6be3bd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.957s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:19:06 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:19:06 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:19:06 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 22:19:06 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 22:19:06 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 22:19:06 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:19:11 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:19:11 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:19:16 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:19:21 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:19:21 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:19:21 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 22:19:21 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 22:19:21 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 22:19:21 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:19:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:19:31 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:19:33 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:19:34 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:19:34 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:19:34 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 22:19:35 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:19:36 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-cb77c8e5-f3a0-4e28-8bdd-e8823fb26e15 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Acquiring lock "40c79805-6e80-4c44-90ca-27a2af6be3bd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:19:36 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-cb77c8e5-f3a0-4e28-8bdd-e8823fb26e15 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Lock "40c79805-6e80-4c44-90ca-27a2af6be3bd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:19:36 user nova-compute[74337]: DEBUG nova.objects.instance [None req-cb77c8e5-f3a0-4e28-8bdd-e8823fb26e15 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Lazy-loading 'flavor' on Instance uuid 40c79805-6e80-4c44-90ca-27a2af6be3bd {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:19:36 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-cb77c8e5-f3a0-4e28-8bdd-e8823fb26e15 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Lock "40c79805-6e80-4c44-90ca-27a2af6be3bd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:19:36 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:19:36 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-cb77c8e5-f3a0-4e28-8bdd-e8823fb26e15 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Acquiring lock "40c79805-6e80-4c44-90ca-27a2af6be3bd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:19:36 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-cb77c8e5-f3a0-4e28-8bdd-e8823fb26e15 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Lock "40c79805-6e80-4c44-90ca-27a2af6be3bd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:19:36 user nova-compute[74337]: INFO nova.compute.manager [None req-cb77c8e5-f3a0-4e28-8bdd-e8823fb26e15 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Attaching volume d21a1e3a-6942-4205-965a-cb5aee0eaecd to /dev/vdb
Oct 23 22:19:36 user nova-compute[74337]: DEBUG os_brick.utils [None req-cb77c8e5-f3a0-4e28-8bdd-e8823fb26e15 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 22:19:36 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:19:36 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:19:36 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[576bc356-d299-4649-a179-1dc2315c7689]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f34011b66e40\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:19:36 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:19:36 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:19:36 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6589cbe-7001-45d2-a621-2748bcca9c61]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:19:36 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:19:36 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:19:36 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ec1eb8-14b8-480c-abb3-d511838a1e60]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:19:36 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[8998dde8-a686-40bc-8388-d1bf0bd06c3c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:19:36 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-cb77c8e5-f3a0-4e28-8bdd-e8823fb26e15 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Running cmd (subprocess): nvme version {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:19:36 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-cb77c8e5-f3a0-4e28-8bdd-e8823fb26e15 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] 'nvme version' failed. Not Retrying. {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 22:19:36 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cb77c8e5-f3a0-4e28-8bdd-e8823fb26e15 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] nvme not present on system {{(pid=74337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 22:19:36 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:19:36 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 22:19:36 user nova-compute[74337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 22:19:36 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e28de04-7d7a-4531-bc78-d2a98ad8a8e9]: (4, '') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:19:36 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-cb77c8e5-f3a0-4e28-8bdd-e8823fb26e15 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 22:19:36 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-cb77c8e5-f3a0-4e28-8bdd-e8823fb26e15 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 22:19:36 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-cb77c8e5-f3a0-4e28-8bdd-e8823fb26e15 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] LIGHTOS: no hostnqn found. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 22:19:36 user nova-compute[74337]: DEBUG os_brick.utils [None req-cb77c8e5-f3a0-4e28-8bdd-e8823fb26e15 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f34011b66e40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 22:19:36 user nova-compute[74337]: DEBUG nova.virt.block_device [None req-cb77c8e5-f3a0-4e28-8bdd-e8823fb26e15 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Updating existing volume attachment record: 3274d7d1-d197-4d18-9dc9-b30d6cb9f451 {{(pid=74337) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 22:19:38 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:19:39 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:19:40 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:19:41 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:19:41 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:19:42 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:19:42 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:19:42 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:19:42 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:19:42 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Auditing locally available compute resources for user (node: user) {{(pid=74337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 22:19:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c79805-6e80-4c44-90ca-27a2af6be3bd/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:19:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c79805-6e80-4c44-90ca-27a2af6be3bd/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:19:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c79805-6e80-4c44-90ca-27a2af6be3bd/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:19:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c79805-6e80-4c44-90ca-27a2af6be3bd/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:19:43 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:19:43 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:19:43 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Hypervisor/Node resource view: name=user free_ram=8969MB free_disk=25.16994857788086GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 22:19:43 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:19:43 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:19:43 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 40c79805-6e80-4c44-90ca-27a2af6be3bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 22:19:43 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 22:19:43 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 22:19:43 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 22:19:43 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 22:19:43 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Compute_service record updated for user:user {{(pid=74337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 22:19:43 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.399s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:19:46 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:19:46 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:19:46 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Starting heal instance info cache {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 22:19:46 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Rebuilding the list of instances to heal {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 22:19:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:19:46 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "refresh_cache-40c79805-6e80-4c44-90ca-27a2af6be3bd" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 22:19:46 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquired lock "refresh_cache-40c79805-6e80-4c44-90ca-27a2af6be3bd" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 22:19:46 user nova-compute[74337]: DEBUG nova.network.neutron [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Forcefully refreshing network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 22:19:46 user nova-compute[74337]: DEBUG nova.objects.instance [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lazy-loading 'info_cache' on Instance uuid 40c79805-6e80-4c44-90ca-27a2af6be3bd {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:19:47 user nova-compute[74337]: DEBUG nova.network.neutron [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Updating instance_info_cache with network_info: [{"id": "c754233d-824c-40ec-bae1-c4ed5a90b392", "address": "fa:16:3e:28:38:e6", "network": {"id": "0110d432-0607-428c-b97f-68c5431cecea", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-718986578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "650cb403fcd142f485bd9b3fad1e0bd7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc754233d-82", "ovs_interfaceid": "c754233d-824c-40ec-bae1-c4ed5a90b392", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 22:19:47 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Releasing lock "refresh_cache-40c79805-6e80-4c44-90ca-27a2af6be3bd" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 22:19:47 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Updated the network info_cache for instance {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 22:19:48 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:19:51 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:19:52 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb77c8e5-f3a0-4e28-8bdd-e8823fb26e15 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Calling os-brick to attach iSCSI Volume {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 22:19:52 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb77c8e5-f3a0-4e28-8bdd-e8823fb26e15 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d21a1e3a-6942-4205-965a-cb5aee0eaecd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tJgVdvwT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 22:19:52 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-cb77c8e5-f3a0-4e28-8bdd-e8823fb26e15 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 22:19:52 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-cb77c8e5-f3a0-4e28-8bdd-e8823fb26e15 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 22:19:52 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-cb77c8e5-f3a0-4e28-8bdd-e8823fb26e15 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 22:19:52 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-cb77c8e5-f3a0-4e28-8bdd-e8823fb26e15 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 22:19:52 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-cb77c8e5-f3a0-4e28-8bdd-e8823fb26e15 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d21a1e3a-6942-4205-965a-cb5aee0eaecd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 22:19:52 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-cb77c8e5-f3a0-4e28-8bdd-e8823fb26e15 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d21a1e3a-6942-4205-965a-cb5aee0eaecd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 22:19:52 user nova-compute[74337]: INFO os_brick.initiator.connectors.iscsi [None req-cb77c8e5-f3a0-4e28-8bdd-e8823fb26e15 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 22:19:52 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d21a1e3a-6942-4205-965a-cb5aee0eaecd -p 172.16.0.220:3260 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:19:52 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d21a1e3a-6942-4205-965a-cb5aee0eaecd -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:19:52 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa33c604-ff6d-48be-ac53-246a6739743a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:19:52 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb77c8e5-f3a0-4e28-8bdd-e8823fb26e15 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 22:19:52 user nova-compute[74337]:  {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:19:52 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d21a1e3a-6942-4205-965a-cb5aee0eaecd -p 172.16.0.220:3260 --interface default --op new {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:19:52 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d21a1e3a-6942-4205-965a-cb5aee0eaecd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:19:52 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[5089e2c1-4187-4494-86ef-479d6ac6181c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d21a1e3a-6942-4205-965a-cb5aee0eaecd] added\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:19:52 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb77c8e5-f3a0-4e28-8bdd-e8823fb26e15 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d21a1e3a-6942-4205-965a-cb5aee0eaecd] added
Oct 23 22:19:52 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:19:52 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d21a1e3a-6942-4205-965a-cb5aee0eaecd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:19:52 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d21a1e3a-6942-4205-965a-cb5aee0eaecd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:19:52 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f58a4e-c74c-47ea-81e2-1189b494c2fa]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:19:52 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb77c8e5-f3a0-4e28-8bdd-e8823fb26e15 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:19:52 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d21a1e3a-6942-4205-965a-cb5aee0eaecd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:19:52 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d21a1e3a-6942-4205-965a-cb5aee0eaecd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:19:52 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[7335906f-9dcd-4cfe-8ac1-717defcd525e]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:19:52 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb77c8e5-f3a0-4e28-8bdd-e8823fb26e15 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:19:52 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d21a1e3a-6942-4205-965a-cb5aee0eaecd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tJgVdvwT {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:19:52 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d21a1e3a-6942-4205-965a-cb5aee0eaecd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tJgVdvwT" returned: 0 in 0.016s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:19:52 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c33c19a4-a2bc-4d73-953b-da5926557933]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:19:52 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb77c8e5-f3a0-4e28-8bdd-e8823fb26e15 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tJgVdvwT'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:19:52 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d21a1e3a-6942-4205-965a-cb5aee0eaecd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:19:52 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d21a1e3a-6942-4205-965a-cb5aee0eaecd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:19:52 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[99033b49-b735-4c84-8a3c-843de76ea407]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:19:52 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb77c8e5-f3a0-4e28-8bdd-e8823fb26e15 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:19:52 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:19:52 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:19:52 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d524854f-d659-4a43-996d-76aebbca46ce]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:19:52 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb77c8e5-f3a0-4e28-8bdd-e8823fb26e15 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 23 22:19:52 user nova-compute[74337]:  {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 22:19:52 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb77c8e5-f3a0-4e28-8bdd-e8823fb26e15 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 23 22:19:52 user nova-compute[74337]:  {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 22:19:52 user nova-compute[74337]: WARNING os_brick.initiator.connectors.iscsi [None req-cb77c8e5-f3a0-4e28-8bdd-e8823fb26e15 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 23 22:19:52 user nova-compute[74337]: 
Oct 23 22:19:52 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d21a1e3a-6942-4205-965a-cb5aee0eaecd -p 172.16.0.220:3260 --login {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:19:53 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d21a1e3a-6942-4205-965a-cb5aee0eaecd -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:19:53 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb39829-02bf-4cf5-9515-3e776b09962b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d21a1e3a-6942-4205-965a-cb5aee0eaecd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d21a1e3a-6942-4205-965a-cb5aee0eaecd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:19:53 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb77c8e5-f3a0-4e28-8bdd-e8823fb26e15 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d21a1e3a-6942-4205-965a-cb5aee0eaecd, portal: 172.16.0.220,3260]
Oct 23 22:19:53 user nova-compute[74337]: Login to [iface: default, target: iqn.2010-10.org.openstack:d21a1e3a-6942-4205-965a-cb5aee0eaecd, portal: 172.16.0.220,3260] successful.
Oct 23 22:19:53 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:19:53 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d21a1e3a-6942-4205-965a-cb5aee0eaecd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:19:53 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d21a1e3a-6942-4205-965a-cb5aee0eaecd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:19:53 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2f360b4-4a24-4fdd-8180-f9dccec8f832]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:19:53 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb77c8e5-f3a0-4e28-8bdd-e8823fb26e15 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:19:53 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:19:53 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:19:53 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8d5b8ae-952b-4e5e-8d57-b2a9ddda1bb4]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21a1e3a-6942-4205-965a-cb5aee0eaecd (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:19:53 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb77c8e5-f3a0-4e28-8bdd-e8823fb26e15 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21a1e3a-6942-4205-965a-cb5aee0eaecd (non-flash)
Oct 23 22:19:53 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 22:19:53 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb77c8e5-f3a0-4e28-8bdd-e8823fb26e15 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21a1e3a-6942-4205-965a-cb5aee0eaecd (non-flash)
Oct 23 22:19:53 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 22:19:53 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-cb77c8e5-f3a0-4e28-8bdd-e8823fb26e15 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d21a1e3a-6942-4205-965a-cb5aee0eaecd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.234s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 22:19:53 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb77c8e5-f3a0-4e28-8bdd-e8823fb26e15 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Connected to 172.16.0.220:3260 {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 22:19:53 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-cb77c8e5-f3a0-4e28-8bdd-e8823fb26e15 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=74337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 22:19:53 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-cb77c8e5-f3a0-4e28-8bdd-e8823fb26e15 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 22:19:53 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:19:53 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:19:53 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c552b0-dc3a-4b3e-a6cc-772af0a2fbf6]: (4, ('- - 0', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:19:53 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-cb77c8e5-f3a0-4e28-8bdd-e8823fb26e15 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 22:19:53 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb77c8e5-f3a0-4e28-8bdd-e8823fb26e15 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d21a1e3a-6942-4205-965a-cb5aee0eaecd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tJgVdvwT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 22:19:54 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-cb77c8e5-f3a0-4e28-8bdd-e8823fb26e15 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.262s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 22:19:54 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb77c8e5-f3a0-4e28-8bdd-e8823fb26e15 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] <== connect_volume: return (1263ms) {'type': 'block', 'scsi_wwn': '23535613163316665', 'path': '/dev/sdb'} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 22:19:54 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb77c8e5-f3a0-4e28-8bdd-e8823fb26e15 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23535613163316665', 'path': '/dev/sdb'} {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 22:19:54 user nova-compute[74337]: DEBUG nova.objects.instance [None req-cb77c8e5-f3a0-4e28-8bdd-e8823fb26e15 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Lazy-loading 'flavor' on Instance uuid 40c79805-6e80-4c44-90ca-27a2af6be3bd {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:19:54 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-cb77c8e5-f3a0-4e28-8bdd-e8823fb26e15 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 22:19:54 user nova-compute[74337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 22:19:54 user nova-compute[74337]:   <source dev="/dev/sdb"/>
Oct 23 22:19:54 user nova-compute[74337]:   <target dev="vdb" bus="virtio"/>
Oct 23 22:19:54 user nova-compute[74337]:   <serial>d21a1e3a-6942-4205-965a-cb5aee0eaecd</serial>
Oct 23 22:19:54 user nova-compute[74337]: </disk>
Oct 23 22:19:54 user nova-compute[74337]:  {{(pid=74337) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 22:19:54 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-cb77c8e5-f3a0-4e28-8bdd-e8823fb26e15 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] No BDM found with device name vda, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 22:19:54 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-cb77c8e5-f3a0-4e28-8bdd-e8823fb26e15 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 22:19:54 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-cb77c8e5-f3a0-4e28-8bdd-e8823fb26e15 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] No VIF found with MAC fa:16:3e:28:38:e6, not building metadata {{(pid=74337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 22:19:54 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-cb77c8e5-f3a0-4e28-8bdd-e8823fb26e15 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Lock "40c79805-6e80-4c44-90ca-27a2af6be3bd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.927s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:19:56 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:19:57 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-941edbc2-fad4-4caf-bda9-cd4c8dd9c774 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Acquiring lock "40c79805-6e80-4c44-90ca-27a2af6be3bd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:19:57 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-941edbc2-fad4-4caf-bda9-cd4c8dd9c774 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Lock "40c79805-6e80-4c44-90ca-27a2af6be3bd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:19:57 user nova-compute[74337]: INFO nova.compute.manager [None req-941edbc2-fad4-4caf-bda9-cd4c8dd9c774 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Detaching volume d21a1e3a-6942-4205-965a-cb5aee0eaecd
Oct 23 22:19:57 user nova-compute[74337]: INFO nova.virt.block_device [None req-941edbc2-fad4-4caf-bda9-cd4c8dd9c774 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Attempting to driver detach volume d21a1e3a-6942-4205-965a-cb5aee0eaecd from mountpoint /dev/vdb
Oct 23 22:19:57 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-941edbc2-fad4-4caf-bda9-cd4c8dd9c774 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Attempting to detach device vdb from instance 40c79805-6e80-4c44-90ca-27a2af6be3bd from the persistent domain config. {{(pid=74337) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 22:19:57 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-941edbc2-fad4-4caf-bda9-cd4c8dd9c774 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 22:19:57 user nova-compute[74337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 22:19:57 user nova-compute[74337]:   <source dev="/dev/sdb"/>
Oct 23 22:19:57 user nova-compute[74337]:   <target dev="vdb" bus="virtio"/>
Oct 23 22:19:57 user nova-compute[74337]:   <serial>d21a1e3a-6942-4205-965a-cb5aee0eaecd</serial>
Oct 23 22:19:57 user nova-compute[74337]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 22:19:57 user nova-compute[74337]: </disk>
Oct 23 22:19:57 user nova-compute[74337]:  {{(pid=74337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 22:19:57 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-941edbc2-fad4-4caf-bda9-cd4c8dd9c774 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Successfully detached device vdb from instance 40c79805-6e80-4c44-90ca-27a2af6be3bd from the persistent domain config.
Oct 23 22:19:57 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-941edbc2-fad4-4caf-bda9-cd4c8dd9c774 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 40c79805-6e80-4c44-90ca-27a2af6be3bd from the live domain config. {{(pid=74337) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 22:19:57 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-941edbc2-fad4-4caf-bda9-cd4c8dd9c774 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 22:19:57 user nova-compute[74337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 22:19:57 user nova-compute[74337]:   <source dev="/dev/sdb"/>
Oct 23 22:19:57 user nova-compute[74337]:   <target dev="vdb" bus="virtio"/>
Oct 23 22:19:57 user nova-compute[74337]:   <serial>d21a1e3a-6942-4205-965a-cb5aee0eaecd</serial>
Oct 23 22:19:57 user nova-compute[74337]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 22:19:57 user nova-compute[74337]: </disk>
Oct 23 22:19:57 user nova-compute[74337]:  {{(pid=74337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 22:19:58 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-941edbc2-fad4-4caf-bda9-cd4c8dd9c774 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 40c79805-6e80-4c44-90ca-27a2af6be3bd {{(pid=74337) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 22:19:59 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:20:01 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:20:02 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:20:02 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Cleaning up deleted instances {{(pid=74337) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 23 22:20:02 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] There are 0 instances to clean {{(pid=74337) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 23 22:20:06 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:20:11 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:20:11 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74337) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 23 22:20:11 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:20:16 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:20:16 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:20:16 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 22:20:16 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 22:20:16 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 22:20:16 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:20:18 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-941edbc2-fad4-4caf-bda9-cd4c8dd9c774 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 40c79805-6e80-4c44-90ca-27a2af6be3bd is timed out.
Oct 23 22:20:18 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-941edbc2-fad4-4caf-bda9-cd4c8dd9c774 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Successfully detached device vdb from instance 40c79805-6e80-4c44-90ca-27a2af6be3bd from the live domain config.
Oct 23 22:20:18 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-941edbc2-fad4-4caf-bda9-cd4c8dd9c774 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] calling os-brick to detach iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 22:20:18 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-941edbc2-fad4-4caf-bda9-cd4c8dd9c774 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, {'target_iqn': 'iqn.2010-10.org.openstack:d21a1e3a-6942-4205-965a-cb5aee0eaecd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tJgVdvwT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 22:20:18 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-941edbc2-fad4-4caf-bda9-cd4c8dd9c774 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 22:20:18 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-941edbc2-fad4-4caf-bda9-cd4c8dd9c774 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 22:20:18 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-941edbc2-fad4-4caf-bda9-cd4c8dd9c774 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 22:20:18 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:20:18 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:20:18 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a89a3fba-7659-48da-8e06-095c3abe97d7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d21a1e3a-6942-4205-965a-cb5aee0eaecd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:20:18 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-941edbc2-fad4-4caf-bda9-cd4c8dd9c774 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 22:20:18 user nova-compute[74337]: No targets found.
Oct 23 22:20:18 user nova-compute[74337]: iSNS:
Oct 23 22:20:18 user nova-compute[74337]: No targets found.
Oct 23 22:20:18 user nova-compute[74337]: STATIC:
Oct 23 22:20:18 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:d21a1e3a-6942-4205-965a-cb5aee0eaecd
Oct 23 22:20:18 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 22:20:18 user nova-compute[74337]:                 Iface Name: default
Oct 23 22:20:18 user nova-compute[74337]: FIRMWARE:
Oct 23 22:20:18 user nova-compute[74337]: No targets found.
Oct 23 22:20:18 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 22:20:18 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-941edbc2-fad4-4caf-bda9-cd4c8dd9c774 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 22:20:18 user nova-compute[74337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 22:20:18 user nova-compute[74337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 22:20:18 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-941edbc2-fad4-4caf-bda9-cd4c8dd9c774 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d21a1e3a-6942-4205-965a-cb5aee0eaecd', 0)] {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 22:20:18 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:20:18 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:20:18 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[9339c29d-2b7a-41e0-9f8b-2c0cc3e14d50]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d21a1e3a-6942-4205-965a-cb5aee0eaecd\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:20:18 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:20:18 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:20:18 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[3df0faaa-8e91-417f-98fd-baa9f1e49114]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21a1e3a-6942-4205-965a-cb5aee0eaecd (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:20:18 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-941edbc2-fad4-4caf-bda9-cd4c8dd9c774 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21a1e3a-6942-4205-965a-cb5aee0eaecd (non-flash)
Oct 23 22:20:18 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 22:20:18 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-941edbc2-fad4-4caf-bda9-cd4c8dd9c774 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d21a1e3a-6942-4205-965a-cb5aee0eaecd (non-flash)
Oct 23 22:20:18 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 22:20:18 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-941edbc2-fad4-4caf-bda9-cd4c8dd9c774 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5ec87bb7f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d21a1e3a-6942-4205-965a-cb5aee0eaecd'): ({'sdb'}, set())}) {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 22:20:18 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-941edbc2-fad4-4caf-bda9-cd4c8dd9c774 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Removing single pathed devices sdb {{(pid=74337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 22:20:18 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:20:18 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:20:18 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e769150-5772-49b2-9a46-c86e4bef210b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:20:18 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:20:18 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:20:18 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a34765-4927-4eb6-ae2a-4da2ef016325]: (4, ('ok\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:20:18 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-941edbc2-fad4-4caf-bda9-cd4c8dd9c774 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Flushing IO for device /dev/sdb {{(pid=74337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 22:20:18 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:20:18 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:20:18 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[2038b322-705e-4df6-8fbe-df93511dea94]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:20:18 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-941edbc2-fad4-4caf-bda9-cd4c8dd9c774 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 22:20:18 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:20:18 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.031s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:20:18 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[60246ad3-3a42-40a3-b0bc-115d2c59b0b6]: (4, ('1', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:20:18 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-941edbc2-fad4-4caf-bda9-cd4c8dd9c774 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 22:20:18 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-941edbc2-fad4-4caf-bda9-cd4c8dd9c774 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] SCSI volumes sdb have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 22:20:18 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-941edbc2-fad4-4caf-bda9-cd4c8dd9c774 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d21a1e3a-6942-4205-965a-cb5aee0eaecd')] {{(pid=74337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 22:20:18 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d21a1e3a-6942-4205-965a-cb5aee0eaecd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:20:18 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d21a1e3a-6942-4205-965a-cb5aee0eaecd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:20:18 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[2197e6e4-fb47-46a4-9c30-028e22647869]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:20:18 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-941edbc2-fad4-4caf-bda9-cd4c8dd9c774 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:20:18 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d21a1e3a-6942-4205-965a-cb5aee0eaecd -p 172.16.0.220:3260 --logout {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:20:18 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d21a1e3a-6942-4205-965a-cb5aee0eaecd -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:20:18 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a90b663-fb38-48cd-b3be-23c291a0f407]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:d21a1e3a-6942-4205-965a-cb5aee0eaecd, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:d21a1e3a-6942-4205-965a-cb5aee0eaecd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:20:18 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-941edbc2-fad4-4caf-bda9-cd4c8dd9c774 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:d21a1e3a-6942-4205-965a-cb5aee0eaecd, portal: 172.16.0.220,3260]
Oct 23 22:20:18 user nova-compute[74337]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:d21a1e3a-6942-4205-965a-cb5aee0eaecd, portal: 172.16.0.220,3260] successful.
Oct 23 22:20:18 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:20:18 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d21a1e3a-6942-4205-965a-cb5aee0eaecd -p 172.16.0.220:3260 --op delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:20:18 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d21a1e3a-6942-4205-965a-cb5aee0eaecd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:20:18 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[253f4cd4-2fc5-4ca7-b7c4-08185dedba5b]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:20:18 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-941edbc2-fad4-4caf-bda9-cd4c8dd9c774 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:20:18 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-941edbc2-fad4-4caf-bda9-cd4c8dd9c774 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.275s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 22:20:18 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-941edbc2-fad4-4caf-bda9-cd4c8dd9c774 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] <== disconnect_volume: return (276ms) None {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 22:20:18 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-941edbc2-fad4-4caf-bda9-cd4c8dd9c774 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Disconnected iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 22:20:19 user nova-compute[74337]: DEBUG nova.objects.instance [None req-941edbc2-fad4-4caf-bda9-cd4c8dd9c774 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Lazy-loading 'flavor' on Instance uuid 40c79805-6e80-4c44-90ca-27a2af6be3bd {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:20:19 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-941edbc2-fad4-4caf-bda9-cd4c8dd9c774 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Lock "40c79805-6e80-4c44-90ca-27a2af6be3bd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.669s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:20:21 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:20:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:20:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:20:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 22:20:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 22:20:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 22:20:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:20:31 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:20:34 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:20:34 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:20:34 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 22:20:35 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:20:36 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:20:36 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:20:36 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:20:36 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 22:20:36 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 22:20:36 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 22:20:36 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:20:38 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:20:38 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:20:38 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Triggering sync for uuid 40c79805-6e80-4c44-90ca-27a2af6be3bd {{(pid=74337) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 23 22:20:38 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "40c79805-6e80-4c44-90ca-27a2af6be3bd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:20:38 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "40c79805-6e80-4c44-90ca-27a2af6be3bd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:20:38 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "40c79805-6e80-4c44-90ca-27a2af6be3bd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.030s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:20:41 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:20:41 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:20:42 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:20:42 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:20:42 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:20:42 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:20:42 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Auditing locally available compute resources for user (node: user) {{(pid=74337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 22:20:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c79805-6e80-4c44-90ca-27a2af6be3bd/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:20:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c79805-6e80-4c44-90ca-27a2af6be3bd/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:20:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c79805-6e80-4c44-90ca-27a2af6be3bd/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:20:42 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c79805-6e80-4c44-90ca-27a2af6be3bd/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:20:43 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:20:43 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:20:43 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Hypervisor/Node resource view: name=user free_ram=8969MB free_disk=25.169071197509766GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 22:20:43 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:20:43 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:20:43 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 40c79805-6e80-4c44-90ca-27a2af6be3bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 22:20:43 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 22:20:43 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 22:20:43 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Refreshing inventories for resource provider dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 23 22:20:43 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Updating ProviderTree inventory for provider dfcf3942-a432-4293-945b-14b86f57d794 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 23 22:20:43 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Updating inventory in ProviderTree for provider dfcf3942-a432-4293-945b-14b86f57d794 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 23 22:20:43 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Refreshing aggregate associations for resource provider dfcf3942-a432-4293-945b-14b86f57d794, aggregates: None {{(pid=74337) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 23 22:20:43 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Refreshing trait associations for resource provider dfcf3942-a432-4293-945b-14b86f57d794, traits: COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE2,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE42,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_EXTEND,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_TRUSTED_CERTS {{(pid=74337) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 23 22:20:43 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 22:20:43 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 22:20:43 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Compute_service record updated for user:user {{(pid=74337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 22:20:43 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.282s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:20:46 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:20:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:20:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:20:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 22:20:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 22:20:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 22:20:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:20:48 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:20:48 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Starting heal instance info cache {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 22:20:48 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Rebuilding the list of instances to heal {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 22:20:48 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "refresh_cache-40c79805-6e80-4c44-90ca-27a2af6be3bd" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 22:20:48 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquired lock "refresh_cache-40c79805-6e80-4c44-90ca-27a2af6be3bd" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 22:20:48 user nova-compute[74337]: DEBUG nova.network.neutron [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Forcefully refreshing network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 22:20:48 user nova-compute[74337]: DEBUG nova.objects.instance [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lazy-loading 'info_cache' on Instance uuid 40c79805-6e80-4c44-90ca-27a2af6be3bd {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:20:49 user nova-compute[74337]: DEBUG nova.network.neutron [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Updating instance_info_cache with network_info: [{"id": "c754233d-824c-40ec-bae1-c4ed5a90b392", "address": "fa:16:3e:28:38:e6", "network": {"id": "0110d432-0607-428c-b97f-68c5431cecea", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-718986578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "650cb403fcd142f485bd9b3fad1e0bd7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc754233d-82", "ovs_interfaceid": "c754233d-824c-40ec-bae1-c4ed5a90b392", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 22:20:49 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Releasing lock "refresh_cache-40c79805-6e80-4c44-90ca-27a2af6be3bd" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 22:20:49 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Updated the network info_cache for instance {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 22:20:51 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:20:52 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-402b721f-12ee-4fa7-a966-f23fd6f736d6 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Acquiring lock "40c79805-6e80-4c44-90ca-27a2af6be3bd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:20:52 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-402b721f-12ee-4fa7-a966-f23fd6f736d6 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Lock "40c79805-6e80-4c44-90ca-27a2af6be3bd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:20:52 user nova-compute[74337]: DEBUG nova.objects.instance [None req-402b721f-12ee-4fa7-a966-f23fd6f736d6 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Lazy-loading 'flavor' on Instance uuid 40c79805-6e80-4c44-90ca-27a2af6be3bd {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:20:52 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-402b721f-12ee-4fa7-a966-f23fd6f736d6 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Lock "40c79805-6e80-4c44-90ca-27a2af6be3bd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:20:52 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-402b721f-12ee-4fa7-a966-f23fd6f736d6 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Acquiring lock "40c79805-6e80-4c44-90ca-27a2af6be3bd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:20:52 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-402b721f-12ee-4fa7-a966-f23fd6f736d6 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Lock "40c79805-6e80-4c44-90ca-27a2af6be3bd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:20:52 user nova-compute[74337]: INFO nova.compute.manager [None req-402b721f-12ee-4fa7-a966-f23fd6f736d6 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Attaching volume 1fddf0a9-4340-4298-8271-06a0824e1d9d to /dev/vdb
Oct 23 22:20:52 user nova-compute[74337]: DEBUG os_brick.utils [None req-402b721f-12ee-4fa7-a966-f23fd6f736d6 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 22:20:52 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:20:52 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:20:52 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[40808361-f8c9-4afe-9049-d0c9bbe28757]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f34011b66e40\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:20:52 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:20:52 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:20:52 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec26567-6288-4bbd-94a1-e5d337e40bc5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:20:52 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:20:53 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:20:53 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df04cc9-6101-4c51-86f5-489210cd2e48]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:20:53 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbf4f1de-8a03-455b-a59f-0a519666a1b5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:20:53 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-402b721f-12ee-4fa7-a966-f23fd6f736d6 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Running cmd (subprocess): nvme version {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:20:53 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-402b721f-12ee-4fa7-a966-f23fd6f736d6 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] 'nvme version' failed. Not Retrying. {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 22:20:53 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-402b721f-12ee-4fa7-a966-f23fd6f736d6 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] nvme not present on system {{(pid=74337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 22:20:53 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:20:53 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 22:20:53 user nova-compute[74337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 22:20:53 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7a04086-2ad2-424d-a5bf-895146a8f3d9]: (4, '') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:20:53 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-402b721f-12ee-4fa7-a966-f23fd6f736d6 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 22:20:53 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-402b721f-12ee-4fa7-a966-f23fd6f736d6 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 22:20:53 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-402b721f-12ee-4fa7-a966-f23fd6f736d6 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] LIGHTOS: no hostnqn found. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 22:20:53 user nova-compute[74337]: DEBUG os_brick.utils [None req-402b721f-12ee-4fa7-a966-f23fd6f736d6 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f34011b66e40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 22:20:53 user nova-compute[74337]: DEBUG nova.virt.block_device [None req-402b721f-12ee-4fa7-a966-f23fd6f736d6 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Updating existing volume attachment record: 0153080d-1b7a-42f6-8b68-22b175e856df {{(pid=74337) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 22:20:54 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:20:56 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:21:01 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:21:06 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:21:08 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-402b721f-12ee-4fa7-a966-f23fd6f736d6 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Calling os-brick to attach iSCSI Volume {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 22:21:08 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-402b721f-12ee-4fa7-a966-f23fd6f736d6 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1fddf0a9-4340-4298-8271-06a0824e1d9d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jOVlmAcH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 22:21:08 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-402b721f-12ee-4fa7-a966-f23fd6f736d6 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 22:21:08 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-402b721f-12ee-4fa7-a966-f23fd6f736d6 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 22:21:08 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-402b721f-12ee-4fa7-a966-f23fd6f736d6 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 22:21:08 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-402b721f-12ee-4fa7-a966-f23fd6f736d6 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 22:21:08 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-402b721f-12ee-4fa7-a966-f23fd6f736d6 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1fddf0a9-4340-4298-8271-06a0824e1d9d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 22:21:08 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-402b721f-12ee-4fa7-a966-f23fd6f736d6 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1fddf0a9-4340-4298-8271-06a0824e1d9d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 22:21:08 user nova-compute[74337]: INFO os_brick.initiator.connectors.iscsi [None req-402b721f-12ee-4fa7-a966-f23fd6f736d6 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 22:21:08 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fddf0a9-4340-4298-8271-06a0824e1d9d -p 172.16.0.220:3260 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:21:08 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fddf0a9-4340-4298-8271-06a0824e1d9d -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:21:08 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ab5e896-11f4-412f-adea-c1b2a6c4d105]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:21:08 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-402b721f-12ee-4fa7-a966-f23fd6f736d6 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 22:21:08 user nova-compute[74337]:  {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:21:08 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fddf0a9-4340-4298-8271-06a0824e1d9d -p 172.16.0.220:3260 --interface default --op new {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:21:08 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fddf0a9-4340-4298-8271-06a0824e1d9d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:21:08 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b292dcf3-9e4a-4313-8afd-86abfad35e13]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1fddf0a9-4340-4298-8271-06a0824e1d9d] added\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:21:08 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-402b721f-12ee-4fa7-a966-f23fd6f736d6 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1fddf0a9-4340-4298-8271-06a0824e1d9d] added
Oct 23 22:21:08 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:21:08 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fddf0a9-4340-4298-8271-06a0824e1d9d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:21:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fddf0a9-4340-4298-8271-06a0824e1d9d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:21:09 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f1a2c13-442d-4f90-9354-47a9b4f543af]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:21:09 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-402b721f-12ee-4fa7-a966-f23fd6f736d6 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:21:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fddf0a9-4340-4298-8271-06a0824e1d9d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:21:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fddf0a9-4340-4298-8271-06a0824e1d9d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:21:09 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa354b6e-7a27-43a6-9ede-ba980b903d9e]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:21:09 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-402b721f-12ee-4fa7-a966-f23fd6f736d6 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:21:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fddf0a9-4340-4298-8271-06a0824e1d9d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jOVlmAcH {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:21:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fddf0a9-4340-4298-8271-06a0824e1d9d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jOVlmAcH" returned: 0 in 0.020s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:21:09 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e62abdd1-60ba-43c1-912b-77ad888b263c]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:21:09 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-402b721f-12ee-4fa7-a966-f23fd6f736d6 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jOVlmAcH'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:21:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fddf0a9-4340-4298-8271-06a0824e1d9d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:21:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fddf0a9-4340-4298-8271-06a0824e1d9d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:21:09 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[536d9053-fcb1-4522-b5f2-4f76fcc3b2d2]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:21:09 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-402b721f-12ee-4fa7-a966-f23fd6f736d6 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:21:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:21:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:21:09 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[0078e201-4c40-45b4-8258-72350e30f09e]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:21:09 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-402b721f-12ee-4fa7-a966-f23fd6f736d6 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 23 22:21:09 user nova-compute[74337]:  {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 22:21:09 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-402b721f-12ee-4fa7-a966-f23fd6f736d6 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 23 22:21:09 user nova-compute[74337]:  {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 22:21:09 user nova-compute[74337]: WARNING os_brick.initiator.connectors.iscsi [None req-402b721f-12ee-4fa7-a966-f23fd6f736d6 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 23 22:21:09 user nova-compute[74337]: 
Oct 23 22:21:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fddf0a9-4340-4298-8271-06a0824e1d9d -p 172.16.0.220:3260 --login {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:21:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fddf0a9-4340-4298-8271-06a0824e1d9d -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:21:09 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[871349e7-19b4-4c1f-b946-aeefeb12c1f4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1fddf0a9-4340-4298-8271-06a0824e1d9d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1fddf0a9-4340-4298-8271-06a0824e1d9d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:21:09 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-402b721f-12ee-4fa7-a966-f23fd6f736d6 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1fddf0a9-4340-4298-8271-06a0824e1d9d, portal: 172.16.0.220,3260]
Oct 23 22:21:09 user nova-compute[74337]: Login to [iface: default, target: iqn.2010-10.org.openstack:1fddf0a9-4340-4298-8271-06a0824e1d9d, portal: 172.16.0.220,3260] successful.
Oct 23 22:21:09 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:21:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fddf0a9-4340-4298-8271-06a0824e1d9d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:21:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fddf0a9-4340-4298-8271-06a0824e1d9d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:21:09 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d8df5b-8004-4e9b-9123-1e3326d25690]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:21:09 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-402b721f-12ee-4fa7-a966-f23fd6f736d6 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:21:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:21:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:21:09 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[412ebc6b-59d3-44ba-a9f3-de0260138d4a]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fddf0a9-4340-4298-8271-06a0824e1d9d (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:21:09 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-402b721f-12ee-4fa7-a966-f23fd6f736d6 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fddf0a9-4340-4298-8271-06a0824e1d9d (non-flash)
Oct 23 22:21:09 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 22:21:09 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-402b721f-12ee-4fa7-a966-f23fd6f736d6 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fddf0a9-4340-4298-8271-06a0824e1d9d (non-flash)
Oct 23 22:21:09 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 22:21:09 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-402b721f-12ee-4fa7-a966-f23fd6f736d6 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1fddf0a9-4340-4298-8271-06a0824e1d9d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 22:21:09 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-402b721f-12ee-4fa7-a966-f23fd6f736d6 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Connected to 172.16.0.220:3260 {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 22:21:09 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-402b721f-12ee-4fa7-a966-f23fd6f736d6 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=74337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 22:21:09 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-402b721f-12ee-4fa7-a966-f23fd6f736d6 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 22:21:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:21:09 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:21:09 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c75396ef-cf7d-431d-af9e-d20f454ef8ec]: (4, ('- - 0', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:21:09 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-402b721f-12ee-4fa7-a966-f23fd6f736d6 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 22:21:09 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-402b721f-12ee-4fa7-a966-f23fd6f736d6 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:1fddf0a9-4340-4298-8271-06a0824e1d9d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jOVlmAcH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 22:21:10 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-402b721f-12ee-4fa7-a966-f23fd6f736d6 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.285s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 22:21:10 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-402b721f-12ee-4fa7-a966-f23fd6f736d6 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] <== connect_volume: return (1287ms) {'type': 'block', 'scsi_wwn': '26164353836356162', 'path': '/dev/sdb'} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 22:21:10 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-402b721f-12ee-4fa7-a966-f23fd6f736d6 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26164353836356162', 'path': '/dev/sdb'} {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 22:21:10 user nova-compute[74337]: DEBUG nova.objects.instance [None req-402b721f-12ee-4fa7-a966-f23fd6f736d6 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Lazy-loading 'flavor' on Instance uuid 40c79805-6e80-4c44-90ca-27a2af6be3bd {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:21:10 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-402b721f-12ee-4fa7-a966-f23fd6f736d6 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 22:21:10 user nova-compute[74337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 22:21:10 user nova-compute[74337]:   <source dev="/dev/sdb"/>
Oct 23 22:21:10 user nova-compute[74337]:   <target dev="vdb" bus="virtio"/>
Oct 23 22:21:10 user nova-compute[74337]:   <serial>1fddf0a9-4340-4298-8271-06a0824e1d9d</serial>
Oct 23 22:21:10 user nova-compute[74337]: </disk>
Oct 23 22:21:10 user nova-compute[74337]:  {{(pid=74337) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 22:21:10 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-402b721f-12ee-4fa7-a966-f23fd6f736d6 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] No BDM found with device name vda, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 22:21:10 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-402b721f-12ee-4fa7-a966-f23fd6f736d6 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 22:21:10 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-402b721f-12ee-4fa7-a966-f23fd6f736d6 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] No VIF found with MAC fa:16:3e:28:38:e6, not building metadata {{(pid=74337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 22:21:10 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-402b721f-12ee-4fa7-a966-f23fd6f736d6 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Lock "40c79805-6e80-4c44-90ca-27a2af6be3bd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.928s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:21:11 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:21:11 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:21:11 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 22:21:11 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 22:21:11 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 22:21:11 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:21:12 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-37980a3e-0b22-4f33-8ba8-645ad8447ab6 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Acquiring lock "40c79805-6e80-4c44-90ca-27a2af6be3bd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:21:12 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-37980a3e-0b22-4f33-8ba8-645ad8447ab6 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Lock "40c79805-6e80-4c44-90ca-27a2af6be3bd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:21:12 user nova-compute[74337]: INFO nova.compute.manager [None req-37980a3e-0b22-4f33-8ba8-645ad8447ab6 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Detaching volume 1fddf0a9-4340-4298-8271-06a0824e1d9d
Oct 23 22:21:12 user nova-compute[74337]: INFO nova.virt.block_device [None req-37980a3e-0b22-4f33-8ba8-645ad8447ab6 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Attempting to driver detach volume 1fddf0a9-4340-4298-8271-06a0824e1d9d from mountpoint /dev/vdb
Oct 23 22:21:12 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-37980a3e-0b22-4f33-8ba8-645ad8447ab6 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Attempting to detach device vdb from instance 40c79805-6e80-4c44-90ca-27a2af6be3bd from the persistent domain config. {{(pid=74337) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 22:21:12 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-37980a3e-0b22-4f33-8ba8-645ad8447ab6 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 22:21:12 user nova-compute[74337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 22:21:12 user nova-compute[74337]:   <source dev="/dev/sdb"/>
Oct 23 22:21:12 user nova-compute[74337]:   <target dev="vdb" bus="virtio"/>
Oct 23 22:21:12 user nova-compute[74337]:   <serial>1fddf0a9-4340-4298-8271-06a0824e1d9d</serial>
Oct 23 22:21:12 user nova-compute[74337]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 22:21:12 user nova-compute[74337]: </disk>
Oct 23 22:21:12 user nova-compute[74337]:  {{(pid=74337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 22:21:12 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-37980a3e-0b22-4f33-8ba8-645ad8447ab6 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Successfully detached device vdb from instance 40c79805-6e80-4c44-90ca-27a2af6be3bd from the persistent domain config.
Oct 23 22:21:12 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-37980a3e-0b22-4f33-8ba8-645ad8447ab6 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 40c79805-6e80-4c44-90ca-27a2af6be3bd from the live domain config. {{(pid=74337) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 22:21:12 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-37980a3e-0b22-4f33-8ba8-645ad8447ab6 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 22:21:12 user nova-compute[74337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 22:21:12 user nova-compute[74337]:   <source dev="/dev/sdb"/>
Oct 23 22:21:12 user nova-compute[74337]:   <target dev="vdb" bus="virtio"/>
Oct 23 22:21:12 user nova-compute[74337]:   <serial>1fddf0a9-4340-4298-8271-06a0824e1d9d</serial>
Oct 23 22:21:12 user nova-compute[74337]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 22:21:12 user nova-compute[74337]: </disk>
Oct 23 22:21:12 user nova-compute[74337]:  {{(pid=74337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 22:21:13 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-37980a3e-0b22-4f33-8ba8-645ad8447ab6 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 40c79805-6e80-4c44-90ca-27a2af6be3bd {{(pid=74337) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 22:21:14 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:21:16 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:21:21 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:21:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:21:31 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:21:33 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-37980a3e-0b22-4f33-8ba8-645ad8447ab6 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 40c79805-6e80-4c44-90ca-27a2af6be3bd is timed out.
Oct 23 22:21:33 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-37980a3e-0b22-4f33-8ba8-645ad8447ab6 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Successfully detached device vdb from instance 40c79805-6e80-4c44-90ca-27a2af6be3bd from the live domain config.
Oct 23 22:21:33 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37980a3e-0b22-4f33-8ba8-645ad8447ab6 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] calling os-brick to detach iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 22:21:33 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-37980a3e-0b22-4f33-8ba8-645ad8447ab6 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, {'target_iqn': 'iqn.2010-10.org.openstack:1fddf0a9-4340-4298-8271-06a0824e1d9d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jOVlmAcH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 22:21:33 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-37980a3e-0b22-4f33-8ba8-645ad8447ab6 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 22:21:33 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-37980a3e-0b22-4f33-8ba8-645ad8447ab6 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 22:21:33 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-37980a3e-0b22-4f33-8ba8-645ad8447ab6 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 22:21:33 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:21:33 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:21:33 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a9db9e3-de6e-411b-a686-bca303629cf0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1fddf0a9-4340-4298-8271-06a0824e1d9d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:21:33 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-37980a3e-0b22-4f33-8ba8-645ad8447ab6 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 22:21:33 user nova-compute[74337]: No targets found.
Oct 23 22:21:33 user nova-compute[74337]: iSNS:
Oct 23 22:21:33 user nova-compute[74337]: No targets found.
Oct 23 22:21:33 user nova-compute[74337]: STATIC:
Oct 23 22:21:33 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:1fddf0a9-4340-4298-8271-06a0824e1d9d
Oct 23 22:21:33 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 22:21:33 user nova-compute[74337]:                 Iface Name: default
Oct 23 22:21:33 user nova-compute[74337]: FIRMWARE:
Oct 23 22:21:33 user nova-compute[74337]: No targets found.
Oct 23 22:21:33 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 22:21:33 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-37980a3e-0b22-4f33-8ba8-645ad8447ab6 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 22:21:33 user nova-compute[74337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 22:21:33 user nova-compute[74337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 22:21:33 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-37980a3e-0b22-4f33-8ba8-645ad8447ab6 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1fddf0a9-4340-4298-8271-06a0824e1d9d', 0)] {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 22:21:33 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:21:33 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:21:33 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d4f5563-5826-4942-8daf-7b79cdd667d7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1fddf0a9-4340-4298-8271-06a0824e1d9d\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:21:33 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:21:33 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:21:33 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[db1eb3ae-113c-47d6-a709-8ce365b74dd9]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fddf0a9-4340-4298-8271-06a0824e1d9d (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:21:33 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-37980a3e-0b22-4f33-8ba8-645ad8447ab6 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fddf0a9-4340-4298-8271-06a0824e1d9d (non-flash)
Oct 23 22:21:33 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 22:21:33 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-37980a3e-0b22-4f33-8ba8-645ad8447ab6 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fddf0a9-4340-4298-8271-06a0824e1d9d (non-flash)
Oct 23 22:21:33 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 22:21:33 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-37980a3e-0b22-4f33-8ba8-645ad8447ab6 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5eec3cc3a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1fddf0a9-4340-4298-8271-06a0824e1d9d'): ({'sdb'}, set())}) {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 22:21:33 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-37980a3e-0b22-4f33-8ba8-645ad8447ab6 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Removing single pathed devices sdb {{(pid=74337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 22:21:33 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:21:33 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:21:33 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[de167583-c08a-40d8-b3b3-37e606317f98]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:21:33 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:21:33 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:21:33 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f1e584a-ac15-4bc2-8443-b5103fe170c7]: (4, ('ok\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:21:33 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-37980a3e-0b22-4f33-8ba8-645ad8447ab6 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Flushing IO for device /dev/sdb {{(pid=74337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 22:21:33 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:21:33 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:21:33 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[db34cee5-2a34-4268-a0de-7f824e4d9004]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:21:33 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-37980a3e-0b22-4f33-8ba8-645ad8447ab6 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 22:21:33 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:21:33 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:21:33 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5cfec86-9a4e-40a5-a57a-bd3fe745b6bd]: (4, ('1', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:21:33 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-37980a3e-0b22-4f33-8ba8-645ad8447ab6 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 22:21:33 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-37980a3e-0b22-4f33-8ba8-645ad8447ab6 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] SCSI volumes sdb have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 22:21:33 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-37980a3e-0b22-4f33-8ba8-645ad8447ab6 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1fddf0a9-4340-4298-8271-06a0824e1d9d')] {{(pid=74337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 22:21:33 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fddf0a9-4340-4298-8271-06a0824e1d9d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:21:33 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fddf0a9-4340-4298-8271-06a0824e1d9d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:21:33 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1182449-9a47-40a1-8853-a5472870d862]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:21:33 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-37980a3e-0b22-4f33-8ba8-645ad8447ab6 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:21:33 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fddf0a9-4340-4298-8271-06a0824e1d9d -p 172.16.0.220:3260 --logout {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:21:33 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fddf0a9-4340-4298-8271-06a0824e1d9d -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:21:33 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[c622a08e-c4ef-4aec-a6e9-a5d826623d0c]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:1fddf0a9-4340-4298-8271-06a0824e1d9d, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:1fddf0a9-4340-4298-8271-06a0824e1d9d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:21:33 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-37980a3e-0b22-4f33-8ba8-645ad8447ab6 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:1fddf0a9-4340-4298-8271-06a0824e1d9d, portal: 172.16.0.220,3260]
Oct 23 22:21:33 user nova-compute[74337]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:1fddf0a9-4340-4298-8271-06a0824e1d9d, portal: 172.16.0.220,3260] successful.
Oct 23 22:21:33 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:21:33 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fddf0a9-4340-4298-8271-06a0824e1d9d -p 172.16.0.220:3260 --op delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:21:33 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fddf0a9-4340-4298-8271-06a0824e1d9d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:21:33 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b9b8f1-832b-42e0-bf2f-0468bb9acef2]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:21:33 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-37980a3e-0b22-4f33-8ba8-645ad8447ab6 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:21:33 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-37980a3e-0b22-4f33-8ba8-645ad8447ab6 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 22:21:33 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-37980a3e-0b22-4f33-8ba8-645ad8447ab6 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] <== disconnect_volume: return (284ms) None {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 22:21:33 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37980a3e-0b22-4f33-8ba8-645ad8447ab6 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Disconnected iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 22:21:34 user nova-compute[74337]: DEBUG nova.objects.instance [None req-37980a3e-0b22-4f33-8ba8-645ad8447ab6 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Lazy-loading 'flavor' on Instance uuid 40c79805-6e80-4c44-90ca-27a2af6be3bd {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:21:34 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-37980a3e-0b22-4f33-8ba8-645ad8447ab6 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Lock "40c79805-6e80-4c44-90ca-27a2af6be3bd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.705s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:21:35 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:21:36 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:21:36 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:21:36 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 22:21:36 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:21:36 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:21:36 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 22:21:36 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 22:21:36 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 22:21:36 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:21:37 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:21:40 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:21:41 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:21:42 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:21:43 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:21:43 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:21:43 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:21:43 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:21:43 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Auditing locally available compute resources for user (node: user) {{(pid=74337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 22:21:43 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c79805-6e80-4c44-90ca-27a2af6be3bd/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:21:43 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c79805-6e80-4c44-90ca-27a2af6be3bd/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:21:43 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c79805-6e80-4c44-90ca-27a2af6be3bd/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:21:43 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c79805-6e80-4c44-90ca-27a2af6be3bd/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:21:44 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:21:44 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:21:44 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Hypervisor/Node resource view: name=user free_ram=8950MB free_disk=25.168048858642578GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 22:21:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:21:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:21:44 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 40c79805-6e80-4c44-90ca-27a2af6be3bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 22:21:44 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 22:21:44 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 22:21:44 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 22:21:44 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 22:21:44 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Compute_service record updated for user:user {{(pid=74337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 22:21:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.190s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:21:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:21:47 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:21:50 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:21:50 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Starting heal instance info cache {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 22:21:50 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Rebuilding the list of instances to heal {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 22:21:50 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "refresh_cache-40c79805-6e80-4c44-90ca-27a2af6be3bd" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 22:21:50 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquired lock "refresh_cache-40c79805-6e80-4c44-90ca-27a2af6be3bd" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 22:21:50 user nova-compute[74337]: DEBUG nova.network.neutron [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Forcefully refreshing network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 22:21:50 user nova-compute[74337]: DEBUG nova.objects.instance [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lazy-loading 'info_cache' on Instance uuid 40c79805-6e80-4c44-90ca-27a2af6be3bd {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:21:50 user nova-compute[74337]: DEBUG nova.network.neutron [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Updating instance_info_cache with network_info: [{"id": "c754233d-824c-40ec-bae1-c4ed5a90b392", "address": "fa:16:3e:28:38:e6", "network": {"id": "0110d432-0607-428c-b97f-68c5431cecea", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-718986578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "650cb403fcd142f485bd9b3fad1e0bd7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc754233d-82", "ovs_interfaceid": "c754233d-824c-40ec-bae1-c4ed5a90b392", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 22:21:50 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Releasing lock "refresh_cache-40c79805-6e80-4c44-90ca-27a2af6be3bd" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 22:21:50 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Updated the network info_cache for instance {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 22:21:51 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:21:53 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:21:56 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:21:56 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:21:56 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 22:21:56 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 22:21:56 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 22:21:56 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:22:01 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:22:06 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:22:06 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:22:06 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 22:22:06 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 22:22:06 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 22:22:06 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:22:07 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-3d8296da-c87d-4589-8817-66a8af85483f tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Acquiring lock "40c79805-6e80-4c44-90ca-27a2af6be3bd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:22:07 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-3d8296da-c87d-4589-8817-66a8af85483f tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Lock "40c79805-6e80-4c44-90ca-27a2af6be3bd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:22:07 user nova-compute[74337]: DEBUG nova.objects.instance [None req-3d8296da-c87d-4589-8817-66a8af85483f tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Lazy-loading 'flavor' on Instance uuid 40c79805-6e80-4c44-90ca-27a2af6be3bd {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:22:07 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-3d8296da-c87d-4589-8817-66a8af85483f tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Lock "40c79805-6e80-4c44-90ca-27a2af6be3bd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:22:07 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-3d8296da-c87d-4589-8817-66a8af85483f tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Acquiring lock "40c79805-6e80-4c44-90ca-27a2af6be3bd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:22:07 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-3d8296da-c87d-4589-8817-66a8af85483f tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Lock "40c79805-6e80-4c44-90ca-27a2af6be3bd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:22:07 user nova-compute[74337]: INFO nova.compute.manager [None req-3d8296da-c87d-4589-8817-66a8af85483f tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Attaching volume 5de933dd-5177-48e4-a7df-32e0ac272a68 to /dev/vdb
Oct 23 22:22:08 user nova-compute[74337]: DEBUG os_brick.utils [None req-3d8296da-c87d-4589-8817-66a8af85483f tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 22:22:08 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:22:08 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:22:08 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[7acad3c8-b477-47ce-8564-60d5ab92039c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f34011b66e40\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:22:08 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:22:08 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:22:08 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d2ef96f-7c9c-4b0e-9422-6ac8c32a052f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:22:08 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:22:08 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:22:08 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aed232c-2927-4b77-83e4-7e4404a4f00a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:22:08 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa03aa4f-1579-4585-a879-5c53117fad0d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:22:08 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-3d8296da-c87d-4589-8817-66a8af85483f tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Running cmd (subprocess): nvme version {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:22:08 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-3d8296da-c87d-4589-8817-66a8af85483f tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] 'nvme version' failed. Not Retrying. {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 22:22:08 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3d8296da-c87d-4589-8817-66a8af85483f tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] nvme not present on system {{(pid=74337) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 23 22:22:08 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:22:08 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 23 22:22:08 user nova-compute[74337]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 23 22:22:08 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[f691457d-e6ef-4ffc-8af1-f98cdaea7a5b]: (4, '') {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:22:08 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-3d8296da-c87d-4589-8817-66a8af85483f tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74337) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 23 22:22:08 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-3d8296da-c87d-4589-8817-66a8af85483f tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 23 22:22:08 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.lightos [None req-3d8296da-c87d-4589-8817-66a8af85483f tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] LIGHTOS: no hostnqn found. {{(pid=74337) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 23 22:22:08 user nova-compute[74337]: DEBUG os_brick.utils [None req-3d8296da-c87d-4589-8817-66a8af85483f tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f34011b66e40', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 22:22:08 user nova-compute[74337]: DEBUG nova.virt.block_device [None req-3d8296da-c87d-4589-8817-66a8af85483f tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Updating existing volume attachment record: ca986aaf-5d56-48fa-ada8-18c6ac3679e3 {{(pid=74337) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 23 22:22:09 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:22:11 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:22:16 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:22:21 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:22:23 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d8296da-c87d-4589-8817-66a8af85483f tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Calling os-brick to attach iSCSI Volume {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 23 22:22:23 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d8296da-c87d-4589-8817-66a8af85483f tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5de933dd-5177-48e4-a7df-32e0ac272a68', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VTZdrHfL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 22:22:23 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-3d8296da-c87d-4589-8817-66a8af85483f tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 22:22:23 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-3d8296da-c87d-4589-8817-66a8af85483f tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 22:22:23 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-3d8296da-c87d-4589-8817-66a8af85483f tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 22:22:23 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-3d8296da-c87d-4589-8817-66a8af85483f tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 22:22:23 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-3d8296da-c87d-4589-8817-66a8af85483f tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5de933dd-5177-48e4-a7df-32e0ac272a68" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 22:22:23 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-3d8296da-c87d-4589-8817-66a8af85483f tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5de933dd-5177-48e4-a7df-32e0ac272a68" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 22:22:23 user nova-compute[74337]: INFO os_brick.initiator.connectors.iscsi [None req-3d8296da-c87d-4589-8817-66a8af85483f tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 23 22:22:23 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5de933dd-5177-48e4-a7df-32e0ac272a68 -p 172.16.0.220:3260 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:22:23 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5de933dd-5177-48e4-a7df-32e0ac272a68 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:22:23 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[841a3846-b368-4378-a595-8b0852f8b5ed]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:22:23 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d8296da-c87d-4589-8817-66a8af85483f tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 23 22:22:23 user nova-compute[74337]:  {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:22:23 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5de933dd-5177-48e4-a7df-32e0ac272a68 -p 172.16.0.220:3260 --interface default --op new {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:22:24 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5de933dd-5177-48e4-a7df-32e0ac272a68 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:22:24 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad49595-447a-40de-a1c2-708874179190]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5de933dd-5177-48e4-a7df-32e0ac272a68] added\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:22:24 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d8296da-c87d-4589-8817-66a8af85483f tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5de933dd-5177-48e4-a7df-32e0ac272a68] added
Oct 23 22:22:24 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:22:24 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5de933dd-5177-48e4-a7df-32e0ac272a68 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:22:24 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5de933dd-5177-48e4-a7df-32e0ac272a68 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:22:24 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[b683971c-f720-49c2-8976-ded215fa87b1]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:22:24 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d8296da-c87d-4589-8817-66a8af85483f tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:22:24 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5de933dd-5177-48e4-a7df-32e0ac272a68 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:22:24 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5de933dd-5177-48e4-a7df-32e0ac272a68 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:22:24 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[363cb2ec-47d7-4cd4-8b6f-450762d6ad5e]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:22:24 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d8296da-c87d-4589-8817-66a8af85483f tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:22:24 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5de933dd-5177-48e4-a7df-32e0ac272a68 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VTZdrHfL {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:22:24 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5de933dd-5177-48e4-a7df-32e0ac272a68 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VTZdrHfL" returned: 0 in 0.019s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:22:24 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[55319f29-c640-4d78-abcb-b99b73b2ca82]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:22:24 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d8296da-c87d-4589-8817-66a8af85483f tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VTZdrHfL'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:22:24 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5de933dd-5177-48e4-a7df-32e0ac272a68 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:22:24 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5de933dd-5177-48e4-a7df-32e0ac272a68 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:22:24 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[eea83054-48e0-4214-b6ce-a3d393d91aea]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:22:24 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d8296da-c87d-4589-8817-66a8af85483f tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:22:24 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:22:24 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:22:24 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd4d800f-4026-402f-82e2-fb8e2715f218]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:22:24 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d8296da-c87d-4589-8817-66a8af85483f tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 23 22:22:24 user nova-compute[74337]:  {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 22:22:24 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d8296da-c87d-4589-8817-66a8af85483f tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 23 22:22:24 user nova-compute[74337]:  {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 22:22:24 user nova-compute[74337]: WARNING os_brick.initiator.connectors.iscsi [None req-3d8296da-c87d-4589-8817-66a8af85483f tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 23 22:22:24 user nova-compute[74337]: 
Oct 23 22:22:24 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5de933dd-5177-48e4-a7df-32e0ac272a68 -p 172.16.0.220:3260 --login {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:22:24 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5de933dd-5177-48e4-a7df-32e0ac272a68 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:22:24 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a2d267-c5fa-4077-8f0d-5cb940a345f3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5de933dd-5177-48e4-a7df-32e0ac272a68, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5de933dd-5177-48e4-a7df-32e0ac272a68, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:22:24 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d8296da-c87d-4589-8817-66a8af85483f tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5de933dd-5177-48e4-a7df-32e0ac272a68, portal: 172.16.0.220,3260]
Oct 23 22:22:24 user nova-compute[74337]: Login to [iface: default, target: iqn.2010-10.org.openstack:5de933dd-5177-48e4-a7df-32e0ac272a68, portal: 172.16.0.220,3260] successful.
Oct 23 22:22:24 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:22:24 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5de933dd-5177-48e4-a7df-32e0ac272a68 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:22:24 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5de933dd-5177-48e4-a7df-32e0ac272a68 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:22:24 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ce1c545-e1a0-4100-a292-2b285f686304]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:22:24 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d8296da-c87d-4589-8817-66a8af85483f tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:22:24 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:22:24 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:22:24 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee95b768-e64a-433a-88c8-c1e5f89fd25d]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de933dd-5177-48e4-a7df-32e0ac272a68 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:22:24 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d8296da-c87d-4589-8817-66a8af85483f tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de933dd-5177-48e4-a7df-32e0ac272a68 (non-flash)
Oct 23 22:22:24 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 22:22:24 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d8296da-c87d-4589-8817-66a8af85483f tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de933dd-5177-48e4-a7df-32e0ac272a68 (non-flash)
Oct 23 22:22:24 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 22:22:24 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-3d8296da-c87d-4589-8817-66a8af85483f tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5de933dd-5177-48e4-a7df-32e0ac272a68" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 22:22:24 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d8296da-c87d-4589-8817-66a8af85483f tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Connected to 172.16.0.220:3260 {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 23 22:22:24 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-3d8296da-c87d-4589-8817-66a8af85483f tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=74337) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 23 22:22:24 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-3d8296da-c87d-4589-8817-66a8af85483f tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74337) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 23 22:22:24 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:22:24 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:22:24 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7c28a1a-b0bf-49d6-81ac-b473eafaf537]: (4, ('- - 0', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:22:24 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-3d8296da-c87d-4589-8817-66a8af85483f tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: None {{(pid=74337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 22:22:25 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-3d8296da-c87d-4589-8817-66a8af85483f tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74337) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 23 22:22:25 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d8296da-c87d-4589-8817-66a8af85483f tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5de933dd-5177-48e4-a7df-32e0ac272a68', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VTZdrHfL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74337) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 23 22:22:25 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-3d8296da-c87d-4589-8817-66a8af85483f tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.289s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 22:22:25 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d8296da-c87d-4589-8817-66a8af85483f tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] <== connect_volume: return (1290ms) {'type': 'block', 'scsi_wwn': '26164323665666562', 'path': '/dev/sdb'} {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 22:22:25 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d8296da-c87d-4589-8817-66a8af85483f tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26164323665666562', 'path': '/dev/sdb'} {{(pid=74337) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 23 22:22:25 user nova-compute[74337]: DEBUG nova.objects.instance [None req-3d8296da-c87d-4589-8817-66a8af85483f tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Lazy-loading 'flavor' on Instance uuid 40c79805-6e80-4c44-90ca-27a2af6be3bd {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:22:25 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-3d8296da-c87d-4589-8817-66a8af85483f tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] attach device xml: <disk type="block" device="disk">
Oct 23 22:22:25 user nova-compute[74337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 22:22:25 user nova-compute[74337]:   <source dev="/dev/sdb"/>
Oct 23 22:22:25 user nova-compute[74337]:   <target dev="vdb" bus="virtio"/>
Oct 23 22:22:25 user nova-compute[74337]:   <serial>5de933dd-5177-48e4-a7df-32e0ac272a68</serial>
Oct 23 22:22:25 user nova-compute[74337]: </disk>
Oct 23 22:22:25 user nova-compute[74337]:  {{(pid=74337) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 23 22:22:25 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-3d8296da-c87d-4589-8817-66a8af85483f tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] No BDM found with device name vda, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 22:22:25 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-3d8296da-c87d-4589-8817-66a8af85483f tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74337) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 23 22:22:25 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-3d8296da-c87d-4589-8817-66a8af85483f tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] No VIF found with MAC fa:16:3e:28:38:e6, not building metadata {{(pid=74337) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 23 22:22:25 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-3d8296da-c87d-4589-8817-66a8af85483f tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Lock "40c79805-6e80-4c44-90ca-27a2af6be3bd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.845s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:22:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:22:28 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-ea8b5411-c4f8-4f2a-8c94-d90ad2a41481 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Acquiring lock "40c79805-6e80-4c44-90ca-27a2af6be3bd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:22:28 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-ea8b5411-c4f8-4f2a-8c94-d90ad2a41481 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Lock "40c79805-6e80-4c44-90ca-27a2af6be3bd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:22:28 user nova-compute[74337]: INFO nova.compute.manager [None req-ea8b5411-c4f8-4f2a-8c94-d90ad2a41481 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Detaching volume 5de933dd-5177-48e4-a7df-32e0ac272a68
Oct 23 22:22:28 user nova-compute[74337]: INFO nova.virt.block_device [None req-ea8b5411-c4f8-4f2a-8c94-d90ad2a41481 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Attempting to driver detach volume 5de933dd-5177-48e4-a7df-32e0ac272a68 from mountpoint /dev/vdb
Oct 23 22:22:28 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-ea8b5411-c4f8-4f2a-8c94-d90ad2a41481 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Attempting to detach device vdb from instance 40c79805-6e80-4c44-90ca-27a2af6be3bd from the persistent domain config. {{(pid=74337) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 23 22:22:28 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-ea8b5411-c4f8-4f2a-8c94-d90ad2a41481 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 22:22:28 user nova-compute[74337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 22:22:28 user nova-compute[74337]:   <source dev="/dev/sdb"/>
Oct 23 22:22:28 user nova-compute[74337]:   <target dev="vdb" bus="virtio"/>
Oct 23 22:22:28 user nova-compute[74337]:   <serial>5de933dd-5177-48e4-a7df-32e0ac272a68</serial>
Oct 23 22:22:28 user nova-compute[74337]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 22:22:28 user nova-compute[74337]: </disk>
Oct 23 22:22:28 user nova-compute[74337]:  {{(pid=74337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 22:22:28 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-ea8b5411-c4f8-4f2a-8c94-d90ad2a41481 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Successfully detached device vdb from instance 40c79805-6e80-4c44-90ca-27a2af6be3bd from the persistent domain config.
Oct 23 22:22:28 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-ea8b5411-c4f8-4f2a-8c94-d90ad2a41481 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 40c79805-6e80-4c44-90ca-27a2af6be3bd from the live domain config. {{(pid=74337) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 23 22:22:28 user nova-compute[74337]: DEBUG nova.virt.libvirt.guest [None req-ea8b5411-c4f8-4f2a-8c94-d90ad2a41481 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] detach device xml: <disk type="block" device="disk">
Oct 23 22:22:28 user nova-compute[74337]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 23 22:22:28 user nova-compute[74337]:   <source dev="/dev/sdb"/>
Oct 23 22:22:28 user nova-compute[74337]:   <target dev="vdb" bus="virtio"/>
Oct 23 22:22:28 user nova-compute[74337]:   <serial>5de933dd-5177-48e4-a7df-32e0ac272a68</serial>
Oct 23 22:22:28 user nova-compute[74337]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 23 22:22:28 user nova-compute[74337]: </disk>
Oct 23 22:22:28 user nova-compute[74337]:  {{(pid=74337) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 23 22:22:28 user nova-compute[74337]: DEBUG nova.virt.libvirt.driver [None req-ea8b5411-c4f8-4f2a-8c94-d90ad2a41481 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 40c79805-6e80-4c44-90ca-27a2af6be3bd {{(pid=74337) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 23 22:22:29 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:22:31 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:22:36 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:22:36 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:22:36 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 22:22:36 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 22:22:36 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 22:22:36 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:22:37 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:22:37 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:22:38 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:22:38 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 22:22:39 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:22:40 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:22:41 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:22:41 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:22:41 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 22:22:41 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 22:22:41 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 22:22:41 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:22:44 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:22:44 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:22:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:22:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:22:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:22:44 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Auditing locally available compute resources for user (node: user) {{(pid=74337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 22:22:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c79805-6e80-4c44-90ca-27a2af6be3bd/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:22:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c79805-6e80-4c44-90ca-27a2af6be3bd/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:22:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c79805-6e80-4c44-90ca-27a2af6be3bd/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:22:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c79805-6e80-4c44-90ca-27a2af6be3bd/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:22:45 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:22:45 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:22:45 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Hypervisor/Node resource view: name=user free_ram=8957MB free_disk=25.167041778564453GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 22:22:45 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:22:45 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:22:45 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 40c79805-6e80-4c44-90ca-27a2af6be3bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 22:22:45 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 22:22:45 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 22:22:45 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 22:22:45 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 22:22:45 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Compute_service record updated for user:user {{(pid=74337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 22:22:45 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.158s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:22:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:22:47 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:22:48 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-ea8b5411-c4f8-4f2a-8c94-d90ad2a41481 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 40c79805-6e80-4c44-90ca-27a2af6be3bd is timed out.
Oct 23 22:22:48 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-ea8b5411-c4f8-4f2a-8c94-d90ad2a41481 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Successfully detached device vdb from instance 40c79805-6e80-4c44-90ca-27a2af6be3bd from the live domain config.
Oct 23 22:22:48 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea8b5411-c4f8-4f2a-8c94-d90ad2a41481 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] calling os-brick to detach iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 23 22:22:48 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8b5411-c4f8-4f2a-8c94-d90ad2a41481 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5ef4064100>, {'target_iqn': 'iqn.2010-10.org.openstack:5de933dd-5177-48e4-a7df-32e0ac272a68', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VTZdrHfL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 23 22:22:48 user nova-compute[74337]: WARNING os_brick.initiator.connectors.base [None req-ea8b5411-c4f8-4f2a-8c94-d90ad2a41481 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 23 22:22:48 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-ea8b5411-c4f8-4f2a-8c94-d90ad2a41481 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 23 22:22:48 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-ea8b5411-c4f8-4f2a-8c94-d90ad2a41481 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 23 22:22:48 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:22:48 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:22:48 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[e13b5a5a-c667-4892-935c-13e27843b2e8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5de933dd-5177-48e4-a7df-32e0ac272a68\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:22:48 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8b5411-c4f8-4f2a-8c94-d90ad2a41481 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 23 22:22:48 user nova-compute[74337]: No targets found.
Oct 23 22:22:48 user nova-compute[74337]: iSNS:
Oct 23 22:22:48 user nova-compute[74337]: No targets found.
Oct 23 22:22:48 user nova-compute[74337]: STATIC:
Oct 23 22:22:48 user nova-compute[74337]: Target: iqn.2010-10.org.openstack:5de933dd-5177-48e4-a7df-32e0ac272a68
Oct 23 22:22:48 user nova-compute[74337]:         Portal: 172.16.0.220:3260,-1
Oct 23 22:22:48 user nova-compute[74337]:                 Iface Name: default
Oct 23 22:22:48 user nova-compute[74337]: FIRMWARE:
Oct 23 22:22:48 user nova-compute[74337]: No targets found.
Oct 23 22:22:48 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 22:22:48 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8b5411-c4f8-4f2a-8c94-d90ad2a41481 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 23 22:22:48 user nova-compute[74337]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 23 22:22:48 user nova-compute[74337]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74337) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 23 22:22:48 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8b5411-c4f8-4f2a-8c94-d90ad2a41481 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5de933dd-5177-48e4-a7df-32e0ac272a68', 0)] {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 23 22:22:48 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:22:48 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:22:48 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b495dd-1f97-4983-952a-c42fe1da6f06]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5de933dd-5177-48e4-a7df-32e0ac272a68\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:22:48 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:22:48 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:22:48 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[32144712-7d72-4665-9ab3-3375c1cddb14]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de933dd-5177-48e4-a7df-32e0ac272a68 (non-flash)\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:22:48 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8b5411-c4f8-4f2a-8c94-d90ad2a41481 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de933dd-5177-48e4-a7df-32e0ac272a68 (non-flash)
Oct 23 22:22:48 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 23 22:22:48 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8b5411-c4f8-4f2a-8c94-d90ad2a41481 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de933dd-5177-48e4-a7df-32e0ac272a68 (non-flash)
Oct 23 22:22:48 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 23 22:22:48 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8b5411-c4f8-4f2a-8c94-d90ad2a41481 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5ef457f640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5de933dd-5177-48e4-a7df-32e0ac272a68'): ({'sdb'}, set())}) {{(pid=74337) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 23 22:22:48 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-ea8b5411-c4f8-4f2a-8c94-d90ad2a41481 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Removing single pathed devices sdb {{(pid=74337) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 23 22:22:48 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:22:48 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:22:48 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c6e9d9d-8e46-480c-9af5-1a9c42fd03f3]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:22:48 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:22:48 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:22:48 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e9322b9-70d3-4da7-887d-cd6e85c27db4]: (4, ('ok\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:22:48 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-ea8b5411-c4f8-4f2a-8c94-d90ad2a41481 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Flushing IO for device /dev/sdb {{(pid=74337) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 23 22:22:48 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:22:48 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:22:48 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f3a93b2-124b-4620-bd8f-df6d00bc44e0]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:22:48 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-ea8b5411-c4f8-4f2a-8c94-d90ad2a41481 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74337) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 23 22:22:48 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:22:48 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:22:48 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a1174bd-47f0-48c6-b439-d33c31099ac9]: (4, ('1', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:22:48 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-ea8b5411-c4f8-4f2a-8c94-d90ad2a41481 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 23 22:22:48 user nova-compute[74337]: DEBUG os_brick.initiator.linuxscsi [None req-ea8b5411-c4f8-4f2a-8c94-d90ad2a41481 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] SCSI volumes sdb have been removed. {{(pid=74337) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 23 22:22:48 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8b5411-c4f8-4f2a-8c94-d90ad2a41481 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5de933dd-5177-48e4-a7df-32e0ac272a68')] {{(pid=74337) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 23 22:22:48 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5de933dd-5177-48e4-a7df-32e0ac272a68 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:22:48 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5de933dd-5177-48e4-a7df-32e0ac272a68 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:22:48 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[34a8741e-72a6-427b-bf24-638248a66ece]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:22:48 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8b5411-c4f8-4f2a-8c94-d90ad2a41481 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:22:48 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5de933dd-5177-48e4-a7df-32e0ac272a68 -p 172.16.0.220:3260 --logout {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:22:48 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5de933dd-5177-48e4-a7df-32e0ac272a68 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:22:48 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[49b65bb5-2375-4834-b2bc-9894fb49506e]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:5de933dd-5177-48e4-a7df-32e0ac272a68, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:5de933dd-5177-48e4-a7df-32e0ac272a68, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:22:48 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8b5411-c4f8-4f2a-8c94-d90ad2a41481 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:5de933dd-5177-48e4-a7df-32e0ac272a68, portal: 172.16.0.220,3260]
Oct 23 22:22:48 user nova-compute[74337]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:5de933dd-5177-48e4-a7df-32e0ac272a68, portal: 172.16.0.220,3260] successful.
Oct 23 22:22:48 user nova-compute[74337]:  stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:22:48 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5de933dd-5177-48e4-a7df-32e0ac272a68 -p 172.16.0.220:3260 --op delete {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:22:48 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5de933dd-5177-48e4-a7df-32e0ac272a68 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85566) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:22:48 user nova-compute[74337]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc8186b-d5f9-49c3-9846-b92dd36bca20]: (4, ('', '')) {{(pid=85566) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 23 22:22:48 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8b5411-c4f8-4f2a-8c94-d90ad2a41481 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74337) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 23 22:22:48 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.base [None req-ea8b5411-c4f8-4f2a-8c94-d90ad2a41481 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.253s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 23 22:22:48 user nova-compute[74337]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8b5411-c4f8-4f2a-8c94-d90ad2a41481 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] <== disconnect_volume: return (254ms) None {{(pid=74337) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 23 22:22:48 user nova-compute[74337]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea8b5411-c4f8-4f2a-8c94-d90ad2a41481 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Disconnected iSCSI Volume {{(pid=74337) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 23 22:22:49 user nova-compute[74337]: DEBUG nova.objects.instance [None req-ea8b5411-c4f8-4f2a-8c94-d90ad2a41481 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Lazy-loading 'flavor' on Instance uuid 40c79805-6e80-4c44-90ca-27a2af6be3bd {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:22:49 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-ea8b5411-c4f8-4f2a-8c94-d90ad2a41481 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Lock "40c79805-6e80-4c44-90ca-27a2af6be3bd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.644s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:22:51 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:22:52 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:22:52 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Starting heal instance info cache {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 22:22:52 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Rebuilding the list of instances to heal {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 22:22:52 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "refresh_cache-40c79805-6e80-4c44-90ca-27a2af6be3bd" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 22:22:52 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquired lock "refresh_cache-40c79805-6e80-4c44-90ca-27a2af6be3bd" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 22:22:52 user nova-compute[74337]: DEBUG nova.network.neutron [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Forcefully refreshing network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 22:22:52 user nova-compute[74337]: DEBUG nova.objects.instance [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lazy-loading 'info_cache' on Instance uuid 40c79805-6e80-4c44-90ca-27a2af6be3bd {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:22:52 user nova-compute[74337]: DEBUG nova.network.neutron [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Updating instance_info_cache with network_info: [{"id": "c754233d-824c-40ec-bae1-c4ed5a90b392", "address": "fa:16:3e:28:38:e6", "network": {"id": "0110d432-0607-428c-b97f-68c5431cecea", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-718986578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "650cb403fcd142f485bd9b3fad1e0bd7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc754233d-82", "ovs_interfaceid": "c754233d-824c-40ec-bae1-c4ed5a90b392", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 22:22:52 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Releasing lock "refresh_cache-40c79805-6e80-4c44-90ca-27a2af6be3bd" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 22:22:52 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Updated the network info_cache for instance {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 22:22:56 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:23:01 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:23:01 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:23:01 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 22:23:01 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 22:23:01 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 22:23:01 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:23:06 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:23:11 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:23:16 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:23:21 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:23:26 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:23:31 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:23:31 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:23:31 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 22:23:31 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 22:23:31 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 22:23:31 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:23:36 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:23:38 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:23:39 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:23:39 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:23:39 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 22:23:40 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:23:41 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:23:41 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:23:41 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 22:23:41 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 22:23:41 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 22:23:41 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:23:42 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:23:44 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:23:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:23:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:23:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:23:44 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Auditing locally available compute resources for user (node: user) {{(pid=74337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 22:23:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c79805-6e80-4c44-90ca-27a2af6be3bd/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:23:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c79805-6e80-4c44-90ca-27a2af6be3bd/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:23:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c79805-6e80-4c44-90ca-27a2af6be3bd/disk --force-share --output=json {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 23 22:23:44 user nova-compute[74337]: DEBUG oslo_concurrency.processutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40c79805-6e80-4c44-90ca-27a2af6be3bd/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74337) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 23 22:23:45 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:23:45 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:23:45 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Hypervisor/Node resource view: name=user free_ram=8956MB free_disk=25.166210174560547GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 22:23:45 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:23:45 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:23:45 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Instance 40c79805-6e80-4c44-90ca-27a2af6be3bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74337) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 23 22:23:45 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 22:23:45 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 22:23:45 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 22:23:45 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 22:23:45 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Compute_service record updated for user:user {{(pid=74337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 22:23:45 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.190s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:23:46 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:23:46 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:23:46 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:23:51 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:23:53 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:23:53 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:23:53 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Starting heal instance info cache {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 22:23:53 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Rebuilding the list of instances to heal {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 22:23:53 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "refresh_cache-40c79805-6e80-4c44-90ca-27a2af6be3bd" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 23 22:23:53 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquired lock "refresh_cache-40c79805-6e80-4c44-90ca-27a2af6be3bd" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 23 22:23:53 user nova-compute[74337]: DEBUG nova.network.neutron [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Forcefully refreshing network info cache for instance {{(pid=74337) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 23 22:23:53 user nova-compute[74337]: DEBUG nova.objects.instance [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lazy-loading 'info_cache' on Instance uuid 40c79805-6e80-4c44-90ca-27a2af6be3bd {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:23:54 user nova-compute[74337]: DEBUG nova.network.neutron [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Updating instance_info_cache with network_info: [{"id": "c754233d-824c-40ec-bae1-c4ed5a90b392", "address": "fa:16:3e:28:38:e6", "network": {"id": "0110d432-0607-428c-b97f-68c5431cecea", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-718986578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "650cb403fcd142f485bd9b3fad1e0bd7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc754233d-82", "ovs_interfaceid": "c754233d-824c-40ec-bae1-c4ed5a90b392", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 22:23:54 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Releasing lock "refresh_cache-40c79805-6e80-4c44-90ca-27a2af6be3bd" {{(pid=74337) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 23 22:23:54 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Updated the network info_cache for instance {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 23 22:23:56 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:24:01 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:24:01 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:24:01 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 22:24:01 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 22:24:01 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 22:24:01 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:24:06 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:24:11 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:24:16 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:24:21 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:24:21 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:24:21 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 22:24:21 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 22:24:21 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 22:24:21 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:24:24 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4cac5510-80e4-4ba7-9bc5-7d5aa0a6cb80 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Acquiring lock "40c79805-6e80-4c44-90ca-27a2af6be3bd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:24:24 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4cac5510-80e4-4ba7-9bc5-7d5aa0a6cb80 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Lock "40c79805-6e80-4c44-90ca-27a2af6be3bd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:24:24 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4cac5510-80e4-4ba7-9bc5-7d5aa0a6cb80 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Acquiring lock "40c79805-6e80-4c44-90ca-27a2af6be3bd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:24:24 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4cac5510-80e4-4ba7-9bc5-7d5aa0a6cb80 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Lock "40c79805-6e80-4c44-90ca-27a2af6be3bd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:24:24 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4cac5510-80e4-4ba7-9bc5-7d5aa0a6cb80 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Lock "40c79805-6e80-4c44-90ca-27a2af6be3bd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:24:24 user nova-compute[74337]: INFO nova.compute.manager [None req-4cac5510-80e4-4ba7-9bc5-7d5aa0a6cb80 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Terminating instance
Oct 23 22:24:24 user nova-compute[74337]: DEBUG nova.compute.manager [None req-4cac5510-80e4-4ba7-9bc5-7d5aa0a6cb80 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Start destroying the instance on the hypervisor. {{(pid=74337) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 23 22:24:24 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:24:24 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:24:24 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:24:24 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:24:25 user nova-compute[74337]: DEBUG nova.compute.manager [req-c5a3f77c-7b65-4df6-b52c-dc10d587d1e6 req-fe00c5c5-1eb6-4f5b-844a-4b4fb82f3e5b service nova] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Received event network-vif-unplugged-c754233d-824c-40ec-bae1-c4ed5a90b392 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:24:25 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-c5a3f77c-7b65-4df6-b52c-dc10d587d1e6 req-fe00c5c5-1eb6-4f5b-844a-4b4fb82f3e5b service nova] Acquiring lock "40c79805-6e80-4c44-90ca-27a2af6be3bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:24:25 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-c5a3f77c-7b65-4df6-b52c-dc10d587d1e6 req-fe00c5c5-1eb6-4f5b-844a-4b4fb82f3e5b service nova] Lock "40c79805-6e80-4c44-90ca-27a2af6be3bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:24:25 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-c5a3f77c-7b65-4df6-b52c-dc10d587d1e6 req-fe00c5c5-1eb6-4f5b-844a-4b4fb82f3e5b service nova] Lock "40c79805-6e80-4c44-90ca-27a2af6be3bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:24:25 user nova-compute[74337]: DEBUG nova.compute.manager [req-c5a3f77c-7b65-4df6-b52c-dc10d587d1e6 req-fe00c5c5-1eb6-4f5b-844a-4b4fb82f3e5b service nova] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] No waiting events found dispatching network-vif-unplugged-c754233d-824c-40ec-bae1-c4ed5a90b392 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 22:24:25 user nova-compute[74337]: DEBUG nova.compute.manager [req-c5a3f77c-7b65-4df6-b52c-dc10d587d1e6 req-fe00c5c5-1eb6-4f5b-844a-4b4fb82f3e5b service nova] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Received event network-vif-unplugged-c754233d-824c-40ec-bae1-c4ed5a90b392 for instance with task_state deleting. {{(pid=74337) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 23 22:24:25 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:24:25 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:24:25 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:24:25 user nova-compute[74337]: INFO nova.virt.libvirt.driver [-] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Instance destroyed successfully.
Oct 23 22:24:25 user nova-compute[74337]: DEBUG nova.objects.instance [None req-4cac5510-80e4-4ba7-9bc5-7d5aa0a6cb80 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Lazy-loading 'resources' on Instance uuid 40c79805-6e80-4c44-90ca-27a2af6be3bd {{(pid=74337) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 23 22:24:25 user nova-compute[74337]: DEBUG nova.virt.libvirt.vif [None req-4cac5510-80e4-4ba7-9bc5-7d5aa0a6cb80 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-23T22:15:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1080142120',display_name='tempest-SnapshotDataIntegrityTests-server-1080142120',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1080142120',id=52,image_ref='d859d89d-998d-4109-b26a-0d6e28152932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD0ZJ66/SS0QXICHfTuUYGPEF1OyTOZ8zgWMFGkWENzxXlkyHD7iJZjOlCf4M5DKWR0W6PhAS88D+FzAsNS+5TRAhLnCeF2D3URL5PVZe1Ml4toSg0GHyLrkFxpXwlhxnQ==',key_name='tempest-keypair-81986919',keypairs=<?>,launch_index=0,launched_at=2023-10-23T22:15:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='650cb403fcd142f485bd9b3fad1e0bd7',ramdisk_id='',reservation_id='r-tnxyd5kp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d859d89d-998d-4109-b26a-0d6e28152932',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1345308748',owner_user_name='tempest-SnapshotDataIntegrityTests-1345308748-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-23T22:15:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fca6fd7d79d64b6085bfccaaff8a1dc4',uuid=40c79805-6e80-4c44-90ca-27a2af6be3bd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c754233d-824c-40ec-bae1-c4ed5a90b392", "address": "fa:16:3e:28:38:e6", "network": {"id": "0110d432-0607-428c-b97f-68c5431cecea", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-718986578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "650cb403fcd142f485bd9b3fad1e0bd7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc754233d-82", "ovs_interfaceid": "c754233d-824c-40ec-bae1-c4ed5a90b392", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 23 22:24:25 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-4cac5510-80e4-4ba7-9bc5-7d5aa0a6cb80 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Converting VIF {"id": "c754233d-824c-40ec-bae1-c4ed5a90b392", "address": "fa:16:3e:28:38:e6", "network": {"id": "0110d432-0607-428c-b97f-68c5431cecea", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-718986578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "650cb403fcd142f485bd9b3fad1e0bd7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc754233d-82", "ovs_interfaceid": "c754233d-824c-40ec-bae1-c4ed5a90b392", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 23 22:24:25 user nova-compute[74337]: DEBUG nova.network.os_vif_util [None req-4cac5510-80e4-4ba7-9bc5-7d5aa0a6cb80 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:28:38:e6,bridge_name='br-int',has_traffic_filtering=True,id=c754233d-824c-40ec-bae1-c4ed5a90b392,network=Network(0110d432-0607-428c-b97f-68c5431cecea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc754233d-82') {{(pid=74337) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 23 22:24:25 user nova-compute[74337]: DEBUG os_vif [None req-4cac5510-80e4-4ba7-9bc5-7d5aa0a6cb80 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:38:e6,bridge_name='br-int',has_traffic_filtering=True,id=c754233d-824c-40ec-bae1-c4ed5a90b392,network=Network(0110d432-0607-428c-b97f-68c5431cecea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc754233d-82') {{(pid=74337) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 23 22:24:25 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:24:25 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc754233d-82, bridge=br-int, if_exists=True) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:24:25 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:24:25 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:24:25 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:24:25 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=05f67b07-3078-4a7c-b616-8d96a8420bb0) {{(pid=74337) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 23 22:24:25 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:24:25 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:24:25 user nova-compute[74337]: INFO os_vif [None req-4cac5510-80e4-4ba7-9bc5-7d5aa0a6cb80 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:38:e6,bridge_name='br-int',has_traffic_filtering=True,id=c754233d-824c-40ec-bae1-c4ed5a90b392,network=Network(0110d432-0607-428c-b97f-68c5431cecea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc754233d-82')
Oct 23 22:24:25 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-4cac5510-80e4-4ba7-9bc5-7d5aa0a6cb80 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Deleting instance files /opt/stack/data/nova/instances/40c79805-6e80-4c44-90ca-27a2af6be3bd_del
Oct 23 22:24:25 user nova-compute[74337]: INFO nova.virt.libvirt.driver [None req-4cac5510-80e4-4ba7-9bc5-7d5aa0a6cb80 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Deletion of /opt/stack/data/nova/instances/40c79805-6e80-4c44-90ca-27a2af6be3bd_del complete
Oct 23 22:24:25 user nova-compute[74337]: INFO nova.compute.manager [None req-4cac5510-80e4-4ba7-9bc5-7d5aa0a6cb80 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Took 0.86 seconds to destroy the instance on the hypervisor.
Oct 23 22:24:25 user nova-compute[74337]: DEBUG oslo.service.loopingcall [None req-4cac5510-80e4-4ba7-9bc5-7d5aa0a6cb80 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74337) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 23 22:24:25 user nova-compute[74337]: DEBUG nova.compute.manager [-] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Deallocating network for instance {{(pid=74337) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 23 22:24:25 user nova-compute[74337]: DEBUG nova.network.neutron [-] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] deallocate_for_instance() {{(pid=74337) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 23 22:24:26 user nova-compute[74337]: DEBUG nova.network.neutron [-] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Updating instance_info_cache with network_info: [] {{(pid=74337) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 23 22:24:26 user nova-compute[74337]: INFO nova.compute.manager [-] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Took 0.92 seconds to deallocate network for instance.
Oct 23 22:24:26 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4cac5510-80e4-4ba7-9bc5-7d5aa0a6cb80 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:24:26 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4cac5510-80e4-4ba7-9bc5-7d5aa0a6cb80 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:24:26 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-4cac5510-80e4-4ba7-9bc5-7d5aa0a6cb80 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 22:24:26 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-4cac5510-80e4-4ba7-9bc5-7d5aa0a6cb80 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 22:24:26 user nova-compute[74337]: DEBUG nova.compute.manager [req-abbd15cd-9a75-43f8-a123-d5b964cd9576 req-d7d9ca85-cf90-40f7-a668-230863b99ea2 service nova] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Received event network-vif-deleted-c754233d-824c-40ec-bae1-c4ed5a90b392 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:24:26 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4cac5510-80e4-4ba7-9bc5-7d5aa0a6cb80 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.112s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:24:26 user nova-compute[74337]: INFO nova.scheduler.client.report [None req-4cac5510-80e4-4ba7-9bc5-7d5aa0a6cb80 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Deleted allocations for instance 40c79805-6e80-4c44-90ca-27a2af6be3bd
Oct 23 22:24:26 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-4cac5510-80e4-4ba7-9bc5-7d5aa0a6cb80 tempest-SnapshotDataIntegrityTests-1345308748 tempest-SnapshotDataIntegrityTests-1345308748-project-member] Lock "40c79805-6e80-4c44-90ca-27a2af6be3bd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.083s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:24:27 user nova-compute[74337]: DEBUG nova.compute.manager [req-3862dc29-31bf-4880-9b83-ed973551468e req-f299da32-db69-451e-8973-bf755aa80842 service nova] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Received event network-vif-plugged-c754233d-824c-40ec-bae1-c4ed5a90b392 {{(pid=74337) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 23 22:24:27 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-3862dc29-31bf-4880-9b83-ed973551468e req-f299da32-db69-451e-8973-bf755aa80842 service nova] Acquiring lock "40c79805-6e80-4c44-90ca-27a2af6be3bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:24:27 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-3862dc29-31bf-4880-9b83-ed973551468e req-f299da32-db69-451e-8973-bf755aa80842 service nova] Lock "40c79805-6e80-4c44-90ca-27a2af6be3bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:24:27 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [req-3862dc29-31bf-4880-9b83-ed973551468e req-f299da32-db69-451e-8973-bf755aa80842 service nova] Lock "40c79805-6e80-4c44-90ca-27a2af6be3bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:24:27 user nova-compute[74337]: DEBUG nova.compute.manager [req-3862dc29-31bf-4880-9b83-ed973551468e req-f299da32-db69-451e-8973-bf755aa80842 service nova] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] No waiting events found dispatching network-vif-plugged-c754233d-824c-40ec-bae1-c4ed5a90b392 {{(pid=74337) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 23 22:24:27 user nova-compute[74337]: WARNING nova.compute.manager [req-3862dc29-31bf-4880-9b83-ed973551468e req-f299da32-db69-451e-8973-bf755aa80842 service nova] [instance: 40c79805-6e80-4c44-90ca-27a2af6be3bd] Received unexpected event network-vif-plugged-c754233d-824c-40ec-bae1-c4ed5a90b392 for instance with vm_state deleted and task_state None.
Oct 23 22:24:30 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:24:35 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:24:35 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:24:35 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 22:24:35 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 22:24:35 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 22:24:35 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:24:39 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:24:40 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:24:40 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:24:41 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:24:41 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 22:24:42 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:24:42 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:24:42 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:24:44 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:24:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:24:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:24:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:24:44 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Auditing locally available compute resources for user (node: user) {{(pid=74337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 22:24:44 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:24:44 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:24:44 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Hypervisor/Node resource view: name=user free_ram=9107MB free_disk=25.193405151367188GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 22:24:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:24:44 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:24:45 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 22:24:45 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 22:24:45 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 22:24:45 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 22:24:45 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Compute_service record updated for user:user {{(pid=74337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 22:24:45 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.261s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:24:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:24:46 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:24:46 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:24:50 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:24:50 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:24:50 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 22:24:50 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 22:24:50 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 22:24:50 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:24:53 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:24:53 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Starting heal instance info cache {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 23 22:24:53 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Rebuilding the list of instances to heal {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 23 22:24:53 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Didn't find any instances for network info cache update. {{(pid=74337) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 23 22:24:55 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:24:55 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:24:55 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74337) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 23 22:24:55 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 22:24:55 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74337) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 23 22:24:55 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:25:00 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:25:05 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 23 22:25:10 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:25:12 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:25:12 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Cleaning up deleted instances {{(pid=74337) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 23 22:25:12 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] There are 0 instances to clean {{(pid=74337) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 23 22:25:15 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:25:15 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:25:18 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:25:20 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:25:21 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:25:23 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:25:23 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74337) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 23 22:25:25 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:25:30 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:25:35 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:25:40 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:25:40 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:25:41 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:25:41 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:25:41 user nova-compute[74337]: DEBUG nova.compute.manager [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74337) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 23 22:25:44 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:25:44 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:25:45 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:25:45 user nova-compute[74337]: DEBUG oslo_service.periodic_task [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74337) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 23 22:25:45 user nova-compute[74337]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74337) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 23 22:25:45 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:25:45 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:25:45 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 23 22:25:45 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Auditing locally available compute resources for user (node: user) {{(pid=74337) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 23 22:25:45 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:25:45 user nova-compute[74337]: WARNING nova.virt.libvirt.driver [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 23 22:25:45 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Hypervisor/Node resource view: name=user free_ram=9232MB free_disk=25.140098571777344GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74337) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 23 22:25:45 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 23 22:25:45 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 23 22:25:45 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 23 22:25:45 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74337) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 23 22:25:45 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Refreshing inventories for resource provider dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 23 22:25:45 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Updating ProviderTree inventory for provider dfcf3942-a432-4293-945b-14b86f57d794 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 23 22:25:45 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Updating inventory in ProviderTree for provider dfcf3942-a432-4293-945b-14b86f57d794 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 23 22:25:45 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Refreshing aggregate associations for resource provider dfcf3942-a432-4293-945b-14b86f57d794, aggregates: None {{(pid=74337) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 23 22:25:46 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Refreshing trait associations for resource provider dfcf3942-a432-4293-945b-14b86f57d794, traits: COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE2,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE42,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_EXTEND,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_TRUSTED_CERTS {{(pid=74337) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 23 22:25:46 user nova-compute[74337]: DEBUG nova.compute.provider_tree [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed in ProviderTree for provider: dfcf3942-a432-4293-945b-14b86f57d794 {{(pid=74337) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 23 22:25:46 user nova-compute[74337]: DEBUG nova.scheduler.client.report [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Inventory has not changed for provider dfcf3942-a432-4293-945b-14b86f57d794 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74337) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 23 22:25:46 user nova-compute[74337]: DEBUG nova.compute.resource_tracker [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Compute_service record updated for user:user {{(pid=74337) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 23 22:25:46 user nova-compute[74337]: DEBUG oslo_concurrency.lockutils [None req-699b3655-3613-41e1-a796-b3e05ca69871 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.209s {{(pid=74337) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}